Home Discord Chat
Go Back   ChiefsPlanet > Nzoner's Game Room

Reply
 
Thread Tools Display Modes
Old 01-07-2013, 08:27 PM  
hometeam hometeam is offline
Supporter
 
hometeam's Avatar
 
Join Date: Jul 2011
Casino cash: $4381956
Draft "experts" , Do they know a damn thing?

http://harvardsportsanalysis.wordpre...raft-rankings/

Quote:

Equally Inaccurate: An Analysis of Mel Kiper Jr. and Todd McShay’s Draft Rankings
Posted on May 25, 2012 by harvardsportsanalysis
By Kevin Meers and Scott Sherman

Conan vs. Leno. Jack Shephard vs. John Locke. Seinfeld vs. Newman. Over the years, hundreds of great rivalries have come to dominate our television screens. But to sports fans, none of those individual competitions are quite as captivating as the one between ESPN’s two draft gurus: Mel Kiper Jr. and Todd McShay.

There are many iconic hairstyles in the National Football League. Brett Keisel’s lumberjack beard. Troy Polamalu’s bodacious curls. Clay Matthews’ scintillating golden locks. But among the most distinct looks is that of Kiper, whose hair, glasses, and those squinted eyes are one of the signature images of the NFL draft. Every year, he and his fellow heavyweight, the former University of Richmond waterboy McShay, slug it out on millions of television screens in the months leading up to the draft a dramatic attempt to display their expertise. But which of these two titans is a better judge of talent? This post sought to answer that question.


To compare the success rates of the two gurus, we collected the rankings of the Top 25 players in each year’s draft from 2006 (when McShay joined ESPN) through 2010. Kiper’s rankings were determined by his final “Big Board” before each year’s draft, while McShay’s were determined via Scouts Inc.’s final Top 25 (McShay runs Scouts Inc.). We then compared each player’s ranking to their actual performance ranking in their draft class (performance here is approximated by Career Approximate Value). As an example, Kiper ranked Julius Peppers as the best player in the 2002 NFL Draft, and that prediction proved to be dead on, as 10 years later Peppers has the highest CAV of any player from the ’02 draft. While we would have preferred to use the ranks of all players drafted, Kiper only releases his top 25 prospects on his “Big Board,” which severely limited sample size. Nonetheless, here’s what we found:




As the chart above shows, Kiper and McShay have proven to be equally inefficient judges of talent over the past five years. Neither expert’s rankings were a particularly good predictor of how a player would perform compared to the rest of his class. In fact, the average errors listed above suggest that the gurus’ rankings are off by around 35 spots when compared to the player’s actual performance. In other words, a player Kiper or McShay ranked as the 15th-best player in the draft is most likely to actually have been the 40th-best based on CAV to this point in their careers. The root mean square errors (RMSE) imply that Kiper is very slightly less prone to extreme errors than his ESPN counterpart, but that difference is not significant. RMSE severely punishes large errors, so having a comparatively lower RMSE implies that one makes fewer huge errors. However, like the average errors, the RMSE for each scout is enormous.

Indeed, when looking at the lists themselves, it is clear that both Kiper and McShay have, like all draft experts, been prone to extreme hits and misses when compared to the other. In 2006, both had future busts Matt Leinart, A.J. Hawk, Vince Young, and Michael Huff ranked in their Top 10s. But McShay was wise enough to include future All-Pro center Nick Mangold in his Top 25, while Kiper instead opted for Jason Allen. The following year, McShay found more success by ranking Darrelle Revis tenth overall, but the Island himself was nowhere to be found on Kiper’s Big Board. Also that year, both Kiper and McShay smartly pegged Calvin Johnson, Adrian Peterson, and Joe Thomas as three of the four top players in the draft, but both also had JaMarcus Russell and Brady Quinn in their top sevens.

In 2008, Kiper wisely ranked future bust Derrick Harvey 23rd—McShay had him 11th—but Kiper had fellow pass-rushing disaster Vernon Gholston 7th, compared to 15th for McShay. In 2009, both had the bust triumvirate of Aaron Curry, Michael Crabtree, and Jason Smith in their top four, but Kiper pegged Matthew Stafford at No. 3 while McShay had him at No. 7. McShay, however, wisely had both Clay Matthews and Hakeem Nicks in his Top 25, while Kiper had neither (but did, unlike McShay, include Percy Harvin). Finally, in 2010, Kiper, unlike McShay, smartly deemed Ndamukong Suh a better prospect than Gerald McCoy, but that success was immediately negated by his ranking of Jimmy Clausen at No. 4 overall (McShay, to his credit, did not feel Clausen was a top 25 talent).

Clearly, then, both “experts” have been both on-point and wildly off-base with their draft predictions over the past few years. On the whole, neither’s rankings are very accurate. If a player is listed in the Top 25 by either scout, that players will, on average, be in the top forty or sixty players from their draft class, but he is absolutely not guaranteed to be one of the very best players from his year. Furthermore, none of the differences between the average errors of Kiper and McShay are statistically significant: the differences between them are likely more due to luck than actual skill. In other words, you could take Kiper’s “Big Board” or McShay’s Top 25 and ask any random person to put them in any random order, and on average, that person’s rankings will be about as accurate as predicting future NFL success than any of ESPN’s two experts.

Of course, this study was limited by its sample size, as we’d have a fair better chance of really determining who was more accurate if Kiper and McShay both ranked every player in the draft (which only Scouts Inc. does; Kiper merely publishes his Top 25). But the nearly-equal numbers in the table above suggest there is not much of a difference between either’s ability to form an accurate Top 25. Of course, predicting NFL success—as it is in any sport—is extremely difficult, and it’s certainly possible that Kiper and McShay are statistically more accurate than any of the dozens of other websites that publish draft rankings each year. Since player rankings tend to be generally similar, it’s likely all such sites would be prone to a number of mistakes. But to determine whether such errors were as significant as those made by Kiper and McShay, future research should compare ESPN’s two gurus success rate to that of their lesser-known counterparts around the web. Until then, the best we can say is that neither Kiper or McShay is extraordinarily good at what they are paid to do, or even better than the other at doing it.
This article specifically targets McShay and Kiper, but it got me thinking about whether any so called draft experts knew shit about anything. Do they know more than me and you?

Are there any other examples or data on whether any draft expert or non-expert actually gets it right consistently?

So picking a QB who is 'ranked' at X spot in the first round, but not 1st if he is the best guy out there is stupid based on what? Mel Kipers big board? Get real. Nobody knows shit!










Geno for president
Posts: 10,635
hometeam is obviously part of the inner Circle.hometeam is obviously part of the inner Circle.hometeam is obviously part of the inner Circle.hometeam is obviously part of the inner Circle.hometeam is obviously part of the inner Circle.hometeam is obviously part of the inner Circle.hometeam is obviously part of the inner Circle.hometeam is obviously part of the inner Circle.hometeam is obviously part of the inner Circle.hometeam is obviously part of the inner Circle.hometeam is obviously part of the inner Circle.
    Reply With Quote
Old 01-08-2013, 11:37 AM   #46
philfree philfree is offline
Indian Twitter
 
philfree's Avatar
 

Join Date: Nov 2000
Location: Free Agency
Casino cash: $2036198
That's interesting stuff but can it be used to judge the production of each GM/team in the draft? Saying Kiper and McShay suck is fine but how do they compare to the actual guys making the picks?
__________________
[/SIGPIC]
Posts: 14,875
philfree has an IQ even higher than Frankie's.philfree has an IQ even higher than Frankie's.philfree has an IQ even higher than Frankie's.philfree has an IQ even higher than Frankie's.philfree has an IQ even higher than Frankie's.philfree has an IQ even higher than Frankie's.philfree has an IQ even higher than Frankie's.philfree has an IQ even higher than Frankie's.philfree has an IQ even higher than Frankie's.philfree has an IQ even higher than Frankie's.philfree has an IQ even higher than Frankie's.
    Reply With Quote
Old 01-08-2013, 11:58 AM   #47
htismaqe htismaqe is offline
'Tis my eye!
 
htismaqe's Avatar
 

Join Date: Aug 2000
Location: Chiefsplanet
Casino cash: $10269900
Quote:
Originally Posted by duncan_idaho View Post
I used to edit Russ Lande
How ****ing hard was that?

How many times did you tell him he was a ****ing idiot?
Posts: 100,022
htismaqe is obviously part of the inner Circle.htismaqe is obviously part of the inner Circle.htismaqe is obviously part of the inner Circle.htismaqe is obviously part of the inner Circle.htismaqe is obviously part of the inner Circle.htismaqe is obviously part of the inner Circle.htismaqe is obviously part of the inner Circle.htismaqe is obviously part of the inner Circle.htismaqe is obviously part of the inner Circle.htismaqe is obviously part of the inner Circle.htismaqe is obviously part of the inner Circle.
    Reply With Quote
Old 01-08-2013, 12:03 PM   #48
duncan_idaho duncan_idaho is offline
M-I-Z-Z-O-U
 
duncan_idaho's Avatar
 

Join Date: Apr 2001
Location: Kansas City
Casino cash: $2150308
Quote:
Originally Posted by htismaqe View Post
How ****ing hard was that?

How many times did you tell him he was a ****ing idiot?
It was almost as bad as trying to keep a website up-to-date on AP stories and write-throughs during the NCAA basketball tournament. Almost.

I actually liked reading the scouting stuff (it wasn't all from Lande). I learned a lot from that (and was fortunate enough to have a couple of the guys willing to answer questions, watch tape with me and give me pointers, etc.)

Russ is an old-school NFL guy. That's why he always rates guys on either line so highly. It's also why he LOVES QBs who look like Mike Glennon (and I don't mean goofy - I mean tall, cement-footed pocket passers).

If I can find his original write-up of Drew Bledsoe, I'll post it on here. I wasn't working there when he did it in 94, but it was still getting passed around 10 years later...
__________________
"You gotta love livin', cause dying is a pain in the ass."
---- Sinatra
Posts: 20,928
duncan_idaho is obviously part of the inner Circle.duncan_idaho is obviously part of the inner Circle.duncan_idaho is obviously part of the inner Circle.duncan_idaho is obviously part of the inner Circle.duncan_idaho is obviously part of the inner Circle.duncan_idaho is obviously part of the inner Circle.duncan_idaho is obviously part of the inner Circle.duncan_idaho is obviously part of the inner Circle.duncan_idaho is obviously part of the inner Circle.duncan_idaho is obviously part of the inner Circle.duncan_idaho is obviously part of the inner Circle.
    Reply With Quote
Old 01-08-2013, 12:23 PM   #49
htismaqe htismaqe is offline
'Tis my eye!
 
htismaqe's Avatar
 

Join Date: Aug 2000
Location: Chiefsplanet
Casino cash: $10269900
Quote:
Originally Posted by duncan_idaho View Post
It was almost as bad as trying to keep a website up-to-date on AP stories and write-throughs during the NCAA basketball tournament. Almost.

I actually liked reading the scouting stuff (it wasn't all from Lande). I learned a lot from that (and was fortunate enough to have a couple of the guys willing to answer questions, watch tape with me and give me pointers, etc.)

Russ is an old-school NFL guy. That's why he always rates guys on either line so highly. It's also why he LOVES QBs who look like Mike Glennon (and I don't mean goofy - I mean tall, cement-footed pocket passers).

If I can find his original write-up of Drew Bledsoe, I'll post it on here. I wasn't working there when he did it in 94, but it was still getting passed around 10 years later...


That's awesome.
Posts: 100,022
htismaqe is obviously part of the inner Circle.htismaqe is obviously part of the inner Circle.htismaqe is obviously part of the inner Circle.htismaqe is obviously part of the inner Circle.htismaqe is obviously part of the inner Circle.htismaqe is obviously part of the inner Circle.htismaqe is obviously part of the inner Circle.htismaqe is obviously part of the inner Circle.htismaqe is obviously part of the inner Circle.htismaqe is obviously part of the inner Circle.htismaqe is obviously part of the inner Circle.
    Reply With Quote
Old 01-08-2013, 01:48 PM   #50
whoman69 whoman69 is offline
The Master
 
whoman69's Avatar
 

Join Date: Sep 2002
Location: Marion, IA
Casino cash: $10004925
I don't think the argument against them is totally fair, as accurate as it may be. Kiper tries to post himself as some great judge of talent. All their either of them really do is to try to guess where these players should be drafted. Kiper is more a self promoter who got himself a gig at a fledgling ESPN when they started covering the draft because he was the only draft wonk out there at the time.
__________________
-Watching Eddie Podolak
Quote:
Originally posted by Logical
When the boobs are a bouncin, the Chiefs will be trouncin
What the Raiders fan has said is true, our customs are different. What Al Davis has said is unimportant, and we do not hear his words.
Posts: 23,101
whoman69 is blessed with 50/50 Hindsight.whoman69 is blessed with 50/50 Hindsight.whoman69 is blessed with 50/50 Hindsight.whoman69 is blessed with 50/50 Hindsight.whoman69 is blessed with 50/50 Hindsight.whoman69 is blessed with 50/50 Hindsight.whoman69 is blessed with 50/50 Hindsight.whoman69 is blessed with 50/50 Hindsight.whoman69 is blessed with 50/50 Hindsight.whoman69 is blessed with 50/50 Hindsight.whoman69 is blessed with 50/50 Hindsight.
    Reply With Quote
Old 01-08-2013, 01:54 PM   #51
DaneMcCloud DaneMcCloud is offline
Supporter
 
DaneMcCloud's Avatar
 

Join Date: Sep 2000
Location: Hollywood, CA
Casino cash: $10053648
Quote:
Originally Posted by whoman69 View Post
All their either of them really do is to try to guess where these players should be drafted.
And that's the most difficult part because teams often change their boards up until the last minute.

It's not like they routinely predict that fifth rounders will be first rounders or vice versa.

The thing that most hurts guys like Mayock, Kiper, etc. is that they don't have the same access to the players as the actual teams themselves, i.e., independent psych exams, medical info, aren't in the room during the interview process, etc.
Posts: 88,960
DaneMcCloud is obviously part of the inner Circle.DaneMcCloud is obviously part of the inner Circle.DaneMcCloud is obviously part of the inner Circle.DaneMcCloud is obviously part of the inner Circle.DaneMcCloud is obviously part of the inner Circle.DaneMcCloud is obviously part of the inner Circle.DaneMcCloud is obviously part of the inner Circle.DaneMcCloud is obviously part of the inner Circle.DaneMcCloud is obviously part of the inner Circle.DaneMcCloud is obviously part of the inner Circle.DaneMcCloud is obviously part of the inner Circle.
    Reply With Quote
Old 01-08-2013, 01:56 PM   #52
Molitoth Molitoth is offline
Mahomes Fanboi
 
Molitoth's Avatar
 

Join Date: Apr 2004
Casino cash: $3314969
Anyone who believes these guys should look at the hype Blaine Gabbert got and just laugh it off.

Blaine Gabbert was so incredibly over hyped. This is exactly what's happening with Mike Glennon.
Posts: 19,447
Molitoth is obviously part of the inner Circle.Molitoth is obviously part of the inner Circle.Molitoth is obviously part of the inner Circle.Molitoth is obviously part of the inner Circle.Molitoth is obviously part of the inner Circle.Molitoth is obviously part of the inner Circle.Molitoth is obviously part of the inner Circle.Molitoth is obviously part of the inner Circle.Molitoth is obviously part of the inner Circle.Molitoth is obviously part of the inner Circle.Molitoth is obviously part of the inner Circle.
    Reply With Quote
Old 01-08-2013, 05:20 PM   #53
scho63 scho63 is offline
Politically Incorrect
 
scho63's Avatar
 

Join Date: Feb 2009
Location: Scottsdale, AZ
Casino cash: $3171110
This is a little outdated, year old, but it shows how many "can't miss" players selected in the first round tanked....

http://bleacherreport.com/articles/9...history/page/1
__________________
"The only difference between sex for free and sex for money is that sex for free costs you a WHOLE LOT more!" ~Redd Foxx~


2018 2019 2020 20212022 2023 2024 Adopt a Chief - Clark Hunt and Brett Veach
"The men who drafted Patrick Mahomes"


Posts: 49,957
scho63 is obviously part of the inner Circle.scho63 is obviously part of the inner Circle.scho63 is obviously part of the inner Circle.scho63 is obviously part of the inner Circle.scho63 is obviously part of the inner Circle.scho63 is obviously part of the inner Circle.scho63 is obviously part of the inner Circle.scho63 is obviously part of the inner Circle.scho63 is obviously part of the inner Circle.scho63 is obviously part of the inner Circle.scho63 is obviously part of the inner Circle.
    Reply With Quote
Old 01-08-2013, 05:33 PM   #54
TribalElder TribalElder is offline
Arrowhead Trail of Tears
 
TribalElder's Avatar
 

Join Date: Oct 2012
Location: KansasCity
Casino cash: $2780441
I enjoy some of mayocks info especially his mock draft
Posts: 29,076
TribalElder is obviously part of the inner Circle.TribalElder is obviously part of the inner Circle.TribalElder is obviously part of the inner Circle.TribalElder is obviously part of the inner Circle.TribalElder is obviously part of the inner Circle.TribalElder is obviously part of the inner Circle.TribalElder is obviously part of the inner Circle.TribalElder is obviously part of the inner Circle.TribalElder is obviously part of the inner Circle.TribalElder is obviously part of the inner Circle.TribalElder is obviously part of the inner Circle.
    Reply With Quote
Old 01-08-2013, 06:20 PM   #55
BlackHelicopters BlackHelicopters is offline
Spiraling down the Drain
 
BlackHelicopters's Avatar
 

Join Date: Oct 2012
Location: Dante's Ninth Circle
Casino cash: $3110588
Mel Kiper has nice hair.
__________________
"We're both part of the same hypocrisy, Senator, but never think it applies to my family."


"Fredo. You are my brother, and I love you. But never take sides against the Family again. Ever."
2019 Adopt a Chief - Travis Kelce #87
Posts: 31,594
BlackHelicopters is obviously part of the inner Circle.BlackHelicopters is obviously part of the inner Circle.BlackHelicopters is obviously part of the inner Circle.BlackHelicopters is obviously part of the inner Circle.BlackHelicopters is obviously part of the inner Circle.BlackHelicopters is obviously part of the inner Circle.BlackHelicopters is obviously part of the inner Circle.BlackHelicopters is obviously part of the inner Circle.BlackHelicopters is obviously part of the inner Circle.BlackHelicopters is obviously part of the inner Circle.BlackHelicopters is obviously part of the inner Circle.
    Reply With Quote
Old 01-08-2013, 06:31 PM   #56
bevischief bevischief is offline
....
 
bevischief's Avatar
 

Join Date: Apr 2009
Location: Somewhere Kansas
Casino cash: $8659352
VARSITY
I only listen to the ones on here.
Posts: 27,731
bevischief is obviously part of the inner Circle.bevischief is obviously part of the inner Circle.bevischief is obviously part of the inner Circle.bevischief is obviously part of the inner Circle.bevischief is obviously part of the inner Circle.bevischief is obviously part of the inner Circle.bevischief is obviously part of the inner Circle.bevischief is obviously part of the inner Circle.bevischief is obviously part of the inner Circle.bevischief is obviously part of the inner Circle.bevischief is obviously part of the inner Circle.
    Reply With Quote
Old 01-08-2013, 07:16 PM   #57
hometeam hometeam is offline
Supporter
 
hometeam's Avatar
 

Join Date: Jul 2011
Casino cash: $4381956
Quote:
Originally Posted by whoman69 View Post
I don't think the argument against them is totally fair, as accurate as it may be. Kiper tries to post himself as some great judge of talent. All their either of them really do is to try to guess where these players should be drafted. Kiper is more a self promoter who got himself a gig at a fledgling ESPN when they started covering the draft because he was the only draft wonk out there at the time.
I'm not sure why. They tell people, and enjoy other people telling them, that they are draft experts.

Sooooo Kiper can suck it.

I would still like to see evidence of someone having a consistently high percentage of hits.
Posts: 10,635
hometeam is obviously part of the inner Circle.hometeam is obviously part of the inner Circle.hometeam is obviously part of the inner Circle.hometeam is obviously part of the inner Circle.hometeam is obviously part of the inner Circle.hometeam is obviously part of the inner Circle.hometeam is obviously part of the inner Circle.hometeam is obviously part of the inner Circle.hometeam is obviously part of the inner Circle.hometeam is obviously part of the inner Circle.hometeam is obviously part of the inner Circle.
    Reply With Quote
Old 01-08-2013, 07:24 PM   #58
chop chop is offline
Go Chiefs!
 
chop's Avatar
 

Join Date: Oct 2000
Location: Michigan
Casino cash: $3174270
Quote:
Originally Posted by patteeu View Post
I don't see that. He's got Geno Smith going to the Chiefs if Brandon Albert is retained. But he says "Luke Joeckel has to be the pick" if Albert leaves.

Edit: It looks like that site has 4 different guys doing mocks. The one duncan_idaho mentioned has the Chiefs taking Geno. So do two of the others. The fourth guy has the Chiefs taking Matt Barkley.
My mistake, I looked at another article written by another person.

NEPD Staff Writer: Dan Hope
The first 24 picks in the NFL draft order are now set following the first round of the NFL playoffs, and with only one game remaining in bowl season as of Monday, the draft stocks of many prospects are much closer to set as well. As a result, we are in much better position than even one week ago to begin projecting who the top picks in the 2013 NFL draft will be.
The following mock draft includes projections for each pick in the first two rounds, with many new selections including a big change at the top of the draft.
Note: Underclassmen who have announced their intentions to declare for the draft and those who have not yet committed to returning to school as of Sunday are included.
Selections 25-32 are not yet set, and are based on playoff results projections.
1. Kansas City Chiefs: Tyler Wilson, QB, Arkansas
In Andy Reid’s first draft with the Philadelphia Eagles in 1999, they selected Donovan McNabb with the No. 2 overall pick. Reid is now the Kansas City Chiefs’ head coach, and unless the Chiefs pursue a veteran quarterback via trade or free agency, his new team will likely take the same strategy in finding their next signal-caller.
Geno Smith is considered by most as the top quarterback in this class, but his stock could be about to fall, due to some serious flaws were exposed in his game over the second half of his senior season. While this class lacks an elite quarterback, the best choice as a No. 1 overall pick would be Arkansas’ Tyler Wilson, who is the most sound all-around downfield pocket passer in the class.
Wilson has the tools to be a very solid starting quarterback at the next level, and looks like the best choice for a new Kansas City regime that must upgrade over Matt Cassel and Brady Quinn under center.
__________________
Never be satisfied with what you achieve, because it all pales in comparison with what you are capable of doing in the future.
Posts: 2,938
chop must have mowed badgirl's lawn.chop must have mowed badgirl's lawn.chop must have mowed badgirl's lawn.chop must have mowed badgirl's lawn.chop must have mowed badgirl's lawn.chop must have mowed badgirl's lawn.chop must have mowed badgirl's lawn.chop must have mowed badgirl's lawn.chop must have mowed badgirl's lawn.chop must have mowed badgirl's lawn.chop must have mowed badgirl's lawn.
    Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is On

Forum Jump




All times are GMT -6. The time now is 04:55 AM.


This is a test for a client's site.
Fort Worth Texas Process Servers
Covering Arlington, Fort Worth, Grand Prairie and surrounding communities.
Tarrant County, Texas and Johnson County, Texas.
Powered by vBulletin® Version 3.8.8
Copyright ©2000 - 2024, vBulletin Solutions, Inc.