Introducing an Updated Method for Prospect Valuation

Seven years ago, Craig Edwards published a landmark study on prospect valuation. Craig’s work built on previous studies by Victor Wang, Scott McKinney, Kevin Creagh, Steve DiMiceli, and our own Jeff Zimmerman, as well as a few prior ad hoc attempts here at FanGraphs; subsequent work on the subject was done by the team at Driveline Baseball. These studies have been hugely important both for FanGraphs’ own evaluation of prospects — among other things, Craig’s work has helped to feed the Farm System Rankings over on The Board — and for the broader public study of the minor leagues.
The reasoning behind these studies is clear and simple. If you want to evaluate a prospect-for-big-leaguer trade, you’ll need to know the expected value of the prospect in the trade. If you want to evaluate how much help is waiting in a given team’s farm system, a quantitative assessment of the talent there is necessary. Even if you’re just wondering how likely your team is to find the next big thing, again, you’ll need some type of framework to understand how often that’s happened in the past.
The previous studies of prospect valuation are still excellent, but they’re all very much of their time. Since Craig published his study in November 2018, the league has changed significantly. The COVID-abbreviated 2020 season changed minor league timelines across the board. The league contracted the number of minor league franchises significantly in 2021. A new CBA, signed before the 2022 season, changed compensation structures and competitive balance tax levels, and introduced the Prospect Promotion Incentive. The cost of a win in free agency has skyrocketed; league-wide payrolls are up more than 30%, and free agent salaries are up by more than that.
With help from my colleagues, I set out to update those previous studies for the modern era. I followed the lead of prior research and divided my evaluation between pitchers and hitters, split between each Future Value tier we use to grade prospects, and estimated values across three different possible measures of value.
What We Measure
The simplest way to think about what a prospect is “worth” is to work out what their production would cost in free agency and subtract what they project to make in their team control years. This surplus value, to use the industry term, is particularly useful when it comes to evaluating trades. Comparing major leaguers and minor leaguers with different team control profiles, skill sets, and positions is much easier if you reduce them all to a single dimension, and surplus value does a good job of tracking real-life trades. It’s one of the things that teams care about most in evaluating transactions, and as such, it’s historically been the most common measure of prospect value. We’ve updated our surplus value calculations to include the modern-day cost of a win in free agency, which is increasingly non-linear at the top end. That works out to roughly $7 million per win for 0-1 WAR players, $8.5 million per win for 1-2 WAR players, and $13 million per win for players who rack up more than 2 WAR. Teams will pay up for stars, and as a result, prospects more likely to turn into stars command extra surplus value.
That’s not the only useful way to think about prospect value, however, so we’ve included two other metrics. First, we calculated the un-discounted WAR that each tier of prospect projects to accumulate during their team control years. If you’re hoping to use a prospect to shore up a weak spot in your lineup instead of trading that prospect for a veteran, surplus value isn’t a sufficient metric. A player producing $100 million worth of on-field value and getting paid $99 million and a player producing $10 million of value and getting paid $9 million each have $1 million in surplus value, but it wouldn’t make sense to treat those guys the same in team-building.
And mean WAR isn’t the only way of looking at potential outcomes, either. That number is an average of all the hits, semi-hits, semi-misses, and outright busts that carried a similar evaluation in each prospect tier in the past. Sometimes, though, you don’t want to know the average; you want to know your odds of hitting a good outcome. To that end, we also calculated the odds that a prospect will turn out to be a star. For this study, we’ve defined a star as a player who posts two or more seasons of 4 or more WAR during their team control years.
None of these three metrics is a perfect encapsulation of the value of a prospect, but each has merit, and looking at all three in conjunction provides a good holistic picture. And it’s particularly useful to aggregate these numbers up to the team level.
Methodology
If you’re interested in a deep dive on the methodology used to produce these valuations, you’ll find an detailed explainer here. What follows is a top-level overview of what data we used, how we used it, and how that turns into each of our outputs.
First, we took historical prospect rankings from 2005-2018, using Baseball America’s Top 100 for 2005-2016, and our own rankings for 2017 and 2018. We transformed the ordinal rankings (nos. 1-100) from 2005-2016 into FV grades based on the current distribution of FV grades that our prospect team gives to players, assigning grades to pitchers and hitters separately. For each player, we then calculated how much WAR they accrued during their team control years. We also noted whether or not a player achieved two four-win seasons during their team control years.
To create a per-player surplus value, we then valued that WAR at 2026 levels with adjustments for the time value of money and the rising cost of a win over time, using our own study of the cost of a win in free agency. We then subtracted out pre-arbitration and estimated arbitration salaries to produce a by-year surplus value in present-day dollars. We didn’t ignore any prospect rankings in doing so, and didn’t remove nulls – if a 50-FV player didn’t make the majors, for example, we left in a row of zero WAR and zero surplus value.
That handled the valuation of the 50-FV and higher prospects. Given that we have no consistent historical record of lower-ranked prospects, some approximation was in order to complete the next step. To estimate the total value of prospects outside of the Top 100, we measured team control WAR accumulated by players who debuted in each year and separated them into two groups: Top 100 players and players who were not ranked in a Top 100.
From there, we estimated the value accrued by 50-FV players outside the Top 100 in each year. Top prospect lists have to end somewhere, but ranking exactly 100 players is a somewhat arbitrary endpoint; on this year’s preseason Top 100 list, for example, our prospect team ranked 110 players, with the number of 50-FV and above players growing to 123 over the course of this list cycle. Since the historical Baseball America lists ranked exactly 100 players in every year, it seemed likely that ascribing all of the value outside the Top 100 to players with a grade below a 50 FV would mis-assign some of that value. So we attributed some value to those players who were outside of the strict historical Top 100 list but nonetheless would carry a grade of 50 FV or higher using modern grading methods, and subtracted that from the value assigned to prospects with a grade below a 50 FV. We approximated the distribution of this remaining WAR based on the early-career returns of players graded as a 35+, 40, 40+, 45, or 45+ on FanGraphs lists starting in 2019, taking care to subtract from our estimate based on the share of players who make major league contributions without being ranked by the team before their debut.
To turn that yearly debut number into the value of all current minor leaguers, whether they debut this year or not, we estimated the time spent in the minors by the average player with a grade below a 50 FV. In this estimation, we used only data from the last 10 years; the shortening of the draft, the contraction of the minor leagues, and the Prospect Promotion Incentive mean that players play in the minor leagues for less time on average, and our numbers account for that change. Finally, we calculated the odds that a prospect currently graded below a 50 FV would be upgraded to a 50 FV or higher. We worked out the estimated value of each tier as a weighted average: the odds of being upgraded times the value we’d calculated earlier for a 50-FV or higher player plus the expected major league contribution of a player conditional on not being upgraded times one minus the odds of an upgrade.
I’ve described the methodology for calculating surplus value, but the WAR and star odds methods follow closely from this one. In addition to calculating surplus value, we also calculated the total team control WAR for each player, and measured how frequently each tier of player turned in a star-level team control span. In that way, we were able to use the same method of dividing value to measure these variables as well.
That’s a ton of words for an abbreviated description of the methodology, but what can I say? This is a complicated thing to measure. Dealing with limited historical data and approximating value over decade-long spans for players on prospect lists means that we’re limited to working off of the past and making educated decisions about how to apply that information to current and future outcomes. The methodology piece contains some sensitivity analysis, but in broad terms, we calculated that the value of the minor leaguers we currently assign grades to is between $10.5 billion and $13.75 billion across the affiliated minor leagues, with our best-calibrated guess at $12 billion.
Results
We used this method to calculate the value of each Future Value grade, both for hitters and pitchers. The following table displays those results:
| FV | Type | Expected Surplus Value | Expected WAR | Star Odds |
|---|---|---|---|---|
| 70 | Hitter | $195,000,000 | 27.5 | 87.5% |
| 70 | Pitcher | $195,000,000 | 27 | 87.5% |
| 65 | Hitter | $95,000,000 | 13.5 | 40.0% |
| 65 | Pitcher | $95,000,000 | 13.5 | 40.0% |
| 60 | Hitter | $82,000,000 | 12.5 | 33.0% |
| 60 | Pitcher | $70,000,000 | 11 | 21.0% |
| 55 | Hitter | $55,000,000 | 8 | 17.5% |
| 55 | Pitcher | $45,000,000 | 7 | 7.0% |
| 50 | Hitter | $45,000,000 | 7 | 13.5% |
| 50 | Pitcher | $33,500,000 | 5 | 7.0% |
| 45+ | Hitter | $18,500,000 | 3.2 | 6.0% |
| 45+ | Pitcher | $15,000,000 | 2.6 | 3.0% |
| 45 | Hitter | $14,500,000 | 2.5 | 3.5% |
| 45 | Pitcher | $9,500,000 | 1.6 | 1.5% |
| 40+ | Hitter | $8,000,000 | 1.2 | 1.8% |
| 40+ | Pitcher | $7,000,000 | 1 | 1.0% |
| 40 | Hitter | $5,500,000 | 0.75 | 0.8% |
| 40 | Pitcher | $4,000,000 | 0.55 | 0.4% |
| 35+ | Hitter | $2,000,000 | 0.3 | 0.4% |
| 35+ | Pitcher | $1,500,000 | 0.25 | 0.4% |
As you can see here, 70- and 65-FV prospects are phenomenally valuable to teams, whether you’re interested in surplus value, expected WAR, or just the odds of them developing into a star. That’s something that arises from how rarely we hand out 65- and 70-FV grades to pitchers these days. We haven’t given out a 70 FV to a pitcher since 2020 (MacKenzie Gore), and our grading has changed meaningfully since then, to the point where I’m confident that the same evaluation wouldn’t produce a 70-FV grade today. The last three 65s? Paul Skenes, Roki Sasaki, and Nolan McLean. The only other 70-FV pitcher in the history of our rankings? That would be Shohei Ohtani, and that grade was meant to also encompass his contributions as a hitter. Pitching prospects this elite are less common than hitting prospects of the same caliber, but the few who do exist perform just as well on a per-player basis.
By the time we get to more “normal” top prospects, the standard split, with hitting prospects being more valuable than pitching prospects with the same grade, is still borne out by the data. That pattern continues even outside the prospects who populate the Top 100; for every Future Value below 65, pitchers deliver less WAR on average and are less likely to turn into stars than hitters with the same grade.
Notably, there’s plenty of value to be had outside the Top 100. Across the entire population of ranked minor leaguers, we project prospects with a grade of 50 FV or higher to accumulate $5.7 billion in surplus value during their team control years, while prospects graded below a 50 FV project to accrue an aggregate $6.3 billion in their team control years. Sure, one individual 40-FV prospect might not be that likely to turn into a star, but if the past is a reliable indicator, a good number of players who we currently rank below a 50 FV will end up making that leap. Prospect evaluation is hard and talent levels aren’t stationary. This makes good sense, and now we have the numbers to show it.
We compared these new rankings to Craig’s methodology from 2019 to get a sense of how different the two approaches are. We also compared our rankings to Craig’s methodology after adjusting for inflation; the cost of a win is meaningfully higher than it was in 2019, so placing those numbers in 2026 dollars is another useful comparison. Here are the results by prospect grade:
| FV | Type | Edwards (2019 $) | Edwards (With Inflation) | New Method | Number of Prospects | Total Value (Edwards) | Total Value (Edwards, w/Infl) | Total Value (New) |
|---|---|---|---|---|---|---|---|---|
| 70 | Hitter | $112M | $146.2M | $195M | 1 | $112M | $146M | $195M |
| 70 | Pitcher | $85M | $111M | $195M | 0 | $0 | $0 | $0 |
| 65 | Hitter | $62M | $81M | $95M | 2 | $124M | $162M | $190M |
| 65 | Pitcher | $64M | $84M | $95M | 1 | $64M | $83M | $95M |
| 60 | Hitter | $55M | $72M | $82M | 4 | $220M | $287M | $328M |
| 60 | Pitcher | $60M | $78M | $70M | 4 | $240M | $313M | $280M |
| 55 | Hitter | $46M | $60M | $55M | 13 | $598M | $780M | $715M |
| 55 | Pitcher | $34M | $44M | $45M | 7 | $238M | $311M | $315M |
| 50 | Hitter | $28M | $36.5M | $45M | 52 | $1,450M | $1,900M | $2,340M |
| 50 | Pitcher | $21M | $27.5M | $33.5M | 39 | $819M | $1,070M | $1,306M |
| 45+ | Hitter | $8M | $10.5M | $18.5M | 33 | $264M | $345M | $610M |
| 45+ | Pitcher | $6M | $7.8M | $15M | 20 | $120M | $157M | $300M |
| 45 | Hitter | $6M | $7.8M | $14.5M | 59 | $354M | $462M | $855M |
| 45 | Pitcher | $4M | $5.2M | $9.5M | 62 | $248M | $324M | $589M |
| 40+ | Hitter | $4M | $5.2M | $8M | 102 | $408M | $533M | $816M |
| 40+ | Pitcher | $3M | $4M | $7M | 94 | $282M | $368M | $658M |
| 40 | Hitter | $2M | $2.5M | $5.5M | 168 | $336M | $439M | $924M |
| 40 | Pitcher | $1M | $1.5M | $4M | 208 | $208M | $272M | $832M |
| 35+ | Hitter | $.5M | $.65M | $2M | 182 | $91M | $119M | $364M |
| 35+ | Pitcher | $.5M | $.65M | $1.5M | 239 | $119.5M | $156M | $358M |
| Total | – | – | – | – | – | $6,305M | $8,227M | $12,072M |
As mentioned above, the new rankings place more value on prospects outside of the Top 100. Accordingly, our Farm System Rankings, the 2026 edition of which you can now view on The Board, will look different using these new numbers, because teams with more prospects graded below a 50 FV come out looking better by our new approach. Here’s an overview of how our Farm System Rankings come out using the old and new prospect valuation methods:
| Org | Edwards Values | Edwards (w/Infl) | New Values | Rank (Old) | Rank (New) |
|---|---|---|---|---|---|
| PIT | $375M | $490M | $671M | 1 | 1 |
| TBR | $315M | $411M | $644M | 2 | 2 |
| MIL | $307M | $401M | $565M | 3 | 3 |
| BAL | $257M | $336M | $529M | 10 | 4 |
| DET | $293M | $383M | $512M | 4 | 5 |
| NYM | $270M | $353M | $492M | 6 | 6 |
| LAD | $261M | $341M | $492M | 9 | 7 |
| CLE | $262M | $342M | $490M | 8 | 8 |
| BOS | $268M | $350M | $485M | 7 | 9 |
| STL | $274M | $358M | $485M | 5 | 10 |
| MIA | $256M | $335M | $478M | 11 | 11 |
| SFG | $243M | $317M | $462M | 12 | 12 |
| MIN | $226M | $295M | $449M | 15 | 13 |
| WSN | $241M | $315M | $438M | 13 | 14 |
| ARI | $176M | $230M | $410M | 19 | 15 |
| SEA | $241M | $315M | $384M | 14 | 16 |
| CHW | $199M | $260M | $384M | 16 | 17 |
| TEX | $190M | $245M | $343M | 17 | 18 |
| KCR | $170M | $222M | $337M | 21 | 19 |
| TOR | $178M | $233M | $335M | 18 | 20 |
| CIN | $173M | $226M | $332M | 20 | 21 |
| CHC | $165M | $215M | $329M | 22 | 22 |
| COL | $160M | $209M | $329M | 23 | 23 |
| PHI | $156M | $204M | $296M | 24 | 24 |
| NYY | $142M | $186M | $282M | 25 | 25 |
| ATH | $137M | $179M | $276M | 26 | 26 |
| LAA | $119M | $155M | $271M | 27 | 27 |
| ATL | $113M | $147M | $246M | 28 | 28 |
| HOU | $68M | $89M | $171M | 30 | 29 |
| SDP | $72.5M | $95M | $163M | 29 | 30 |
This is a good time to remind everyone that the Farm System Rankings on The Board update in real time as our prospect team adjusts the grades of individual players. As key risers move up (like some of the young hitters in Atlanta’s system) or rookies graduate and fall off team lists (like Konnor Griffin and Kevin McGonigle), you’ll see changes to where various systems rank. The current snapshot includes any ranked prospects from this list cycle who were rookie eligible to begin the season.
As we discuss in the methodology post, the individual assumptions used in this prospect model move the final value of the minor leagues around, but the rough contours of these numbers hold across a broad range of possible assumptions. It’s inarguable that the future big league contributors currently in the minor leagues provide a huge amount of surplus value to their teams.
We think that this approach to prospect valuation does a good job of approximating how much value today’s prospects are likely to return to teams over the course of their team control years. Importantly, these estimates reflect the current structure of the minor leagues and player compensation; should the next collective bargaining agreement change the rules of early-career compensation, or even change free agency such that the cost of a win moves meaningfully, these surplus values will move as well. The WAR estimates and the odds of a player being a star are more robust to changes in compensation structure, but if the length of team control changes, those will need recalibration too. But none of those things have happened yet, and should they transpire, we’ll simply use the new state of the world and update this model to create new estimates. In other words, we think both that this is the best way to approximate the value of prospects today, and that this method will allow us to approximate the value of prospects well into the future.
Ben is a writer at FanGraphs. He can be found on Bluesky @benclemens.
I absolutely LOVE stuff like this. Thanks for giving us a small peek behind the curtain.
I think this is mostly pretty good, and it’s interesting to compare this to previous years. But I have one small issue (which was also present in Craig’s version, although I don’t think I knew it at the time).
This means that pitchers are double-penalized when using FG grades and the FG calculations because both are accounting for the higher pitching bust rate.
I think there’s a simple fix for this, which is that when using FG grades and this valuation you just use the hitter valuation for all prospects, and when using it with other publications that don’t dock pitchers you would use the different grades for pitchers and hitters.
A ton of care shown here on a difficult topic but a worthy objective. To my mind, we are still permitting long-ago draft position and mere age curves to bias these top 30 prospect and MLB Pipeline lists. In other words, stack rank much less on the “artifact of their draft position” and far more on production. Much more emphasis should be on actual minor league advanced stats regardless of whether a player was even drafted highly or signed as a free agent. This could all be back-tested by looking at MLB WAR vs Top Prospect lists with a 3 year lag.
Keep it coming.
Draft position and age curves are both highly relevant, though. Sure, you miss out on some guys like Ben Rice who has an uncanny ability to barrel pitches, but it’s still reasonable to put much more weight on a 20 year old producing a 186 wRC+ in AA than a 24 year old doing that. It’s also fair to give more runway to a guy whose talent was so obvious that a major league took him in the top ten versus one who fell to the fourth round.
I love the increased access we have to advanced minor league statistics, but they still only tell you how a player is performing at their current level, not how they will do in the majors. There have been plenty of players over the years who had amazing minor league numbers, but my analysis of their strengths and weaknesses made me skeptical of their ability to replicate that success against better competition, and I’ve been proven correct much more often than not.
That’s precisely why I put much more stock in Eric’s work than I do any other prospect analyst. His write-ups are based on scouting. He does look at and acknowledge advanced stats, but his judgments are always built on his assessment of that player’s skills, not their numbers.
In recent years, FanGraphs has been great at toeing the line between acknowledging genuine improvement by a prospect and not overreacting to small sample successes. If players fly up and down a list due to hot or cold streaks, then those lists have little value. The numbers really aren’t important in and of themselves. They’re only useful in so far as what they tell us about that prospect’s development.
Think BA has more concern with this “hot streak” issue now that they’re doing monthly updates of their Top 30’s. While most stay around their prior spot there is some “spikiness(?)” showing. E.g. a big bump for Henry Lalane in this month Yanks list. He is finally enjoying a healthier season 🤞 so that being a big concern prior it could be justified but guess we’ll see.
I put far less weight on MLB’s ranks since they do seem more rooted to draft position than others.
Eric and Brendan are excellent with using data and scouting to check each other. Most other places are really just about tools and minor league performance.
One of the things other outlets don’t write up—maybe they think their readers won’t get what they are saying, maybe they’re on a deadline and minor league stats are so easy to get—is that minor league performance is often super noisy because minor league parks are super weird. Changes to contact rate, swing decisions, exit velocities, and other things like that are much more consistent indicators across contexts. Changes in performance usually require longer runs of time (as you said) and a robust adjustment based on the parks they are in. And these adjustments are weirdly difficult.
You should actually test Eric’s historical views vs consensus (BA/ESPN/MLB) sometime. Spoiler: it’s not pretty.
That’s because Baseball America & MLB Pipeline go the safe route by touting consensus prospects whereas Eric’s work is not influenced by anyone else’s rankings. That perspective is precisely why I find his analysis valuable even in situations where I disagree with his conclusion.
No, it’s horrerndous, but that’s fine because he actively improves it. There is a super odd boot licking toxic culture here where you’re not allowed to be critical of anyone’s work as a whole, and in regards to Eric, not really at all.
And part of that is the workload he’s carried and the depth he provided on his own. Remember, we’re just two years removed from him doing it by himself. And he can’t be compared to institutions like Baseball America and ESPN, or even other smaller outlets but that are hyperfocused like BP, because though the sites may be similiar in their size, for ML evaluation purposes specifically, that’s BP’s entire focus. It’s not a top three focus here and never can be.. Stats – of the sabermetric variety – baseball coverage both for the season and the offseason, just have to be 1 and 2. And then fantasy, and it has some bleed over, but fantasy cares about top 100 generally, Eric goes probably close to 1500 deep, and he’s not concerned about fantasy..
They’ve had more coverage in the past. Chris Mitchell and KATOH, e.g., was so good, the Twins hired him and immediately took it from public eyes… KATOH was a game changer. And then they’d blend it with Kiley’s list and Dan’s list, KATOH+ or something, but man those lists were unreal in how many “guys” they nailed, especially amongst the unheralded. It got even better when it was Kiley and Eric. Eric left too, to the Twins as well. And actually so did Kiley, he went to the Braves IIRC.
That was during the great FG exodus, in like 12 or 18 months they all left, plus Dave Cameron, Eno Sarris, and my favorite writer – not just baseball writer, favorite writer period – Jeff Sullivan. All to MLB teams like Carson. Travis Sawchik went to FiveThirtyEight, and I can’t think of who off the top of my head, but I know The Athletic poached a couple of guys too.
So Eric comes back, and he’s by himself. And then he gets Tess. No one has said it, but they didn’t mesh, a resource to help him progress, didn’t. Remember that year he was all in on tools, like Miguel Bleis was ranked #8 overall? That was a Tess year. That methodology that Eric had to compromise on set him back. They had overcorrected, because the year prior they missed on tools guys, they were too low.
And then two years ago he’s by himself again, and he had 11 catchers in the top 50.. He had 40 pitchers in the top 100, but #100 was Jefferson Quero, 101 was River Ryan I think, and 102 was Ricky Teidemann, and all three were injured at the time and going to miss the entire season.. You don’t have to jump to many conclusions to conclude that he probably ran out of time and kind of had to pinch them in and publish because the same readers that are overly protective of him, still had been asking, pitchforks in hand, for the list. And ofc he doesn’t just do the list, it’s a week long event.
The important thing is that he adjusts, he recognizes, every year, areas to improve. BA doesn’t innovate, they don’t try anything against the grain, they’re safe projections, and that’s fine. They have a hard cap though that Eric doesn’t have.
Two years ago the imperous jerks that are FG readers didn’t like like my comments at all, just as they aren’t going to like these. But my comments age well. There’s don’t. Also, FG isn’t immune from bots. There are bots here.. And it’s super clicky.
But ends up, my questions – not criticism, mind you, just questions – about the list and names like, well I mentioned 39 names, but I focused on Zyhir Hope, Charlie Condon, or Ranier or Griffin Zyhir Hope, Konnor Griffin, Bryce Ranier, Lazaro Montes, and Konnor Griffin missing the list..
And I got blasted, told I don’t get FG despite being a longer time reader than literally everyone talking crap, and the crap they talked they made up.
For antiquity sake..
https://blogs.fangraphs.com/2025-top-100-prospects/
Point is, your feedback is valid, though it’s not welcome from the other readers, I bet you it is from Eric. He knows. And he’s on it. He’ll get there..
I agree with much of what you say, but I don’t think it’s a lack of time spent. Eric’s writeups are the longest and most detailed in the biz. But, as you have elucidated, he’s been wrong more than right in prospect opinions that have differed from consensus (Vidal Brujan anyone?). Ultimately, that’s what matters most in any prediction business.
I do not agree with you that he’ll get there, as he has been doing this for more than 10 years…
No, it isn’t. If you’re looking for the most accurate rankings then those will always be aggregations of the major lists, since anyone who deviates from the consensus is more likely to be wrong than correct.
What matters most in prospect lists is not the number assigned to the player, be it their overall ranking or even their estimated FV. What matters most is the writeup itself. The analysis is what you should be focused on. The description of a player’s strengths and weaknesses based on actually watching them perform is what has value.
I’ve been subject to this over the years, with my go-to example being what I thought was reasonable criticism of the 2016 Boston Red Sox prospect list written by Dan Farnsworth. I articulated my issues with his ranking and analysis while being downvoted into oblivion, yet every single thing I said about Yoan Moncada, Rafael Devers, and Andrew Benintendi ended up coming true.
I got paid to write about prospects in a small magazine for over twenty years, and my accuracy rate was significantly higher than anyone else that I’ve ever read. So when I praise Eric’s work, that’s coming from someone who has also done this for a long time and who did it exceptionally well.
What I appreciate about him is that I can tell that his analysis comes from scouting these players. I don’t mind him being wrong about guys he’s going out on a limb for, and in fact I enjoy that because it gets me to take a closer look at them before making my own conclusion. I find value in what he does and how he does it.
I am grateful that they gave him some help from another person in Brendan who has a scouting background. No one can accurately cover thirty systems by themselves, and one criticism you make that I would agree with is being disappointed when the profile for a particular prospect is recycled from a previous year. While I would go back and reread what I had written earlier about a prospect, I would never copy and paste anything from it. Having someone like Brendan to help share the load and with whom he can discuss his analysis should help significantly.
In terms of the differences in value between the grades, we have (for hitters, since I still don’t know how I feel about the pitching calculations):
FV70 is 2.05 times higher than FV65 ($100M difference)
FV65 is 1.16 times higher than FV60 ($13M difference)
FV60 is 1.49 times higher than FV55 ($27M difference)
FV55 is 1.22 times higher than FV50 ($10M difference)
FV50 is 3.10 times higher than FV45 ($30M difference)
FV45 is 2.64 times higher than FV40 ($9M difference)
Which means that there is really not a huge difference between a 50 and a 55, but those two have quite a large difference from an FV45 and an FV60.
I think this makes sense to me conceptually. There’s a ton of value in just being average, so the large jump in value from a 45 to 50 makes sense compared to the relatively small difference between 50 to 55. And then once you get to a 60, you’re looking at the difference between a potential All Star and a regular, which is also a larger difference.
Kind of agree though I’m not certain I’d place a tag of “average” on a 50 or 45. But in practice it may be.
A 50 grade, by definition, is league average.
The new FanGraphs scouting primer has a writeup of the WAR levels for each grade. IIRC a 50 is usually around 2 wins, a league average starter.
The issue I see here is we’re applying a ton of precision and rigor to calculating the dollar value, but that calculation is predicated on a FV that is highly subjective.
This gives us significant error bars when it comes (for example) to org ranking. Flipping two 45’s to 50’s increases the aggregate value by ~$60m, which is no small amount when we’re seeing mid tier orgs in the $300’s
This is a good way to look at it… theres a gentle “quasi-exponential” slope of expected value with respect to prospect grade
Excited to dig into this and it made me wonder about assessment — is there an analysis if how many Top 100 succeed/bust per methodology and are conclusions able to be drawn about the biases of each? We know not everyone makes it, but I’d be curious if we know why some evaluations work better than others (in addition to their value). That might be a bit out of this purview, but seems related.
This is where I want to get more information and knowledge of. Do we know if a pitcher who throws 93 with movement and control is a better prospect than one who can hit 99 but with less of the other components? Is the ability to catch up to high heat a better trait than knowing the zone and not chasing breaking stuff and, of course, the corollaries to the variables in all facets of the game? This leads me to a question that I am asking myself which is “why have so many highly touted prospects had such a difficult time succeeding at the major league level”?
Honestly, I think a lot of that is failure & the player’s reaction to it.
Some can adjust, some have never really experienced it & when they do, they don’t know how to adjust or are too stubborn to adjust.
I think, due to that, & also different teams having differing approaches & ability to maximize player skills, you’re first couple of questions are almost impossible to answer.
Plus some of this may be rooted in our expectations of quick success for the highly rated – sometimes it just takes time (see Jurickson Profar).
And maybe Bosox a little frustration with a couple of your recent guys may be showing -“ patience Grasshopper”
Marcelo Mayer is among the group I speak of, but the collapse of the very highly touted group the Orioles appeared to have assembled just a couple of years ago is what sticks out to me. Henderson, close to expectations, and Rutschman, somewhat disappointing, are serviceable regulars while Kjerstad, Mayo, and Cowser can’t hit their weight. Then what do you do with Jackson Holliday who was thought, by many, to be a once in a decade player. The Orioles aren’t the only team that has been disappointed. Matt McLain, Evan Carter and Lawrence Butler, are below the Mendoza line past the halfway point. There are players who resurrect their careers but I think you could have done better than using Jurickson (on the juice) Profar as an example of one. Mickey Moniak was tossed in the bin and has had a big year. He is available and is a great trade chip for the Rockies
If the total excess value of prospects is $12B, that means the average team is sitting on $400M in future savings. That’s money in the owner’s pockets that they don’t have to pay payroll taxes on or finagle from local legislatures. It’s money that doesn’t count as revenue when players come asking for a bigger slice of the pie. All the owners have to do to get that money is to continue to support MiLB, an expense far less than $400M/team over the course of the current prospect pool’s development.
And yet…the owners consistently seem to want to make that huge pile of money (which they have exclusive access too) smaller. First by getting rid of some minor league teams, then by making fewer players eligible to join the pile with their new draft proposal.
It’s just a mind-boggling business decision.
I am sympathetic to anyone who wants to trash MLB’s minor league / draft proposals because it’s clearly written by people who are indifferent to baseball as a game. But I don’t think this article is super relevant to it.
The whole concept of surplus value as discussed in this article exists in the framework of competition for talent and for WAR. And in this context they’re not in competition for talent, they’re trying to hold down costs. They don’t (and probably shouldn’t) care about the ability to gain advantages over other teams in a CBA negotiation, because they’re all on the same side.
What they should care about the relationship between how much they are paying players and the draw those players have for getting subscriptions and selling tickets. That’s a very different type of “surplus value” than the way it’s being used here. And the problem is that they only care about how much they are paying and ignoring the the revenue benefits of having better players.
That means problem with their proposals has nothing to do with surplus value as defined in this article or WAR. It’s that the caliber of major league player might go down across the league under their proposal. It either doesn’t occur to them or they know and they don’t care. If there are shorter developmental runways and the average player isn’t quite as good, it’s irrelevant to them because there will always be players above the average and below it. If Clayton Kershaw blows out his arm in a 140 pitch masterpiece for Texas A&M the owners would never know what they were missing, and they figure there will always be other stars.
Unfortunately, I think your last paragraph is spot on with their thinking…& I’m not sure they’re wrong.
Would the average fan notice if the quality of play was worse? & if it was would quality being “worse” lead to more crazy plays/outcomes that might make the game more entertaining to the average person? (in college sports, sometimes weird things happen that NEVER happen in the NFL/NBA..that can make it more entertaining in the “I’ll never see that again” way or create more drama.)
I went to a wood bat league game on Sunday and am between innings at an MLB game now (it’s pretty lopsided). And the difference is unbelievable…I don’t think it will get that bad but the level of play with more AAA caliber players in the Major is absolutely a possibility and I think many fans would notice.
There’s certainly a point where even the average person would notice, but, if they kept it above that level, I’m not sure most people would notice/care.
When I go to Tigers games, feels like about 25% of the people are barely paying attention/standing around talking/walking around, etc. Then you have families where kids probably wouldn’t notice or people that go to 1 game a year or even less.
Obviously, people that follow it closely or dive into analytics would notice & it would suck.
BTW- I didn’t mention it before, but, i do think this way of thinking from the owners is stupid..can’t see intentionally making your product worse as a logical business strategy. It takes a really jaded view of your customers to think it can succeed.
I’m mystified that owners continue to focus on short-term reduction of costs over potential long-term gains. The entire idea behind barring high schoolers from the draft is making universities pay for those years of development when what they should be focusing on is if there are ways to turn more 40s into 50s and 50s into 60s.
Twenty years ago, I noticed that Latin players made up progressively less of each level in the minor leagues as you advanced. My hypothesis was that the difficulties associated with acculturation negatively affected their performance and caused them to have a higher washout rate. I ended up doing a Masters thesis on the topic after many interviews and statistical analysis where I came up with a framework on potential ways to increase the success rate of Latin prospects. I sent it out to all thirty teams but only one ended up using my proposals because most teams don’t want to spend extra money on housing or residential advisors or chefs.
If most organizations are not optimizing talent development, and I think that’s very obviously the case, then they’re missing out on tens of millions in potential surplus future value in order to save a few million on present expenses.
That sounds like a pretty cool thesis. Accounting for censoring wouldn’t be super straightforward but would be doable in that case.
In any case I think we and most other commenters on this site are appalled by the seeming disinterest the owners have for baseball itself. You would think that even if they are purely self interested they would think that improving the standing of baseball would be good for their bottom line.
And you would think that teams would absolutely invest more in minor league nutrition and social adjustment simply because it would help them get more out of the talent in their system.
But MLB teams have got so used to the easy TV money that most of them have forgotten about developing the game as a method for getting more customers. The idea of getting new customers is alien to them now, and it often takes a while. So instead they focus on cost cutting. They are some of the lousiest rent-seekers this side of patent trolls.
This is exactly what I am talking about. Teams say they are looking for the next market inefficiency that they can exploit to get an edge on their competitors for a little while, before everybody adopts it. Well, the biggest market inefficiency to me seems to be really taking care of your prospects to give them a developmental edge. It’s cheap compared even to a big arbitration award and it potentially has big payoffs. If guys don’t have to worry about housing, transportation to the ballpark or training center, figuring out diet on their own, etc, they can put more energy into becoming better baseball players and it wouldn’t cost the teams that much to give them that edge.
I have a friend that works for the Tigers & they did start incorporating some of this stuff when Scott Harris came in..to what level I’m not sure, but, in the past they did nothing…which seems almost unbelievable.
You’re taking 16 year olds who have had no education & moving them to a foreign country where they don’t speak the language & everything is different & then paying them a barely subsistence wage. I almost can’t imagine any other business being so cheap & NOT providing basic levels of support/education.
& others have said, you’d think the hit rate on prospects would improve significantly. One guy even becoming a league average player would pay for the entire system providing more support many times over.
No competitive advantage is permanent. That’s true in every industry.
Not really seeing that can lead to ugly outcomes. Just ask the folks from Enron, Drexel Burnham, or US Steel.
Shortsightedly they seem to be reacting to the fact that ever more of their bottom 10 draft picks are getting $150 K bonuses where they often signed for far less, though my memory may be skewed by the prior, deeper drafts.
So they’re concerned about saving maybe a $1 million? Geez!
Lets implement Georgist economics to prevent prospect hoarding. What would be the equivalent of a land value tax on the unrealized gains in prospect value.
Want to hoard and keep a talented 21 year old out of the majors? Pay tax on that 65 FV worth
100% a joke before someone down votes me.
I need to dig into it more, but I don’t love the assumption that there isn’t a longterm trendline in terms of how accurately public prospect grades sort eventual outcomes. Folks just have so much more and better information now. And if the aggregate estimates haven’t actually improved, that’s would be very interesting too.
I very much appreciate the detailed methodology here.
So much has changed since COVID, that I think this refresher was necessary.
This was a great read, thanks Ben.
At the very least, Orioles fans will be thrilled at this study’s findings. Cardinals fans not so much.
One thing I am always curious about in baseball prospect rating improvements is benchmarking. What went right in giving Paul Skenes a 65 FV? And more importantly, what went wrong in giving Gavin Lux a 70 FV overall and 70 FV game power? In particular, it seems that since Lux graduated, we have added quite a bit of granularity in batting such as bat speed (Lux is 16th percentile in bat speed, a metric that was not available when he was ranked and would hopefully disqualify him from a 70 FV power rating now no matter how many dingers he hit in AAA).
Now the question: is there a “lesson learned” aspect to any of this updating?
My bias is that Lux reflects a bias towards Dodger development in prospect evals
This is anecdotal, so there’s a fwiw inherent to it obvs, but the Gavin Lux who was at AAA was not the same guy at the MLB level. The swings were rarely as aggressive and athletic-looking, he constantly looked defensive and/or confused in comparison to how he attacked pitching in the minors. Again, anecdotal, but with bat tracking data, I feel like that would be borne out – the video’s available, his barrel whipped through the zone in a way it just has not in the show. I don’t know how anyone goes about evaluating a collapse of something like that.
This is great work and very thorough. So don’t I feel like a jerk wishing there was a little more! My recollection is that the original Edwards research split the lower FVs into age buckets. I forget the exact split, but it does provide some extra granulairy that would be relevant, I think, given the way Eric uses timeline to dock younger players. A 40 FV who is under 20 is likely a high upside player in the DSL to lo-A range. A 40 FV who is 22+ in the high minors is more expected to be a role player with a much higher success rate. It would be nice to see how they compare and if they are not comparable would give Eric some important feedback. In theory, if they deserve the same grade they should have similar Expected WAR with very different Star Odds.
Would it be possible to get some more granularity on these results? I’m assuming that the reported “expected value”s for a given FV are average values? If so, could we get a median value reported as well? I’d argue that the median value is more representative of the player you can expect to get at a given FV evaluation, since the few superstars at any given rating will drag the average value up, potentially substantially. I’d actually like to see the distribution of values for each rating (both in terms of WAR and surplus value), or at a minimum 25th, 50th, and 75th percentiles would give an idea of the shape of the distribution.
This is amazing. Seems like this is the foundation for the ability to simulate the future trajectory of franchises based on this, expected payroll, historical skill in trades/player development/free agency to get a rolling short-medium term outlook for every organization.
Nice. I appreciate the updates here.
The Prospects section is among the reasons why I gladly became a member, since the FanGraphs staff is doing one heck of a job!
How is a prospect being treated that has made the lists in multiple years with varying grades? Is he just accounted for multiple times or is his final grade before graduating driving his value?
I think you have to use every time a player appears on the list as an individual instance, and include all appearances/ratings. This was a huge flaw in Wang’s prospect valuation, IMHO – he included only the final rating for a player on the list, which gets evaluators off the hook if their initially assessed 60 crashes and burns and ends up a 30, and makes the evaluators look better than they actually are if their originally assessed 40 ends up a 60. It also means that the annual lists are kind of worthless, since all that really matters is a players final appearance, which could be multiple years away. I think to most people, what matters is the annual list, not the final assessment. Including all evaluations will increase the variability and spread of a given FV, but I think that reflects the reality of prospect evaluation.
Ben writes in the article: “Finally, we calculated the odds that a prospect currently graded below a 50 FV would be upgraded to a 50 FV or higher. We worked out the estimated value of each tier as a weighted average: the odds of being upgraded times the value we’d calculated earlier for a 50-FV or higher player plus the expected major league contribution of a player conditional on not being upgraded times one minus the odds of an upgrade.”
This is wonderful and comprehensive! Thank you!
Question: Zero scores for 50+s who never make the bigs makes sense methodologically here for sure. But does an “expected” good-to-star player who bombs out, pre-bigs, actually accrue negative value for a team? Longer time spent occupying precious high-level minors playing time? Increased time and money spent on development? Or, in the case of injury, essentially “wasted” surplus value?
Great stuff. A follow up deeper dive to show specific examples of how the methodology changes impacted BAL and STL would be interesting.
Just eyeballing the farm rankings page, with Baltimore it looks like it’s mainly because of how many prospects they have- 63 total, with 41 of them being either 40 or 35+ prospects that gained a huge amount of collective value even though they aren’t all that valuable individually, and with St Louis the big ordinal ranking fall is partly just a weakness of how ordinal rankings work- by either method they’re very close in value to the four teams immediately ahead of them in the new ranking, but went from slightly ahead of all four the old way to slightly behind all four the new way, I’m guessing because the 55 FV group got relatively less valuable compared to other prospect tiers, and the Cards have 3 55-FV prospects driving a huge part of their system’s value, more than any other team.
I play Strat-O-Matic so I am happy that you provide some valuations that try to account for all aspects of a player’s skills and not just fantasy contributions. Past valuation of FV for M. Vargas coupled with output projections when he moved to the White Sox for a likely full-time role proved to be a valuable add for me in our keeper league.
Thanks for your hard work.
If we split data/analysis/stats into two buckets, those that are useful for 1) fantasy baseball (i.e., to what degree a player will contribute to a fantasy baseball owner/team winning in fantasy baseball), and 2) “real” baseball (i.e., to what degree the player will contribute to a major league team winning games), IIUC this updated method falls into the latter, i.e., the real baseball bucket. Am I mistaken?