KATOH’s Organizational Rankings

Last week, Kiley McDaniel published his write-up of the Milwaukee Brewers farm system, marking the 25th installment of his “Evaluating the Prospects” series. Once he makes it through the five teams left on the table, he’ll be publishing his ranking of all thirty teams’ farm systems. In anticipation of this release, I thought it would be interesting to create an organizational ranking based exclusively on KATOH — my prospect projection system. The methodology for making this list seems pretty obvious: Simply add up all of the KATOH projections for the players on each team. In practice, however, this isn’t nearly as straightforward as it sounds.

First, I had to decide what to do with players who appeared in only a small number of games. For example, Carlos Rodon — the White Sox top prospect — receives a projection of 7.9 WAR through age-28. That projection seems pretty reasonable for Rodon, but it’s only based on 95 batters faced over 21 innings. That  sample’s not nearly large enough to mean much of anything.

To address this problem, I decided to only consider players who logged at least 200 plate appearances last season (or 200 batters faced for pitchers). This inevitably means that some big-name prospects (like Rodon) wind up being excluded, but there’s really no other way to go about it. KATOH projections are based on 2014 stats, and for guys who only appeared in a few games, the 2014 stats are almost meaningless.

There’s also the issue of knowing the affiliations for thousands of minor league players. My database of 2014 stats includes each player’s organization from the 2014 season, but a lot has changed since then. It would be easy enough to account for the players who were traded, but what about the hundreds of nondescript minor league free agents who changed organizations over the winter? It would be futile to try to figure out where each one ended up.

Due to this restriction, I only included KATOH’s top 400 players in this analysis. I tracked down and confirmed the whereabouts for all 400 of these players, but after seeing some of the names that ranked in the high 300’s, I decided it would be foolish to go any deeper than 400. So prospects outside the top 400 — those projected for less than 1.8 WAR through age-28 — were not considered.

I’m sure you didn’t click on this article to read about methodologies and the caveats, so I’ll cut to the chase. Below, you’ll find the organizational farm system rankings according to KATOH.

Team Sum of WAR thru 28
Texas Rangers 101.0
New York Yankees 89.2
New York Mets 88.2
Chicago Cubs 83.9
Los Angeles Dodgers 80.4
Houston Astros 63.8
Boston Red Sox 62.4
Pittsburgh Pirates 55.9
Arizona Diamondbacks 50.9
Tampa Bay Rays 49.6
Kansas City Royals 47.8
Seattle Mariners 46.3
Atlanta Braves 46.0
St. Louis Cardinals 45.2
Cleveland Indians 38.3
Detroit Tigers 37.4
Toronto Blue Jays 37.3
Minnesota Twins 36.8
Chicago White Sox 36.3
Oakland Athletics 33.6
Baltimore Orioles 33.4
Washington Nationals 33.4
Colorado Rockies 33.0
Philadelphia Phillies 32.9
San Francisco Giants 32.7
San Diego Padres 30.1
Cincinnati Reds 28.2
Milwaukee Brewers 20.9
Los Aneles Angels of Anahiem 17.2
Miami Marlins 16.6

 

And here it is in the form of an infographic.

 

ttt

Somewhat surprisingly, its not the Chicago Cubs, but the Texas Rangers who take the top spot. Outside of Joey Gallo, the Rangers don’t have any elite prospects according to KATOH, but they have a dozen guys who project for between 3 and 10 WAR through age-28. The average team only placed five players in this range. This glut of merely good prospects was enough to vault them to the top of the list.

Texas’ depth goes further than that, however. All told, the Rangers have 24 guys in the top 400, which puts them in a tie for the second most. Here’s a look at this breakdown for all 30 teams.

top 400

The moral of the story is that depth — rather than high-impact talent — wins out in KATOH’s eyes. Although the Cubs have several guys with excellent projections, their lack of depth (according to KATOH) knocks them down to fourth overall. Meanwhile, the Rangers, Yankees and Mets overtake them due to their sheer quantity of decent prospects. This doesn’t necessarily prove that current evaluations place too much value elite prospects. It very well could be that KATOH’s just overly conservative when it comes to crème de la crème prospects.  However, I also wouldn’t rule out the possibility that KATOH might be on to something here.

The order of these rankings may seem a bit odd in some cases, but they appear to be at least somewhat grounded in reality. Last month, using Kiley’s FV grades, Dave Cameron put together a rough estimate of what each team’s farm system is worth. Unsurprisingly, KATOH’s WAR values correlate respectably with Cameron’s dollar values.

KATOK vs Cameron

KATOH’s organizational rankings are interesting to look at, but I’d caution against taking them too seriously. Not only is the KATOH model far from perfect, but my cutoffs for this list were completely arbitrary. If I had instead chosen to consider, say, the top 500 players with at least 300 plate appearances, there’s a good chance things would move around a bit. By no means are these rankings gospel, but at the very least, they’re something to think about while we wait for meaningful baseball to start up again.





Chris works in economic development by day, but spends most of his nights thinking about baseball. He writes for Pinstripe Pundits, FanGraphs and The Hardball Times. He's also on the twitter machine: @_chris_mitchell None of the views expressed in his articles reflect those of his daytime employer.

22 Comments
Oldest
Newest Most Voted
Inline Feedbacks
View all comments
Bridgeport Joe
9 years ago

“First, I had to decide what to do with players who appeared in only a small number of games. For example, Carlos Rodon — the White Sox top prospect — receives a projection of 7.9 WAR through age-28. That projection seems pretty reasonable for Rodon, but it’s only based on 95 batters faced over 21 innings. That sample’s not nearly large enough to mean much of anything.”

Holy methodological dumpster fire, Batman!

It seems to me that simply ignoring projections for top prospects with limited playing time is maybe the absolute worst way to go about it.

EthanBmember
9 years ago
Reply to  Bridgeport Joe

I don’t think that’s a terrible decision given the model, but it implies that KATOH has no regression component based on sample size. Is that really true? If a player puts up a 10% K rate and a .200 ISO over a month’s worth a plate appearances he gets the same projection as someone who does that over a full season? The latter is clearly a much better prospect, statistically. That seems like an area where KATOH has a lot of room to improve.

Brian Cartwright
9 years ago
Reply to  EthanB

regression will help, but also more data, such as the 346 innings that Rodon threw in college.

Roger
9 years ago
Reply to  Bridgeport Joe

“Holy methodological dumpster fire, Batman!”

Congratulations, this is the most FanGraphs sentence ever uttered