How to Identify 1.14 Excellent Pitchers at the Fall League

There are a lot of reasons to assume that right-handed Boston Red Sox prospect Michael Kopech is well positioned — or, at least, as well positioned as any young pitcher can be — not only to reach the majors but also to experience some success while there. The velocity is one reason why, obviously. He reportedly hit 105 mph on multiple radar guns earlier this summer. He was sitting at 93-97 during instructional-league play last month. He’s recorded an average fastball of 98.7 mph in the Arizona Fall League. Provided his arm remains attached and in mostly serviceable condition, he appears certain to serve at least as competent reliever.

There are other promising indicators, though. Objective ones. Consider: Kopech was selected 33rd overall in the 2014 draft. Research by Matthew Murphy indicates that players taken between 31st and 35th overall as amateurs produce about two and three wins over the course of their team-controlled years. As for his status as a prospect, specifically, one finds that Kopech was ranked 89th on last year’s edition of Baseball America’s top-100 list. The most recently updated iteration of Kevin Creagh and Steve DiMiceli’s work on prospect valuation suggests a pitcher ranked between 75 and 100 on BA’s list is likely to contribute something like three or four wins before reaching free agency.

Two or three or four wins might not seem like a great result over half a decade, but that’s also just an average figure. There’s a lot of attrition baked into it, a lot of zero-win seasons. The point is that, on average, a pitcher with Kopech’s profile ends up contributing in the majors. That has considerable value.

There’s one more promising indicator for Kopech, though, and it’s not necessarily one you’d expect — namely, his performance so far in the Arizona Fall League, where he’s recorded the highest strikeout rate among starters. Given the circumstances under which it’s played, there are multiple reasons to discount the numbers coming out of the AFL. It’s a developmental league, first of all. The mandate isn’t really for prospects to “win” as much as it is to improve. Plus there’s also the fact of the inflated run environment, which is probably the product of an imbalance in the quality of pitching and hitting prospects and also the product of the weather in Phoenix. Finally, there’s an even more basic reason why to approach Fall League data with some caution: the samples are small. There are only about 30 games in an AFL season — or, the equivalent of a month’s worth of regular-season major-league play. The dangers of extrapolating too much from a single month of data are manifest.

All of that is valid. That said, one shouldn’t immediately throw out all the statistical bath water quite yet, lest some figurative babies remain inside it. Because even after accounting for all the reasons why AFL data oughtn’t predict future success, there’s probably still some use for it.

A couple years ago, I examined a collection of AFL pitchers from the latter half of the aughts and found a real correlation between their strikeout rates in the Fall League and their eventual success (or lack of it) in the majors. Perhaps this isn’t shocking: strikeout rate is pretty elegant as an evaluative tool. Not only does it become reliable in much smaller samples than other metrics, but it exerts a great deal of influence on run prevention, also. If a pitcher is striking out opposing batters in the Fall League, that would seem to be a strong indication that he’d strike out other kinds of batters, too — which, because of how strikeouts work, would also lead to run prevention.

In any case, with a couple more years’ worth of data available now, it appears as though the correlation between AFL strikeouts rates and major-league run prevention remains. I’ll get to the numbers in a moment. First, here’s a lightly edited excerpt from that piece two years ago, detailing some of the methodology of this exercise.

To better understand how much pitcher strikeout rate in the AFL rate might inform future major-league success, I looked at AFL pitchers from 2005 to -09 who’d both (a) faced 70 or more batters (that is, the sample threshold at which strikeout rate becomes reliable for major-league pitchers*) and also (b) made at least half their appearances as starts. Each year in the AFL there are about 25-30 pitchers who meet both those criteria. For each of the five years in question, I isolated both the top and bottom third by AFL strikeout rate, resulting in 43 “high strikeout” and 43 “low strikeout” pitchers.

*As Russell Carleton notes, these thresholds oughtn’t be regarded as a “magic number,” but rather “the point where a measure of reliability slowly crosses an only-somewhat-arbitrary line in the sand.”

Yesterday, in my cold house, I expanded the original sample, including AFL pitcher-seasons from the 2010 and -11 campaigns, as well. Doing so adds 17 more pitcher seasons to both the “high strikeout” and “low strikeout” pitcher groups, bringing each sample to a total of 60 unique player-seasons. The differences between the major-league numbers of the two groups are substantial.

First, the high-strikeout group (sorted by WAR as calculated with runs allowed):

MLB Numbers of High-Strikeout AFL Pitchers, 2005-11
Name IP K% BB% xFIP- FIP- ERA- FIP-WAR RA9-WAR
Jered Weaver 2025.0 19.2% 6.5% 104 98 88 31.4 42.6
Max Scherzer 1696.1 27.1% 6.9% 83 81 82 37.7 36.8
James Shields 2294.1 20.6% 6.4% 90 97 96 31.0 34.2
Ian Kennedy 1430.1 21.9% 7.9% 102 104 99 16.1 18.7
Stephen Strasburg 924.1 29.0% 6.3% 73 75 82 22.7 18.2
Phil Hughes 1204.2 19.0% 5.7% 101 98 106 17.9 13.5
Alex Cobb 520.2 20.5% 7.4% 86 90 89 8.2 10.1
Josh Collmenter 678.1 17.2% 5.9% 110 104 88 6.0 10.0
Tommy Hanson 708.0 21.6% 8.3% 99 99 97 9.5 9.7
Glen Perkins 618.2 19.3% 5.9% 93 94 91 7.4 8.7
Mike Fiers 572.2 22.5% 7.0% 96 97 96 8.6 8.1
Andrew Cashner 726.1 19.7% 8.3% 99 100 103 7.5 4.3
Dustin McGowan 572.2 19.1% 10.1% 103 105 104 4.5 3.8
Nick Blackburn 818.2 10.9% 5.7% 106 116 115 4.0 3.3
Marc Rzepczynski 393.0 22.0% 10.3% 88 93 94 2.9 2.4
Brian Matusz 528.2 19.8% 8.7% 107 106 117 4.7 1.8
Jenrry Mejia 183.1 19.9% 9.4% 98 101 101 1.3 1.4
Angel Guzman 157.0 20.8% 10.6% 100 102 105 0.9 1.3
Matt Palmer 185.1 12.1% 11.6% 118 111 108 0.6 0.9
Darrell Rasner 165.2 12.6% 7.3% 113 109 114 1.5 0.7
Luis Marte 26.0 20.0% 9.1% 117 112 66 -0.1 0.5
Tyler Lyons 197.2 22.6% 6.8% 94 108 107 0.9 0.5
Charlie Morton 893.0 16.0% 8.6% 103 107 119 7.6 0.4
Bobby Parnell 336.2 20.1% 9.3% 94 84 99 4.2 0.3
Bill Murphy 17.2 10.1% 19.0% 140 126 89 -0.2 0.2
Nate Adcock 123.0 14.8% 10.4% 112 119 102 -0.6 0.2
Robert Ray 28.0 13.5% 9.2% 117 118 94 0.1 0.2
Willie Eyre 163.2 11.9% 9.0% 115 109 109 -0.1 0.2
David Purcey 206.0 18.8% 12.8% 118 108 116 0.9 0.2
Oliver Drake 33.2 26.0% 11.0% 93 81 82 0.3 0.0
Humberto Sanchez 2.0 12.5% 25.0% 134 119 104 0.0 0.0
Scott Barnes 27.2 21.7% 8.3% 109 116 131 0.0 -0.1
Adam Loewen 189.1 18.2% 14.8% 115 111 131 1.2 -0.2
Shane Lindsay 6.0 17.7% 14.7% 128 134 283 0.0 -0.2
Jared Wells 8.1 11.4% 15.9% 147 179 210 -0.2 -0.3
Jack Egbert 3.1 0.0% 10.0% 150 192 468 -0.1 -0.3
Ryan Verdugo 1.2 13.3% 13.3% 190 298 785 -0.1 -0.4
Anthony Bass 278.1 15.7% 9.0% 110 112 117 0.0 -0.6
Donnie Veal 69.0 23.0% 15.4% 115 118 136 -0.1 -0.6
Joe Martinez 55.2 12.0% 7.9% 111 109 144 0.2 -0.7
Virgil Vasquez 61.1 12.5% 8.0% 121 140 154 -0.3 -0.7
Scott Mathieson 44.0 15.7% 9.7% 116 123 148 0.0 -0.9
Bryan Augenstein 22.2 10.7% 8.0% 126 128 199 -0.1 -0.9
Clint Nageotte 41.2 12.3% 14.2% 119 125 176 -0.1 -1.0
Hayden Penn 82.1 12.4% 13.4% 131 150 218 -0.9 -3.5

Next, the low-strikeout one:

MLB Numbers of Low-Strikeout AFL Pitchers, 2005-11
Name IP K% BB% xFIP- FIP- ERA- FIP-WAR RA9-WAR
Mike Minor 652.2 20.7% 6.9% 102 105 109 6.9 6.1
Tyson Ross 469.1 21.1% 9.4% 93 93 99 6.2 4.1
Jared Hughes 183.0 15.5% 8.0% 102 108 80 -0.5 1.4
Stephen Fife 91.0 17.5% 8.3% 107 122 99 0.2 1.1
T.J. McFarland 133.1 15.7% 7.0% 94 89 89 0.9 1.0
Mitchell Boggs 316.2 16.7% 10.3% 107 108 105 0.6 1.0
Anthony Swarzak 439.2 14.2% 6.7% 111 104 109 1.4 1.0
Steve Johnson 54.0 29.5% 13.8% 98 90 89 0.6 0.9
David Pauley 209.2 13.2% 7.4% 107 113 114 0.2 0.9
Brooks Brown 26.0 20.2% 4.8% 87 93 64 0.1 0.4
Stuart Pomeranz 6.0 11.5% 3.9% 92 111 72 0.0 0.1
Charles Brewer 6.0 18.5% 7.4% 100 63 77 0.1 0.1
Steve Garrison 0.2 0.0% 0.0% 121 72 0 0.0 0.0
Randor Bierd 36.2 14.0% 10.7% 121 103 110 0.1 0.0
Sean West 112.2 15.2% 9.3% 114 110 119 0.9 0.0
Jeff Marquez 5.0 8.7% 0.0% 98 113 126 0.0 0.0
John Koronka 158.1 10.7% 9.3% 122 120 135 0.6 0.0
Evan MacLane 1.0 0.0% 25.0% 182 485 230 -0.2 -0.1
Chris Smith 67.2 17.8% 9.3% 116 145 121 -0.8 -0.2
Brian Broderick 12.1 7.0% 5.3% 123 93 172 0.0 -0.3
Jordan Tata 28.2 10.9% 11.6% 130 109 152 0.1 -0.3
Mitch Talbot 232.2 12.3% 10.3% 120 121 132 0.7 -0.5
Brian Burres 358.1 13.6% 9.7% 120 115 132 1.7 -0.5
Kevin Mulvey 27.1 14.5% 10.7% 118 162 180 -0.3 -0.5
Lucas Harrell 401.2 14.9% 11.1% 112 112 122 2.1 -0.6
Casey Kelly 29.0 19.1% 7.4% 99 127 171 0.0 -0.7
Mike Parisi 23.0 10.7% 12.4% 134 121 197 -0.1 -0.8
Chris Lambert 33.0 15.9% 8.5% 116 139 165 -0.2 -0.9
Fernando Rodriguez 132.1 24.2% 11.7% 110 108 119 0.2 -1.0
Maikel Cleto 45.0 26.5% 13.7% 115 151 174 -0.7 -1.2

There are a lot of names and numbers in these tables. Readers, as members of a free and just society, are welcome to interpret the data as they want. Here are some telling observations, however:

  • Among the high-strikeout group, 45 of 60 pitchers (75%) have recorded at least one major-league appearance. Among the low-strikeout group, only 30 of 60 (or, 50%) have.
  • Among the high-strikeout group, 7 of 60 pitchers (12%) have both (a) recorded the majority of their major-league appearances in a starting capacity and also (b) produced a strikeout rate above 20% (i.e. roughly the league-average rate). Only 2 of 60 (or, 3%) from the low-strikeout group (Mike Minor and Tyson Ross) have done the same.
  • Pitchers from the high-strikeout group have compiled a collective 222.8 RA9-WAR, or 3.7 wins per pitcher. The low-strikeout group has produced just a 10.5 RA9-WAR collectively, or 0.2 wins per pitcher.
  • Among the high-strikeout group, 8 of 60 pitchers (13%) have recorded a 10 RA9-WAR or better. Zero pitchers among the low-strikeout group have reached the 10-win threshold. (Indeed, with the exception of Minor and Ross, no low-strikeout pitcher has recorded more than two wins by this measure.)

Regarding that fourth and final observation: 10 wins is totally arbitrary as a point of demarcation. That is, there’s nothing appreciably different between a pitcher who’s produced 10.1 RA9-WAR over the course of his career and another who’s produced 9.9. That said, there are fewer than 100 active pitchers who’ve recorded more than 10 career wins. Reaching that 10-win threshold requires some combination either of peak or longevity for a pitcher. It’s either the result of five average seasons or two MVP-level ones or 20 half-win seasons. Whatever the case, it’s difficult for a pitcher to find his way there by accident. These pitchers are excellent*.

*More on the (unexpected but probably deserved) characterization of Josh Collmenter as excellent in a later post.

The seven-year sample of high-strikeout AFL pitchers considered here has produced eight of these major leaguers, or 1.14 per season (the figure cited in the title of this post). Perhaps that number sounds low. After all, the Fall League has a reputation for showcasing some of baseball’s best talent. And, in fact, the number is a bit low. Remember, we’ve only considered the high- and low-strikeout groups here. Adding in the third and final group — the pitchers who produced roughly average strikeout rates during their Fall League tenures — augments the collection of 10-win pitchers by five: Gavin Floyd (from the 2006 AFL season), Ricky Nolasco (2007), Matt Harrison (2007), Clay Buchholz (2008), and Mike Leake (2009). So that’s 13 different 10-win pitchers from a sample of 182 (or, roughly 7%) over seven years (or, about 1.63 per season).

The precise number of overall excellent major leaguers produced by the Fall League isn’t ultimately the point of this post, however. Rather, the focus here is on the predictive nature of strikeout rate in the AFL — and the addition of the average-strikeout group to the overall sample lends some credibility to it. As the data reveal, zero of the AFL’s low-strikeout pitchers have reached the 10-win threshold as a major leaguers and eight of the high-strikeout group have. If strikeout rate were actually predictive of future major-league success, one would expect the AFL’s average-strikeout group to have produced a figure somewhere between zero and eight. In fact, it has: it’s produced five of them, or almost exactly the halfway point. As for the relevance of this to the current AFL season, that’s a consideration for a different post. For the moment, however, the data seem to provide a framework by which to better identify future excellent major-league pitchers.





Carson Cistulli has published a book of aphorisms called Spirited Ejaculations of a New Enthusiast.

3 Comments
Oldest
Newest Most Voted
Inline Feedbacks
View all comments
ChippersJonesing
7 years ago

Fun and informative post, needs more italics though.