Assessing Reliever Value in a Shorter Season
Trying to predict how a reliever will perform from one season to the next can be a pretty frustrating exercise. Some amount of uncertainty surrounds all players, but being a pitcher makes things a little more difficult and being a pitcher who is often asked to throw with max effort with little to no rest complicates further still. And even after we move past those factors, we’re faced with a smaller sample of outcomes for bullpen arms. A 60-inning season is a complete season for a reliever, considerably fewer innings than a starter throws and many fewer batters faced than the number of times most starting position players come to the plate. Trying to predict reliever performance in half a season is even more difficult; attempting to put a value on relievers in a potentially condensed, shorter season becomes quite challenging.
Consider that last season, there were 158 qualified relievers with at least 48 innings pitched. Ken Giles produced 1.9 WAR, ranking 10th in baseball among his bullpen brethren. Brett Martin ranked 60th among relievers with a 0.8 WAR and Matt Albers ranked 130th as a replacement-level reliever. Now, let’s cut those seasons in half. Giles still ranks 10th with just under a win, but he’s now closer to Matt Albers in half a season than he was to Brett Martin in a full season. It is considerably harder to tell, in terms of results, the difference between a good and bad reliever under those constraints. This is further complicated by the fact that the smaller the sample size, the less likely that the results will match the actual performance.
I separated pitchers into three groups from last season: pitchers with at least 100 innings, qualified relievers, and pitchers with at least 20, but less than 40, innings on the season. Then I ran some correlations between WPA, which shows how the actual results on the field mattered to the team, and ERA, FIP, and WAR, to show some measures of performance.
WPA/WAR | FIP/WPA | ERA/WPA | |
---|---|---|---|
Starters (min. 100 IP) | 0.61 | 0.56 | 0.77 |
Relievers (min. 48 IP) | 0.40 | 0.38 | 0.54 |
Pitchers (20-40 IP) | 0.24 | 0.23 | 0.47 |