Bullpen Usage Is Destroying Offense This Postseason

The story of this postseason has been the dramatic change in the attitude towards relief pitcher usage. It’s been most notable in Cleveland, where Andrew Miller has been used anywhere from the 5th through 9th inning, but basically all of the teams still left have been utilizing their best relievers as often as possible, and relying more on their bullpens than ever before.

Yesterday, over at FiveThirtyEight, Rob Arthur showed that this isn’t just our perception, but that teams really are pulling their starters earlier than ever this year. Below, I’ll borrow a neat graphic from his post.

arthur-postseasoninnings-1

The maxim of starting pitching being the key component to winning in October is dying a very public death this month; relievers are the hot new thing, and pretty much everyone is buying in at the same time. But in Arthur’s piece, he also suggests that this big change hasn’t actually mattered all that much.

But is this shift to the bullpen working? No — or at least, not that we can see.

Runs per game tends to decline from its regular season norm every October, and this year is no different. So far, only 2.6 runs per game are crossing the plate in the postseason, down from 4.5 in the regular season. If managers’ newfound bullpen savvy was depressing runs per game to a significant degree, you’d expect the gap between the regular season and postseason to be even larger than usual. But that’s not the case: Since 2000, seven years have seen larger drops in scoring between the regular season and playoffs than we’ve seen so far this year.

You Aren't a FanGraphs Member
It looks like you aren't yet a FanGraphs Member (or aren't logged in). We aren't mad, just disappointed. We get it. You want to read this article. But before we let you get back to it, we'd like to point out a few of the good reasons why you should become a Member. 1. Ad Free viewing! We won't bug you with this ad, or any other. 2. Unlimited articles! Non-Members only get to read 10 free articles a month. Members never get cut off. 3. Dark mode and Classic mode! 4. Custom player page dashboards! Choose the player cards you want, in the order you want them. 5. One-click data exports! Export our projections and leaderboards for your personal projects. 6. Remove the photos on the home page! (Honestly, this doesn't sound so great to us, but some people wanted it, and we like to give our Members what they want.) 7. Even more Steamer projections! We have handedness, percentile, and context neutral projections available for Members only. 8. Get FanGraphs Walk-Off, a customized year end review! Find out exactly how you used FanGraphs this year, and how that compares to other Members. Don't be a victim of FOMO. 9. A weekly mailbag column, exclusively for Members. 10. Help support FanGraphs and our entire staff! Our Members provide us with critical resources to improve the site and deliver new features! We hope you'll consider a Membership today, for yourself or as a gift! And we realize this has been an awfully long sales pitch, so we've also removed all the other ads in this article. We didn't want to overdo it. In case you didn't read all that, here's the short version. Membership includes:
✓Ad-free browsing
✓Unlimited FanGraphs & RotoGraphs articles
✓Historical & platoon projections
✓Leaderboard & player-page stat heatmaps
✓One-click data exports
✓Customizable player-page dashboards
✓Dark & Classic site modes
✓Weekly Members-only mailbag
✓FanGraphs Walk-Off, your year in review
✓Optional homepage photo removal
✓Gift articles to non-members

Another place reliever usage might alter the game is in terms of preventing comebacks. Going to the bullpen while the starter is cruising is an even tougher sell when you have a lead, but sabermetrics suggests it’s the best way to preserve that lead. Through 24 playoff games3, there have been two comeback wins after six innings — close to the regular-season average of 13.6 percent. Similarly, if managers were acquiring leads and then unleashing a cavalcade of relievers to prevent offense, we’d expect there to be less movement in win probability. But the 2016 postseason has featured an average win probability change almost exactly in line with those of previous Octobers.

That part of the article struck me as odd, as it certainly feels like offense is way down this October, and that relievers are primarily responsible for the domination of opposing hitters. So, instead of just looking at runs per game, I asked David Appelman to send me the regular season and postseason wOBA for each of the last 15 years. Here’s those numbers in a table, along with the difference between the two.

Regular Season and Postseason wOBA
season Regular Season wOBA Postseason wOBA Difference
2002 0.326 0.339 -0.013
2003 0.328 0.303 0.025
2004 0.330 0.339 -0.009
2005 0.326 0.316 0.010
2006 0.332 0.314 0.018
2007 0.331 0.331 0.000
2008 0.328 0.322 0.006
2009 0.329 0.320 0.009
2010 0.321 0.290 0.031
2011 0.316 0.329 -0.013
2012 0.315 0.281 0.034
2013 0.314 0.287 0.027
2014 0.310 0.295 0.015
2015 0.313 0.292 0.021
2016 0.318 0.278 0.040

As I write this, hitters are posting a .278 wOBA this postseason, the lowest year of any year in the sample, down 14 points from last year’s postseason, even though offense was up during the regular season this year. And naturally, that means that the gap between regular season and postseason wOBA is at its largest point in the sample as well. Here’s a graph of the data, in case you’d rather see it visually.

woba-regular-postseason

The broader recent trend has been towards larger gaps in wOBA between the regular season and postseason, with 2016 being a more extreme version of 2010 and 2012, the previous years where there were gaps over 30 points. This lines up a bit with Arthur’s graph of the move away from starting pitching, and it’s probably not a coincidence that gap is getting larger as starters are being asked to pitch less in the playoffs.

So why isn’t it showing up in runs per game yet, as Arthur noted yesterday? Well, run scoring can be influenced pretty heavily by sequencing, and especially in small samples, stringing hits together can lead to runs even if pitchers dominate most of the rest of the game. But when we look at the rate stats that are the building blocks of offense, we can see pretty clearly that offense is down significantly this postseason, and manager’s increased aggressiveness in using their relievers is indeed working.





Dave is the Managing Editor of FanGraphs.

28 Comments
Oldest
Newest Most Voted
SucramRenrutMember since 2017
9 years ago

Dave, it would be interesting to see how the drop in wOBA since 2012 correlates to the true talent of the teams that made it to the playoffs. Is it possible that it might be a talent-based change rather than strictly a use-based change? It sure seems like we have had some particularly dominating ‘pens in the last 4 years.

elobell
9 years ago

Thinking about sequencing – wouldn’t increased bullpen usage have a run-reducing impact on sequencing, rather than the other way around? Obviously there is always going to be randomness, but you’d think that an increased willingness to play the matchups and use relievers earlier would lead to things like higher strand rates and even fewer runs.

Concerned Reader John
9 years ago
Reply to  elobell

That’s possibly true over hundreds of games, but I doubt sequencing and strand rate would stabilize over the entire playoffs, let alone by the league champion series. I imagine the discrepancy between runs scored and wOBA is mostly noise at this point.

RotoholicMember since 2016
9 years ago

The method here, comparing regular season to post-season, seems to include way too much noise to be useful. For the post-season, you’re only looking at a subset of teams that played in the regular season, skewed heavily towards the 4 teams that make their respective LCS since they play by far the most postseason games. This year, the 4 LCS teams all finished in the top 7 of MLB in team ERA (1st, 5th, 6th, 7th) compared to their team Runs-For ranks of 3rd, 5th, 9th, and 15th. The 2nd, 3rd, and 4th place finishers in team ERA also made the playoffs. It would seem to be a postseason with an unusual amount of pitching-heavy teams.

I think a comparison of playoff teams’ run differential in the regular season vs the postseason, weighted for postseason games played, would be a much better indication of how much scoring changes in the postseason. But just by virtue of the fact that starters are going so many fewer innings is an indication of a sea change in that regard, and one that is working. An oddity in all of this, though, is the Blue Jays and their league-leading Starter ERA (0.44 runs/game lower than second place) not getting their first complete game of the season until the ALCS. Gibby seems to have waited until the playoffs to let his faith in the starting pitcher get the best of him (See: Stroman, Marcus).

johnforthegiants
9 years ago

Obviously this is true in general but in the case of game 4 of the giants-cubs series it’s very likely that bochy pulling moore gave the cubs 4 more runs. Moore was pitching very well and the bullpen was unreliable and exhausted.

AnonMember since 2020
9 years ago

Wait, wait, wait. I can’t let this comment go. How exactly was the Giants’ bullpen exhausted?

Here is their pitcher usage over the end of the regular season and the playoffs:
9/30 Bumgarner 7.1 IP, Law 0.2 IP, Casilla 1 IP
10/1 Blach 8 IP, Romo 1 IP
10/2 Moore 8, Romo 1
10/5 Bumgarner 9
10/7 Cueto 9

So right there, no reliever pitched for 5 days between 10/2 and 10/8 and only Romo pitched the 2 days before that. Only Law and Casilla the day before then.

10/8 Samardzija 2, Kontos 2, BLach 1.1 Casilla 0.2, Law 0.1, Lopez 0.2, Strickland 1
10/9 Off day
10/10 Bumgarner 5, Law 2, Strickland 1, Romo 2, Smith 1, BLach 2
11/11 Moore 8, Law/Lopez/Romo all 0, Smith 0.1, Strickland 0.2

So:
– Lopez had not pitched at all in 2 days and only 0.2 IP total in the prior 11 days (at least).
– Smith pitched the day before but only 1 IP and not in at least 10 days before then
– Strickland had not pitched in 2 days and that was only 1 IP, then not in at least 8 days before then.
– Yes Romo and Law had gone 2 the day before but Law had 0.1 IP in the 9 days prior to that and Romo 0 IP in the 7 days prior to then

With the CG in there and the off day on 10/9, the pen had basically a week off.

How is that exhausted?

johnforthegiants
9 years ago
Reply to  Anon

Law pitched first in the inning. He has pitched 2 innings the day before, which he had done twice this year, and still had not regained his strength after getting back from the dl (he’d lost 2 mph from his fastball). Romo pitched third, he had also pitched 2 innings the day before, also had an extended period on the dl, and he hasn’t pitched 2 innings in years–the general understanding with him since he came back from the dl is that he shouldn’t pitch 2 days in a row even with his normal load of 1 inning a game.

johnforthegiants
9 years ago

I guess you haven’t been paying attention to the fact that law and romo were both on the dl for extended periods of time this year and you didn’t notice that they were 2 of the first three pitchers in the inning who got the tying run on base with no outs.

johnforthegiants
9 years ago

In any case, this isn’t the point of my post. The point is that bochy gave the cubs 4 runs by pulling moore for no good reason. Whether this was because the bullpen was exhausted (which i suggested) or generally incompetent (which i guess you are suggesting) doesn’t matter to this point. I leaned towards the exhausted explanation because they has pitched 15 innings before on the series and only given up 3 runs, and the difference between that and game 4 was law and romo having pitched 2 innings the day before. But if you want to go with general incompetence, fine, that doesn’t affect the point i’m making–in this case, turning to the bullpen resulted in *more* runs being scored.

output gap
9 years ago

Still salty.

v2miccaMember since 2016
9 years ago

Eventually MLB will need to do something to address this concern, right? I can’t imagine that Baseball wants its play-offs to morph into games regularly featuring 20 or more pitching changes, and 6 or fewer hits per 9 innings.

Concerned Reader John
9 years ago
Reply to  v2micca

I, for one, welcome our new bullpen overlords.

Operation Shutdown
9 years ago

Don’t look at me, I voted for Grady Little.

Johnston
9 years ago
Reply to  v2micca

I certainly hope so. I like the proposal by Bill James: a pitcher has to stay in until he has given up at least one run.

TKDCMember since 2016🏆 MVP
9 years ago
Reply to  v2micca

I like the pitching changes. More chances to go grab another beer.

WARrior
9 years ago

The article begins by noting that rpg are down in the postseason relative to the regular season, but no more so than in previous years. It’s implied that the drop this year, a remarkable 40%, is no less than in previous years. Yet the wOBA table indicates that the postseason wOBA in these earlier years was roughly the same as that for the regular season. Why would a more or less average wOBA translate into a much lower run total?

AJS
9 years ago

I’m not sure I entirely buy this — the gap was also large in 2010, when starters actually threw *more* innings per start in the playoffs than they did during the regular season.

Seems like in some years with really strong starters, they are better at run/wOBA suppression than relievers. In other years — like this one, where Dave has pointed out that many teams have rotation question marks — relievers are better at run suppression than starters. I would guess that at some point, it will swing back the other way.

O'KieboomerMember since 2021
9 years ago

There have been enough postsesaon games now to throw out small sample size concerns. Some of the best relievers in baseball like Wade Davis and Edwin Diaz are not even in the postseason. Why would we expect this group to magically be better than they were in the regular season? Your reasoning is a bit suspect here, dave.

JoeMember since 2020
9 years ago
Reply to  O'Kieboomer

You want to throw out small sample size concerns and Dave’s reasoning is suspect?

O'KieboomerMember since 2021
9 years ago
Reply to  Joe

The sample size is large enough now that it isn’t a concern. I suggest reading some of the primers on when rate stats stabilize, it’s on this website.

JediHoyer
9 years ago
Reply to  O'Kieboomer

I think you meant to say some of the last relievers in the pen are never used in the playoffs so it’s obvious why they are better than in the regular season.

LieutKaffeeMember since 2016
9 years ago

Wow I can’t believe Arthur stopped with runs per game what a rookie mistake.

Michael K Woods
9 years ago

Can we all agree that baseball-writers should adopt a new standard of using Runs per 9 Innings instead of the blasphemous runs per game?

Paul22
9 years ago

Me thinks SSS. I think the Blue jays (worst offense in AL in Sep/Oct) and slumping Red Sox have skewed some of the numbers this year in the AL post season, plus the Indians depleted starting rotation had the starters on shorter hooks.

I also feel the ball is not as lively as it was in the regular season, and the strike zone has been more pitcher friendly than usual.

That said, I do think Miller, Allen and Shaw are just as dominant as the 3 headed monster the Yankees had most of the year with Miller, Chapman and Betances. If they didn’t sell they could be going to the World Series instead of the Indians

In the NL, we have seen some pretty good bullpen failures,

That said, post season baseball lends itself to more reliance on bullpens since the best guys are available pretty much every game, and the shortness of the post season makes players willing to be used in more unconventional roles, Cant really do that stuff in the regular season

kevinthecomic
9 years ago

So the game being played in the post season is becoming more and more different than the game being played in the regular season. You cobble together a team that can, over 162 games, qualify for a tournament that will subsequently require a completely different skill set. This seems absurd. Wouldn’t it be better to have all teams play a balanced schedule and then just crown the best team at the end of the season or is the spectacle (and $$$$$$) that is the playoffs too entrenched in our psyche to change? Or, perhaps, I am too left-brain dominant.

jfree
9 years ago
Reply to  kevinthecomic

Baseball playoffs should be resolved via free kicks like soccer.

kevinthecomic
9 years ago
Reply to  jfree

That’s not a bad idea. Since the playoff game is so different than the regular season game, I was thinking they could even make the playoffs be a 3-on-3 basketball tournament. Or maybe have everyone strap on a pair of skates and play a game of hockey to determine the World Series winner.

Mahoney
9 years ago
Reply to  kevinthecomic

With 30 teams, you need some way to keep the fan bases excited for most of the teams for most of the season. If you got rid of the playoffs altogether, the level of tanking would be too much for even Sam Hinkie.