To Walk or Not to Walk
In my head, the playoffs have always had a unique relationship with analysis. Things are happening, always new and exciting things, and I feel a strong desire to know what’s skill and what’s luck, to sort out whether Adam Wainwright found the secret formula to pitching or whether he just had a good breakfast Sunday, while the Braves stubbed their collective toes on the hotel bed frame.
But for the most part, there’s not much to say conclusively about one pitching outing, or even a few pitching outings. The samples are vanishingly small in the postseason, and so I watch for the narratives and the drama, rather than trying to find an interesting line to analyze. Sure, I have opinions about the players in the playoffs, formed from a year of crunching numbers on their performances. But for the most part, I don’t use October to tell me new things about them.
If Patrick Corbin comes in and gives up six runs in relief, is he bad? Is he unsuited to relieving? Did he just not have it that day? I don’t know, and short of some velocity or spin rate smoking gun, I’ll probably never know.
Having said all that, there’s one thing I feel very comfortable analyzing. Managers still walk people intentionally in the playoffs, and maybe they shouldn’t. Dave Martinez and Mike Shildt succumbed to the temptation of making a difference over the weekend, and while neither decision ended up impacting the final accounting of the game, I was curious to see what those walks did to the teams’ chances of winning.
Let’s talk about Martinez’s decision first, because it’s much stranger. We’ll set the stage with all the essentials: in Game 2 of their series against the Dodgers, the Nationals took a 4-2 lead into the ninth inning, with Daniel Hudson taking the mound following a dominant inning by Max Scherzer. Justin Turner doubled to start the inning, but Hudson rebounded, striking out A.J. Pollock and getting Cody Bellinger to pop out to third.
Then things got weird. Max Muncy was due up next, and Martinez had a plan. That plan? Walk Muncy intentionally, putting the winning run on base and bringing Will Smith to the plate. It doesn’t take a beautiful sabermetric mind to know that this is a pretty wild decision, but let’s go through it just to make sure.
First, there’s the raw unadulterated win probability change. I used FanGraphs’ win probability inquirer to work out how much this move would cost the Nationals in an otherwise completely neutral context. Before the walk, the Nationals had a 94.7% chance of winning the game. Afterwards, that number fell to 90.2%.
That’s obvious. Walking a batter makes for more runners on base, and runners can score runs — we’re not simpletons here. The question, then, is whether the upgrade the Nationals received from facing Smith rather than Muncy recouped that 4.5% decrease in win expectancy. I’ll save you the suspense upfront — nope!
But let’s go through the math anyway. Normally, we could just look at wOBA to compare two hitters. Daniel Hudson has no career platoon split, and pitching platoon splits are pretty reliable at the sample size we have for him — he still has a below-average platoon split even after regressing somewhat towards the mean. Max Muncy also has no observed platoon split, but his is in a smaller sample and batter platoon advantages stabilize much more slowly, so his platoon advantage is likely around 3.8% or 13 points of wOBA (using some handy formulas from The Book).
Take the requisite projections and platoon splits for Muncy, Smith, and Hudson in this fashion, and use the odds ratio method to calculate expected pitcher/batter combinations, and Muncy projects to a .349 wOBA against Hudson while Smith projects to come in at a comparably poor .294 wOBA. That 55 points of wOBA is a big edge — something like the difference between facing 2019 Francisco Lindor and 2019 Leury García.
Per a handy post by Tom Tango, we can convert the wOBA to wins and vice versa. Do the math, and the Nationals would have needed to face someone with a wOBA 150 points lower to have this walk make sense. That’s not the difference between Lindor and García; that’s the difference between Alex Bregman and worst-qualifying-hitter Orlando Arcia.
Okay, so wOBA and win probability math says this walk was abysmal. We can do better, though, because wOBA isn’t quite right for this situation. Context-neutral stats like wOBA don’t perfectly capture what’s going on in a given situation, even if you adjust them for leverage. As a simple example, with a runner on third and less than two outs in a one-run game, wOBA will overvalue walks and undervalue contact. In the Nats/Dodgers situation, wOBA undervalues home runs, because it takes the average value of each outcome over all games, whereas a home run is exactly what the Dodgers needed.
To handle this, I went a little further into the math. I worked out the expected chance of each outcome for each player given the relevant platoon situation, then used the same odds ratio method for the two matchups. From there, I simply looked at the win probability in each end state. For example, if Muncy made an out, the Dodgers were done — the Nats would be 100% to win. If he hit a home run, the Dodgers would be tied, which works out to a 46.1% chance of Washington winning per our tool (in reality, it was probably lower given that the Dodgers are the better team).
I’m not going to show you the nitty-gritty details here, because ew math, but here’s an example. Muncy projects to hit a home run in 4.9% of his plate appearances against righties. Hudson projects to allow a home run in 3.2% of his plate appearances against lefties. The league average is 3.6%, which works out to Muncy having a 4.3% chance of hitting a home run in a given appearance against Hudson.
Plugging those values in, the Nationals were 94.3% likely to win the game when Muncy stepped in. That’s slightly lower than the naive expectation of our WPA inquirer, which makes sense: Muncy is better than the average batter. After the intentional walk, the Nationals were 89.8% to win the game. That’s a 4.5% drop, exactly what the generic numbers said. In other words: don’t walk Muncy!!!
That’s one intentional walk covered. Now let’s turn to Sunday’s Cardinals/Braves tilt, where Mike Shildt faced a slightly different situation. In a one run game with a runner on third and two outs, Shildt had the choice between facing Brian McCann or walking him to face Dansby Swanson. Once again, a manager chose to put an important runner on base to gain some ephemeral advantage.
The difference is, this one isn’t as bad as Martinez’s decision. Here, the Cardinals’ odds of winning the game fell from 86.9% to 83% in the generic case. 3.9% of a win is nothing to scoff at, of course, so it’s still a bad decision in the generic case. Let’s delve into the situation, though, to see whether this one was more merited.
First, we’ll do the wOBA method again. McCann has a greater than normal platoon split over a pretty big sample, and Carlos Martínez has an even larger platoon split over an even larger sample (and pitcher splits stabilize more quickly). On net, we’d expect McCann to produce a .316 wOBA against Martínez, while Swanson would project for an abysmal .252 wOBA. That’s a huge gap!
Next, we plug in the win probability change (.039 wins) and leverage situation and get that we’d need to see an 77-point wOBA gap between the two hitters to make it worth it. The actual gap is a mere 64 points, so it wasn’t worth it, but it was close. If McCann had been a slightly better hitter, or Swanson slightly worse, it might make sense.
Now, let’s add in the individual outcomes method. Before McCann came to the plate, and assuming no intentional walk, the Cardinals had a 87.7% chance to win the game, more or less in line with our naive expectation. When Swanson stepped in after the walk, the Cardinals were — wait for it — 87.6% to hold on. That’s right — the intentional walk did almost nothing.
This isn’t an intuitive result, so I ran through the math a few times. It comes down to a few things. First, McCann is basically a league average hitter against righties and Martínez is a league average pitcher against lefties. On the other hand, Martínez is one of the best pitchers in baseball against righties (expected .268 wOBA), while Swanson is below average against righties. Even more than that, Swanson gets most of his production from singles and walks, without much thump to speak of. Extra base hits are the way you get burned by this walk, and Swanson is not an extra bases kind of guy for the most part.
In the end, neither of the decisions mattered. Hudson walked Smith but struck out Corey Seager, and the Nationals won. Martínez gave up a first pitch double to Swanson, and the free baserunner the Cardinals gifted the Braves ended up scoring along with Swanson to make it 3-1 Braves, but the insurance run didn’t matter; the Cardinals didn’t score in the bottom of the ninth.
That’s merely what did happen, though. The math says that the Nationals absolutely shouldn’t have walked Muncy, while the Cardinals were pretty expected-value-neutral on their decision. Intentional walks are often bad, and data-savvy fans are rightly skeptical of them. That doesn’t mean they’re literally never the correct decision. Were I in Mike Shildt’s shoes, I still probably wouldn’t have walked McCann. But it was a close call due to Martínez’s extreme platoon splits, something that wasn’t obvious as I watched.
Ben is a writer at FanGraphs. He can be found on Bluesky @benclemens.
Muncy though thru the IW had gone 3 for 6 and had hit a home run in his prior at bat.
Smith on the other hand had gone 1 for 7 with 3 strike outs After a September where he batted 10-57.
even Seager had gone 1-7 with 2 strikeouts. And had not looked good at all.
I think I agree with Martinez that you don’t let Muncy hit there- even if it’s not an IW, it’s a pitch around(and if it gets to even 2-0, it’s then an IW).
I would have been totally cool with a pitch-around. Throw some garbage up there and see if Muncy is too over eager and gets himself out. If you end up walking him that’s fine, but they should have at least made a token effort. Craziness.
wow 3 for 6 that’s like a .400 hitter
Give or take .100.
Which isn’t even relevant to the discussion, anyway.
Fantastic and perfect {clap clap}
Really great piece and just cause you did the extra leg work on the math. You asked a question (“was the walk worth it?”), then immediately answered it (“no”), and THEN gave the details. This way of storytelling is sooooo much better in industry because otherwise the audience is not really paying attention to your math and trying to figure out the answer. I wish more people conveyed information like this and relied on the intrigue of the question/answer details to lure people into keep reading after already knowing the answer.
Ben Clemens: “Was it worth it? / Let me work it”
This is a great piece, but I want to point out that you worked under the assumption that Carlos Martinez was going to pitch regardless. I would have liked to see Shildt bring in Tyler Webb to face McCann. Then if the Braves pinch hit, bring in Gallegos.
Well, if Shildt brought in Webb he’d have to face at least one batter before Shildt could bring in Gallegos. So realistically we’d probably be looking at Webb vs. a pinch hitter, either Flowers or Cervelli, both poor against lefties. Plus Webb has very good numbers vs. righties, so Webb vs. one of those guys with a runner on third is still far preferable, imo, to Martinez vs Swanson with runners on first and third.
Wow I completely forgot about that rule. Thanks for correcting me civilly!
I think the take away is that the gap between the current hitter and the guy in the on-deck circle may feel significant, but it likely never covers the run expectancy shift unless the guy at the plate is trout or the batter on deck is a pitcher.
I’d say there are more top tier hitters than just Trout where it’s often worth it, plus there are other game situations (such as runners on 2nd and 3rd with one out and a one run lead) where the win expectancy drop for an IBB is much less.
and not just a pitcher but one who is either going to likely stay in to hit or be replaced by a terrible pinch hitter
Ben,
How do the odds change if you walk McCann, but have to assume that with Billy Hamilton on 3rd, the pinch runner has a cake walk to 2nd?
I think the Hamilton factor also makes pitching to Swanson harder than pitching to McCann. McCann has trouble with high velocity and Swanson has trouble with Sliders away. I think having Hamilton on third took that pitch away from Martinez because he couldn’t risk a pitch in the dirt.
Re-ran it assuming an automatic two-base IBB, which feels like the only way to really do this. In that case, the Cardinals’ win probability drops down to around 83% depending on how you feel about Ortega scoring from second on some of Swanson’s singles. This, indeed, makes it a bad play.
As to the slider thing, and the high velocity thing, that seems like a fine reason to weight your decision-making against walking him, and again, I wouldn’t have walked him. But they clearly weren’t huge considerations given that Martinez threw a first-pitch slider. For better or worse, Yadi seems quite confident in his ability to block pitches.
Thanks for the re-run analysis.
Occasional discrete factors like this often overwhelm generalities. It’s also the exact reason every play-off bound team should have made every effort to add Hamilton to their team.
As for the slider, anecdotally I feel Swanson is just fine hitting sliders that start up and in a go into the strike zone but pretty horrific at sliders that start in the strike zone and dart out of it. Perhaps Martinez just missed his spot. Regardless, it’s these intricacies that make baseball so fun.
Why would the Cardinals want Hamilton when they already have the same guy but with a somewhat better bat in Bader?
I had the same reaction to Eaton’s no out sac bunt to get Trea to second. Given Eaton’s on base percentage, it boggles my mind that he is allowed to do this. The decrease in run expectancy is 7.3% for this sac generically (BP).
And Eaton’s OBP is .365. Is it possible that Julio Urias is so good at preventing runs that this sac was warranted?
And this is against one of the top defenses in baseball (if not THE top).
I think Eaton faced urias once before this season and was out on a fly.
I’m just digging for a sabermetric reason that Eaton could do this. I don’t want to be this outraged over mismanagement.
The question is- Is the increase in run expectancy that an IBB entails worth the perceived (probably not real, but perceived) decrease in the chance of giving up one run?
For example, man on third, one out. Giving an IBB to the next batter (especially if he is better than the next batter) may increase your chance of getting out of an inning unscathed (a double play, etc.), but increase the chabce that if something goes wrong (a double or home run) that you’ll give up more than one run.
Schidt said exactly this in his explanation for the IBB to McCann- he realized it put the go-ahead run on first, but felt it gave him a better chance to give up zero runs (I think he was wrong, but that’s what he was thinking)
This is not directed solely at you, the author of this piece, but it is endemic here on Fangraphs and is an egregious error committed right in the first paragraph. Stop calling random variance – over and under achievement – luck. It isnt. The things these players do on the field happen based on their skill, not happenstance.
Clearly the individuals writing these articles understand the math behind statistical analysis, which means they have no excuse for calling random variance luck. Those are the kinds of things taught in Stats 100. For those of you who might not be aware, here is the difference.
Rolling a die is pure luck. There is no rhyme or reason to when a certain number will come up, and any pattern that is produced is coincidence. Luck cannot and does not regress to the mean. Every result has the same chance, no matter who tosses the die.
Random variance is the ebb and flow of a particular performance in a given sample of time. Because the results fluctuate, even given consistent inputs, variance based on a particular input (in this case, player skill) does regress to the mean. The input determines the range of results, and their likelihood of occurrence.
For example, Fernando Tatis Jr is very likely not a “true talent” .410 BABIP player. Next year, his BABIP is likely to be very near what his actual talent is. If his BABIP were based on luck, then next year his BABIP would likely be around the league average. In fact, were it luck then projections would make no sense at all, because everyone would be assumed to be league average.
Surely this is not what the author, and the other authors here at Fangraphs, are suggesting. But by calling the random variance in performance luck, they are implying it unintentionally. Calling this variance luck is more inaccurate than using RBIs or Wins to determine who had a good season.
Why this is important is because over time we are getting further and further away from what questions we should actually be asking, namely: Is this sustainable? All the new metrics and measuring tools available to analysts have caused an increase in sloppiness of reporting of what is actually going on.
When we look at new metrics we are attempting to see if we can quickly detect a change in skill. In essence, what we are attempting to ascertain is whether the input has changed, and if so, how much? Given the input, predicting player performance becomes more accurate.
And again, at the risk of pedantry, if the variance were just luck, none of this analysis has any meaning!
The goal of the analysis is accurately determining the nature of the inputs, and quickly judging when those inputs have changed, versus when a player is just over (or under) achieving.
tl;dr It aint luck, folks.
While you’re technically correct, I don’t think this is causing any problems with the actual analyses on Fangraphs. They’re just using the wrong terminology.
Good analysis. I was also surprised that the intentional walk to McCann is such a close call.
That said, I do wonder about a couple additional considerations on whether the McCann-Martinez matchup should be more in Martinez’s favor than the overall projection that McCann is league average against RHP’s and Martinez is league average against LHB’s.
(1) Understanding the danger of looking at small samples and assuming that they’re predictive rather than just slumps (or streaks) that are likely to end, I wonder about a thesis that McCann is a fatigued 35-year old catcher who right now is less than the league average hitter against RHP’s indicated by his overall numbers. His second half overall wRC+ was only 74 – albeit in just 130 PA’s – and his wRC+ was even lower than that in August and September.
(2) I recall reading a claim – probably in the comments here – that McCann in recent years has struggled notably against really high velocity 4-seam fastballs. I’m not aware how to check on that claim easily, but it seems relevant (if true) since Martinez hits 98-99 on his 4-seamer.
The biggestheadshaker to me had nothing to do with probability. Intentionally walk Brian McCann? Brian McCann? To get to a hot hitter?
I like to refer to intentional walks as “The Coward’s Last Bastion”
You and AJ Hinch , apparently.