Kevin Cash Is Good and Bad at Challenges

While I was on my daily ambulation through the equivalent of the basement archives at Baseball Reference (the manager pages), I came across a strange fact: Kevin Cash, rookie manager of the Tampa Bay Rays, has challenged nine times this season and has not won a single time. That seems very strange, given the fact that managers generally have a good idea of when they’re going to win challenges nowadays: it’s why they stand at the top of the dugout steps while someone looks at video before they actually challenge.

We’ve had just over a year of the challenge system in major league baseball, and already we have a good idea of the types of challenges managers are most likely to win, the ones they’re likely to lose, and the ones that still seem to go either way for reasons that haven’t been and might never be fully established. That understanding is engrained in managers to varying degrees, and we now have enough data on the subject to identify the ones that seem to get it and the ones that don’t.

So, how and why exactly has Cash gone 0-9 so far this year? Does it matter that he seems bad at winning challenges? It also got me thinking: how have other managers fared, and are we thinking about this in the wrong way?

Needless to say, challenges are a tiny part of the massive equation of manager evaluation, but they’re certainly an interesting one. There was some great work done By Jesse Wolfersberger at The Hardball Times on when managers should and should not challenge that can inform our discussion today. This is the main part of the article that interests us, on the frequency of challengable plays (though you should certainly read the whole thing):

“So, should a manager challenge a one-on, one-out play in the first inning? According to my analysis, the likely answer is ‘yes.’ I found that the expected number of any over-turnable plays in a given game is less than one. Further, the expected number of over-turnable plays that go against your team in a medium-to-high leverage situation is far less than one.

Bottom line for managers: If there is a call that you have even a 50/50 chance of reversing, you should probably challenge, no matter the inning or the game situation. The odds are, there won’t be a better time to use that challenge later in the game.”

That final point is the kicker — when faced with half a shot at winning a challenge at any point in the game, do it. First, let’s take a look at every manager’s tendency to challenge, and their success rate in doing so. I’ve charted out all of the managers using the data from Baseball Reference’s pages, with new managers from 2015 at the bottom of the chart to avoid small sample size confusion. Managers who were replaced mid-season last year are grouped together as one:

Manager_Challenges

Joe Girardi is great at winning challenges, and the same could be said for embattled Marlins manager Mike Redmond. John Gibbons and Walt Weiss not so much, especially the former, who has one of the highest overall number of challenges and also the lowest rate of winning them. Down in our new manager section, we have three out of five off the mark with at least one overturn, then we have Paul Molitor and Kevin Cash. Molitor has only challenged once, so let’s key in on Cash, and his glaring 0-fer.

I’ve compiled the nine challenges he’s initiated this year below to try to see what’s behind his challenge strategy. I’ve also put the win probability shift for the team that eventually won the challenge, which is the team that isn’t the Rays in every circumstance.

#1: 4/6/15 vs. Baltimore, bottom 5, 2 out, down 0-3. Winning team win probability shift: 3%

Cash_Challenge_1

James Loney was clearly out at home on a single to right field to end the inning, but this is one of those gray area calls that isn’t bad to challenge — the home plate collision rule still seems to be misunderstood, or rather it’s still subjective and ill-defined. Still, through most of 2014, home plate collisions were overturned only 15% of the time, one of the lowest rates of all types of plays. If won, the Rays would have been down 3-1 with a runner on first. However, Loney was obviously beaten by the throw, so unless the umpires thought Caleb Joseph was blocking the plate, it would stand. And it did.

#2: 4/8/15 vs. Baltimore, bottom 4, 2 out, score even. Winning team win probability shift: 1%

Cash_Challenge_2

This was an incredible play by Manny Machado (it is one of the few plays labelled “remote” by our advanced metrics at 3B this year), and Logan Forsythe beats the throw. However, he was called out, and he steps in front of the bag without touching it, which is clear from many of the replays that were shown immediately afterward. Something that would become a recurring theme as I went through these challenges is that Kevin Cash pops straight out of the dugout after the play; there’s no waiting at the top of the steps while someone watching video tells him if he should challenge. There was no evidence that this out call should have been overturned, so it wasn’t, which is something the bench coach should have relayed to the manager.

#3: 4/14/15 vs. Blue Jays, top 6, 2 out, score even. Winning team win probability shift: 3%

Cash_Challenge_3

Here is where Cash should’ve gotten his first overturn. This was Desmond Jennings getting called out stealing second base with a tag that clearly missed. In a tie game in the sixth inning, a runner in scoring position is pretty valuable, and this was a no-brainer. Even though the tag looked like it missed from multiple angles, New York sided with the original call, and Cash was spurned again.

#4: 4/15/15 vs. Blue Jays, top 2, 1 out, down 2. Winning team win probability shift: 3%

Cash_Challenge_4

Another day, another Desmond Jennings out call at second base. The play was very close, but again, this is not a call that gets overturned unless there is clear evidence against the initial ruling, and there isn’t from the replays. This was another play that Cash popped out of the dugout on before having a chance to be briefed on video from a coach or staff member.

#5: 4/16/15 vs. Blue Jays, bottom 8, 0 out, down 4. Winning team win probability shift: 9%

Cash_Challenge_5

The third day in a row Cash would lose a challenge, this high and tight pitch was judged to hit Josh Donaldson on the hand with two men on base. These are also difficult to overturn — FiveThirtyEight puts them at 43% overturned through most of 2014 — especially when the pitcher almost hits the batter in the head. Cash was ejected immediately after the call was confirmed, citing “frustration with the process” in a postgame interview. He also did not appear to wait for video review on this play in the dugout before deciding to challenge.

#6: 4/18/15 vs. Yankees, top 7, 0 out, down 2. Winning team win probability shift: 0%

Cash_Challenge_6

Another play at the plate. Chase Headley was ruled safe, and is obviously safe on replay. Even the Tampa Bay announcers sounded resigned on this one:

“The way the Rays track record has been going…”

“The track record has been nil.”

The call stood, like home plate/clear tag calls usually do. This wasn’t a bad point in the game to challenge given the circumstances, even if there wasn’t much hope for this one.

#7: 4/19/15 vs. Yankees, bottom 6, 1 out, down 2. Winning team win probability shift: 2%

Cash_Challenge_7

Did Mark Teixeira come off the first base bag before he caught the ball? The initial ruling said he stayed on, and there wasn’t evidence to say otherwise. However, in the sixth inning with a leverage index around 1, it’s not a bad idea to challenge.

#8: 4/21/15 vs. Red Sox, bottom 6, 1 out, down 1. Winning team win probability shift: 5%

Cash_Challenge_8

We’ll talk about the opportunity costs of challenges following the recap, but this was a good place to challenge, even if Cash wasn’t confident of winning. With a leverage index of 2.13 on the play, this runner being safe instead of out in a one out, one run game would have been huge. The Tampa Bay announcers picked up on a theme of Cash challenges: “This is another one of those where… is there enough there to have it overturned?” The answer to that was no, and the call stood.

#9: 4/22/15 vs. Red Sox, bottom 8, 0 out, up 2. Winning team win probability shift: 2%

Cash_Challenge_9

This final challenge seems like a good point to start talking about those opportunity costs. The runners were ruled out at both first and third base (there was initially a runner on first that tried to get to third on the groundout). Every manager in the game should challenge this play if they still have one available, mostly due to the fact that it’s the eighth inning and they almost certainly won’t get another play to challenge in the game. Even if both runners were clearly out (which was slightly unclear from the replays), it would probably still be a good time to challenge, because you gain nothing from holding onto your challenge after the game. The opportunity cost for a challenge late in the eighth inning is very, very low.

This is also where the dominant unwritten guidelines for manager challenges come into play. Here’s a strange thought: Kevin Cash might actually be utilizing the challenge system better than other managers, simply because he’s not afraid to be wrong. If we grade Cash’s challenges by Jesse Wolfersberger’s method (leverage, which inning they were initiated, and possibility of winning), most of these plays are certainly worthy of a challenge. That they weren’t overturned is unrelated to whether they should have challenged, and we can see that at least one of them definitely should have gone Cash’s way. The issue isn’t that Cash has challenged often and lost; the issue is that other managers probably don’t challenge often enough.

So, does it matter that Cash is 0-9? Considering he probably shouldn’t be, and considering challenges are only a small part of a manager’s job, it matters very little. The issue for Cash is the public perception of him being wrong on the field so often, something that can have a way of growing against a rookie manager. Could Cash do a better job at having a bench coach look at video before he challenges? Probably, but that’s also in line with the dominant thought process — that challenges should only be made on plays a team thinks they have a very good chance of winning. As it turns out, the trigger for challenging should probably be much lower than it is across the league. To his credit, Cash seems to get that; but he still has an 0-9 next to his name, which has its drawbacks.





Owen Watson writes for FanGraphs and The Hardball Times. Follow him on Twitter @ohwatson.

31 Comments
Oldest
Newest Most Voted
JD
11 years ago

Pretty sure its 10 challenges. Last night he lost 2 challenges on the same play.

Bradley WoodrumMember since 2020
11 years ago

Great work, Owen! I really like that first chart, too. Does a great job of presenting the data.

Jeremy Koo
11 years ago

Another aspect to keep in mind is that so far, manager’s only need to worry about having a challenge in reserve through the sixth inning because I don’t think we’ve seen a crew chief refuse a manager’s request for a review in the 7th inning or later. There may be reputation concerns to challenging and being wrong so frequently (you keep challenging incorrectly so I’m not going to stop the game again for you because I think I’m right.). I think the embarrassment of I refused to review a play and replay would’ve reversed the call vastly outweighs reputation issues.

That aspect is why I was completely miffed by Robin Ventura not immediately challenging a safe call at second base last week in a tie game in the bottom of the 9th. Leverage is so high AND the crew chief will hand out free challenges at that point such that there’s nothing the video replay employees could tell him that would make him not challenge.

Grant
11 years ago

Regarding the Desmond Jennings tag at second base, a different angle from the third base side shows that he is clearly tagged on the left elbow. The umpires got it right.

CozarMember since 2020
11 years ago
Reply to  Grant

I was thinking even in this image used, it looks like the glove might be bouncing a little as it passes the arm, as if the very tip touched the arm but not was moving too fast to stick on it. Based on that, my call would be inconclusive, not “should have been overturned.”

Sandy Kazmir
11 years ago

I don’t understand why the call on the field is being relayed, presumably, to those making the judgment call. It should not be about confirming the replay. It should be about getting an objective opinion from someone that is seemingly an expert at making these decisions.

You give them an easy out when they can just say, “well it was too close to call” everytime. Why even have replay?

snoop god
11 years ago
Reply to  Sandy Kazmir

> “It should not be about confirming the replay.”

I completely disagree, that’s exactly what it should be about. The umpiring crew does not want “an objective opinion”, they want someone with access to high quality video replays to determine if the call was made in obvious error. If the video does not provide obvious evidence that the call was erroneous, then the video guy has nothing to contribute.

Sandy Kazmir
11 years ago
Reply to  snoop god

Agree to disagree then. It should be about getting as many right as possible without allowing biases to influence the outcome. As is, the human reviwer has plenty of room to side with his colleague on anything close.

Grant
11 years ago
Reply to  Sandy Kazmir

Many times, replay does not show the action in question, usually a tag. What good is replay then? It doesn’t tell you anything. The call on the field has to mean something.

skyshib
11 years ago

Why are managers ranked by success rates? Maybe I’m missing something, but shouldn’t the only figure focused on be total successes? (You miss 100% of the challenges you don’t make.) By that, Renteria was the best last year.

mgoetze
11 years ago
Reply to  skyshib

I would like to see managers ranked by WPA on challenges, or maybe sum of LI on plays that were successfully challenged.

Sandy Kazmir
11 years ago

You keep coming back to this point that Cash should have reviewed the play in the dugout, but that’s not in the current spirit of the rule. You’re no longer allowed to go out and stall for time. I agree that if you’re looking to speed the game up then forcing the manager to either challenge nearly immediately or sit back down is a worthy aim. All managers should be held to this same standard. Nobody wants to see Buck Showalter spitting and talking while some guy relays whether he should challenge or not.

nomo
11 years ago

Also, he was right twice last night. And I absolutely loved the calm certainty of “He was safe, and he was safe.” He is such a change from Maddon, and I’m really enjoying it.

Paul A.
11 years ago
Reply to  nomo

Looking at the replays multiple times, it seemed pretty clear to me that the runner was out at first, with third base being the truly close call, and even so, it looked to my eyes like the initial call was correct.

Neil
11 years ago

One of the obvious things missing from that chart with the success rates is how often the managers are challenging a call that’s obviously been blown (nearly 100% chance of over-turning) vs. a toss-up vs. a correct call (nearly 100% chance they’ll lose). Shouldn’t we be putting this in different buckets? Isn’t it possible that someone like Girardi has simply been lucky/unlucky enough to have had a lot of obviously bad calls made against his team? Or has he just somehow landed on the right side of a lot of iffy challenges?

Joe WilkeyMember since 2016
11 years ago

Wouldn’t it be best to show the difference in Win Expectancy for Cash being right against Cash being wrong? Sort of a Challenge WPA? Because if he’s wrong and it’s a blowout, the other team doesn’t gain that much if he’s wrong, but neither does he if he’s right. If it’s a close game, the other team may still not gain very much if he’s wrong, but it could be a big swing in his favor if he’s right.

radivel
11 years ago

Kevin Cash is going to be quite an outlier next year when you put this list up again and he has 40 successes out of 120 challenges, and the next most challenges used is someone with 24 successes out of 60 attempts.

Since there is zero downside to using a challenge, you might as well make sure you use it!

Good work, Kevin.

pft
11 years ago

I have seen a couple of his challenges where he does not even wait for the video review. On replay the call was clearly right and time should never have been wasted on a challenge. Maybe its a way of getting an additional commercial break now that MLB has shortened the breaks

PeliCans
11 years ago

Wouldn’t the only “bad” challenge be one that is not successful AND prevents a following play that could otherwise have been challenged (and won) from being challenged? I suppose we could go down a rabbit hole with what is a “better” challenge, but assuming there were no other plays that Cash should have been able to challenge after his failed challenges, it’s not really a loss, right?

Bill
11 years ago
Reply to  PeliCans

You can’t judge the merits of a decision based upon what happens in the future. Obviously, the manager wouldn’t waste a challenge if he knew he would need one later. As most managers do not have access to a time machine, I think it would be unfair to make judgements on their decisions based on future knowledge.

evo34Member since 2023
11 years ago

Year-to-year challenge success rate correlation?

Frank
11 years ago

“This graph can be read by picking a leverage on the x-axis, a probability of a successful challenge on the y-axis, and finding where the associated point lies. The different colored areas correspond to the inning of the game. If the point falls to the left, then the manager should not challenge, if it falls to the right, then he should.”

Forgive my ignorance, but where is the line/mark of demarcation for left (no challenge)/right (challenge) in the graph shown in the Hardball Times article?

DNA+
11 years ago

For the majority of plays managers have almost perfect prior knowledge about whether they will be successful on the challenge. Girardi isn’t correct so often because he isn’t challenging enough. He is correct so often because the Yankees have a team reviewing the video for him deciding whether the play is worth challenging.

Bill
11 years ago
Reply to  DNA+

So, let me get this straight. The replay umpires are in New York and they most often rule in favor of the most popular team in New York? Coincidence.

Bill
11 years ago

I agree with the premise of this article, however I hope other managers don’t start doing this. It would suck if we saw managers challenge every close call in the late innings. I’m not sure of a good way to prevent this, maybe if a team loses 4 challenges in a row, they have to go a game without one?

ReuschelCakes
11 years ago

1 clear problem with using win % is that an unused challenge and a lost challenge are effectively the same thing. I realize that yes, you lose the ability for more challenges later in the game… but whereas it looks like Girardi has bested his peers by winning 77%, in reality his 23 won challenges are pretty similar to say Maddon who has 21 with a much worse rate. Unlike in batting average or SB %, the other side of the coin is not a negative (or is an incredibly minor negative.)