Managing Decisions and an MLB Team
Author Michael Lewis described his new book, ‘The Undoing Project’, as a “prequel” to Moneyball in an NPR interview, so it should have our attention.
“It explains why experts’ intuitive judgments can go wrong and why you need to have data to rely on as a check against the judgments of these experts,” Lewis said.
One of the more interesting aspects of the book — which examines the work and relationship of Israeli psychologists Danny Kahneman and Amos Tversky — is the idea we are wired be more sensitive to pain than pleasure in decision making.
Said Lewis in an interview with Time advancing the book:
“Some of the most interesting ideas were these throw-away thoughts, like Danny’s idea they played with for a while—how people making decisions aren’t actually trying to maximize their returns, but minimize regret. I see it all that time in people’s decisions.”
For instance, when offering research subjects $1,000 — or — having a 50% chance to earn $2,500 depending on the result of a coin flip, most chose the certainty of $1,000. From a Kahneman and Tversky paper recounted in the book:
“The greater sensitivity to negative rather than positive changes is not specific to monetary outcomes,” wrote Amos and Danny. “It reflects a general property of the human organism as a pleasure machine. For most people, the happiness involved in receiving a desirable object is smaller than the unhappiness involved in losing the same object. … Happy species endowed with infinite appreciation of pleasures and low sensitivity to pain would probably not survive the evolutionary battle.”
Kahneman and Tversky changed how “we think about how we think”.
Their work, Lewis’ book, had me thinking about how it might apply to baseball decision making, and to the role of a major league manager.
The role of manager has been diminished in the modern age of baseball. The front office has grown its power and influence in regard to roster construction and even in-game strategy. Managers are more and more often seen as extensions of the front office, that must be in general agreement with the philosophies and practices of the general manager. But managers are still making the greatest volume of decisions on a daily basis for a major league club. They still hold the power over the lineup card, bullpen usage, and pinch-hitting decisions. They ultimately give green lights to base-runners, choose whom to rest, and preside over advance scouting meetings when strategies are set.
However lessened the role is, a major league manager is still a key decision maker.
And unlike a general manager, whose role is assessed at intervals, a manager is subject to questioning 324 times during the regular season by the press alone, as managers are required to speak with the media twice a day (before and after games). The manager has to deal, daily, with players whom his decisions effect in terms of playing time and future earning potential. He also has to answer to a front office. There is much answering to be done. And, like the rest of us, managers are subject to second-guessing themselves.
So in reading the studies of Kahneman and Tversky, what interested me is how major league managers avoid the trappings of their human hard-wiring. How do they avoid acting against their own club’s own interest? For example, how do they avoid shying away from making bold call —- a decision that might be unorthodox though it would increase the probability of a win — but could yield much more second-guessing if it fails? How do they stick to what they believe is the best decision when thinking about a situation in the quiet of their office before a game, but a decision that could be swayed by the in-game emotion in the dugout during a game?
To gather some understanding, I spoke to three MLB mangers recently about the subject: A.J. Hinch, Terry Francona and Joe Maddon.
Seated in the visiting dugout at Progressive Field for his pre-game media briefing last month, Hinch said he tries to “manage the game at 2 o’clock” in the afternoon.
“It keeps the emotion out of the game,” Hinch said.
Hours before the game Hinch said he is trying to conceive of every scenario possible his club might face, and he tries to out an approach for each situation in his office. He attempts to make as many pre-determined decisions as possible. For example, if the Astros are facing Indians first baseman Edwin Encarnacion late in the game in high-leverage situation, he already knows whom he wants to face him, and how he wants that pitcher to attack him.
“I second guess myself only if I come across a possibility I didn’t recognize before hand,” Hinch said. “Maybe I could have someone else up in the bullpen … I don’t second guess the result, I second guess the process. All I can do is put my guys in a position where I feel it’s the right thing to do, whether it’s batting order, playing time, inserting a bench player, sitting [Jose] Altuve …… But If I had a bad process, I will beat myself up.”
Hinch mentioned a situation when Brian McCann faced Andrew Miller later in a game earlier in the series. After the game, he thought he perhaps should have pinch-hit for him. He noted how he regrets having Chris Devenski up in the bullpen when he doesn’t call upon him.
If a plan goes awry he said he is second-guessing himself about a decision “way before” the media ever approaches him after a game.
Hinch said he’s always thinking at “100 mph” that his “mind never stops.” But he believes he’s more “conservative” before a game.
Of course, not every scenario can be foreseen hours before a game. Like Hinch, Madden is seen as one of the more analytically-minded managers in the game.
I asked Maddon about how he avoids regret in decision making.
“Fortune favors the bold. That is what you are talking about,” Maddon said. “If you are concerned about answering a question about a [poor outcome] then you will never make that decision, the bold decision. You are going to choose the conservative method that is easily answerable. And I totally disagree with that. I would never want to be that guy. I don’t mind being second guessed. I would definitely mind making a decision based upon the path of least resistance, avoiding turmoil, if it doesn’t work.”
Maddon embraces data, and is supported be a robust, analytically-friendly staff and front office. Maddon tries to work out some decisions, like Hinch, hours before a game but notes not every scenario can be foreseen before hand.
Interestingly, Maddon does see more and more value in intuition. It was after reading a different book, Malcolm Gladwell’s Blink that Maddon became more comfortable with trusting his instincts during games. In Blink, Gladwell argues the human unconscious is a powerful tool and often leads us the right way in making snap judgments.
“I try to keep the emotion out of it,” Maddon said. “But since I read ‘Blink’ I am more comfortable with it. Understanding intuitive thinking, I’m a little bit better now at trusting it. And realizing it is not just pulling something out of the air. It actually can be something you’ve nurtured for a long period of time, unknowingly, then you draw upon it in the moment. Thinking in those terms, I’m comfortable with it. But most of the time, everything I do, I think about it right now before the game begins. I come out here and talk to you guys [the media] and go back and re-address it. The game starts and stuff happens and things get blown up a little bit then you have to be able to adjust on the fly.
“Everyone wants to treat this like it’s fantasy baseball. It’s not. If you just want to sit in a cocoon somewhere based upon numbers and … pitching match-ups, whatever. That’s one way to do it. But that’s not reality. You have to plan out in advance, but then you have to be flexible to adjust.”
Indians manager Terry Francona is also supported by an analytical-friendly front office. He has an appreciation and grasp of the statistical tools available to him. He makes some decisions pre-game, like the availability of relief pitchers, so he cannot, say, get caught up in the emotion of the game in the eighth inning and call to the bullpen for a trusted but overworked arm.
But Francona says he limits the pre-determined decisions. He is comfortable letting the game unfold and making decisions on the fly.
“I always look [pre-game] at the lineup to see where guys can fit, then I look at the bench to see what they potentially could do,” Francona said. “I think A.J. [Hinch] is probably a little more book-smart than I am, probably a lot more. I can’t necessarily do that at two in the afternoon, but you certainly try to look and see what could happen, and what you’d like to do. Like, there’s certain guys I’m more comfortable with some of our guys facing. You get in crazy games, sometimes you can’t do that. If everything’s going according to plan, I have certain guys I’d rather face.”
All managers manage their clubs in different ways, but all managers questioned are putting in place pre-game practices to protect them from themselves from decisions that might be more rooted in emotion than logic in games. Managers are wary of being second-guessed, particularly by themselves.
A Cleveland native, FanGraphs writer Travis Sawchik is the author of the New York Times bestselling book, Big Data Baseball. He also contributes to The Athletic Cleveland, and has written for the Pittsburgh Tribune-Review, among other outlets. Follow him on Twitter @Travis_Sawchik.
The Undoing Project is excellent. I’d highly recommend it. As I was reading it I thought to myself – man, each chapter would make a great article with the concepts applied to baseball. Great stuff Travis.
But seriously, stop scooping me. 🙂
I’ll echo the endorsement for The Undoing Project and add Kahneman’s Thinking, Slow and Fast as a must-read.
Unfortunately, so much of that book has not survived the replication crisis.
Yeah, Chapter 4 is a mess. Ironically, if he had taken his own advice on rationality he would have seen this coming. See: https://replicationindex.wordpress.com/2017/02/02/reconstruction-of-a-train-wreck-how-priming-research-went-of-the-rails/
If you’re really interested in this topic, books like Dan Ariely’s “Predictably Irrational” and Duncan Watts’ “Everything Is Obvious, Once You Know the Answer” are really well-researched, accessible books about how common sense doesn’t work well.
There’s also something that I think we miss about managing and data and intuition. One of the most important skills a manager has (and that both Maddon and Francona have in spades) is emotional intelligence. Knowing how to keep players in the best possible mental state to perform is an incredibly valuable skill. We know very little about how to do that, beyond that some people just seem to have it and others don’t. Having that skill allows you to avoid second-guessing by players (who are the ones who matter). It also gives you a sense of when the “rational” decision is going to kill morale, and when it’s going to fire the guys up. Maybe you can call that “intuition” but it’s not the type we usually associate with it.
This is a very important point that might not get picked up if you’re analyzing it from the view of a manager being questioned 324 times during the regular season. A manager is obviously trying to win the individual game but its the long term management over the course of a season that is the skill that sets good managers apart from the rest. In a 162 game season the best long term decisions may not always coincide with choosing the best relief matchup or pinch hitter for individual games.
Well, someone should pick on Kahneman and Tversky, so I will. The sequel to Freakanomics has an excellent takedown of their work, forget the professor’s name tho’. In essence, surveying college students or putting them through artificial experiments has obvious limitations that professors and other people don’t recognize because they don’t want to.
“Hunch said” Tell me that wasn’t deliberate.
Some interesting reading for me to do here. Thanks.
re risk aversion and ego. The military has long had a way of countering that in order to separate personal risk from decision risk – just assume you are dead already. Can work in business/baseball too – assume you’re fired or your job ends. Once you stop trying to protect yourself from the consequences of the decision, it becomes much easier to look at the decision as its own thing where you are merely the implementation tool. And a whole world of what otherwise seems like undue risky options opens up.
Course you also need to minimize the other personal ego thing – the notion that yeah you’re gonna die so it better be in a blaze of glory with medals and such. Cuz that will simply lead you to risk-for-risks-sake decisions.
“… people making decisions aren’t actually trying to maximize their returns, but minimize regret.”
I agree. But then I also agreed the first time i heard this, 30+ years ago in a business psychology course when I was doing my MBA. Did Kahneman and Tversky represent this as original?
It is when you assume that people are rational – and that assumption is a lot more pervasive than we might think. And they did much of their original work 40 or so years ago
They probably had the original, and your business course got it from them. Kahneman and Tversky started developing their theory in the 1970s.
OK, I misread the article, mistakenly assuming that the influences for Lewis’s new book were recent. My bad.
As it is, just for fun I pulled the textbook from my course (“Judgement and Choice” by Robin Hogarth, originally published in 1980) off of a very high shelf, dusted it off and looked for references to Kahneman and Tversky. Appendix D “A guide to further reading” cites at least 12 works attributed to either one, or both of them.
I stand corrected.
According to the belief of many, this is why NFL coaches punt on 4th and short (and otherwise are conservative). It’s easier to do what is expected, than to get questioned if/when you do something not ordinarily done, and it fails.
Just addressing the $1000 vs $2500 / 2 scenario, I think it’s a serious fallacy to attribute the “people usually go for the sure money” result to “a preference to minimizing regret or loss over maximizing gain”.
Rather, at least in that specific example, it is a fallacy of that argument to treat every dollar as equally valuable. Instead, the (marginal) happiness gained by getting $1000 vs the (marginal) happiness gained by getting $2500 is a lot higher than 2 out of 5. The first thousand is a lot more meaningful to happiness than the second fifteen hundred, and therefore from a “expected total happiness gain” perspective, if the $2500 is only, say, half again “as happy” as $1000, and discounting that by half for the coin flip results in lower expected happiness than by just taking the sure $1000 (3/4 of the relative happiness for taking the flip relative to the sure).
This is exactly the same reason players sign pre-arb long term contracts at the expense of free agency. Sure they sacrifice some long term earnings expectations, but the first million is a lot more meaningful than the tenth million, and it is absolutely a fallacy to attribute this to “regret aversion > maximizing gains” when in fact what they *are* optimizing expected gains, just not on a monetary scale.
Not that I think this is necessarily wrong or anything, just that they need to be extremely careful about study design, and how that example in no way supports the stated argument.
When I studied this stuff in school, it was used to explain how insurance companies make money – people are generally more willing to spend X dollars to prevent a possible loss of Y dollars, than to invest the same X dollars in order to gain Y dollars.
Think of it this way:
You have a meeting with a potential customer that you’re pretty sure you’re about to close with for a $2500 fee – all you’ve got to do is show up to the meeting on time (the customer is really big on punctuality). When you get to his office there is no parking anywhere except for a tow zone that advertises that the fine for illegal parking is $500.
So … even if you get towed, your expected return is still close to $2000. Do you park the car and take your chances on the parking inspector? Or do you keep looking for parking and risk blowing the deal?
If you have to think about it at all, you’ve proved their point.
To be fair, the idea that happiness could be a “gain” was inconceivable when Kahneman and Tversky were writing. The modern summary of it is too loose, but part of the reason we can even talk in these terms is because of the work Kahneman and Tversky did–the argument is/was between people working in a rational choice paradigm vs. prospect theory, and a lot of the happiness economics work builds off of their work.
Telling response by Maddon, one of my least “favorite” managers, decision-making-wise (not commenting at all about his motivational skill, etc.).
One, whether a decision is bold, unconventional, follows the path of least resistance, etc., is irrelevant and should NEVER be a consideration. A decision is either correct, incorrect, flip of the coin, or we simply don’t know, based on data and analysis. Some correct decisions are easy and many incorrect ones are bold. In fact, many of Maddon’s worst decisions (and he’s made many, especially in the post-season) are “bold” ones.
I have said many times that I think that Maddon likes everyone to think that he is the smartest manager in baseball and consequently makes many unconventional decisions, many of which are awful. As I said, whether a move is conventional or not has nothing whatsoever to do with whether it is correct or not. The correct decision is the one which increases a team’s chances of success in the short and long-term (it is sometimes difficult to balance the two), at least from one perspective. (There are many perspectives – e.g., from an owner’s perspective, it MAY be the one that makes his team the most amount of money.)
The other thing he said which is simply indefensible is that he has learned to “trust his intuition more.” Now, that is obviously a complex subject, but I can say with a high degree of certainty that not only are there very few decisions in baseball that can be correctly surmised from “intuition,” but the single most prevalent cause of bad decisions in baseball and in many areas of business and life (but not necessarily in love!) is intuition or “going with your gut.”
If you want to call actual knowledge by a manager of things which we, as outside observers and analysts may not know, “intuition,” well, that’s a different story. However, regarding that, I can also say that in my 25 years of research (and I have researched hundreds of things in baseball), I almost always find that what managers think they know that the outside observer does not, such as when a pitcher is tiring or pitching well, when a batter is hot or cold, or which batter or pitcher matches up best with his opponent, is almost always false.
So, based on data and 25 years of research, I have no faith whatsoever in manager “intuition” or “inside knowledge” (I’m obviously not talking about things like injuries we don’t know about, and the like).
If you think that Maddon’s “ring” and the success of the Cubs last year is some indication of Maddon’s managerial talent, I’ll say this: Motivation is probably a pretty big part of managerial skill and Maddon may be very good at that. I only comment on his in-game and pre-game decisions (like lineups and personnel).
Also keep in mind that he’s managed 14 years with 2 pennants and 1 WS, hardly a monumental achievement. His overall record is .535 about that of the average team at home, again, nothing earth-shattering by any means.
Finally, by far and away the lion’s share of a manager’s w/l record belongs to the talent of his teams (yes obviously the manager has some effect on that). When the Rays sucked his record sucked. When the rays got good, his record got good too. The Cubs last year, talent-wise, were one of the best teams in baseball history regardless of who their manager was. Most forecasters pegged them for 98 wins.
Disclaimer: All that I said in those last few paragraphs, in my informed opinion, has virtually nothing to do with a manager – I merely mention it to foreclose on those who would (incorrectly) cite his 2 pennants and 1 WS win and good team w/l records in 2015/2016 as “evidence” of his greatness.