Playoff Formats and the Marginal Win

In the weirdest year of baseball history so far, 2020 featured a gigantic playoff field introduced right as the season began, turning a 10-team postseason into a 16-team format. Changing the basic structure of awarding the sport’s championship with no advance notice would have been an odd choice in a normal season. But given the 102-game reduction in the league’s schedule and its resulting small sample size season, it kind of made sense. When the decision was made, it wasn’t a surety that there would even be a season, to the point that people would have been happy if extra-inning games were decided by closers riding ostriches and jousting.

So what is the ideal playoff system? That’s a difficult question, one that’s impossible to answer to everyone’s satisfaction. I can only answer for myself, and for me, there are a few requirements that are particularly important. Basically, I want a system in which regular-season performance matters, thus maintaining one of the core aspects of the game. I also want a playoff system that more heavily awards quality over randomness without making the result a preordained one. The more a championship is decided by randomness, the less incentive there is for teams to innovate and invest.

To keep people interested in baseball’s long regular season, the wins have to actually matter. So what is the value of an additional win under various playoff formats? To answer this, I reconfigured ZiPS to run using four new playoff formats: a 14-team playoff system with byes for the top teams in the first round, a 16-team playoff system like last season, a four-team playoff system with the top two teams advancing, and the no-division format in use before the 1969 season. I then ran 31 simulations for each playoff format, first to get the baseline World Series win probability, then adding a single win’s worth of strength to each of the 30 teams in order. After writing three new models and running a million seasons in 155 separate simulations, I’ve got some hard data I did not previously have. Also, I think I hate numbers and never want to see one again!

World Series Probability, Current System
Team Current WS Probability With One More Win Change
Los Angeles Dodgers 14.67% 15.91% 1.24%
San Diego Padres 11.44% 12.58% 1.14%
New York Yankees 10.87% 11.99% 1.12%
Minnesota Twins 8.13% 9.12% 0.99%
Chicago White Sox 7.87% 8.83% 0.96%
New York Mets 6.64% 7.52% 0.88%
Oakland A’s 6.03% 6.88% 0.84%
Atlanta Braves 7.88% 8.71% 0.83%
Tampa Bay Rays 5.09% 5.91% 0.82%
Toronto Blue Jays 3.99% 4.69% 0.71%
Houston Astros 4.18% 4.87% 0.69%
St. Louis Cardinals 3.84% 4.45% 0.60%
Washington Nationals 1.97% 2.41% 0.44%
Chicago Cubs 1.92% 2.34% 0.42%
Milwaukee Brewers 1.52% 1.88% 0.36%
Los Angeles Angels 1.33% 1.69% 0.36%
Cincinnati Reds 0.67% 0.87% 0.20%
Boston Red Sox 0.33% 0.46% 0.13%
Cleveland 0.27% 0.37% 0.10%
Arizona Diamondbacks 0.20% 0.29% 0.09%
Seattle Mariners 0.14% 0.20% 0.06%
Kansas City Royals 0.07% 0.10% 0.03%
Miami Marlins 0.05% 0.07% 0.03%
San Francisco Giants 0.02% 0.05% 0.02%
Pittsburgh Pirates 0.01% 0.02% 0.01%
Baltimore Orioles 0.00% 0.01% 0.01%
Detroit Tigers 0.00% 0.01% 0.01%
Texas Rangers 0.01% 0.01% 0.00%

By adding a single win, the average team gained 0.44 percentage points of World Series championship probability. Considering gains of at least 0.1 percentage points significant — since that’s what we normally round to — 20 teams saw movement by making them one win stronger. Somewhat arbitrarily, I imagine 0.5 percentage points as being major gains; 12 teams meet that threshold. Where we set these lines doesn’t necessarily matter in that we’re simply looking at relative changes due to format. Under the current format, the best teams all see significant benefits of adding a win thanks to division winners not having to play the high-stakes Wild Card game.

Next up, 2020’s format:

World Series Probability, 2020’s 16-Team System
Team Current WS Probability With One More Win Change
Los Angeles Dodgers 10.25% 10.72% 0.47%
San Diego Padres 9.15% 9.60% 0.45%
New York Yankees 8.19% 8.63% 0.44%
Minnesota Twins 6.95% 7.37% 0.42%
Atlanta Braves 6.75% 7.17% 0.42%
New York Mets 6.25% 6.67% 0.42%
Chicago White Sox 6.84% 7.25% 0.41%
Tampa Bay Rays 5.83% 6.24% 0.41%
Toronto Blue Jays 5.24% 5.65% 0.41%
Oakland A’s 5.52% 5.93% 0.41%
Houston Astros 4.63% 5.03% 0.40%
Washington Nationals 3.62% 4.00% 0.38%
St. Louis Cardinals 3.81% 4.17% 0.36%
Los Angeles Angels 2.56% 2.91% 0.35%
Chicago Cubs 2.62% 2.95% 0.33%
Milwaukee Brewers 2.26% 2.58% 0.32%
Boston Red Sox 1.42% 1.70% 0.28%
Cincinnati Reds 1.31% 1.56% 0.25%
Cleveland 1.18% 1.42% 0.24%
Arizona Diamondbacks 1.13% 1.36% 0.23%
Seattle Mariners 0.59% 0.75% 0.16%
Kansas City Royals 0.48% 0.63% 0.15%
Miami Marlins 0.41% 0.53% 0.12%
San Francisco Giants 0.31% 0.41% 0.10%
Texas Rangers 0.08% 0.12% 0.04%
Detroit Tigers 0.08% 0.11% 0.03%
Baltimore Orioles 0.07% 0.10% 0.03%
Pittsburgh Pirates 0.07% 0.10% 0.03%

Naturally, baseball’s best teams take the biggest overall hit, with the Dodgers losing nearly a third of their simulated championships. That the Dodgers actually did win in 2020 is one of those little practical jokes that history likes to pull, with the most random playoffs in history resulting in the winningest AL and NL teams making the World Series. It would be a mistake to assume predestination here; it only requires changing a few plays last October to get the 29-31 Houston Astros into the World Series.

More teams see gains in playoff probability, with 25 teams now making that 0.1 percentage-point threshold. But now, not a single team meets the 0.5 percentage-point mark. With no bye for division winners, adding a free agent who improves the roster by a win suddenly has less than half the value for quality teams in tight division races like the Dodgers, Padres, Yankees, and Mets. Teams at the bottom, however, improve but remain long shots.

So, let’s restore the divisional advantage with one of MLB’s proposals, a 14-team format that leaves the top team in each league with the ability to skip the Wild Card round:

World Series Probability, 14 Teams, Two Byes
Team Current WS Probability With One More Win Change
Los Angeles Dodgers 12.87% 13.71% 0.84%
New York Yankees 9.84% 10.64% 0.80%
San Diego Padres 10.67% 11.46% 0.79%
Minnesota Twins 7.53% 8.24% 0.71%
Chicago White Sox 7.37% 8.06% 0.69%
Tampa Bay Rays 5.86% 6.48% 0.62%
Atlanta Braves 6.82% 7.41% 0.59%
Oakland A’s 5.37% 5.94% 0.57%
Toronto Blue Jays 5.05% 5.62% 0.57%
New York Mets 6.14% 6.70% 0.56%
Houston Astros 4.19% 4.70% 0.51%
Washington Nationals 3.08% 3.48% 0.40%
St. Louis Cardinals 3.16% 3.56% 0.40%
Los Angeles Angels 1.92% 2.26% 0.34%
Chicago Cubs 1.94% 2.26% 0.32%
Milwaukee Brewers 1.62% 1.92% 0.30%
Boston Red Sox 0.99% 1.23% 0.24%
Cincinnati Reds 0.85% 1.05% 0.20%
Cleveland 0.77% 0.97% 0.20%
Arizona Diamondbacks 0.83% 1.02% 0.19%
Kansas City Royals 0.28% 0.38% 0.10%
Miami Marlins 0.27% 0.36% 0.09%
San Francisco Giants 0.20% 0.27% 0.07%
Texas Rangers 0.03% 0.05% 0.02%
Baltimore Orioles 0.03% 0.05% 0.02%
Pittsburgh Pirates 0.03% 0.04% 0.01%
Detroit Tigers 0.03% 0.04% 0.01%
Seattle Mariners 0.35% 0.35% 0.00%

Under this blueprint, the average team’s World Series probability gains 0.35%, less than the current system’s 0.44%. Still, by giving a significant advantage to each league’s best teams, there’s a real motivation not to coast into the playoffs at 89 wins. Twenty-two teams pass the significant gain line, and the number of teams passing the major gain one goes back to 11 from zero.

Let’s go really old-school and look at the playoff format that dominated before the divisional era: two leagues, with the best team in each league going straight to the World Series:

World Series Probability, Old-School World Series
Team Current WS Probability With One More Win Change
Los Angeles Dodgers 26.52% 29.90% 3.38%
San Diego Padres 17.51% 20.46% 2.95%
New York Yankees 15.13% 17.72% 2.59%
Minnesota Twins 8.27% 10.14% 1.87%
Chicago White Sox 7.92% 9.71% 1.79%
Atlanta Braves 5.60% 7.04% 1.44%
Tampa Bay Rays 4.51% 5.81% 1.30%
New York Mets 4.20% 5.35% 1.15%
Oakland A’s 3.54% 4.61% 1.07%
Toronto Blue Jays 3.11% 4.06% 0.95%
Houston Astros 1.88% 2.56% 0.68%
St. Louis Cardinals 0.56% 0.82% 0.26%
Washington Nationals 0.51% 0.77% 0.26%
Los Angeles Angels 0.30% 0.46% 0.16%
Chicago Cubs 0.11% 0.19% 0.08%
Milwaukee Brewers 0.07% 0.13% 0.06%
Boston Red Sox 0.06% 0.09% 0.03%
Cleveland 0.03% 0.05% 0.02%
Cincinnati Reds 0.01% 0.03% 0.02%
Arizona Diamondbacks 0.02% 0.03% 0.01%
Kansas City Royals 0.00% 0.01% 0.01%
Baltimore Orioles 0.00% 0.00% 0.00%
Detroit Tigers 0.00% 0.00% 0.00%
Miami Marlins 0.00% 0.00% 0.00%
Pittsburgh Pirates 0.00% 0.00% 0.00%
San Francisco Giants 0.00% 0.00% 0.00%
Texas Rangers 0.00% 0.00% 0.00%
Seattle Mariners 0.00% 0.00% 0.00%

The average gain is the highest so far, with 0.67 percentage points per team. The gains, however, are limited to only a very few teams, with the break point somewhere around 85 wins. One can argue that this isn’t necessarily healthy for baseball, either. Teams like the Dodgers see larger gains by adding free agents, but those individual free agents would have a lot fewer suitors despite the larger average improvement. Auctions require bidders! This is likely the best playoff format for crowning the best team but may not be a healthy one for the game for various other reasons.

As the last playoff format to look at today, I ran a modified version of the divisional era format. Rather than making up new divisions — there are teams in different leagues and two teams that did not exist during the two-division era — I simply looked at the two best teams in each league.

World Series Probability, Four-Team Playoffs
Team Current WS Probability With One More Win Change
Los Angeles Dodgers 22.16% 24.25% 2.09%
San Diego Padres 17.06% 19.05% 1.99%
New York Yankees 13.09% 14.86% 1.77%
Minnesota Twins 8.22% 9.70% 1.48%
Chicago White Sox 7.91% 9.33% 1.42%
Atlanta Braves 7.06% 8.40% 1.34%
New York Mets 5.47% 6.67% 1.20%
Tampa Bay Rays 5.05% 6.17% 1.12%
Oakland A’s 4.15% 5.14% 0.99%
Toronto Blue Jays 3.67% 4.58% 0.91%
Houston Astros 2.44% 3.14% 0.70%
St. Louis Cardinals 1.03% 1.41% 0.38%
Washington Nationals 1.04% 1.41% 0.37%
Los Angeles Angels 0.50% 0.72% 0.22%
Chicago Cubs 0.30% 0.45% 0.15%
Milwaukee Brewers 0.20% 0.32% 0.12%
Boston Red Sox 0.13% 0.21% 0.08%
Cleveland 0.08% 0.13% 0.05%
Cincinnati Reds 0.05% 0.09% 0.04%
Arizona Diamondbacks 0.05% 0.09% 0.04%
Seattle Mariners 0.01% 0.02% 0.01%
San Francisco Giants 0.00% 0.01% 0.01%
Kansas City Royals 0.01% 0.01% 0.00%
Baltimore Orioles 0.00% 0.00% 0.00%
Detroit Tigers 0.00% 0.00% 0.00%
Pittsburgh Pirates 0.00% 0.00% 0.00%
Texas Rangers 0.00% 0.00% 0.00%
Miami Marlins 0.00% 0.00% 0.00%

Not surprisingly, this one comes smack-dab between the 10-team system and the old-school one. With 17 teams at worse than 100-to-1 to win the championship compared to 13 today, it has some of the same problems as the pre-divisional system, though they aren’t quite as severe.

Here’s the quick-and-dirty summary for the five formats we looked at.

World Series Probability, Five Formats
Format Average Improvement Significant Gains Major Gains
Old-School World Series 0.67% 14 11
Current System 0.44% 20 12
14 Teams, Two Byes 0.35% 22 11
2020’s 16-Team System 0.28% 25 0
Four-Team Playoffs 0.55% 17 11

So, what does this all mean? One can make the argument that whether by design or dumb luck, MLB has stumbled into a reasonable playoff configuration. The regular season still matters and while a third of the league makes the playoffs, there are real benefits to winning the division.

We’re far more likely to get more teams in the playoffs than fewer going forward, but I think these numbers demonstrate some of the risks involved of simply shoving more teams into October. Having more teams make the playoffs doesn’t have to destroy the regular season or eviscerate the value of adding a Mookie Betts or a Yu Darvish. But it will have to involve the league designing a postseason that not only gives more teams hope but also makes teams actually care whether they win 90 games instead of 88, or 98 instead of 96. This is absolutely necessary because of how even teams are, relatively speaking. The NBA postseason works with 16 teams because low seeds mainly get destroyed by the top seeds. No MLB team can be the Jordan-era Bulls or peak Warriors.

Three professors, Michael J. Lopez, Gregory J. Matthews, and Benjamin S. Baumer, looked at this specific issue a few years ago and estimated that to match the NBA’s playoff history of the team with the better record 80% of the time, baseball would need to have best-of-75 series. I don’t think I need to go into why that is impractical.

I think that for a larger playoff field to be a good idea requires MLB to continue to re-think what kind of advantages can be given to the better teams. The bye was a clever idea, but there are limitations of how many byes you can give top teams before you’re almost penalizing them by making them cool their jets for weeks. That likely makes a straight-up application of the KBO’s gauntlet also a non-starter. What it might take is for MLB to explore lopsided playoff series. If you’re going to give a chance for a 78-84 team to knock off a 105-win team, you need to think of a bigger hurdle than winning two of three games. Why not require a four-game sweep?

If expanding the playoffs is going to mean more to the owners than simply a way to fatten their wallets and thin those of the players, some creativity will be needed. We’ll see.

Dan Szymborski is a senior writer for FanGraphs and the developer of the ZiPS projection system. He was a writer for ESPN.com from 2010-2018, a regular guest on a number of radio shows and podcasts, and a voting BBWAA member. He also maintains a terrible Twitter account at @DSzymborski.

Inline Feedbacks