Archive for Research

FIP vs. xwOBA for Assessing Pitcher Performance

At a basic level, nearly every piece at FanGraphs represents an attempt to answer a question. What is the value of an opt-out in a contract? Why do the Brewers continue to fare so poorly in the projected standings? How do people behave in the eighth inning of a spring-training game? Those were the questions asked, either explicitly or implicitly, by Jeff Sullivan, Jay Jaffe, and Meg Rowley just yesterday.

This piece also begins with question — probably one that has occurred to a number of readers. It concerns how we evaluate pitchers and how best to evaluate pitchers. I’ll present the question momentarily. First, a bit of background.

Fielding Independent Pitching, or FIP, is a well-known tool for estimating ERA. FIP attempts to isolate a pitcher’s contribution to run-prevention. It also serves as a better predictor of future ERA than ERA itself. The formula for FIP is elegant, including just three variables: strikeouts, walks, and homers. It does not include balls in play. That said, one would be mistaken for assuming that FIP excludes any kind of measurement for what happens when the bat hits the ball. Let this be a gentle reminder that home runs both (a) are a type of batted ball and (b) represent a major component of FIP. There is, in other words, some consideration of contact quality in FIP.

Expected wOBA, or xwOBA, is a newer metric, the product of Statcast data. xwOBA is calculated with run-value estimates derived from exit velocity and launch angle. Basically, xwOBA calculates the average run value of every batted ball for a hitter (or allowed by a pitcher), adds in the defense-independent numbers, and arrives as a wOBA-like figure. The advantage of xwOBA is that it removes the variance of batted-ball results and uses a “Platonic” value instead.

The introduction of Statcast’s batted-ball data is exciting and seems like it might help to better isolate a pitcher’s contributions. But does it? This is where I was compelled to ask my own, relatively simple question — namely, is xwOBA better for assessing pitcher performance than the more traditional FIP? What I found, however, is that the answer isn’t so simple.

The differences between FIP and xwOBA, as well as the similarities, deserve some exploration.

Read the rest of this entry »


Players Don’t Become Terrible at 30

One of the oft-mentioned reasons for the slow free-agent market this winter is that teams are thinking on the same wavelength when it comes to evaluating players. One of the tenets of this theory is that free agents are bad bets because of the aging process. As players age, especially after 30, they get worse on the field, and teams don’t want to get stuck with those decline years.

There is a whole lot of reason in that explanation for the offseason’s lack of activity. There’s also a little bit of faulty logic regarding the aging process, particularly when it comes to this year’s free-agent class and the two biggest names out there, Eric Hosmer and J.D. Martinez.

The first flaw in this argument is based on a misunderstanding of how clubs are compensating players. All teams — and especially the “smart” ones — know and understand that the final year or years of a free-agent contract are unlikely to be valuable in terms of strict wins-per-dollar calculus. It’s generally accepted that those “out” years are going to be mostly dead weight. Players are typically signed to deals for which the total guarantee is equally distributed over the course of a deal. The team isn’t paying an equal amount every year expecting metronomic production over the life of a contract. They expect to receive a surplus of value in the early years and a deficit in latter years. The hope is that the early years compensate for the latter ones.

Teams could, in theory, compensate players a greater amount at the beginning of a contract than at the end, but most clubs choose not to do this because, by spreading the payments out, they get to keep more money in the present, which is more valuable to them. If a team doesn’t want to add, say, a seventh year at $25 million to Eric Hosmer’s offer, it isn’t because they believe he isn’t going to be worth $25 million in that seventh year. It’s because they believe he won’t be worth extra $25 million over the first six years. The value in the seventh year is going to be close to zero in terms of expectations. That’s not the main point I’m trying to make in this post, but it does deserve a mention.

Read the rest of this entry »


Manny Margot and the Stickiness of a Launch-Angle Breakout

Manny Margot had a breakout within a breakout last year. After accounting for his offensive and defensive contributions, the Padres’ rookie center fielder was worth roughly two wins in slightly less than a full season’s worth of plate appearances. Even for a player who was highly touted as a prospect, producing league-average work at 22 years old represents, in itself, a kind of breakout.

Hidden within that strong end-of-year line was a drastic change in the second half, though. Margot started hitting the ball in the air. That’s a change that has powered many other breakouts. But before we book the skinny center fielder for all of the homers next year, we have to ask: what’s happened with launch-angle surgers in the past?

Read the rest of this entry »


Neuroscience Can Project On-Base Percentages Now

I have an early, hazy memory of Benito Santiago explaining to a reporter the approach that had led to his game-winning hit moments earlier. “I see the ball, I hit it hard,” said Santiago in his deep accent. From which game, in what year, I can’t remember. Also, it isn’t really important: it’s a line we’ve heard before. Nevertheless, it contains multitudes.

We know, for example, that major-league hitters have to see well to hit well. Recent research at Duke University has once again made explicit the link between eye sight, motor control, and baseball outcomes. This time, though, they’ve split out some of the skills involved, and it turns out that Santiago’s deceptively simple description involves nuanced levels of neuromotor activity, each predictive of different aspects of a hitter’s abilities. Will our developing knowledge about those different skills help us better sort young athletes, or better develop them? That part’s to be determined.

Read the rest of this entry »


Statcast’s Outs Above Average and UZR

Given the relative novelty of Statcast data, it remains unclear for the moment just how useful the information produced by it can and will be. As with any new metric or collection of metrics, it’s necessary to establish baselines for success. How good is an average exit velocity of 90 mph? What does a 10-degree launch angle mean for a hitter? How does sprint speed translate to stolen bases or defensive ability?

In an effort to begin answering such questions, the Statcast team has rolled out a few different metrics over the past few years that attempt to translate some of the raw material into more familiar terms. Hit probability uses launch angle and exit velocity to determine the likelihood that a batted ball will drop safely. Another metric, xwOBA, takes that idea a step further, using batted-ball data to estimate what a player should be hitting.

Another example is Outs Above Average. In the case of OAA, the Statcast team has accounted for all the balls that are hit into the outfield, determined how often catches are made based on a fielder’s distance from the ball, and then distilled those numbers down to find what an average outfielder would do. The final result: a single number above or below average.

At Reddit, mysterious user 903124 has published research showing that the year-to-year reliability for Outs Above Average has been considerably higher than the Range component for UZR. The user was kind enough (or foolish enough) to create a Twitter account reproduce some graphs of his results, which are shown below. There is a subsequent tweet in the thread that shows left field.

 

 

For those who can’t see the charts and would prefer not to open up a new window, what you’d see here is that, for the group selected, the r-squared is much higher for Outs Above Average than for the Range component for UZR. If Statcast could produce something that is much more reliable and much more accurate than the Range component of UZR, that would be a pretty significant breakthrough and win for Statcast, potentially improving the way WAR is calculated and providing a better measure of a player’s talent and results on the field.

Read the rest of this entry »


What Statcast Says About the National League Cy Young

Over in the American League, there’s a clear two-horse race between Chris Sale and Corey Kluber for the Cy Young Award. Both are head and shoulders above the rest of the league and both have very strong cases for the honor, depending on what metrics you prefer.

Over in the National League, that isn’t quite the case. Max Scherzer is the clear front-runner at this point, with a host of other pitchers behind him all trying to make an argument why they might have had better seasons. Clayton Kershaw has a lower ERA. Zack Greinke pitches in a much tougher park. Teammate Stephen Strasburg has a lower FIP.

Those are just the stats that measure outcomes, though. Let’s see what Statcast has to say about the sort of contact the other candidates are allowing to see if anybody has a real case against Scherzer.

Read the rest of this entry »


How 2017 Compares to the Steroid Era: Part II

Yesterday, I looked at how one of the last seasons of the steroid era (2002) compares to the present one in terms of home runs, total offense, and overall value by position. To summarize the findings of that post briefly: while corner outfielders account for less production now than they did in 2002, infielders and catchers are now responsible for more of it. Moreover, players at the top of the home-run leaderboards now are accounting for a lower percentage of total league-wide homers than in the steroid era. There’s a more even distribution of homers, in other words.

Read the rest of this entry »


How 2017 Compares to the Steroid Era: Part I

Infielders account for a greater percentage of homers now than in 2017. (Photo: Ryan Claussen)

The 2017 season has seen offensive levels rise to a height unmatched in major-league baseball for quite some time. Overall this year, teams are averaging 4.65 runs per game, the highest mark since 2007 — though not quite the five runs per game teams averaged in 1999 and 2000. Most of the offensive increase can be traced to a juiced ball. There’s also been a lot of talk about the role of a fly-ball revolution of some sort or another in the establishment of a new league-wide seasonal home-run record.

An increase in PED use has now been raised as an issue, as well. MLB has administered both PED testing and PED-related suspensions since 2004; both have existed in the minors since 2001. Even with those measures in place, however, power continues to be associated with steroid use, and unfounded rumors have hounded the authors of every breakout season over the last decade. With the rise of power in recent years, the whole league is under suspicion. But how similar is this version of the league to the one now known as the “steroid era”? Let’s take a look at what the latter actually looked like and how it compares to now.

Our split tools are very expansive going back to 2002. This is convenient because 2002 was the last season that lacked PED testing of any kind. It might not have been quite the height of that period now regarded as the “steroid era” — that was probably 1999 and 2000 — but the league looked quite different before testing and suspensions were permitted.

Read the rest of this entry »


What Strikeouts Have Taken from Baseball

It shouldn’t be news that strikeouts have increased at a pretty alarming pace over the last decade. From the end of the last strike through 2007, the league-wide strikeout rate was pretty steady, averaging 16.7%. That is, roughly one in every six plate appearances ended in a strikeout. Over the last decade, the average has reached nearly 20%, including a high of 21.6% this year. Now, more than one in every five plate appearances ends in a strikeout. A strikeout is now 30% more likely than it was a little over a decade ago.

This is a problem with many possible solutions: raising the bottom of the strike zone; lowering the mound; or, my personal favorite, expanding the league. This piece isn’t prescriptive, however. The focus of this piece is to show exactly what the strikeout has replaced, and it isn’t actually all bad.

Because I started this piece by doing some research on the home-run record, we will focus here on the year 2000 as it compares to the present. That season represents what was probably the height of the PED era; it was also the season responsible for the league-wide high in home runs until this year. Because the power numbers between the two periods are similar, a comparison of the seasons creates an interesting vantage point from which to view the role of the strikeout.

Generally, we imagine that players have to sacrifice contact for power. It’s notable, then, that the power numbers of today are equivalent those of the 2000 season even though players are striking out 30% more often now than they did back then. To provide some background, here are some standard numbers from 2000 and 2017.

Comparing 2000 and 2017
Season G PA HR BB% K% ISO BABIP AVG OBP SLG wOBA
2000 62083 190261 5693 9.6 % 16.5 % .167 .300 .270 .345 .437 .341
2017 54957 173900 5753 8.5 % 21.6 % .172 .300 .255 .325 .427 .321

As the 20-point difference in wOBA illustrates, overall offensive levels were higher back in 2000. The ISO and BABIP figures are all roughly similar. When a batter hits a ball in play, that batted ball is just as likely to become a hit as it was before. When it lands fair, it’s leading to roughly the same amount of extra bases. All that’s basically the same.

In terms of differences, one finds that this year’s walk rate is a bit lower than in 2000. That has some influence on run scoring, but not at all to the same degree that the increase in strikeout rate has. In effect, 5% of potentially positive plate appearances have been turned into strikeouts. That’s significant. However, while the main complaint about strikeouts is that they lead to fewer balls in play, it isn’t accurate to suggest that every extra strikeout has actually had that effect.

Read the rest of this entry »


Eugenio Suarez Can Hit Both Fastballs

Eugenio Suarez can hit the sinker. He’s been able to do it his whole life. And, generally speaking, that means he shouldn’t be able to hit the four-seamer. Or, at least not hit it as well, I mean. That’s typically how it goes, one or the other. It has to do with swing paths and approaches, mostly.

But Suarez has pulled off a rare feat this year. He’s been hitting the four-seamer, too. And he’s improved his success against that pitch by improving something other than his swing.

With an .878 lifetime OPS against sinkers, Suarez ranks in the top quartile among the more than 600 players who’ve seen 500-plus sinkers in the PITCHf/x era. His .797 OPS against four-seamers makes him only average against that pitch, though.

Again, that’s not uncommon. Peruse the top-40 hitters against both the four-seamer and the sinker, and only seven names appear on both lists. You might have heard of Kris Bryant, Miguel Cabrera, Matt Kemp, Paul Goldschmidt, Aaron Judge, Mike Trout, and Joey Votto. They’re pretty good.

Read the rest of this entry »