FanGraphs Official Position On…
With just a week and a half left in the regular season and most of the playoff races offering little in the way of end-of-season excitement, a lot of attention has been paid to the postseason awards. The rise in popularity of a lot of the metrics we host here on FanGraphs – especially WAR – has led to a lot of discussion about how those numbers should play into a voter’s decision making process. In many cases, those writing pieces about advanced metrics and awards voting have assumed that the statistical crowd is in lockstep agreement on the rigidity of how these metrics should be interpreted, and in most cases, the assumption is that we trust the numbers over all else.
That’s not really true, of course. The statistical community has a broad base of opinions, and in general, few if any serious analysts believe that awards voting should be done according to an ordinal ranking of WAR. We don’t believe that the numbers that we look at regularly are infallible – we just happen to think that they usually do a better job of accurately answering questions than any other statistic does at answering the same question. As Joe Posanski put it last week:
And this gets at exactly why I love WAR. It makes things more fun. Should we be a slave to it? Of course not. But, is that even necessary to say? I mean: should we be a slave to anything?
WAR’s rapid rise in mainstream acceptance has thrust arguments from the statistically-leaning crowd into a more prominent role this year, but in general, the nuances of how we believe WAR (or FIP, UZR, WPA, etc…) should we interpreted usually don’t make it into the conversation. Too often, the argument is framed as statheads who put complete and utter faith in their numbers against those who aren’t ready to accept them at face value yet. However, we don’t really hold the position that the metrics were designed for strict adherence. We believe that it’s a good idea to consider things like WAR or FIP when casting a vote, but you should consider other things as well. We don’t believe that anyone should vote based on sorting our leaderboards and calling it a day.
So, we’ve decided that it would be helpful if, as a site, we wrote up our “official position” on each award – not an endorsement of a specific candidate, but instead, a generally agreed upon thought process about how our numbers should play into the voting for that award. These pieces aren’t going to be campaigns for a certain outcome, but instead, we hope to explain how we think our numbers should be used to help inform the voting process.
Throughout the rest of the week, we’ll have pieces on each of the six “major” awards, talking about where we see the metrics we use most on FanGraphs fitting in, their limitations, and what we deem as responsible usage of those numbers in making decisions about who deserves a vote. We’ll also have a separate piece tomorrow about single-season UZR data, which we know is the most controversial piece of WAR’s calculations.
Through it all, our goal is essentially to clarify our generally accepted positions on the best way to look at the data found on FanGraphs. We do believe that the numbers we look at most often do contain interesting insights and reveal important truths about the game, but we also understand that they do not sum up the game in perfection. We don’t have to settle for an either accept-them-or-reject-them narrative, and hopefully, this series of posts will help show how our metrics can be used to improve awards voting without enslaving anyone to a particular number.
First up this afternoon will be a piece on the AL MVP voting – perhaps the award where our metrics are most often discussed. We’ll go award by award through the rest of the week, and we’ll wrap up on Friday with our staff’s selections for each award. It should be a fun week.
Dave is the Managing Editor of FanGraphs.
I like this a lot, thanks Dave for stating your position so clearly.
Dave, any chance you could expand upon the subject matter of this series a bit? I’d be interested in knowing Fangraphs’ official position on the following:
the debt ceiling
the new version of “Two and a Half Men”
Palestinian statehood
Dick Allen’s HoF case
abortion
Google+
eliminating the FICA tax cap
chunky vs smooth peanut butter
the continued sentencing disparity under the Fair Sentencing Act of 2010
etc
no way does ashton kutcher come even close to sheen’s media coverage above replacement
Few comments actually make me laugh out loud, this one did. Nicely done.
Aren’t there really 3 distinct awards (with 2 versions of the same thing)?
Given the ‘controversy’ surrounding UZR, I think it would be helpful to seperate O- and D- WAR on FanGraphs, especially when looking at it from an MVP perspective (AFAIK they are not seperated anywhere on FG right now). That way, one could at least get a little context about how much a player’s WAR is generated from UZR, and weigh it according to their own interpretation. I also think that would be useful when looking at old-timey stats, given that that data has got to be even more inaccurate on the UZR/d-WAR side.
Umm, thats pretty much already there.
Where? I’ve never seen WAR seperated anywhere on this site.
Go to the “value” tab on the leaderboards, or the bottom of a player page. WAR is separated into runs from: batting, baserunning, fielding, positional value, and value from replacement level (i.e., playing time). When adding them up to get total RAR, you can regress or discount whatever categories you want.
Ah, I see what you’re saying now. Thanks!
go to a players page, go to the bottom, see how many runs above replacement they have in each category. For example Jose Bautista this year
2011 Blue Jays 63.0 3.4 -4.5 20.4 -5.2 77.2 8.2
the 63 is batting runs, the 3.4 is baserunning runs, the -4.5 is fielding runs, the 20.4 is replacement level runs, the -5.2 is positional runs, the 77.2 is runs above replacement and the 8.2 is of course his WAR
now, since he has -4.5 fielding runs, and 77.2/8.2=9.41 (meaning 9.41 Runs above replacement equals 1 WAR) we can conclude that Bautista has about -.5 WAR from his fielding. It requires the conversion from runs above replacement to WAR, but that isn’t that difficult. If you want the VERY shorthand way, (if slightly inaccurate way) of getting WAR from RAR, just divide by 10.
I think it’d be constructive if you guys did an article on past MVPs/Cy Young award winners and their WAR and other advanced stats. Than compare where that ranked them vs their peers that year, etc.
The old timers love that WAR validates Willy Mays as the best player of all time.