Build a Better WAR Metric: Neutralizing Players

Larry Walker is a great hitter.

He’s a great hitter at Olympic Stadium. He’s a great hitter at Coors. He’s a great hitter at Busch. He’s a great hitter at any ballpark named after a beer.

Whereas the average hitter might create 120 runs per 162 games at Coors, Walker would create 190. That’s +60%.

Whereas the average hitter might create 85 runs per 162 games in every non-Coors park, Larry Walker would create 110. That’s +30%.

When you evaluate Larry Walker, you have two choices:
1. Neutralize Larry Walker by giving him 268 plate appearances in each of the home ballparks of the 30 MLB teams. His 2501 PA at Coors? Now we only count about 11% of that. His 32 PA in Oakland? We have to figure out how he’d have done if he got 268 PA. And so on.

2. Take a league average hitter, and put him in the same playing conditions as Larry Walker. Walker had 2501 PA at Coors? Great, let’s count it all. But let’s compare him to a league average hitter who also got to bat 2501 times at Coors. He came to bat 32 times in Oakland? Then the league average hitter also came to bat 32 times.

You Aren't a FanGraphs Member
It looks like you aren't yet a FanGraphs Member (or aren't logged in). We aren't mad, just disappointed.
We get it. You want to read this article. But before we let you get back to it, we'd like to point out a few of the good reasons why you should become a Member.
1. Ad Free viewing! We won't bug you with this ad, or any other.
2. Unlimited articles! Non-Members only get to read 10 free articles a month. Members never get cut off.
3. Dark mode and Classic mode!
4. Custom player page dashboards! Choose the player cards you want, in the order you want them.
5. One-click data exports! Export our projections and leaderboards for your personal projects.
6. Remove the photos on the home page! (Honestly, this doesn't sound so great to us, but some people wanted it, and we like to give our Members what they want.)
7. Even more Steamer projections! We have handedness, percentile, and context neutral projections available for Members only.
8. Get FanGraphs Walk-Off, a customized year end review! Find out exactly how you used FanGraphs this year, and how that compares to other Members. Don't be a victim of FOMO.
9. A weekly mailbag column, exclusively for Members.
10. Help support FanGraphs and our entire staff! Our Members provide us with critical resources to improve the site and deliver new features!
We hope you'll consider a Membership today, for yourself or as a gift! And we realize this has been an awfully long sales pitch, so we've also removed all the other ads in this article. We didn't want to overdo it.

So, what are the strengths of these two options. In Option 1, we don’t allow Larry Walker to take “unfair” advantage of a park he might be ideally suited for. Whereas most hitter would increase their runs created by 40% at Coors relative to a non-Coors park, Larry Walker increased his by 70%. Given that he got 2501 PA at Coors, Walker ends up shining more than he would otherwise. It’s like letting Mariano Rivera come in 1- and 2-run games, while letting Trevor Hoffman and Billy Wagner only enter blowouts. They are all suited to close games, but if only Mo gets to leverage that, he’ll be the one getting all the saves. Is that fair? I dunno.

In Option 2, we deal with what actually happened. We don’t have to play a game of what-if. We simply accept what the player did, and that he was able to leverage (or not leverage) his unique playing conditions. All we do is make the comparison level all those thousands of players who also played in those exact same conditions, at the same frequency as our player. Walker@Coors is compared to average player at Coors, and Mo in high leverage situations is compared to the average reliever in high leverage situations, and so on. Everyone gets to keep what they did.

So, how do you want to see it?





15 Comments
Oldest
Newest Most Voted
Inline Feedbacks
View all comments
Roger McDowell Hot Foot
9 years ago

“How do I want to compare players” for what purpose? Option 1 seems obviously better for predictive forward-looking talent evaluation/projection, Option 2 seems obviously better for retrospective comparison. Do we need to pick one option for both? If so, why?

tz
9 years ago

Though I wouldn’t be so quick to say that Option 1 is better for projections. You’re severely underweighting about half of the sample size while expanding the relative weight of the rest. That could be a huge issue for players with just a small number of plate appearances at any given ballpark – if Walker only had a .113 wOBA for his 32 PA in Oakland, that’s a meaningful distortion.

tz
9 years ago
Reply to  Tangotiger

* regress