Build a Better WAR Metric, Checkpoint

In trying to summarize the responses to the three questions, so far, what we have in terms of preference is:
– the event, regardless of the context
– the event, within the context of the whole game state (inning, score, base, out)
– the event, within the context of the base-out state
– and far down the list, the event as it ultimately affects the inning

What the responders therefore are gravitating toward is a purely
content-neutral metric. But, to the extent that we do want to measure the context-specific impact, that should be kept separate, and perhaps not even tied to the player at all. Just a general “timing” bucket.

If we take the case of the triple in the previous thread, in either case, Hamilton and Dyson will get +1 run, because that’s the context-neutral value of the triple, according to Linear Weights.

We immediately add a -0.1 runs because a triple with the bases empty and 0 outs is worth +0.9 runs. So, they don’t want to penalize either guy for getting the triple when they did, and so, to make things add up, we need “-0.1” runs for timing.

Then the three outs, they each get -0.25 runs, as is the standard weight.

So far, we have this:
+1.0 Hamilton
-0.1 timing: limited impact triple
-0.25 batter1
-0.25 batter2
-0.25 batter3

You Aren't a FanGraphs Member
It looks like you aren't yet a FanGraphs Member (or aren't logged in). We aren't mad, just disappointed.
We get it. You want to read this article. But before we let you get back to it, we'd like to point out a few of the good reasons why you should become a Member.
1. Ad Free viewing! We won't bug you with this ad, or any other.
2. Unlimited articles! Non-Members only get to read 10 free articles a month. Members never get cut off.
3. Dark mode and Classic mode!
4. Custom player page dashboards! Choose the player cards you want, in the order you want them.
5. One-click data exports! Export our projections and leaderboards for your personal projects.
6. Remove the photos on the home page! (Honestly, this doesn't sound so great to us, but some people wanted it, and we like to give our Members what they want.)
7. Even more Steamer projections! We have handedness, percentile, and context neutral projections available for Members only.
8. Get FanGraphs Walk-Off, a customized year end review! Find out exactly how you used FanGraphs this year, and how that compares to other Members. Don't be a victim of FOMO.
9. A weekly mailbag column, exclusively for Members.
10. Help support FanGraphs and our entire staff! Our Members provide us with critical resources to improve the site and deliver new features!
We hope you'll consider a Membership today, for yourself or as a gift! And we realize this has been an awfully long sales pitch, so we've also removed all the other ads in this article. We didn't want to overdo it.

That’s a total of +0.15 runs. But since the inning started at +0.5 runs of expectancy, and we get 0 runs scored, the total has to be -0.5 runs. So, we add another item:
-0.65 bad timing: leaving runner on base

As for the other scenario:
+1.0 Dyson
-0.1 timing: limited impact triple
-0.25 batter1
-0.25 batter2
-0.25 batter3

But, since we actually scored a run, that should come in at +0.5 runs. We need another:
+0.35 good timing: scoring the runner

For a minority, a vocal minority, those “timing” impact runs should be given to the players involved. Looking at the Hamilton one, whereas a generic out is worth -0.25 runs, an out with a runner on third is more costly. So, that -0.65 runs has to be distributed to the three out-makers, for those readers part of the vocal minority. For the readers in the majority, those runs are an after-thought. Maybe they should be considered, so the thing adds up. But, it shouldn’t fall on the shoulders of the players involved. Just a general team bucket to capture the various plays affected by timing.

So, that’s how you build your WAR:

For each player, figure his context-neutral impact as one value, and his “timing” as another value.

Then, the reader can choose whether to include the timing value or not.

Now, on to the pitchers and fielders!





20 Comments
Oldest
Newest Most Voted
Cool Lester SmoothMember since 2020
10 years ago

But how do you split the timing runs between Dyson and the guy who hit the sac fly?

Eminor3rdMember since 2019
10 years ago

What if, instead of applying the “timing” factor to individual players, you simply added it up by team? The result would be a sort of coefficient to temper our context-neutral WAR valuations. For example, Trout may be a context-neutral 9-win player, but the Angels (and luck, the park, the weather, etc.) may have dropped the ball so often that they had a substantially below average “timing” score, and we would then be able to understand that the value of Trout’s performance was diminished by some measurable context-driven number.

hurricanexyzMember since 2016
10 years ago

I would actually take a slightly different approach to evaluating the players who bat after the lead-off triples. One key part of the point is that a sacrifice fly is not the same thing as a strikeout. Nor is this simply a matter of luck: with a runner on third and zero or one outs, there’s a real sense that the batter is supposed to prioritize putting the ball in play to get the run in. So I would give a substantial bonus to the guy who hits the sac fly, perhaps the whole +0.65 or perhaps not quite.

Conversely, I’d like to penalize the guys who fail to get that runner in. An ordinary out really is worse there than, say, with the bases empty; among other things, the threshold for achieving a positive result is a lot lower. A generalization of this approach would be to reward/punish players based on their propensity for getting “productive outs.” This isn’t just a matter of luck, since players do actively try for them and some are presumably better than others. And of course in an ideal world you’d put some of the credit/blame on the runner’s speed, in certain situations, but there’s probably no realistic way to implement that.

I’m less sure how to handle the guys who bat with that runner at third and two outs already. A single there feels a lot more meaningful than an ordinary single, or even a single with the runner on third and no outs. Partly, again, that’s because there’s an intermediate possibility with less than two outs, where you get one benefit of the single (driving in the run) but not the other two (baserunner, lack of out). Partly it’s because you’re on the precipice of losing that run forever, whereas the guy who strikes out right after the triple has only lost the first of three chances at it. Certainly these events feel very clutch, but it’s less clear how they should actually be valued.

Poor Mans Rick ReedMember since 2016
10 years ago
Reply to  hurricanexyz

Is the out in that situation (runner on 3rd, <2 out) really worse than one with the bases empty? It's just a matter of looking at which run you're trying to score, runner ahead of you, or yourself. Bases empty outs I'd say are worse contextually, because you're doing nothing positive for the lineup spots ahead of you or behind you.

hurricanexyzMember since 2016
10 years ago

I mean, the point is really that there are two kinds of outs you can make with a runner on third and <3 outs. They're the same as concerns scoring a run yourself (you won't). They're very different as concerns scoring the runner ahead of you. Since this difference is far from arbitrary or a matter of dumb luck, I'd argue it should be accounted for.

Now, where does the out with the bases empty fall in between those two kinds of outs with the runner on third? I dunno, but I'd incline to say "somewhere in the middle," among other things since the category includes all of the events from both results with the runner on third (the deep fly-out is just like a strikeout with the bases empty).

hurricanexyzMember since 2016
10 years ago
Reply to  hurricanexyz

<2 outs, whoops.

Baron Samedi
10 years ago

WAR is fine leave it alone

Cool Lester SmoothMember since 2020
10 years ago
Reply to  Tangotiger

Personally, I adjust WAR (for MVP purposes, etc.) by replacing players’ wRAA with their RE24, and averaging their DRS and UZR.

hurricanexyzMember since 2016
10 years ago
Reply to  Tangotiger

I’m not sure I agree with this interpretation of the polling results so far. We’ve established that (a) different events which have the same contextual effect should be treated differently, and that (b) events should not be treated differently based on what happens after them.

What we haven’t established is that the same event should be treated the same regardless of what came before it, and thus of the context in which it happened. You haven’t polled, that is, on the two-out RBI single versus the two-out bases empty single.

hurricanexyzMember since 2016
10 years ago
Reply to  Tangotiger

That’s fair.

johnforthegiants
10 years ago

To a certain extent, this is turning out to be a referendum on whether the respondents are more interested in actual baseball or fantasy baseball, and depressingly enough it’s looking like they’re more interested in fantasy baseball, or at least the statistics on which fantasy baseball is currently based. This would account for the focus on the event and disinterest in the context, since fantasy baseball is based entirely on events with no context. In principle it would be a good idea to ask respondents to include with each response the relative extent to which their answers reflect an interest in actual baseball and to what extent they reflect an interest in fantasy baseball, but I have the feeling that this wouldn’t really clear things up. At some point in the evolution of statistics it’s going to become apparent that these interests are clearly divergent and statisticians will frame their research questions accordingly, but we definitely aren’t there now.

jamesryu
10 years ago

Hi Mr.Tango,

I am just trying to make sense of this: “We immediately add a -0.4 runs because a triple with the bases empty and 0 outs is worth +0.6 runs.” Is this saying that triple with the bases empty and 0 out in an inning, during the game of history, led to 0.6 runs on average?

jamesryu
10 years ago

Mr.Tango,

I want to get a complete grasp of this, so I want you to see if I got this right: Inning events were single, walk, strikeout, strikeout, groundout.

+0.73 single
-0.33 limited impact single
+0.76 walk
-0.1 limited impact walk
-0.64 strikeout
-0.50 strikeout
-0.45 groundout

-.53 runs

Based on: http://www.tangotiger.net/lwtsrobo.html

jamesryu
10 years ago
Reply to  Tangotiger

Oh nice. We did it different way, but same conclusion.

jamesryu
10 years ago
Reply to  Tangotiger

Where do you get the high impact and low impact values?