Nowhere But Down

Much of my work this week has focused on the ‘Clutch’ statistic kept here, attempting to shed light or help the confusion surrounding its meaning and usage to dissipate. A great discussion took place in the comments section at my post ‘All About Clutch’ wherein it was suggested that the best hitters in the league will struggle to post high clutch scores because, essentially, they would be so high up the performance chart that there would be no higher ground to which their games could be raised. The inverse would then be true for poorer hitters; since their games were so low much more room exists for game-raising performance.

The major confusion stemmed from the fact that a player with a .333 BA in situations with a high leverage index could be less clutch than one with a .225 BA in the same situations. The way the clutch statistic works is that it measures a player against himself, comparing production to what that production would be in a context-neutral environment. Clearly, I would rather have the .333 guy up to bat in a crucial situation and, because of that, heads begin to spin when it is realized that the .225 guy could have a higher clutch score because in all others he hit .200; the .333 guy posted the same BA in all situations, therefore failing to raise his game.

With this in mind I decided to do a little digging in order to see if this generally holds true. I took the qualifying major league players from 2000-2007, first found the average WPA/LI, and then calculated the average clutch score for those with above average WPA/LI as well as the average clutch score for those with below average WPA/LI. Keep in mind that, in the results below, BA refers to the average clutch for below average WPA/LI with AA meaning the same for above average:

2000: 1.15 WPA/LI, -0.10 BA, 0.07 AA
2001: 1.39 WPA/LI, 0.05 BA, -0.10 AA
2002: 1.38 WPA/LI, -0.02 BA, -0.19 AA
2003: 1.15 WPA/LI, 0.03 BA, -0.32 AA
2004: 1.20 WPA/LI, -0.06 BA, -0.25 AA
2005: 1.15 WPA/LI, 0.01 BA, -0.27 AA
2006: 1.07 WPA/LI, 0.22 BA, -0.13 AA
2007: 0.98 WPA/LI, 0.03 BA, -0.14 AA

As you can see, other than in 2000 and 2007, the average clutch score for those with below average WPA/LI was much better than their above average colleagues. Not to say that their clutch scores were earth-shatteringly spectacular, but, rather just much higher and more indicative of game-raising performance. Deciding to go a little deeper, I looked at the top and bottom 10% in each year to see if the results differed:

2000: 0.06 BA, -0.25 AA
2001: 0.03 BA, -0.54 AA
2002: 0.05 BA, -0.87 AA
2003: 0.02 BA, -0.39 AA
2004: -0.20 BA, -0.11 AA
2005: -0.01 BA, -0.46 AA
2006: 0.16 BA, 0.21 AA
2007: 0.34 BA, -0.27 AA

Here we get very similar results; those in the bottom 10% of WPA/LI generally post much higher clutch scores than those at the top. 2004 and 2006 are the exceptions to this “rule” but even they do not differ too heavily; they actually come within ten points of each other whereas every other year is vastly different in the average clutch scores.

Based on these results it would seem that, yes, the players with below average performance are more likely to post higher clutch scores because they have more room to work with, so to speak. I would still rather take, with much confidence, those in the top 10% of WPA/LI in crucial situations, even though the clutch statistic, in its current state, will debit their performance for having nowhere to go really but down.

Now, to clarify the above paragraph, after some tests, there is no correlation between WPA/LI and Clutch, meaning that it is not a concrete rule that all good players will post lower clutch scores and vice versa. From these results, though, it does seem that those with a higher WPA/LI have more opportunity to post lower clutch scores.