Some Early Observations on Reliever Usage

My goal at the start of the research for this article was to develop a quick methodology (i.e. not digging into individual game logs) to find out how effectively teams were deploying their relievers. My first cut was to take a team’s qualifying relievers ranked by gmLI and compare that to the same set of relievers ranked by CHONE ERA. The simple numerical representation I used was the absolute value of the difference between individual pitcher’s rankings summed over each team. For example a player that was ranked 2nd on his team in gmLI, but 3rd in CHONE ERA would have a difference of 1, so a team that has two players flipped would get a total score of 2. So, according to this metric, who is doing well so far? The Rays, Twins and Phillies all have a score of 2, and the next tier is the Cubs Marlins and Orioles with 4. The bottom list consists of the Indians and White Sox at 16, and the Rangers at 14*. Full list can be found here.

That brings me to observation number two, a couple of guys that have already seen their role (read leverage) shift. Randy Williams of the White Sox is ranked 2nd in gmLI and 6th (out of 7) in CHONE ERA for his bullpen, and it seems like Ozzie has figured this out. Here’s a chart of his LI (in this case pLI as it was easier to scrape from the game logs) by appearance

That, my friends, is being put in the reliever doghouse.

On the flip side is Jason Bulger of the Angels. He ranks 4th in gmLI, but 1st in CHONE ERA. Scioscia also seems to be figuring this out as here’s his chart.

I’ll willingly admit that my quick little metric from above might not be the best way to judge a managers bullpen usage, but what do you guys think? Fans of the teams that were in the top or bottom lists, does your team appearing there make sense? Is it worth looking at this retrospectively (i.e. for 2009)?

*I didn’t adjust for Starter to Reliever conversions, so that likely affects the Rangers ranking.