Some Early Observations on Reliever Usage

My goal at the start of the research for this article was to develop a quick methodology (i.e. not digging into individual game logs) to find out how effectively teams were deploying their relievers. My first cut was to take a team’s qualifying relievers ranked by gmLI and compare that to the same set of relievers ranked by CHONE ERA. The simple numerical representation I used was the absolute value of the difference between individual pitcher’s rankings summed over each team. For example a player that was ranked 2nd on his team in gmLI, but 3rd in CHONE ERA would have a difference of 1, so a team that has two players flipped would get a total score of 2. So, according to this metric, who is doing well so far? The Rays, Twins and Phillies all have a score of 2, and the next tier is the Cubs Marlins and Orioles with 4. The bottom list consists of the Indians and White Sox at 16, and the Rangers at 14*. Full list can be found here.

That brings me to observation number two, a couple of guys that have already seen their role (read leverage) shift. Randy Williams of the White Sox is ranked 2nd in gmLI and 6th (out of 7) in CHONE ERA for his bullpen, and it seems like Ozzie has figured this out. Here’s a chart of his LI (in this case pLI as it was easier to scrape from the game logs) by appearance

That, my friends, is being put in the reliever doghouse.

On the flip side is Jason Bulger of the Angels. He ranks 4th in gmLI, but 1st in CHONE ERA. Scioscia also seems to be figuring this out as here’s his chart.

You Aren't a FanGraphs Member
It looks like you aren't yet a FanGraphs Member (or aren't logged in). We aren't mad, just disappointed.
We get it. You want to read this article. But before we let you get back to it, we'd like to point out a few of the good reasons why you should become a Member.
1. Ad Free viewing! We won't bug you with this ad, or any other.
2. Unlimited articles! Non-Members only get to read 10 free articles a month. Members never get cut off.
3. Dark mode and Classic mode!
4. Custom player page dashboards! Choose the player cards you want, in the order you want them.
5. One-click data exports! Export our projections and leaderboards for your personal projects.
6. Remove the photos on the home page! (Honestly, this doesn't sound so great to us, but some people wanted it, and we like to give our Members what they want.)
7. Even more Steamer projections! We have handedness, percentile, and context neutral projections available for Members only.
8. Get FanGraphs Walk-Off, a customized year end review! Find out exactly how you used FanGraphs this year, and how that compares to other Members. Don't be a victim of FOMO.
9. A weekly mailbag column, exclusively for Members.
10. Help support FanGraphs and our entire staff! Our Members provide us with critical resources to improve the site and deliver new features!
We hope you'll consider a Membership today, for yourself or as a gift! And we realize this has been an awfully long sales pitch, so we've also removed all the other ads in this article. We didn't want to overdo it.

I’ll willingly admit that my quick little metric from above might not be the best way to judge a managers bullpen usage, but what do you guys think? Fans of the teams that were in the top or bottom lists, does your team appearing there make sense? Is it worth looking at this retrospectively (i.e. for 2009)?

*I didn’t adjust for Starter to Reliever conversions, so that likely affects the Rangers ranking.





Steve's ramblings about baseball can also be found at Beyond the Box Score and Play a Hard Nine or you can follow him on Twitter

7 Comments
Oldest
Newest Most Voted
Inline Feedbacks
View all comments
Tactical Bear
15 years ago

Very cool. I’ll be checking back to see what the data looks like as the year goes on.

I wonder how the use of relievers impacts a team’s performance relative to Pythagenport W/L. Is there a relationship between the “proper” use of relievers and the team’s ability to outperform its Pyth? Also, this would be a cool longterm project, as a way to evaluate managers.