Small Sample Size And Spring Training

In a perfect world, every prospect piece would be written after multiple looks at a player including batting practice, infield and in game performance. Unfortunately, everyday life makes it nearly impossible to make that goal a reality as career, family and budget restraints limit the ability for a prospect writer to keep the same schedule as an affiliated scout. And while small sample size is always a concern when it comes to writing about prospects, spending only three days in Arizona watching players did more to confuse my positions than clarify them.

Videos after the jump

The best example of this would be Texas Rangers corner infield prospect Mike Olt who managed three outs in two at bats including a strikeout where he looked completely overmatched by a Dodgers pitcher I had never heard of and a tailor made double play. Earlier that day, Olt’s batting practice session was decent, but I heard little explosion off of his bat and found myself underwhelmed by the player I saw.

In the same batting practice group as Olt, Engel Beltre roped line drive after line drive showing explosion through the ball and impressive raw power for a prospect beginning to fill out. Later in the day, Beltre also logged two plate appearances and made solid contact in both of them including a single back through the box if my memory serves me correctly.

You Aren't a FanGraphs Member
It looks like you aren't yet a FanGraphs Member (or aren't logged in). We aren't mad, just disappointed.
We get it. You want to read this article. But before we let you get back to it, we'd like to point out a few of the good reasons why you should become a Member.
1. Ad Free viewing! We won't bug you with this ad, or any other.
2. Unlimited articles! Non-Members only get to read 10 free articles a month. Members never get cut off.
3. Dark mode and Classic mode!
4. Custom player page dashboards! Choose the player cards you want, in the order you want them.
5. One-click data exports! Export our projections and leaderboards for your personal projects.
6. Remove the photos on the home page! (Honestly, this doesn't sound so great to us, but some people wanted it, and we like to give our Members what they want.)
7. Even more Steamer projections! We have handedness, percentile, and context neutral projections available for Members only.
8. Get FanGraphs Walk-Off, a customized year end review! Find out exactly how you used FanGraphs this year, and how that compares to other Members. Don't be a victim of FOMO.
9. A weekly mailbag column, exclusively for Members.
10. Help support FanGraphs and our entire staff! Our Members provide us with critical resources to improve the site and deliver new features!
We hope you'll consider a Membership today, for yourself or as a gift! And we realize this has been an awfully long sales pitch, so we've also removed all the other ads in this article. We didn't want to overdo it.

Engel Beltre’s triple slash in 2011: .231/.285/.300 in double-A

Mike Olt’s triple slash in 2011: .267/.381/.500 in high-A

And while Beltre did play the 2011 season a level higher than Olt, the former first round pick out of the University of Connecticut appeared on every major top-100 list and is considered a surefire major leaguer. Meanwhile, the Dominican born Beltre has lost much, if not all of his prospect steam after a forgettable 2011 season. If forced to write a detailed report on each prospect, Beltre would have rated higher and many would consider me more than a bit misguided for it.

Another Ranger, pitching prospect Neil Ramirez, toed the rubber versus the Dodgers with stuff not entirely different than what I scouted in Savannah as a member of the A-level Hickory Crawdads in both 2009 and 2010. From a physical standpoint, Ramirez had filled out considerably and looked the part of a major leaguer. However, his fastball was 92ish throughout – A far cry from the upper-90’s he is reported to throw when firing on all cylinders. Ramirez mixed in a curveball which lacked bite and a changeup he struggled to locate resulting in a poor performance including a long home run to Juan Rivera, the poster boy for league average at the big league level.

On this day, Ramirez was the fourth best pitching prospect for the Rangers in terms of stuff behind Tanner Scheppers, Robbie Ross and Martin Perez. However, off-season prospect rankings would place him behind only Martin Perez, a pitcher ranked between 17th and 31st on the Baseball America top-100 for the past three seasons. In fairness to Ramirez, he appeared to be fighting through the outing and never did seem comfortable on the mound. With his two inning stint being his first Cactus League action, one simply can’t take away too much from the outing and writing about Ramirez in a definitive sense would be downright irresponsible.

With the saturation of talent in Arizona each spring, no better opportunity exists to blanket scout a substantial number of top prospects within 45-minutes of each other. However, I wonder how much of the prospect coverage coming from spring training winds up being little more than throwing information gleaned from an at bat or two against the wall and hoping it sticks. And while small sample sizes are something prospect writers are forced to work from, I’ll feel much better about doing so in June and July when prospects are at their peak level of performance.





Mike Newman is the Owner/Managing Editor ofROTOscouting, a subscription site focused on baseball scouting, baseball prospects and fantasy baseball. Follow me onTwitter. Likeus on Facebook.Subscribeto my YouTube Channel.

10 Comments
Oldest
Newest Most Voted
radivel
14 years ago

Other article stating other cases of similar things:

Beyond the Boxscore:
http://www.beyondtheboxscore.com/2012/3/27/2905234/do-spring-training-records-matter

Michael Barr
14 years ago
Reply to  radivel

so roughly 90% of the variance in a regular season record can be explained by something other than a spring training record.

Brian S
14 years ago

I spent some time in the Phoenix area a couple weeks ago and saw Olt in 2 games and a BP session. Not huge power, but noticed the pop especially when he was pulling the ball. In-game, his at bats were literally forgettable, but I was fortunate enough to see a really promising defensive showing. Lacks some range, but his instincts and reaction time at third were some of the best seen over 5 days at various parks. Based on the power projection, I would hope the Beltre blockage works itself out to keep him as a 3B (one of the two leaving the Rangers). Would be a shame to move him to 1B just to get him into the bigs.

Jason
14 years ago

I thought SSS only applied to statistical annalysis… not direct observation? obviously more data points is better… but statistical significance is not something you can achieve with direct observation.

Keystone Heavy
14 years ago

Tanner Scheppers is the definition of TNSTAAPP.

matt w
14 years ago
Reply to  Keystone Heavy

Dunno about that — he’s been injured since before he was a prospect.

Jim
14 years ago

Seems like you made a rather hasty decision. I watched Olt for eight days
when he was playing with the big team. I saw some of the finest defensive plays from a third baseman that I’ve seen. In adittion his bat wasn’t too bad with two triples and a double.

Seems like your outlook was a bit hasty,

Keystone Heavy
14 years ago

Also, hearing “explosion off the bat” seems like a pretty questionable way of evaluating a players’ hitting prowess. I mean, I’m not a scout , nor will I ever claim to be, but I can’t help but question how much- if any- information you can recieve from listening to batting practice.