Explaining LIPS
It’s been almost four years since I first tried to devise a defense-independent pitching metric that incorporated batted ball data. I was inspired, then, by Voros McCracken’s articles on DIPS, both the original where he showed that pitchers appear to have little control over the results of balls put into play against them, and his follow-up, where Voros examined various improvements that could be made to DIPS, one of which was to incorporate batted ball data.
For years, I’ve been tinkering with various ways to do just that. The first incarnation of this statistic I called DIPS 3.0 (since Voros had already released two versions), but since I’ve switched to LIPS, which stands for “Luck Independent Pitching Statistics.” See, in my research I have found that not only do pitchers have little control over the results of their balls in play, but they also have little control over the number of home runs they allow, outside of their flyball or groundball tendencies. I repeat: Outside of forcing ground balls, an ability by the way, which is very persistent, there is little a pitcher can do to prevent home runs.
In light of this, we must re-assess Voros’ spectrum of what a pitcher can and cannot control. Rather than giving a pitcher credit for his strikeouts, walks, hit-by-pitch, and home runs and ignoring everything else as Voros did, we want to give him credit for his strikeouts, walks, hit-by-pitch, infield flies, outfield flies, and ground balls, while ignoring or adjusting everything else. At this point, we are not just removing defense from the equation, but luck itself, which is why I eventually changed the name of my statistic from “DIPS 3.0” to “LIPS.”
So how do we calculate LIPS? It’s a complicated process, one which has undergone many revisions, so in the interest of making it clear to all, I thought I’d show you through an example, using Rich Harden as my guinea pig (note that I haven’t updated my database in about a week, so these stats are a bit dated):
- Harden has allowed 10 infield flies, 35 outfield flies, 23 line drives, 41 ground balls, and 6 bunts. Because we know that a pitcher has little or no control over his line drive rate, we replace Harden’s line drive rate with the league average and adjust the rest of his batted ball numbers accordingly. Rounding, that leaves us with 10 infield flies, 36 outfield flies, 22 line drives, 42 ground balls, and 6 bunts. Basically, there’s no change for Harden specifically, though other pitchers may see big variations. (Also note that BIS actually breaks out another category for us, called a “fliner,” which is something between a fly ball and a line drive. In the actual LIPS calculations, these are treated as a separate category, but for simplicity, I’ve lumped them in with fly balls and line drives here.)
- We now multiply all of Harden’s transformed batted ball statistics by the league average outcome rates for each. So if the average National League pitcher allows 0.21 singles per ground ball, we calculate that Harden will allow 0.21*42 = 8.8 ground ball singles. Do that for every outcome and every batted ball type and you get a predicted pitching line. In this case we predict that, independent of luck, Harden would have allowed about 23 singles, 7 doubles, 1 triple, 4 home runs, and 1 reached on error. His actual line is, 23 singles, 8 doubles, 0 triples, 8 home runs, and 1 reached on error. You can see that the two lines match in just about everything except for home runs. (We also predict outs on balls in play and double plays using the same method, by the way.)
- Next, we adjust Harden’s strikeout, walk, and hit-by-pitch numbers for park. This is done because all of the numbers we derive in step (2) are park neutral, and we don’t want to mix apples and oranges, or in this case, park-adjusted stats with non-park-adjusted stats. Harden doesn’t see much change here, going from 53 strikeouts, 21 walks, and 2 hit-by-pitch to 52 strikeouts, 21 walks, and 2 hit-by-pitch.
- Now we throw the results of steps (2) and (3) into the BaseRuns formula. You can read more about BaseRuns here, but the basic idea is that it is the most accurate, least biased run estimator around. At this point, we know how many runs we expected Harden to allow, which in this case is 16.
- We now adjust step (4) for park factor—in the reverse. Our estimated runs allowed are park neutral, but we want them to be directly comparable to ERA. Therefore, we multiply by the park factor instead of dividing as you do when trying to make a statistic park neutral. Harden’s estimated runs allowed are increased four percent, as Wrigley Field is a hitter’s park, yielding a new estimate of 17 runs
- We estimate luck independent innings pitched by adding together the number of expected outs and double plays we got in step (2) with the adjusted strikeouts we got in step (3), and dividing by three. We get 41 luck-neutral innings pitched.
- We divide step (6) by step (5), and multiply by 9. Without rounding, the result is 3.63 runs per nine innings.
- Finally, we estimate how many unearned runs Harden should have allowed based on his ground ball rate, which has a very high correlation with unearned runs. We find that around 93 percent of Harden’s runs are expected to be earned, yielding a LIPS of 3.39.
That’s the basic process. OK, I understand that it’s anything but basic, but I hope my explanation was simple enough for all to follow. Every step is based on thorough research, a lot of which you can read in The Hardball Times Annual 2007 if you so desire, but otherwise you’ll have to take my word for it. LIPS takes the luck out of pitching statistics better than any other such stat I’ve ever read about, and that’s why we use it so often here at THT Fantasy.
If you have any questions, fire away in the comments section and I’ll try to answer them as best I can.
this was actually really great. The explanation was easy to understand, thanks a ton.
I would love to ask one more question: What are the main differences between Lips and xFip?
DT,
xFIP is FIP but with HR/OF normalized to the league average. It gets you most of the way to LIPS, but it does not (1) Take into account things like infield fly and ground ball rate, (2) Use the best run estimator (BaseRuns), and (3) Adjust for park so as to be directly comparable to ERA. Those are the main differences.
I haven’t followed these things as closely as I should, so take these comments as possibly uninformed. But I find a couple of the statements here astounding and counter-intuitive:
“Outside of forcing ground balls there is little a pitcher can do to prevent home runs.”
“we know that a pitcher has little or no control over his line drive rate”
Really?
I’m also wondering where in all of this is one of the REAL things a pitcher can’t control – the quality of the opposition batters he faces. Simplistically, if I pitch in the AL, I’m facing better hitters than I would in the NL. Unlucky?
Steve,
The simple answer is yes, really. If you want all the data, look up the 2007 Annual.
David,
Excellent piece. This type of LIPS primer is something many people have been looking for.
With respect to the previous post and the issue of data supporting a pitcher’s inability to control his line drive rate and HR/FB, why did you suggest The Hardball Times Annual 2007 and not a more recent version (such as 2009)? Is there a piece in the 2007 book that discusses the research behind these principles, or were you just referring to the raw data underlying previous analyses?
I ask mainly because I would be interested in such an article, where the research itself is discussed, even if only superficially. (And if the same discussion is in the more recent book, that would be preferable to the 2007 version.)
DMC,
Glad you enjoyed the piece. My article on how much players control batted balls is in the 2007 Annual, which is why that’s what I recommended.
Cool beans.
Hey Brad,
We’d love to but it takes a lot of programming. If you want to splurge (or take your chances in the “Worst Monday” contest), Heater Magazine carries updated LIPS numbers every week.
does a pitcher really have no control over his line drive rate? It seems there an extreme groundball pitcher (Wang, Lowe, Halladay) would be lower than league average.
Mark,
An average LD% is around 19%. Here are how the three pitchers you named have done in the past few years:
Wang – 18% (2007), 22% (2008), 26% (2009)
Lowe – 16% (2007), 17% (2008), 17% (2009)
Halladay – 18% (2007), 19% (2008), 20% (2009)
There is little evidence that pitchers control their line drive rate. What little evidence I’ve found actually points to ground ball pitchers having HIGHER ground ball rates, though it’s not a huge effect.
I am currently working on a study regarding relief pitchers and evaluating their regressions. Currently, I am using DERA as a means to evaluate, but this sounds much better. Is there anywhere around the site to find info on players from 98-current?
Tim,
Unfortunately, no.
Great article, I use xfip religiously in fantasy baseball, but this stat seems even more accurate, any chance it gets added to the THT pitching section?
Nathaniel,
That’s exactly why we do that. Different pitchers have different propensities for giving up unearned runs. The reason for that (or at least most of the reason) is that ground balls are much more likely to become errors than other batted ball types. So ground ball pitchers give up more errors and therefore more unearned runs. That’s why we estimate errors based on batted ball types and then estimate what percentage of a pitcher’s runs allowed will be earned—to come up with the best estimate of what a pitcher’s ERA should have been.
Late to the party, yes, I know, but….
If you’re trying to design LIPS to be a most accurate evaluation of a pitchers effectiveness, why would you estimate how many errors would occur behind a pitcher and adjust for earned runs? The point is to try to come as close as possible to the real world in examining a pitchers ability to prevent runs, no? If a pitcher’s “style” results in more errors, that leads to more real world runs. It seems like trying to make a correction for earned runs actually makes this formula less accurate.
Which means, of course, that the stat is less accurate at estimating real world runs allowed. People are still in love with the ERA stat, aren’t they?
Well, we first estimate real world runs allowed, so if that number was of interest to a lot of people that’s what we would report. But since ERA is (1) The stat that is generally used in fantasy baseball and (2) Carries the more intuitive scale for most people, that’s what we estimate.