Regression Alert: Week 8

Adam Harstad's Regression Alert: Week 8 Adam Harstad Published 10/27/2022

Welcome to Regression Alert, your weekly guide to using regression to predict the future with uncanny accuracy.

For those who are new to the feature, here's the deal: every week, I dive into the topic of regression to the mean. Sometimes I'll explain what it really is, why you hear so much about it, and how you can harness its power for yourself. Sometimes I'll give some practical examples of regression at work.

In weeks where I'm giving practical examples, I will select a metric to focus on. I'll rank all players in the league according to that metric and separate the top players into Group A and the bottom players into Group B. I will verify that the players in Group A have outscored the players in Group B to that point in the season. And then I will predict that, by the magic of regression, Group B will outscore Group A going forward.

Crucially, I don't get to pick my samples (other than choosing which metric to focus on). If I'm looking at receivers and Cooper Kupp is one of the top performers in my sample, then Cooper Kupp goes into Group A and may the fantasy gods show mercy on my predictions.

Most importantly, because predictions mean nothing without accountability, I track the results of my predictions over the course of the season and highlight when they prove correct and also when they prove incorrect. At the end of last season, I provided a recap of the first half-decade of Regression Alert's predictions. The executive summary is we have a 32-7 lifetime record, which is an 82% success rate.

If you want even more details, here's a list of my predictions from 2020 and their final results. Here's the same list from 2019 and their final results, here's the list from 2018, and here's the list from 2017.


The Scorecard

In Week 2, I broke down what regression to the mean really is, what causes it, how we can benefit from it, and what the guiding philosophy of this column would be. No specific prediction was made.

In Week 3, I dove into the reasons why yards per carry is almost entirely noise, shared some research to that effect, and predicted that the sample of backs with lots of carries but a poor per-carry average would outrush the sample with fewer carries but more yards per carry.

In Week 4 I discussed the tendency for touchdowns to follow yards and predicted that players scoring a disproportionately high or low amount relative to their yardage total would see significant regression going forward.

In Week 5, I revisited an old finding that preseason ADP tells us as much about rest-of-year outcomes as fantasy production to date does, even a quarter of the way through a new season. No specific prediction was made.

In Week 6, I explained the concept of "face validity" and taught the "leaderboard test", my favorite quick-and-dirty way to tell how much a statistic is likely to regress. No specific prediction was made.

In Week 7, I talked about trends in average margin of victory and tried my hand at applying the concepts of regression to a statistic I'd never considered before, predicting that teams would win games by an average of between 9.0 and 10.5 points per game.

STATISTIC FOR REGRESSION PERFORMANCE BEFORE PREDICTION PERFORMANCE SINCE PREDICTION WEEKS REMAINING
Yards per Carry Group A had 24% more rushing yards per game Group B has 25% more rushing yards per game None (Win!)
Yards per Touchdown Group A scored 3% more fantasy points per game Group A has 12% more fantasy points per game None (Loss)
Margin of Victory Average margins were 9.0 points per game Average margins are 11.9 points per game 3

The writing had been on the wall for a couple of weeks, but we officially close the books on our first failed prediction of the season; in fact, this is the first time this particular prediction has failed in the six-year history of Regression Alert. I'm not especially surprised that it failed. If you make an 80-90% bet often enough, eventually, it's going to go bad. But I'm a little surprised by how it failed.

The core observation of the yard-to-touchdown ratio prediction is that there is a narrow "sustainable" range of rates at which players can convert yards into touchdowns. Players who are averaging fewer than 100 yards per touchdown are going to start scoring less. Players who are averaging more than 250 yards per touchdown are going to start scoring more. And that's exactly what happened. Group A averaged one touchdown for every 57 yards at the time of the prediction; it averages one per every 207 yards since. Group B averaged a touchdown for every 378 yards at the time of the prediction; it averages one per 148 since. Group B actually outscored Group A with 0.36 touchdowns per game against 0.31.

No, it's the secondary observation that let us down. Usually, when yard-to-touchdown ratio stabilizes, it's the yards that stay constant and the touchdowns that regress. In this case (as mentioned above) the touchdowns regressed just fine, but the yards changed dramatically. Group A went from 48 yards per game at the time of the prediction to 64 yards per game since. Group B plummeted from 84 yards per game at the time of the prediction down to 53 since. It wasn't a single injury or a single outlier player or a fluky big game that did it, either; Group A was up pretty much across the board, and Group B was down pretty much across the board.

No real takeaways other than that random things behave randomly.

As for our second prediction, the average margin rebounded from its aberrant early-season low mark. It passed our predicted range, but it's hard to say so soon whether that's a bad sign or just random noise. We'll have to wait another week or two to see.


Interceptions Are Also Pseudoscience

Three years ago, I wrote about how interception rate was very nearly as unstable from one sample to the next as my favorite punching bag, yards per carry. I cited research, including findings by fellow Footballguy Danny Tuccito that while we only needed a sample of 396 pass attempts before a quarterback's yard per attempt average is as much a result of skill as luck, it takes a sample of 1681 pass attempts before interception rate stabilizes in the same way. (For context, yards per carry requires 1978 carries to stabilize and represent equal parts skill and luck.) People dramatically underestimate just how much luck is involved in whether a pass gets picked off or not.

In fact, given how unstable interception rates are, my biggest lament is simply that interceptions... don't really matter for fantasy football. In most scoring systems, quarterbacks are only penalized one or two points per turnover. Sometimes there's not any penalty at all. (My favorite scoring system penalizes players 4.5 points per turnover, which makes identifying regression much more valuable, but such setups are rare.)

Otherwise, we can predict that guys with a lot of interceptions will likely throw a lot fewer going forward, but this doesn't produce much actionable insight when it comes to fantasy football. With one notable exception.

Already a subscriber?

Continue reading this content with a PRO subscription.

You see, while interceptions play a virtually negligible role in quarterback scoring, they're a massive part of defensive scoring. And they're just as random for defenses as they are for quarterbacks, if not more so. (Justin Fields and Kenny Pickett will still be the same people a week from now, but their opponents will be different.) Which means fantasy defenses that have been excelling on the back of unsustainable interception rates are probably due for a reckoning, while solid units that have been good at getting sacks and keeping opposing teams out of the end zone but haven't been getting as many takeaways are due for a boost.

To this point of the season, the Buffalo Bills, Philadelphia Eagles, Chicago Bears, New York Jets, Baltimore Ravens, and Pittsburgh Steelers all have eight or more interceptions. Collectively, they've intercepted 51 passes in just 40 games, an average of 1.28 per game. This is our Group A.

On the other end, the Denver Broncos, Carolina Panthers, Miami Dolphins, Las Vegas Raiders, Indianapolis Colts, Kansas City Chiefs, Detroit Lions, Green Bay Packers, Washington Commanders, Cleveland Browns, New York Giants, and New Orleans Saints all have four or fewer interceptions. Collectively, they've intercepted 31 passes in 82 games, or 0.38 per game. This is our Group B.

To this point, Group A has a whopping 65% more interceptions than Group B. They might be better defenses, but that kind of advantage in such an unstable statistic isn't sustainable; I predict that through the magic of regression, Group B will intercept more passes than Group A over the next four weeks.

Photos provided by Imagn Images

More by Adam Harstad

 

Dynasty, in Theory: Do the Playoffs Matter?

Adam Harstad

Should we include playoff performances when evaluating players?

01/18/25 Read More
 

Odds and Ends: Divisional Round

Adam Harstad

Examining past trends to predict the future.

01/17/25 Read More
 

Odds and Ends: Wild Card Weekend

Adam Harstad

Examining the playoff futures and correctly predicting the Super Bowl winner.

01/10/25 Read More
 

Dynasty, in Theory: Evaluating Rookie Receivers

Adam Harstad

Revisiting this year's rookies through the lens of the model

01/09/25 Read More
 

Dynasty, in Theory: Consistency is a Myth

Adam Harstad

Some believe consistency helps you win. (It doesn't.)

01/04/25 Read More
 

Odds and Ends: Week 18

Adam Harstad

How did we do for the year? Surprisingly well!

01/02/25 Read More