The Quiet Whistle

The 5-year officiating problem at Washington-Grizzly.

Share
The Quiet Whistle
The Quiet Whistle
Bobby BallThe officiating fileWa-Griz

The Quiet Whistle

The 5-year officiating problem at Washington-Grizzly.

Fewer judgment calls on visiting defenses−38%Since 2021. Compared to the rest of their own season. Their procedural fouls go up 29% on the same trip.
Bailout calls for Montana at home, 2021–258 of 631on 3rd or 4th down, extending drive. Other Big Sky offenses get 19. Cal Poly gets 34.
Officials with quieter whistles in Missoula33 of 43Those with 3+ games since 2021. Each man against his own personal record at the other Big Sky stadiums.

Eli Gillman went 55 yards in the third quarter with a hand in his face mask and then in his collar, and when he got up there was no flag. There wasn't going to be one. Northern Colorado's defense played 64 snaps against Montana's offense on Saturday and was not flagged once while the ball was live. No holding. No interference. No face mask, no horse collar, no hands to the face. The only flag it drew all day was a personal foul for a late hit.

Everyone yelled loudest about the replay reversal of the Birdno catch, but I was more concerned by the zero live-ball penalties. This has been the trend in Missoula since 2021: when the home crowd goes quiet for the offense, the referees' whistles do too, and only then, and only at Wa-Griz.

Visiting defenses commit more procedural fouls but draw fewer judgment calls
Flags on the visiting defense while Montana has the ball, Missoula against the road, 2021–25
At Washington-Grizzly On the road League
0 1.0 2.0 3.0 flags per 100 snaps JUDGMENT holding, PI,face mask, etc. 2.06 at home 3.28 league 2.87 PROCEDURAL offside, 12 men, etc. 0.77 at home 0.36 league 0.88 JUDGMENT holding, PI, face mask, etc. At Washington-Grizzly 2.06 On the road 3.28 PROCEDURAL offside, 12 men, etc. At Washington-Grizzly 0.77 On the road 0.36 0 1 2 3 flags per 100 Montana snaps
The other thirteen offenses draw judgment flags at the same rate home and away.

Encroachment is a fact. Pass interference is a judgment. This file is about those judgment calls: a man in stripes deciding whether to blow his whistle or not. The first bar is what the visitors did. Rattled teams commit more of both kinds of foul in every other stadium in the conference. To keep the officials out of this you have to believe eleven men commit procedural fouls at twice their usual rate in one stadium but a third fewer judgment fouls on the very same plays.

Everyone working for the University is barred from commenting on officiating by Big Sky Code 6.1.1.1.1, a rule that needed four decimal points to say hush. Last October the conference fined Sacramento State's Brennan Marion $10,000 for saying his team faces "10 to 1 penalties every single game," and the commissioner wrote that "publicly questioning the integrity of our officials and the Conference Office will not be tolerated." Three weeks later it suspended multiple officials from a Sacramento State–Idaho game over a last-minute catch it conceded was "incorrect judgment," and the next day it fined Idaho's Thomas Ford $2,500 for "commenting publicly about officiating." Both of those releases end with the same sentence, give or take a word. "The Big Sky will have no further comment on this matter."

The gag order doesn't reach me. I've come with data. Twelve years of it. I have been sitting on this file since early September, waiting for a Saturday like we just had. If you need a refresher on stats class before you keep reading, click here to read the appendix.

01

Eight bailouts in five years. The league gets nineteen

Facts, opinions, and third and fourth down

A false start is a fact, or at least it should be. Somebody moved, the ref saw it, there is nothing to weigh. Offside, delay of game, twelve men, illegal formation: a camera could throw them. Those are procedural fouls, and what they measure is execution. On Saturday even a fact went uncalled. On the snap Northern Colorado scored from the 2, the right tackle moved before the ball did. Nobody threw it. That is a different problem.

Holding is an opinion. So is pass interference, a personal foul, a face mask, a block in the back, targeting. Something that could be called holding happens on nearly every snap of a football game, and what varies is whether a man in stripes decides this one went too far. The officials' own manual says so, in the chapter on sportsmanship fouls: "It is the nature of the business to be criticized, and it seems especially true when we try to apply the relevant rules (Rule 9-2-1). These are judgment calls, as are all the decisions officials make during the action of the game." Consider the rest of this page the nature of the business.

The commissioner put it the same way in October 2022, in a game Griz fans remember well. Montana led Sacramento State 24–17 with just over three minutes left and had the Hornets in fourth-and-5. A sideline catch that every replay angle showed was out of bounds stood on review: first down at the Montana 4, touchdown, overtime, loss. Big Sky commissioner Tom Wistrcill wrote on his personal account: "The official, who was in correct position, made a judgment call." Montana AD Kent Haslam, who is bound by the code, told the Missoulian he "won't go into any specifics," which is Rule 6.1.1.1.1 working as designed. That is the whole answer, every time, and it is the reason this file counts the judgment calls instead of arguing about one.

Eight bailouts in 631 late downs. The league draws nineteen
Flags on the defense that hand the offense a first down on third or fourth down, per 100 such downs
0 1.0 2.0 3.0 bailouts per 100 third and fourth downs faced MONTANA, HOME 1.27 · 8 in 631 Montana, road 2.79 · 13 in 466 The other thirteen, home 2.99 · 185 in 6,181 Montana, home, execution flags 0.32 · 2 flags; zero on the road MONTANA, HOME · 8 in 631 1.27 Montana, road · 13 in 466 2.79 The other thirteen, home · 185 in 6,181 2.99 Montana, home, execution flags · 2; zero on the road 0.32 0 1.0 2.0 3.0 bailouts per 100 third and fourth downs faced
The lowest home rate of the fourteen, p = 0.058 against its own road rate. The gold bar is fouls a camera could call.

Of all the opinions, one is worth more than the rest. Third down, or fourth. The defense makes the stop. A judgment foul on that defense hands the offense the first down anyway. Call it a bailout, because that is what it is, and every offense in the Big Sky draws them, in every building, every year, about three per hundred of those downs.

Except Montana's offense at Washington-Grizzly, which has been handed 8 of them in five seasons, 41 games, 631 third and fourth downs. That is 1.27 per 100, less than half the conference rate. Hand those 631 downs to an average Big Sky offense in its own building and it draws nineteen. Hand them to Cal Poly and it draws thirty-four. That's eleven to twenty-six first downs the Griz did not get at home that other teams would have. The same Griz offense on the road drew 13 in 466, 2.79 per 100, close to the conference average. The one bailout of the day Saturday went the other way, interference on fourth-and-2 at our 4 yard line late in the third. UNC scored a touchdown on the next snap. One flag, seven more points.

What it says
Visiting defenses commit more procedural fouls and draw fewer judgment calls. No other building does both.
02

Every stadium in the league sits on one line, except ours

Put every stadium in the conference on one picture and a relationship becomes clear: Buildings where visiting defenses draw more judgment flags are the same buildings where they draw more procedural ones. That is what a hard place to play looks like. Crowd, travel, altitude, turf, a fast offense, and every one of them pushes both kinds of foul the same direction at once.

Thirteen of the fourteen sit on that line. The fourteenth, Montana, doesn't sit anywhere near it.

Thirteen stadiums on one line. One isn’t
One dot per stadium: the visiting defense’s home-to-road ratio, judgment flags against procedural
0.60 0.80 1.00 1.20 1.40 0.6 1.0 1.4 1.8 2.2 judgment calls, home ÷ road procedural calls, home ÷ road MONTANA 4.0 SD above the line the other 13 stadiums 0.60 1.00 1.40 0.6 1.0 1.4 1.8 2.2 judgment calls, home ÷ road procedural calls, home ÷ road MONTANA 4.0 SD above the line the other 13
Slope +1.24, r = 0.72, p = 0.006. Montana sits 4.0 standard deviations above the line; drop any school and refit and all thirteen refits hold.

Four standard deviations is a lot. Line up American men by height. The average is five foot nine, and two out of every three land within three inches of it, which makes three inches the standard deviation. Four standard deviations from 5'9" is a man who is six foot nine.

Montana's dot is a 6'9" man. Treat the fourteen dots as exact and the odds of one school landing that far off the line by chance are about 1 in 500. The dots are not exact. Montana's is built from 22 procedural flags at home and 7 on the road, and a handful of flags either way moves it. Give every dot that room to wobble and the odds are still about 1 in 100.

What it says
Every stadium in the league fits one line except ours. Chance puts it there once in 100 tries.
03

The crowd did not change. The calls did

Every visitor measured against its own season

Everything so far compares Montana at home against Montana on the road, and the honest objection is the opponent. Different teams, different discipline. So run it the other way. Take each visiting team from that season and ask what it did in Missoula against what that same team did in the rest of its own season, weighted by the snaps it played. Cal Poly is measured against Cal Poly. Weber State against Weber State. The opponent is on both sides of the comparison, so the opponent cannot be the answer.

The crowd’s fingerprint did not move. The judgment calls fell by half
How many more or fewer fouls visitors committed in Missoula than in the rest of their own season
2014–192021–25
PROCEDURAL FOULS (what players did) +33% +29% JUDGMENT FOULS (what an official decided) +13% −38% BAILOUTS GIVEN UP +6% −78% −75% −50% −25% 0 +25% +50% ◀ fewer than their own norm more ▶ PROCEDURAL FOULS (what players did) +33% +29% JUDGMENT FOULS (what an official decided) +13% −38% BAILOUTS GIVEN UP +6% −78% −75% −50% −25% 0 +25% +50% ◀ fewer than their own norm more ▶
Judgment: 26 flags where 41.9 were expected, p = 0.006. Bailouts: 2 where 9.1 were expected, p = 0.006.

Visiting teams have always committed about a third more procedural fouls (false starts, offsides, illegal formations) in Missoula than they commit anywhere else, and they still do.6 Between the two periods, the fouls that require a man to decide dropped from 1.13 to 0.62, and the bailouts from 1.06 to 0.22. Flags on opposing defenses dropped precipitously. Again, this is the same teams compared to themselves, how they were officiated in Wa-Griz, compared with how they were officiated everywhere else that season. Either you believe each and every team plays much cleaner in Missoula, or you believe something else is going on.

The hardest building in the league, and the second-quietest whistle
Every Big Sky venue, sorted by the crowd’s effect on visitors; the two dots move together everywhere but one
procedural fouls (the crowd)judgment fouls (the whistle)
0.5 1.0 1.5 what visitors did there ÷ what the same teams did everywhere else that season MONTANA 0.62 1.29 Idaho State Southern Utah Northern Arizona Weber State Montana State Idaho Northern Colorado Cal Poly UC Davis Utah Tech Portland State Eastern Washington Sacramento State MONTANA 0.62 1.29 Idaho State Southern Utah Northern Arizona Weber State Montana State Idaho Northern Colorado Cal Poly UC Davis Utah Tech Portland State Eastern Washington Sacramento State 0.5 1.0 1.5 visitors there ÷ same teams everywhere else
Montana’s procedural rate is the highest in the league; judgment p = 0.006. Every other building keeps its two dots within half a point. Montana’s are 0.67 apart, the wrong way.

Five venues come back significant, four of them quiet, and the two Montana schools lead them. With fourteen buildings and a one-in-twenty bar, chance alone would hand you about one, not five. Montana State is 0.54 on judgment and 1.03 on procedural. Sacramento State is 0.72 and 0.52. Those are buildings that are easy to play in, and it shows on both kinds of foul. Washington-Grizzly is the one place where visiting defenses commit more of the procedural penalties but get called less for what a man in stripes has to judge.

Run the identical test on 2014 through 2019 and only Cal Poly comes back significant, at 0.61. Montana sits at 1.13, tenth of thirteen. Whatever this is, it wasn't happening before 2021.

What it kills
Opponent quality, scheme and discipline cancel out. The crowd held steady; only the whistle changed.
04

Montana used to get the call. In 2021 it flipped

Pool all twelve years and there is nothing here. Judgment flags drawn at home 146, on the road 127, against 154.0 expected, no statistical significance. Bailouts 27 at home and 23 on the road against 26.8 expected. Anybody who tells you Washington-Grizzly has always been officiated strangely is telling you something the record will not support.

The twelve years cancel because the two halves run opposite ways, producing a misleading average.

Montana got the home call before 2020. Now it gets it least
How much more the offense’s judgment flags come at home than on the road, before and after the lost season
Montana Rest of the league
2014-2019 Montana 1.25 Rest of the league 0.94 2021-2025 Montana 0.63 Rest of the league 1.01 0 0.5 1 1.5 no home difference home rate as a share of the same team's road rate 2014-2019 Montana 1.25 Rest of the league 0.94 2021-2025 Montana 0.63 Rest of the league 1.01 0 0.5 1 1.5 home rate as a share of the same team's road rate
The rest of the league drifted the other way.

From 2014 through 2019 Montana's offense drew judgment flags at 1.25 times its own road rate, third in the conference, and bailouts at two to one. Since 2021 it is 0.63 and 0.45, the bottom of the conference.

I am not asking for a favorable whistle back. Montana got a modest home call from 2014 through 2019, the way home teams do in most sports.3 The complaint is the flip, which on its own could pass for a blip. A blip is one number pointing one way once. This is one direction everywhere you look, in one building, starting the same year, after six seasons of the opposite.

The Big Sky changed who runs its officials in April 2023,9 so split the five seasons at the handoff. Against every other building in the league, Montana’s home whistle is quiet on both sides of it: 34 percent below the league’s rate before, 26 percent below after; bailouts 68 percent below before, 57 percent below after. Comparing home vs. Montana’s own road games, most of the gap is from 2021–22: after 2023 the road rate fell significantly and home rose modestly; both still below the league average. The quiet whistle started traveling in 2023.

The league drifted up. Montana fell by half, on bailouts by five sixths
Montana’s change in the home call after 2021 against the other thirteen’s, each team and season held fixed
Montana, net of the leaguethe other thirteen
0 0.5 1.0 1.5 rate after 2021 ÷ rate before, as a multiple BAILOUTS 0.17 1.27 JUDGMENT FLAGS DRAWN 0.48 1.04 PROCEDURAL DRAWN, control 1.51 1.35 BAILOUTS 0.17 1.27 JUDGMENT FLAGS DRAWN 0.48 1.04 PROCEDURAL DRAWN, control 1.51 1.35 0 0.5 1 1.5 rate after 2021 ÷ rate before, as a multiple
Bailouts p = 0.006, judgment flags p = 0.008. The league’s own rise is not significant, and the procedural control does not move, p = 0.46.

Someone might write this off by saying the officiating changed everywhere after the lost season and Montana is just the school somebody (me) counted. The data says the opposite. And I counted every school the same way. Set Montana against the other thirteen, before against after, 1,663 team-games, each team's own baseline and each season held fixed. After 2021 the other thirteen schools got slightly more of the home call. Montana's went down by half on judgment flags and by five sixths on bailouts. Run the identical test on every school with games on both sides of the break and Montana is first on both. On bailouts it is the only school in the conference with a significant result in that direction. On judgment flags one other school clears the bar with it, and it is Montana State.

What it says
Montana used to get a mild home whistle. Since 2021 it gets the opposite.
05

Nineteen ways of asking. Eighteen give the same answer

You might say I'm cherry picking. So I ran nineteen different ways of asking the same question, on different subsets of the games and by different methods. Eighteen of the nineteen clear one-in-ten significance (p < 0.1), thirteen clear one in twenty (p < 0.05), and two more sit at 0.050. The one that fails holds the real betting line fixed inside a 10-to-24-point band, a cut that leaves almost no Montana road games to compare; the same band on our modeled margin comes back at 0.45. Every p-value is in the appendix. Set your own bar.

What is left
Something changed in how judgment calls get made at Wa-Griz in 2021, and it stuck.
06

The NCAA's playoff crews go quieter in Missoula and louder in Bozeman

The test that should have broken this

Seven of Montana's 41 home games were worked by crews the NCAA assigns for the playoffs rather than by the conference. A different officiating body with its own supervisor and its own points of emphasis, in the same building with the same 25,000 people. If this were a story about who the Big Sky hires, those seven games are where it ought to come apart. The NCAA's championship manual requires that playoff officials "be neutral," and the seven crews that worked those games have no Big Sky officials on them.

It gets sharper. Montana's offense drew judgment flags at 2.17 per 100 snaps from Big Sky crews at Washington-Grizzly and 1.49 from the NCAA's. The bailout count does not follow, two in 103 playoff third and fourth downs against six in 528 under Big Sky crews. Seven games is too few to test and no test is claimed. The direction on the judgment calls is the point.

The playoff crews go quieter in Missoula and louder in Bozeman
What each home offense draws from Big Sky crews against the NCAA’s playoff crews, 2021–25
Big Sky crewsNCAA playoff crews
0 1.0 2.0 3.0 judgment flags drawn by the home offense per 100 snaps, 2021–25 MONTANA 2.17 1.49 MONTANA STATE 1.43 2.82 THE OTHER TWELVE 3.02 2.85 MONTANA 2.17 1.49 MONTANA STATE 1.43 2.82 THE OTHER TWELVE 3.02 2.85 0 1.0 2.0 3.0 judgment flags drawn by the home offense per 100 snaps, 2021–25
Montana under Big Sky crews in 34 games, playoff crews in 7. Montana State’s playoff number comes from 11 home playoff games.

The obvious reply is that playoff crews call a tighter game everywhere and Montana hosts a lot of them. Take both Montana schools out, so the comparison cannot contain the thing being tested, and the rest of the league's home playoff games run 2.85 judgment flags per 100 against 3.02 in the regular season. What gap there is runs looser. Then Bozeman settles it. Montana State hosted eleven home playoff games, more than anybody in the conference, and its home rate goes from 1.43 per 100 under Big Sky crews, the lowest in the league, to 2.82 under playoff crews. The crews that go quiet at Washington-Grizzly do not go quiet at Bobcat Stadium.

None of the argument needed those games anyway. Delete every playoff game in the file and Montana is still first of fourteen at p = 0.026, and the league's line in section 02 gets tighter. If crew composition were manufacturing this result, deleting those games would end the argument.

What it rules out
Big Sky and NCAA playoff crews both go quiet at Wa-Griz. The playoff crews go quietest.
07

Thirty-three of forty-three officials call Missoula quieter than their own norm

The test a conference average cannot pass

"We do have every play of every football game graded out afterward, and they are at an incredibly high rate for the number of correct calls that they've made." That is deputy commissioner Dan Satter at the Big Sky Kickoff in July 2025, and it is true, which is the problem. An average is built to wash out one building. It cannot see this and it was never going to.

Forty-three officials worked at least three games at Washington-Grizzly between 2021 and 2025, and every one of them also worked the other Big Sky stadiums in the same seasons. For each man, take the rate at which home offenses draw judgment flags in his own games everywhere else, and ask what Montana got from him in Missoula. All eight positions, not just the crew chief.

Measurebelow his own rate above itp, crews accounted for
Judgment flags drawn by the home offense33 of 4310p = 0.05
Bailouts drawn, third and fourth down35 of 438p = 0.03

Twenty-three of the 43 have never thrown a bailout for Montana's offense at Washington-Grizzly. Their own rates elsewhere in this conference run from 0.9 to 5.6 per 100 third and fourth downs. In Missoula, nothing.

Those 43 men are not 43 independent facts. They work in crews of seven and eight drawn from 33 distinct games, so counting them one by one would be counting one venue 43 times. Hold the real crews together, let each game's count vary the way counts do, and ask how often chance alone puts 33 of them under their own rate: p = 0.05. Their own rates elsewhere predict 78 judgment flags for Montana's offense across those 41 games. It drew 59. They predict 18 bailouts. It drew 8.

Run the same count on the procedural flags the same crews threw and it comes back 26 of 43, a coin flip. Six officials clear 5% on their own, where 43 tests would hand you two by chance, and none clear it the other way. Take those six out and the other 37 still run 27 under their own rate to 10 over, so there is no short list of names to hand the conference. A handful of bad officials would be a personnel problem the Big Sky could fire its way out of in an afternoon. This is worse news than that.

What it says
33 of the 43 Big Sky officials who have worked at least 3 Wa-Griz games call it quieter than everywhere else.
08

Saturday's crew has no record of calling Missoula quiet

And the four home games of 2026, which do not all go my way

Seven men officiated the game Saturday. One eGriz poster wanted the whole crew struck from Griz games. Another was sure the referee works every one of them. The white hat has worked six Griz games in six seasons, four of them in Missoula.

In total he's officiated 41 Big Sky games since 2021, every one as the referee, and his crews are quiet everywhere. Home offenses draw judgment flags at 1.95 per 100 snaps in his games at the other Big Sky stadiums, against a league rate of 2.87. In his three games at Washington-Grizzly before Saturday, Montana's offense drew six in 203 snaps, 2.96 per 100, more than he gives anybody else, and zero bailouts in 49 third and fourth downs where his own rate predicts 1.6. Saturday made it zero in 63.

The side judge Saturday has been in Missoula four times, and Montana's offense drew eight judgment flags in 261 snaps from his crews, 3.07 per 100 against his 2.09 everywhere else, with zero bailouts in 61 third and fourth downs. The linesman Saturday runs the other way: 3.02 per 100 in 34 games elsewhere, 1.76 in three games in Missoula, zero bailouts in 50. The back judge has six Big Sky games in the file and one in Missoula, 81 snaps, nothing drawn. I cannot find records of the other three officials on any Big Sky crew in five seasons.

Wa-Griz, 2026UM snaps judg drawnper 1003rd+4th downsbailouts
Aug 29 · Southern Utah4624.35110
Sep 5 · Drake8300.00170
Sep 12 · Utah Tech6634.55161
Oct 3 · Northern Colorado6411.56140
FOUR GAMES25962.32581
2021–2025 home2,861592.066318

2026 is slightly above the five-year home rate. Four home games are now in the file, and Montana's offense has drawn six judgment flags in 259 snaps, 2.32 per 100, against the 2.06 that built the case and below the conference average of 2.87, with one bailout in 58 third and fourth downs. Our own defense has been called for four at home this year, Saturday's at the goal line among them.

What it says
Saturday’s crew has no history of calling it quiet. Whatever this is, it is bigger than any one officiating crew.
09

Montanans could bet on the Griz for the first time in 2021. The whistle went quiet the same year

In March 2020 the first Sports Bet Montana kiosks went live in Montana bars and casinos. From that day a Griz game and a Cat game carried a posted number that anyone in the state could see and act on, legally, without leaving Montana.

Then the Big Sky did not play a fall 2020 season. The first Big Sky season Montanans could legally bet on the Griz is 2021. The two schools whose home judgment calls moved the most since 2021 are Montana and Montana State, first and second in the conference. That could well be coincidence.

There is research1 on 38,871 flags in FBS games from 2012 to 2015 and the peer-reviewed version2 in 2021 that shows the existence of a betting line correlates with a bias "toward the underdog team during in-conference games." The studies showed the team Vegas favored was called for more judgment flags than the opponent. This wasn't observed in every conference. In conferences where it was seen, the more a team was favored, the more penalties were called on them. Nobody has identified the mechanism.

Montana is the favorite at Washington-Grizzly nearly every week. It draws fewer judgment flags there than anywhere, and offensive holding gets called on it at home at twice its road rate, 1.33 per 100 snaps against 0.68. That is what an underdog-favoring whistle looks like in a building where the home team is almost always the favorite. I'm not saying that is happening here. But it could be.

None of this is a claim about anybody's conduct. I am just pointing out the correlation between the state law change and the officiating change, and other research on officiating behavior. Perhaps there's no connection. If there were a connection, it would not likely be nefarious. The research I cited "offers no evidence that specific officials intentionally skewed game outcomes."

Another correlation one might point to is that crews worked a short spring season in 2021 and otherwise sat out 21 months between the 2019 and 2021 fall seasons. That interlude could have changed points of emphasis, or how games get called, or changed something else about officials. If it did, it is hard to see why this would mostly affect just the two Montana schools, or why the Griz would move 4 standard deviations off the conference trendline.

What it says
Legal Griz betting and the quiet whistle arrived the same season. That correlation is all this page claims.
10

What this file proves, what it can't, and what would settle it

The results are not independent of one another: the bailout count, the difference-in-differences and the bailout half of the officials test are the same 21 flags looked at three ways. The sample is as large as five seasons of home football games can make it, and smaller than an ideal one. Throw it out for its size and you are saying a question like this can never be measured. It is large enough to find results that are unlikely to have been caused by chance.

Every one of these calls is on tape. A review of third and fourth downs at Washington-Grizzly against the same situations on the road would answer the question.

The Big Sky will likely have no further comment on this matter, but I invite the league to explain why the whistle has gone quiet at Washington-Grizzly. A paper on referee bias in the NBA7 showed that research calling attention to a bias can make it rapidly disappear. I hope that will be the case here.

Subscribe free

Nothing here alleges misconduct by any official, any conference, any team, or any other individual or entity. The per-official figures are counts of flags in games a man worked, and a rate is not a verdict on anybody or any thing. The measurements are of games, in aggregate, across a conference.

APPENDIX

Count the flags, divide by the chances, compare a team against itself

How every number on this page was made, for readers who skipped statistics on purpose

Every number here starts the same way. Count the flags, divide by the chances. A flag per 100 snaps is a rate, and a rate lets a 46-snap game and an 83-snap game sit on one scale. Then compare a team against itself. Montana's offense on the road is the same offense as Montana's offense at home, same players and the same playbook, so when the road gets 3.28 judgment calls per 100 snaps and home gets 2.06, the difference has to come from something that changes between Missoula and everywhere else.

Every comparison carries a p value, which answers one question: if nothing were going on, how often would random chance produce this outcome? A p of 0.007 means about 1 out of 150. Or pretty damn unlikely. Some of the tests here are built for counting rare events, some hold each team's own baseline and each season fixed so a bad team or a flag-happy year can't manufacture the result, and one in section 04 asks whether Montana changed more across 2021 than the rest of the league did, which is all "difference-in-differences" means. All of them answer the same question, in the same way.

Judgment foul
Holding, interference, personal foul, face mask, block in the back. An official decides whether what he saw was a foul.4,5
Procedural foul
False start, offside, delay, formation, substitution. It happened or it didn't.
Bailout
A judgment foul on the defense on third or fourth down that hands the offense the first down.
Against its own season
Each visitor in Missoula compared with that same team everywhere else it played that year.

Back to the top ↑

What to hold onto
Count the flags, divide by the chances, compare a team against itself. That is the whole method.
Note · the nineteen specifications, every p-value as computed
How it was testedMontana at homep
Judgment drawn, exact test against Montana's own road rate0.63×0.007
Bailouts, exact test against Montana's own road rate0.45×0.058
Every visitor against its own season, judgment0.62×0.006
Every visitor against its own season, bailouts0.22×0.006
Judgment drawn, Poisson against the other 130.61×0.018
Same, with crew fixed effects0.60×0.017
Same, excluding playoff games0.61×0.026
Same, Big Sky crews only0.62×0.057
Same, holding the market spread linear0.61×0.018
Same, spread in 7-point buckets0.62×0.022
Games Montana was favored by 7+ on the real line0.54×0.053
Bailouts, exact test, excluding playoff games0.41×0.049
Difference-in-differences, bailouts, vs 13 schools0.17×0.006
Difference-in-differences, judgment drawn0.48×0.008
Distance off the league's judgment-procedural line, counts allowed their own noise4.0 SD0.009
Same, excluding playoff games4.0 SD0.010
Officials below their own rate, crews accounted for33 of 430.050
Spread −10 to −24 at both venues, real market line1.09×0.81
Same band, modeled margin instead of the market line0.45×0.050
Notes and sources

None of this is published anywhere. The NCAA posts team penalty totals and nothing else, no conference releases which crew worked which game, and the officiating statistics the national rules committee reviews every February are never printed.8 I could not find this done anywhere before. No published study of college football separates the calls an official decides from the fouls a camera could call, none names the crew on every flag, and the only prior study of FCS officiating counts season totals with every foul lumped together.11 The pieces come from earlier work: the judgment-procedural split from NFL research,4,5 the crowd’s effect on pre-snap fouls from Farnell,6 the betting-line comparison from Brymer and his coauthors,2,3 and the warning about high-leverage moments from Moskowitz.10 Putting them together on 15,491 flags with the officials identified is, as far as I can find, new.

The file covers 1,200 games, all 14 Big Sky schools, 2014 through 2025, including the spring 2021 season, plus 308 flags from the 25 games of 2026 so far. Every flag is checked against both teams’ official penalty totals and carries its type, yardage, down, quarter, enforcement and crew. The models are Poisson with an exposure offset, team and season fixed effects, and errors clustered on the game; the expected margin comes from a rating model that tracks the betting market at 0.91 where one exists. Betting dates come from Montana Lottery reporting, the manual quotation from the 2024 CCA Football Officiating Manual, and the Big Sky Code quotations from its 2023–24 edition.

Officials in several sports have been shown to swallow the whistle when the game is on the line.10 The models here hold team, season, spread and crew fixed, but not the score or the clock. The bailout test compares third and fourth downs at home with third and fourth downs on the road, so those calls are already like for like.

  1. Study of 38,871 FBS penalties, 2012–2015, as reported by Financial Advisor.
  2. Brymer, Rodenberg, Zheng & Holcomb, “College Football Referee Bias and Sports Betting Impact,” Eastern Economic Journal 47 (2021): 91–106. Link.
  3. Brymer, Rodenberg & Holcomb, “Referee Analytics: Bias in Major College Football Officiating,” MIT Sloan Sports Analytics Conference, 2015.
  4. Snyder & Lopez, “Consistency, accuracy, and fairness: a study of discretionary penalties in the NFL,” Journal of Quantitative Analysis in Sports 11 (2015): 219–230. Link.
  5. Harvard Sports Analysis Collective, “Inside the Flags?: A Data-Driven Investigation of NFL Penalties,” September 2025. Link.
  6. Farnell, “False Start? An Analysis of NFL Penalties With and Without Crowds,” Journal of Sports Economics 24 (2023): 695–716. Link.
  7. Pope, Price & Wolfers, “Awareness Reduces Racial Bias,” working paper, 2014; published in Management Science, 2018. Link.
  8. NCAA Football Rules Committee, annual meeting reports, February 2025 and February 2026.
  9. Big Sky Conference, “Campbell Named Big Sky Coordinator of Football Officials,” April 7, 2023. Link.
  10. Moskowitz, “Swallowing the Whistle,” Freakonomics, January 31, 2012. Link.
  11. Dix, “A Decade of Referee Bias against College Football Programs from Historically Black Colleges and Universities,” International Journal of Sport Culture and Science 5 (2017): 197–212. Link.