Old Gold Standard

Methodology

This page is factual: what the data tiers are, how the rating and accomplishment measures are built, and what the known limits are. No conclusions are drawn here - see what it means for that.

Data tiers and sources

The rating model and weighting test

The 1985-present rating is fit on every REG and CONF_TOURNEY game across the Division I field, then tested by predicting each season's NCAA tournament games under several candidate weighting schemes (unweighted, conference-weighted, recency-weighted, recency-weighted with a postseason boost, and an uncapped version of the last). Schemes are scored by pooled and per-decade log-loss, accuracy, and margin RMSE.

Weighting-test results by scheme and decade
SchemeDecadeNAccuracyLog-lossMargin RMSE
conference1980s31570.5%0.52910.15
conference1990s63073.5%0.52611.36
conference2000s63973.4%0.51010.78
conference2010s66770.6%0.55411.23
conference2020s33471.0%0.57712.10
conferencepooled2,58572.0%0.53611.14
recency1980s31570.5%0.52910.16
recency1990s63073.3%0.52611.37
recency2000s63972.6%0.51110.79
recency2010s66770.3%0.55411.21
recency2020s33470.7%0.57612.09
recencypooled2,58571.7%0.53611.14
recency_postseason1980s31570.5%0.52910.16
recency_postseason1990s63073.3%0.52611.37
recency_postseason2000s63972.6%0.51010.79
recency_postseason2010s66770.5%0.55411.20
recency_postseason2020s33471.0%0.57612.09
recency_postseasonpooled2,58571.8%0.53611.14
recency_postseason_uncapped1980s31572.7%0.53810.36
recency_postseason_uncapped1990s63071.9%0.53111.30
recency_postseason_uncapped2000s63973.6%0.51110.76
recency_postseason_uncapped2010s66769.6%0.55911.31
recency_postseason_uncapped2020s33469.5%0.58512.05
recency_postseason_uncappedpooled2,58571.5%0.54111.16
unweighted1980s31570.8%0.52910.15
unweighted1990s63073.5%0.52611.36
unweighted2000s63972.6%0.51010.79
unweighted2010s66770.3%0.55311.23
unweighted2020s33470.7%0.57812.10
unweightedpooled2,58571.8%0.53611.15

The chosen default scheme is recency_postseason: it has the best (lowest) pooled log-loss among the capped schemes, and capping the recency weight keeps Purdue's own season-to-season rating movement close to the unweighted baseline (rank correlation above 0.99) while the uncapped version lets a single hot or cold postseason swing a season's rating by up to several points - the cap trades a small amount of predictive sharpness for stability.

Tier C construction and calibration

For each Big Ten season 1906-07 through 1984-85, Purdue's Tier C strength is the mean, over that season's conference games only, of Purdue's game margin plus a home-court adjustment plus k times the opponent's own conference win percentage that season (with games against Purdue removed and standardized across that year's conference field), then standardized across all Tier C seasons. Non-conference games are excluded entirely rather than penalized with a placeholder value. The smoothing parameter k was calibrated, not guessed: the identical measure was built for 1985-2025 (where a real rating already exists) under several values of k, and the value that best rank-correlates with that real rating_z was chosen.

Tier C calibration: correlation with rating_z by choice of k
kSpearman rho vs rating_zp-valueN seasons
0.000.8250.00041
5.000.8440.00041
10.000.8480.00041
15.000.8260.00041
20.000.7570.00041
raw_margin_only0.8100.00041

Accomplishment weights

The accomplishment score for each season is a weighted sum of components: conference wins, marquee non-conference wins, a Big Ten regular-season title, conference-tournament result, NCAA bid and round (scaled by field selectivity), and NIT bid/wins.

Accomplishment weights and rationale
Row TypeKeyValueRationale
base_weightbigten_regular_season_title4Winning the conference outright over a full round-robin is the single most repeatable proof of a great season; set as the largest fixed (non-scaled) stake below only the deepest NCAA runs.
base_weightbigten_regular_season_title_pre1975_multiplier1.5Before at-large bids (1975), the Big Ten champion was Purdue's only route to the NCAA tournament (one bid per conference) -- the regular-season title WAS the tournament bid, so it is worth more in that era, applied on top of the base weight.
base_weightbigten_conference_tourney_title2.5The Big Ten Tournament began in 1998 and, unlike the regular season, is a single elimination weekend that does not fully replace the round-robin's proof of sustained quality -- valued below the regular-season title.
base_weightbigten_conference_tourney_roundsee accomplishment_conf_tourney_round_weightsEach conference tournament win short of the title is worth a fraction of the title itself (1998-on only; the event did not exist before).
base_weightncaa_bid0.5Base value of simply reaching the NCAA field before selectivity scaling, set below a first-round win (1) since making the field is not yet a result on the floor; scaled by the same selectivity factor as every round value (normalized to 1.0 for a 64-team field, the 1985-2009 standard).
base_weightncaa_round_R641First tournament win (or, in eras with fewer rounds, an equivalent early win), scaled by that year's selectivity factor. See docs/ACCOMPLISHMENT_WEIGHTS.md for how a round is matched to R64/R32/etc. across eras with different bracket depths.
base_weightncaa_round_R322Second tournament win.
base_weightncaa_round_S163.5Sweet Sixteen win; value accelerates faster than round-by-round wins below it because the remaining field is now uniformly tournament-caliber.
base_weightncaa_round_E85.5Elite Eight win (reaching the Final Four).
base_weightncaa_round_F48.5Final Four win (reaching the national championship game).
base_weightncaa_round_title13National championship win. Escalating (roughly Fibonacci-like) round values reflect that each surviving round eliminates a much stronger field than the one before it, not just one more game.
base_weightncaa_third_place_game1Pre-1982 NCAA consolation ('3rd place') game win; a genuine result but not an advancement, so it is valued at the same flat rate as a single non-marquee non-conference win rather than scaled with the round ladder.
base_weightnit_bid0.6NIT credit only 1939-1975 (see cutoff rule below); worth noticeably less than an NCAA bid in the same years because the NCAA was already the more selective, higher-prestige event even before it required winning the conference.
base_weightnit_round_win1Each NIT tournament win in 1939-1975, flat (the NIT bracket structure and its media guide records are too thin pre-1976 to justify a round ladder as fine-grained as the NCAA's).
base_weightnit_cutoff_last_credited_season19751975 is the last season the NIT is credited. Rationale: 1975 is also the last season before the NCAA introduced at-large bids beyond one-per-conference (1975-76 doubled at-large slots, and by 1980 the NCAA field passed 48 teams); once the NCAA absorbed the great majority of at-large-caliber teams, the NIT stopped being a peer national event for a team of Purdue's caliber and became a legitimate consolation/'also ran' bracket. This is a judgment call -- Brian may prefer a different cutoff year (1980, when the NCAA field hit 48, is a defensible alternative).
base_weightbigten_conference_win2Per PLAN.md 2b: a Big Ten regular-season win counts double an ordinary non-conference win in the accomplishment (stakes) sense -- every conference game carries standings and NCAA-seeding weight that a random buy game does not.
base_weightmarquee_tournament_win1.5A neutral-site regular-season win in a marquee multi-team event (Maui Invitational, Battle 4 Atlantis, Phil Knight Legacy/Legacy, Great Alaska Shootout, Wooden Legacy/Classic, Charleston Classic, Puerto Rico Tip-Off, Paradise Jam, Rainbow Classic, NIT Season Tip-Off/Preseason NIT, Jimmy V Classic, the ACC/Big Ten Challenge, Gavitt Games, Crossroads Classic) is worth 1.5x an ordinary non-conference win -- the guide's own footnote legend names these events, and beating a national-name-brand field on a neutral floor is a more meaningful stake than a home buy game, even though it does not move the strength rating differently.
base_weightordinary_nonconference_win1Baseline unit for all accomplishment weights: an ordinary non-conference win (home or away, not part of a named marquee event).
selectivityncaa_selectivity_formulavalue = base * (d1_teams_approx / field_size) / (350/64)Selectivity factor = share of D-I teams NOT admitted, inverted, then normalized so a 64-team field drawn from a ~350-team D-I (the 1985-2009 standard, and the most common one in Purdue's post-1975 history) scores exactly 1.0. A smaller field relative to D-I (e.g. 8 of 100 in 1939, or 25-of-~200 in the 1960s) scores higher; a larger field (68-of-364 today) scores slightly below 1.0.
selectivityncaa_selectivity_applies_toncaa_bid and every ncaa_round_* valueThe whole round ladder is multiplied by the same season's selectivity factor, not just the bid -- a Final Four win in a 25-team field was a rarer feat than a Final Four win in a 68-team field, proportionally so.
era_routeconference_champion_only_route_multiplier1.5Applied ON TOP of bigten_regular_season_title_pre1975_multiplier for seasons before 1975 when winning the Big Ten was Purdue's ONLY possible route into the NCAA tournament (single bid per conference, no at-large bids at all). Combined pre-1975 conference-title multiplier is 1.5 (title alone) x 1.5 (only route) = 2.25x the post-1975 base title weight. This stacks because both effects are real and separate: winning was harder to matter (fewer paths existed) AND mattered more (it was the only path).
conf_tourney_roundbigten_tourney_round_11Big Ten Tournament first-round win (1998-on only).
conf_tourney_roundbigten_tourney_round_21.5Big Ten Tournament second-round / quarterfinal win.
conf_tourney_roundbigten_tourney_semifinal2Big Ten Tournament semifinal win.
conf_tourney_roundbigten_tourney_title2.5Big Ten Tournament championship win (matches bigten_conference_tourney_title above).

Player lenses

Player greatness is measured with three lenses that are never blended into one number: (1) adjusted share of team production per season, weighting points, rebounds, shooting efficiency, assists, steals, blocks, and turnovers, with the available components varying by era since not every stat was tracked in every decade; (2) career totals under the same adjustment; (3) with/without team-margin impact and year-over-year team-rating impact around a player's arrival and departure, for players who reached the top of the production-share rankings.

Coaching measures

Every coach is measured with the same construction, including Matt Painter (see the footer note). The one genuinely hard spot is the Tier A/B (1985+) / Tier C (pre-1985) boundary, which cuts through Gene Keady's tenure (4 Tier C seasons, 1981-84, then 21 Tier A/B seasons, 1985-2005) but not Painter's (all 20 seasons are Tier A/B). coach_comparison.csv reports mean_strength_ab and mean_strength_c separately for this reason, and the Keady-vs-Painter head-to-head restricts Keady to 1985-2005 (Tier A/B only) so the direct comparison never touches Tier C. "Results above roster" is a crude coaching-effect estimate: the season-over-season rating change not explained by returning production share.

Known limits