fix(review): gate the zero-error label floor at the Bonferroni split delta - #9922
Conversation
…delta calibrateActThreshold compared the label count against a floor computed at the raw delta, but the scan itself tests each candidate at delta/K after JSONbored#9066's Bonferroni split. A zero-error calibration set that clears the raw floor but falls short of the split-delta floor fell through the whole scan and was misreported as no_certifiable_threshold (an error-rate shortfall) instead of insufficient_labels (a label-count shortfall), losing JSONbored#9048's status split. Also stop reporting a recalibration infra failure as insufficient_labels in runRiskControlRecalibration's catch.
|
Superagent didn't find any vulnerabilities or security issues in this PR. |
|
Tip ✅ LoopOver review result - approve/merge recommendedReview updated: 2026-07-29 23:24:38 UTC
Review summary Nits — 4 non-blocking
Decision drivers
Context & advisory signals — never blocks the verdict
Linked issue satisfactionAddressed Review context
Contributor next steps
Signal definitions
🧪 Chat with LoopOverAsk LoopOver a question about this PR directly in a comment — grounded only in the same cached, public-safe facts shown above, never a new claim.
Full command reference: https://loopover.ai/docs/loopover-commands 🧪 Experimental — new and may change. 🟩 Safe / merged · 🟦 Advisory · 🟨 Held for review · 🟥 Blocked / closed 💰 Earn for open-source contributions like this. Gittensor lets GitHub contributors earn for the work they already do — register to start earning →. Checked by LoopOver, a quiet PR intelligence layer for OSS maintainers.
|
Codecov Report✅ All modified and coverable lines are covered by tests. Additional details and impacted files@@ Coverage Diff @@
## main #9922 +/- ##
==========================================
+ Coverage 79.52% 79.56% +0.03%
==========================================
Files 281 283 +2
Lines 58577 58699 +122
Branches 6833 6871 +38
==========================================
+ Hits 46581 46701 +120
Misses 11706 11706
- Partials 290 292 +2
Flags with carried forward coverage won't be shown. Click here to find out more.
|
fix(review): gate the zero-error label floor at the Bonferroni split delta
calibrateActThreshold compared the label count against a floor computed at
the raw delta, but the scan itself tests each candidate at delta/K after
#9066's Bonferroni split. A zero-error calibration set that clears the raw
floor but falls short of the split-delta floor fell through the whole scan
and was misreported as no_certifiable_threshold (an error-rate shortfall)
instead of insufficient_labels (a label-count shortfall), losing #9048's
status split. Also stop reporting a recalibration infra failure as
insufficient_labels in runRiskControlRecalibration's catch.
Closes #9637