Repository navigation
V65: an unlabelled file becomes a submission - #165
Merged
Merged
Conversation
Under a scored batch, a block writes the file a competition platform expects: an identifier and a prediction under the names the user gives, every row kept in its order, missing and repeated identifiers counted. The lab guesses neither the identifier nor the names. The same family can be fitted again on every labelled row. Measured first, on the six demos against rows kept away from both models: +5.0 accuracy points on reviews, +0.8 on titanic, 2 to 3 % of RMSE on mpg and energy, nothing on fraud and iris. The gain follows the learning curve, not the size of the file, so the refit is offered, never the default, and announced as a model nobody measured. Docs (score a batch, limits, reference, refusals) in both languages, README, PLAN row V65, version 1.65.0. Co-Authored-By: Claude Fable 5.2 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01AyBsUet8WybTG986ubroar
dapiced
marked this pull request as ready for review
November 13, 2026 17:43
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What
The second part of F8, the competition path. Under a scored batch, a new Submission file block writes what a platform expects: an identifier and a prediction, under the names the user gives.
train/submission.ts(pure): three forms of prediction (class by name, probability of the second class in binary, one probability per class in multiclass, value in regression). Every row of the scored file is kept in its order; a missing or repeated identifier is written and counted, never dropped.train/refit.ts(pure): the inspected family fitted again on every labelled row, same columns, seed, caps and class weighting. Used for the submission only; it enters neither the leaderboard, nor the export, nor the saved run.build-submissionon the last scored file, which stays in the worker. The worker keeps the configuration its artifacts were trained with, so a refit cannot repeat another run.SubmissionPanelinsideBatchScorePanel, strings in French and English.Measured before building
Does fitting again on every row pay? Six demos, ten splits each, a quarter of the rows kept away from both models, every family:
The plan expected a gain « clearer on small files ». That was wrong: iris is the smallest demo and gains nothing. The gain follows the learning curve, not the size. So the refit is offered, never the default, and the result line names the model that predicted: the measured one, or its sibling nobody measured.
Design rules
Not in this wave
Sending anything to a platform, measuring the refitted model, a submission from a re-imported model, applying the decision threshold to the written label, blending several models into one submission. The glass box stays proposed.
Docs
Score a batch (new section), limits, ML reference and refusals in both languages, README, PLAN row V65, changelog, version 1.65.0.
Checks
xlsxtypes unreachable in my sandbox), format: clean.spreadsheet.test.ts(thexlsxtarball cannot be fetched in my sandbox; CI is the reference). 27 new tests.lab.spec.ts:31, the Excel upload, same cause). Newe2e/submission.spec.tsscores a file whose identifiers are out of order and checks the order survives, then builds the refitted probabilities.Generated by Claude Code