Repository navigation
Conversation
Contributor
Speed against
|
aywrite
force-pushed
the
search/attention-refit
branch
from
September 17, 2026 10:10
97061c1 to
dc23564
Compare
The thirteen ATTENTION_ integers were fitted on 2026-09-06 over 193,143 rows from the bench's eighteen roots, train and holdout split by position. Rows from one root share a parent node and most of a feature vector, so that holdout had seen the training half's neighbours, and its 0.927 was read on the rows the gate cannot reach as much as on the rows it can. On fresh rows the same vector reads 0.7468 at depth four and up. This vector was fitted by `scripts/fit_attention.py --group-by` over a depth 8 ledger recorded one root at a time on 1,428 positions sampled from 1,340 of our own games, 13,697,021 scouts with a 20% row sample fitted, the halves split by source game. On its held out half it reads 0.7674 +/- 0.0093 at depth four and up, +0.0206 +/- 0.0029 over the old vector paired on the same rows. A split by position on the same ledger reads 0.7723 +/- 0.0038: on a corpus this wide the position split does not inflate the figure, it understates the error. The two thresholds move with the vector. Each is the integer that deads the same share of the ledger's depth four and up rows, scouts and skipped together, as the old threshold did, matched on the training half and read on the other: -4401 deads 86.74% against -4637's 86.52%, at 0.324% attention against 0.344%; -6324 skips 37.73% against -7954's 37.64%, at 0.076% against 0.091%. The same share of rows is not the same tree, so the nodes move. The schedule does not: LATE_MOVE_THRESHOLD, DEEP_REDUCTION and the replay are as they were. An auc is an offline reading, so this was played before it landed: as 97061c1 on master 4b1b80f, sprt [0, 10] at 10+0.1 on 8moves_v3, eight batches of 500 games carried as pair counts. +8 +/-8 over 4,000 games, likelihood ratio 1.67 of 2.94, unresolved at the registered cap, which is not a pass. This is that commit rebased onto master after the match, the constants having moved to late_move.rs in the meantime; the integers are the same and the tree under them is master's. The tests pinning the score arithmetic carry the new integers, the threshold tests solve alpha and beta at eight a point and one a point rather than seven and four, and the swap fixture's node budget moves to 2,350,000 to sit inside depth ten's swap on this tree. The two suites move with the gates. The tactical suite finds 236 of 300 at depth six against 237: WAC.120 is the position spent, where this vector plays h1g1 and does not find g5g6 through depth nine, and it is written into ACCEPTED_LOSSES with that reason, running out at 0.6.0. The strategic suite scores 99,670 of 149,703 against 100,176, half a percent down, spread over the themes rather than sitting in one. Bench: 4105923 Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
aywrite
force-pushed
the
search/attention-refit
branch
from
September 17, 2026 10:24
dc23564 to
ae03c53
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Played twice and unresolved both times: +8 ±8 over 4,000 games, then +1 ±16 over 1,000 on the rebased head. Opened so the measurement can be read where the code is; whether it merges is a separate decision.
The thirteen
ATTENTION_*integers were fitted on the bench's eighteen roots with train and holdout split by position. This vector was fitted on a depth 8 ledger over 1,428 positions from 1,340 of our own games, the halves split by source game, withscripts/fit_attention.py --group-by(#261). On rows the gates can reach it reads a held out auc of 0.7674 ± 0.0093 against 0.7468 for the old vector on the same rows, +0.0206 ± 0.0029 paired.The two thresholds move with the vector. Each was frozen on the training half to dead the same share of depth 4+ rows as the old one, then read on the other half: −4401 deads 86.74% against −4637's 86.52%, −6324 skips 37.73% against −7954's 37.64%. The schedule (
LATE_MOVE_THRESHOLD,DEEP_REDUCTION, the replay) is unchanged. Bench 4,105,923 against master's 4,102,609.The match
Registered before the first batch: this commit against master
4b1b80f, sprt [0, 10] at 10+0.1 on 8moves_v3, 500 game batches carried as pair counts, cap 4,000.Pooled pairs by the candidate's score: 154, 446, 723, 510, 167. Neither bound reached at the cap, so the registration says not shipped. An auc gap of 0.02 is worth about eight elo give or take eight, and a [0, 10] test of this size cannot tell that from nothing. A longer run is a new registration.
Notes
97061c1on4b1b80f. This head is that commit rebased ontoa18334don request, after the match: the constants moved tolate_move.rsin the meantime, the integers are the same, and the bench and the swap fixture's budget moved with the tree.ACCEPTED_LOSSESwith that reason and running out at 0.6.0. The strategic suite scores 99,670 of 149,703 against 100,176, half a percent down.a18334d(run 35210387073): +1 ±16, LLR −0.55, inconclusive, pairs 35, 119, 198, 103, 45. Consistent with the 4,000 games above and with an effect of a few elo either side of nothing. Nothing here supports merging.🤖 Generated with Claude Code