Repository navigation
Plain-language list fusion; two fresh holdouts (cobra, axios); baseline path-match fix - #136
Merged
Merged
Conversation
…d before any run Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…ld locked before any run Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…aseline path-match fix - localization for a short question: RRF of the packet order and the whole- question ranking. R@3: ripgrep 0.208 -> 0.500, click 0.750 -> 0.917, cobra 0.792 -> 0.875, this repo and the fresh axios holdout unchanged. List order only; packets unchanged. - Two plain-language holdouts with gold locked before any run: cobra (Go) and axios (JavaScript), wired into benchmark-fast.sh (packet 0.833/0.357 and 0.667/0.528). - Python baselines matched gold with a plain endswith (`zsh_completions.go` "was" `completions.go`): now on a path-segment boundary. Published numbers re-run unchanged; only the new cobra set was affected (BM25 R@3 0.875). - jina-reranker-v2 rejected on the fresh cobra holdout (R@3 0.792 -> 0.708). Fourteen sets unchanged. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Merged
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
localization= RRF(packet order, whole-question ranking). R@3 ripgrep 0.208→0.500, click 0.750→0.917, cobra 0.792→0.875; fresh axios holdout unchanged (0.833 vs BM25 0.583).endswith; now segment-boundary. Published tables re-run: unchanged.Fourteen benchmark sets unchanged. Details: contributions-log §8.6.
🤖 Generated with Claude Code