Repository navigation
Random share-safe titles never contain one another (flaky property test) - #519
Merged
Merged
Conversation
The share-safe property hid a bookend title and asserted that no published
title or headline contains it. Two random titles can be a prefix of each
other ("ZqtoLocaa" and "ZqtoLoca", fast-check seed -1167034155), so a
visible first title carried the hidden last title by substring and the
property failed once in a while in CI. The generator now rejects a title
set in which one title contains another; the check itself is unchanged.
Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_011TLtULGdZXTe6L61jNKqRF
|
Claude finished @mchestr's task in 13s —— View job Review of PR #519Verdict: looks good. It's a test-only change, and it fixes the flake as described. Correctness
Notes (non-blocking)
CLAUDE.md conventions look fine: there is no |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Why
lib/wrapped/data/__tests__/share-safe.property.test.tsfailed on #514's CI run with fast-check seed-1167034155: the shrunk counterexample had a first titleZqtoLocaaand a last titleZqtoLoca. With only the last title hidden, the property's substring check (published.some((text) => text.includes(hidden))) matched the visible first title, so the test reported a leak that is not one. The generator draws each title fact independently from/^Zq[A-Za-z0-9 :'-]{4,60}$/, so one title being a prefix of another is a matter of luck, and the suite goes red once in a while on any PR.What changes
The title dictionary rejects a set in which one title contains another (
fc.filter); the property itself is unchanged. Reproduced the failure locally with the seed, confirmed the fix passes with that seed, and soaked it for 2,000 runs.No product code changes.
Generated by Claude Code