Skip to content

test(assert): drop jq from flaky custom-assertion test#794

Merged
Chemaclass merged 1 commit into
mainfrom
fix/flaky-custom-assertion-macos
Jul 14, 2026
Merged

test(assert): drop jq from flaky custom-assertion test#794
Chemaclass merged 1 commit into
mainfrom
fix/flaky-custom-assertion-macos

Conversation

@Chemaclass

Copy link
Copy Markdown
Member

🤔 Background

The macOS CI job has been intermittently red on main (e.g. a docs-only commit failed while the preceding code commit passed) on a single test: "Custom assertion with fail shows correct test name". It is the only one of its three sibling tests that shells out to jq, and the only one that flakes; the two pure-bash siblings never do. Not reproducible locally (0 failures across 65+ isolated and full-suite runs).

💡 Changes

  • Make the test's _assert_valid_json scaffolding jq-free — route the failure through bashunit::fail with a pure-bash JSON check, removing the external-binary dependency that distinguished the flaky test from its stable siblings
  • No production code change; the other two custom-assertion tests are untouched

The 'custom assertion with fail shows correct test name' test was the
only one of its three siblings to shell out to jq, and the only one that
flaked on the macOS CI runner (empty/mismatched captured output) while
the two pure-bash siblings never did. Route the failure through
bashunit::fail with a pure-bash json check so the test no longer depends
on an external binary.
@Chemaclass Chemaclass added the bug Something isn't working label Jul 14, 2026
@Chemaclass Chemaclass self-assigned this Jul 14, 2026
@Chemaclass Chemaclass merged commit 6b355a7 into main Jul 14, 2026
49 of 50 checks passed
@Chemaclass Chemaclass deleted the fix/flaky-custom-assertion-macos branch July 14, 2026 11:33
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

bug Something isn't working

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant