Skip to content

fix(reporter): surface reporter errors and fail the run#41307

Open
dgozman wants to merge 1 commit into
microsoft:mainfrom
dgozman:fix-40983
Open

fix(reporter): surface reporter errors and fail the run#41307
dgozman wants to merge 1 commit into
microsoft:mainfrom
dgozman:fix-40983

Conversation

@dgozman

@dgozman dgozman commented Jun 15, 2026

Copy link
Copy Markdown
Collaborator

Summary

  • Catch errors thrown by reporters in the Multiplexer and re-dispatch them through onError() so they are reported by the other reporters (instead of being swallowed to the console).
  • Track reporter errors via hasReporterErrors() and fail the test run when one occurs (checked in TestRun.result() and after onEnd/onExit in finishTaskRun).
  • Make merge-reports fail (exit 1) when a reporter errors; merged test failures still exit 0 as before.

References #40983

Errors thrown by reporters were swallowed and only printed to the console.
They are now re-dispatched through onError() so the other reporters report
them, tracked via hasReporterErrors(), and fail the test run as well as the
merge-reports command.

References microsoft#40983

@Skn0tt Skn0tt left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

re-reporting it is smart!

@github-actions

Copy link
Copy Markdown
Contributor

Test results for "MCP"

1 failed
❌ [webkit] › mcp/annotate.spec.ts:368 › should cancel browser_annotate when the MCP request is aborted @mcp-ubuntu-latest-webkit

7340 passed, 1122 skipped


Merge workflow run.

@github-actions

Copy link
Copy Markdown
Contributor

Test results for "tests 1"

6 flaky ⚠️ [chromium-library] › library/video.spec.ts:717 › screencast › should work with video+trace `@chromium-ubuntu-22.04-arm-node20`
⚠️ [chromium-library] › library/popup.spec.ts:260 › should not throw when click closes popup `@chromium-ubuntu-22.04-node20`
⚠️ [chromium-library] › library/video.spec.ts:680 › screencast › should capture full viewport on hidpi `@chromium-ubuntu-22.04-node20`
⚠️ [chromium-library] › library/video.spec.ts:680 › screencast › should capture full viewport on hidpi `@chromium-ubuntu-22.04-node22`
⚠️ [firefox-page] › page/page-emulate-media.spec.ts:144 › should keep reduced motion and color emulation after reload `@firefox-ubuntu-22.04-node20`
⚠️ [webkit-library] › library/browsercontext-clearcookies.spec.ts:146 › should remove cookies by name and domain `@webkit-ubuntu-22.04-node20`

39579 passed, 743 skipped


Merge workflow run.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants