PDX-000: fix(ci): make npm publish idempotent and wait for registry propagation#165
Closed
mrdailey99 wants to merge 19 commits into
Closed
PDX-000: fix(ci): make npm publish idempotent and wait for registry propagation#165mrdailey99 wants to merge 19 commits into
mrdailey99 wants to merge 19 commits into
Conversation
… and git-workflow command RCA: Users and AI agents lacked structured onboarding, troubleshooting, and tool selection guidance when connecting a Provar project via ProvarDX MCP, causing long friction loops and repeated tool selection mistakes that baked-in agent workflows would prevent. Fix: Added three MCP prompts (provar.guide.onboarding, troubleshoot, orchestration), one resource (provar://docs/tool-guide), and a tracked /git-workflow slash command covering Jira ticket creation, branch naming, worktree setup with yarn install, and the full dev/PR lifecycle. Smoke test updated to 54 entries. Gitignore tightened to track .claude/commands/.
RCA: CI workflow pinned QualityOrchestrator at v1.0.0, requiring manual edits to pick up every subsequent patch or minor release, causing the action to drift behind the latest available version. Fix: Created floating v1 tag on mrdailey99/QualityOrchestrator (currently at v1.0.2) and updated CI_Execution.yml to reference @v1, so the workflow automatically uses the latest v1.x release without any further changes needed.
RCA: Copilot flagged 14 issues — wrong tool schemas in guide prompts and docs, missing build copy step, hardcoded cloudId in a public repo file, broken gitignored file reference. Fix: Add PROVAR_TOOL_GUIDE.md to package.json build copy; fix all wrong tool params in guide docs and prompts (properties_generate output_path, --plan-name, testrun_rca project_path, testcase_step_edit test_case_path, testplan add-instance hyphen, defect run_id); remove hardcoded cloudId; remove broken agents ref. Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
…r-version PDX-0: chore(ci): update QualityOrchestrator to floating v1 tag
…ides PDX-0: feat(mcp): add user-facing guide prompts, tool-guide resource, and git-workflow command
… repo at release time RCA: NitroX component packages were statically bundled in the repo and not updated automatically; the source of truth is the ProvarTesting/factPackages GitHub repo (main branch), so packages would silently drift stale between releases. Fix: Added scripts/fetch-nitrox-packages.cjs to the prepack hook; it downloads all component package files from factPackages@main, regenerates NITROX_COMPONENT_CATALOG.md, and writes NITROX_CATALOG_SOURCE.json with the commit SHA. On failure (no token, network error) it logs a warning and falls back to the committed catalog — the release is never blocked. A new provar://nitrox/catalog-source MCP resource exposes the bundled version so consumers can verify which factPackages commit is in use.
…ings RCA: The factPackages repo stores component files under fact-*/src/components/ not fact-*/components/, so the path-matching regexes and catalog builder needed updating; additionally nine pre-existing unicorn/numeric-separators-style lint warnings in updateChecker.ts and its test file were left unaddressed. Fix: Updated PKG_JSON_RE and COMPONENT_FILE_RE in fetch-nitrox-packages.cjs to match the fact-*/src/ layout and adjusted buildCatalogFromDir to navigate the src/ subdirectory; ran eslint --fix on updateChecker.ts and updateChecker.test.ts to resolve all numeric-separator warnings, leaving the project at 0 lint errors and 0 warnings.
RCA: downloadRaw() used the branch name (main) in the raw URL rather than the resolved commit SHA, so files could be fetched from a different commit than the one the tree listing described; additionally both httpsGet and httpsGetBuffer had no timeout, meaning a stalled network connection would block prepack indefinitely. Fix: Added REQUEST_TIMEOUT_MS (15s) to both http helpers via req.setTimeout/req.destroy so hangs fail fast and fall through to the graceful fallback; updated downloadRaw to accept and use the commitSha parameter so all downloads are pinned to the same commit as the tree.
…ponent-package-retrieval PDX-463: feat(mcp): fetch NitroX component packages from factPackages repo at release time
…er startup (#158) RCA: No bin entry in package.json forced users through a two-step sf CLI plugin install before connecting Claude Desktop, creating unnecessary onboarding friction. Fix: Added provardx bin entry pointing to bin/mcp-start.js; lightweight ESM entrypoint parses mcp start flags, validates --allowed-paths as required, then delegates to the same server bootstrap used by the sf plugin path.
* PDX-464: feat(mcp): fetch NitroX schemas from internal source at build time RCA: FactComponent.schema and FactPackage.schema were bundled statically and never refreshed from the canonical internal source, risking stale schema validation in released packages. Fix: Extended fetch-nitrox-packages.cjs to download both schemas from the same commit SHA as the component catalog, write to src/mcp/rules/ and root-level copies, and record schemasUpdated in NITROX_CATALOG_SOURCE.json. Falls back to bundled schemas with a warning on any failure. * PDX-464: fix(mcp): address Copilot review — schema consumers, repo field, schemasUpdated normalisation RCA: Four review issues: docs incorrectly named runtime tools as schema consumers; repo field exposed internal URL in MCP resource; readCatalogSource did not normalise missing schemasUpdated from older build artifacts; fallback object also contained the internal URL. Fix: Corrected docs to describe IDE/SchemaStore as schema consumers; removed repo field from emitted JSON and fallback; normalised schemasUpdated to null in readCatalogSource try-path when field is absent; updated tests to cover the new normalisation and assert no repo field in fallback.
…alidate (#159) * PDX-466: feat(mcp): add AJV JSON schema validation alongside hardcoded NX rules RCA: provar_nitrox_validate only ran hardcoded NX001–NX010 semantic rules; structural errors (wrong types, extra properties, enum violations) encoded in FactComponent.schema.json were never caught at validation time. Fix: Added Ajv2020 as a runtime dependency; schema is lazily loaded from lib/mcp/rules/FactComponent.schema.json on first call and validated in parallel with existing rules. Violations are returned as NX_SCHEMA_<KEYWORD> issues (ERROR for type/required, WARNING for additionalProperties/pattern/enum). Falls back to hardcoded-rules-only when schema is unavailable. * PDX-466: fix(test): replace no-explicit-any with typed ValidateFunction import in NX_SCHEMA tests RCA: ESLint no-explicit-any rule rejected the any parameter type used for the schemaOverride parameter in AJV schema override tests; the eslint-disable comment was positioned on the wrong line. Fix: Added import type { ValidateFunction } from ajv/dist/2020.js and replaced all any usages with properly typed ValidateFunction and a narrow IssueShape type alias for the return value. * PDX-466: fix(mcp): address Copilot review comments on nitrox-ajv-schema-validation RCA: Copilot flagged incorrect 'in parallel' wording (validation is synchronous/sequential), an overly broad ERROR severity mapping in ajvErrorToIssue (MIN_ITEMS/MINIMUM/MAXIMUM should be WARNING), and broken markdown rendering of NX_SCHEMA_* in docs (underscores parsed as italic markers). Fix: Reworded tool description and docs to 'sequential' passes; narrowed ERROR set to REQUIRED and TYPE only; fixed NX_SCHEMA_* heading and inline text with backtick quoting; updated docs table to show MIN_ITEMS as WARNING.
…nstall tag (#160) * PDX-467: chore(docs): bump version to 1.5.0 stable and remove @beta install tag RCA: The 1.5.0 release is ready for stable promotion; all docs and install commands still referenced the @beta dist-tag and pre-release version string. Fix: Updated package.json and server.json to 1.5.0, removed @beta from all install commands in README.md, docs/mcp.md, and docs/mcp-pilot-guide.md, and updated the stale-cache unit test to use the latest channel. * PDX-467: test(mcp): make stale-cache test release-agnostic by deriving channel at runtime RCA: Hardcoded version and channel values in the stale-cache test will fail once the branch version cycles back to a prerelease (beta/rc) after the 1.5.0 stable release. Fix: Derive currentVersion and channel from the running version at test time, mirroring the pattern used in the fresh-cache test, so the test remains valid across any semver channel.
RCA: Four issues identified in post-merge Copilot review: AJV error mapping for additionalProperties/required used instancePath (parent object) instead of err.params, NITROX_CATALOG_SOURCE.json had an exposed repo field and missing schemasUpdated key, the provardx-cli bin alias was absent making npx resolution ambiguous, and prompt counts in README/docs were stale at 7 (now 11). Fix: ajvErrorToIssue now special-cases additionalProperties and required keywords to pull field/applies_to from err.params; committed JSON normalised to stable shape; package.json adds provardx-cli bin alias; README.md and docs/mcp.md updated to 11 MCP prompts.
…ies and required errors RCA: Copilot review noted that the new ajvErrorToIssue params-based mapping for additionalProperties and required keywords had no test coverage for the field and applies_to values, leaving the mapping free to silently regress. Fix: Expanded NX_SCHEMA_ADDITIONAL_PROPERTIES test to assert field and applies_to equal the extra property name; added NX_SCHEMA_REQUIRED case asserting field and applies_to equal the missing property name; added applies_to/field assertions to the NX_SCHEMA_TYPE test.
…ropagation before MCP publish RCA: MCP registry publish failed with 404 because npm package was not yet indexed when mcp-publisher ran immediately after npm publish. Fix: Skip npm publish if version already exists on npm, and poll npm registry for up to 3 minutes before running mcp-publisher publish. Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
Contributor
There was a problem hiding this comment.
Pull request overview
This PR updates the release and MCP server packaging flow, adding idempotent npm publishing and registry-propagation waiting, while also expanding the MCP server’s bundled NitroX validation/catalog metadata, prompts, resources, and “zero-install” startup entrypoint as part of the 1.5.0 release.
Changes:
- Make the DeployManual workflow more re-run friendly by skipping
npm publishwhen the version already exists and polling npm for up to 3 minutes before MCP registry publish. - Add NitroX catalog source metadata + AJV-backed JSON schema validation (
NX_SCHEMA_*) and expose catalog/source/tool-guide resources via MCP. - Ship new MCP guide prompts, a zero-install
bin/mcp-start.jsentrypoint, and update docs/tests for the stable1.5.0release.
Reviewed changes
Copilot reviewed 20 out of 23 changed files in this pull request and generated 3 comments.
Show a summary per file
| File | Description |
|---|---|
| test/unit/mcp/updateChecker.test.ts | Adjusts update-checker tests for current-version-derived cache fixtures and ms constants. |
| test/unit/mcp/server.test.ts | Adds coverage for readCatalogSource() behavior and fallback normalization. |
| test/unit/mcp/nitroXTools.test.ts | Adds tests validating AJV schema error mapping into NX_SCHEMA_* issues. |
| test/unit/bin/mcpStart.test.ts | Adds CLI arg-validation tests for the new bin/mcp-start.js entrypoint. |
| src/mcp/update/updateChecker.ts | Minor constant formatting changes (ms and buffer sizing). |
| src/mcp/tools/nitroXTools.ts | Adds AJV2020 schema validation pass + schema loading/caching and new NX_SCHEMA_* issues. |
| src/mcp/server.ts | Adds new MCP resources (provar://nitrox/catalog-source, provar://docs/tool-guide) and readCatalogSource(). |
| src/mcp/prompts/index.ts | Registers the new “guide” prompt set. |
| src/mcp/prompts/guidePrompts.ts | Introduces onboarding/troubleshooting/orchestration prompts. |
| server.json | Bumps MCP registry manifest versions to 1.5.0. |
| scripts/mcp-smoke.cjs | Extends smoke coverage for new prompts and updates expected RPC counts. |
| scripts/fetch-nitrox-packages.cjs | Adds prepack-time fetch/update of NitroX catalog + schemas (with fallback). |
| README.md | Updates install/setup instructions for stable release and npx-based “zero-install” option. |
| package.json | Bumps version to 1.5.0, adds ajv, adds npm bin entrypoints, and runs fetch script in prepack. |
| docs/PROVAR_TOOL_GUIDE.md | Adds a new tool-selection guide bundled as an MCP resource. |
| docs/NITROX_CATALOG_SOURCE.json | Adds default catalog source metadata file (null placeholders). |
| docs/mcp.md | Updates docs for stable install, adds NitroX schema sourcing and new resource/prompt docs. |
| docs/mcp-pilot-guide.md | Updates install instructions to remove @beta. |
| bin/mcp-start.js | Adds new lightweight provardx ... mcp start entrypoint for npx usage. |
| .gitignore | Adjusts Claude-related ignore patterns and documents intent to track .claude/commands/. |
| .github/workflows/DeployManual.yml | Implements idempotent npm publish + registry polling before MCP registry publish. |
| .github/workflows/CI_Execution.yml | Changes QualityOrchestrator action version selector. |
| .claude/commands/git-workflow.md | Adds documented git workflow command for Claude Code. |
💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.
Comment on lines
+38
to
+40
| STATUS=$(curl -s -o /dev/null -w "%{http_code}" "https://registry.npmjs.org/%40provartesting%2Fprovardx-cli/${VERSION}") | ||
| if [ "$STATUS" = "200" ]; then | ||
| echo "Version ${VERSION} already published on npm, skipping." |
| with: | ||
| persist-credentials: false | ||
| - uses: mrdailey99/QualityOrchestrator@v1.0.0 | ||
| - uses: mrdailey99/QualityOrchestrator@v1 |
Comment on lines
2
to
15
| @@ -11,6 +11,7 @@ | |||
| "dependencies": { | |||
| "@modelcontextprotocol/sdk": "^1.8.0", | |||
| "@oclif/core": "^3.27.0", | |||
| "ajv": "^8.17.1", | |||
| "@provartesting/provardx-plugins-automation": "1.2.2", | |||
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
mcp-publisher publishto avoid the 404 race conditionRoot cause
mcp-publisher publishvalidates the npm package exists before publishing to the MCP registry. The step ran immediately afternpm publish, but npm's CDN hadn't indexed the new version yet, causing a 404.Test plan
🤖 Generated with Claude Code