Skip to content

Add AI context description to commands#3503

Open
ehl-jf wants to merge 2 commits into
masterfrom
JGC-473-ai-context-help
Open

Add AI context description to commands#3503
ehl-jf wants to merge 2 commits into
masterfrom
JGC-473-ai-context-help

Conversation

@ehl-jf
Copy link
Copy Markdown
Contributor

@ehl-jf ehl-jf commented May 21, 2026

Summary

Top-of-stack PR for JGC-473. Adds AI-agent-oriented help text to the JFrog CLI as a whole.

Two commits:

  1. Add the --ai-help global flag + argv pre-pass. Bridges --ai-help to JFROG_CLI_AI_HELP before getCommands() runs, since the conversion layer in jfrog-cli-core reads the env var during command setup.
  2. Populate GetAIDescription() in 85 local docs/<ns>/<cmd>/help.go files (28 hidden/dead-code stubs skipped) and rewrite ~85 cli.Command literals in main.go + 7 */cli.go files to route Usage/HelpName through corecommon.ResolveDescription (umbrella uses urfave/cli directly, not components.Command). Namespace shells got <name>AIUsage consts. main_test.go forces JFROG_CLI_AI_HELP=false in setup so help-text-asserting tests are deterministic under an AI-agent shell.

Dependency status

  • jfrog-cli-core (Remove redundant git test that moved to client #1563): MERGED. Core is now a normal require to its master pseudo-version v2.60.1-0.20260601130310-8d52a530da18 — no replace.
  • The 4 remaining replace directives in go.mod point at the in-flight JGC-473 branches of the plugin repos (on the developer's fork). Each must be dropped and re-pinned to the plugin's merged pseudo-version once that plugin's PR merges. Do not merge this PR until all four plugin PRs have merged and the replaces are removed.

Blocking PRs (plugins)

Test plan

  • go build ./... clean
  • go test ./... 0 failures on a clean (non-agent) env. (The RTECO-1368 TestVisibility_*_E2E tests are sensitive to the runner's agent env — they pass on CI and on a shell without CLAUDECODE/CURSOR_*.)
  • Manual §6 matrix: env force-on/off, CLAUDECODE auto-detect, --ai-help flag, unparseable env value (graceful), namespace listings, runtime unaffected.
  • End-to-end plugin AI text confirmed: jf rt upload, jf audit, jf evd create, jf apptrust ping, jf worker deploy.

Out of scope (follow-ups)

  • AI-mode help template polish (standalone Description: block instead of multi-line text in Name:).
  • apptrust version-rollback declares 2 Arguments but Action requires 3 — pre-existing, separate fix.

@ehl-jf ehl-jf force-pushed the JGC-473-ai-context-help branch from dfde4c1 to 2cba82a Compare May 27, 2026 08:33
@ehl-jf ehl-jf changed the title JGC-473 - Add --ai-help flag, AI text for umbrella commands, and call-site wiring Add --ai-help flag, AI text for umbrella commands, and call-site wiring Jun 1, 2026
@ehl-jf ehl-jf marked this pull request as ready for review June 1, 2026 12:33
Add a global --ai-help flag that, together with the JFROG_CLI_AI_HELP env
var, switches the conversion layer in jfrog-cli-core to render
AIDescription instead of Description.

The argv pre-pass runs before getCommands() so the conversion layer
(invoked during command setup) reads the env var early; urfave/cli's
own flag parsing happens later inside app.Run, by which time
command strings are already frozen.

The flag deliberately omits EnvVar: urfave/cli's BoolFlag EnvVar
binding parses the env value with strconv.ParseBool at startup and
crashes on unparseable values (e.g. JFROG_CLI_AI_HELP=maybe). Our
resolver in docs/common.AIHelpEnabled treats unparseable as a soft
fall-back to detection - bypassing urfave/cli's binding preserves
that gentler behavior.

No AIDescription content is populated yet; that arrives via the
follow-up backfill commit (umbrella subagent for help.go files and
call-site rewrites).
@ehl-jf ehl-jf changed the title Add --ai-help flag, AI text for umbrella commands, and call-site wiring Add AI context description for each command Jun 1, 2026
@ehl-jf ehl-jf force-pushed the JGC-473-ai-context-help branch from 2cba82a to eae5fc3 Compare June 1, 2026 12:45
The list should be comma-separated(,) in the form of user1,user2,...
`
}

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Shouldn't all the changes below be in jfrog-cli-artifactory ?
https://github.com/jfrog/jfrog-cli-artifactory/blob/main/artifactory/docs/groupaddusers/help.go
Is there a reason we have this in CLI too ?

This applies to all help.go files.

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It is because the commands are not located in RT repo.

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Maybe they should someday.

…l sites

Builds on commit 0650eec (which added the --ai-help flag and argv
pre-pass to main.go). This commit completes the umbrella's side of
JGC-473 by:

1. Adding GetAIDescription() to 85 docs/<ns>/<cmd>/help.go files for
   all visible jfrog-cli local commands. 28 help.go files for hidden /
   deprecated / dead-code stubs were intentionally skipped.

2. Rewriting cli.Command literals in main.go and 7 */cli.go files to
   route Usage / HelpName through corecommon.ResolveDescription, so the
   conversion-layer mechanism in jfrog-cli-core applies to the umbrella's
   own urfave/cli-based commands (which don't go through components.Command).
   For namespace shells with hardcoded Usage strings (rt, mc, pl, c, etc.)
   new <name>AIUsage constants were introduced.

3. Adding JFROG_CLI_AI_HELP=false default in main_test.go's
   setupIntegrationTests so help-text assertions remain deterministic
   when the test runner inherits an AI agent's env (CLAUDECODE,
   CURSOR_AGENT, etc.). CI runners without agent env are unaffected.

TEMPORARY go.mod state - REMOVE the 5 replace directives in the replace
block before merge. Each points at the in-flight JGC-473 branch of the
respective repo (jfrog-cli-core on JGC-473-devbase; 4 plugin repos on
developer's fork because direct org push is not in scope for plugin
repos). Once each repo's JGC-473 PR merges to its base branch, the
require pinning is sufficient and these replaces MUST be removed.

This PR MUST NOT merge until: (a) all 5 cross-repo JGC-473 PRs have
merged, AND (b) the yarn-coordination break between core master and
jfrog-cli-artifactory main is resolved upstream (RTECO-1035 follow-up).
@ehl-jf ehl-jf force-pushed the JGC-473-ai-context-help branch from 01b7665 to a662e89 Compare June 1, 2026 13:39
@ehl-jf ehl-jf changed the title Add AI context description for each command Add AI context description to commands Jun 1, 2026

When to use:
- Modifying RBAC after the fact (adding repos, users, or actions to a permission target).
- Drift correction in GitOps-style RBAC management.
Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I couldn't find anything about GitOps-style RBAC management in the JFrog public documentation. Do we need to validate the text?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants