[NV] Add Qwen3.5 FP4 GB300 TRT-LLM Disaggregated AgentX / 新增 Qwen3.5 FP4 GB300 TRT-LLM 分离式 AgentX - #2584
[NV] Add Qwen3.5 FP4 GB300 TRT-LLM Disaggregated AgentX / 新增 Qwen3.5 FP4 GB300 TRT-LLM 分离式 AgentX#2584richardhuo-nv wants to merge 3 commits into
Conversation
|
Thanks for the contribution! Please reach out to respective companies' CODEOWNER to fill in the latest PR_REVIEW_CHECKLIST.md before pinging core maintainer on Slack for review. In order for the signoff PR check bot to trigger, you must follow the PR_REVIEW_CHECKLIST.md template correctly, including the phrase For PR verification, add the PR authors are responsible for ensuring that after merging, all GitHub Action jobs fully pass. A lot of the time, failures are just flakes and simply re-running the failed jobs will fix it. See GitHub's docs on re-running failed jobs 感谢你的贡献!请联系相应公司的 CODEOWNER 填写最新的 PR_REVIEW_CHECKLIST.md,然后再在 Slack 上联系核心维护者进行审阅。为了触发 signoff PR 检查机器人,你必须正确遵循 PR_REVIEW_CHECKLIST.md 模板,包括保留英文语句 如需进行 PR 验证,请为此 PR 添加 PR 作者有责任确保合并后所有 GitHub Action 任务完全通过。 很多时候失败只是偶发抖动(flake),重新运行失败的任务即可解决。参见 GitHub 关于重新运行失败任务的文档 |
|
see unofficial run visualizer at https://inferencex.semianalysis.com/inference?unofficialRun=31648775819 |
|
see unofficial run visualizer at https://inferencex.semianalysis.com/inference?unofficialRun=31648851366 |
Add Qwen3.5 FP4 GB300 TRT-LLM Disaggregated AgentX / 新增 Qwen3.5 FP4 GB300 TRT-LLM 分离式 AgentX
Summary / 摘要
Registers nine disaggregated Dynamo-TRT agentic benchmark recipes for Qwen3.5-397B-A17B-NVFP4-V2 on GB300, covering a range of topologies from single-node small-scale to large multi-node high-throughput.
新增九个 Qwen3.5-397B-A17B-NVFP4-V2 GB300 分离式 Dynamo-TRT AgentX Benchmark 配置,覆盖从单节点小规模到大型多节点高吞吐量的一系列拓扑结构。
Changes / 变更内容
configs/nvidia-master.yamlqwen3.5-fp4-gb300-dynamo-trt-agentic-disaggwithscenario-type: agentic-coding, imagenvcr.io/nvidia/tensorrt-llm/release:1.3.0rc24, modelnvidia/Qwen3.5-397B-A17B-NVFP4-V2, Dynamo router1.4.0.dev20260807, and NIXL KV transfer.benchmarks/multi_node/srt-slurm-recipes/trtllm/qwen3.5/gb300-fp4/disagg/agentx/srt-slurm/recipes/trtllm/qwen3.5-fp4/agentx/submission/.runners/launch_gb300-nv.shIS_AGENTIC=1 && dynamo-trt && qwen3.5: clonesNVIDIA/srt-slurmatv1.0.48and overlays the agentx recipe directory.perf-changelog.yamlqwen3.5-fp4-gb300-dynamo-trt-agentic-disagg.Validation / 验证
Matrix generator produces all 9 expected
agentic-codingrows: