Skip to content

[codex] Update MiniMax M3 B200 FlashInfer image#1833

Merged
Oseltamivir merged 9 commits into
mainfrom
chore/b200-m3-flashinfer
Jun 23, 2026
Merged

[codex] Update MiniMax M3 B200 FlashInfer image#1833
Oseltamivir merged 9 commits into
mainfrom
chore/b200-m3-flashinfer

Conversation

@cquil11

@cquil11 cquil11 commented Jun 18, 2026

Copy link
Copy Markdown
Collaborator

Summary

  • update minimaxm3-fp8-b200-vllm to vllm/vllm-openai:minimax-m3-0618
  • enable FlashInfer TRT-LLM attention with FP8 indexer KV and KV cache
  • use the image's default FlashInfer TRT-LLM MoE backend instead of explicitly forcing Marlin

Validation

  • benchmark script passes bash -n
  • MiniMax M3 B200-DGXC vLLM sweep generation succeeds

Note

Medium Risk
Changes inference stack (attention/MoE/KV dtypes) and mutates installed vLLM source at job start; benchmark behavior and numerics may shift versus the prior Marlin image.

Overview
Aligns MiniMax M3 B200 single-node benchmarking with the newer minimax-m3-0618-x86_64-cu130 vLLM image (replacing vllm/vllm-openai:minimax-m3 in nvidia-master.yaml).

The B200 launch script now matches the B300 recipe: a startup Python patch on sparse_attention_msa.py adds .contiguous() on sliced prefill top-k indices so MSA CSR construction works under TP with CUDA graphs; TP-only runs drop --moe-backend marlin in favor of the image default FlashInfer TRT-LLM MoE; vllm serve gains FlashInfer TRT-LLM attention, FP8 indexer KV, and FP8 KV cache. perf-changelog.yaml documents the config change.

Reviewed by Cursor Bugbot for commit e57575d. Bugbot is set up for automated code reviews on this repo. Configure here.

@github-actions

Copy link
Copy Markdown
Contributor

Thanks for the contribution! For vLLM & SGLang, please ensure that your recipes is similar to the official vLLM recipes and/or the SGLang cookbook

If it is not, please create a PR first before we can merge your single node PR into the master branch. Let's ensure that the documentation is first class such that the entire ML community can benefit from your hard work! Thank you

PR authors are responsible for ensuring that after merging, all GitHub Action jobs fully pass. A lot of the time, failures are just flakes and simply re-running the failed jobs will fix it. If re-running failed jobs is attempted, PR authors are responsible for ensuring it passes. See GitHub's docs on re-running failed jobs: https://docs.github.com/en/actions/how-tos/manage-workflow-runs/re-run-workflows-and-jobs#re-running-failed-jobs-in-a-workflow

As a rule of thumb, generally, PR authors should request a review & get a PR approval from the respective companies' CODEOWNERS before requesting a review from core maintainers.

If additional help is needed, PR authors can reach out to core maintainers over Slack.

@github-actions

Copy link
Copy Markdown
Contributor

@SemiAnalysisAI SemiAnalysisAI deleted a comment from cquil11 Jun 18, 2026
@github-actions

Copy link
Copy Markdown
Contributor

@cursor cursor Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Cursor Bugbot has reviewed your changes and found 1 potential issue.

Fix All in Cursor

❌ Bugbot Autofix is OFF. To automatically fix reported issues with cloud agents, enable autofix in the Cursor dashboard.

Reviewed by Cursor Bugbot for commit 10af6e2. Configure here.

Comment thread perf-changelog.yaml
- "Enable FlashInfer TRT-LLM attention with FP8 indexer KV and KV cache."
- "Switch TP-only configurations from explicit Marlin MoE to the new image's default FlashInfer TRT-LLM MoE backend."
- "Patch the image's MiniMax M3 MSA prefill path to materialize sliced top-k indices before CSR construction."
pr-link: https://github.com/SemiAnalysisAI/InferenceX/pull/1833

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Changelog not appended at end

High Severity

The new minimaxm3-fp8-b200-vllm block is inserted immediately before the existing trailing minimaxm3-fp8-mi300x-vllm entry instead of after it. Repository changelog validation requires append-only edits with unchanged historical bytes, so this diff fails check-changelog and can block sweep setup.

Fix in Cursor Fix in Web

Reviewed by Cursor Bugbot for commit 10af6e2. Configure here.

@github-actions

Copy link
Copy Markdown
Contributor

@Oseltamivir Oseltamivir requested a review from Ankur-singh as a code owner June 23, 2026 03:27

@Oseltamivir Oseltamivir left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

@Oseltamivir

Oseltamivir commented Jun 23, 2026

Copy link
Copy Markdown
Collaborator

/reuse-sweep-run 27805371252

@Oseltamivir Oseltamivir merged commit a9ddd5f into main Jun 23, 2026
22 of 23 checks passed
@Oseltamivir Oseltamivir deleted the chore/b200-m3-flashinfer branch June 23, 2026 03:34
@github-actions

Copy link
Copy Markdown
Contributor

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

Development

Successfully merging this pull request may close these issues.

2 participants