Skip to content

Add Qwen 3.8 27B Megatron support - #810

Draft
Kovbo wants to merge 1 commit into
codex/require-peft-0191from
codex/qwen3-8-27b
Draft

Add Qwen 3.8 27B Megatron support#810
Kovbo wants to merge 1 commit into
codex/require-peft-0191from
codex/qwen3-8-27b

Conversation

@Kovbo

@Kovbo Kovbo commented Aug 19, 2026

Copy link
Copy Markdown
Collaborator

Summary

  • register Qwen/Qwen3.8-27B as a validated Qwen 3.5-family dense Megatron model
  • preserve Qwen attention dimensions in checkpoint adapter metadata
  • cover model-family routing and checkpoint metadata for the new identifier

Why

Qwen 3.8 27B has the same model architecture and checkpoint schema as Qwen 3.6 27B, but ART currently rejects it because validated model support is keyed by exact Hugging Face model identifier.

Validation

  • uv run --extra tensors pytest tests/unit/test_trainer_rank_validation.py -k qwen35_checkpoint_adapter_config_captures_attention_dimensions
  • uv run prek run --all-files

@Kovbo
Kovbo had a problem deploying to trainer-rank-gpu-validation August 19, 2026 18:17 — with GitHub Actions Error
@Kovbo
Kovbo force-pushed the codex/qwen3-8-27b branch from 53e0a85 to c6e0fbb Compare August 19, 2026 18:18
@Kovbo
Kovbo changed the base branch from main to codex/require-peft-0191 August 19, 2026 18:18
@Kovbo
Kovbo temporarily deployed to trainer-rank-gpu-validation August 19, 2026 18:19 — with GitHub Actions Inactive
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant