Repository navigation

feat: support opt-in multi-adapter MoE LoRA waves - #1139

Merged

bradhilton merged 15 commits into

mainfrom

stark/fused-moe-pr

Oct 22, 2026

Merged

feat: support opt-in multi-adapter MoE LoRA waves#1139
bradhilton merged 15 commits into
mainfrom
stark/fused-moe-pr

Commits on Oct 21, 2026
- feat: support dense canonical multi-adapter LoRA
  
  bradhilton
  and
  claude
  committed
  1baed6e
- fix: preserve default LoRA behavior outside segmented execution
  
  bradhilton
  and
  claude
  committed
  643933e
- chore: merge ART main into fused MoE lane
  
  bradhilton
  and
  claude
  committed
  d0193b2
- fix: preserve native adapter geometry in opt-in MoE waves
  
  bradhilton
  and
  claude
  committed
  bd6d388
- fix: retain native attention tile origins in MoE waves
  
  bradhilton
  and
  claude
  committed
  349d016
- chore: merge reviewed ART fusion into the MoE lane
  bradhilton
  committed
  ef1458f
- fix: reuse forward-preserving deterministic backward for MoE waves
  
  bradhilton
  and
  claude
  committed
  f20b8b3
- fix: preserve native GDN gate reductions in opt-in MoE waves
  
  bradhilton
  and
  claude
  committed
  16605fa
- fix: retain MoE gate reductions through activation recompute
  
  bradhilton
  and
  claude
  committed
  8d8b173
- fix: preserve preexisting native GDN autograd contexts
  
  bradhilton
  and
  claude
  committed
  4bba0bf
Commits on Oct 22, 2026
- chore: merge current ART inference compatibility
  
  bradhilton
  and
  claude
  committed
  a0bd182
- test: cover Hopper tail attention in deterministic backward
  
  bradhilton
  and
  claude
  committed
  9f026c9
- test: isolate compiled attention policy cases
  
  bradhilton
  and
  claude
  committed
  ca75d38
- fix: reject uncompiled FLASH fallback in deterministic mode
  
  bradhilton
  and
  claude
  committed
  f47f793
- ci: run Megatron-dependent MoE wave unit tests in the Megatron step
  
  bradhilton
  and
  claude
  committed
  fab384e

Commits

Commits on Oct 21, 2026

Commits on Oct 22, 2026