Skip to content

feat(qwen): add paged greedy MTP with FP8 block weights - #584

Open
big-hip wants to merge 7 commits into
InfiniTensor:InfiniLM-v0.2.9cfrom
big-hip:feat/qwen-greedy-mtp
Open

feat(qwen): add paged greedy MTP with FP8 block weights#584
big-hip wants to merge 7 commits into
InfiniTensor:InfiniLM-v0.2.9cfrom
big-hip:feat/qwen-greedy-mtp

refactor(mtp): remove orphaned snapshot accessors

31ef429
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs