Skip to content
@Infini-AI-Lab

Infini-AI-Lab

Next Generation AI algorithms and systems

Popular repositories Loading

  1. Sequoia Sequoia Public

    scalable and robust tree-based speculative decoding algorithm

    Python 375 37

  2. TriForce TriForce Public

    [COLM 2024] TriForce: Lossless Acceleration of Long Sequence Generation with Hierarchical Speculative Decoding

    Python 280 21

  3. hermit hermit Public

    Python 275 19

  4. MagicPIG MagicPIG Public

    [ICLR2025 Spotlight] MagicPIG: LSH Sampling for Efficient LLM Generation

    Python 256 21

  5. MagicDec MagicDec Public

    [ICLR2025] Breaking Throughput-Latency Trade-off for Long Sequences with Speculative Decoding

    Python 161 14

  6. MonarchRT MonarchRT Public

    Python 146 13

Repositories

Showing 10 of 47 repositories
  • hermit Public
    Infini-AI-Lab/hermit's past year of commit activity
    Python 275 Apache-2.0 19 4 7 Updated Oct 27, 2026
  • STAPLE Public
    Infini-AI-Lab/STAPLE's past year of commit activity
    Python 3 BSD-3-Clause 0 0 0 Updated Oct 12, 2026
  • ServeLearnBench Public
    Infini-AI-Lab/ServeLearnBench's past year of commit activity
    Python 9 Apache-2.0 0 0 0 Updated Oct 7, 2026
  • SED Public
    Infini-AI-Lab/SED's past year of commit activity
    Python 4 MIT 1 0 0 Updated Sep 15, 2026
  • vortex_torch Public

    Vortex: Programmable Sparse Attention for Agents as Algorithm Designers

    Infini-AI-Lab/vortex_torch's past year of commit activity
    Python 69 Apache-2.0 14 0 6 Updated Aug 22, 2026
  • flashrt-blog Public
    Infini-AI-Lab/flashrt-blog's past year of commit activity
    HTML 0 0 0 0 Updated Aug 10, 2026
  • aibattle Public
    Infini-AI-Lab/aibattle's past year of commit activity
    HTML 4 MIT 0 0 0 Updated Aug 5, 2026
  • astraflow Public

    Dataflow-Oriented Reinforcement Learning for (Multi-)Agentic LLMs

    Infini-AI-Lab/astraflow's past year of commit activity
    Python 111 Apache-2.0 18 0 3 Updated Jul 26, 2026
  • FlashRT Public
    Infini-AI-Lab/FlashRT's past year of commit activity
    Python 5 0 0 0 Updated Jul 23, 2026
  • Sparrow Public
    Infini-AI-Lab/Sparrow's past year of commit activity
    Python 17 2 0 0 Updated Jun 15, 2026
View all repositories