repositories Search Results · topic:llm-inference org:Infini-AI-Lab fork:true

Filter by

• • Code... (...)results
  • Repositories4 (4)results
  • Issues
    results
  • Pull requests
    results
  • Discussions
    results
  • Users
    results
  • More

• Advanced

  • Owner
  • Size
  • Number of followers
  • Number of forks
  • Number of stars
  • Date created
  • Date pushed
  • Topic
  • License
  • Archived
  • Public
  • Private
• Advanced search

Filter:Repositories4 (4)

4 results  (129 ms)

4 results

inInfini-AI-Lab (press backspace or delete to remove)

Sort by: Best match

Filter

Infini-AI-Lab/TriForce

[COLM 2024] TriForce: Lossless Acceleration of Long Sequence Generation with Hierarchical Speculative Decoding

acceleration

efficiency

inference

llm

long-context

• Python
·
• 280
·
• Updated
  on Aug 31, 2024

Star

Infini-AI-Lab/MagicPIG

[ICLR2025 Spotlight] MagicPIG: LSH Sampling for Efficient LLM Generation

decoding

lsh-algorithm

llm-inference

gpu-cpu

• Python
·
• 257
·
• Updated
  on Dec 16, 2024

Star

Infini-AI-Lab/UMbreLLa

LLM Inference on consumer devices

offloading

llm-inference

speculative-decoding

• Python
·
• 131
·
• Updated
  on Mar 17, 2025

Star

Infini-AI-Lab/vortex_torch

Vortex: Programmable Sparse Attention for Agents as Algorithm Designers

sparse

sparse-attention

llm

llm-inference

• Python
·
• 69
·
• Updated
  on Aug 22

Star

Sponsor open source projects you depend on

Contributors are working behind the scenes to make open source better for everyone—give them the help and recognition they deserve.Explore sponsorable projects

ProTip! Press the / key to activate the search input again and adjust your query.

Sponsor open source projects you depend on

Contributors are working behind the scenes to make open source better for everyone—give them the help and recognition they deserve.Explore sponsorable projects

ProTip! Press the / key to activate the search input again and adjust your query.