repositories Search Results · topic:speculative-decoding org:Infini-AI-Lab fork:true

Filter by

• • Code... (...)results
  • Repositories3 (3)results
  • Issues
    results
  • Pull requests
    results
  • Discussions
    results
  • Users
    results
  • More

• Advanced

  • Owner
  • Size
  • Number of followers
  • Number of forks
  • Number of stars
  • Date created
  • Date pushed
  • Topic
  • License
  • Archived
  • Public
  • Private
• Advanced search

Filter:Repositories3 (3)

3 results  (97 ms)

3 results

inInfini-AI-Lab (press backspace or delete to remove)

Sort by: Best match

Filter

Infini-AI-Lab/Sequoia

scalable and robust tree-based speculative decoding algorithm

efficiency

inference

llm

speculative-decoding

• Python
·
• 375
·
• Updated
  on Jan 28, 2025

Star

Infini-AI-Lab/TriForce

[COLM 2024] TriForce: Lossless Acceleration of Long Sequence Generation with Hierarchical Speculative Decoding

acceleration

efficiency

inference

llm

long-context

• Python
·
• 280
·
• Updated
  on Aug 31, 2024

Star

Infini-AI-Lab/UMbreLLa

LLM Inference on consumer devices

offloading

llm-inference

speculative-decoding

• Python
·
• 131
·
• Updated
  on Mar 17, 2025

Star

Sponsor open source projects you depend on

Contributors are working behind the scenes to make open source better for everyone—give them the help and recognition they deserve.Explore sponsorable projects

ProTip! Press the / key to activate the search input again and adjust your query.

Sponsor open source projects you depend on

Contributors are working behind the scenes to make open source better for everyone—give them the help and recognition they deserve.Explore sponsorable projects

ProTip! Press the / key to activate the search input again and adjust your query.