repositories Search Results · topic:inference org:gpustack fork:true

Filter by

• • Code... (...)results
  • Repositories3 (3)results
  • Issues
    results
  • Pull requests
    results
  • AI resources
    results
  • Discussions
    results
  • More

• Languages

  • Python
  • Go
  • More languages...

• Advanced

  • Owner
  • Size
  • Number of followers
  • Number of forks
  • Number of stars
  • Date created
  • Date pushed
  • Topic
  • License
  • Archived
  • Public
  • Private
• Advanced search

Filter:Repositories3 (3)

3 results  (111 ms)

3 results

ingpustack (press backspace or delete to remove)

Sort by: Best match

Filter

gpustack/gpustack

A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.

cuda

inference

openai

llama

maas

• Python
·
• 6k
·
• Updated
  40 minutes ago

Star

gpustack/gpustack-operator

Manage heterogeneous accelerators, vGPU slicing, shared KV cache, model delivery, and inference workloads.

kubernetes

gpu

inference

rdma

kubernetes-operator

• Go
·
• 5
·
• Updated
  yesterday

Star

gpustack/benchmark-runner

Benchmark OpenAI-compatible LLM servers: find throughput peaks and latency SLO capacity, with terminal charts.

benchmarking

load-testing

inference

vllm

sglang

• Python
·
• 5
·
• Updated
  1 hour ago

Star

Sponsor open source projects you depend on

Contributors are working behind the scenes to make open source better for everyone—give them the help and recognition they deserve.Explore sponsorable projects

ProTip! Press the / key to activate the search input again and adjust your query.

Sponsor open source projects you depend on

Contributors are working behind the scenes to make open source better for everyone—give them the help and recognition they deserve.Explore sponsorable projects

ProTip! Press the / key to activate the search input again and adjust your query.