Skip to content

repositories Search Results · topic:gguf org:gpustack fork:true

Filter by

3 results  (107 ms)

3 results

ingpustack (press backspace or delete to remove)

Review/Check GGUF files and estimate the memory usage and maximum tokens per second.

Public archive

LM inference server implementation based on *.cpp.

Deliver LLMs of GGUF format via Dockerfile.
Package icon

Sponsor open source projects you depend on

Contributors are working behind the scenes to make open source better for everyone—give them the help and recognition they deserve.Explore sponsorable projects
ProTip! Press the / key to activate the search input again and adjust your query.