Pinned Loading

1. vllm-project/vllm-metal vllm-project/vllm-metal Public

   Community maintained hardware plugin for vLLM on Apple Silicon

   Python 1.8k 281

2. KVBoost KVBoost Public

   Make local LLM inference faster with chunk-level KV cache reuse

   Python 30

3. Tenosra/Proxima Tenosra/Proxima Public

   Proxima lets existing GPUs serve 4x more concurrent requests

   Python 26 4

4. TokenBurn TokenBurn Public

   TokenBurn: Information-theoretic metrics for measuring LLM confidence, hallucination risk, and optimal reasoning length.

   Python 20

5. laya-drift laya-drift Public

   opencode plugin to monitor agent drift over time

   TypeScript 17

6. CUDA-From-Scratch CUDA-From-Scratch Public

   A self-study for CUDA principles from 0 to 1

   Cuda 19