🏆 OScaR: The Occam's Razor for Extreme KV Cache Quantization in LLMs and Beyond — redefining the accuracy-efficiency Pareto front for X-LLMs KV quantization.

TokenSpeed is a speed-of-light LLM inference engine.

brpc is an Industrial-grade RPC framework using C++ Language, which is often used in high performance system such as Search, Storage, Machine learning, Advertisement, Recommendation etc. "brpc" mea…

A (G)Vim plugin which build the trinity of Source Explorer, TagList and NERD tree to be an IDE for software development.

Resumes generated using the GitHub informations