Toast552
Follow
Highlights
- Pro
-
-
l Public
Forked from LMCache/LMCacheSupercharge Your LLM with the Fastest KV Cache Layer
-
llIl Public
Forked from NVIDIA/Model-OptimizerA unified library of SOTA model optimization techniques like quantization, pruning, distillation, speculative decoding, etc. It compresses deep learning models for downstream deployment frameworks …
Python Apache License 2.0 UpdatedOct 5, 2026 -
aicR Public
Forked from NVIDIA/aicrTooling for optimized, validated, and reproducible GPU-accelerated AI runtime in Kubernetes
Go Apache License 2.0 UpdatedOct 5, 2026 -
lllIIIIIl Public
Forked from langchain-ai/langgraphBuild resilient language agents as graphs.
Python MIT License UpdatedOct 5, 2026 -
-
-
llllllllllllllIl Public
Forked from DietrichGebert/ponytailMeh
JavaScript MIT License UpdatedOct 5, 2026 -
lllllllllllllllllllI Public
Forked from 0xSero/dsv41-flash-offloadDeepSeek-V4.1-Flash EXL3 on one 24 GB RTX 3090 + DDR4 + NVMe: staged-DMA prefill, AVX2 CPU expert tier, elastic VRAM expert cache, Engram on disk, OpenAI API --> haven't tested it yet
Python MIT License UpdatedOct 5, 2026 -
R0LL Public
Forked from alibaba/ROLLAn Efficient and User-Friendly Scaling Library for Reinforcement Learning with Large Language Models
Python Apache License 2.0 UpdatedOct 5, 2026 -
sglangZzz Public
Forked from sgl-project/sglangSGLang is a fast serving framework for large language models and vision language models.
-
llllllllI Public
Forked from Kludex/uvicornAn ASGI web server, for Python. 🦄
Python BSD 3-Clause "New" or "Revised" License UpdatedOct 3, 2026 -
lllllIlI Public
Forked from google/tunixA Lightweight LLM Post-Training Library
Python Apache License 2.0 UpdatedOct 3, 2026 -
IIIIIIlIlIlll Public
Forked from ggml-org/Llama-WindowsWindows Llama App Companion
C# UpdatedOct 3, 2026 -
-
-
IIIllllIIl Public
Forked from apache/datafusionApache DataFusion SQL Query Engine
Rust Apache License 2.0 UpdatedOct 3, 2026 -
needlezZz Public
Forked from cactus-compute/needleAutomation foundation model for tiny devices: 2-bit, 8-29 MB, tool calls, structured extraction and embeddings on phones, wearables, smart homes, robots, cars and microcontrollers.
Python Apache License 2.0 UpdatedOct 2, 2026 -
llllllllIl Public
Forked from microsoft/nvxCross-Platform Micro-VM Sandbox for Agentic Workloads
Python MIT License UpdatedOct 2, 2026 -
-
AngelSlim Public
Forked from Tencent/AngelSlimModel compression toolkit engineered for enhanced usability, comprehensiveness, and efficiency.
Python Other UpdatedOct 2, 2026 -
-
llllll Public
Forked from sipeed/NanoKVMAffordable, Multifunctional, Nano RISC-V IP-KVM
TypeScript GNU General Public License v3.0 UpdatedOct 1, 2026 -
IIIIIIIIIII Public
Forked from 0xSero/glm53-flash-offloadMehehehehe
Python MIT License UpdatedOct 1, 2026 -
lllllllI Public
Forked from langchain-ai/deepagentsAgent harness built with LangChain and LangGraph.
Python MIT License UpdatedOct 1, 2026 -
ktransformers Public
Forked from kvcache-ai/ktransformersA Flexible Framework for Experiencing Heterogeneous LLM Inference/Fine-tune Optimizations
-
fLoW Public
Forked from ruvnet/ruflo🌊 The leading agent orchestration platform for Claude. Deploy intelligent multi-agent swarms, coordinate autonomous workflows, and build conversational AI systems. Features enterprise-grade archite…
TypeScript MIT License UpdatedOct 1, 2026 -
kubesprayzZz Public
Forked from kubernetes-sigs/kubesprayDeploy a Production Ready Kubernetes Cluster
-
.zZz. Public
Forked from huggingface/trlTrain transformer language models with reinforcement learning.
-
doris Public
Forked from apache/dorisApache Doris is an easy-to-use, high performance and unified analytics database.