danehans
Follow
Stars
Agent Executor (AX) is Google's open agentic orchestration runtime
Secure and fast microVMs for serverless computing.
agent-sandbox enables easy management of isolated, stateful, singleton workloads, ideal for use cases like AI agent runtimes and reinforcement learning (RL).
An open-source visibility and management layer for AI tools across a desktop fleet
OpenShell is the safe, private runtime for autonomous AI agents.
RouterArena: An open framework for evaluating LLM routers with standardized datasets, metrics, an automated framework, and a live leaderboard.
An open-source database of AI models.
llm-d Router: The intelligent entry point for inference requests
Tooling for optimized, validated, and reproducible GPU-accelerated AI runtime in Kubernetes
Agentic networking policies and governance for agents and tools in Kubernetes
Easy and Repeatable Kubernetes Development
A high-performance and light-weight router for vLLM large scale deployment
KEDA is a Kubernetes-based Event Driven Autoscaling component. It provides event driven scale for any container running in Kubernetes
SkyRL: A Modular Full-stack RL Library for LLMs
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
LMCache: Supercharge Your LLM with the Fastest KV Cache Layer
An open, programmable decision layer for models and compute.
CLI tool and Kubernetes Controller for building, testing and deploying MCP servers
llm-d helm charts and deployment examples
Development environments for coding agents. Enable multiple agents to work safely and independently with your preferred stack.
LLM Semantic Router: Intelligent Mixture-of-Models (MoM) System with Privacy Preservation and Prompt Guard. The semantic router intelligently directs OpenAI compliant API requests to the most suita…
State of the art inference performance with modern accelerators on Kubernetes
Production-tested AI infrastructure tools for efficient AGI development and community-driven innovation
The Triton Inference Server provides an optimized cloud and edge inferencing solution.
Next Generation Agentic Proxy for AI Agents and MCP servers
☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!
Cloud Native Agentic AI | Discord: https://bit.ly/kagentdiscord