AI and Agents

Libraries for building AI applications, LLM integrations, and autonomous agents.

Build a typed agent in Pydantic AI. Long-running, stateful agents suit LangGraph. Apps tied to one model vendor can use that vendor's Python AI agent library.

How to choose:

  • Typed agents: Pydantic AI, or LangGraph for long-running, stateful ones
  • Agents on Claude, OpenAI, or Gemini models: Claude Agent SDK, OpenAI Agents SDK, or Google ADK
  • Skills for your coding agent: Django AI Skills, Sentry Skills, or Trail of Bits Skills
  • MCP servers and clients: MCP Python SDK, or FastMCP to compose and proxy servers
  • A personal assistant in your chat apps: Hermes Agent, or AstrBot for QQ, Feishu, and DingTalk
  • Prompts tuned against a metric: DSPy
  • Agent data: Instructor for structured output, LlamaIndex for RAG, Mem0 for memory
  • Open models from the Hugging Face Hub: Transformers
  • Serving open models: vLLM or SGLang, or MLX LM on Apple silicon
  • One OpenAI-style API for many model providers: LiteLLM
  • Image and video generation: Diffusers
  • Fine-tuning: TRL with PEFT adapters, Unsloth for less GPU memory, Axolotl from YAML
  • Speech: faster-whisper, FunASR for Chinese, gTTS for text to speech

Listed in editorial order, grouped by use case. Click a column to re-sort the whole list.

Press / to search. Tap a tag to filter. Click any row for details.

Search and filter

Results

Row number Tags

Agent Skills 3 projects

Django backend agent skills for Django, DRF, Celery, and Django-specific code review.
Agent skills the Sentry team uses for code review, pull requests, and Django reviews.
Security skills for vulnerability detection, auditing, and testing.

Orchestration 4 projects

A framework for building agents and LLM-powered applications.
langchain-ai/github.com/langchain-ai/langchain / /164,916,946 downloads/month
Low-level orchestration framework for building stateful, long-running LLM agents.
langchain-ai/github.com/langchain-ai/langgraph / /43,015,034 downloads/month
A Python agent framework for building generative AI applications with structured schemas.
pydantic/github.com/pydantic/pydantic-ai / /5,218,697 downloads/month
A framework for orchestrating role-playing autonomous AI agents for collaborative task solving.
crewAIInc/github.com/crewAIInc/crewAI / /2,401,816 downloads/month

Vendor Agent SDKs 3 projects

Anthropic's Python SDK for building AI agents on Claude Code's harness — custom tools, in-process MCP servers, hooks.
anthropics/github.com/anthropics/claude-agent-sdk-python / /28,864,820 downloads/month
OpenAI's framework for building and managing AI agents.
openai/github.com/openai/openai-agents-python / /12,078,797 downloads/month
Google's code-first toolkit for building, evaluating, and deploying AI agents.
google/github.com/google/adk-python / /9,841,896 downloads/month

Model Context Protocol 2 projects

The official Python SDK for building Model Context Protocol servers and clients.
modelcontextprotocol/github.com/modelcontextprotocol/python-sdk / /226,341,224 downloads/month
A high-level, Pythonic framework for building MCP servers and clients.
PrefectHQ/github.com/PrefectHQ/fastmcp / /52,280,364 downloads/month

Personal Assistants 2 projects

An adaptive personal AI assistant that grows with you.
NousResearch/github.com/NousResearch/hermes-agent / /161,021 downloads/month
A multi-platform AI assistant that connects LLMs to chat apps like Telegram, Slack, and QQ, extensible with Python plugins.
AstrBotDevs/github.com/AstrBotDevs/AstrBot / /29,813 downloads/month

Prompt Optimization 1 project

A framework for programming, not prompting, language models.
stanfordnlp/github.com/stanfordnlp/dspy / /5,189,676 downloads/month

Data Layer 5 projects

A library for extracting structured data from LLMs, powered by Pydantic.
567-labs/github.com/567-labs/instructor / /8,188,650 downloads/month
A toolkit for building RAG pipelines and agents over your data.
run-llama/github.com/run-llama/llama_index / /2,877,616 downloads/month
An intelligent memory layer for AI agents enabling personalized interactions.
mem0ai/github.com/mem0ai/mem0 / /1,975,911 downloads/month
A context database for AI agents that unifies memory, resources, and skills.
volcengine/github.com/volcengine/OpenViking / /434,712 downloads/month
A graph-native context and knowledge layer for AI agents with reasoning, provenance, and governance.
semantica-agi/github.com/semantica-agi/semantica / /15,525 downloads/month

Pre-trained Models 1 project

The model-definition framework for pretrained models in text, computer vision, audio, video, and multimodal tasks, for inference and training.
huggingface/github.com/huggingface/transformers / /92,904,196 downloads/month

LLM Inference and Serving 3 projects

A high-performance serving framework for large language models and multimodal models.
sgl-project/github.com/sgl-project/sglang / /2,788,765 downloads/month
A high-throughput and memory-efficient inference and serving engine for LLMs.
vllm-project/github.com/vllm-project/vllm / /1,965,887 downloads/month
Run and fine-tune large language models on Apple Silicon with MLX.
ml-explore/github.com/ml-explore/mlx-lm / /532,024 downloads/month

LLM Gateways 1 project

Call 100+ LLMs using OpenAI format.
BerriAI/github.com/BerriAI/litellm / /89,154,495 downloads/month

Image and Video Generation 1 project

A library that provides pre-trained diffusion models for generating and editing images, audio, and video.
huggingface/github.com/huggingface/diffusers / /4,875,537 downloads/month

Fine-tuning 4 projects

A library for parameter-efficient fine-tuning of large pretrained models.
huggingface/github.com/huggingface/peft / /8,039,161 downloads/month
A library for post-training transformer language models with SFT, DPO, GRPO, and other trainers.
huggingface/github.com/huggingface/trl / /2,516,534 downloads/month
Faster, lower-memory LLM fine-tuning, as a Python library or a desktop app.
unslothai/github.com/unslothai/unsloth / /916,264 downloads/month
A framework for fine-tuning and post-training large language models.
axolotl-ai-cloud/github.com/axolotl-ai-cloud/axolotl / /9,476 downloads/month

Speech 4 projects

A Whisper reimplementation on CTranslate2, up to 4 times faster than openai-whisper with less memory.
SYSTRAN/github.com/SYSTRAN/faster-whisper / /9,107,226 downloads/month
A general-purpose automatic speech recognition model trained on 680k hours of multilingual and multitask supervised data.
openai/github.com/openai/whisper / /4,857,769 downloads/month
Python library and CLI tool for converting text to speech using Google Translate TTS.
pndurette/github.com/pndurette/gTTS / /1,123,488 downloads/month
Industrial-grade speech recognition toolkit with speaker diarization and emotion detection.
modelscope/github.com/modelscope/FunASR / /269,971 downloads/month

AI and Agents guide

Pydantic AI comes from the Pydantic team and is typed end to end. Outputs, tools, and dependencies all carry types, so your type checker knows what an agent returns. Switching models takes one string. Give an agent an output type and tools, and every run comes back validated.

LangGraph is a low-level orchestration framework for long-running, stateful agents, and it can mix hand-coded steps with LLM-driven ones in one graph. For your first agent, its docs suggest LangChain's agents instead: a minimal harness built on LangGraph, which you extend through middleware.

The Claude Agent SDK gives you the tools and agent loop behind Claude Code, so it fits agents that read files, run commands, and edit code. Call query() for a one-off task, and switch to ClaudeSDKClient when the next step depends on Claude's reply, as in a chat.

The OpenAI Agents SDK keeps to a small set of primitives: use it when you want the runtime to handle turns, tool calls, handoffs, and guardrails for you. Despite the name, it isn't limited to OpenAI models.

Google ADK is optimized for Gemini but model-agnostic. Start a project with adk create.

All three skill collections install from a Claude Code plugin marketplace. Django AI Skills and Sentry Skills follow the open Agent Skills format, so other coding agents can load them too. Sentry Skills is written for Sentry's own engineers, so some of its skills follow Sentry's internal standards.

CrewAI splits an app into Flows, which manage state and control execution, and Crews, teams of agents that work on one task together. For a production app, start with a Flow, and hand a Crew only the steps that need autonomy.

The MCP Python SDK reads each tool's schema from its type hints and docstring, so you write no JSON Schema or request handlers. FastMCP wrote the high-level API that the SDK took in. The standalone project is a fuller framework: it can mount several servers into one and proxy another MCP server through your own.

Hermes Agent talks to you on Telegram, Discord, Slack, WhatsApp, and Signal from one gateway process, and writes itself new skills as it works. Since it runs commands for whoever it lets in, allow only your own account on its gateway with an allowlist, and leave approval prompts on for dangerous commands. AstrBot covers chat apps such as QQ, Feishu, and DingTalk. It's AGPL, while Hermes Agent is MIT.

DSPy has you write structured signatures, not prompts, and its optimizers tune the prompts for you. Before they can, define a metric and score a baseline to beat.

Instructor turns an LLM's reply into a validated Pydantic model, and when validation fails, it retries with the error message. Its docs draw the line at extraction versus agents: Instructor for the first, Pydantic AI for the second.

LlamaIndex builds agents over your own data. Its high-level API goes from documents to answers in a few lines, and its lower-level API lets you replace any part.

Mem0 gives an agent memory of each user: search their memories before the model answers, then add the new exchange. Run it as a library in your app, or as a self-hosted server for a team.

Transformers is the model definition that most training frameworks and inference engines share, Axolotl, Unsloth, vLLM, and SGLang among them. Load a model from the Hugging Face Hub with from_pretrained(), then run it through Pipeline for inference or Trainer for training. For large production deployments, its docs send you to vLLM or SGLang.

vLLM runs batch inference offline or an OpenAI-compatible server, so apps written for the OpenAI API work unchanged. SGLang is optimized for agentic workloads, RL rollouts, and large-scale serving. On a Mac, MLX LM runs and fine-tunes models on Apple silicon.

LiteLLM returns every provider's responses in the OpenAI format and maps their errors to OpenAI's exception types, so one code path covers them all. Use its Python SDK inside your app, or run its proxy as a self-hosted gateway for your team.

Diffusers centers on the DiffusionPipeline: a few lines generate an image, video, or audio clip.

Start fine-tuning with LoRA or QLoRA rather than training every weight, as both PEFT and Unsloth advise. TRL trains with methods from SFT to DPO and GRPO, and every TRL trainer takes a peft_config for PEFT adapters. Axolotl keeps the whole pipeline, from dataset preprocessing to inference, in one YAML file.

faster-whisper reimplements Whisper on CTranslate2 for the same accuracy in less time and memory. For Chinese audio, FunASR's AutoModel chains speech recognition with voice activity detection, punctuation, and speaker models in one call. gTTS speaks through Google Translate's undocumented speech feature, so upstream changes can break it without notice.

Know a project that belongs here?

Tell us what it does and why it stands out.