Finetune Llama 3.1, Mistral, Phi & Gemma LLMs 2-5x faster with 80% less memory

Utils for Unsloth https://github.com/unslothai/unsloth

LLM inference in C/C++

250+ Fine-tuning & RL Notebooks for text, vision, audio, embedding, TTS models.

Diffusion model(SD,Flux,Wan,Qwen Image,Z-Image,...) inference in pure C/C++

RAPIDS Sample Notebooks

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

Accessible large language models via k-bit quantization for PyTorch.

An interface library for RL post training with environments.

A high-throughput and memory-efficient inference and serving engine for LLMs

Inference, Fine Tuning and many more recipes with Gemma family of models

Public repo for HF blog posts

Tool for generating high quality Synthetic datasets

Clean, accessible reproduction of DeepSeek R1-Zero

Material for gpu-mode lectures

Efficient Triton Kernels for LLM Training

SkyPilot: Run AI and batch jobs on any infra (Kubernetes or 12+ clouds). Get unified execution, cost savings, and high GPU availability via a simple interface.

Llama 2 Everywhere (L2E)

The official PyTorch implementation of Google's Gemma models

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.