DeepGEMM: clean and efficient FP8 GEMM kernels with fine-grained scaling

Tile primitives for speedy kernels

NanoGPT (124M) quality in 7.8 8xH100-minutes

A repo for distributed training of language models with Reinforcement Learning via Human Feedback (RLHF)

🚀 A simple way to train and use PyTorch models with multi-GPU, TPU, mixed-precision

Large Language Model Text Generation Inference

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

Optax is a gradient processing and optimization library for JAX.

CodeTF: One-stop Transformer Library for State-of-the-art Code LLM

Pipeline Parallelism for PyTorch

OpenSpiel is a collection of environments and algorithms for research in general reinforcement learning and search/planning in games.

🎓 Hugo Academic Theme 创建一个学术网站. Easily create a beautiful academic résumé or educational website using Hugo, GitHub, and Netlify.

This repo contain the syllabus of the Hugging Face Deep Reinforcement Learning Class.

Lab Materials for MIT 6.S191: Introduction to Deep Learning

Distributed Heuristic Multi-Agent Path Finding with Communication - ICRA 2021