Rust bindings for the C++ api of PyTorch.

SGLang is a high-performance serving framework for large language models and multimodal models.

Your own personal AI assistant. Any OS. Any Platform. The lobster way. 🦞

chat log tool, easily use your own chat data. 聊天记录工具，轻松使用自己的聊天数据

PyTorch native quantization and sparsity for training and inference

FlashInfer: Kernel Library for LLM Serving

Code for the paper "Evaluating Large Language Models Trained on Code"

SGLang is yet another fast serving framework for large language models and vision language models.

Composable transformations of Python+NumPy programs: differentiate, vectorize, JIT to GPU/TPU, and more

Structured Text Generation

A curated list for Efficient Large Language Models

Stanford DSPy: The framework for programming—not prompting—foundation models

Ongoing research training transformer language models at scale, including: BERT & GPT-2

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

This repository contains code to quantitatively evaluate instruction-tuned models such as Alpaca and Flan-T5 on held-out tasks.

Benchmarking large language models' complex reasoning ability with chain-of-thought prompting

gnark-crypto provides elliptic curve and pairing-based cryptography on BN, BLS12, BLS24 and BW6 curves. It also provides various algorithms (algebra, crypto) of particular interest to zero knowledg…

This repository contains integer operators on GPUs for PyTorch.

An Open Source Machine Learning Framework for Everyone

Training and serving large-scale neural networks

Tutorial for writing constraints in the `arkworks` framework

End to end Tensor IR/DSL stack for deploying deep learning workloads to hardwares

Mesh TensorFlow: Model Parallelism Made Easier

A distributed deep learning framework that supports flexible parallelization strategies.