Github Action to deploy a mod to Steam Workshop

Easily portable doom

Implementing the IEEE 754 standard for floating-point numbers to Hearts of Iron IV's modding system

HTTP 2.0 client & server implementation for Rust.

Redis Python client

A platform-independent file lock for Python.

A high-throughput and memory-efficient inference and serving engine for LLMs

FlashInfer: Kernel Library for LLM Serving

Fast and memory-efficient exact attention

A framework for few-shot evaluation of language models.

Enforce the output format (JSON Schema, Regex etc) of a language model

NumPy & SciPy for GPU

Large Language Model Text Generation Inference

A fast and simple framework for building and running distributed applications. Ray is packaged with RLlib, a scalable reinforcement learning library, and Tune, a scalable hyperparameter tuning libr…

Create UIs for your machine learning model in Python in 3 minutes

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

Python bindings for llama.cpp

Distributed XGBoost on Ray

Run deepspeed on ray serve

A repo for distributed training of language models with Reinforcement Learning via Human Feedback (RLHF)

LightGBM on Ray

A Comprehensive and Scalable Python Library for Outlier Detection (Anomaly Detection)