Highlights
Stars
A python API client for the United States Federal Register.
OpenAI-Compatible RESTful APIs for Amazon Bedrock
Sample files, code snippets and downloads for ContextualAI
CloudFormation template for Amazon SageMaker Studio Code Editor
🦄 Record your terminal and generate animated gif images or share a web player
All-in-one LLM CLI tool featuring Shell Assistant, Chat-REPL, RAG, AI Tools & Agents, with access to OpenAI, Claude, Gemini, Ollama, Groq, and more.
A modern Swift SDK for OpenAI's Realtime API
A unified orchestration layer for heterogeneous AI compute. It standardizes how to manage compute and run training and inference on GPU clouds, Kubernetes, VMs, or bare-metal clusters.
Deploy and scale distributed python applications on Amazon EKS using Ray
Headless WiFi configuration for the Raspberry Pi (or most other devices running Linux) by using a temporary WiFi access point and web interface
Raspberry Pi project to visualize flight conditions on a map using WS8211 LEDs addressed via NeoPixel
IDEA is a platform that facilitates distributed HPC and self-service Virtual Desktops on AWS
Experimental scripts for Amazon SageMaker HyperPod
The Amazon S3 Connector for PyTorch delivers high throughput for PyTorch training jobs that access and store data in Amazon S3.
Python 3.8+ toolbox for submitting jobs to Slurm
Minimalistic large language model 3D-parallelism training
Amplify UI is a collection of accessible, themeable, performant React (and more!) components that can connect directly to the cloud.
This Guidance demonstrates how to deploy a machine learning inference architecture on Amazon Elastic Kubernetes Service (Amazon EKS). It addresses the basic implementation requirements as well as w…
TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. Tensor…
This is a plugin which lets EC2 developers use libfabric as network provider while running NCCL applications.
Best practices, reference architectures, and examples for distributed AI training and inference on AWS.
Contains example recipes that demonstrate how to build HPC systems using AWS services and solutions.
Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We also show you how to solve end to end problems using Llama mode…




