Hopsworks - Data-Intensive AI platform with a Feature Store
A scalable, high-performance serving system for federated learning models
Common library for serving TensorFlow, XGBoost and scikit-learn models in production.
JAiRouter is a production-ready AI model gateway that provides a unified, OpenAI-compatible API for managing multiple LLM backends. It handles load balancing, rate limiting, circuit breaking, and failover — so you can focus on building applications, not managing infrastructure.
Generic Model Serving Implementation leveraging Flink
Production ready templates for deploying Driverless AI (DAI) scorers. https://h2oai.github.io/dai-deployment-templates/
Serving layer for large machine learning models on Apache Flink
Production-grade Java 25 Virtual Thread inference gateway bridging NVIDIA Triton → Dynamo with Earliest Deadline First (EDF) priority queuing, adaptive batching, and async shadow validation.
KServe TrustyAI explainer
A scalable machine learning microservice built with Java and Spring Boot for serving AI models.
To associate your repository with the model-serving topic, visit your repo's landing page and select "manage topics."