State of the art inference performance with modern accelerators on Kubernetes
-
Updated
Oct 29, 2026 - Python
#
model-server
Here are 19 public repositories matching this topic...
High-performance Lemonade alternative for AMD Strix Halo & Radeon — latest MoE models (Ling-3.0-Flash, Qwen 3.8 Flash Next, Ornith 1.5), bleeding-edge RDNA 3.5 Wave64/ROCmFP4 kernels, and silicon-tuned profiles.
vulkan moe quantization lemonade rocm multimodal model-server openai-api llama-cpp local-llm llm-inference gguf speculative-decoding fp4 strix-halo wave64 amd-ryzen-ai radv ornith halofpx
-
Updated
Sep 24, 2026 - Python
A collection of model deployment library and technique.
aws data-science machine-learning caffe deep-learning neural-network mxnet azure tensorflow model keras pytorch model-deployment model-serving serving serving-recommendation model-server serving-pytorch-models serving-tensors
-
Updated
Jul 22, 2020
A standalone inference server for trained Rubix ML estimators.
api infrastructure php machine-learning microservice json-api rest-api inference http-server inference-server inference-engine model-deployment php-ml ml-infrastructure model-server rubix-ml php-machine-learning rubix-server
-
Updated
Mar 3, 2026 - PHP
Apache MXNet Gluon implementation for state of the art FER+ paper for Facial Emotion Recognition - https://arxiv.org/abs/1608.01041
-
Updated
Nov 22, 2022 - Jupyter Notebook
High Performan Ai Model Web Server. Mainly support computer vision model. Quickly establish your own ai-model server. https://github.com/MaybeShewill-CV/mortred_model_server
workflow image-classification object-detection image-segmentation model-server mnn-model image-ocr high-perforance-computing
-
Updated
Oct 29, 2026 - C++
Model Server for Kepler
machine-learning sustainability tensorflow prometheus stream-processing model-server online-machine-learning tensorflow2 tensorflow-io
-
Updated
Mar 19, 2026 - Python
Serve pytorch / torch models using Drogon
-
Updated
Sep 25, 2022 - C++
Production ready templates for deploying Driverless AI (DAI) scorers. https://h2oai.github.io/dai-deployment-templates/
-
Updated
Sep 1, 2025 - Java
Client for TensorFlow Serving
-
Updated
Mar 27, 2018 - Python
Free, open-source Mac menu-bar Duck that keeps your Mac awake — local AI agents, model servers, renders, downloads. Lid closed, on battery. No telemetry.
macos swift open-source mac macbook sparkle appkit caffeinate ai-agents local-server menu-bar clamshell-mode model-server apple-silicon keep-awake local-ai notarized sleep-prevention smappservice lid-closed
-
Updated
Jul 28, 2026 - Swift
Simple webserver for externalizing RASA models.
-
Updated
May 1, 2023 - Python
One API and one way to launch any Jev-type decision model on a Mac
-
Updated
Oct 2, 2026 - Go
SKIL: Skymind Intelligence Layer
-
Updated
Jun 18, 2019 - Jupyter Notebook
Isolated runtime for Hugging Face models requiring `trust_remote_code=True`, using a loopback-only Docker container and a FastAPI bridge.
python docker machine-learning sandboxing model-server ai-security fastapi huggingface secure-inference llm trust-remote-code
-
Updated
Dec 20, 2025 - Python
One OpenAI + Anthropic endpoint for every local model: starts models on request, frees GPU cards when idle, runs background work on free cards
-
Updated
Oct 29, 2026 - Python
Fork of Ollama for BlackRoad local model runtime, Pi fleet, and RoadCode provider experiments.
model-server local-models ollama blackroad blackroad-os forkies-27 candidate-review-required open-source-integration local-model-server
-
Updated
May 20, 2026 - Go
Find, download and serve OpenVINO models on your own machine, from one window. A Monad app.
-
Updated
Oct 29, 2026 - Python
Add this topic to your repo
To associate your repository with the model-server topic, visit your repo's landing page and select "manage topics."