inference-proxy

Here are 3 public repositories matching this topic...

LLM-4-People / millivolt

Self-hosted inference proxy for OpenAI-compatible and Anthropic clients. Live dashboard, SQLite history, per-request routing, and operator controls.

golang dashboard sqlite self-hosted observability anthropic llm-proxy ai-gateway llm-observability llm-gateway mcp-server openai-compatible inference-proxy

Updated Nov 6, 2026
Go

connortessaro / phantom-api

Star

Anonymous AI inference proxy. Pay any crypto, get an OpenAI-compatible API key.

python privacy ai cryptocurrency fastapi confidential-computing openai-api llm inference-proxy

Updated May 27, 2026
Python

freellms / free-ai-proxy-gateway

Star

Free AI proxy gateway — route requests across 30+ LLM providers (Groq, Gemini, Mistral, Cohere, OpenRouter, NVIDIA NIM) through one OpenAI-compatible endpoint. Build your own LLM proxy, AI router, and multi-provider gateway. Failover & load balancing.

Updated Aug 10, 2026

Add this topic to your repo

To associate your repository with the inference-proxy topic, visit your repo's landing page and select "manage topics."

Learn more