Skip to content
#

tabbyapi

Here are 19 public repositories matching this topic...

Call LLMs and VLMs from ComfyUI with any OpenAI compatible chat completions API: local servers (llama.cpp, vLLM, SGLang, Ollama, LM Studio, tabbyAPI, Unsloth Studio…) or cloud providers. Text and image inputs, multi-turn history with memory loops, and model unloading for local servers.

  • Updated Nov 17, 2026
  • Python

Qwen3.8-Flash-Next (turboderp's 2.68bpw EXL3) on 2× RTX 5090, ExLlamaV3 + TabbyAPI: 262k context, 819k-token 8-bit KV pool, 8 slots, MTP + prompt lookup. 1 stream: 239-341 t/s by content with thinking off (311 code), 249 with thinking on; 795 t/s at 8 streams; ~12.4k t/s prefill. Launcher, overlays, probes, dated measurements.

  • Updated Nov 16, 2026
  • Python

Add this topic to your repo

To associate your repository with the tabbyapi topic, visit your repo's landing page and select "manage topics."

Learn more