AI engineer — Local inference and agentic developer tooling. I build end-to-end systems and contribute upstream to the tools I depend on.
Now: Starbridge, so a coding agent that stops for a question reaches you on your phone, live at starbridge.run. Still shipping voice for coding agents in localvoxtral.
- Starbridge — when a coding agent (Claude Code, Codex, Pi, opencode) stops for a question, Starbridge puts it on your phone and in your browser. You answer with one tap and the session carries on. It also shows what's left on each AI plan, read from CodexBar. The server stores your content only as ciphertext, though it still sees who sent what, and when. Free server at starbridge.run, or host your own.
TypeScriptKotlin - vidtheque — the talks you don't have time to watch, queryable by an agent over MCP: transcripts, on-screen text and keyframes, every answer stamped with the second it happened. Self-hosted, with a demo that indexes 310 AI Engineer talks and both days of AI Engineer Paris 2026.
PythonJavaScript - localvoxtral — native macOS menu-bar app for realtime, fully local dictation. Words appear while you're still speaking. Built for prompting coding agents by voice, it grounds LLM polishing in the session under your cursor, its screen and the repo's vocabulary.
Swift - mlx-audio-swift — eight merged PRs on the Voxtral realtime streaming path: incremental mel/conv front end (O(N²) → O(N)), in-place KV append and token-by-token decode for bounded memory, and the 4-bit tied-head checkpoint I publish. Streaming went from ~1.9× slower than realtime to 0.76 RTF.
Swift - working-set — how many agents a given GPU configuration keeps warm, and which constraint binds first: KV cache, decode bandwidth, or prefill compute. A scenario model on PyPI (
ws predict,ws teston a live vLLM endpoint) behind an explorer that answers with a verdict.PythonHTML - llama.cpp #20120 — merged: preserve Anthropic thinking blocks through the server's message conversion.
C++ - skills — the agent skills I run across Claude Code, Codex, opencode and pi: delegating work to another CLI, Remote Control servers under systemd, prose cleanup. Each one is a gotcha backed by evidence, deleted once upstream fixes it.
Shell
Mel spectrogram: drop the extra last frame, as Python does
Blaizzy/mlx-audio-swiftfeat(turn-priority-fairness): enable tool calling on the GPU vLLM overlay
llm-d/llm-dQwen3-ASR: default to 60 s chunks instead of 1200 s
Blaizzy/mlx-audio-swiftTTS: Kokoro and Kitten text processors use the loadModel cache
Blaizzy/mlx-audio-swiftCore: reuse a cached snapshot that has no config.json
Blaizzy/mlx-audio-swiftMisc. bug: server: realtime commit completes the item before the flushed words are decoded
ggml-org/llama.cppWhisper: add a translate task to STTGenerateParameters
Blaizzy/mlx-audio-swiftQwen3-ASR: cap maxTokens per chunk, not per file
Blaizzy/mlx-audio-swift
LinkedIn · Hugging Face · npm · PyPI




