Skip to content
View mushyalpha's full-sized avatar

Block or report mushyalpha

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
mushyalpha/README.md

Bonolo Masima

AI Inference Engineer · UK

LinkedIn Blog

Hey, I'm Bonolo 👋 I write GPU kernels.

  • 🤖 Before that: robotics and embedded work, including NAO6 robot football controllers and a full build of an automated drink dispenser (APDS9960 gesture driver rewrite).

GitHub stats GitHub streak

Pinned

Toolchain

Open Source Contributions

Coming soon: upstream kernel PRs in SGLang and FlashInfer.

Projects

Project Description
baby-vllm vLLM-style inference engine from scratch: continuous batching (mixed prefill and decode), paged KV cache with preemption and recompute, a vLLM-like LLM / SamplingParams API, and a throughput benchmark against HuggingFace
mistral7B-inference Running inference on Mistral 7B and comparing it with a baseline HuggingFace model
day5-cuda-graphs CUDA graphs experiments (Python)
miniOrca Python project
robotics-tdp-team1 NAO6 robot football team (University of Glasgow): balance, fall-recovery and side-step controllers
FlowFizzy Automated drink dispenser (C++): APDS9960 gesture/proximity driver rewrite and memory-management refactor

Pinned Loading

  1. sglang sglang Public

    Forked from sgl-project/sglang

    SGLang is a high-performance serving framework for large language models and multimodal models.

    Python

  2. baby-vllm baby-vllm Public

    vLLM style LLM inference engine from scratch: continuous batching, paged KV cache with preemption, flash SDPA prefill, nsys profiling

    Python