Inference Without a Round Trip
WebGPU shipped, quantization matured, and small-but-useful models exist. The browser is an LLM runtime now, and the consequences are bigger than the novelty.
10 MAY 202612 min read
READ_
ARCHITECTURE,
CODE AND WHATEVER
I'M BUILDING NOW.
I design software systems for a living and build personal projects to stay sharp. This is where I write about both and whatever else has caught my attention. If that sounds interesting, stick around.
