Role
Founder · Lead Engineer
Company
Personal / R&D
Stack
TypeScript · LLM Agents · RAG
Status
Live
01 — chapter
Problem
Most AI tools are chat boxes bolted onto workflows designed before LLMs existed.
02 — chapter
Research
Studied how power users chain ChatGPT, Notion, and a dozen scripts. The pattern was always: assemble context, run a step, save the output somewhere else. Nothing composed.
03 — chapter
Architecture
- 01Agent runtime with tool-use and memory primitives\nVector store for retrieval over documents\nEdge functions for low-latency streaming\nProvider-agnostic model routing (OpenAI, Claude, Gemini)
04 — chapter
Development
Wrote the agent runtime first. Every UI surface — chat, docs, workflows — became a thin client over the same runtime, so features composed instead of forking.
05 — chapter
Challenges
Cost control. Naïve retrieval blew up token spend. Built a two-stage retriever that pre-filters cheaply before re-ranking with the model.
06 — chapter
Results
Live beta with active daily use across two organisations. Sub-second first-token latency at the edge.
07 — stack used
- TypeScript
- LLM Agents
- RAG
- Vector DB
- Edge