← Raghav Gupta
§ Case studies · 5

The long version of what I build.

Cards are for scanning. These are the writeups — what the problem actually was, which decisions were load-bearing, and how each system is proved to work rather than asserted to.

01Evaluating AI coding agentsTest design for non-deterministic systemsCurrent assignment · Handshake AI

Five years of test design rest on one assumption: run it twice, get the same answer. Coding agents break that assumption. Most of what a tester knows survives the break — but only after you rewrite what “pass” means.

Role
QA Engineer — AI Agent Evaluation (contract)
Since
March 2026
Unit of work
A Dockerised task with a verifier
Read the case study
02Squared UpUPI-native expense splittingShipped · open source

Splitwise got worse and it never understood UPI. Squared Up is the version I wanted. The interesting part is not the app — it is that the money math is a framework-free Python package, proved out before Django ever sees it.

Stack
Django · DRF · PostgreSQL · React PWA
Money
Integer paise · no floats
Proved with
Spec vectors + Hypothesis
Read the case study
03Equity CrewMulti-agent equity researchShipped · open source

An LLM that says “BUY” is worthless. An LLM that says BUY at 0.78 confidence, with a 12-month target, two named reasons and two named risks — and gets retried when it fails to produce them — is at least something you can argue with.

Stack
Python · CrewAI · OpenRouter · EXA
Agents
6 defined · 4 run in parallel
Output
Validated schema + PDF report
Read the case study
04Git GuideAgentic RAG over GitLab docsShipped · open source

A documentation assistant that would rather say nothing than guess. Every answer is retrieved from GitLab's own docs, cited back to a source URL, and refused outright when retrieval cannot clear a relevance floor.

Stack
Python · CrewAI · ChromaDB · Streamlit
Embeddings
BAAI/bge-small · local CPU
Cost
$0 to operate
Read the case study
05StenoWriting standard for AI proseShipped · on sale

A product, not a repository. Steno is a writing standard that stops AI prose announcing itself — sold as a one-time purchase, with the rules, the copy, the brand, the landing page and the payment flow all built by the person who wrote the rules.

Ships as
Claude skill · portable prompt
Model
One-time purchase
Built
Product · copy · brand · front end
Read the case study