My Blog

September 23, 2026

KV-Caching, Batching, and Memory Complications : Scaling Kshipra on CPU

September 21, 2026

Building Kshipra: Why LLM Inference Belongs on Average Consumer Hardware

September 5, 2026

My Semantic Cache improved latency by 275x , hit 94% similarity and still wrong