I'm Prathamesh Hedau
I’m an Inference Engineer focused on making LLMs practical, efficient, and cost-effective under real hardware constraints. The goal isn’t just to build a working system, but to optimize the complete execution pipeline—from core text-generation baselines and memory caching, to dynamic batching, token streaming, speculative speed boosts, and model compression.
Projects
A local semantic caching engine that reduces repeated LLM inference using FastAPI, Ollama, Qwen, and vector similarity search.