Hi, this is Vamshi. I am a full stack developer with deep expertise on Frontend. I have been working on Applied AI, augmented experiences and I want share my learnings through this blog. More details about me can be found on my about page.
Five quantization techniques for 70B models on one GPU, the inference optimizations production stacks need, and building a custom RAG eval metric from scratch.
Read PostRebuilding Claude Code's 6-layer harness in CrewAI, why small models alone won't cut your inference bill, and the four agent loop patterns — plus Kimi K3's 2.8T drop.
Read PostKV caching rethought with LMCache and 14x faster TTFT, the 4-stage production routing pipeline, and Fable-as-Advisor at 92% quality for 63% of the cost.
Read PostModel routing that cuts costs 50-60%, the 4-layer agent engineering stack, and self-improving harnesses lifting small models 33-60% — plus Sonnet 5 ships.
Read PostSpeculative decoding at 4x speedups, the RAG taxonomy every engineer needs, and Karpathy's agentic engineering framework — plus GPT-5.6 under government review.
Read PostStructured notes from the week's best AI and engineering newsletters — retrieval layers as a shared tool, 8.5x faster LLM inference, and model distillation.
Read PostA clean, battle-tested way to handle multiple GitHub accounts on one machine..
Read PostA simplified guide to understand how different Network Protocols work, and picking the right choice for your application scenarios.
Read PostSimple summary to understand CAP Theorem, and it's guidance for the trade-offs in a distributed system.
Read Post
