BUILD
How it's built. Architecture, patterns, code.
55 posts
I cut a RAG pipeline from 90s to 4s without changing the model
RAG pipelines hit a latency wall 2 weeks after launch. The fix is never a faster model. Three pipeline bugs account for 80% of the delay and each has a one-line fix.
Your agent wastes money on three things. Here is how to fix each one.
Three caching layers every agent needs: KV/prompt caching for the system prompt, schema-level progressive disclosure for tool definitions, and result caching for redundant tool calls. Each layer is independently useful and they stack.
Build a verifier that never ties: continuous scoring from LLM logprobs
LLM judges collapse scoring to a single token, causing 27% tie rates. A verifier that reads the full logprob distribution produces continuous scores, zero ties, and 3 scaling knobs you can tune per use case.
7 practical context engineering techniques you can use right now
The papers talk about context engineering as a harness problem. But the highest-impact techniques are things you can do in the chat right now. No infrastructure changes needed.
How to write project instructions that AI agents actually follow
I spent a day writing the perfect AGENTS.md. The first task I gave it, the agent ignored every instruction and did what it 'knew' from training. The fix: don't describe the right path. Invalidate the wrong one.
Bottleneck in model routing is information, not reasoning
A new paper from NUS and Alibaba proves that model routing fails due to information deficit, not reasoning limits. The C-A-F loop (Context-Action-Feedback) builds a router that improves with every decision, achieving +15.3% over vanilla routing and maintaining performance on out-of-distribution tasks.
How Netflix built GenPage: generative homepage at scale
Netflix's GenPage replaces a 5-stage recommender pipeline with one generative transformer that builds the homepage autoregressively. ~200M params, custom tokenizer, Dr. GRPO post-training, and 20% lower latency in production.
How DeepSeek cuts agent response latency by 60% with speculative decoding
DeepSeek's DSpark framework uses semi-autoregressive generation and confidence-scheduled verification to accelerate LLM inference by 60-85% with zero quality loss. The training code is now open source.
Building pi-loop: A Research-Backed Recursive Agent Loop
How I built a recursive agent loop that breaks tasks into 8-15 tiny sub-problems, solves them in parallel, critiques with majority voting, and recursively deepens where the critic finds gaps.
How to process 1,000-page documents without hitting context limits
Two models solving each other's limits: Unlimited-OCR reads scanned documents the RLM can't access, and the RLM recursively analyzes text the OCR model can't fit in context.
I ran Krea-2 Turbo on a 16GB Mac. Here's how CLIP, VAE, and the KSampler turned noise into an image.
I downloaded 12GB of model files, wired them together in ComfyUI, and generated a neon fox on a laptop. The CLIP translated my words. The VAE compressed and decompressed. The KSampler denoised through latent space. Here's what each step actually does.
How to convert your agent from LLMs to SLMs without breaking it
NVIDIA Research's 6-step algorithm for migrating agents from frontier LLMs to small language models. With case studies showing 40-70% of queries can be replaced.
Nanbeige4.1-3B: How a 3B model sustains 600 tool calls and beats 30B models
How Nanbeige4.1-3B uses a 4-stage RL pipeline with gated time-complexity rewards to beat Qwen3-30B-A3B on coding and match 100B+ models on deep search. Full architecture breakdown with benchmark analysis and local-first implications.
llama.cpp: The local inference engine that changed how developers ship AI
Quantization, CLI commands, Python bindings, and architecture explained from first principles. Real benchmark data from arxiv 2601.14277, not guesswork.
DeepSeek V4's hybrid attention changes your agent context budget
DeepSeek V4's hybrid attention (CSA+HCA) brings KV cache to 2% of a standard transformer at 1M context. For agents, this shifts context engineering from 'what to exclude' to 'let compression handle it' — but only for the right workloads.
How to build an independent LLM drift detection probe
LLM drift is real and it compounds silently. Here's how to build an independent probe that stays out of your system and continuously checks for behavioral regression.
Your context window is a workspace, not a filing cabinet
Your agent's context window is a workspace. Every byte of memory you shove in there is a byte of working memory you took away. Four strategies with real code.
Your LLM judge flips a coin 13.6% of the time
LLM-as-a-Judge reliability: pairwise preferences flip 13.6% between identical runs. How to build trustworthy evaluations with multi-trial aggregation and position randomization.
How to build model-agnostic agents that survive a provider shutdown
Anthropic had to pull Fable 5 for all customers. If your agent depends on one model, you're one government order away from a full rewrite. Here's the architecture that prevents that.
Best AI Coding Agents 2026: Ranked for Real Projects
Hands-on comparison of Claude Code, Cursor, Copilot, OpenCode, and Codex in 2026. Ranked by agentic capability, cost, and real project fit. Now with Agents' Last Exam benchmark data.
Automation Templates: making cron jobs smart with Hermes Agent
Cron jobs are dumb. They run at 2am and dump output to a file you never read. Hermes Agent's Automation Templates fix that. an LLM evaluates the output, decides if it matters, and ships a summary to Telegram. Here's how to set one up in 5 minutes.
Is Your Agent Extension Actually Working?
Tool invocation looks like success. But if your agent produces the same output without your extension, your extension is drag, not lift. Here's how to measure it.
Making FlashAttention-4 Faster for Inference
Modal's engineering team made three targeted changes to FlashAttention-4 that improved inference throughput by up to 4.37x. split KV parallelism, FP8 input support, and arbitrary KV page sizes.
DiffusionGemma: hands-on with Google's 4x faster text model
Google's DiffusionGemma generates text through diffusion. denoising blocks of 256 tokens in parallel. reaching up to 1000 tokens/s on an H100. Here's how it works, how to run it, and what it means for local AI.
AI agent deployment server: production infrastructure setup
A production-grade guide to setting up an AI agent deployment server. VPS provisioning, Docker, Nginx, SSL, monitoring, CI/CD, and zero-downtime deploys. For when a platform isn't enough.
Best AI Agent Frameworks 2026: Production-Tested Comparison
A hands-on comparison of LangGraph, CrewAI, AutoGen, Pi (Factory), and Mastra. ranked by production readiness, debugging, multi-agent support, and developer experience in 2026.
Best MCP Servers & Tools 2026: The Essential List
The MCP ecosystem has exploded in 2026. Here are the servers worth installing. ranked by utility, reliability, and real-world use.
Best Open-Source LLMs for Coding 2026
The open-source LLM landscape for coding has shifted. DeepSeek V4-Pro and Kimi K2.6 lead the benchmarks. Here's what can run locally, what needs cloud, and which model wins for each coding task.
Best Side Projects for AI Engineers in India 2026
The best AI side projects for Indian engineers in 2026. ranked by earning potential, learning value, and time to ship. With INR cost estimates and Indian-market considerations.
Build an agentic incident triage assistant with AWS Quick and New Relic
AWS and New Relic published a guide for building an agentic incident triage assistant. Here's the architecture pattern. automated context gathering, diagnostic execution, and remediation suggestions triggered by alerts.
Cohere North Mini Code: a 30B MoE model for agentic coding
Cohere dropped North Mini Code. a 30B MoE model (3B active) trained for agentic coding tasks. It tops SWE-Bench for its size class and runs on OpenCode. Here's the architecture breakdown and what it means for agent builders.
How AI coding agents actually use your SDK
You ship an SDK. AI coding agents consume it differently than humans do. Here's the exact step-by-step trace of what happens between 'developer types a prompt' and 'agent generates code with your technology'. and how to design for it.
How to guide AI agents and ship web apps: a vocabulary
A scannable reference of terms for guiding AI coding agents and shipping production web apps. Steering, agent architecture, typography, layout, motion, design systems.
How to host an AI agent: a beginner's guide
A beginner-friendly guide to hosting your first AI agent. the simplest path from local development to a live, accessible agent on a server.
How to set up Hermes Agent: a step-by-step guide
Hermes Agent is an open-source CLI agent by Nous Research. Here's how to install, configure providers, set up skills, and run your first session. from scratch to a working agent.
SilverTorch: Meta's Index as Model: a new retrieval paradigm
Meta Engineering published SilverTorch. an 'Index as Model' retrieval paradigm that replaces a microservice mesh with a unified PyTorch neural network. 23.7x higher throughput, 20.9x more compute efficient.
Test-case reducers: the debugging tool you're not using
When a test fails with a 500-line input, finding the actual bug is tedious. Test-case reducers automatically minimize failing cases to the minimal reproducing input. saving hours of manual binary search.
Build a state machine for your AI agent in a weekend
Your agent crashes mid-conversation and doesn't recover. It runs the same tool call 10 times. It doesn't know when to stop. Those are all state machine problems. Here's how to build the FSM that fixes all of them. in a weekend, with no framework.
Dynamic Workflows in Claude Code: When to Use Them (and When Not To)
Default Claude Code handles most tasks well. But complex, adversarial, or long-running tasks expose three failure modes. Dynamic workflows solve them by letting Claude coordinate a team.
The 15 jobs every agent harness must do
Frameworks sell you one decision. The problem is that an agent harness is 15 separate jobs. and when you need to replace one, you're forced to replace all 15. Here's the full list, what each job does, and why the composition model matters.
The policy gate every agent needs before you go to production
Your agent can call any tool. That's the point. But without a policy gate, it can also delete production databases, send emails to the wrong people, and burn through budget on a single runaway loop. Here's how to add the gate that catches all of that.
Why your agent forgets conversations (and how to fix it with a branching tree)
You ask your agent to try something different. It forgets the original conversation. You try to go back and the agent is confused. That's not a memory problem. it's a data structure problem. Here's why sessions are stored wrong and how to fix it.
AI agent context window: keeping your agent from forgetting
Your agent remembers everything in the current conversation. That's both its superpower and its biggest weakness. Here's how to manage context windows so your agent stays focused and cost-efficient.
AI agent deployment guide: from localhost to production
Building an agent that works on your laptop is step one. Making it run reliably in production. cost-controlled, monitored, failure-resilient. is where most attempts fail. Here's the deployment guide I wish existed.
AI agent error handling patterns
Your agent will fail. Not sometimes. regularly. The difference between a demo agent and a production agent is how it handles those failures. Here are the patterns that kept my agents running.
AI agent logging and monitoring: seeing inside your agent
Your agent is doing something strange and you have no idea why. Here's exactly what to log, how to structure it, and how to debug agents in production.
AI agent multi-step workflows: building complex pipelines
Four workflow patterns every agent developer needs. sequential, parallel fan-out, conditional branching, and loop with human-in-the-loop. With real code and production lessons.
Best open source AI tools for indie hackers in 2026
Open source AI tools are proliferating fast. Most of them are not worth your time. These are the ones that survived my brutal evaluation: must be actually useful for a solo developer shipping products.
Building an AI code review agent: lessons from production
I built an AI code review agent that posts comments on GitHub PRs. The architecture was the easy part. The failure modes. hallucinated bugs, missing real issues, arguing with human reviewers. nearly made me scrap the project.
CrewAI vs LangGraph: which agent framework to use
I built the same research agent in both CrewAI and LangGraph. One felt natural from the start. The other made me appreciate why state graphs exist. Here's the honest comparison.
Cursor vs Claude Code vs Copilot: 6 months of daily use
I've been a heavy user of all three for 6 months. They're not interchangeable. each excels at different things. Here's the honest comparison on real coding tasks.
How to build your first AI agent in 2026 (tutorial)
You've used ChatGPT. You've maybe used Claude or Copilot. But building an agent. something that acts on its own. feels like a different skill. It's not. Here's the tutorial I wish existed when I started.
LangGraph tutorial for beginners: build your first workflow
LangGraph keeps getting recommended but every tutorial assumes you already know LangChain. Here's a beginner-friendly walkthrough. from state graphs to a working agent. without the chain-of-thought abstraction.
OpenAI function calling tutorial: building tools for GPT
OpenAI's function calling API lets the model request function execution. fetch data, interact with APIs, compute things. Here's how to use it from scratch.
अपना पहला एआई एजेंट कैसे बनाएं (2026 ट्यूटोरियल)
आपने ChatGPT इस्तेमाल किया है। शायद Claude या Copilot भी इस्तेमाल किया है कोडिंग में मदद के लिए। लेकिन एजेंट बनाना. जो अपने आप कार्रवाई करे. एक अलग कौशल लगता है। ऐसा नहीं है। यह ट्यूटोरियल वह है जो मैं शुरू में चाहता था।
Need an AI agent?
I ship them in 14 days. $1,400.
Prefer a scheduled call? Book 30 minutes on Cal.com
Get the brief on AI agents
Practical posts on shipping agents, automating work, and building in public. No hype, no fluff.
Contact: [email protected]