Browsing Tag
LLM
176 posts
10,000 Agents, Zero Tokens: Why the Best AI Architectures “Skip” the LLM
1. Introduction: The Scalability Paradox of Agentic Systems In the boardroom, AI agents are promised as the ultimate…
You routed 80% to cheaper models. Now measure whether it worked.
Last week I argued the obvious part: most production LLM traffic — extraction, classification, short rewrites — rarely…
Probe vs Prose: what the verifier-sharing-your-text-channel really costs
Probe vs Prose: what the verifier-sharing-your-text-channel really costs Agent Determinism Illusions (Part 13) 2026-08-31 Where this fits: This…
Embeddings Cannot Say No: An Intent Detector’s Real Numbers
My message detector worked on my test set. On messages it had never seen, it missed one real…
I Tried to Prompt-Inject My Own Agent Engine. It Didn’t Work. Here’s Why.
This is article 5 in a series about building PlannerCritic, an open-source engine where one LLM writes a…
Grok Decrypted an Attacker’s Payload Mid-Execution, Then Exfiltrated Your Chat History
A webpage that just sits there, encrypted blob and all, waiting for an LLM agent to walk in…
Prompt injection: your customer-facing AI is an attack surface
Here is a fun little exercise. Imagine you hired a brilliant, tireless, endlessly polite support rep. They memorized…
One terminal, two trust levels — running Claude Code against a real subscription and a cheap proxy
Part of an ongoing series on model routing and trust tiering for agentic coding tools. This one’s the…
vLLM vs Ollama: Production Serving 2026
Compare vLLM and Ollama for LLM serving in 2026 — architecture, verified performance under concurrency, and a decision…
RAG vs. Direct Context: I Tested Both on Real Documents, Here’s What Broke
A hands-on test of BGE-M3 + Qwen3 (RAG vs. direct-context answering) on a real research paper and a…
