Browsing Tag
testing
167 posts
ASP.NET Core 10 Authentication Metrics: Distinguish No Result from Failure
When every unauthorized request becomes the same dashboard line, diagnosis turns into guessing. ASP.NET Core 10 authentication metrics…
Lesson 4b – Validation: Testing the gate itself
The last lesson was about validating what a model hands you. The story behind it: a set of…
I type-check AI-generated SDK code against the real package. Claude refused a third of my Stripe tasks.
I build a small tool called SDKProof. It measures whether AI coding agents write a library’s current API…
How I cut my Chromatic bill 10x (works on any visual testing tool)
I have been a huge Storybook and Chromatic fan for years. But at some point the bill got…
A formula can be implemented perfectly and still give the wrong answer
I spent a while this year writing a small zero-dependency library of health and fitness formulas — BMI,…
A Framework-Agnostic Testing Methodology for AI Agents (61 sources, 58 test blocks, OWASP Agentic Top 10)
How do you actually test an AI agent? Not “does it respond,” but: does it route to the…
I told one AI to demolish the handoff prompt I wrote for another AI. It found a test that passes even when it’s empty
I’m building an app with Claude Code right now. The setup is a little unusual. One “commander” session…
The Shape of Failure: Before You Blame the AI
Every automated system receives a particular shape of the world. That shape is expressed through records, documents, events,…
389 Tests Passed. NIST Still Caught the Bug.
I gave an AI agent a calculator because I wanted one hard, inspectable point inside a probabilistic workflow.…
The AI writes the tests. It doesn’t get to grade them.
Originally published at dmitriiev.dev Here is the rule the whole thing is built on: every stage is checked…