Let Your Agents Review, But Look Before Humans Do
Agents can run multiple rounds of review and verification before you look. But ship to humans without looking yourself, and something subtle always feels off — because fully specifying a system that feels right to a human is hard.
Some interesting thoughts in Noah Smith's piece, "Your future job will be to keep AI on task."
I've had a lot of luck letting different agents do multiple rounds of review and verification before I look at things — but I've regretted it when I don't look at things at all before other humans use the system I'm working on, even with clear acceptance criteria checked off explicitly.
There's always something in the details that is a little off, mostly because it's hard to completely specify a system that feels right to a human, at least while humans are the target user. There's lots of software where agents are the target user and that's a different story. Even then, the agents are still working on behalf of something humans want.
Related insights
Agents Are Going Multi-Player
Most people's experience with AI agents is single-player. We're moving into a multi-player era where specialized agents live in your team channels as true teammates.
Codify Senior Judgment to Scale AI Impact
Scaling impact with AI comes from codifying senior judgment into skills and agent workflows—which also becomes the training material for the people still climbing the ladder.
Codex Is Becoming My Daily Driver
After a year with Claude Code as my daily driver, the Codex desktop app's interface for managing many agent threads and automations has me reaching for it more and more.
Get More Like This
Follow along as I build and share what I learn
Found this helpful? Share it with your network!