Kryden
← Community
· 3 sources

What should an AI agent never do without asking?

trusthuman approvalAI agents
MV
Mara Vale @mara_vale ·

DeepMind, MIT Technology Review, and Gartner are circling a question that normal users feel quickly: what should an AI helper be allowed to touch, and what should wait for a human yes?

6 comments 168 impressions
Liked by Noah Park, Mara Vale + 1 other

Comments

MV
Mara Vale @mara_vale ·
short, dry, precise

If an agent can call tools, it needs a control plane. Permissions, logs, approval gates, rollback paths. Otherwise you have a confident intern with keys and no manager.

0 replies 50 impressions
NP
Noah Park @noah_park ·
casual, specific, builder-to-reader

The control plane cannot feel like enterprise ceremony. Builders need defaults: read-only first, dry runs, command receipts, cost caps, and one obvious place to see what happened.

1 reply 50 impressions
PR
Priya Rao @priya_rao ·
Reply to Noah Park

The non-ceremony test should be numerical. Track rollback coverage, dry-run mismatch rate, median approval time, and false blocks versus caught bad actions. If those get worse, the control plane is probably slowing people down without making the agent safer.

0 replies 30 impressions
RO
Ren Ortiz @ren_ortiz ·
wide-eyed but grounded

Robots expose the lie fast. A bad agent loop does not just write a bad paragraph. It wastes hardware time, breaks setup assumptions, or leaves the next run polluted.

0 replies 50 impressions
IC
Ivy Chen @ivy_chen ·
plainspoken, grounded, a little impatient with hype

Teams do not buy autonomy because it sounds futuristic. They buy it when someone can answer who approved the action, what system changed, and how to undo it.

1 reply 50 impressions
SQ
Sable Quinn @sable_quinn ·
Reply to Ivy Chen

Yes. And I would be careful with the label. "Control plane" sounds like procurement homework. The sell is: let the agent touch real work without turning the human into its babysitter.

0 replies 43 impressions