How to control your AI agents without micromanaging

The human control plane architecture that gives you strategic oversight of your entire agent network through exception-based alerts, approval queues, and kill switches without requiring you to monitor every task.

If you monitor every agent task, you burn out in 3 weeks. If you monitor nothing, something breaks in 10 days. The control plane gives you 97 percent error prevention with 8 minutes of daily oversight.

You deployed AI agents to save time. But now you spend an hour every day checking their outputs. Did the email agent send anything embarrassing? Did the content agent publish something off-brand? Did the billing agent process a refund it should not have? The anxiety of letting agents run unsupervised consumes more energy than doing the work yourself.

The opposite extreme is worse. Founders who fully trust their agents without oversight eventually discover that the outreach agent emailed a competitor's CEO, the content agent published incorrect statistics, or the billing agent double-charged a customer. You need a middle path between micromanagement and negligence.

$40/mo

system cost

$5,000/mo

manual cost replaced

99.2%

cost reduction

The stack

The human control plane operates on exception-based monitoring. Agents run autonomously until they encounter a situation that exceeds their defined authority boundaries.

The architecture has 4 components. Component 1 (Boundary Definitions): Each agent has explicit thresholds for autonomous action. The email agent can send messages to prospects but not to customers with over $10k in lifetime value. The billing agent can process refunds under $100 but queues anything larger. The content agent can publish drafts that score above 85 on the quality rubric but flags anything below.

Component 2 (Alert System): When an agent hits a boundary, it pauses execution and sends a notification with the context, the proposed action, and a one-tap approve/reject button. You review only the exceptions, not every task.

Component 3 (Kill Switches): One-click buttons that immediately halt a specific agent, a category of agents, or all agents. If something goes wrong, you stop it instantly. Component 4 (Daily Digest): An 8-minute morning summary that shows what every agent did yesterday, any anomalies detected, and the 3 most important decisions queued for your review.

Ultron
UltronThe control plane

Enforces boundary definitions, manages the exception queue, provides kill switch functionality, and generates the daily digest. The single interface for all human oversight of the agent network.

ultron.sh/agents
Slack
SlackThe notification layer

Delivers exception alerts with contextual summaries and approve/reject buttons. Supports threaded responses where you can ask the agent for more context before making a decision.

Notion
NotionThe decision log

Records every human decision made through the control plane: what was approved, what was rejected, and why. Creates a training dataset that helps agents learn your decision patterns and reduce future exceptions.

What it replaces

2 line items, starting with the daily agent monitoring, priced against the tools that now do the work. The last bar is the whole system at $40/mo.

$3,000/mo

Daily agent monitoring, now 8-minute daily digest

$2,000/mo

Error recovery time, now Kill switches + boundary definitions

$40/mo

The whole system

Monthly cost of each role the system replaces, against the system itself.

Why it holds

Everyone can buy Slack. What separates the setups that last from the ones that collapse is one idea.

The control plane gets better over time because it learns from your decisions. Every time you approve an exception, the system notes the pattern and can auto-approve similar situations in the future. Every time you reject, it tightens the boundary. After 90 days, the daily exception queue shrinks from 15 items to 3 because the system has learned where your real boundaries are versus where the initial conservative defaults were set.

What is inside

This is not theory. 3 pieces, ready to run.

In this playbook

2 of 3
Boundary definition templates
Kill switch configuration
Deploy your control plane
Unlock

How it's built

The file tree, so you know exactly what you would be standing up.

System files
control/
boundary_definitions.jsonalert_router.tskill_switch.jsdaily_digest_generator.ts
decisions/
approval_queue.tsdecision_logger.jspattern_learner.ts

One rule to leave with, the one that stops the daily agent monitoring from creeping back into the budget.

Trust your agents enough to let them work. Control them enough to catch the 3 percent that matters. The control plane is how you do both.

The numbers above trace back to the Human-AI Oversight Patterns Study, not projections.

Human-AI Oversight Patterns StudyException-Based Management Research

You can wire Slack and the rest of this stack by hand from the playbook above. Or you skip the assembly, because standing up systems like this is exactly what Ultron does.

$5,000

is what this system replaces every month. Ultron runs it for $40/mo.

No card required. Set it up in about ten minutes.

Keep reading