1. Design the state machine
Outcome: Agent behavior does not depend on a hidden loop.
Tasks
- →Define states
- →Define transitions
- →Add maximum-step limits
- →Add terminal outcomes
Checks
- ✓Every state has an exit condition
- ✓An infinite loop is impossible
Build a governed AI agent with tools, explicit state, approvals, cost and time limits, an audit log, and a rollback path.
Scenario
An agent prepares changes to an operating environment: it reads data, creates a plan, invokes tools, and requests approval before risky actions. Every action must be reconstructable from the audit trail.
Outcome: Agent behavior does not depend on a hidden loop.
Tasks
Checks
Outcome: Every tool has a contract and explicit access boundaries.
Tasks
Checks
Outcome: Risk, time, and cost are bounded before execution.
Tasks
Checks
Outcome: An action can be explained, replayed, or rolled back.
Tasks
Checks
Assessment rubric
States, transitions, terminal outcomes, and recovery are explicit.
Insufficient
Behavior depends on a hidden or unbounded loop.
Competent
Every state has an exit condition and explicit limits.
Strong
Deterministic replay, recovery states, and property tests are implemented.
Evidence required
Every tool has a schema, permission scope, risk level, and dry-run policy.
Insufficient
Tools are invoked without explicit contracts or access boundaries.
Competent
The registry defines contracts, risks, and permissions.
Strong
Policies are enforced by a separate policy engine and covered by tests.
Evidence required
Risky actions, time, steps, and cost are bounded before execution.
Insufficient
Write actions can run without approval or limits.
Competent
Approval gates and budgets block unsafe actions.
Strong
Risk-based policy, cancellation, and delegated approvals are implemented.
Evidence required
The decision sequence is reproducible and changes have rollback evidence.
Insufficient
The audit trail is incomplete or rollback is only declarative.
Competent
The audit log reconstructs the cycle and rollback is verified.
Strong
Tamper-evident logging, replay, and an automated recovery drill are implemented.
Evidence required