Question
How do I practice comparative monitoring?
Quick Answer
Pick two agents (habits, routines, or decision rules) that serve similar goals. Define 2-3 shared metrics. Track both for one week under comparable conditions. At the end, place the results side by side: which agent performed better on which metric? Did one dominate across the board, or did they.
The most direct way to practice comparative monitoring is through a focused exercise: Pick two agents (habits, routines, or decision rules) that serve similar goals. Define 2-3 shared metrics. Track both for one week under comparable conditions. At the end, place the results side by side: which agent performed better on which metric? Did one dominate across the board, or did they trade advantages? Write a one-paragraph verdict explaining which you will keep, modify, or retire — and why.
Common pitfall: Comparing agents on a single metric and declaring a winner. One agent may score higher on throughput but lower on sustainability. Another may look worse this week but was operating under unusual conditions. The failure is premature convergence — collapsing a multi-dimensional comparison into a single number and optimizing for it, which is precisely the trap Goodhart's law describes.
This practice connects to Phase 28 (Agent Monitoring) — building it as a repeatable habit compounds over time.
Learn more in these lessons