Observability for Agent Runs
Harness Engineering
90-120 minutes0/4 steps0%
Step 1 of 4
Instrument spans across the loop
The trace tree is the run's skeleton - build it first.
First time here? Paste the Context Pack first so the AI understands your project - open it from the header above.
Prompt Capsule
Add structured tracing to the agent. Span hierarchy: session -> task -> turn -> {model_call, tool_execution, hook_check, compaction, memory_op}. Attributes per span type: model calls get model, tier, tokens in/out, cost, latency, stop reason; tool spans get tool name, argument digest, result size, verdict; hook spans get rule and verdict. Use OpenTelemetry SDK conventions (GenAI semantic conventions where they fit) so exporters and existing backends work. Export to your available backend (an OTLP collector, or a local trace store if self-contained). Add a scrubber on attribute capture: known secret patterns and configured sensitive fields are redacted before export. Verify one session renders as a correct, complete tree.Paste into EmergentFull Build: complete implementation prompt with explicit requirements
Quick is short. Full Build is recommended for most steps. Strict forces real logic when the AI keeps faking output.
Actual change check
Expected after this step
A complete scrubbed trace tree for a real session.
Should NOT happen
- An existing feature broke
- A button only logs to console
- Data disappears after refresh
- Errors fail silently with no visible state
This is what should exist before you continue. If reality does not match, do not move on.
Track what changed, failed, or needs follow-up. Notes export with the flow.
Pass the Verify Gate to complete this step