Headline finding
Cogitator is a harness for deterministic, auditable evaluation of autonomous agents that commits to the witnessed semantics of a run using canonical JSON (JCS) and a domain-separated BLAKE3 hash chain, yielding a witness root that recomputes identically in replay mode from recorded transcripts and in live mode when prompts/seeds and tool behaviour are held constant.
The manuscript specifies the cryptographic commitment construction and provides empirical demonstrations of deterministic witness roots, replayability, and verification.
“Cogitator is a harness for deterministic, auditable evaluation of autonomous agents. It treats each evaluation as an experiment whose artefacts can be replayed off-line and independently verified. Cogitator commits to the witnessed semantics of a run—agent trace entries and tool-call witness views—using canonical JSON (JCS) and a domain-separated BLAKE3 hash chain, yielding a witness root. In replay mode, the witness root recomputes identically from the recorded transcripts; in live mode, it recomputes identically when prompts/seeds and tool behaviour are held constant.” · Show in paper