JudgeMyAIOpenDiscoveryTrace: Enabling Auditable Reasoning for Autonomous AI Scientists
Executive Takeaway OpenDiscoveryTrace delivers the first public, high‑fidelity dataset of 558 complete AI scientific agent trajectories across 124 drug‑discovery, materials‑science, genomics, and literature‑analysis tasks. By recording a nine‑field per‑step trace—thoughts, tool calls, observations, errors, revision triggers, self‑reported confidence, and three auxiliary signals—the dataset makes the *reasoning process* of frontier models (GPT‑5.4, Claude Opus 4.6, Gemini 3.1 Pro) observable, auditable, […]