Agents & InferencearXiv

OpenDiscoveryTrace releases 558 AI scientist trajectories across 124 tasks

Which summary reads better? Pick one — models revealed after.Both summaries are AI-generated.

Match the models (Optional)

Which model wrote which summary? Select a matchup mapping below before voting.

Summary A

558 complete AI scientific agent trajectories are now available in a public dataset, capturing the step-by-step reasoning process of seven different models across 124 scientific tasks. This enables the auditing of AI scientific methodology and diagnosis of failure modes, revealing significant differences in error profiles between models with similar success rates. Practitioners shipping AI scientists can now evaluate not just the final output but the entire reasoning process, potentially reducing costly errors.