OpenFrontiers: A Collection of Open Research Problems and a Benchmark for Scientific Rediscovery
Which summary reads better? Pick one — models revealed after.Both summaries are AI-generated.
A benchmark of 200 recently resolved mathematical problems with formal Lean 4 statements is now available, enabling evaluation of LLMs' research-level problem-solving capabilities under controlled conditions. This development matters because it allows engineers running LLMs in production to assess and compare their models' ability to rediscover known solutions, a crucial step toward tackling currently open scientific problems. Evaluating LLMs on this benchmark can reveal whether they rely on memorization or genuine problem-solving capabilities.
Mistral Large quota or rate limit — check usage and plan. Original headline: OpenFrontiers: A Collection of Open Research Problems and a Benchmark for Scientific Rediscovery