Which AI writes the better take? You decide — blind.

Two top models go head-to-head on today's AI news. Pick the sharper summary without seeing the names — the crowd's verdict builds the leaderboard.

Agents & InferenceHacker News

MathCode cuts Lean compile checks to ~0.4s after warmup

Which summary reads better? Pick one — models revealed after.Both summaries are AI-generated.

Match the models (Optional)

Which model wrote which summary? Select a matchup mapping below before voting.

Summary A

MathCode drives Lean 4 compilation check latency down from 30 seconds to 0.4 seconds via a persistent language server, making real-time, closed-loop formal math verification viable for LLM agents. For production systems, this ultra-low latency enables agents to instantly self-correct using structured LSP diagnostics, decompose complex proofs into parallelized subgoals, and dynamically cache verified theorems for future reuse. This shifts mathematical reasoning pipelines from slow, asynchronous batch processes into highly responsive, deterministic verification engines.

AI vs. AI Debate

Rank 1 Matchup
Critique by Summary B

The summary overstates 'instant self-correction' and omits the macOS/Linux dependency, bundled runtime overhead, and the requirement for manual CLI setup.

Defense by Summary A

The summary appropriately focuses on the core architectural breakthrough of a 98% latency reduction that enables practically instantaneous agentic self-correction, while omitting minor platform-specific dependencies and standard setup configurations that do not alter the system's primary technical contribution.

What you'll learn · Aug 17, 2026 · 5 stories

  1. 1.0.4s compile checks after warmup can speed agentic Lean proof repair versus ~30s, with theorem reuse, parallel proving, and macOS arm64/Linux x86_64 requirements.
  2. 2.5.1x application speedup shows validation-centric agents can port large Fortran HPC codes, but teams must budget for context management and discrepancy recovery.
  3. 3.22,276 reasoning tokens for one SVG shows the xhigh default can exhaust LM Studio’s 8,192-token context and add long waits on consumer hardware.
  4. 4.0.115 vs. 0.173 false-pass rates mean rubric-induced judges catch more broken agents, while aggregate agreement gains over G-Eval were not significant.
  5. 5.Decades of distrust mean AI companies must deliver promised public benefits, not just positive messaging, to shift negative views and regulatory pressure.
Browse editions · 84 days
NewerOlder
Agents & InferenceHacker News

AI-Assisted GPU Porting of a 250k Line Legacy Weather Simulation Code

Which summary reads better? Pick one — models revealed after.Both summaries are AI-generated.

Match the models (Optional)

Which model wrote which summary? Select a matchup mapping below before voting.

Summary A

An AI agent successfully ported a 250,000-line legacy Fortran simulation to GPUs, achieving a 5.1x application speedup by automating OpenACC transformations and validating 162 kernels against runtime state dumps. This proves that LLM-driven legacy code modernization is highly viable at scale but requires wrapping the agent in a strict, execution-based validation harness to catch the subtle floating-point and intrinsic-function discrepancies that static code generation misses. For teams shipping agentic refactoring tools, your engineering bottleneck is no longer code generation, but building the complex runtime infrastructure needed to reconstruct execution states and verify numerical precision.

Agents & InferenceSimon Willison

Qwen 3.8 27B is excellent, but it defaults to wildly overthinking things

Which summary reads better? Pick one — models revealed after.Both summaries are AI-generated.

Match the models (Optional)

Which model wrote which summary? Select a matchup mapping below before voting.

Summary A

Qwen 3.8 27B defaults to "xhigh" reasoning effort, burning 22k+ tokens and 21 minutes to generate a single SVG—20x slower than with reasoning off. This matters because it silently tanks throughput and spikes costs on consumer hardware; if you ship this in production, you’ll need to explicitly cap reasoning effort or risk unpredictable latency and token waste.

Agents & InferencearXiv

Inducing Reward-Free Judging Rubrics that Reduce Over-Crediting in Agent Evaluation

Which summary reads better? Pick one — models revealed after.Both summaries are AI-generated.

Match the models (Optional)

Which model wrote which summary? Select a matchup mapping below before voting.

Summary A

A new method cuts false-pass rates in LLM-as-judge evaluations by ~50% (0.115 vs. 0.173 on tau-bench) without touching model weights—just by evolving a human-readable rubric from a small set of labeled trajectories. This matters because every false pass ships a broken agent to production, so you can now deploy with half the risk of silent failures while keeping the same inference cost and latency. The rubric is frozen text, so you can audit or tweak criteria without retraining.

Agents & InferenceTechCrunch

Anthropic CEO says AI backlash is ‘fundamentally a crisis of trust’

Which summary reads better? Pick one — models revealed after.Both summaries are AI-generated.

Match the models (Optional)

Which model wrote which summary? Select a matchup mapping below before voting.

Summary A

Growing public and political resistance to AI data centers is actively bottlenecking the physical infrastructure needed to scale production models, compounded by impending safety and transparency regulations backed by major providers like Anthropic. For engineers running LLMs, this means the era of frictionless compute expansion is hitting hard physical limits, and generic wrappers will face resource starvation. To survive this shift, you must architect your systems to deliver undeniable, high-utility domain value that justifies their mounting infrastructure costs to skeptical public and regulatory stakeholders.

See who's winning the model face-off

Tomorrow's blind matchup and the running leaderboard — one email a day.

Takeaways written by GPT-5.5 — not one of this week's two contestants.