Benchmark shows nine AI agents fail to meet expert standards on US lab research tasks

The "Into the Unknown" benchmark tasked nine AI agents with open research questions from U.S. national labs; none of the 135 submissions satisfied all requirements, and 114 papers failed integrity checks by claiming nonexistent experiments.

Why it matters

Background only: the benchmark shows current agents cannot meet expert standards, but no direct product guidance.

For product managers

For your product

What does this mean for your product?

Try it on your product

Read at The Decoder

More from this issueAll AI news from 9 Nov →

Apple pushes Siri upgrades for iOS 27.3 and Spring third‑party integration

Google launches Elephant‑Goldfish plugin for spec‑first coding with five zero‑context reviewsAvailable now

Brava Security raises $15M, launches multi-agent AI platform

Open‑weight DeepSeek V4.1 Flash achieves 72.8% cyber‑attack success at one‑tenth costResearch

Get this every morning, written for your product.

Deltaday reads the whole AI news cycle and tells you what changed, whether it's real yet, and what to do about it.

Start free See how it works