Anthropic Introduces Message Threads, Cutting First‑Token Latency 35% for Long Chats

Anthropic’s public‑beta Message Threads feature lets Claude agents send only the changed portion of a conversation, cutting time‑to‑first‑token by roughly 35 % for requests of 500 k–1 M tokens. Token usage stays the same, the thread memory is encrypted and expires after five minutes, and the feature is available on Claude, AWS, Microsoft Foundry and Google Cloud.

Benchmarks are the company's own; not independently verified.

Why it matters

Benchmark Claude’s Message Threads latency for long‑context features; a 35 % first‑token speedup may shift performance expectations.

For product managers

For your product

What does this mean for your product?

Try it on your product

Read at The Decoder

More from this issueAll AI news from 4 Nov →

Google disables Search for K‑12 schools that reject its AI features

Toyota unveils 16nm SoC with STT‑MRAM that boots in 65.7 ms

Soket Labs and ZenteiQ launch EKA-1 and Dhīr models under IndiaAI Mission

Qwen 3.8 27B runs weight‑space programming on laptopResearch

Get this every morning, written for your product.

Deltaday reads the whole AI news cycle and tells you what changed, whether it's real yet, and what to do about it.

Request an invite See how it works