Design & media · 2 November 2026

UX Collective outlines AI agents using onscreen context as interface

The article argues that the future of design will focus on how AI agents use onscreen context to interpret and employ app capabilities, illustrated with a scenario of checking a restaurant recommendation and scheduling a meeting.

Why it matters

Integrate onscreen context detection into your AI assistant so users can verify details and set times without leaving the conversation.

For product managers

For your product
What does this mean for your product?
Try it on your product

Get this every morning, written for your product.

Deltaday reads the whole AI news cycle and tells you what changed, whether it's real yet, and what to do about it.