Google began rolling out new capabilities for AI Mode in Search to U.S. users on 14 May 2024. The update introduces document uploads, a planning workspace, live video queries, and deeper Chrome integration.
What's new
The features are arriving first for participants in Search Labs and will expand in the coming weeks.
- Image and PDF uploads on desktop. Search boxes now accept image attachments. Google says PDF support will follow within weeks.
- Canvas workspace. Typing “Create Canvas” launches a board where users can build and refine plans such as study guides or travel itineraries.
- Search Live in Google Lens. Mobile users can converse with AI Mode while streaming real-time video through the new “Live” option.
- Chrome page summaries. An “Ask Google about this page” command delivers AI overviews of highlighted content, with follow-up questions handled in the Lens panel or AI Mode.
Google adds that broader file-type support and Google Drive integration are planned "in the months ahead."
Background
AI Mode first reached testers in May 2023 under the Search Generative Experience. Since then, Google has added code understanding and multimodal input.
The new Search Live capability builds on Project Astra, unveiled at Google I/O 2024. Canvas relies on session memory similar to NotebookLM.
Source citations
- Google Search Labs
- AI Overviews in Search - 14 May 2024
- Project Astra - 14 May 2024
Inside Google's Universal Commerce Protocol that lets AI agents tap carts, catalogs and loyalty pricing
Google quietly upgrades AI shopping protocol: what Cart, Catalog and Identity Linking change next
Google and DocMorris Launch AI Health Companion for Europe - What Changes Next
Worried About Endless 404 Reports In Search Console? John Mueller Reveals What They Really Mean.svg)
