Google began rolling out new capabilities for AI Mode in Search to U.S. users on 14 May 2024. The update introduces document uploads, a planning workspace, live video queries, and deeper Chrome integration.
What's new
The features are arriving first for participants in Search Labs and will expand in the coming weeks.
- Image and PDF uploads on desktop. Search boxes now accept image attachments. Google says PDF support will follow within weeks.
- Canvas workspace. Typing “Create Canvas” launches a board where users can build and refine plans such as study guides or travel itineraries.
- Search Live in Google Lens. Mobile users can converse with AI Mode while streaming real-time video through the new “Live” option.
- Chrome page summaries. An “Ask Google about this page” command delivers AI overviews of highlighted content, with follow-up questions handled in the Lens panel or AI Mode.
Google adds that broader file-type support and Google Drive integration are planned "in the months ahead."
Background
AI Mode first reached testers in May 2023 under the Search Generative Experience. Since then, Google has added code understanding and multimodal input.
The new Search Live capability builds on Project Astra, unveiled at Google I/O 2024. Canvas relies on session memory similar to NotebookLM.
Source citations
- Google Search Labs
- AI Overviews in Search - 14 May 2024
- Project Astra - 14 May 2024
.svg)
.svg)
.svg)