Google Search's AI mode has been significantly improved, with support for content-based searches of images and PDF files.
Google has announced that it has added new features to its search page's '
AI Mode in Search adds Canvas, file upload, and more
https://blog.google/products/search/ai-mode-updates-back-to-school/
'AI Mode' is a search option available to Google users in the US, India, and the UK. By pressing the 'AI Mode' button and searching, the AI-powered search function will summarize search results and follow up with additional information. Unlike ' AI Summary ,' it answers questions with AI-generated answers based on information in the search index, giving it even greater access to real-time data than an AI chatbot.
Google is testing an 'AI mode' button on its search page - GIGAZINE
In AI mode, you simply enter a search term and the AI will provide a detailed answer, but on July 29, 2025, Google announced new features for AI mode.
The first new feature is the ability to upload images or PDFs and enter complex questions about those files. This feature was previously available on the Google app for Android and iOS, but is now also available on the browser.
It's easy to use: just drag and drop your files and enter your questions. Google says it plans to support additional file formats, including Google Drive files, in the coming months.
2/6 File uploads in AI Mode make it easy to ask questions about your homework or course materials. On desktop, you'll be able to upload images & PDFs – like lecture slides or class notes - to get a summary or go deeper with info from the web. pic.twitter.com/iIRxEd84Md
— Robby Stein (@rmstein) July 29, 2025
In addition, Search Live , which combines AI mode with Project Astra (Astra), an AI agent that understands video and audio and answers questions in real time, will be released in early August. Google explains, 'Using Search Live makes it feel like you're in contact with an expert who shares the same information you see and explains difficult concepts in real time.'
3/6 If you want to ask about a hands-on science project or what's in your textbook, Search Live with video input gives you an AI-powered learning partner that can see what you see. Just point your camera and have a real-time voice convo with Search – all with easy access to… pic.twitter.com/KAses1WmBX
— Robby Stein (@rmstein) July 29, 2025
The second new feature is the 'Canvas' feature. Canvas allows you to plan and organize information across multiple sessions. By entering what you want to learn and clicking 'Create with Canvas,' you can get an overview and plan for your studies. In combination with the file upload function, you can also customize your study plan from class notes and textbooks.
5/6 Finally, Canvas in AI Mode will soon help you build study plans, with info from the web as well as your own file uploads. It'll put everything together in the side panel, and you can use follow-ups to refine the output. It's great for schoolwork, but can also help with any… pic.twitter.com/blA1XMRO50
— Robby Stein (@rmstein) July 29, 2025
The third new feature is the ability to ask questions and learn about what you see while browsing, not just when you search on Google. Clicking on the Chrome address bar will display a button that says 'Ask Google about this page.' After clicking the button, you can select a sentence or image on a website and an AI explanation will appear in the side panel.
At the time of writing, users must join AI Mode Labs to try out the new features of AI Mode and Search Live. It is unclear when the new features will be available to general users or when AI Mode will be released in Japan.
Related Posts:
in Web Service, Posted by log1e_dh