Google has introduced a new update to its search engine that enhances the AI mode to analyze and understand images. Now, users can upload or capture a photo and ask questions about it. The AI will provide accurate answers along with helpful links for more information.
Understanding the Whole Picture
According to Google, the updated AI mode can now comprehend an entire image. It understands objects, their relationships, size, position, and other visual details. This feature is an expansion of the AI mode in “Search Labs” that first launched in March for Google One AI Premium users. Now, Google is making it available to millions of users in the United States.
Powered by Gemini 2.0 AI Model
The new AI mode uses a customized version of Google’s Gemini 2.0 AI model. This makes it more powerful and capable of handling deep and complex questions. Users can now ask multi-part or detailed queries and get interactive and thorough responses.
More Complex, Open-Ended Questions
Google reports that the questions asked in AI mode tend to be longer and more exploratory than regular searches. People use it to ask open-ended questions, compare products, plan trips, and complete complex tasks.
New Tab in Google Search
The AI mode will appear as a separate tab in Google Search, alongside the regular options like Images, News, and Videos. This tab will use a technology called “Query Fan-Out.” It collects information from multiple topics and data sources at once to provide one well-structured answer.
Integrated with Google Lens
The feature is built into the Google app and works together with Google Lens. This gives users a smarter multimedia search experience. For example, taking a photo of a product will let the AI recommend similar items. The feature is now available for Android and iOS users via the Google app.
