Google Lens now supports video and voice search
By ForGeeks Google has added video and voice search capabilities to Google Lens, first introduced this May at the I/O 2024 conference. Users can now simply press a button and ask questions by voice, making the search process even more convenient and accessible.
Google Lens is now available to users.
Video search using Google’s Gemini model
.
The video search feature in Google Lens uses the customizable Gemini model. Google is now rolling out the feature via Search Labs on devices running Android and iOS. However, voice search is currently only available for queries in English.
Android and iOS.
The new feature allows users to get AI overview and search results based on video content and questions asked. In a demo video shown at the I/O conference, Google showed an example where a user sees fish in an aquarium, points the phone at the exhibit, opens the Google Lens app and holds down the shutter button. Once the recording starts, the user can ask a question, such as “Why are they swimming together?”, and Lens responds with Google Gemini.
Google Lens.
Smart Search with Video
The ability to search through video can show your phone how objects are moving and ask questions about what’s going on, making Google Lens much more useful in a number of situations. To take advantage of this feature, users can join an experiment “AI Overviews and more” at Search Labs.
For those wondering how the feature works, Rajan Patel, vice president of engineering at Google, explained that the video is recorded as a series of frames, after which the same computer vision techniques already used in Lens are applied. However, the Gemini model developed by Google can understand multiple frames in a sequence to provide accurate answers. After processing the frames, the model uses information from the internet to generate an answer.
Gemini.
The introduction of voice and video search in Google Lens is a great use of existing technology that adds value to the app and makes it even more versatile and useful in everyday scenarios.
