Google launches real-time screen and camera analysis for Gemini
By ForGeeks Google’s artificial intelligence is being taken to the next level, with Gemini now able to analyze a smartphone or camera screen image in real time and answer questions about it. These capabilities have already started to appear for some Google One AI Premium subscription users, as confirmed by company spokesperson Alex Joseph in a comment to The Verge.
The first users are already testing the novelty: a post demonstrating how the feature works on a Xiaomi smartphone appeared on Reddit 9to5Google. In the published video, Gemini reads screen content and provides on-the-fly explanations, one of the features that Google announced back in early March, promising their imminent launch for subscribers of Gemini Advanced.
Another important tool that has already started to proliferate is real-time video stream analysis. It allows Gemini to take a smartphone camera image and make instant recommendations. In a demo, Google showed a user selecting a paint color for a ceramic piece by consulting the AI in real time.
The move underscores Google’s technological leadership in AI assistants, especially against the backdrop of its competitors. While Amazon is just getting ready to launch the updated Alexa Plus, and Apple is delaying the release of the improved Siri, Google is already rolling out cutting-edge features. Even Samsung, which has its own voice assistant Bixby, uses Gemini by default on its devices.
