Microsoft’s latest Copilot updates include a mobile version of the Vision multimodal tool
By ForGeeks Microsoft has just unveiled a number of updates to its Copilot AI assistant, and some of them look really promising. One of the key updates was bringing Copilot Vision to mobile devices with the addition of new features. For those not in the know, this software was originally developed for the Edge web browser and allowed Copilot to “see” and comment on the content of websites.
The software was originally developed for the Edge web browser and allowed Copilot to “see” and comment on the content of websites.
Now Microsoft is improving the mobile version by introducing multimodal features. Copilot will be able to integrate with your phone’s camera, offering an “interactive experience with the real world.” The company says the software will be able to analyze both live video and photos stored on the device.
And it will be able to analyze both live video and photos stored on the device.
As an example, Microsoft demonstrates how Copilot Vision can analyze videos of plants, determining their health and offering care recommendations. We can only hope that it can indeed make such subtle inferences. Modern AI companies often promise a lot, but the reality may turn out to be different. Nevertheless, a mobile version of Vision is already available on the Copilot app for iOS and Android, and a web version will soon be available on Windows.
A mobile version of Vision is already available on the Copilot app for iOS and Android, with a web version coming soon on Windows.
Microsoft is also bringing Copilot Search to Bing to “seamlessly combine the best of traditional and generative search” to help users find the information they need. Bing is now positioned as “your AI-powered search and answer engine.” Like many AI-powered web search tools, it provides summaries of answers to queries.
Microsoft notes that results can be presented as a simple paragraph – similar to Google’s Gemini AI – and also include “images and data from your favorite publishers.” The Copilot Search feature is available now.
The company also introduced a new feature called Copilot Memory. It’s a step towards a more personalized user experience: after all, it’s hard to have a true AI-powered companion if they don’t remember anything about you. With this addition, Copilot will be able to remember important details about your life – like your favorite food, your movie preferences, or your nephew’s birthday.
Microsoft says the software will suggest actions based on your memories. For example, it will be able to help with buying tickets to events, ordering flowers or making restaurant reservations. The service will work with most websites on the internet – we’ll see how it’s implemented.
The update also includes additional tools: the ability to automatically generate podcasts on pre-set topics and provide shopping tips based on online sales history. These updates begin rolling out today, but may not affect all users at once. Microsoft promises to expand availability in the coming weeks and months.
