Microsoft’s latest Copilot update includes a mobile version of the multimodal vision tool
Microsoft has just announced a few updates to its Copilot AI Assistant and it sounds useful. It brings the vision of the secondary view to mobile devices, but has some new features. For beginners, the software was initially launched for the Edge web browser and enabled Copilot to “view” and comment on website content.
The company is offering gaming for the mobile version and has added some multimodal features. It will be able to integrate with your phone camera to “interactively experience with the real world.” Microsoft says it can analyze camera live videos and photos stored on the device
Microsoft has given examples of copy visual analysis of plant videos to determine whether they are healthy and recommends action. We’ll see if it can actually perform this subtle reasoning. Modern AI companies like to assure the world, and then, you know the rest. Anyway, a mobile version of Vision is available today in the Copilot app for iOS and Android. The network version will also be used for Windows.
Microsoft is bringing copy search to Bing to “seasonably blend the best of traditional and generative search to help you find what you need.” The company now calls Bing “your AI-driven search and answer engine.” Like most AI web search tools, this provides a summary of answering queries.
This could take the form of simple paragraphs, such as Gemini AI for Google searches, but it could also provide “images and data from your favorite publishers and content owners.” Copilot Search is launching today.
The company also introduced what is called a secondary copper memory. This is Microsoft’s attempt to bring more personalized co-pilot to Copilot. After all, it’s hard to have a true AI companion when it doesn’t remember you. With this addition, the deputy will be able to remember specific details about your life, such as “your favorite food, the type of movie you like and your nephew’s birthday and his interests.”
The company touts the software to recommend actions based on what it remembers. To this end, Microsoft said the side effects will be able to do things like buying event tickets, ordering flowers and booking dinners. It says the service will be “used with most websites on the web”. We’ll learn how it works.
The update brings some other tools to the table, such as the ability to automatically generate podcasts based on a specific topic and provide shopping advice based on sales history on the web. These updates are launched today, but may not hit every user. Microsoft said availability will expand in the coming weeks and months.
If you purchase something through the links in this article, we may earn commissions.
