Microsoft begins testing Copilot Vision on Windows

Copilot Vision on Windows is rolling out to Windows Insiders. Well, we can't have enough AI, that's probably their motto at Redmond.

You may have heard about Copilot Vision on Microsoft Edge, which lets you browse with an AI. Well, Copilot Vision on Windows is similar. You can share your whole desktop with the AI, and it can see everything on the screen and talk to you about it. Microsoft says that this real-time conversation will help users analyze content, provide insights, answers, and even coach you.

This isn't like Recall, as in it won't be looking at your screen all the time. You will need to manually invoke Copilot Vision from the Copilot app. To do this, you have to click on the glasses icon.  A floating toolbar with Copilot Voice, Vision controls will appear, and a greeting will play. That is not unlike how the Hey Copilot wake word behaves when activated.

Hit the X button, or Stop, to end the desktop sharing process. It's similar to sharing your desktop screen. Users can also talk with the AI using their voice. This is fairly similar to what Google Gemini Live does.

Microsoft says that Copilot Vision can be used with any app (limited to 2 apps at a time), and it can assist users with various tasks like "making improvements to your creative project, help with improving your resume, or guidance while navigating a new game". Copilot Vision on Windows is rolling to users who have opted into the Windows Insider Channel, it is available in Copilot app version 1.25071.125 and higher. Here's the official support page for the feature. It says that only Copilot's responses are logged for monitoring of unsafe interactions and outputs. Microsoft says that it does not collect user inputs, images, page content, these are not logged or stored. The data is deleted after the "Voice Session" ends.

On a similar topic, Microsoft is testing a new Click To Do action called Describe Image, that lets you ask the AI to describe the contents in a photo.

Windows is looking less appealing with each AI-related announcement.

Thank you for being a ComTek4u TechTips reader. The post Microsoft begins testing Copilot Vision on Windows appears on ComTek4u TechTips. (via Ghacks)