Microsoft’s Copilot Vision can now see and analyze your entire PC screen – not just what’s in Edge
Lance Whitney / Elyse Betters Picaro / ZDNETMicrosoft has expanded the powers and reach of its Copilot Vision AI to help you with all types of content. In a blog post published Thursday, the company revealed that Copilot Vision is now baked into the Copilot Windows app, where you can ask it to analyze and answer questions about any item on your screen.A big leap forwardAvailable in the US for Windows 10 and 11 and coming soon to other non-European countries, Copilot Vision on Windows acts as a virtual companion, providing another set of eyes to help you with files, apps, and other items displayed and shared on the screen. You can ask it to analyze or summarize the content or respond to any questions about it. Not sure how to use a specific application? With the Highlights option, you’re able to ask Copilot how to accomplish a certain task. The AI will then show you where to go and what to do. Also: 8 ways I use Microsoft’s Copilot Vision AI to save time on my phone and PCFor example, maybe you’re playing a game and are stuck at a certain level. Ask Copilot Vision for tips on how to proceed, and it will nudge you along. Perhaps you’re viewing a photo in a program like Adobe Photoshop Elements and are wondering how to improve the lighting. Ask Copilot Vision for advice, and it will explain the specific steps to follow in Photoshop Elements. You can even share two apps or files at a time, and Copilot Vision will connect the dots between them. For example, you might share both your calendar and a web page of interesting events and ask the AI to find dates when you’d be free to attend the events you like. Copilot Vision will find a suitable date and even talk you through the steps to add the event to your calendar. This latest skill is a big leap forward for Copilot Vision. Previously, the desktop version of the tool worked only in Edge and could only analyze and answer questions about your current web page. Now anything you open in Windows is available for you to share with Copilot. How to try itIn Windows 10 or 11, open the Copilot Windows app. More