Microsoft, the largest tech company, has announced a new update to its Copilot Vision, the AI tool for Windows. The AI assistant can view everything that’s on your desktop screen, meaning the user’s ongoing activity.
Previously, Copilot Vision could only view two apps at a time; however, with this significant upgrade, the AI assistant Copilot can now scan your entire desktop, including browser or app Windows, on your screen. This is indeed a significant leap by Microsoft in offering smart AI assistance and helping users understand the entire activity on-screen.
This feature, named “Desktop Share,” allows Copilot to offer real-time assistance. Let’s take an example, you want to edit your resume and make it an impactful one.
Open the Word document, share the Window with Copilot, and ask it to highlight your experiences. The Copilot will review the document and provide suggestions for edits. Similarly, you can work on creative design projects, coach users, provide insights, learn about different tasks alongside, and take suggestions for a new game you’re playing.
This new upgrade differs from Microsoft’s Recall feature, which automatically captures the background screen. Alternatively, Copilot Vision requires manual activation, allowing users to control what AI can do and when to turn it off.
How Does Microsoft’s Copilot Vision Work?
- To get started with desktop-wide scanning, click the glasses icon in the Copilot UI. To end the scanning instantly, click the Stop or X buttons. (Source)
Users in the Windows Insider program are receiving the update with version 1.25071.125 or higher, via the Microsoft Store. It is initially available in the market where Windows Vision Copilot is enabled, and for Windows users who have Windows 10 or Windows 11 on their devices.
Last year, Microsoft introduced Copilot Vision, an AI feature in Windows that can automatically check your activity while browsing Edge. Alongside, when you activate the feature, it uses voice to answer questions about the page it sees on your desktop and suggests the next step. However, now it can analyze content from your mobile phone’s camera, going above and beyond in its functionality.
Microsoft Expanding AI Possibilities
This feature illustrates Microsoft’s shift towards incorporating AI into all aspects of its offerings. Copilot Vision makes it easy to scan any content on your screen immediately and get the answers you need from the context.
Staying current with the trending news is the need of the hour! We’ve got you covered with this. Head over to our site now!
Also Read:
Brief Understanding About Microsoft Power Automate & Power Flow
Microsoft to launch Chromium-based browser. Is it the End of Microsoft Edge?
Everything You Need to Know About Microsoft’s LAM: Your Smart Assistant That Gets Things Done