Microsoft debuts Copilot Vision for Windows 10 and 11, offering real-time screen-aware AI help as part of its Copilot Lab program, initially in the US.

Microsoft will provide real-time assistance to users with their daily duties with the launch of Copilot Vision for Windows. It is intended to act as an extra pair of eyes for them, navigating, analyzing, and completing activities on their PC. It was created to become the standard companion app for daily tasks. It is comparable to Google's Gemini Live.

When you turn on Copilot Vision, it reads a blog post about the release and utilizes speech recognition to respond to questions about the page you are reading and offer suggestions for what to do next. It serves as a mechanism to enable customers to link Microsoft's Copilot virtual AI chatbot to their PC.

Copilot may view the user's screen and offer context-specific assistance once the feature is enabled. Users will be able to work with the AI and efficiently use their PC if they need to, for example, locate a button in a menu, either "ask" them questions concerning what they are seeing on their display, or run two different apps. Copilot Vision is now limited to Windows 10 and Windows 11 users in the United States.

Soon, the Redmond-based business intends to bring the new technology to additional non-European nations. It is a part of Windows' Copilot Lab, a pilot program that lets users test and access unreleased and beta features of Microsoft Copilot. Microsoft's efforts to make computing more personalized and engaging are demonstrated by this launch. The recently introduced tool is meant to be an opt-in, flexible, and user-controlled experience.