Microsoft is expanding the capabilities of Windows 11 by integrating a range of new AI features accessible through Copilot. Copilot Vision is a key component, designed to scan and interpret content visible on the user’s screen. This includes the ability to analyze what is displayed across multiple applications and web pages. Users can then pose questions about the content or task Copilot to perform actions like improving photo lighting. The deployment of these features will be phased, with some exclusively available to Copilot Plus PCs. A Microsoft-commissioned report indicates that a significant percentage of people are already leveraging generative AI for a variety of professional and personal projects. Windows aims to make routine PC tasks easier through these AI-powered enhancements. The Settings app will provide access to the AI agent for users with Snapdragon-powered Copilot Plus PCs.
A new feature is the “Click to Do” preview, available to Copilot Plus PC owners, enabling functions such as paragraph summarization and reading fluency improvements by using the Windows key and left-clicking on elements on the screen. Further, the update includes an AI-powered sticker generator for Paint, an object selection tool for image editing, an AI-enhanced lighting feature for Photos, and an AI-assisted tool for perfect screenshots. The rollout is planned for August and includes additional updates, such as a color picker for the Snipping Tool and a feature that attempts to automatically address problems that cause unexpected PC restarts.