Microsoft is set to release a suite of new AI-driven features for Windows 11, centered around the Copilot assistant. The update includes Copilot Vision, a tool capable of scanning and analyzing content displayed on the screen, including real-world objects. Users will be able to interact with the AI to get information about the analyzed content, streamlining the process of gathering information and simplifying daily tasks.
The rollout of these features will be gradual, ensuring a smooth integration for all users. Copilot Vision will be accessed through the Copilot application, allowing users to analyze content from various sources. In addition to content analysis, users can utilize Copilot to complete tasks on their PCs, such as adjusting the lighting in photos.
Microsoft’s recent research indicates significant adoption of generative AI for both professional and personal uses, and the new features are aimed at seamlessly integrating AI into everyday PC usage, simplifying workflows and improving productivity.
Copilot Plus PC users, especially those with Snapdragon-powered devices, will be able to access the AI agent directly from the Settings app. A key feature is the ‘Click to Do’ preview, which enables users to summarize paragraphs, enhance reading fluency and pronunciation. Other additions include an AI-powered sticker generator in Paint, an object selection tool for detailed image editing, an AI lighting option in Photos, and a precision screenshot tool that uses AI.
Most of these enhancements will begin rolling out in August, alongside additional updates such as a color picker for the Snipping Tool and an automatic fix for issues that cause unexpected restarts.