Microsoft Upgrades Copilot with Web Actions, Memory, and Real-Time Video Analysis

For its 50th anniversary, Microsoft has introduced major upgrades to Copilot, enhancing its web capabilities, memory, and interaction with real-world visuals.

Key Upgrades: Web Actions & Automation Copilot can now book tickets, reserve restaurants, and complete tasks on many websites. Partners include Expedia, OpenTable, Booking.com, and more. It can track online deals and notify users of price drops. Memory & Personalized Assistance Copilot can now remember user preferences, similar to ChatGPT. Users can delete specific memories or opt out entirely for privacy control. Real-Time Video & Screen Analysis On Android & iOS, Copilot can analyze live camera feed or gallery images (e.g., identifying objects or flowers). On Windows, it can interact with desktop screens to search, organize files, and adjust settings. Enhanced Content & Research Features Podcasts: Generates AI-hosted dialogues summarizing articles or studies. Pages Function: Organizes research, akin to ChatGPT Canvas and Claude Artifacts. Deep Research: Analyzes online sources, documents, and images for complex queries. Looking Ahead Microsoft is reportedly working on revamping Copilot with more in-house AI rather than relying on OpenAI models. The Windows Insiders program will receive the first rollout of these updates next week. While the new features show promise, questions remain about potential privacy risks and accuracy in task execution. Microsoft assures users they remain in full control of Copilot’s memory and data.