Tech News

Microsoft Introduces New AI Features to Copilot

Highlights

Microsoft is adding voice and vision capabilities to its Copilot.
New features will allow users to interact more naturally and efficiently.
Will introduce more personalised features like Copilot Voice and Copilot Daily.
Copilot Vision helps users interact with web content in real time, interpreting text and images.
Introduced Think Deeper for complex questions.
Copilot Labs for user feedback and further development before a wider release.

Microsoft announced new Copilot features in a blog post titled “An AI companion for everyone”. (Image credit – Microsoft)

Microsoft is rolling out significant updates to its chatbot, Copilot. It is adding AI-powered voice and vision capabilities. These updates announced recently via the Microsoft blog aim to make Copilot more intuitive, efficient and accessible, “creating an AI companion for everyone”. It will provide faster and more natural responses.

The new Copilot Voice feature is similar to the voice modes in Gemini Live and ChatGPT. Moreover, the Recall feature will now be available to all Windows Insider users this month.

In the blog post, Mustafa Suleyman Executive Vice President and CEO of Microsoft AI said, “Copilot will be there for you, in your corner, by your side and always strongly aligned with your interests. It understands the context of your life, while safeguarding your privacy, data and security, remembering the details that are most helpful in any situation. It gives you access to a universe of knowledge, simplifying and decluttering the daily barrage of information, and offering support and encouragement when you want it.”

Today we’re launching our new Copilot experience. I truly believe we can deliver a calmer, more helpful and supportive era of technology, with a Copilot that is now more intuitive, more personalized, and secure. Learn more, download, and enjoy.

At Microsoft AI, we are creating… pic.twitter.com/gxY1DgwNzV

— Mustafa Suleyman (@mustafasuleyman) October 1, 2024

Microsoft Copilot Team further explained, “Our refreshed Copilot is focused on delivering a more intuitive design with more digestible, speedy and fluent answers. It now adapts to you with a warm tone and a distinct style, providing not only information but encouragement, feedback and advice as you navigate life’s everyday challenges — no matter how big or small. For example, in addition to helping you plan that big trip, it can also offer tips on how to keep your composure when, say, the back of your seat is getting kicked by a small child.”

Microsoft Copilot Updated With AI-Powered Features

In a new blog post on its official website, Microsoft has shared details of the new AI features coming to Copilot. These features will be available on the Copilot app on iOS and Android, the web client as well as the Copilot assistant on Windows.

The latter will only be available on the Copilot+ PCs, which are currently powered by the Snapdragon X series chipsets.

Key Updates Announced for Copilot’s Next Phase

Copilot Voice

Users can now interact with Copilot using voice commands. It will make it easier to brainstorm, ask quick questions, or simply vent. It offers four voice options and allows a more personalized experience.

Copilot Daily

This feature helps users start their day with a summary of news and weather. Everything will be delivered in the chosen Copilot voice. Copilot Daily pulls content from authorized sources like Reuters, USA TODAY, and Financial Times. It plans on adding more partners and personalisation options.

Personalised Discover Cards

This feature provides a guide to Copilot’s useful functions and conversation starters. It customises the AI features based on users’ interactions with Microsoft services and conversation history.

Copilot in Microsoft Edge

Image: Microsoft

Copilot will be Integrated directly into the Edge browser. It will be able to answer questions, summarise web pages, translate text, or rewrite sentences. Microsoft is making is easily accessible by typing “@copilot” into the browser’s address bar.

Copilot Labs

Image: Microsoft

Microsoft is introducing experimental features through Copilot Labs. Users will be able to use this new feature to try new tools and provide feedback.

Two new features are launching in Labs:

Copilot Vision: This will allow Copilot to see and interpret the content of web pages. It will include both text and images. Copilot Vision can answer questions, suggest next steps, and provide assistance without disrupting workflow.
Think Deeper: It is designed to help with more complex questions. This feature provides step-by-step reasoning for detailed queries. It’s still in development and currently available in Copilot Labs for testing and feedback.

Microsoft emphasizes that safety and privacy are central to these new features. Copilot Vision ensures user data is discarded once a session ends.

The company plans to refine the tools based on user feedback before a broader release.

More announcements in the Microsoft blog include –

Initially available in English in Australia, Canada, New Zealand, the United Kingdom and the United States, Copilot will expand to more regions and languages soon.
Copilot Daily is rolling out in the United States and the United Kingdom with more countries coming soon.
Personalisation in Copilot follows our Microsoft Privacy Statement, and people can opt out at any time in Settings.
Microsoft is finalising options for offering personalization to users in the European Economic Area and the United Kingdom.
Copilot Vision is rolling out to Copilot Labs soon and will be available to a limited number of Copilot Pro subscribers in the United States.
Think Deeper starts to roll out this week through Copilot Labs to a limited number of Copilot Pro users in Australia, Canada, New Zealand, the United Kingdom and the United States.

FAQs

Q1. What new capabilities has Microsoft Copilot added recently?

Ans. Microsoft Copilot has added voice and vision capabilities, allowing for two-way verbal conversations and image recognition.

Q2. How does Copilot Voice work?

Ans. Copilot Voice enables users to have verbal conversations with Copilot, similar to ChatGPT Voice Mode and Gemini Live.

Q3. What is Copilot Discover?

Ans. Copilot Discover provides personalized suggestions and guides to help users get started with Copilot, based on their use of other Microsoft services.

Q4. What improvements have been made to Copilot’s interface?

Ans. Copilot’s interface has been redesigned to be more user-friendly and card-based, with a personalized Copilot Discover page.

Q5.What are the Key Features of Microsoft Copilot ?

Ans. Natural Language Processing (NLP): Copilot understands and generates human-like text, allowing users to interact with it using everyday language. This feature simplifies tasks like drafting emails, creating documents, or generating summaries from large blocks of text.

Data Analysis and Visualization: In applications like Excel, Copilot can automatically analyze data and provide insights, create complex data visualizations, and even suggest ways to optimize data layout for better understanding and presentation.

Content Creation: Whether it’s drafting a blog post in Word or designing a presentation in PowerPoint, Copilot assists by suggesting content based on the input you provide. It can write sections of text, suggest design layouts, and recommend images or themes that align with your content.

Workflow Automation: In Outlook, Copilot can help manage emails by summarizing email threads, drafting responses, and prioritizing emails based on urgency and relevance. This automation extends to scheduling and managing meetings, thus freeing up valuable time for users.

Integration and Customization: Copilot is designed to seamlessly integrate with the tools within the Microsoft ecosystem, enhancing the functionality of each tool while providing a unified experience across apps.

Q6.What are the Benefits of Microsoft Copilot in the Workplace ?

Ans. Increased Productivity: By automating routine tasks and streamlining complex processes, Copilot allows professionals to focus on higher-value activities, significantly boosting productivity.

Enhanced Creativity: With AI-driven suggestions for content and design, users can explore new creative possibilities without the initial heavy lifting that often hampers the creative process.

Improved Decision Making: Copilot’s ability to analyze data and provide actionable insights helps professionals make informed decisions faster and with greater confidence.
Accessibility and Inclusivity: The intuitive nature of Copilot’s interface, combined with its ability to understand natural language, makes technology more accessible to people with diverse skill sets and abilities.