The new version of Copilot was unveiled; Microsoft artificial intelligence, more advanced and modern than ever

Microsoft today unveiled extensive changes to the Kopilot smart assistant. By adding audio and visual capabilities, Copilot will become a more personal AI assistant. Copilot’s new features include a special mode for reading news headlines, the ability to view the content of your screen, and an audio feature for more natural interaction.

Copilot’s smart assistant is undergoing a major redesign across mobile, web, and dedicated Windows platforms to improve its user experience with a card-based approach and more closely resemble Inflection AI’s Pi personal AI assistant.

Microsoft earlier this year a number of Inflection AI experts including Mustafa Suleimanone of the founders of Google DeepMind and the current CEO of Microsoft’s artificial intelligence department. This is Suleiman’s first major impact at CoPilot after taking over the leadership role of Microsoft’s AI division.

The user interface of Copilot has undergone a significant evolution compared to previous versions of Microsoft and has a completely different look. This user interface elevates the user experience to a higher level with a warmer and more attractive design, especially on the personalized Copilot Discover screen.

Unlike simple text prompts in chatbots, Copilot Discover provides useful and relevant information to the user. Microsoft says it’s fully personalizing Copilot’s home page based on a user’s conversation history, and over time will enrich the page with useful searches, helpful tips, and relevant information.

Microsoft

Earlier this year, Microsoft handed over the version for regular users to Tim Suleiman to conduct more experiments in the field of personalization and creating personality traits for this smart assistant. Yusuf Mehdiexecutive vice president and senior director of consumer marketing at Microsoft, said in an interview with The Verge, “What we’ve learned from the Pi team and the professionals who have joined us from Inflection AI is that they always pay close attention to the details of our customers’ needs. “The way they listened and what they learned from the long conversations in this research has undoubtedly influenced what we’ve done.”

In addition to improving KoPilot’s appearance, Microsoft has taken great strides by adding ChatGPT-like voice capabilities. Now users can chat with Kopilot’s AI assistant, ask questions and even interrupt the conversation like a normal conversation with friends or colleagues. Copilot currently offers four different audio options.

Microsoft

Copilot Vision is the second big change that allows Microsoft’s AI assistant to see what you’re looking at on a web page. You can ask it questions about text, images, and page content and get natural answers combined with Copilot’s new audio features. For example, when shopping online, you can use Copilot Vision to receive product suggestions and let Copilot search for a variety of options for you.

Microsoft

Use of Copilot Vision is completely optional, and Microsoft emphasizes that no content is stored or used to train models. Copilot Vision isn’t available on all websites yet, as Microsoft has imposed restrictions on the types of websites that the feature works with. “We start with a limited list of popular websites to ensure the experience is safe and secure for all users,” says the Copilot team.

According to The Verge, Microsoft has clearly outlined a long-term vision for new audio and visual features in the CoPilot smart assistant. In one hands-on demonstration, Copilot Vision was used to analyze images of old handwritten food recipes. Copilot Vision is able to recognize the type of food and estimate its approximate cooking time. Microsoft also showed off a similar experience for Xbox games earlier this year, showing how Copilot can help users navigate games like Minecraft.

The next stage of Copilot development includes a new feature called Copilot Daily. This feature provides audio summaries of news and weather as if read by a professional news anchor. This summary is designed as a short clip that users can listen to in the morning.

Microsoft

The content of Copilot Daily is obtained only from reliable and authorized news and weather sources. Microsoft is initially working with news agency Reuters, Axel Springer and Hearst, and the Financial Times, with plans to add more news sources in the future.

Thanks to advanced OpenAI models, Copilot is able to answer more complex questions. The new Think Deeper feature allows CoPilot to spend more time processing complex questions and provide step-by-step and more detailed answers. This feature will be very useful especially for comparing two different options.

The Think Deeper feature is still in the early stages of development, and Microsoft has it in Copilot Labs. These labs are a space to evaluate new features that Microsoft develops.

The Copilot Vision feature will also initially be part of Copilot Labs, where users can share their thoughts on new experiences. Microsoft is taking a more cautious approach to Copilot Vision after the recall was criticized for security and privacy issues.

From today, the new Copilot will be available to users. The new Copilot can be accessed through the iOS and Android mobile apps, the copilot.microsoft.com website, and the Copilot Windows app.

Initially, the Copilot Voice feature will only be available in English in Australia, Canada, New Zealand, the United Kingdom, and the United States. However, there are plans to expand this feature to more regions and languages ​​in the future. The Copilot Daily feature will initially be limited to the US and the UK, and the Copilot Vision feature will initially be available to a limited number of Copilot Pro subscribers in the US.