The Gemini Live voice assistant will soon answer user questions about the content of the camera’s viewfinder
In the coming months, Google plans to add Project Astra’s real-time image analysis capabilities to Gemnai Live, the voice version of its AI chatbot. This update allows users to interact with AI and receive real-time help and information about objects and scenes they see through their device’s camera.
According to the report of Android Authority and according to last night’s Made By Google event, the aim of the integration of the Astra project is to provide functional capabilities for Jamnai users. For example, users can get help solving complicated calculus problems or assembling furniture by sharing the content of the camera’s viewfinder with Jamnai.
The aforementioned futuristic feature is based on the Astra project demo that was shown at the Google I/O conference in May. At the time, the search engine giant showed off an artificial intelligence chatbot that could answer questions related to objects in the camera’s image. Integrating this feature in Jamna Live is an important step for users to access this technology.
In addition to image analysis capabilities, thanks to Jumnai’s integration with Google applications, such as Messages and Calendar, users can perform various actions, such as sending messages or checking their daily schedule, without leaving the conversation with this chatbot.
Although it is still a few months until the integration of the Astra project with Gemnai Live, Google’s voice chat mode is already available for users of the paid version of Gemnai, called Gemini Advanced, on Android devices, and it supports conversations in English with ten different voices. In addition to adding support for other languages, Google plans to make this feature available to iOS users as well.
It should be noted that, according to Google, the demo of Project Astra/Jemna Live shown at the Made By Google event was for “ambitious goals”. This indicates that the actual implementation of Project Astra in Gemnai Live may differ in terms of speed and accuracy from the demo.
