At the recent Google I/O 2024 event, held on Tuesday, AI stole the spotlight once again. Google unveiled its latest Gemini 1.5 language model and introduced a new text-to-video generator, along with a fresh AI voice assistant. However, the announcements were not limited to AI advancements; Android enthusiasts had much to look forward to as well. Google revealed plans to infuse several AI capabilities into its operating system, including the introduction of the Gemini Nano model and updates to Circle to Search, Google Photos, and more.
Here are the top five features heading to Android phones:
Enhanced Homework Assistance with Circle to Search: Originally introduced with the Pixel 8 series and later extended to the flagship Samsung Galaxy S24 series, Circle to Search is now getting a significant upgrade. Google aims to empower students by providing step-by-step guidance for solving various physics and math problems through this AI feature. While already available on over 100 million devices, Google hints at expanding this feature's reach to more devices in the future.
Major Boost for Gemini Nano: Google announced a significant enhancement for Gemini Nano, its lightweight on-device AI model. The new Gemini Nano 1.0 boasts multimodal capabilities, enabling it to comprehend sights, sounds, spoken words, and text prompts. This updated AI model will debut with the Pixel 9 series later this year.
AI-Powered Scam Protection:
Leveraging the multimodal abilities of Gemini Nano, Google plans to offer real-time scam alerts to users. This opt-in feature ensures privacy, as conversations remain on-device. Users will have the discretion to activate this AI tool manually, and Google assures that on-device AI will uphold privacy standards.
Gemini's Enhanced Role on Android:
Gemini will now leverage on-screen content to enhance user experiences. It will overlay on existing apps, providing answers related to the current content. For example, users can ask Gemini questions about a video or insert AI-generated images directly into Google Messages or Gmail.
Introduction of New AI Assistant Capabilities:
Google introduced a new AI agent dubbed 'seeing and talking' under Project Astra. This agent, built on Gemini, offers a glimpse into Google's vision for a future AI assistant capable of real-time interaction on phones or Glasses. Demonstrated in a video, the AI assistant showcases abilities like identifying codes, locating objects, and even suggesting creative dog names through a mix of visual and audio cues. Google promises to integrate some of Project Astra's capabilities into the Gemini app and web experience later this year.
Google I/O 2024 Promises Surprises in AI and Pixel Lineup