Google’s annual I/O developer conference unveiled a plethora of new AI-powered features and products, showcasing the company’s commitment to leading in the AI space. With “AI” mentioned over 120 times during the keynote, here are the standout announcements from Google I/O 2024.
Generative AI in Search
Google is transforming search results pages using generative AI to create more organized and informative outputs. Depending on the query, users might see AI-generated summaries of reviews, discussions from platforms like Reddit, and lists of suggestions. Initially, AI-enhanced results will focus on travel planning, dining options, and recipes, with plans to expand to movies, books, hotels, and e-commerce.
Project Astra and Gemini Live
Google’s AI chatbot, Gemini, is getting a significant upgrade with Gemini Live. This new feature allows users to engage in “in-depth” voice chats on their smartphones. Gemini can now see and respond to surroundings via photos or video captured by the device’s camera. Expected to launch later this year, Gemini Live, powered by Project Astra, will answer questions about objects within view, such as identifying neighborhoods or parts of a broken bicycle.
Google Veo
Challenging OpenAI’s Sora, Google introduced Veo, an AI model capable of creating 1080p video clips up to a minute long from text prompts. Veo can generate various visual styles, including landscapes and time lapses, and understand camera movements and physics for realistic video creation. It also supports masked editing and can generate videos from still images.
Ask Photos
Google Photos is integrating an AI feature called Ask Photos, powered by Gemini. Launching this summer, Ask Photos will enable users to search their photo collections using natural language queries. This AI can identify the “best” photos based on lighting, clarity, and metadata, and perform complex searches like finding the best photo from each visited national park.
Gemini in Gmail
Gmail will soon leverage Gemini AI for enhanced functionality, including summarizing and drafting emails, and handling more complex tasks like processing returns. A demo showcased Gemini summarizing all recent emails from a child’s school, including analyzing attachments. Users can also organize receipts and automate workflows.
Detecting Scams During Calls
An upcoming Android feature will use AI to detect potential scams during calls. Gemini Nano, the smallest version of Google’s AI, will listen for scam-associated conversation patterns in real-time. This feature, which is opt-in, aims to enhance user security without compromising privacy, as it operates entirely on-device.
AI for Accessibility
Google’s TalkBack accessibility feature is getting a boost with generative AI. Using Gemini Nano, TalkBack will provide aural descriptions of objects for low-vision and blind users. This includes detailed descriptions of images, potentially reducing the need for manual labeling.
Google TV Enhancements
Google TV will now feature AI-generated descriptions for movies and TV shows, filling in missing information and translating descriptions into viewers’ native languages. This personalization makes content more accessible and engaging.
Private Space Feature
A new Android feature, Private Space, will allow users to create a secure area within their device for sensitive information. Similar to Incognito mode, this container can be locked and will hide apps from notifications and settings, providing an extra layer of privacy.
Geospatial AR in Google Maps
Google Maps will soon feature geospatial augmented reality (AR) content, starting with pilot programs in Singapore and Paris. Users can access AR content by searching for locations and activating the “AR Experience.” This feature will also be available in Street View for remote exploration.
Wear OS 5
The new version of Google’s smartwatch operating system, Wear OS 5, promises improved battery life and performance. Developers can expect updated tools for creating watch faces and new versions of Wear OS tiles and Jetpack Compose for building apps.
Enhanced Security Features
Google announced new security and privacy protections for Android, including live threat detection and safeguards against malicious apps. The Theft Detection Lock feature uses AI to identify theft-associated movements and automatically lock the device.
New AI Models: Imagen 3 and Veo
Google introduced Imagen 3, a powerful text-to-image model, and Veo, an AI for video generation. Imagen 3 promises fewer artifacts and more lifelike images, while Veo can create videos over a minute long and understand natural language and visual semantics.
AI in Learning: LearnLM
Google unveiled LearnLM, generative AI models designed for educational purposes. These models can tutor students conversationally and help teachers with lesson planning. LearnLM is being piloted in Google Classroom.
Future Vision: Project Astra
Project Astra aims to create a multimodal AI assistant that can process text, video, and audio in real-time. Demonstrated on smartphones and tech headsets, Astra can identify objects, explain them, and generate creative outputs.
AI for Developers: Firebase Genkit
Google introduced Firebase Genkit, an open-source framework to help developers build AI-powered applications quickly. It supports content generation, text translation, and image creation, making AI integration more accessible.
Google’s AI Chips: Trillium
The sixth generation of Google’s Tensor Processing Units (TPU), dubbed Trillium, promises a 4.7x performance boost. These chips will enhance AI processing power and efficiency, catering to the growing demand for AI capabilities.
With these groundbreaking announcements, Google I/O 2024 solidifies Google’s position at the forefront of AI innovation, paving the way for more intelligent, secure, and accessible technology.
Like this article? Keep up to date with AI news, apps, tools and get tips and tricks on how to improve with AI. Sign up to our Free AI Newsletter
Also, come check out our free AI training portal and community of business owners, entrepreneurs, executives and creators. Level up your business with AI ! New courses added weekly.
You can also follow us on X