Android 15’s Gemini AI assistant can answer questions about anything on your screen

Made by Google at CES

With the arrival of Android 15, Google continues infusing AI into just about every layer of its tech stack, from the data center all the way to mobile devices. In this latest Android version officially launched today, Google has rebuilt its mobile operating system with its AI digital assistant at its core, to redefine what your phone can do.

Also: Everything announced at Made by Google 2024

At the heart of Android is Gemini, which now allows you to speak to your device in a more natural way, as though you were having a conversation with another person. According to Google, Gemini can understand your intent, follow your train of thought, and even complete complex tasks.

With the release of Android 15, you'll be able to bring up Gemini's overlay on top of any app you're using to ask questions about what's displayed on the screen. For example, if you're watching YouTube, you can ask Gemini questions about the given video. You'll even be able to generate images from the overlay and then drag and drop them into the likes of Gmail and Google Messages.

Google stresses that it is taking the privacy of your personal information seriously. If you give Gemini permission, the chatbot will connect your personal data with the vast stores of Google information to accomplish things such as generating a daily workout routine based on communications with a trainer or writing a work summary based on a resume stored in Google Drive.

Android 15 is the first-ever mobile OS to include an on-device multimodal AI model, called Gemini Nano, so your more sensitive information never has to leave your phone. (Apple's AI suite — Apple Intelligence — is expected to bring on-device AI to iOS 18 later this year.)

Also: Google Pixel 9 Pro XL hands-on: I'm reminded of the iPhone, but in the best way

Google has also tailored Gemini for the various Android form factors, such as slab smartphones and foldables. For example, on foldables like the Samsung Galaxy Z Fold 6, you'll be able to use Gemini in a multi-window, split-screen, mode for multitasking. With phones like the Motorola Razr+, you'll be able to bring up Gemini from the external display to summarize your emails, without having to open your phone.

Google is releasing Android 15 today, August 13, along with the Pixel 9, Pixel Buds Pro 2, and Pixel Watch 3.

Google

0 0 votes
Article Rating
Subscribe
Notify of
guest
0 comments
Oldest
New Most Voted
Inline Feedbacks
View all comments