It’s been an exciting year for Google Home as we continue enhancing our smart home experiences for both users and developers. At Google I/O, we opened our platform, giving developers tools to create new and innovative experiences for the home. While we were making the smart home better, Google’s Gemini models were unlocking new ways to help people in their daily lives.

Today, we’re reinventing two of our most iconic and beloved devices with our newest Nest Learning Thermostat and the new Google TV Streamer. And we’re thrilled to unveil how we’re using Gemini models to make our devices smarter and simpler to use than ever, starting with cameras and home automation. We’re also using Gemini models to make Google Assistant much more natural and helpful on your Nest speakers and displays.

Supercharging your Nest Cameras and Google Home experiences with Gemini

Security cameras have become an important part of our daily lives in helping us keep our family safe and secure. Over time, cameras across the industry have gotten smarter — from simple motion detection, to people and package detection, to more advanced AI features like familiar face detection unique to our Nest cameras. But even with these AI improvements, it can be hard to truly understand what is happening in and around your home.

With Gemini multimodal models that can process video, images and text we’re now able to redefine camera intelligence for the industry. Over time, your Nest cameras will go from understanding a narrow set of specific things (i.e., motion, people, packages, etc.) to being able to more broadly understand what it sees and hears, and then surface what’s most important.

This means that your camera can understand that it isn’t just an “animal detected” in the video, but it will understand that “the dog is digging in the garden.” With these new AI descriptions, Gemini models are making your camera clips in the Google Home app far more useful.

You can also use the new camera activity search in the Google Home app to find exactly what you are looking for in your home. For example, “Did the kids leave their bikes in the driveway?” Google Home can search through your camera history, giving you a list of only the relevant events and a helpful summary. That simply wasn’t possible before. The sky’s the limit for what you can ask, “Did the FedEx truck drive by today?” or “Did my dog go near the cookies?” This will be a monumental shift for Nest cameras and will transform how you get help in your home. And we do all of this while ensuring your data is safe and private, consistent with our principles.