AI descriptions for camera events in the Google Home app

AI descriptions is a new AI-powered feature available to select Home app users who meet eligibility requirements.

With Gemini’s generative capabilities, recorded camera events are given specific short and long descriptions. For example, instead of the usual “animal or activity detected” label, the AI-generated description may be ”the dog is digging in the garden.”

The detailed descriptions make it easier for you to search and review your recorded footage. Instead of tapping every recorded event to find out what happened, you can now easily search for an event using specific keywords.

Who can use AI descriptions

AI descriptions is currently rolling out to some Public Preview participants with a Nest Aware Plus subscription, on a limited basis. You also need to opt in to the terms of usage before you can use this feature.

Important:

AI descriptions is rolling out gradually and may not be available to you yet.
This feature will only be available on Nest cameras set up in Google Home App (launched in 2021 or later) and legacy cameras that have been migrated to the Home app.

This feature has limited language support. It is currently only available in the USA (English). This feature is not available in Illinois.

How to opt in for AI descriptions

To use AI descriptions, you must agree to the terms of usage and data sharing. To opt in:

Tap the Public Preview icon.
Activate the Experimental AI features button.

Note: This button will be grayed out if you don't have a Nest Aware Plus subscription or the feature is not available yet for you.
On the Terms page, read and scroll down tap Agree to give your consent. The Experimental AI features button is now on.

Another way to opt in is through in-app messages, like offers from your Home app Inbox or helpful interruptions. Just follow the on-screen steps after tapping Learn more.

Once you’ve opted in, all eligible experimental AI features will be available to you in the Home app. For a more detailed description of the opt in process, go to Public Preview for Google Home app.

How to opt out of experimental AI features

If for some reason you want to stop the use of experimental AI features, you may opt out and withdraw your consent.

Tap the Public Preview icon.
Slide to turn off the Experimental AI features button.
The Experimental AI features button is now turned off.

Once opted out, you’ll need to review and agree to the terms again if you decide to opt in at a later time.

How to view and use AI descriptions

All recorded camera events are available to check in the Activity tab, search history results, and the individual camera video history view in the Devices tab.

To go to your Activity tab and view the events:

Open your Google Home app .
At the bottom, tap Activity .

For example, you might get “Person leaving package on porch” or “Car parking.” To get a more detailed explanation of what happened in the recording, tap the information icon of an event.

To search for a specific recorded event, use the search box available in your Activity tab. You can type phrases like “recent delivery,” “unfamiliar visitor,” or even “garage door opening” to show all events with such descriptions.

For more information about searching camera events, go to Search camera history for the Google Home app.

Note:

When a single person is detected during a camera event, the AI caption and description might include their name if they're in your familiar face library.
When multiple people are detected, the caption and description won't include their names.
If you search your camera events for someone in your familiar face library, the results include any event when their face was detected, even if other people were there.

How to provide feedback

To improve AI descriptions, use the thumbs up and thumbs down feedback buttons for every description.

Tap the camera event that you want to evaluate (in your Activity history, camera events, or search results).
Tap the information icon.
A standard feedback question will be available under the detailed description. Tap either the thumbs up or thumbs down buttons.
If you want to provide more detailed feedback, tap Add feedback details.

Note: You must agree to the clip lending agreement before you can provide more feedback.
The Additional feedback prompt will appear. Answer all applicable questions. You can write on the text box to help explain your feedback.

Was this helpful?

How can we improve it?