https://support.google.com/gemini/answer/16836988
“[Gemini app activity] is used to improve Google services for everyone, including by training generative AI models, if your Keep Activity setting is on.“
https://support.google.com/gemini/answer/13594961?hl=en#human_review
“A subset of chats are reviewed by human reviewers”
https://support.google.com/gemini/answer/13594961?hl=en#pn_retain_data
“Chats reviewed by human reviewers [...] are not deleted when you delete your activity. Instead, they are retained for up to three years.”
https://support.google.com/gemini/answer/13594961?hl=en#pn_data_usage
“Please don’t enter confidential information that you wouldn’t want a reviewer to see or Google to use to improve our services, including machine-learning technologies.”
To disable their training on your chat sessions, you need to turn off “Keep Activity” in Gemini’s settings. Turning that off means you’ll lose any chat sessions after 72 hours.
I learned this too late, thinking that having a paid subscription = not being turned into the product. Apparently paying is not enough.
Thank you to this user on HN for mentioning in another thread: https://news.ycombinator.com/item?id=50355424
I had it switched off:
"Hey Google, remind me at 7pm <something>"
"OK, your reminder is set for 7pm"
Next day:
"Hey Google, why didn't you remind me at 7pm"
"I can't do anything with your phone unless you enable chat history."
WTAF!
Google has this pattern of all or nothing approach.
Maps refuses to show your *current* location if you don't enable location accuracy i.e. if you won't allow it to spy on your WiFi or Bluetooth it refuses to show your current location at all. GPS, what's that?
We can disable notifications and even phone access but physical activity is the one permission that cannot be disabled for play services !?
Google apps have a lot of WTFs!
If Gemini has access to app data like gallery, mail etc that can also be subjected to human review? I imagine that will also be part of the context.
They are vague when they say 'don't enter'. Is it only prompts or does it also cover other data too.
> A subset of chats are reviewed by human reviewers
This is expected these days for threads which may make the provider liable. Just look at the recent death case due to bad GPT medication recommendation.
> Chats reviewed by human reviewers [...] are not deleted when you delete your activity. Instead, they are retained for up to three years.
They're being retained for legal purposes.
> Please don’t enter confidential information...
This is so they don't accidentally preserve it for review, but also they don't want you to share private info that the agent will post somewhere without an explicit approval.
Those points make sense for them, regardless what other T&C rules apply.
But there's two reasons to bring cautionary attention to it anyway:
1. As a user, I may not be okay with those terms as they stand and may not have the legal insight to have intuited them. In as much as I have a choice, because of those terms, I may want to use Gemini less/differently or look at other providers that have crafted less shrewd and defensive legalese and processes.
2. As a executive or manager at Google, whether working directly in feature management, or advertising, or government compliance, these same terms define the framework for anything I want to develop. What "makes sense" from a defensive legal standpoint today can the open door for an exploitative or otherwise unexpected use later.
I get what you're saying here in terms of plausible or justifiable "innocence", but that probably shouldn't get in the way of some critical personal reflection for users.
> They're being retained for legal purposes.
It’s a significantly wider usage than that:
A subset of chats are reviewed by human reviewers (including Google’s trained service providers) to help improve Google services. These include Gemini models, other generative AI models that power Gemini Apps, and technologies that help reduce unintended activations.
Reviewers assess if Gemini Apps’ responses were low-quality, inaccurate, or harmful. They also suggest better responses. We use their suggestions to help our models respond better in the future.
That’s in addition to the liability language:
Chats are also reviewed to keep Gemini safe and secure for everyone and to address violations of the Google Terms of Service, including the Generative AI Prohibited Use Policy. Reviewed chats are retained for up to three years.
https://support.google.com/gemini/answer/13594961?hl=en#huma...
Some important things to take away from this:
* They’re claiming to use chat transcripts for both training and for human review to improve training, not just for liability.
* They don’t define “subset”. It could be most chats.
* They make no promises of anonymizing content, just “disconnecting” it from the account.
* This is happening for free and paid user subscriptions, by default, and the only way to stop it is to turn off chat history altogether.
The _primary_ purpose has always been improving search overall -- traditionally this has meant updating query interpretation, ranking, presentation, etc for smaller and smaller query slices ("Ah, when we show the mayor and the population in response to [Barcelona] people just revise their query to [Barcelona FC], so we should make sure to include the sports team on the top. Not so for [New York]."), and running tests on every product change to see what people like. In this case nobody cares about any _individual_ user's data, only the collective. This is basically the original "collective intelligence" contract of PageRank, albeit hillclimbing on billions of searches and clicks instead of using link structure. (Old question: does original PageRank count as machine learning, or not?)
Second is personalization -- things like "Oh, my flight or my delivery is expected on date X, handy that gmail popped a reminder on my calendar, good work Google." Or searching for a restaurant in Maps and seeing results that are biased towards the kinds of restaurants you already like, that kind of thing.
When it comes to revenue the purpose of these isn't to target ads, it's just to have you use the product so you're likelier to see ads that are based on your search.
Finally there is _limited_ use of a _limited_ set of data for ads relevance. There's higher CPC for ads you might actually be interested in (and if you're looking to spend money is finding a willing seller who has compelling terms, via an ad so bad?) _But ad revenue is mostly downstream of users being satisfied with the core product_, whatever that is. (Search, Maps, AI chat, etc)
(Bonus. My Search pro tip for ads is leverage the modern stack and _spell out your intent_ with a few more words when you query. We're pretty good at _not_ serving ads for non-commercial queries. But old-school super short "searchese" queries make it hard to guess whether your intent is commercial or not.)
“ This license is for the limited purpose of operating the services, which means allowing the services to work as designed and creating new features and functionalities. ”
https://policies.google.com/terms?hl=en-US#toc-permission
The training exclusion has always been a distraction. These service providers have plenty of other uses for your data.
actually even gemma locally is great for a lot of chat purposes.
eg Gemini enterprise has a note under each chat session explicitly saying it’s not used to improve the models
You’d maybe want to counter with something like 'But Google/Amazon/whoever just wants to sell me stuff!'. What makes you think that Chinese B2C would just pass on that opportunity?