The AI Data Dilemma: Google, Gemini, and Privacy Concerns

4 Dec 2025 · 12 min · 5 chapters

Ask about this episode

Ask anything about it. ChatGPT or Claude reads this page and answers with the times it was said.

Connect VO and ask about every podcast you hear, including the moments you saved. Add to ChatGPT · Add to Claude

In short

How Google’s Gemini improves by using large amounts of user data (Gmail, Docs, YouTube, Search, connected apps), and why that raises privacy concerns.

Guests

Host Jaden Schaefer and co-host Jamie McCauley; no outside guests named.

Guest backgrounds

Schaefer and McCauley are AI Hustle podcast hosts; McCauley shares a personal example from experimenting with AI image tools.

Key claims

Gemini/Search can become “uniquely helpful” by knowing users better via connected services; more data enables better personalized recommendations.

Notable examples

“Nano Banana 2” generated a fake Albanian government ID from only a face photo and name, allegedly inferring nationality/age and adding realistic watermarking. Also discussed: Google Search VP Robbie Stein’s quote about AI getting more advice-seeking questions and needing more data; Gemini settings allow turning off connected apps like Gmail.

Written by AI. May contain mistakes. Listen to the episode to check what was said.

Chapters

Tap a time to open that second in VO

Data Collection by Google and AI

1:12 to 2:18

Discussion on Google's data collection practices and implications for AI.

“Google has on you, why that can make its AI model, Gemini, a lot better than other models, but also some areas of concern that people are worried about.”

Astonishing AI Data Experiment

2:18 to 3:45

Jamie shares a compelling story about an AI generating a fake ID using data.

“link in the description to the AI Hustle School community.”

The Power and Risks of AI Personalization

3:45 to 6:31

Exploring how AI personalizes responses using user data and the associated risks.

“I mean, you can imagine how that how that would happen.”

Google's AI Data Strategies

6:31 to 8:38

Discussion on Google's strategies for data use in AI and user personalization.

“It can take into account all of the things it knows about you and give you an answer that's, you know, catered to exactly who you are, which can be very helpful in some cases.”

Concerns Over Data Use and AI

8:38 to 10:41

Debate on the implications of Google's data collection for users' privacy.

“Now, the interesting thing that he has, I mean, I don't want to say admitted, like it's a secret because he's publicly talking about it.”
Hear the part that matters, and keep it.Open this episode in VO. Double tap your headphones to save a moment as you listen.
Get VO free

Transcript

Automatic transcript. May contain errors.

0:00John Daly here. You know what day it is? Neither do I. I live life daily. That's why I only spend on Moto Casino. Moto's got daily free bonuses, daily tournaments, new slots added daily, and the best part, guaranteed daily jackpots. You can't beat that. So today's the day you're gripping to spend it with me on Moto. America's Social Casino. Play for free on Moto.us. Moto Casino is a social casino. We're prohibited. No purchase necessary. Visit Moto.us for more details. Download the Moto Casino app today. Must be 21 plus. Moto Casino. America's Social Casino. You're listening to a podcast right now.

0:32Driving, working out, walking the dog. If you're into podcasts, chances are you have something to say too. With RSS.com, starting your own is free and easy. Upload an episode and we distribute it to Apple Podcasts, Spotify, Amazon Music, and hundreds more. Track your listeners, see where they're from, and start earning from ads like this. even with just 10 listeners a month. If you've been thinking about starting a podcast, this is your sign. Start free at rss.com.

1:04Jayden Schafer:Welcome to the AI Hustle podcast. I'm your host, Jaden Schaefer, joined, of course, with Jamie McCauley. Today, we are talking about one of the biggest names in AI and some concerns and a absolutely crazy story about how much data Google has on you, why that can make its AI model, Gemini, a lot better than other models, but also some areas of concern that people are worried about. And I think when we're talking about Google and Gemini, it's impossible to miss the entire fact that maybe Google search, and when I say Google search, maybe that's just the Gemini AI responses are going to get better because of how much data they are now collected on you through these different AI mediums, because they have access to all of these different tools like your docs and your Gmail and your YouTube history that as AI is getting more infused into things, they're sort of consolidating a lot more of your data in a way that maybe wasn't happening before.

1:55Jayden Schafer:So if you want to have your business rank inside of the new Gemini search results, though, I think a really important thing to do is to be able to figure out how to do that. Jamie and I recorded an entire video on how to get your business or service ranked inside of Gemini search results or ChatGPT search results. If you want to get access to that, it's on our school community, an exclusive community where we post one video every single week breaking down how we're making money with AI tools. There's a link in the description to the AI Hustle School community. It's$19 a month. We have a Black Friday Cyber Monday discount going on right now.

2:23Jayden Schafer:The price will go up a lot in the future. But for now, if you lock in that price, it'll never be raised on you. So if you want to get access to that, the link is in the description. Jamie, tell us about you're saying you're recently reading up on an absolutely mind blowing story about just how much data Google is currently collecting on us. We'll talk about how this can make it better and why this is concerning. But tell us about the story. Yeah. So there's this guy I follow on Instagram. He's big into just trying out different AI things, AI image generation, video generation, things like that.

2:50Jayden Schafer:And he didn't experiment. He uploaded a picture of his face and his name inside of Nano Banana 2. So all he did is upload those two things and said, please generate an ID for me, like a fake ID. And so it guessed his nationality, his age, color of his official Albanian government idea without me specifying any of it. Let me emphasize, I knew I'm Albanian without me telling it. It added the official watermark to crazy. I believe Nano Banana searches Google to pull all this information and it used it through Enhancer as an API provider. So there's no way for it to know anything about me. We're stepping into an era where AI is recognizing it's profiling, it's connecting dots that most of us never gave permission to connect.

3:38Jayden Schafer:Wondering where we go from here. So I just think that's a crazy story about how. I mean, what are your thoughts on that, Jayden? It's absolutely amazing. I mean, you can imagine how that how that would happen. The AI is just like, oh, I have to like generate an image. Well, how do I make the ID look realistic? Oh, let me just search up all the information about that person and pull it all together. I mean, the image of the ID there looks super, super realistic. It also looks like a debit card. I don't know if Albanian IDs actually have a chip like that embedded like a credit card. or maybe that was just a funny thing with Nano Banana.

4:06Jayden Schafer:I mean, it pulled all the information. And so I think this illustrates the point, which is that Google is collecting and Gemini is collecting and has access to way more data about you than you know. And, you know, the question is like, oh, well, how did it know his, you know, his birthday, for example? Well, I mean, technically you, and I'm not saying this is where you, they get the data from, but like you've given your birthday to Google when you sign up for like any of the Google services, Gmail, YouTube, like anything else. So technically it could be there. Maybe they went and found it on a website or a forum or blog or like somewhere else.

4:34Jayden Schafer:But regardless, Google and Gemini either can get access to or have access already to so much of your personal data. The finding out that he was Albanian, I think is really crazy. But to be fair, like you can look at a picture and probably these AI image models could do a pretty good job of determining what your nationality was to some degree, right? Like I think for myself, I went to school in Hawaii and at Hawaii growing up, or sorry, Hawaii, when I was going to school, there was like tons of different nationalities. Basically, it's a school. I went to BYU Hawaii and they it's a school that has it's like all of Asia Pacific.

5:10Jayden Schafer:It brings like islanders from the South Pacific, like all sorts of places to to one place. And I'm sure I don't know, people can get mad at me all they want for this. When I first got there, it was very difficult for me to identify between different nationalities of like of Asian culture, Asian people. Right. So like Chinese, Korean, Taiwanese, Mongolian, like if for me, it was very difficult. I hadn't been grown up around a lot of them. And to me, I just thought they all looked roughly the same. By the end of my school, I could just walk up to someone and look at them and just by looking at them be like, oh, they're definitely Japanese.

5:42Jayden Schafer:They're definitely Korean. They're definitely from Mongolia or China or Taiwan. And so I think what's interesting here is AI is like we have the capability, obviously, of doing that to some degree. But the AI is way more capable than us, right? It sees millions of pictures of people. It can just I mean, obviously, you can have some crazy exception where I go and move to China and my wife and I have some, you know, a child in China that is technically Chinese, but like looks just like me and it's not going to find that right. There's crazy exceptions. But I think for the most part, it can tell a lot about you through facial recognition.

6:13Jayden Schafer:It can pull a lot of this data about you. And I think it's way more advanced than any human. So it is it is an interesting point. When it comes to data collection and being able to target people, sell them things, know what types of things that they're interested in buying. It's got a lot of data and that is That is a pretty valuable resource, but also a little bit scary. Yeah, I mean, I think there's definitely usefulness to this, especially when you do ask it a question. It can take into account all of the things it knows about you and give you an answer that's, you know, catered to exactly who you are, which can be very helpful in some cases.

6:43Jayden Schafer:But where it gets scary is if you think about Google and all the different things that it knows about you. Like if it's connected to Gemini is now connected to your Gmail, your calendar, your drive. I just bought a new TV that has Google TV on it. It's a Google Smart TV. So I'm sure you know what TV shows I watch, you know, what TV shows my kids watch. There's a ton of information that's, if you think about it, it's kind of scary. And so, yeah, is this going to be a privacy concern moving forward? Or is it already, is it too late? I mean, what are your thoughts, Jaden? Okay, so there's a recent podcast interview on the Limitless podcast.

7:20Jayden Schafer:And Robbie Stein, who's the VP of product for Google search, was talking about this kind of AI trend. And he was saying that Google's AI tends to get more questions that are advice seeking for users that are looking for recommendations. And because of those types of questions, they're more likely to benefit from like, like Google can give a better response if they have more data about you, right? If you're asking for recommendation, you know, like, let's say I'm like, hey, what are the best things to do in Honolulu? Because I'm here today, it could give me a way better response if it's like, what's my age?

7:52Jayden Schafer:What kinds of things am I interested in? Do I have kids with me? Like all of that's going to play into the best things to do because there's a hundred things to do if it's going to give me recommendations and wants to make them personalized. So because of that, they want to make, they want to get as much data as they can and make more personalized. Here's a quote that Robbie was saying about this. He says, we think there's a huge opportunity for our AI to know you better and then be uniquely helpful because of that knowledge. And one of the things we talk about at Google Developer Conference IO was how AI can get a better understanding of you through connected services like Gmail.

8:27Jayden Schafer:So he goes on to outline this a little bit, but it, I mean, it, it makes a lot of sense from Google's perspective, their product does get better, the more personalized it becomes, but in order to be more personalized, they have to get a lot more personal data on you. And they do that. Now, the interesting thing that he has, I mean, I don't want to say admitted, like it's a secret because he's publicly talking about it. And I think it's kind of obvious that Google is like, Hey, look, we want to give you a better, better, a better experience. This is how we're doing it. They are pulling data from your Gmail, from your docs, from your YouTube, from your history, like anywhere they can get it.

8:57Jayden Schafer:It's kind of interesting, because I feel like in the past, there was this kind of feeling and I don't know if it was real or not. Maybe Google was just putting off like putting on airs or whatever. But they were like, don't worry, you're you know, like we have ads inside of Gmail, but we don't actually read your emails to serve you ads, or it's like, it's an automated system. And I I don't know, like they had all these things where they tried to make you feel like your Gmail wasn't being like read by somebody. Because I remember I remember that Microsoft had this big marketing campaign maybe like 15 years ago, which was called Don't Get Scroogled.

9:30Jayden Schafer:And it was like saying that Google is taking all your data through your Gmail and you should use Hotmail instead if you didn't want to get scroogled because the big Gmail man was like reading all. It was like this guy and he was like opening your mail and like reading it and stuff. Anyways, so they've always had like that kind of like bad brand perception they're fighting against. And so it feels like we've now come to a point where they have fully embraced the fact that they do have access to all of your data and it makes their results better for their AI model. And so they're just like, yeah, we're building a giant consolidated puddle of all of your data, database of all your data, and it's going to give you great results.

10:04Jayden Schafer:Some people love that. But like you mentioned, some people are concerned about that. I guess, where do you fall on that debate, Jamie? me. I mean, it's definitely a concern. I mean, I think at this point for me, it's too late. But what's interesting is I feel like when it comes to like knowing about you, I feel like, and admittedly, I don't use Gemini that much, but I feel like ChatGPT does a better job personalizing responses to me with what it knows about me than Google does at this point. But maybe that'll change in the future. But you would think with Google having these capabilities that they would try to work in the personalization more, but I just feel like they don't that much.

10:41Jayden Schafer:Would you agree or disagree? Yeah, I think I'd agree with you there. And I will say one thing that is interesting talking about all of this is that recently some people were saying basically that it's definitely more useful. They said it is very much the vision of building something that can be really knowledgeable for you specifically. But of course, yeah, there is the risk that all of your data gets pulled into that. Is Google going to leak your data? I think that's less likely. But does Google, I don't know, share it with the government or share it with parties you wouldn't want? Like, there's definitely there's definitely possibilities there.

11:19Jayden Schafer:And some people embrace giving all their data to the government. And some people don't love that. I for one don't like the feeling. But I also think it's like too late. And there's nothing I can really do. Also, I'm pretty sure like every government agency has a profile on me anyways. I was recently talking to someone I know that was like, they have a job in the government and I've known them my whole life. And they were telling me that when they had to apply for their job, they had to give a list of like basically anyone they've known their entire life growing up, what their middle name was, what their address was.

11:53Jayden Schafer:So I apologize. I have given your address to the FBI and your middle name. I'm like, oh, cool. But like, do you know what I mean? There's nothing I can do about it. It's just it's all out of I don't know, in my opinion, it's all over our hands. The FBI has already got a file on me. So, you know, whatever. I'm sure they probably have it on all of you that are listening as well. So don't feel too smug either. One thing that I will say that's interesting, Google does let you control the apps that Gemini uses to make its AI more knowledgeable about you specifically, you go to the connected apps section in Gemini settings.

12:21Jayden Schafer:And you can turn off, you know, access to Gmail, for example, where Gemini is pulling from Gmail. At this point, I've given up on my AI overlords. But if you like many people I do know, take privacy and security very seriously, this is something I'd recommend doing or just don't use Gemini or Gmail, probably if you really cared about your privacy a lot. At the end of the day, the results are getting better, but it is taking more of your more of your data and sucking it into Google's hive mind, which is, a little bit concerning, perhaps. And maybe some people are like, well, I love Google. It's a great company.

12:54Jayden Schafer:But it's like, okay, but there's like a hundred of these other AI companies that might all be trying to do it as well. So hope you trust all of them. You know what I mean? Yeah, for sure. For sure. Well, hey, if you enjoyed this episode, be sure to leave us a rating or review wherever you're listening. We really appreciate those and they help us reach more people. And be sure to check out the AI Hustle School community if you want to learn how to grow your business or just make money on the side using AI. I would love to have you be a part of that. Thanks for listening and we'll see you next time.

13:20Here's golf legend John Daly. Hell yeah, these wins are piling up faster than my divorces. I only spent on Moto, America's social casino. You know I've won a couple of majors and on Moto, I've won majors, grands and epic jackpots on their classic Vegas slots with huge, huge bonus rounds. Moto Casino adds new games and awards players free coins every single day. Grip it and spend it on Moto Casino.

13:39Jayden Schafer:Download the Moto Casino app today. Moto Casino is a social casino. We're prohibited to purchase necessary. Visit Moto.us for more details. Moto Casino America's Social Casino You're listening to a podcast right now. Driving, working out, walking the dog. If you're into podcasts, chances are you have something to say too. With RSS.com, starting your own is free and easy. Upload an episode and we distribute it to Apple Podcasts, Spotify, Amazon Music, and hundreds more. Track your listeners, see where they're from, and start earning from ads like this. even with just 10 listeners a month. If you've been thinking about starting a podcast, this is your sign.

14:20Start free at rss.com.

From the publisher

Join hosts Jayden Schafer and Jamie McCauley as they delve into the intriguing world of AI data collection. Discover how Google's AI model, Gemini, leverages vast amounts of personal data to enhance its capabilities, and explore the privacy concerns that arise from this data consolidation.

Links

  • Get the top 40+ AI Models for $20 at AI Box: https://aibox.ai
  • AI Chat YouTube Channel: https://www.youtube.com/@JaedenSchafer
  • Join my AI Hustle Community: https://www.skool.com/aihustle
  • More from AI Hustle: Make Money with AI

    All 178 episodes
    The AI Data Dilemma: Google, Gemini, and Privacy ConcernsAI Hustle: Make Money with AI · 12 min
    Listen in VO