Google's Liz Reid on Who Will Own Search in a World of AI

23 Apr 2026 · 51 min · 24 chapters

Ask about this episode

Ask anything about it. ChatGPT or Claude reads this page and answers with the times it was said.

Connect VO and ask about every podcast you hear, including the moments you saved. Add to ChatGPT · Add to Claude

In short

How Google’s Liz Reid says AI overviews and Gemini change search usage, query behavior, and monetization—without replacing the web or ads.

Guest backgrounds

Liz Reid is VP of Search at Google/Alphabet, leading the search team across product, engineering, UX design, and data science. She’s been at Google for 20+ years and has worked on the search team for several years.

Key claims

  • AI in search isn’t new; it’s evolved from earlier ML (e.g., BERT, MUM) to today’s AI overviews and AI mode.
  • AI overviews are shown only when they add value, based on user signals—not “question marks.”
  • People want AI and the web together; quick answers don’t eliminate browsing or buying.
  • Google measures success by whether users come back and ask more, not just engagement.
  • AI expands queries and can improve ad targeting when users express more of their real intent.

Notable examples

  • “Can you see tankers from the Strait of Malacca?” now triggers an AI overview.
  • “Falafel” illustrates how longer, more specific queries reduce ambiguity.
  • Fashion influencers: users still want human perspectives, not chatbots.

Written by AI. May contain mistakes. Listen to the episode to check what was said.

Chapters

Tap a time to open that second in VO

The Legacy of Google Search

2:00 to 4:00

Explore the evolution of Google's search technology and its competition with AI.

“But of course, we know that the legacy tech companies, the so-called hyperscalers, etc., They're not just going to give up this groundbreaking technology without a fight.”

Challenges Posed by AI to Google's Business

4:00 to 6:00

Discussion on AI's impact on Google's search business and advertising revenue.

“Even though we don't trade, like, should have bought it in, like, 2023 when everyone was saying that ChatGPT was going to eat its lunch.”

The Future of Search and User Expectations

6:00 to 8:00

Insights on how user expectations for search results are changing with AI.

“Are the search results that are being turned up actually of any certain quality, right?”

AI Overviews: Enhancing the Search Experience

8:00 to 10:00

Liz Reid explains how AI overviews can provide quick answers and enhance search.

“It referred to general machine learning and other things like that.”

Determining When to Use AI Overviews

10:00 to 12:00

Understanding how Google decides to show AI overviews based on user signals.

“And you don't once, but then you're going to go on a trip and you're going to go and actually dig in more because you're going surfing on other pieces.”

The Balance Between AI and Traditional Search

12:00 to 14:00

Discussion on the interplay between AI-generated answers and traditional search results.

“determine whether it shows the AI overview or not?”

Quality in AI Responses

14:01 to 14:29

Discover how AI models prioritize user-centric responses in search.

“So as the models have gotten more powerful, we can cover more cases and just continue to develop really with the focus being what is the best response to give a user for the question they've asked.”

User Behavior in Search

16:00 to 17:39

Examine how users interact with Google and Gemini for different queries.

“And my question is, do you see the same user or a cohort of people who use both Google.com and Gemini.Google.com?”

Fact-Checking with Search

17:39 to 19:29

Explore how users utilize Google to verify information from LLMs.

“If you know that like your goal is to just get to a particular web page, you're more likely to start with the search result page.”

Challenges in Search Results

19:29 to 21:07

Understand the complexities of delivering relevant search results based on user intent.

“And so some of these questions they started bringing to an LLM as we brought AIO reviews in, they took on those same types of questions and have brought them to search.”
Show all 24 chapters

Evolution of Querying

21:07 to 23:09

Learn about the shift in user queries from keywords to natural language.

“Because if you don't know who, most of the people searching for it know who the person is, but some of the people searching for it don't.”

Real User Needs and AI

23:09 to 24:21

Discover how AI enhances the ability to address real user queries.

“We see more natural language queries, but it's also not even something as basic of that.”

Privacy and Complexity in Search

24:21 to 26:11

Analyze the implications of diverse queries on privacy and search quality.

“to see because when we can be more helpful, but also like those are real problems people had.”

Recruitment Challenges in AI Era

26:11 to 28:00

Explore how AI impacts the recruitment process for software engineers at Google.

“I think sometimes people think, oh, a few years ago they said like, oh, what more can you do with Google search?”

The Changing Landscape of AI Tools

28:00 to 29:15

Learn how AI tools are transforming the approach of software engineers and the importance of fluency in using these tools.

“How are you doing that on some basic way?”

Future Interactions with the Web

29:15 to 30:48

Explore predictions on how users will interact with the web in the future, with a focus on personal agents and the evolution of interfaces.

“So I'm just curious, if you gaze five or 10 years into the future, what do you think the default entry point for interacting with the web is actually going to be?”

Diverse Access Points and User Interfaces

30:48 to 33:16

Discuss the increasing variety of access points for digital interaction and the need for adaptable user interfaces.

“So with that aside, I think there are some things I believe in and some things I think we don't know.”

The Role of AI in Productivity Metrics

33:16 to 35:54

Investigate how AI usage is assessed in productivity, including the potential pitfalls of relying on token consumption as a metric.

“PayPal, Venmo, Pay Later, and all major cards, so you can focus on the future.”

AI's Impact on User Engagement and Curiosity

35:54 to 42:00

Understand how AI lowers barriers for user engagement and encourages curiosity in a way that traditional search methods do not.

“Wasabi Hot Cloud Storage, proud partner of iHeart Podcast Network.”

The Exploration of Multilingual AI

42:00 to 43:15

Learn how AI can enhance the search experience for multilingual users.

“can be more multilingual than just the web corpuses by default, right?”

Monetizing AI Overviews

43:15 to 45:23

Understand the commercial implications of AI in search queries.

“Like, how do you make money off of the AI overviews?”

Understanding Two Search Boxes

45:23 to 48:34

Explore the reasons behind having distinct search applications like Google and Gemini.

“And I have like a sort of real an intuition of which one I go to for which purpose.”

Navigating AI Slop in Search

48:34 to 50:26

Discover how Google manages content quality amidst increasing AI-generated information.

“So I realized we kind of promised to talk about AI slop a little bit in this conversation.”

Reflections on Human-Generated Slop

50:26 to 51:04

Reflect on the historical context of low-quality content on the web.

“but making sure that the information you do see is trusted.”
Hear the part that matters, and keep it.Open this episode in VO. Double tap your headphones to save a moment as you listen.
Get VO free

Transcript

Automatic transcript. May contain errors.

0:00Tracy Alloway:Hey Fidelity, what's it cost to invest with the Fidelity app? Start with as little as$1 with no account fees or trade commissions on U.S. stocks and ETFs. Hmm, that's music to my ears. I can only talk. Investing involves risk, including risk of loss. Zero account fees apply to retail brokerage accounts only. Sell order assessment fee not included. A limited number of ETFs are subject to a transaction-based service fee of$100. See full list at Fidelity.com slash commissions. Fidelity Brokerage Services, LLC. Member NYSE SIPC. If you follow markets, you know the value of long-term thinking. You plan, you diversify, you prepare for volatility.

0:38But even the best strategies can't prevent every bad day. For more than 75 years, Cincinnati Insurance has helped individuals and businesses navigate tough moments with expertise, personal attention, and independent agents who focus on relationships, not transactions. The Cincinnati insurance companies. Let them make your bad day better. Find an agent at c-i-n-f-i-n dot com.

1:05Tracy Alloway:The thing about AI for business, it may not automatically fit the way your business works. At IBM, we've seen this firsthand. But by embedding AI across HR, IT, and procurement processes, we've reduced costs by millions, slash repetitive tasks, and freed thousands of hours for strategic work. Now we're helping companies get smarter by putting AI where it actually pays off, deep in the work that moves the business. Let's create smarter business, IBM. Bloomberg Audio Studios. Podcasts, radio, news.

1:53Tracy Alloway:Hello and welcome to another episode of the Odd Lots podcast. I'm Joe Wiesenthal. And I'm Tracy Allaway. Tracy, when we talk about AI, we talk a lot about the big labs, the big independent labs, particularly open AI, anathropic. But of course, we know that the legacy tech companies, the so-called hyperscalers, etc., They're not just going to give up this groundbreaking technology without a fight. No. And we've certainly seen various efforts to, I don't want to say catch up, but to keep pace, I guess. Keep pace. Yeah. So of the major legacy companies, which I would say are like Microsoft, Amazon, Meta, and Google, or sorry, Alphabet.

2:33Tracy Alloway:I would say clearly Alphabet is the one that has the model that people are talking about. Gemini, right? And in a way, that's kind of surprising because one common intuition that people have is that companies aren't very good at developing the thing that disrupts their own legacy business, right? This is just a famous sort of B-school thing that people talk about all the time. Yes. So the issue, one would think, with AI and Google in particular is that Google, you know, famous for its search. No one believes me, by the way. The first time I ever used Google in like, I guess it was the either late 1990s or early 2000s, I told my parents to invest in the company and they didn't listen to me.

3:13Oh, really? Yeah. They don't believe me either, but I swear I did. The first time I used it, I was like, oh my God, this is so much better.

3:19Tracy Alloway:So I feel so dumb because I remember the Google IPO very well. And I thought I was very smart because it was like I was 20, I think it was 2004. I thought I was very smart back in those days. I don't think now now that I'm older, I realize I don't know anything. But I thought I was very smart. I was like, oh, these sheep, they're just buying. It's overvalued. Should I short this IPO? It's like a bubble, et cetera. Thank God I didn't put on some short trade and go bankrupt. But it never occurred to me to go long because I don't. And I think it's the journalist temperament. We're all like very cynical.

3:49Tracy Alloway:That's right. You have to be an optimist to be an investor. Yeah, you have to be an optimist. You have to be willing to be part of the crowd. You have to ride the wave. We don't really like riding waves, et cetera. And so I was like, oh, should I short this? Anyway, I should have bought it. Okay. I should have held it. And you know what? I should have bought it. Even though we don't trade, like, should have bought it in, like, 2023 when everyone was saying that ChatGPT was going to eat its lunch. Should have bought it a year later when people were saying, oh, Gemini is too woke, et cetera. All these turns, there are opportunities.

4:20Tracy Alloway:But anyway, I'm happy to just talk about it. All right. Now that we've gone on a very long segue, what we are getting at. It's an important segue. What we're getting at is that in theory, AI would seem to pose a threat to Google's core business, which is search. So if you type in a query in Google now, I think I have one open from the last time we recorded a podcast. I don't know why I was looking this up. It says, can you see tankers physically from the Strait of Malacca? Oh, yeah. In the Strait of Malacca from Singapore. So if you type that into Google, it used to be you would just get a bunch of search results.

4:51Tracy Alloway:That's right. Now you get an AI overview, which basically pulls in a bunch of results from other pages and gives you a sort of summary. And so the question is, if people are just going to be looking at these summaries instead of actually going to the pages that Google search used to turn out as links at the top of the page, what does that mean for traffic via Google search? Well, and then the other big element here, which is that, you know, people stop like clicking as much on links or even seeing links. What does that mean for the advertising business? If the expectation is that you see the answer right there, et cetera.

5:27Tracy Alloway:And one of the questions we have about OpenAI in particular is, are they ever going to be able to launch an advertising business? Can these two things combine, et cetera? We know that to this day that Google search ads are the greatest money printer that's ever been invented, basically, in the history of the world. And so how this is going to interact and how Google is thinking about these questions, as you say, it's a little unclear to me because, yeah, it's nice. I could just put on the same question. Can you see tankers in the Strait of Malacca? I don't know if these are right. I don't know if the AI overview is right, but it's there.

6:00It's there. So lots of interesting questions here. Also, AI slop, right? Are the search results that are being turned up actually of any certain quality, right?

6:10Tracy Alloway:It's a great point. And one of the reasons perhaps that a lot of people, and I would include myself in this, use AI more and more is because I have some issues, let's say, with search. So anyway. I'm going to clip that. I have some issues, Joe Weisenthal. Anyway, we really do have the perfect guest to talk about this. someone who is like really literally right in the middle of all of this and can answer all of our questions. We're going to be speaking with Liz Reed. She is the VP of search at Google, and she has been at the company for over 20 years, has been in the current role, has been on the search team for a few years.

6:48Tracy Alloway:And so we're going to hopefully get answers to all these questions. Liz, thank you so much for coming on the Outlaws podcast. Thank you for having me. Delighted to be here today. Absolutely. Why don't you just start by telling us, like, what's your role at Google? What does it mean? Okay, you're the VP of search at a company that people know for being a search engine company. But what does your title actually entail? I lead the search team that you can think of as covering the product, the engineering, our user designers and data science. Sort of the team that fundamentally builds the search product that you use.

7:20So how much of your day-to-day has taken up thinking about AI nowadays versus, like, let's say, two years ago? Well, two years ago, I would say it was also still a fairly large amount. I think AI is a deeply transformative technology in what it opens up. And I think AI has been in search for many years in different forms. It's much more in the forefront these days with things like AI overviews and AI mode. But if you go back several years, it was how we transformed a bunch of ranking with efforts like Bert and Mum that were built on some of the early transformer breakthroughs. But at the end of the day, you know, and if you go back once upon a time, AI didn't just refer to generative AI.

8:01It referred to general machine learning and other things like that. And, you know, in the early 2000s, Google had spell correction, which felt sort of revolutionary at the time that used AI. No one calls spellcheck AI anymore. Yeah. Nobody calls spellcheck AI, but like it was at the time, right? It just shows you how far the world has come. But the opportunity to really transform search and realize Google's mission at a new level is really exciting and an amazing opportunity and very humbling to do this for a product that so many people use.

8:32Tracy Alloway:By the way, you mentioned BERT, my little software hobby project of training a machine learning model to tell whether something is more indicative of the written or spoken word is based on BERT. So thank you for developing that and thank you for open sourcing it so that someone like myself can train it. But talk to us about just how you're thinking about this core tension. That for years, Google had a business of you go to a, you put in a term in a search bar and then people click out. And some people, and some of the clicks were to organic results and some of the clicks were to paid results. And now people are, we're entering this world in which people expect to get whatever they want right there from the query without that impulse for a click.

9:17Tracy Alloway:And you have a business that is still dominated by that click out one way or another. So just like, you know, and I want to drive into the details, but big picture, is that a real tension? I think what's interesting about it is that the space of search is very big and what people are trying to do is very big. And sometimes people really want quick answers and they want it right in front of them. And sometimes they want to go deep or they want to hear from particular individuals, right? I think there's this sort of myth that people want AI or the web that I actually think what we see is that people want AI and the web together.

9:51There are certainly questions for which you just want the quick answer and then you're done. And that's been true in many ways for years. We'll talk about this with AI, but I bet most of the time you look up the weather, you just want to know what the temperature is and you're done. And you don't once, but then you're going to go on a trip and you're going to go and actually dig in more because you're going surfing on other pieces. I think if you think about this, people are like, oh, I have an answer. I don't. So why would I do an ad? Well, like the answer doesn't buy the pair of shoes. You actually have to buy the shoes, right?

10:22So you still have to go pick a merchant for that. People care often to hear people's perspectives, right? Like you'll talk about, okay, well, we want a bunch of answers. And yet this is like a golden age for podcasts, right? So clearly people sometimes want to spend a couple of seconds. And other times they'll spend a whole hour listening to things. And so one of the things we see with the shift with AI overviews is that you get more of this pronouncement with what's your goal, okay? If all you were going to do was go to the web page, see the fact, and immediately click back, you're going to spend like a half a second on the page, okay?

10:56You see those things shift. But if what you were going to go and do is read an article for five minutes, you're still interested in reading that article for five minutes, right? AIO might help you point to the right page so we see fewer bounce clicks where a user would go and immediately come back because they weren't happy. You see people go, though, and they want to hear from other people. They want to hear their expertise, their perspective, their unique take. I take fashion as an interesting example sometimes. If you hate fashion, then you love using chatbots to replace the need. You didn't really want to spend any time.

11:30that's fine. But if you were someone who was spending a lot of time reading influencers and what their interest in the fashion, you have not decided to replace that with a chatbot, right? You're still going to want to hear from those fashion tastemakers. And so there's an opportunity with AI overviews to help you get started and then make it easy for you to dig in and connect. And I think people's interest in connecting with other people is just as strong these days in many ways. So just at a simplistic level, can you tell me, like, how does Google determine whether it shows the AI overview or not?

12:06So if I type in Corgi into Google search, I'm biased because I have two Corgis, but it just gives me a bunch of links to like the American Kennel Club and like the Corgi subreddit and things like that. If I type in what is a Corgi question mark, it gives me the AI overview. Is it just everything with a question mark returns an AI result? Or how are you actually deciding what to present to users? No, what we try and an important premise of this is that we shouldn't give you AI for the sake of giving AI, right? The point is for it when we think it adds value to people. And so it's not really associated with question marks.

12:42Question marks are often when people are looking for more of a description, or they have a harder question, which maybe a single web page doesn't answer, or whatever else. But what we're really using is looking at signals from users to say, does the AI overview provide additional value or not? And so most people, I haven't studied the Corgi query in detail, but for a query like that, probably what we're seeing is that most people aren't just trying to figure out what is a Corgi. Maybe they want to see pictures about it. They want to click on knowing more about the dog breed because they're trying to engage in it.

13:14And so we basically learn over time based on user signals the same way we learn about like, when should you show the weather one box and when should you show local results and when should you do sports that the AI overview provides additional value. Great. We show it. It doesn't. Then we don't want to get out of the way. Right. You don't want your search for Wikipedia. You go and you type in Wikipedia, which a lot of people do. They want to get to Wikipedia. They don't want to go and say, let's give me the history of Wikipedia. That's not why they search for that. Right. If they search for odd lots, they probably want to quickly get to your podcast.

13:47And so we have a variety of signals that try and help us understand when is it adding value and not. And we get smarter over time as people both change how they ask questions, as the models get smarter. We don't want to put in an AI overview if we think it's not going to be high quality. So as the models have gotten more powerful, we can cover more cases and just continue to develop really with the focus being what is the best response to give a user for the question they've asked.

14:29Hey, Fidelity. What's it cost to invest with the Fidelity app? Start with as little as$1 with no account fees or trade commissions on U.S. stocks and ETFs. Hmm. That's music to my ears. I can only talk.

15:30Go on, get a little out there into the big heart of Nevada, where you can go off-road and off the map, on two lakes or on horseback. Dip into hot springs and dive into deserts. Climb a mountain or make your best effort. See thousands of stars in some of the darkest skies. Stake out haunted hotels. Can you make it to sunrise? There's always something new to see because we've got plenty of space to just be. Plan your trip at TravelNevada.com.

15:59Tracy Alloway:I have a question about what you see among user behavior. And my question is, do you see the same user or a cohort of people who use both Google.com and Gemini.Google.com? And do you see distinct patterns of queries from the same user, but different types of searches? Or do people just sort of throw the question mostly in the Google search box and start from there? Or do you see people who just use Gemini and do everything there? What do you see in terms of emergent patterns about how an individual chooses which of the sites to enter into first and how they do different queries in each one? Yeah.

16:42So maybe just so we're all talking about the same thing. There's sort of your main search page. There's AI mode. That's part of search. And then there's the Gemini app, right, across. And I would say, like, there's a lot of users. So their behavior varies across all of them. But there are some patterns, OK? There's plenty of people who co-use across them. There's plenty of people that are actually using several AI products right now, just in general, right? Not even just within Google. Across Gemini and Search, the more informational ones, if it's an informational query, then the probability that they're using Searcher AI mode is going to be higher.

17:18If it's a creative query, it's more of a productivity question. You know, I want to like, please rewrite this to make it sound more formal, right? Those type questions are going to be more Gemini-oriented. Between AI mode and search, the main search page, some people use AI mode mostly via AI overviews. They start on AI overviews and they transition. For those who go direct to AI mode, they tend to do that for queries that they consider sort of more complex, longer questions, questions where they expect that they're going to do more follow-ups versus if you're doing a very browsy query, you might choose to prefer all of the SERP.

17:58If you know that like your goal is to just get to a particular web page, you're more likely to start with the search result page. But you know, there's obviously overlap in the use cases, but across search and AI mode tends to be sort of more longer, complex, more conversational queries versus more traditional queries. And between Gemini and search, there's more of a productivity and creativity versus information slant on them. So since we're talking about user behavior, one of the things that seems to be happening now is people will use an LLM, it doesn't matter which one, they'll ask a question and then they will go and fact check the answer that they get on Google.

18:38And I'm really curious if that's something that you're aware of as a sort of user behavior and if the idea is that maybe Google becomes, maybe not an AI overviewer per se, but maybe the sort of fact checker of last resort for other LLMs. I think we're definitely aware that people use Google as a fact checker for some of their LLM use case. I think people have used Google as a place to fact check information pre-LLMs for a number of things. A friend tells them something, you know, and sort of come. But I think people use search for a lot more than just fact checking, right, or even just looking up facts.

19:16They want to go browse what they're going to go by. They want to go check up the sports score of the latest team. And we do see with AIO reviews that with the presence of AIO reviews, people are asking more longer questions. They're asking more conversational questions. And so some of these questions they started bringing to an LLM as we brought AIO reviews in, they took on those same types of questions and have brought them to search.

19:40Tracy Alloway:One of the complaints about search, and I would say I've complained about this or complained about, is how many of the results in the SERP are like very, almost like too timely. Let's say someone enters the news. There's a headline about so-and-so. I'm like, I'm really curious about this person. And so I like search their name and I get like 10 results or however many results all from the last day since they made the news. And it actually is difficult for me to find information that didn't have the context of the news. So it was like unbiased in some way. Is that recognized as an issue? because I certainly feel it as a user, but I'm curious from your perspective at Google, whether this is something that you think about as a way in which search becomes less than ideal.

20:29I think one of the things that's generally very challenging about search is that people enter the same query that's often very short with a lot of different intents in mind, right? And so in a bunch of the examples where you have, probably our data says that most people just want to see the recent articles. And those are the ones that get all of the clicks. But you didn't, right? And so how do we figure out across all of the different intents and match them across? And so I think there's this question about both how do you get the different facets of a question? How can you personalize the results more effectively for people?

21:09I do see more, this is anecdotal as opposed to complete data, but to your example, people using AI mode and AI overviews for some of the people queries to like understand more about the person independent of the rest of the news articles. Because if you don't know who, most of the people searching for it know who the person is, but some of the people searching for it don't. And so you can see behavior like that. But I do think one of the interesting things about the evolution of AI is that people stop talking just in keyword ease as much and they start expressing more of what they want. And then that becomes much easier for us to give an answer.

21:47So if you say, tell me about someone versus what's new with someone, that's actually much easier for us to figure out how to give better results than if all we just say is someone. right? We used to talk about an example query in a different way is falafel. What do you want to know with falafel? Some people don't know what falafel is. They want a definition. Some people want recipes. Some people want to find where to eat. Some people want nutritional information. They all just use the word falafel. And that's just harder to figure out how across all of them do that. We also see that with tensions on things like, well, do you want video results or do you want more text-based results.

22:25People are very opinionated about what the right answer is, but they are not very opinionated in the same direction. And so we try and meet, you know, multiple billions of people's needs at once.

22:34Tracy Alloway:Just to be clear, the falafel example is great. Would you say that today you see a greater diversity of falafel-related queries, whereas maybe like five or 10 years ago, you just get falafel and now people know that they could type in, where does falafel come from? What is a falafel recipe, et cetera? Have people gotten more sophisticated over time in their query specifications about falafel? I don't know falafel very specifically, but in general, yes. We have seen with AI overviews meaningfully longer queries. We see more natural language queries, but it's also not even something as basic of that.

Read the full transcript

23:15It can also be like you were searching for restaurants. We used to laugh about the, like before I worked on search, I worked on maps and local, some of the intersection with search and people would just be like restaurants, New York. And you're like, what do you want me to do with that query? Right. Okay. The best restaurants in New York are going to take three months and 99.9 % of the population can't afford to go to them. Okay. But like, are you picking 10 random ones, et cetera. But like part of why people will do that is they had a much more complex. I want a restaurant in this location for five people.

23:47It can't be too pricey. I have a vegan member. I also have kids. That was the question they had in their mind. And in the old word of keyword ease, that information would be kind of spread throughout the web. And so you wouldn't feel confident you could just put in the question. And now with AI reviews and AI mode, you can start to actually, and you see people do this, they tell you the real problem. They don't take their need and translate it to what the computer understands. They try to give the computer their actual need and expect us to do the translation. And I think that's really exciting to see because when we can be more helpful, but also like those are real problems people had.

24:26If you go back to the mission, it was organize the world's information and make it universally accessible and useful. Like that useful part, right? It's not just that it's organized. Is it useful to you? And I think one of the most exciting things about AI, the transformation going on right now is that you can actually make information much more useful to people. And that really opens up. That makes it so that people just ask more questions because we can actually do a better job meeting their needs. Does that come with any complications in terms of privacy or competition for Google? If people aren't using keywords as much anymore, if they're doing basically like query brain dumps into the prompt and saying, you know, I am so-and-so, I have a kid, I live here, I want to do the following things.

25:09This is my issue. Is that like an added layer of complexity that you have to deal with as like a large search company? I mean, I think people from a privacy perspective, we give people sort of a range of different things. They can be sort of an incognito, they can be signed out, they can be signed in across. And I think Google has a long tradition of really treating people's data with a great deal of care and having cutting-edge security and privacy by design. So I think people are seeing the value and they have continued their trust in Google. I think it means it's a harder job on quality, right?

25:48You have to take this question that's many parts and you have to figure out how you break it apart. And you have to do work to think about things like latency because you can't just, you know, if everyone uses the same keyword and it's not personalized, then you can cash it all. If all of a sudden the queries get much more diverse, it has consequences there. But I think we just see that it's very empowering people, right? That it takes some of the work out of searching. I think sometimes people think, oh, a few years ago they said like, oh, what more can you do with Google search? But like if you actually ask them, okay, when was the last time you spent 20 minutes searching when you would have preferred to spend two?

26:24It's actually not that hard for me. Oh, the last time I was trying to like go find a service provider. The Last time I was trying to go like do these bigger tasks in life. And so it's been kind of exciting to just make people's lives easier by helping them address their real need.

26:40Tracy Alloway:I have so many different theoretical questions I can ask. Here's one. Actually, you know what? This is something that was inspired by our producer Dash, a conversation that I had with him 10 minutes ago prior to this and related to something else. I imagine in your career at Google spanning over two decades at this point, you've been involved in quite a bit of recruiting and recruiting software engineers in particular. And I imagine that's a particularly important aspect in some way or another for the VP of Surge. Given what we've seen with AI coding and so forth, when you're doing one of these leak code software developer interviews, et cetera, is it different today than five years ago?

27:22Tracy Alloway:Do you have to think really differently about the battery of technical questions that you would propose to a software engineer today, given the restructuring of the nature of the job in the world of AI-generated code? I think the process is definitely evolving. I wouldn't say that we have perfected the science yet, but there's two angles in which you're thinking about it. One is you don't want to ask questions for which they just go and type in the answer in the chatbot and recite it back to you. So you need to make sure. To the extent that your goal is to understand, are they critically thinking?

27:55Are they able to think through a problem and do that? You want to make sure that that's actually what you're assessing, right? And so is it in person? How are you doing that on some basic way? But there's the other thing that I think the tools are powerful. You can use them in ways that make you more effective and you can use them in ways that make you less productive. How do you think as the fluency is changing with AI, the way a software engineer might approach the problem now is different than they might've approached the problem five years ago without some of these tools. And so I think we're all learning how to change, asking that question, right?

28:29Are you building up that expertise? Are you building up that fluency? And the fluency isn't fixed. What was possible with the tools six months ago, let alone two years ago, is different than what's possible now. And in six months, it will be different. So you have to start thinking about how part of your interview is thinking about sort of fluency with the use of tools in the same way that like when IDEs became important or when people stopped using assembly language and they started doing Java, right? You had to sort of evolve the interviews. It's just that it's happening very fast, right? And so we all have to be on our toes, but exciting.

29:06Like you play with this tool and it doesn't work for something. And then it's not like play with it two years later. It's like play with it three months later. Maybe the tool will now work for these things. Okay. Okay. Well, speaking of tools, I mean, one of the things, Joe, I think you've said this, you've been playing around with Cloud Code, this idea that actually when you start vibe coding everything and telling your agent to do everything, it feels like you don't even necessarily need like a computer, much less a search engine, presumably. So I'm just curious, if you gaze five or 10 years into the future, what do you think the default entry point for interacting with the web is actually going to be?

29:43Is it going to be a search engine like Google? Is it going to be a specific LLM? Is it going to be my personal agent that I've vibe coded for all of my preferences?

29:52Tracy Alloway:Yeah, just, can I just add on to this question? This is something I think about. Like if I want to send an email to Tracy today, then what I have to do, like I find the tab in my browser, I scroll over there. Okay, that's my Gmail tab, et cetera, whatever. I would like to just be in my terminal. It'd be so much easier to say, here, send an email to Tracy saying this. There's all these steps that I currently do because of the nature of graphical user interfaces that now that I've gotten in like cloud coding or whatever, feel a little clunky. It feels a little yesterday. And so, yeah, I'm extremely curious about will the web with the series of boxes that we drag and drop, et cetera, is that the future or will it just be someone talking in English to their computer?

30:35I don't think like 10 years is a long time right now and where the tech is. That's fair. In one year. Three months from now.

30:42Tracy Alloway:Will we still have browsers in three months from now? People are like, okay, we believe in 10 years, we'll achieve AGI. Will anyone be doing anything the same? Okay. So with that aside, I think there are some things I believe in and some things I think we don't know. I think you already see if you go back 10, 20 years ago, that the way you interact with the tech has evolved a bunch, right? It used to be it was just the laptop. Well, now it's the phone. Well, now it's also the watch. Okay. In some cases it's the glasses. This sense that it should feel like the information is sort of at your fingertips in whatever medium is useful.

31:18Right. And, but I don't know that this becomes a, we haven't so far replaced all of the old ones, right? Like you use the phone a lot more, but my guess is you're not doing all your cloud code work on your phone and you're doing some of it on a desktop.

31:33Tracy Alloway:That's true. Right. The introduction of the watch has supplemented, but it hasn't eliminated the desktop, right? So what's been interesting actually is that it hasn't gone in the direction of converging to the answer. It's actually increased the form factors. And so that you want to be able to access this information wherever you are in whatever form factor makes sense. And so will it be glasses? Will it be something else? Quite possibly. But let's say, let's even say it's glasses become a big deal. Glasses are very small screens, even there. You're probably not going to do your big productivity thing on desktop.

32:06So I think what you'll see is that the access point is not confined to one thing, but that the key is to eliminate the friction, right? And the toil. To your point, you had to do six steps. You didn't want to do the six steps. Why should you do the six steps, okay? I think you see that like, some things are much easier to do with a chat interface. and then some things, actually a chat interface is a super slow way to go do, right? Like if you have a list and you have to go say, please remove this long title for the 10th item, that's actually much harder to do with chat than like an interface that does that, right?

32:45So I don't think it necessarily converges on a single thing. I do think it should feel much more adaptive to your point about, well, if this is the way you prefer to interact, not just where you are, but how you interact? And can you customize and can you create to what extent do the user interfaces look designed for you versus look designed for general? And can you have influence in them? I think you'll see that. I do think we sometimes, like we're very aware of what doesn't work well. We're not necessarily aware of what does work well. Like companies spend huge efforts working on how do they do shopping carts really well.

33:18yeah okay this belief that sort of the chatbot will have a more optimized shopping cart for every shopping cart place in the world than the one you go to every day i don't know not clear right for those things but i do think it should feel much more personal it should feel much more dynamic it should feel much more ambient and available to you and i don't think it will be one size fits all either per person or per form document

34:12We'll see you next time. PayPal, Venmo, Pay Later, and all major cards, so you can focus on the future. When you need a partner trusted by millions, there's one platform for all business. PayPal Open. Grow today at paypalopen.com. Loan subject to approval in available locations. Go on, get a little out there, into the big heart of Nevada, where you can go off-road and off the map, on two lakes or on horseback. Dip into hot springs and dive into deserts. Climb a mountain or make your best effort. See thousands of stars in some of the darkest skies. Stake out haunted hotels. Can you make it to sunrise?

34:50There's always something new to see because we've got plenty of space to just be. Plan your trip at TravelNevada.com. Innovation is what gets your business to market. And Wasabi is designed to give every business a shot at competition. How? Break free from skyrocketing storage costs and unpredictable egress fees from old and top-heavy legacy providers. You know, the big guys. Wasabi is the world's hottest cloud storage company and the go-to provider for professional and collegiate sports teams and leagues around the world. And here's why. Innovation. From Wasabi's AI-enabled intelligent media storage, Wasabi Air, to the industry's only cloud storage service with triple protection against cyber criminals, data deletion and ransomware, the world's top companies trust Wasabi.

35:40Remember, Wasabi is up to 80 % less than market competition and doesn't charge a cent for businesses to access their own data. Wasabi, another championship story. Check them out for free at wasabi.com. Wasabi Hot Cloud Storage, proud partner of iHeart Podcast Network.

36:00Tracy Alloway:I've been reading some articles. I think I saw one, there was a big one in the information recently. Let's talk about one of your competitors' meta. Yeah, it's a competitor. And it was like, everyone's token maxing there. And there's a token leaderboard and people are competing to show that they're using AI more than others. And from my perspective, that boggles my mind because compute is a cost and just using compute per se does not strike me as a particularly good way of measuring who is productively contributing to the company. I mean, I could certainly find an quick recursive way to burn tokens.

36:36Generate a bunch of AI images of corgis.

36:38Tracy Alloway:Yeah, generate it and then create one that just keeps telling it to improve itself, etc. The flip side, which some people say is like, look, it doesn't matter at this point because everyone has to figure out how they're going to use AI productively in their work. So you know what? Don't even worry about metering AI. Tell everyone to pedal to the metal and AI use. And if someone is maxing out on tokens, it means they're experimenting with something and then they'll find something that really is a productivity enhancer. I'm curious if from your perspective, it makes sense to like essentially see token consumption or compute use as a proxy for like someone who's doing their job aggressively well.

37:20I think the thing with all of these proxy metrics is if you use them blindly, you're going to run yourself into trouble. Okay. If you as a leader sort of don't use judgment on them, then you get the example of like, I will just create a job that runs in the background and does dumb things to do the tokens, right? So as a leader, your job is to sort of use good judgment and not just think about the incentives. So if somebody isn't playing around at all with the tools, when we know that they can improve productivity, then we need to figure out like why and how we help support, like maybe there's some issue with the part of the system they're working on and we should go fix it.

37:58Or maybe we just need to help upstill them or whatever else the case is. I do think there is a level of experimentation required, right? So I don't think it works if your answer is like, you need to ensure that all your token use is completely optimized. Like, it's not going to work, right? People have to learn what's possible. They're doing different jobs. The tech is changing. But it can either be like, don't use the tools, or just max your tools blindly, it's a noisy signal, but it's a signal, right? So go look at it and understand as a place of where to look. Don't use it as a final judgment.

38:35So speaking of measures and not oversimplifying them, I want to go back to the sort of core attention that we started the conversation out with, which is the AI results versus people actually clicking through to results and generating traffic. And I know you were talking about AI being expansion or complimentary for Google search. But I'm very curious how you actually measure that. And the more granular you can get on this, the better. Like, what are you specifically looking at to say that actually this is something that's good for our business versus something that's detracting from the core?

39:13So I guess I would say, like, Google's guidance in Northstar has always been, like, focus on the user. That's our biggest question at the heart, is how do we make a great experience for users? And then you want to be thoughtful, obviously, about other – okay, if you don't have a healthy ecosystem, you can't build a service ongoing. So you need to make sure you're nurturing a healthy ecosystem. If you make no money, then you can't fund this wonderful service. So you have to be thoughtful about those. But the place you start with is try and build something amazing for users. One of the things we've seen again and again with Google search is if you're doing a really great job, people will not just do another query, they will come back to you more often.

39:58They will take their phone out of their pocket an extra time. That's a high bar. It's one thing to go and say, I've showed you something. Can you do one more thing while I'm showing it to you? It's another thing to get you to decide you're going to bother to unlock your phone. you're going to boot up your desktop, you're going to navigate in the browser. And so one of the things we really look for is when we're doing these changes, does it cause people to come to search more often, not just use search more often, but come more often. We also do various like UX research studies and try and understand what are people happy about or not, what are the things they find are frustrating, are more users adopting it, not just how much are they using it.

40:41So we of the biggest is really like, do you choose to come and ask Google? Like, do you essentially hire Google more often, right? For things you need. And one of the things that's very surprising to people at times is they think they come somewhere for all the questions they have already today, right? Like maybe they think they come to Google all the time or they think they go to Google plus LLMs or Google plus LLMs plus TikTok plus whatever. Okay. They think they ask all the questions they have. But that's not true. You actually make a calculation when questions go through your mind of, is it worth spending any time to figure out the answer to this question?

41:16Okay. And if the answer is no, then you just don't ask the question. Right? And so when we talk about AI as an expansionary moment, what we really mean is there's a whole bunch of questions people have, there's a whole bunch of curiosity that is people are not exploring. And they're not exploring because they view it as too difficult or too much time or not sure that it will be worth it. And AI lowers that barrier. And it can lower that barrier in ways that are sometimes for US English speaker are surprising, which is like, actually in a bunch of countries, there's not all the content in the web and the language you speak, okay?

41:55LLMs can help unlock that content. AI overviews, because it's using an LLM, can be more multilingual than just the web corpuses by default, right? Okay, so suddenly information that wasn't available to you as a Hindi speaker is now available. It can be visual. You had a question about this flower. You had a question about that cool purse you saw. Like, where can you buy it? But you didn't know how to describe it. It's possible. It can also just be like, my kid has a question. Do I say, like, I don't know? Or do I go ask the question, right? You see with young kids, they ask questions all the time, right?

42:26They go, why, why, why, why, why, why, why? And like, at some point, parents are like, because. Stop bothering me. Go ask the LLM. They go, okay. Let me Gemini that for you. But they do that because from a kid's perspective, they assume adults know everything, right? And it is no cost to them, right? They're not worried about their time and other things. As an adult, it's not that you're not curious. You just don't think everything is known and you don't have the time, right? And so if you lower that barrier, it allows you to be that kid again that just sort of explores all of these things. or get started on those projects that felt daunting or enables you to save or learn a new skill or whatever else.

43:07And that's really exciting. But I don't want to dismiss the wonder of being a kid and learning about the world, but I'm going to sound very callous in a second. But how do you make money off of that? Like, how do you make money off of the AI overviews? Is it just customer retention? Is that what we're basically boiling it down to? And then if it is customer retention, then you could have a strong argument for saying that like everything can just go through Gemini instead of search? I think I would say a couple of things. Search only shows ads on a subset of queries, right? You're like less than a quarter of queries, right?

43:39So there's a whole bunch of queries pre-AIO reviews, right? That you don't make money on because many of them are not of commercial need, right? And so you asked a question about tankers earlier. Probably pre-AIO, that query wouldn't have shown ads anyway.

43:55Tracy Alloway:It doesn't show ads now, by the way. Yeah. I checked this too. There were no ads on that. It doesn't show ads before. There are no ads on that query, right? Nobody's trying to advertise something on that. Okay. So those queries, AI overview is like, it doesn't disrupt, right? Then there's a bunch of class of queries where like you're shopping. The presence of an AI overview or Gemini Answers, it doesn't preclude the need to still buy the item. So there's still this huge opportunity with ads because there's all of this choice that's going. I think you also see that there's an expansion of queries, right, to this point.

44:30So you get more queries. And so some of those queries are more commercial. Some of them are not, but some of them are more commercial. And so those become new opportunities for ads. And there can also be things like when the query is underspecified or it's a single query, you actually don't know as much. So you can't maybe target the ads as well. If people start expressing more of their need, if it's more of a conversation, they're going more down funnel, you can actually create better ads, right? And so you can think about new opportunities for ads formats, right? Some number of years ago, people would have said like, how can you make money from a fee?

45:02Okay, well, Instagram ads are very popular, right? And so there's new ads formats as you recognize new technology and new opportunities, but the commercial needs are still often there and the desire for user choice is still often there. And so there's still a lot of possibility going forward. And so it's worked out very well right now with us in the balance.

45:22Tracy Alloway:So I realized that I am a user of both the Gemini app or Gemini.Google.com and just Google.com. And I have like a sort of real an intuition of which one I go to for which purpose. So if I want to look up the capital of Moldova, I'll just search capital of Moldova, which I just got. Do you know what it is, Tracy? Sorry, I'm not trying to stump you. No, I feel like you're going to say it. No, it's Kishinau. I'd never heard of it. Oh, no, I didn't know that. Yeah, I didn't know that either. But anyway, but if I want to understand what are some academic papers that have been written about why it is that high-frequency trading firms tend to not have outside capital, etc., and what was the theory for this?

46:07Tracy Alloway:I think at this point I would use Gemini for that and hope to – I'd use Gemini or some other ones. But within the context of this conversation, that's more of a Gemini query for me than a Google one at this point. Will there always be two boxes or do you foresee eventually there is just one box and it will just know this is like why do we need two boxes? I don't know what life will be like in five years. I think it's very – sometimes people want sort of an experience, although the information need seems like similar. They actually want different experiences across. And so if you take a pre-Ellum example, people use YouTube for search some.

46:51In the US, they use it some. In India, they use it a huge amount. They bring a bunch of queries that you would bring to Google search in the US. You could say, okay, well, why haven't we collapsed YouTube and search box into one search box and do that? And it hasn't enslave in the case. We have the Google app and we have Chrome. They both allow you to search and they both allow you to browse the web. You have a set of people that love the Google app and you have a set of people that love Chrome and you have a set of people that use both on a phone, but you can't necessarily convince either population that they want to stop using one app and just switch to the other app.

47:27So I don't think the space is so huge and it's changing so quickly right now that to sort of be able to know for sure whether or not you can create one sufficiently dynamic personalized experience that one app, one entry point can truly do it all. I don't think we know yet on that. People come for restaurant searches, they come to Maps, and they come to Google Search. We have not collapsed the Maps app and the Search app. At some point, it becomes big. You're putting all this directions code into the Google Search app. Is that actually useful, even if you had a full Maps view? So I think we're just going to have to learn over time about what's good.

48:08But the space is really giant and they do have different emphasis right now on what they try to excel at. And you want to make sure that in the attempt to bring things together, you don't become only okay at everything. And you want to make sure that you can shine at all the use cases people need. And that may mean two products or that may not. Or it may be a third product, right? Like I don't know in five years. There may be a third product that replaces all the products. You have your personal agent. You don't talk to any products. I don't know. So I realized we kind of promised to talk about AI slop a little bit in this conversation.

48:39So one of the things that's happening with AI is not just that I can ask a bunch of questions I might not otherwise have had time or the inclination to ask, but also AI is being used to generate vast amounts of content that are aimed at potentially answering any silly question I or anyone else on Earth might have. Creating space, yeah. Yeah, just churning it out. And I'm very curious how search is weighing, I guess, the quality of its results in the new slop era of the internet. I think there's a tendency at times to think about AI slop as if it's, before AI slop, there was slop. Yes. Right? Human-generated slop.

49:19There was human-generated slop. Now there's AI-generated slop. So there has always been slop on the web. And so what doesn't really matter at some level is how much slop is on the web so much as is there great content on the web and can you surface it, right? And this is Google's bread and butter in ranking and has a long history of looking for spam and trying to drop it and make sure it doesn't show. And, like, we crawl many, many more pages than we even put in our index. There's pages we put in the index that we never surface, right? So that we can keep that rate of spam and slop at a very low rate.

49:59And it is a constant effort, right? Like it's not a problem you solve because some of the people generating the spam, right, there's a lot of financial incentives associated with it. But that is what people have come to trust Google is that it will show great information. And it's a thing that we will continue to put a huge amount of effort in. And so that's the way I would think about it. It's not like how much AI slop or human-generated slop or whatever automated slop pre-AI, post-human-generated there is, but making sure that the information you do see is trusted.

50:35Tracy Alloway:Liz Reed, thank you so much for coming on OddLoss. That was a fascinating conversation. I have like a billion more questions, but we'll have you on in three months when the entire world has changed and we'll get an update from you. Thank you very much. It was a pleasure to be on with you.

51:03Tracy Alloway:I like the point about human-generated stuff. Do you remember? Yeah, but the difference is the volume. No, I know. I get it. But do you remember Jason Calacanis' startup Mahalo? No. So Jason Calacanis, who's been on the podcast before, he had this startup for a while. It was like the biggest piece of garbage in the world. No, for real. People need to go like a – it was called Mahalo. And the idea was like they were just going to hire a lot of people to like write articles that were not very good to like appear in Google. Oh, I see. To swamp the – Yeah, there was a famous one that my old colleague at I think Business Insider, Nick Carlson, discovered.

51:40Tracy Alloway:And it was like, if you search how to play the xylophone, there was a Mahalo article for that. And it was, I swear to God. Okay. It was step one, decide if you want to play a xylophone. Well, that's an important step. Step two, get a xylophone. Step three, learn to read sheet music. Step four, practice reading sheet music and play. So like this was actually like this. I'm just remembering like it is people have been trying to like stuff complete garbage into the search results for a very long time. And I always get a chuckle thinking about that example. And you should go look for it. I'm looking for it now.

52:21I'm very distracted. It was so bad. Wait, we're just going to like laugh about this article for. Look at this. Just search it.

52:30Tracy Alloway:Mahalo, how to play the xylophone. Yeah. I see something from Mahalo.com on YouTube. That can't be it. Yeah, yeah. Just search. So, yeah, Business Insider, February 21. Hilariously useless. Mahalo is a guide to playing the xylophone. Did you write that? No, Nick Carlson wrote it. Oh, I see it. He wrote it up. Yeah, yeah. Unfortunately, now it's behind a paywall and itself is covered in sloppy ads. So, I guess. But anyway. Sorry. Decide whether you want to buy a used or new xylophone. metal xylophones are less expensive than wooden ones please that's useful that's a useful tip i know but when you see that it's like please ai like save us from this human generated garbage they were trying to clog search results before all right on a serious note yeah i did think the point about not customer retention but like expanding the volume of like user queries on the platform made a lot of sense totally which i hadn't like really considered that much before So even if you do get a bunch of no-click users, they are more inclined to come back to the platform in the future.

53:37And maybe some of that eventually lands in clicks. The other thing I hadn't thought of, and I thought it was a great point, which is that Google currently runs multiple search boxes.

53:48Tracy Alloway:Are you looking at the Mahalo article and cracking up right now? I'm sorry, I am. Step four is experiment with different mallets. It's so good. I just really want to play the xylophone. It's so good. It's so good. Step five is practice regularly. I think AI is much better. It's so good, isn't it? It's like the biggest steaming pile of garbage I've ever seen on the internet. 15 years or 10 years before anyone has ever... Can we have Calacanis back on the podcast just to talk about this? We should have Jason back on the podcast just to like grill him about what exactly he was thinking and his sins against the internet for having put this on there.

54:34Well, he was an early adopter of non-AI slob.

54:38Tracy Alloway:But anyway, that point about there are multiple search boxes already, right? There's the YouTube search box. You're still laughing. I'm sorry. I was trying to make eye contact with you and not look at my computer. It's so ridiculous. I'm just thinking about the silo phones. Should we just leave it? Yeah. All right. Okay. All right. Yes. Shall we leave it there? Let's leave it there. This has been another episode of the Odd Lots podcast. I'm Tracy Alloway. You can follow me at Tracy Alloway. And I'm Joe Weisenthal. You can follow me at The Stalwart. Follow our producers, Carmen Rodriguez at CarmenArmond, Dash O 'Bennett at Dashbot, and Kale Brooks at Kale Brooks.

55:10Tracy Alloway:And for more Odd Lots content, go to Bloomberg.com slash Odd Lots. We have a daily newsletter and all of our episodes. And you can chat about all of these topics 24-7 in our Discord, discord.gg slash Odd Lots. And if you enjoy Odd Lots, if you like it when we talk about AI and human-generated slop, then please leave us a positive review on your favorite podcast platform. And remember, if you are a Bloomberg subscriber, you can listen to all of our episodes absolutely ad-free. All you need to do is find the Bloomberg channel on Apple Podcasts and follow the instructions there. Thanks for listening.

55:52Thank you.

56:22strategies can't prevent every bad day. A fire, a loss, a disruption that demands immediate attention. When that happens, what matters isn't just what you planned, it's who shows up. That's where Cincinnati Insurance comes in. For more than 75 years, they've helped individuals and businesses navigate life's toughest moments with care, expertise, and personal attention. Together with independent agents, Cincinnati Insurance focuses on relationships, not transactions. Their approach is grounded in experience, follow through and trust built over time. Bad days happen. And when they do, you deserve an insurance partner who understands risk, respects what you've built and is ready to help you move forward.

57:04The Cincinnati insurance companies, let them make your bad day better. Find an independent agent at CINFIN.com. Go on, get a little out there into the big heart of Nevada where you can go off-road and off the map on two lakes or on horseback dip into hot springs and dive into deserts climb a mountain or make your best effort see thousands of stars in some of the darkest skies stake out haunted hotels can you make it to sunrise? There's always something new to see

57:37Tracy Alloway:because we've got plenty of space to just be Plan your trip at TravelNevada.com Ryan Reynolds here from Mint Mobile, with a message for everyone paying big wireless way too much. Please, for the love of everything good in this world, stop. With Mint, you can get premium wireless for just$15 a month. Of course, if you enjoy overpaying, no judgments, but that's weird. Okay, one judgment. Anyway, give it a try at mintmobile.com slash switch. Upfront payment of$45 for three-month plan, equivalent to$15 per month required. Intro rate first three months only, then full price plan options available. Taxes and fees extra.

58:12See full terms at MintMobile.com.

From the publisher

Not too long ago, search engines were the dominant form of querying the internet. But that's changing since the rise of large language models like ChatGPT, Claude, and Google's Gemini. More and more people are getting their online info through AI, effectively bypassing the search bars of old and creating a tension for large tech companies that offer AI models, but also make money from web traffic and search-related advertising. In this episode, we speak with Elizabeth Reid, VP of search at Google. Liz has been with the company for more than two decades, witnessing multiple tech transformations in that time. So we talk with her about how Google is incorporating Gemini into search via AI overviews, what that means for traffic and ad sales, and the practical experience of search in an age of LLMs and internet slop.

Subscribe to the Odd Lots Newsletter
Join the conversation: discord.gg/oddlots

See omnystudio.com/listener for privacy information.

More from Odd Lots

All 682 episodes
Google's Liz Reid on Who Will Own Search in a World of AIOdd Lots · 51 min
Listen in VO