In short
This episode is a weekend special from the Bloomberg Tech Summit in San Francisco, featuring conversations about AI’s impact on productivity, safety, cybersecurity, and even music. Samir Samat (Google) argues Android is evolving into an “intelligence system” that acts on user intent, not just searches; he cites a Gemini example that analyzes a barbecue guest list and auto-builds an Instacart shopping cart, saving minutes. He claims Android’s open ecosystem lets users choose assistants (Gemini, Claude, etc.) and that Google’s advantage is a full stack from data center models to the OS, including “Gemini Intelligence” on premium Android devices. Yoshua Bengio (Mila Quebec) warns AI is unreliable and unsafe to control, stressing international coordination; he highlights risks like cyberattacks, AI-designed viruses, and AI-agents creating unsafe successors, while also pointing to positives like drug and battery design. Rafi Krikorian (Mozilla) discusses “Mythos” finding browser vulnerabilities that could enable code execution and stresses a Y2K-like, large-scale patching effort for critical infrastructure. Hit-Boy (rapper/producer) says AI music tools are “music,” not a creativity killer, and frames his solo album “Software Update” as personal self-improvement.
Guests
Samir Samat; Yoshua Bengio; Rafi Krikorian; Hit-Boy.
Written by AI. May contain mistakes. Listen to the episode to check what was said.
Chapters
Tap a time to open that second in VOBloomberg Tech Summit Overview
0:06 to 0:19
An overview of the Bloomberg Tech Summit and its significance in tech and business.
“Chase for Business helps business owners like you with personalized guidance and convenient digital tools all in one place.”
Bloomberg Tech Summit Overview
1:56 to 2:24
An overview of the Bloomberg Tech Summit and its significance in tech and business.
“Welcome to the weekend edition of Bloomberg Business Week.”
Interview with Samir Samat
2:24 to 2:54
Discussion with Samir Samat on Android's global positioning and ecosystem.
“How do you position Android in the United States versus how you position it globally?”
The Future of Operating Systems
2:54 to 4:32
Exploration of how operating systems are evolving towards intelligence systems.
“They use it for smartwatches and all kinds of new devices, including some smart glasses that we're working on for later this year as well.”
AI Use Cases and Productivity
4:32 to 6:06
Discussion on practical AI applications and their impact on daily tasks.
“Does it know what we want before we want it?”
Communicating AI's Value
6:06 to 8:00
Understanding how to effectively communicate the benefits of AI to users.
“with the technology to understand how it can help you and what the limits of it are.”
AI's Role in Personal and Professional Life
8:00 to 8:53
Discussion on how AI impacts various industries and everyday life.
“And when I got home, I looked like super dad, you know, because I could answer these questions and go back.”
Gemini and Android Ecosystem
8:53 to 14:00
Exploring the integration of Gemini AI within the Android ecosystem.
“when you guys announced a bunch of upcoming features for your Android 17 operating system, you made some comment about there's a great concern about AI for AI's sake, and we want to be very purposeful.”
Gemini and Android Ecosystem
14:36 to 14:47
Exploring the integration of Gemini AI within the Android ecosystem.
“Public has modern design, powerful tools, and customer support that actually helps.”
Gemini and Android Ecosystem
14:53 to 15:06
Exploring the integration of Gemini AI within the Android ecosystem.
Show all 27 chapters
Gemini and Android Ecosystem
15:42 to 15:58
Exploring the integration of Gemini AI within the Android ecosystem.
“The Splash into Savings event from Apple Vacations is here.”
Introduction to Yoshua Bengio
16:12 to 16:46
Introduction of guest Yoshua Bengio and his expertise.
“This is Bloomberg Business Week Daily with Carol Masser and Tim Stenevek on Bloomberg Radio.”
The Safety of AI
16:46 to 17:46
Discussion on the safety concerns regarding AI systems.
“We're building systems that we don't know how to control.”
International Cooperation Needed
17:46 to 19:15
The necessity for global collaboration on AI governance.
“And, you know, so the Americans need to make sure the Chinese models are not used against the U.S.”
The Doomsday Scenario
19:15 to 20:39
Exploration of catastrophic risks associated with AI misuse.
“could be used by terrorists or countries which want to destabilize us.”
Balancing Potential Positives and Negatives
20:39 to 22:24
Discussing the potential benefits of AI amidst concerns.
“I think I should have been seeing ahead earlier that we were building something that could become extremely powerful and that we don't know how to control.”
Historical Context of AI
22:24 to 23:36
Comparison of AI's impact with historical technological changes.
“We're already having, like if I think about democracy, let's go there.”
Productivity and Investment in AI
23:36 to 24:39
Examining the promises of AI on productivity and ROI.
“founder and scientific advisor at Milo Quebec AI Institute, co-president and scientific director at Law Zero.”
AI and the Labor Market
24:39 to 26:12
Impact of AI advancements on jobs and the economy.
“So we talk about races in the world, and this is certainly a tech race, an AI race, right?”
The Need for Safety Principles
26:12 to 27:22
Discussion on the importance of safety principles in AI deployment.
“Joshua, given the work that you've done in this, understanding the potential pitfalls of the technology, name names for us.”
Hopeful Perspectives on AI and Society
28:04 to 28:49
Explore the hopeful outlook on the intersection of government and technology.
“But now we enjoy all these things that are safe and useful because government's having to beat.”
Hopeful Perspectives on AI and Society
28:53 to 29:45
Explore the hopeful outlook on the intersection of government and technology.
“R &D spend, small cap stocks with improving operating margins, or the S &P 500 minus high debt companies.”
Insights from Rafi Krikorian on AI Security
31:13 to 39:41
Rafi Krikorian discusses AI vulnerabilities and the importance of security.
“Welcome back to our special edition of Bloomberg Business Week.”
Hit Boy on Technology in Music Production
39:41 to 42:00
Hit Boy shares his experiences with technology's impact on music creation.
“rapper, and recording artist who has spent over a decade engineering the soundtrack to hip-hop culture, producing hit songs for artists including Jay-Z.”
Hit Boy's Creative Journey and Upcoming Album
42:00 to 43:52
Hit Boy shares insights on his creative process and the meaning behind his solo album.
“And as many hits as I did make, I still feel like I wasn't in my complete right mind because that was always lingering.”
Hit Boy's Creative Journey and Upcoming Album
44:01 to 44:24
Hit Boy shares insights on his creative process and the meaning behind his solo album.
“Today's top stories and global business headlines are coming up right now.”
Hit Boy's Creative Journey and Upcoming Album
45:07 to 45:33
Hit Boy shares insights on his creative process and the meaning behind his solo album.
Transcript
Automatic transcript. May contain errors.0:00Small businesses are the pulse of every community. They bring people together, create opportunities, and drive growth. Chase for Business helps business owners like you with personalized guidance and convenient digital tools all in one place. With that guidance and your determination, you can take your business farther and help build a brighter future for your community. Learn more at chase.com slash business. Chase for Business. Make more of what's yours. The Chase mobile app is available for select mobile devices. Message and data rates may apply. JPMorgan Chase Bank, N.A., member FDIC. Copyright 2026, JPMorgan Chase and Company.
0:37When you're running a business, the best days are the ones where priorities stay on track. For midsize and large companies, risk can affect multiple parts of the organization at once, from property and liability to cyber and regulatory challenges. At that level, managing risk becomes an ongoing discipline. At the Hartford, the focus is on helping businesses manage risk before it turns into something more disruptive. And when losses do happen, that work is paired with insurance coverage shaped by years of underwriting, risk engineering, and claims experience. Learn more at thehartford.com slash risk mitigation.
1:12Policies provided by Hartford Fire Insurance Company and its property and casualty affiliates, Hartford, Connecticut. This coffee shop? Running smooth thanks to genius. From global payments, instant transactions, effortless inventory, and synchronized operations. Big League reliability for any business. That's genius. This is Bloomberg Business Week Daily, reporting from the magazine that helps global leaders stay ahead with insight on the people, companies, and trends shaping today's complex economy. Plus, global business, finance, and tech news as it happens. Bloomberg Business Week Daily with Carol Masser and Tim Stenevek on Bloomberg Radio.
1:55Hi, everyone. Welcome to the weekend edition of Bloomberg Business Week. This week, we were live at the Bloomberg Tech Summit in San Francisco. The summit brings together leaders across tech and business. It brings insightful conversations and connections around today's cutting-edge technologies and how they affect business and beyond. Today, we're going to bring you some of our favorite conversations from the event. We'll hear from leaders across the tech sector, including CEOs, tech executives, and even a Grammy Award-winning rapper and producer. First up this hour, we spoke with Samir Samat, president of the Android ecosystem at Google.
2:29How do you position Android in the United States versus how you position it globally? Where is more widely adopted? Well, Android is an open source operating system, which is really great because it allows people to build all kinds of different devices. So, of course, we know that Android is popular for phones today, where there's over three and a half billion Android devices that are used every day. It's the most widely used operating system in the world. But Android is so much more than phones. People use it for cars. They use it for televisions. They use it for smartwatches and all kinds of new devices, including some smart glasses that we're working on for later this year as well.
3:04So it's really become much more than phones, and it's a whole ecosystem. How do you think about an operating system within an AI world? That is, we're still kind of figuring it out, right? We're all finding our way here. Well, it's changing a lot. Things are changing all around us. And I think the way we think about this moment is we're moving from an operating system to what I call an intelligence system, one that is able to be more predictive and more helpful in the moment for you. So instead of making you the micromanager of your device, which is the way I think computing's worked for 40 years, you have the idea in your head and you use a pointing device or taps to take that idea and do all the things you need to do to get things done.
3:45In this new AI era, how can we actually make the system much smarter? So you give it your intention, your goal, and it can translate that into the action that it needs to take to help you get more done. Yeah, I want to push on that a little bit because I still think when right now, when a lot of people think about AI, they equate it with LLMs and they think about LLMs not necessarily as, you know, clog code or helping us vibe code, but rather as glorified search engines. And that actually does search a lot better than we've grown up using. What is the value proposition for an ecosystem in the world of AI?
4:23Because you're explaining this idea of us being more productive as a result of this technology. But I don't even know what that looks like. Is it predictive? Does it know what we want before we want it? Like, what is it? Which just gets a little creepy then. Potentially. Potentially. Let me give you one simple example that I used a new release of Android with Gemini for recently on my Pixel device. which is you know i had a list of folks that are coming to a barbecue that i'm holding and next to each person i had how many people are coming in their family are they vegetarian are they not vegetarian you know the normal thing you do when you're throwing a party you make this list but like where do you put that list does that go in google docs i think i just had it in an email that i was writing to myself you know like we all do sometimes and i asked jem and i working on my pixel device can you take this list analyze it figure out how many hamburgers how many hot dogs how many buns, and then go to Instacart and add it all to my shopping cart, and then let me check it out.
5:23And it took that, figured out all the vegetarians, figured out all the things, figured out how many people are coming, how many kids, how many not kids, and it did it for me. And so that probably saved me, I don't know, six, seven minutes. You add that up multiple times a day throughout all the things that we're doing, and that's really helpful. Samir, what do you think in terms of the conversations that we're having about artificial intelligence? Because I do feel like you and I were talking about this at dinner last night. We're just scratching the surface in terms of certainly how we use it and how we need to push ourselves to better understand what this tool can do or eventually do.
5:56Well, I think the most important thing right now is for all of us that are in the industry or even around the industry is to make sure we have hands-on experience. One of the things we tell our teams and I tell my kids as well is we should engage with the technology to understand how it can help you and what the limits of it are. And it's changing so quickly what I tell folks is even if it wasn't able to help you with something this month put a note for yourself and check back three months later because it's moving so fast what I think is important about your example is that you had the initiative to actually ask Gemini to do that I think that the challenge in this world is that a lot of people don't know that LLM's like Gemini can actually do that sort of thing so they wouldn't even know that With that example, AI could save them six or seven minutes.
6:46How do you communicate that to a population that has no idea what this technology can do, truly has no idea? You know, in the beginning when these interfaces came out, you had a chat prompt. And we didn't know what we could type into it. And I think people do discover over time by trying things. But most importantly, the software itself, this is where the operating system can be really helpful. You know, when you talk about an intelligence system, it should be able to understand from you what your intention is. You know, what's my goal? What am I trying to get done? Oh, I'm planning a party. Okay, well, did you know I can help you with this?
7:26You know, and to prompt you to do that and to show you how that it can assist you in that moment. And that's a different kind of user interface than what we've seen. What I have noticed is with Google search, it's actually pushing me to Gemini within within web-based Google search and it's becoming very natural. So it's sort of like, I'm not starting at Gemini, I'm starting at Google search and then using it, interacting with search like an LLM. Well, I'm glad it's helping you. That's great. You know, we have, we have so many different tools that, that, that I think are, are there for folks. And I just want to give one small example of one called notebook LM.
8:02And if you're, if your viewers haven't checked out notebook, people love this yes i mean notebook lm is one of my favorites and you know on the android app for example for notebook lm my son who just finished finals he was like dad can you help me study for for the science final and i said sure overly confident as i am about this and then he gave me the material and i looked at it and i said i haven't reviewed this in years you know but tonight i have to do a study session with him so i put it all in notebook lm and it gave me an audio podcast that I listened to on the way home. And when I got home, I looked like super dad, you know, because I could answer these questions and go back.
8:38This is where it starts to become helpful. And I think it's all about the purpose, the way in which we use this technology in a purposeful, intentful way to help make our lives better. And that's what we're trying to do. So let's go there, because last month when you guys announced a bunch of upcoming features for your Android 17 operating system, you made some comment about there's a great concern about AI for AI's sake, and we want to be very purposeful. What does that mean? Well, I mean, I think if you look at any, just go talk to people, the word AI has become pretty overloaded, and I think people are, they have mixed feelings about it.
9:18Let's put it that way. I think what they really want is to not hear about the technology. What they really want is to hear about how is this going to help me. I gave the Notebook LM example, but there are so many more. that when you talk about how this can help you, it changes the conversation. I'll give you one of my favorites from Android. Android has a feature called Circle to Search. And Circle to Search is really simple. You'll hold down the Home button, and then you see a flash, and at that point you can circle anything on your screen. Let's say you have a celebrity on your screen wearing a great outfit.
9:54Circle it and say, Shop the Look. and Google will go take what they're wearing and figure out what the jacket is, what the tie is, all the different pieces, and bring back each of those to you so that you can figure out where to buy them and if they're right for you. There's a ton of AI behind the scenes there. That's not the important thing. The important thing is that it's super helpful, packaged in a way that's intentful, purposeful for the user to help them get something done that they couldn't do before. Samir, where do you think AI impacts our world the most? Is it in our personal lives?
10:27Is it in our work lives? Is it everything? We keep talking about what it's going to mean for our healthcare and medical world. Where do you see it impacting our world the most or will it be everything? Well, I think there's a number of places that it's already impacting our world. But I think if you take the discipline of software engineering, for example, that's going through a lot of change. I think exciting change. But also there are people who are concerned changes with that as well. I think in the end it will be very productive and we're going through that same change at Google as well. But I think if you look at every industry, there are amazing applications.
11:01If you look at biotech, there will be amazing applications. If we look at, as you said, healthcare, there will be amazing applications. I'm wearing my new Fitbit Ace. Yeah, if you're listening on radio, Samir's got a Fitbit on one wrist. It looks like an Android watch. I have a Pixel watch. An Oura Ring. He's got to check out what the competition is doing. If you have any others to record it. So I want to go back to this whole idea of the ecosystem and and how it relates to AI and Gemini and the stickiness of it. Because I think that's a part of the conversation that really has just recently occurred to me.
11:34And I'm wondering what advantage you think Google has having Gemini as its own AI operating system along with Android and not working seamlessly across whether we're talking about your Fitbit, whether you're talking about an Android phone, whether you're talking about a Pixel watch, versus sort of third-party LLMs like, you know, Claude or ChatGPT? I want to say a couple things about that. First, you know, Android is an open platform. And so one of the things that's the central tenant of Android is choice. So Android is the only mobile operating system where you can choose your personal assistant.
12:11You can choose the agent that's important to you. So if you want Gemini, you can use Gemini. If you want Claude or something else, you can choose that. And those will work equally well? Yeah. The idea with Android is that it's open and so you should be able to plug in what's important to you. That's a fundamentally important part of Android and I think it's an advantage in this world when things are moving fast. From a Google perspective, of course, Google competes with some of those companies. And I think Google has a unique position in that it has a full stack of innovation that it's worked on over a decade from Silicon, unique Silicon in the data center, foundational models, all the way through to the operating system.
12:47And we want to connect those things in ways that are powerful and that help consumers live better lives. That's what we're doing. In fact, recently we announced something called Gemini Intelligence. Gemini Intelligence is the best Gemini experience available on the most premium Android devices. So take a Samsung device or a Pixel device. And that's really where you can experience the best of that entire stack. Do you think being open source and being able to let users choose and select what their agent will be will give you guys longer term an advantage? Because I do think there's folks say that at some point there's going to be some shake out because we're not going to need necessarily every big LLM.
13:28Like at some point people are going to financially, we heard it from the Cerebris CEO last night, that people are going to select kind of what they need and want. I think that competition is good. And I think that it's led to a ton of innovation. I mean, look at all the change we're seeing. That's fueled by everyone competing, which is great. From an Android perspective, the thing about Android being open source and being an open ecosystem, it means that we work with many, many different partners. That was Samir Samad, president of the Android ecosystem at Google. You're listening to a special edition of Bloomberg Businessweek.
14:01Coming up, more conversations from our trip out west to the Bloomberg Tech Summit in San Francisco. I'm Jim Stanovic, along with Carol Masser. This is Bloomberg.
14:35all the bugs or the confetti. Retirement accounts, yep. High yield cash, yes again. They even have direct indexing. Public has modern design, powerful tools, and customer support that actually helps. Go to public.com slash market and earn an uncapped 1 % bonus when you transfer your portfolio. That's public.com slash market.
15:05zero hash. All investing involves risk of loss. See complete disclosures at public.com slash disclosures. Ryan Reynolds here from Mint Mobile. I don't know if you knew this, but anyone can get the same premium wireless for$15 a month plan that I've been enjoying. It's not just for celebrities. So do like I did and have one of your assistant's assistants switch you to Mint Mobile today. I'm told it's super easy to do at mintmobile.com slash switch. Upfront payment of $45 for a three-month plan, equivalent to$15 per month required. Intro rate first three months only, then full price plan options available.
15:38Taxes and fees extra. See full terms at mintmobile.com. Apple Vacations, where your story starts. The Splash into Savings event from Apple Vacations is here. Now through June 25th, save up to$150 on vacation packages, plus instant savings at select resorts in Mexico, the Caribbean, Central America, and top U.S. destinations. Use promo code June 26 for these limited time offers. Start planning today at applevacations.com or contact your travel advisor. Apple Vacations, where your story starts. This is Bloomberg Business Week Daily with Carol Masser and Tim Stenevek on Bloomberg Radio. Welcome back to a special edition of Bloomberg Business Week.
16:22We are taking a look at some of our conversations from this past week when we were live at the Bloomberg Tech Summit. Up next, we spoke with Yoshua Bengio, founder and scientific advisor at Mila Quebec AI Institute. He's a leading expert of artificial neural networks and deep learning. Professor, good to have you on the program. You chair the International AI Safety Report. We'll just start there. Is AI safe? No, that's the problem. We're building systems that we don't know how to control. They will behave sometimes against our instructions. And that is, this lack of reliability is both a scientific challenge and a problem for the deployment of AI.
17:07So how do we, okay, if we use social media as the example, we failed that experiment, I think many would say, that we did not keep ahead in terms of oversight, regulations. We could go into all the things that have gone wrong and how it's impacted society. What faith do you have that we get this right? And it can't just be the U.S. deciding or Europe deciding. I mean, it's got to be a global work or progress on this. Absolutely. Safety is a global question because a dangerous model, I mean, one that can be misused in dangerous ways, like mythos, for example, could be designed in one country, and then somebody in a second country uses it to attack a third country.
17:46And, you know, so the Americans need to make sure the Chinese models are not used against the U.S. and vice versa. It is an international question. Can I ask you, is it like missiles and nuclear weapons and that there will be a mutual deterrence because everyone will be proficient on some level when it comes to AI? There are analogies. I think one of the big differences is that there isn't as much money to be made with nuclear weapons as there is with AI, which means the incentive structure is now pushing companies towards going faster and faster and not paying enough attention to the safety issues and, you know, the public protection.
18:25But I think one thing that I think concerns a lot of people is that, okay, you could have, let's just use Anthropic as an example. You have Anthropic and what they're doing with Mythos. But just because Anthropic has that right now doesn't mean DeepSea couldn't have that six or eight or 12 months from now or even something more powerful. That's right. So it doesn't matter if one country is doing things a certain way or one company is doing a certain way. if the entire world is not actually adhering to a certain set of framework. Exactly. That is why we need international coordination. Initially, it's probably going to be just the U.S.
18:59and China. But at some point, as other countries are also beefing up their capabilities, it has to be international. What keeps you up at night? Lay out the doomsday scenario for us. Well, there are many catastrophic risks because intelligence gives power. And that power could be in the wrong hands. could be used by terrorists or countries which want to destabilize us. It could be used even by the people in power to create a dictatorship. And we don't know how to make sure AIs themselves will not use that power against us. But how? Like harnessing social media, logging in, like taking infrastructure offline.
19:35Like give us concrete examples of what these entities could do. So what the companies are worried about right now are cyber attacks, because these AIs really have a lot of knowledge of computing and vulnerabilities. And on their radar and the evaluations they're making is also the use of AI to build dangerous viruses. So you can think of people using AI to create new pandemics. They're also worried about what happens when AI itself is used to create the next version of AI. So AI doing AI research. And if we don't control these systems, they could put back doors to create AIs that are not friendly to us.
20:15Okay, now I am worried. So in other words, you're talking about AI that can think on its own and work on its own. Well, it's already the case. The whole point of agents is that they're autonomous, they have goals, and they work towards those goals. The real question is, who controls those goals? We would like to be the ones in charge, but right now we don't have the technical answers to make sure that's the case. Yashua, do you regret the work that you did years ago? I think I should have been seeing ahead earlier that we were building something that could become extremely powerful and that we don't know how to control.
20:52And it would impact societies in which that currently, on the current trajectory, could be destructive. So, okay, but here we are, right? Yes. and it sounds like it does feel very doomsday and scary but i do and it also feels like it's too late no it's not but and i want to talk about that but i also feel like there's a lot of potential to do some great things as well yeah talk to us about that side absolutely i've been working for many years on how we can use ai to design better drugs in medicine more broadly how we can use ai to design better materials for batteries, for energy storage. And I know a lot of people working, for example, in how AI can help agriculture, can even help democratic debate tools.
21:41The question is, the same power that enables these things also enables, for example, in the case of biology, dangerous uses that could really harm a lot of people. Do the potential positives outweigh the potential negatives? Well, there's so much we don't know here. You have to weigh in the uncertainty. Because it sounds great to have better medicine. It sounds great to have more efficient batteries. It sounds great to have an ecosystem where people are able to learn more and do quicker and be more efficient. But none of that matters if the AI agents are going to kill us. Yes. Or if we lose our democratic institutions and we end up in a dictatorship.
22:23So these are some seeds. We're already having, like if I think about democracy, let's go there. Yes. Right? We're already having these kinds of problems. We do. And this is a pre-willing gate. We do, but it could get worse. There are studies showing that AI is now getting better than people at persuasion. In other words, making people change their mind. Imagine this applied to change political opinions, to change public opinion. This is like shaking the foundations of what democracy rests on. You know, I don't know. So, you know, people talk about the new industrial revolution. They make comparisons.
22:58Do we have any comparison in terms of the impact AI agents? No. I mean, as usual. It's something else that's changed our world dramatically. The light bulb. As usual, I think, you know, the past can tell us things. But you have to realize we've never been in a situation where we built technology machines that would be smarter than us in many ways. and it's already the case in various domains. It's just going. There's nothing in history. We build machines that help us physically to have much more powerful muscle-wise, but brain-wise, this is completely new. We're speaking with Yoshua Bengio, founder and scientific advisor at Milo Quebec AI Institute, co-president and scientific director at Law Zero.
23:43It's focused on building safer AI agents. The productivity question is one that we want to get to. The investment that's been made from a CapEx perspective has just been so massive. The promises are that this will actually make us so much more productive and will lead to higher returns on investment. Is that true? I don't have a crystal ball. But let's say there are different scenarios about how AI intelligence capabilities will grow in the future. I think the default is going to continue on the same trend. But it could also saturate. And maybe some of these promises will not be realized. The other issue is even if AI is more capable, it doesn't mean that it is behaving well.
24:27In fact, there is a serious scientific hypothesis that intelligence and the goals to which that intelligence is put to use are like two very different things. All right. So we talk about races in the world, and this is certainly a tech race, an AI race, right? So it sounds like for things to go better, safer, you've got to have global collaboration. So what is happening on that regard or what needs to happen in your view? Based on your knowledge, you understand how this works. So what needs to happen to make sure that we don't have AI taking over? I would say the most important thing that needs to happen is better understanding and awareness of what we're talking about by the governments around the world.
25:14and, of course, China and the U.S. in the first place, but eventually many governments who have researchers and companies building AI as well. Because once we understand the magnitude of the risks that we're taking, we'll sit down. We'll sit down at a table and negotiate. One of the things I want to go back to what you said about productivity, what about the labor market? Like, is it going to create, it's already tough for some of those starting jobs, I think, of kids coming out of college. What does it mean for the global economy? What does it mean for the labor force? Does it create jobs? I mean, building data centers, yes, but how do you see it?
Read the full transcript
25:52I mean, the number of people needed for data centers is peanuts compared to the effect that AI could have on the job market. But the economists don't agree. It really depends on the curve of advances in AI in the future. If it continues at a current rate, then yes, there will be massive automation coming too quickly for society to adapt. Joshua, given the work that you've done in this, understanding the potential pitfalls of the technology, name names for us. Who's doing this well? Who understands the potential repercussions here? I don't name names. I think there are a lot of people who have good intentions.
26:31The issue that makes the current dynamics dangerous in some ways is the incentive structure. is the competition between companies, the competition between councils. So maybe I'll ask this question a different way. What if you could have Dario Amadei in a room with Sam Altman, along with Jensen Wang, along with the leaders of all the hyperscalers, and then, of course, the leaders of the Chinese companies as well? What would you tell them? What do they need to know? So they know already, right? They know what I'm talking about. Tell them. What they need to do is to agree with each other on a set of principles about safety and careful deployment of AI.
27:16And they're already talking about it. What they are asking, actually, is governments to agree with each other to make sure there's a level playing field for all the companies so that every company before they build and deploy a very powerful AI needs to show to the public, to the governments, that their system isn't going to be dangerous in the wrong hands and all these issues we're talking about. But are the financial incentives getting in the way? The race is on to spend and spend. Yeah, it seems like a prisoner's dilemma. Yes. And it's who can go fastest and get it all done. So does that prevent the right thing from happening?
27:52You've just got about 30 seconds left. Well, no, we've dealt with situations like this before. I mean, governments have regulated things like drugs, trains, meat. because if it was just competition, we would end up with dangerous food, dangerous planes, dangerous drugs. But now we enjoy all these things that are safe and useful because government's having to beat. So in a word, yes or no, you're more hopeful than worried? Yes, hopeful or no? I don't know. I feel like it's not my vision that matters. It's the actions that we take collectively. That was Yoshua Bengio, founder and scientific advisor at Mila Quebec AI Institute.
28:42Founder and scientific advisor at Mila Quebec AI Institute. You're listening to a special edition of Bloomberg Businessweek. Coming up, more conversations from our trip out west to the Bloomberg Tech Summit in San Francisco. I'm Tim Stenevec with Carol Masser. This is Bloomberg.
29:23R &D spend, small cap stocks with improving operating margins, or the S &P 500 minus high debt companies. Chances are there isn't an ETF that fits your exact criteria. But on public, you just type in a prompt and their AI screens thousands of stocks and builds a one-of-a-kind index. You can even backtest it against the S &P 500. Then you can invest in a few clicks. Go to public.com slash market and earn an uncapped 1 % bonus when you transfer your portfolio. That's public.com slash market.
30:21Save up to$150 on vacation packages, plus instant savings at select resorts in Mexico, the Caribbean, Central America, and top U.S. destinations. Use promo code JUNE26 for these limited-time offers. Start planning today at AppleVacations.com or contact your travel advisor. Apple Vacations, where your story starts. You're a pro at running your life, at committing to your workout, at showing up every day. At Bombas, we're pros, too. Pros at making socks. Our Sport Assortment has specialized socks for whatever sport you're committed to. Running, hiking, golf, Pilates, and so much more. Made with sweat-wicking yarns, blister-fighting details, and targeted arch support.
31:02Bombas Sport is pro-level socks from the pros of socks. For another pro, you. Go to bombas.com slash audio and use code audio for 20 % off your first purchase. That's bombas.com and use code audio. This is Bloomberg Business Week Daily with Carol Masser and Tim Stenevek on Bloomberg Radio. Welcome back to our special edition of Bloomberg Business Week. We were live at the Bloomberg Tech Summit out on the West Coast in San Francisco. Up next, we speak with Rafi Krikorian, Chief Technology Officer at Mozilla. People know Mozilla as really the organization behind Firefox. What are the vulnerabilities, though, that Mythos actually identified?
31:40Yeah, I mean, there's a bunch of them. A lot of them had to do with being able to break out of the browser itself and actually execute code on your machine. So, like, actually having JavaScript or HTML come in and, like, just load it from a web page and instruct the browser to go do other things. So Mythos has been very helpful for us to actually find some of these really long-standing old bugs and actually help us shut them down. But what I noticed in the blog post that your team wrote about this was that, quote, they wrote, quote, But we also haven't seen any bugs that couldn't have been found by an elite human researcher.
32:14So is it as powerful as everybody says it is if an actual human being could have identified these things? Yeah, no, there's just a question of just like how many elite human researchers are there in the grand scheme of things. So like, yeah, these models are pretty powerful and they're allowing us to do what like thousands of these researchers could do instead of just like six of them. So would you have been able to identify these with your own team? We have a really good team. I think in the fullness of time, yes. But allowing us to rapidly accelerate and just close out a bunch of stuff that we didn't even know about.
32:47So should we be freaked out about this tech? Yes, I actually think we should be. I think we'll get into a world, once everything settles down, where things could actually be more secure. But we're living in this intermediary zone. Is the reason why we should be scared? because if Mythos is in the wrong hands, they could go to your bank and say, okay, identify the vulnerabilities in Rafi's account, and then they get access to your money. The bank, the water company, the power company, all the critical infrastructure of the world. I actually have faith that internet folks will figure this out. We're used to patching things and deploying at scale, like Heartbleed when SSL had problems.
33:23But I don't think my bank knows how to do it. Like you said, I don't think my power company knows how to do it. Those are the other pieces of critical infrastructure that I'm really worried about. I mean, you're a CTO. You should tell those CTOs. Okay? So there are things that are happening. Why isn't it happening more? Or is it in where they're being caught or what? Give us an idea. Yeah. No, I think we need to have actually a real large-scale Y2K-like effort to actually start closing a bunch of these critical vulnerabilities. And many kudos to what Anthropica is doing, but we need to give access to more people.
33:53We need to get access to all the open source providers. You need to get access to all the database providers. And then we need to fund them to actually start doing the work. So not only do you need to clean the bugs up, but then we also need to start thinking about mitigation. Like this is actually a large scale. Think about how much work we did for Y2K. Boards got involved. Governments got involved. Insurance got involved. We haven't kicked all those in yet. Why aren't we doing that yet? Because this is moving so fast. Is it just, is that it? That's exactly the problem. I think this is just moving so fast.
34:21Like Mythos was only really given to us in the wintertime. It's only been a couple of months. But the real question is that open models are catching up. So I think it's only 6 to 9 to 12 months when all the open models can start doing what Mythos are doing. So we only actually have a small window of time. So then how do we get to a point where you're sitting here with us a year from now. Mythos is going to be old news. There's going to be some sort of next model that is just that much better. how are you going to be sure that it's a company that's, you know, quote unquote, responsible behind it?
34:55Like many would say Anthropic is being with this rollout, maybe too responsible in your view. But how do you make sure that it's not a bad actor who has this kind? Yeah, no, I mean, I think this is actually where some government intervention might not be a bad thing. Like actually making sure that we put the right investment into actually getting these things shown, deployed, exactly. Have you been to the post office? Yeah, I know, 100%. But we do need to do all this work across all the efforts. We need to secure that post office, too. I don't disagree with you, but I think there are many people out there who say this could be something that maybe the free market would solve more efficiently than government bureaucracy.
35:35You have experience in government, sort of. No, 100%. In politics, you have experience. I think the real problem is that public sector infrastructure is not treated in the same way. And so we need to figure out how to do the real investment there. that I don't think is purely just maybe a public-private partnership solves that, but I don't think that's purely a market problem. Rafi, you were the first CTO of the DNC, the Democratic National Committee. Politics today, we see the impact social media, some good, some bad. Sure. On politics, what about AI? No, I mean, I think about this a lot. We're living in this world where we're owners, not renters, on all this technology.
36:13Just think about your search experience. It used to be 10 blue links on Google. And now it's one result when I ask the chatbot and it's the right result for somebody. Like, is it right result for me? So I really worry about this world where like living in someone else's intelligence all the time. What does that actually do and how we think, how we decide, how we buy all those kind of things? Can we actually get ahead of that and be better with it? I mean, this is where I really think we need to figure out how to do open deployments and open governance. Like right now, the incentive models are just such that like there was a whole study based out of, I think, University of Maryland.
36:47where they just ask a bunch of these chatbots to help you buy something, and they're vastly weighted toward sponsored and promoted goods. So how do we make sure that they're really on my side? I need to be able to go into it, understand it, tweak it, work with it, as opposed to just being delivered it. So we need to start working on those kind of questions now. You were talking a little bit about your family earlier, and I'm just wondering how you, as a CTO, and somebody who understands this technology and the potential downfall and pitfalls of it rather, you sort of have that diet, that information technology diet.
37:20I mean, can I tell you the pros and cons? Yes, please. My 10-year-old is vibe coding video games. They're actually unbelievable, cute and stinky productions. It's like the best thing ever. And so it's an expression of creativity. My 13-year-old, I got a phone call from a teacher saying, I think you used Chachy P.D. to cheat on an essay. So we do need to figure out how we actually treat people. how do we teach critical thinking? That's the thing that's still missing, and that's the thing I think we need to really hone in on. It's less about the tools, it's about that critical thinking. So how do you do it then?
37:49I think it's asking real questions. I think it's having lots of conversation. The Pope has an encyclical called it fasting from AI. So we just need to figure out a way. We need to teach this new tech, but we also need to just monitor and help them do productive struggle. We're being told we have one more question with you, and it's Twitter or Uber, so go. I was going to say, Tim's got to ask. Yeah, I mean, you were at Uber's advanced technology department. This was like the precursor to self-driving cars. This department was killed a few years ago. The promise was that you would have driverless cars at Uber.
38:26The technology as it is today, I mean, you walk outside of here, there are Waymos going everywhere. Not really in New York City at this point. Where are we when it comes to just getting into a car and it taking us where we need to go and there's no steering wheel? I mean, it turns out to be a really hard problem. This is one of the things we learned, right? It turns out to be a really hard problem to do generalized self-driving. Like to be able to drive anywhere, under any condition, under any situation. Like a city by city basis, it seems to be working out. Like Waymos are pretty good. You know, I recently crashed my Tesla under full self-driving.
38:56You did? I did. So like the Teslas clearly have problems. We slammed into the wall at like 30 miles an hour. Oh my God. And so like there are clearly still problems with all this technology, but - That doesn't sound like full self-driving. It doesn't sound like full self-driving. I totally think that the Tesla technology is not quite ready yet, whereas Waymo has been designed to literally not have a person in the wheel. Like the whole human in the loop version of self-driving, I think it's not the right path that we should be going on. And we should be thinking about just like actually tackling the real problem head on.
39:2320 seconds left. What's the question we should all be asking ourselves in this environment today? Yeah, I mean, his question is like, how do we make sure all these technologies we're deploying are actually on our side, not on someone else's side? Like, I want to live in a world of 7 billion AGI, if not 7 AGI. How do we get there? That was Rafi Krikorian, Chief Technology Officer at Mozilla. From Silicon Chips to Platinum Records, our next guest is a multi-Grammy winning producer, rapper, and recording artist who has spent over a decade engineering the soundtrack to hip-hop culture, producing hit songs for artists including Jay-Z.
39:54What is this? Jay-Z. Producing hit songs for artists including Jay-Z, Kanye West, Kendrick Lamar, and Travis Scott. Here's our conversation with Hit Boy. So this is all about technology. How are you thinking increasingly about technology and its impact on music? Well, I started in music like using tech. I used a program called FL Studio. It was called Fruity Hoops back in the day, but it's FL Studio now. And, you know, some of the biggest hits of our generation in hip hop and just popular music have been made on FL. But when it first came out, people were kind of like, oh, it's just like a computer program.
40:31It's not serious music making but you know tech is uh it's always going to advance mankind is that where we are with ai today because people could actually just create you know what they think of as yeah you know fruity loops using ai yeah is that music it is it's music for sure you know you still have a person having to prompt it it can't just press a button and prompt itself so just you know imagination i feel like it's at an all-time high if you have a great imagination and you use that in your work, you're going to succeed. But here's the thing. Isn't it all trained on music that's already out there?
41:05Well, not all of it. There's some people that train it on certain different ways, but however it's done, I feel like when MIDI came out, the person that studied the keyboard or piano for 20 years and learned grooves and melodies was like, what is this MIDI thing? You can just import notes and then make it sound like me? So you're not worried about a loss of creativity in this era at all? Not at all? It's a boom. Isn't all music, even created without technology, just trained on all the music that we've kind of got in our brain and that we hear? One million percent. One million percent, yeah, for sure.
41:38Hey, talk to us about, we want to go back to Universal. 18 years, right? 18 years, yeah. But you decided to go off on your own. How did that change what you can do? Man, I feel like I've been just empowered to the maximum capability. Like, you know, just like being in that deal for 18 years, I always kind of felt like I had a black cloud over me. And as many hits as I did make, I still feel like I wasn't in my complete right mind because that was always lingering. But now I'm completely free and I got all these tools and all this knowledge I've gained over the years. I feel unstoppable. So what did that relationship prevent you from doing?
42:17From making the amount of money I should have been making and just progressing through my deal for, you know, the amount of work I put in. But was it the right thing for you early in your career? I guess so, because I'm here right now on Bloomberg, you know what I mean? So, you know, the hustle, the struggle, the gripe, you know, the grief, like, it just, it led me to this place where I'm just, like, I feel powered up, you know? Tell us about this solo album that you've got coming out, Software Update. Software Update. I love the name. Thank you. Tell us, though, what this means to you. It's beyond just the music.
42:49It's like updating yourself as a person. Just moving better, dressing better, living better. Whatever it is to update yourself on a daily basis, do that. Working out, whatever it is, eating right. You've got to update the software just like a computer. What's it like going from somebody who's known as a collaborator? Carol mentioned a few of the people you've worked with, Jay-Z, Beyonce, Nostrake, and more, to doing this solo project. To be honest, it doesn't feel any different because I'm just a creative. I get the same excitement and the same high when I'm making a beat as if I do a verse or if I engineer for a big artist.
43:23Anything I do creatively that gives me that spark, I'm enjoying it, you know? What's a message you would like to send to people with this album? Just got about 30 seconds here. Lock in, update your software, you know, just look inside every day and just look in the mirror and get better. Hey, very briefly, is YouTube what MySpace was to you in the beginning of your career? Ten seconds? Yeah, I would say so, for sure. You know, I could just fire off as much as I want to on YouTube. That was Grammy Award-winning rapper and music producer Hit Boy. And that does it for this special edition of Bloomberg Businessweek, focusing on our favorite conversations from the Bloomberg Tech Summit out there in San Francisco.
44:00Stay with us. Today's top stories and global business headlines are coming up right now.
44:08Where your story starts. The Splash Into Savings event from Apple Vacations is here. Now through June 25th, save up to$150 on vacation packages, plus instant savings at select resorts in Mexico, the Caribbean, Central America, and top U.S. destinations. Use promo code JUNE26 for these limited-time offers. Start planning today at AppleVacations.com or contact your travel advisor. Apple Vacations, where your story starts. Ask yourself, what are your best people spending their time on right now? Expense reports, receipt chasing, month-end close that takes weeks. You become what you spend on, and that's not what you're building toward.
44:50Brex is the intelligent finance platform that eliminates that work before it starts. AI agents that handle the manual stuff automatically, so your team can spend their time on what actually compounds. It's time to get Brex AF. Learn more at brex.com slash AF.
45:33wherever you get your podcasts.
From the publisher
Featuring some of our favorite conversations of the week from our daily radio show “Bloomberg Businessweek Daily.” Hosted by Carol Massar and Tim Stenovec Hear the show live at 2PM ET on WBBR 1130 AM New York, Bloomberg 92.9 FM Boston, WDCH 99.1 FM in Washington D.C. Metro, Sirius/XM channel 121, on the Bloomberg Business App, Radio.com, the iHeartRadio app and at Bloomberg.com/audio. You can also watch Bloomberg Businessweek on YouTube - just search for Bloomberg Global News. Like us at Bloomberg Radio on Facebook and follow us on Twitter @carolmassar @timsteno and @BW
See omnystudio.com/listener for privacy information.
