In short
Podcast Summary: The Prof G Pod with Scott Galloway - First Time Founders: Is Cohere the Next AI Powerhouse?
Episode Overview In this episode of The Prof G Pod, Ed Elson interviews Nick Frosst, co-founder of the AI company Cohere. They explore Cohere's business strategy, its focus on enterprise clients, the future of AI, and the potential for an IPO. The discussion delves into the broader implications of AI technology on society and the nuances of its development.
Key Themes
- Introduction to Cohere
- Foundational Model Company: Cohere specializes in creating foundational language models tailored for enterprise needs.
- Corporate Focus: Unlike many AI companies, Cohere targets enterprise clients such as Dell, SAP, and Salesforce, ensuring their models are secure, private, and efficient for business use.
- The Landscape of AI
- Limited Foundational Model Players: Only about 10 companies globally can create foundational models, making Cohere one of the few key players.
- Resource-Intensive Development: Building AI models is compared to rocket science due to the high demand for resources, data, and expertise.
- Historical Context and Future Predictions
- AI’s Evolution: The journey of AI, especially for neural networks and transformers, is highlighted. The transformative moment for AI is seen as the rise of large language models, especially with consumer-facing applications.
- Future of AI: Nick emphasizes that while AI will continue to evolve, it is not likely to reach artificial general intelligence (AGI) soon. Instead, the focus should be on augmenting human productivity.
- Socioeconomic Implications
- Impact on Labor Market: AI is expected to automate 20-30% of work but will not replace human jobs entirely. The discussion includes the historical parallels to industrial revolutions.
- Wealth Inequality Concerns: The potential for AI to exacerbate income inequality is acknowledged, stressing the need for policies to address this issue.
- Cohere’s Business Model and Future Plans
- Enterprise Solutions: Cohere’s models help companies automate tasks such as data analysis, report generation, and customer interactions.
- IPO Considerations: Cohere aims for an eventual public offering to ensure the company’s longevity and impact.
- Geopolitical Aspects of AI
- Global Landscape: AI development is concentrated in a few countries. Nick discusses the need for nations to develop their own AI capabilities as a matter of strategic importance.
- Infrastructure Analogy: AI is likened to essential infrastructure, emphasizing that countries should aim for self-sufficiency in AI technology.
- Personal Reflections and Advice
- Navigating Career Paths: Nick advises young people to follow their passions and interests instead of trying to predict optimal career paths.
- Importance of History: Understanding historical contexts can help frame today’s challenges and uncertainties.
Key Takeaways
- Cohere's Unique Position: Focus on enterprise models differentiates Cohere from consumer-oriented AI companies.
- AI's Role in Business: AI is seen as a transformative force in enhancing productivity rather than a direct threat to employment.
- Need for Regulation: The conversation highlights the importance of thoughtful policy-making to address the socioeconomic impact of AI.
- Historical Perspective: Emphasizing the value of learning from history can provide grounding amidst rapid technological changes.
Conclusion This episode offers insights into the inner workings of Cohere, the AI industry, and the broader implications of AI technology on society. Nick Frosst’s reflections underscore the importance of ethical considerations and strategic planning in the age of AI.
Written by AI. May contain mistakes. Listen to the episode to check what was said.
Chapters
Tap a time to open that second in VOCohere: Building Foundational Models
2:15 to 3:38
Nick Frost explains Cohere's role in developing foundational models for AI.
“It even recently signed a deal with Canada's government to bring its technology into public operations.”
The Challenge of Creating AI Models
3:38 to 6:36
Nick discusses the complexities and resources needed for AI foundational models.
“And we make them easy to work with via an agentic platform.”
Nick Frost's Background and Journey
6:36 to 8:38
Nick shares his background and the inception of Cohere.
“In the same way that there's not that many companies building rockets either, right?”
Jeff Hinton: The Godfather of AI
8:38 to 12:06
Nick reflects on Jeff Hinton's contributions to AI and what he learned from him.
“making them really effective at the things that they care about.”
The Evolution of AI and Its Mainstream Moment
12:06 to 14:01
Exploring the history and pivotal moments in AI leading to its current popularity.
“AI, I mean, AI is having its moment right now.”
The Evolution of AI Perspectives
14:01 to 16:50
Explore how the perception of AI has shifted over time and its impact.
“And the joke is, oh, like intelligence is complicated and there's nuance in language.”
Cohere's Journey and Predictions
16:51 to 19:36
Understand the insights and predictions regarding AI trends and Cohere's role.
“So when people write the history of AI, and I want to be clear that I think the history of AI is not done.”
Chat Fine Tuning Revolution
19:37 to 21:28
Learn how chat fine-tuning transformed user interaction with AI models.
“And when we had conversations for the first few years of Cohere's history, the conversation was, this is a large language model, and here's why we think it can help you.”
Beyond Web Data for AI Training
21:29 to 22:30
Discuss the limitations of web-based data for training AI and future possibilities.
“They kind of expected, users kind of expected chat to work when you told them it was a large language model, and it didn't.”
The Path to Artificial General Intelligence
22:31 to 25:56
Examine the challenges and prospects of achieving AGI in AI development.
“I'm wondering if there's other forms of data that you think will be prevalent for model training in the future.”
Show all 23 chapters
The AGI Obsession in AI Industry
25:57 to 28:00
Analyze the industry's fixation on AGI and what it means for AI's future.
“And nor do I think the transformer alone will get us to AGI.”
Understanding Large Language Models
28:00 to 28:44
Explore the limitations and uses of large language models in production.
“need to be deployed correctly, need to have lots of stuff in order to get them into production.”
Cohere vs Competitors
29:55 to 31:29
Discover the unique enterprise focus of Cohere and its differences from competitors.
“I'm going to ask you the question that you said everyone asks about Cohere, which is, what is the difference between Cohere versus the other foundation model companies?”
Use Cases of Cohere in Enterprises
31:29 to 32:55
Examine real-world applications of Cohere's technology in business settings.
“Just so we can picture like what kinds of work is being done, what is an example of a use case that an enterprise is adopting because of using Cohere as a foundation model?”
AI's Impact on Employment
32:55 to 36:36
Discuss the potential effects of AI on jobs and the labor market.
“We're obviously seeing a lot of layoffs in tech right now.”
Addressing Wealth Inequality
36:36 to 38:29
Analyze the implications of AI on wealth distribution and inequality.
“The same way people say the computer was a good idea, the same way people say the Industrial Revolution was a good idea.”
Navigating Policy in Tech
38:29 to 41:16
Discuss the importance of policy in the development and use of AI technologies.
“Because if you're talking about, oh no, what if we make a digital god and it kills all people?”
Future Plans for Cohere
41:16 to 42:00
Explore the potential path for Cohere to become a public company.
“I don't know if you can talk about that, but that's what we've been reading.”
Company Growth and Going Public
42:00 to 42:17
Explore the pride in customer relationships and the path to becoming a public company.
The Landscape of Public Companies
42:32 to 45:20
Discussion on the trends in IPOs, public company valuations, and private investments.
“We've discussed the decline of the IPO on our markets podcast a little bit, just the fact that there are fewer public companies in America than ever.”
AI's Geopolitical Implications
45:20 to 47:48
Analyze the international race in AI development and its societal impacts.
“that we're on you are a canadian company you're based in canada uh how do you think about ai as a sort of international geopolitical race um we've got some big ai companies in america some big AI companies in China.”
The Role of AI Infrastructure
47:48 to 50:08
Understanding AI as a crucial infrastructure akin to power plants and roads.
“For example, you made the comparisons to other technologies.”
Advice for Young People in a Changing World
50:08 to 54:48
Encouragement for youth to pursue curiosity and learn from history amid chaos.
“You are one of the leaders in AI, which is the most important and transformative of technology, it's certainly in my time, I'm Gen Z, I was not there to see the internet be created and built.”
Transcript
Automatic transcript. May contain errors.0:00Ed Elson:Support for today's show comes from Darktrace. Darktrace is the cybersecurity defenders deserve and the one they need to defend beyond. Darktrace is AI cybersecurity that can stop novel threats before they become breaches across email clouds, networks, and more. With the power to see across your entire attack surface, cyber defenders, including IT decision makers, CISOs, and cybersecurity professionals now have the ability to stop zero days before day zero. The world needs Defenders, Defenders need Darktrace. Visit darktrace.com slash defenders for more information.
0:55Nick Frosst:Our suggestion for your podcast is fresh meat and delicious food from Aldi. Always good, always cheap, always varied. Just a fresh for everyone.
1:06Ed Elson:This week, Tafel Trauben 650 Gramm for only 2 ,99 Euro. Or Kultur Heidelbeeren 125 Gramm for only 1 ,39 Euro. In your Aldi Nord Filial. And now it's going to go. Just listen and enjoy. Aldi. Gutes für alle.
1:32Ed Elson:Welcome to First Time Founders. I'm Ed Elson. Artificial intelligence has become one of the most heavily funded sectors in the world. More than 30 startups have raised over 100 million dollars this year alone. As AI becomes more embedded in how the world operates, a handful of firms have emerged as the key players behind that transformation. Among them is a company building the kind of AI most people don't see. That is the AI that is powering the systems that run businesses and governments. Founded in 2019 by three former Google engineers, this company has focused squarely on the enterprise market, developing large language models for clients like Dell, SAP, and Salesforce.
2:15Ed Elson:It even recently signed a deal with Canada's government to bring its technology into public operations. Now valued at nearly$7 billion, it has earned a place alongside giants like OpenAI and Anthropic, helping define what the next era of AI will actually look like. This is my conversation with Nick Frost, co-founder of Cohere. All right, Nick Frost, good to have you on the program. Thanks for having me. So for those who don't know what Cohere is, I think we should probably just start there. What is Cohere? What does Cohere do? What are you guys building in AI?
2:52Nick Frosst:So we're a foundational model company, and we are uniquely and singularly focused on the enterprise. So there's about 10 companies in the world that can make foundational models. So foundational models, the large language models that are largely these days synonymous with AI. If somebody's talking about AI, they're probably talking about large language models. There's about 10 companies in the world that can make them. We are unique amongst them in our singular focus on the enterprise. So we make large language models that are good at the stuff that enterprises need them to be good at. We make them easy to deploy and efficient to deploy for enterprises.
3:30Nick Frosst:We deploy them securely and privately so that we can't see the data that our customers are passing into the model. That allows them to access the truly useful data out there. And we make them easy to work with via an agentic platform. So we do kind of the whole thing in order to get AI to work at work.
3:47Ed Elson:So these foundational models, I think most people who are interested in tech kind of know what they are. But just at a very basic level, the foundational models are the models that all of these AI startups are building off of. Or all of these companies, if you're building AI or you're building AI products, you need the foundational model, which companies like OpenAI and Anthropic and Cohere, your company, are building. um what am i missing if you talk about ai companies there's a lot of companies building
4:21Nick Frosst:stuff with ai mostly when people say they're building stuff with ai they mean they're building stuff with foundational models these days there's still a huge amount of work being done on more traditional machine learning smaller systems and a lot of those people working on that will still very rightfully call so that they're an ai company but if you are talking to someone and they say hey i've got a startup and it's an ai startup or something chances are they mean they're building off of a foundational model. They're getting a large language model to do something useful for their customers. There's a relatively smaller number of companies that actually make the foundational models.
4:55Nick Frosst:So that actually make the large language models that take in a bunch of words and then predict the next words that should come next. Yeah, there's about 10 of those.
5:03Ed Elson:So there are 10-ish companies building foundational models, which is basically the backbone of AI, or at least it's one of, I don't know, the vertebra of AI. Maybe we could call the chips the backbone. But what is so striking is there are thousands of AI companies, and we're seeing many of them and so many of these companies building AI, and yet there are only 10 companies that are building these foundational models. Why is that?
5:34Nick Frosst:So, in short, it's really hard, and it's enormously resource-intensive. building large language models is a lot more like building a rocket than it is like building other computer science projects it requires a huge number of really smart people who have experience doing it working in tight unison there's a whole bunch of different things that need to go well in order for it to be successful there's a whole bunch of experimentation that needs to get done and there's still, you know, and there's huge amounts of resources that need to get put into it in order to make the thing work, right? So you have to get a huge amount of compute.
6:17Nick Frosst:So rent all those chips, you know, that you were talking about. You need to get a huge amount of data. You need to have a huge amount of people helping you create that data, getting data annotators. You need to have a whole bunch of really smart engineers working together in order to make it go well. And even then, it's still challenging. So yeah, so there's really only about 10 companies in the world that are doing it because of that reason. In the same way that there's not that many companies
6:40Ed Elson:building rockets either, right? So how did you end up being one of the people who built one of these rockets? Take us back to the beginning. How are you, how did you get into this?
6:51Nick Frosst:Before co-founding Cohere with Aiden Gomez and Ivan Zhang, I was a researcher at Google Brain. So I worked with Jeff Hinton for a few years there working on explainability and adversarial examples and capsule networks and stuff, which was really fun. And it was there that I met Aiden. And Aiden was just finishing up a stint in Google Brain in California, where he worked on the paper, Attention is All You Need, which introduced the architecture that we still use today. So he helped write that paper in 2017. and you know almost 10 years later we're still using the same the same architecture so after he worked on that and when i met him in google brain toronto he was obviously very excited about the architecture and about what it could do and he showed it to me and i thought it was also really really exciting so you know we noticed something about the nature of this new model that created an opportunity and indeed a need for companies to make foundational models.
7:57Nick Frosst:What we noticed was that for the first time in machine learning's history, if you wanted to solve a task, like a language task, the best model to solve that task was not a model trained on that task alone. It was a model trained on a whole bunch of tasks. So that was really exciting. And that made us realize, hey, like there's going to be a need if companies are going to actually make this stuff useful and get this to work for them, there's going to be a need for companies to create really big and really good foundational models that other companies can use. So we had that realization in 2020, and we've been delivering
8:36Scott Galloway:on that since then. We've been trying to make language models useful for the enterprise by making them really effective at the things that they care about.
8:43Ed Elson:You mentioned Jeffrey Hinton there who you studied under, who, for those who don't know, is considered to be the godfather of AI. Why is he the godfather of AI? What did you learn from him? And I mean, I think people generally recognize him and his name, maybe if you're into tech, but perhaps they don't, if you're not super plugged into what's happening in AI. So what was his role in the story of AI and what did you learn from him?
9:18Nick Frosst:So I studied with him as an undergrad. So I only have an undergrad, I don't have a master's or a PhD or anything. So I had an undergrad from U of T and I did take his course while I was there and I sat in the front and asked lots of annoying questions. And I really only worked with him closely when I was at Google. So I was a researcher at Google Brain and I worked with him for, I was working out of Waterloo for a little bit and then I found out that he was working in Toronto and then we started to work together. And then I helped start up the Toronto Brain Group with him and worked there for a few years.
9:50Nick Frosst:And it's during those three years, four years that I learned most of what I know about research and machine learning and neural nets. And I learned it from him. So I learned a huge amount from him, but I don't have a PhD or a master's or anything. As for his contribution, it really can't be understated. So neural nets have been an idea for a while.
10:13Scott Galloway:People have been thinking about a neural net architecture, and in particular Jeff's been thinking about neural net architectures since the mid-80s. There was a long time where people thought they were not going to work.
10:26Nick Frosst:And there was this whole wave of first perceptrons, which is just a single layer neural net. And people thought that was kind of interesting for a little bit. And then some work came out to show that they had some fundamental flaws. And that really cooled people down on them. People weren't excited about neural nets. And then people started working on multilayer neural nets or multilayer perceptrons. And that solved some of the critiques. But still, people were not excited about it. And they generally thought it was a bad idea. And if they wanted to build AI, they were much better doing things like search or symbolic reasoning or things like that.
10:59Nick Frosst:And so very few people worked on it. And largely, they thought it was dumb, except for a few people. Jeff being one of them. So Jeff tirelessly worked on neural nets in the face of general ridicule for decades, for decades, until around 2011, 2012, they were finally able to show that neural nets were suddenly the best at image recognition. That was the first thing that they really, they really knocked out of the park on.
11:26Scott Galloway:And that was done at U of T with a bunch of other brilliant U of T students. The reason we are where we are with neural nets in general, which of course is the precursor to transformers, right?
11:36Nick Frosst:So there's kind of, if you think of it broadly, there's like AI as a concept, there's machine learning as one strategy for doing that. Neural nets as one strategy for machine learning.
11:46Scott Galloway:Transformers as one type of neural net. That's kind of where we are. So the neural net part in particular, Jeff can claim a huge amount of responsibility for, and it's really his tenacity and his dedication to continuing to work on it, even when everybody else around him was saying, now, this is a bad idea. It's not going to work. But we have to thank for where we are today.
12:06Ed Elson:So when we look through when the history books are written about AI, I mean, AI is having its moment right now. What changed? I mean, AI had been worked on and neural nets had been people had been working on this stuff for decades. Jeff Hinton had been working on it for decades. He makes this breakthrough with image recognition in the early 2010s. now it's ubiquitous was chat gpt the the breakthrough moment like what will the textbooks tell us about what changed when ai became mainstream there have been other ai moments
12:42Nick Frosst:there have been other times when people are when the whole world's really thinking about ai this is the first time that it i would say it's been this dominant narrative of the economy for the past few years. And that's a first like in technology, it's been the dominant narrative of technology for the past few years. And it's been the dominant narrative of the economy even more for the past few years. So that's, that's kind of a first, but there have been moments where people have been as really excited about AI and thinking that they're in some kind of AI moment before you, you got to separate AI as a property versus any implementation trying to get at that property.
13:21Nick Frosst:So people have been thinking about artificial intelligence, like what happens if a machine has intelligence the way a person has intelligence for a really long time. There's a myth that I cite pretty often that was written in like around, you know, 1500s, 1400s, I believe, a Yiddish myth about the golem, which talks about, you know, some rabbi imbuing intelligence into a clay man. And then he asks the, he asks the, the golem to go get fish from the river. And then he leaves his house for a little bit. And when he comes back, the house is filled with fish and the river is empty. And like, like it's a joke, right?
13:57Nick Frosst:Like it's a, it's, it's effectively a comedic story that's told at that moment. And the joke is, oh, like intelligence is complicated and there's nuance in language. And if we gave an artificial thing language, maybe you wouldn't understand that nuance.
14:13Scott Galloway:That's a 500-year-old joke. So people have been thinking about this for a really long time. More recently, after the computer was invented, there was a whole wave of people thinking about that. Now, Alan Turing was thinking about the Turing test, thinking about
14:26Nick Frosst:intelligence. After that, there was search. There was the deep blue moment when search algorithms beat Kasparov at chess, and that had a similar moment. So people have been thinking about this all the time. This is different. This is a different moment and it's different in its scale. And when people write the history of AI, this is certainly going to be a pivotal moment. And I'm convinced that neural nets are certainly going to be a central component of machine learning and AI going forward. Like they're so good. They're so fantastic. They do all kinds of things that there's no other way we could get them to do yet.
15:03Nick Frosst:And transformers in particular, large language models are very easy to use for the average person. And that is, I think, really why this feels different. So if you look at the other moments when people were talking about AI, like Deep Blue, let's look at that one as an example, right? Like you can read tons of articles about people talking about what's happening with the machines or our computers getting as smart as people. They beat the best chess player in the world. Like what's going on? But if you're an average person, you couldn't really interact with that. like maybe if you're good at chess you could try the chess bots and that and people did and
15:39Scott Galloway:actually you know chess in some ways chess is more popular than it's ever been before and in part that's because you can be at your home playing against something better than a grandmaster but you could interact with it that way you couldn't really interact with a search algorithm
15:54Nick Frosst:like an a star search algorithm in anything else so your experience of it's pretty limited same with machine learning like when we made image recognition the best image recognition models, suddenly, yeah, your phone, you could go on Google Photos and you could search up pictures of dogs and see all the pictures of dogs you've seen over the years. That's new. That's cool. But you couldn't, that's still directive. That's still like somebody made the model that does the thing. It's telling you how to use it. Transformers are the first time that any person without any experience in computer science or AI can go up to the model, open up a chat window, ask it to do something and it'll do it or will not do it.
16:35Nick Frosst:And that'll be interesting itself, but you can interact with it without it being prescriptive of how you interact. And that's, I think the reason why this
16:42Scott Galloway:is suddenly so much bigger. It's suddenly so much more interesting, so much more widespread and why
16:48Nick Frosst:it's become the dominant narrative of tech over the past few years. So when people write the history of AI, and I want to be clear that I think the history of AI is not done.
16:57Scott Galloway:I don't think transformers are going to get us to artificial general intelligence. So I think there's going to be more waves of new, independent, spontaneous inventions. I'm sure that's going to happen.
17:08Nick Frosst:But I'm convinced that the transformer is going to be a central component of that.
Read the full transcript
17:12Scott Galloway:And when the history of AI is written a hundred years from now, a thousand years from now, this moment will be talked about as relevant and interesting and a moment when a lot of stuff happened really quickly as a result of the tenacity of a handful of people.
17:26Ed Elson:Yeah, it's interesting that in a way it was the consumerization that really took things in a completely different direction, which is almost a testament not necessarily to the underlying technology, but almost to like the productization and being able to put this kind of technology into the hands of millions and then eventually hundreds of millions of people. is that when you see all of these big tech companies that are spending hundreds of billions of dollars building out their ai capabilities building out data centers renting compute buying chips uh and then spending money on on on models like like the ones you've built to their own products do you think it was sort of a moment where they kind of woke up to what the capabilities and what the prospects of AI could be because they just saw it a lot?
18:24Ed Elson:Or was it something else? Was it that the technology changed a fundamental way? I mean, to what extent was this sort of the narrative that suddenly captured people's imaginations versus something in the technology actually changed, which made Mark Zuckerberg think, now we need to get on this?
18:43Nick Frosst:I think everything we're experiencing today is largely predictable from around 2020, 2019.
18:53Scott Galloway:Now, that's not a coincidence.
18:55Nick Frosst:That's when I left Google to start Cohere with Aiden and Ida. So that's the reason why I think it was largely predictable around that time is because that's when I predicted it. So I'm sure other people predicted it before. I got on board at that time. at the time, I think when I remember telling people I'm going to leave to go create this foundational model, I don't think we use the word foundational model. We just said large language model company. We're going to be a large language model company. We're going to make large language models. I remember everybody saying, yeah, that's probably a good idea.
19:23Nick Frosst:I don't think anybody was thinking like, oh, that makes no sense. The question was not low limit. The question was like, oh, you know, is Google just going to do it? Are the other big companies just going to do it? But I think at the time, it made sense. Now, it really still wasn't popular. And when we had conversations for the first few years of Cohere's history, the conversation was, this is a large language model, and here's why we think it can help you. the conversation now is okay cool like why you know why your large language model or like how can this actually help me get into production how can i have it access my my private data without giving that away like how can i how can i deploy it in a secure and safe way so that i can handle regulated industries um how can i connect it to my specific data in an enterprise like those are all the questions we answer now so it's changed a lot and what changed in particular and a thing I did not predict at the time was the success of chat fine tuning.
20:22Nick Frosst:So you train this big generic language model. When language models were first created, what they did was they just completed the ends of sentences because they were trained on the web. So you really can think of it as like a web. We're calling it a large language model. At the time, it wasn't a large language model. It was a web text model.
20:40Ed Elson:Yeah. It's like a Reddit language model.
20:42Nick Frosst:Yeah. Yeah. So if you wrote the first part of a website, it would write the second part of a website. Not even the HTML, just the text on the website. And you could do a lot of stuff with that, but it was confusing and weird. And then OpenAI and a few other companies at the same time fine-tuned that large language model on chat dialogue.
21:04Scott Galloway:And that suddenly, suddenly people understood it.
21:07Nick Frosst:And at the time, actually, I remember thinking I was surprised at how efficient that was. Because when you think about it, you're training a model on the entirety of the web. So a huge amount of language. And then you fine tune it on a relatively small amount of chat. And yet, actually, it learns how to chat pretty well. So that is, I think, responsible for the difference between 2020 and 2022. It was the data efficiency of chat fine tuning that allowed people to like for the model to meet them where they're at. They kind of expected, users kind of expected chat to work when you told them it was a large language model, and it didn't.
21:41Nick Frosst:It was this like weird text thing. So then making it work in the way they expected it to work seems to have really gotten like woken people up to the effect and the utility of these models.
21:52Ed Elson:Yeah, and I'm sure it was also the volume too, the idea that if you keep on chatting with this AI, you're contributing more and more data for it to train itself on. um i i want to get to the specifics of cohere in a moment but you know it's it's interesting you're describing that the model gets better when it's subjected to or when it's fed large amounts of data and also like diverse forms of data and originally we were kind of just limited to the web but the web isn't all of life there's more beyond the web uh that these models could be trained on. And so, too, you could say the same thing about these chats.
22:34Ed Elson:I'm wondering if there's other forms of data that you think will be prevalent for model training in the future. You know, things in the physical world. I mean, typing words onto a keyboard and seeing words on a screen isn't everything. But to AI right now, it seems to be close to everything. So is there a way, are there other forms of data that you think in the future AI will be fed and therefore that would sort of take us, I guess, on the path to AGI?
23:12Nick Frosst:Let me first talk a little bit about the way we train these models. Okay. So the first step is to train them on everything on the web, everything on the open web. So you create a data set of all the text that's available for training from the web, and that turns out to be a huge amount of text. Orders of magnitude more text than you will ever read. Like a thousand people, a thousand years reading 24 hours a day volumes of text. That's how much text. So first step is train on that. Then you make a data set with people. So you have people talk to the model, and if the model gives a good response, they say, that's great.
23:52Nick Frosst:If it gives a bad response, they say, that's bad and they write what the model should have said. If you do that process, you'll create both ratings, like is it a good response or a bad response? And you'll also create what's called supervised fine-tuning data, SFT data. So that's like, here's the input to the model and here's a gold standard of what a person wanted. Like they wrote out the sentence, like that's what the model should have said. That's called SFT data. So then you trade the model on that SFT data. After that, you can do reinforcement learning, which is a type of machine learning invented before transformers, where you're training a model without access to the right answer.
24:28Scott Galloway:The model kind of tries stuff and then you say, hey, this was better or this was worse. And you update the weights of the model based on that signal.
24:35Nick Frosst:So then you can do reinforcement learning. now we do a whole bunch of reinforcement learning with synthetic data so now we use the model itself to generate data and then do reinforcement learning on that synthetic data so that's a big component of training now so there's like the data you get from the web the data you make with people and then the data you make with the model itself and those all of those are super relevant for making the models that people use today um your question about models being restricted to the to the web and missing the stuff in the real world. Is that a blocker to AGI?
25:12Nick Frosst:Like, yeah, definitely. That's a blocker to AGI. If when you say AGI, you mean human-like intelligence. Yes, that's a blocker to AGI. We are embodied creatures. We have, we learn our intelligence through interactions with the real world and intervention into the real world. There's lots of interesting psychological work that suggests learning and interaction are super related. So interaction is super important. Is that a blocker to AGI? Like, yeah, definitely. But I don't, there's a whole bunch of blockers to AGI. And that's just, that's just one of them. And the technology as it exists today is massively impactful, massively useful, absolutely transformative on the nature of computers and subsequently the nature of work, massively transformative on the economy in general.
25:59Nick Frosst:then I don't think it's AGI. And nor do I think the transformer alone will get us to AGI. Nor do I care. I don't really look out in the world and say, oh geez, I wish my computer was a person. I look out in the world and I say, oh man, there's so much stuff that a computer should be doing and not me.
26:18Scott Galloway:My time should be free to think strategically, to think creatively. There's so much work that a large language model, when connected into the things that I am using, can do for me and subsequently allow me to do the interesting in the human. And like, that's what I want to make. I want to make a technology that does that as good as possible.
26:36Ed Elson:Do you think that AI, the people building AI, the leaders of the AI industry, Sam Altman probably being the high priest right now, at least, do you think that there's not enough appreciation of that? Do you think that people are too obsessed with, we need AGI, we need human-like intelligence. I just look at the contract between Microsoft and OpenAI, which basically one of the stipulations in the contract is, you know, the terms will change once we achieve AGI. I mean, there are many questions like, what does that even mean? But the fact that AGI is sort of the benchmark for everyone, and I'm even asking you, like, How do we get to it?
27:20Ed Elson:Do you think there's too much obsession with this concept of AGI in the AI industry right now? Yeah. Yeah.
27:29Nick Frosst:Look, high priest is a good term. A lot of the thought around AGI and discussion around AGI feels religious to me. It's calmed down a little bit, right? Like back in 2023, like 2024, my views on this were a little heretical. people would disagree. If I said, hey, AGI is probably not around the corner, people would disagree and say, why do you think that? I would get a lot of pushback. I don't get much pushback these days. I'm like, yeah, guys, guys, guys, we know. Transformers, incredible, super awesome, super good, can definitely be way better than they are, need to be deployed correctly, need to have lots of stuff in order to get them into production.
28:08Scott Galloway:That's what we focus on. But AGI? No.
28:12Nick Frosst:And everybody's like, yeah, yeah, yeah, totally, I get it. And if you use a large language model, which as everybody does these days, You'll feel that pretty soon. You'll be like, yeah, they're amazing at these things. And then I ask them some other things and they don't understand at all. And they have a completely different, it's very different talking to a language model as it is chatting to a person. And people kind of know that when they're grounded in an environment. The focus on it is, I think, a narrative device more so than it is a scientific belief. We'll be right back.
28:50Ed Elson:Support for the show comes from LinkedIn. It's a shame when the best B2B marketing gets wasted on the wrong audience. Like, imagine running an ad for cataract surgery on Saturday morning cartoons, or running a promo for this show on a video about Roblox or something. No offense to our Gen Alpha listeners, but that would be a waste of anyone's ad budget. So, when you want to reach the right professionals, you can use LinkedIn ads. LinkedIn has grown to a network of over 1 billion professionals and 130 million decision makers, according to their data. That's where it stands apart from other ad buys.
29:22Ed Elson:You can target your buyers by job title, industry, company role, seniority skills, company revenue. All so you can stop wasting budget on the wrong audience. That's why LinkedIn ads boasts one of the highest B2B return on ad spend of all online ad networks. Seriously, all of them. Spend$250 on your first campaign on LinkedIn ads and get a free$250 credit for the next one. Just go to LinkedIn.com slash Scott. That's LinkedIn.com slash Scott. Terms and conditions apply.
29:55Ed Elson:We're back with First Time Founders. I'm going to ask you the question that you said everyone asks about Cohere, which is, what is the difference between Cohere versus the other foundation model companies? What is the difference between Cohere and OpenAI? Between Cohere and Anthropik? Those are the two big ones in my head. What is the difference?
30:16Nick Frosst:The big difference is we are not a consumer company and we're only an enterprise company.
30:22Scott Galloway:So we can't pay$20 a month to get access to our tech. We're not trying to build a product that people use in their personal lives. We are instead selling only to large and medium enterprise companies.
30:38Nick Frosst:and we create language models and search models and an agentic framework for using them that is tailored to the needs of those companies. That strategic difference comes from a philosophical difference, which is a different view on the technology, right? Like I don't think the technology is going to get us to AGI. And I don't think the biggest utility of the models is in people's personal lives. I think the biggest utility of these models is in work. I think
31:05Scott Galloway:Their ability to augment and automate work at a desk behind a computer is, I think, what they are the best at.
31:13Nick Frosst:And so we have that different view of the technology that leads us to think differently about where we can add the most value to the world. And that leads us to being an enterprise, a singularly enterprise-focused company.
31:24Scott Galloway:And that is, as mentioned, unique amongst the foundational model players.
31:29Ed Elson:Just so we can picture like what kinds of work is being done, what is an example of a use case that an enterprise is adopting because of using Cohere as a foundation model?
31:41Nick Frosst:Lots of people will go into work, open up North, which is the name of our agentic platform. So it's like a chat app with automations and you can make custom agents and you can share those across people. But it's a chat app that on its surface you would be familiar with. So they'll go into work, they'll open that up, and they might open up our model and say, you know, hey, you know, somebody emailed me yesterday about a brief for a meeting, read that email, then cross-reference that with our Salesforce data, and then make a table sharing, like telling me the state of that customer. That's something the model can do for it.
32:16Nick Frosst:Or they might say, hey, you know, I just got this data room from this company, I'm trying to evaluate, read through the data room, do some analysis, come up with a cited
32:25Scott Galloway:and detailed document on how you think that company looks, and then send a Slack message to my coworkers with that PDF.
32:33Ed Elson:Just looking at where you are in the AI world, you are automating tasks that are done at businesses and enterprises that, as we are all talking about, would otherwise be done by humans, which introduces the question of, is AI going to replace people? And this has been a large debate. We're obviously seeing a lot of layoffs in tech right now. A very charged debate. How do you think about all of this? How do I think about it? Frequently.
33:10Yeah.
33:11Nick Frosst:So there's a lot. So I think this technology is, you know, there is a huge amount of stuff that people do that large language models should be doing for them.
33:18Scott Galloway:large language models will do a better job of them. The work itself is not very enjoyable. Humans are really good at a lot of stuff that large language models are very bad at. And largely, they enjoy the stuff that they're good at and don't enjoy the stuff that large
33:29Nick Frosst:language models are good at. So I think, you know, in the same way that we've had previous industrial revolutions that augmented and automated a huge amount of stuff that people
33:41Scott Galloway:generally didn't really like doing.
33:43Nick Frosst:And we look back on those periods of time as kind of chaotic, but largely a good idea. No one's running around saying, hey, the steam engine was a step in the wrong direction, or hey, the industrial revolution was bad. We should all still be farmers. I think there's something similar going on with this. Now, I do think this technology is fundamentally augmentative, right? I think this technology, anybody working behind a computer, I think this technology can automate, I don't know, 20 or 30 % of their work.
34:17Scott Galloway:I don't think it can automate 100 % of pretty much anybody's. Huge amounts of the work that we do is not just text on a computer or images on a computer. It's personal.
34:27Nick Frosst:It's understanding the cultural context. It's talking to people and coordinating and aligning. It's thinking strategically. It's doing all of this stuff. And that's true at every level of an organization.
34:38Scott Galloway:So I think there's a lot of people say, oh, this is going to take out the bottom bit of an organization. I'm like, no. What this is going to do is make, augment and improve and increase efficiency and productivity across the entire organization. Is that going to have consequences on the labor market? Yes, absolutely. It is. Just as the Industrial Revolution had huge consequences on the labor market. Just as, you know, the widespread adoption of computers had huge influences on the labor market.
35:05Nick Frosst:Like in our lifetime, you're in my lifetime, we have seen wild changes in the way that work is done as a result of technology. It was not so long ago that every organization had a huge number of people working as typists to type stuff up because
35:20Scott Galloway:people didn't have computers and that needed to get done. That doesn't exist anymore. But the labor market evolved. The labor market figured out all those people still are doing good work, just doing different work. So I think that this will have similar effects to the computer, to the internet, to the industrial revolution on the labor market. And I think governments and organizations and unions and businesses should be thinking about how to make sure that that goes well, how to make sure that that is largely, that that uplifts people and that builds a resilient economy and that allows people to do things they like to do.
35:54Scott Galloway:And I really like, that's the conversation that I'm encouraging everybody to have. Like, What are the policy decisions that can be made in order to make sure that that is good for all people? But I think recently, like all the talk of, you know, there's been a lot of tech layoffs. And I know that that's kind of tried to be tied towards AI. I think that's a lot more related to the overhiring that happened during the pandemic than I think it's related to having those people suddenly like an AI is doing that job for them. So I think that's kind of borne out if you look at the data. So I do think it's going to have consequences on the labor market.
36:31Scott Galloway:I think when history looks back at this, we'll largely say that it was a good idea. The same way people say the computer was a good idea, the same way people say the Industrial Revolution was a good idea. But it is going to be a chaotic moment, and it does require 10. Do you have concerns about what this will do in terms of inequality?
36:49Ed Elson:I mean, I think about the downsides. I think long term, it's value accretive, which means that's a good thing for society in the same way that the steam engine was, the internet was. But I think the big concern that seems super likely to me is that the value is accrued to the people who own the AI and that, yes, maybe some of us might be getting some value out of using AI, but we won't be the ones who own it. And it will only make wealth inequality even worse, which could have all of its own impacts. Do you worry about that? I do worry about that.
37:30Nick Frosst:Yeah. So income wealth inequality is the thing I, is one of the things I think is the most pressing issue.
37:36Scott Galloway:I think, yeah, I think it's one of the most pressing issues for the world right now. And I do worry that this technology, similar to other technologies, stands to exacerbate the wealth inequality that was already rising over the past few decades. I think the correct solution to that is policy. Oftentimes when people thinking about the economy, they kind of forget that this is a system we create. And it's a system that can be subtly pushed in one direction or another direction. And you can add policies, you can change things in order to make sure that this works for everybody, for all people in your country or in whatever organization you're within.
38:17Scott Galloway:I think that's the conversation I want the world to be having. And one of the reasons why I'm very vocal about saying, hey, I don't think we're getting to AGI is that the AGI conversation often distracts from that conversation. Because if you're talking about, oh no, what if we make a digital god and it kills all people? It's very difficult to have the conversation, hey, do we have the right policies in place to encourage better income distribution such that We don't end up in a bifurcated society, which I don't think anybody wants.
38:47Ed Elson:What kinds of policies or what do you think that would look like is my first question. And then my second question is, as someone who cares about that, are you a pariah in the tech industry? Because from my understanding, there is a feeling of if you're talking about policy and regulation, then you're a Luddite and you're just trying to hold AI back. and you're just scared. So I guess, how do you think about those two questions? Am I a pariah for talking about that stuff?
39:25Nick Frosst:No, no. But I also don't live in Silicon Valley, right? Like I don't, I live in Toronto. I'm certainly in the tech scene. You know, I talk to VCs all the time. I talk to other tech people.
39:40Scott Galloway:I talk to, you know, lots of people thinking about this. but would I, you know, would I be a pariah in, I'd certainly have, I certainly have lots of different views than people would have hanging out in the remnants of the effective altruist parties in Silicon Valley, right? I certainly have very different views than, than the culture that developed there. I mean, am I, like, I'm certainly not a Luddite, right? Like, I'm certainly not
40:08Nick Frosst:against the creation of technology. But, you know, having been to, where was that town I went to?
40:16Scott Galloway:There's a town in England that was kind of the epicenter of that. And I went to a museum there on Luddites that was very interesting.
40:22Ed Elson:I wish I had it, but I know I've studied it. I know what you're talking about. I wish I had them there.
40:28Nick Frosst:Yeah, you know, and a lot of the people at the time were, you know, they were frustrated at the loom for making their economic situation worse.
40:37Scott Galloway:Right. now i again we all look back at the automated loom and we think that was a good idea and the economic situation that people live in now is better than the economic situation that they were living in during that time um but i'm empathetic i'm empathetic to saying hey like my economic situation is shitty and it's shitty at a systematic level at a population system level let's figure out how to how to make that better right so i am empathetic with that um so would I be a pariah? I don't think so. I think actually a lot of people know this. I think if you go to Silicon Valley and you tell somebody, hey, income inequality is bad, it's hard to live in that city and not think that.
41:15Ed Elson:Just looking at the future of Cohere, reportedly Cohere is looking to go public. I don't know if you can talk about that, but that's what we've been reading. Can you tell us about those plans?
41:29Scott Galloway:Aidan and Ivan and my goal in creating this company was to create something that outlasted us was to create a generational company like that's motivating that's exciting that's a fun thing to be part of that's what we're excited about um i think the right way to do that is to become a public company i think that's how you can build i think that's like i i like those mechanisms i think that's how you can build a company that is bigger and longer than you and that's exciting i think the tech we're building is speaks for itself and is getting there. I think the customers that we've closed and the relationships we've built and the value we've been able to add to our customers is something I'm enormously proud of and something I want to keep doing and something I think would be best done through a public company.
42:17Ed Elson:We'll be right back.
42:31Ed Elson:We're back with First Time Founders. We've discussed the decline of the IPO on our markets podcast a little bit, just the fact that there are fewer public companies in America than ever. And also the fact that so many of these massively transformative companies are taking so long to go public. The idea that OpenAI is only now, I mean, they have the nonprofit issues, But the reality is this company is supposedly going to go public at a trillion dollar valuation. That's crazy. So how did you balance? It seems as though the startup world is more interested in staying private as long as possible for, or at least that's what the data would tell us, versus going public.
43:18Ed Elson:So how did you think about going public? What are the pros? What are the cons? And why now-ish?
43:26Nick Frosst:Well, I've made no promises to timing. Yeah, fair enough. No promises to timing. But I do think, look, I don't, yeah, again, I don't know what OpenAI is doing.
43:36Scott Galloway:I think there are very, I look forward to the interesting books that will be written about that company over the next 10 years. I don't know what's going on. And I don't know when they're going to go public. I know they've announced stuff. I don't know. It's a very, it's its own beast. It's its own unique and interesting company. I'm sure lots will be written to describe that story. For us, our business looks a lot different because we don't have a consumer offering. We don't have the same losses that they have. We're not losing money on every customer. Our margins are actually, they look a lot more like SaaS margins.
44:13Scott Galloway:When we work with a customer, we deploy our models into their environment, right? And that allows that model to access their private data securely so that we can't see it. it also makes the nature of our margins completely different um you know i think that puts us in a very different position than the consumer companies that are out there and i think that puts us in a position that makes it a lot more resonant with a public market it's a lot more understandable a lot a lot more uh yeah it looks a lot better um so i i do think the right way for us to make sure that this company outlasts us and continues to deliver is to eventually go public.
44:50Scott Galloway:Um, when, yeah, I don't know. And there's an interesting thing you're pointing out about there being a smaller number of public companies. There's an interesting thing you're pointing out, uh, about companies staying private for longer. I don't think those are unrelated to the income inequality, wealth inequality stuff that we were talking about earlier. There's an interesting dynamic in the economy going on right now. And like all of those things are kind of related. um but for us like yeah no that's that's what we're going for um and i think that's the path
45:20Ed Elson:that we're on you are a canadian company you're based in canada uh how do you think about ai as a sort of international geopolitical race um we've got some big ai companies in america some big AI companies in China. I guess Mistral is another one that's in France. And there's us in Canada, and that's it. Right. Yeah, there are four countries in the world
45:48Nick Frosst:that can make this technology.
45:50Ed Elson:Tell us more about what that means for society.
45:55Scott Galloway:Yeah, that's a strange one. I think that's when you think about how difficult it is to make this technology and how resource intensive it is. It's not super surprising that there aren't, like just in it's not surprising that there aren't that many companies doing it it's not surprising that there aren't that many countries so but it is it is a strange reality that yeah there are four countries in the world that can build this tech when i think about the what that means for geopolitics i think this technology is best in the same way you know i use this analogy of like rockets it's like building rockets um another analogy is to say it's like building power plants.
46:34Scott Galloway:It's like building infrastructure. The technology is a lot more like infrastructure than previous computer science efforts. And so I think it's a good idea for countries to have the ability to build infrastructure themselves. It's a good idea for countries to be able to build their own nuclear power plants. That's useful. That sets up the country for success. It's a good idea for them to be able to build their own roads. like infrastructure for people is good and it's good for countries to be able to do that from a strategic perspective from a security perspective like from an economic perspective it's generally a good idea so i think this technology is important for countries to be able to build i think there's ways that that countries can work with the providers in order to give that ability to their country um and i think that's something that a lot of the world is seeing right now you know we had two decades of the history of tech really being american really being centered on america and america is a dynamic fast-moving ingenious place that will is going to continue to be defining on the technology and technology in general but i do think it's good for the world to have tech that comes from other places you know to have a more distributed um view on on how technology is developed and what it can do for people so that's one of the reasons why i'm happy to be building out of canada is that the the thing that
47:59Ed Elson:changes the trajectory of geopolitics. For example, you made the comparisons to other technologies. I think some people would also make the comparison to the nuclear arms race, not to say that AI is like a nuke, but to say that it was the belief of nations that this is what will tilt the balance of power across the world. We have to build these things because if we don't, and if Russia or anyone else gets their hands on this transformative technology, it will completely upend the geopolitical structure of Earth. Do you view AI in the same way? Not in the sense that it would be, I'm not making a nukes and it's going to be destructive point.
48:42Ed Elson:I'm making a point of the power of it. Is it a question of whoever builds the AI first and whoever builds the best AI, they will be the most powerful force in the world. Do you see it that way?
48:57Scott Galloway:No, that's a little extreme. Yeah, I see it as like a strategic and imperative for countries to have this technology to facilitate economic growth, to do stuff in the same way I see it's imperative for them to build roads, really great healthcare, build nuclear power plants, build wind, build other pieces of infrastructure. I don't think I would go so far as to say it will be the defining thing. Certainly, yeah, the nuclear bomb analogy I disagree with. And I know that's often used when people are talking about AI as an existential threat. But again, because I don't think transformers are going to get us to AGI, I don't think they pose an existential threat.
49:36Scott Galloway:And so I don't think that analogy serves us in conversation. I do think it's important to think about the technology as infrastructure and infrastructure that's good to build. But one piece of infrastructure amongst many pieces of infrastructure that are good to build and important to build in this moment. And we're certainly in a dynamic and changing geopolitical time, right? Like this, you know, these are unprecedented times, as has been said for the past decade. But yeah, and I think the technology will have an impact on that, but I don't think it will be the defining thing.
50:09Ed Elson:You are one of the leaders in AI, which is the most important and transformative of technology, it's certainly in my time, I'm Gen Z, I was not there to see the internet be created and built. So I think, you know, this is an extremely important moment, not just for America or Canada, but for the world. Does that weigh on you? What is it like to be a founder who is at the forefront of this world-changing technology?
50:45Scott Galloway:yeah it weighs on me yeah it's totally a strange place to end up in and not a place i thought i would it excites me i love working with cohere uh working at cohere i love working with all the people at cohere and i get really excited and i'm enormously proud and occasionally deeply moved by the work that we're doing and the group of people that i get to spend time with working on it it is a complicated emotional experience to think hey this technology is you know the defining narrative and we are one of 10 companies in the world four countries in the world that are building it you know I still love I mentioned earlier like I still I love the tech and I'm moved by it and that's that influences how I think about this like I think we're building something beautiful and cool and can be useful and it's it's very meaningful to the world and to the you know to the people around me and that's interesting there is a subsequently a pressure and an intensity that I did not anticipate when we started this company.
51:45Scott Galloway:I don't think anybody did. I think I solved that by staying grounded in things that have nothing to do with tech sometimes. I think that's an important part of the way that I live my life, is by doing stuff occasionally that is completely unrelated to AI, to transformers, to tech itself. And I think that That might be why I have pretty different views than the rest of the people in similar positions to me.
52:15Ed Elson:A lot of young people watch this show. What would be your advice to young people? Not necessarily just founders, but I think young people in general, perhaps even young people who are concerned about their job prospects, their career prospects, people who believe that AI could be taking their jobs. I mean, from the guy who's building the AI, what would your advice be to young people? terms of jobs my advice is to it has been the same for young people for a while which is that i know
52:46Nick Frosst:i meet a lot of people young people who are like anxious about making the right decision like i got to work on this because that's going to be the right thing or that's going to be the right thing and my my advice has often been look the world's too chaotic for you to predict what's right like you can't like every every year you could read an article of somebody saying the next big job is this and you got to go into this and they're almost always wrong and so it's just too chaotic, you can't predict it.
53:10Scott Galloway:What you should instead do is focused on what you're interested in. And what you can optimize for is your own excitement, your own curiosity, your own interest. And when you're thinking about what career you want to pick or something, you should first and foremost be like, well, what am I excited about? What am I interested in? And conditioned on that, your ability to be successful is much higher than conditioned on you choosing what you think is the optimal decision at that moment. So I would really encourage young people to follow their curiosity, follow their passion more than they think follow what's optimal just because you can't predict it
53:43Nick Frosst:it's really hard um my other advice is to when the central when the narrative around the world these days is one of like it's an unprecedented chaotic absolutely crazy time i definitely encourage people to learn about history just read just whatever history from whatever time like whatever you find ancient history prehistoric prehistory um you know enlightenment history
54:05Scott Galloway:modern history, like wherever, literally wherever. Yes, we live in unprecedented times. Yes, stuff is chaotic and weird right now. And I think when the history of this moment, I think people are going to read the history of these few decades with curiosity in the future. But there's been a whole lot of crazy times. There's been a whole lot of absolutely nut stuff that has happened in the history of humanity. And it is calming sometimes to read about those and understand the good things that happened, the bad things that happened, the way stuff continued in the face of it, I find that grounding.
54:42Scott Galloway:And that grounding is helpful for keeping you focused on like what you're interested in, what you're passionate about, what you're curious about.
54:47Ed Elson:Nick Frost is the co-founder of Cohere. Nick, this was great. We really appreciate your time. You as well. Thanks for the conversation.
55:00Ed Elson:This episode was produced by Alison Weiss and engineered by Benjamin Spencer. Our research associates are Dan Shallan and Kristen O'Donoghue. And our senior producer is Claire Miller. Thank you for listening to First Time Founders from Prof. G Media. We'll see you next month with another founder story.
From the publisher
Ed Elson speaks with Nick Frosst, a co-founder of Cohere. They discuss why the company chose an enterprise-only strategy, how he sees the future of AI unfolding, and whether an IPO is on the horizon.
Learn more about your ad choices. Visit podcastchoices.com/adchoices




