GitHub CEO Thomas Dohmke on Building Copilot, and the the Future of Software Development

6 Aug 2024 · 1 h 8 min

Ask about this episode

Ask anything about it. ChatGPT or Claude reads this page and answers with the times it was said.

Connect VO and ask about every podcast you hear, including the moments you saved. Add to ChatGPT · Add to Claude

In short

Podcast Episode Notes: GitHub CEO Thomas Dohmke on Building Copilot, and the Future of Software Development

Episode Overview In this episode of Training Data, hosts Stephanie Zhan and Sonya Huang interview Thomas Dohmke, CEO of GitHub. The discussion focuses on the development of GitHub Copilot, its impact on software engineering, and the future of coding with AI.

Key Themes

  1. Background and Vision
  2. Thomas Dohmke's Journey:
  3. Grew up in East Berlin, developed a passion for software at a young age, and started his first company focused on insurance software.
  4. Joined Microsoft through an acquisition and later took on the role of CEO at GitHub.
  5. Ambition for GitHub:
  6. Aims to empower 1 billion developers by 2030.
  7. Focus on integrating AI throughout the coding process and improving software development workflows.
  1. GitHub's Acquisition by Microsoft
  2. Acquisition Highlights:
  3. In 2018, Thomas played a key role in the acquisition process.
  4. Vision included exploring the potential of GitHub beyond its initial offerings.
  5. Changes Post-Acquisition:
  6. The integration allowed for the development of tools like GitHub Actions and Copilot, expanding GitHub's functionality.
  1. Development of GitHub Copilot
  2. Copilot's Origins:
  3. Concept initiated during the pandemic with GPT-3, enabling code completion features.
  4. Grew from a simple autocomplete tool to a comprehensive coding assistant.
  5. Impact on Developer Productivity:
  6. Reports indicate Copilot writes 40% of code in enabled files.
  7. Significant improvement in developer satisfaction and productivity.
  1. Future of Software Development
  2. Tools for Expansion:
  3. Tools like Copilot are expected to democratize coding, making it accessible to a broader audience.
  4. Thomas anticipates Copilot will evolve to include more complex features, such as agents for different coding tasks (e.g., autofixing security vulnerabilities).
  5. Insights on AI's Limitations:
  6. AI can assist in coding but lacks human creativity and systems thinking.
  7. The distinction between tool-use (AI) and the craft of programming is emphasized.
  1. Advice for Founders and Developers
  2. For Founders:
  3. Focus on specific problems rather than technology for its own sake.
  4. Finding product-market fit is essential; starting with developer-led growth can help spread a product quickly.
  5. Encouragement for Incumbents:
  6. Large companies can innovate by fostering small, focused teams (e.g., Tiger teams) to explore new ideas rapidly.
  1. Looking Ahead
  2. AI and Coding:
  3. Thomas predicts that AI agents will handle increasingly complex tasks, enhancing productivity.
  4. The future includes a blend of human creativity and AI assistance, enriching the development environment.
  5. Industry Trends:
  6. Expect continuous evolution in AI architectures and applications in coding.
  7. Focus on securing software supply chains and enhancing collaboration in software development.

Key Takeaways

  • GitHub aims to revolutionize coding with AI tools like Copilot, enhancing productivity and accessibility for developers everywhere.
  • The journey from concept to product is essential in the tech industry, requiring focus and rapid iteration.
  • The future of software development will combine human creativity with AI capabilities, fostering a more inclusive environment for aspiring developers.

Conclusion The conversation with Thomas Dohmke provides insights into the transformative potential of AI in software development. As GitHub continues to innovate with tools like Copilot, the landscape of coding is poised for significant change, emphasizing the importance of creativity, collaboration, and effective use of technology in the developer community.

---

Note: This content does not constitute investment advice or an offer to buy or sell interests in any investment fund.

Written by AI. May contain mistakes. Listen to the episode to check what was said.

Hear the part that matters, and keep it.Open this episode in VO. Double tap your headphones to save a moment as you listen.
Get VO free

Transcript

Automatic transcript. May contain errors.

0:00There will be human brain is still so much more advanced than the transformer models and the diffusion models and the other types of models that we have to image recognition and what not that we have today. And you know, remains to be seen if we can kind of like add that sentience piece to it. But today I'm not seeing it and I haven't seen any research that telling me that that's coming anytime soon.

0:39Hi everyone, welcome to Training Data. Today we host Thomas Domke, CEO of GitHub. Thomas has an ambitious vision for enabling a world of 1 billion developers and bringing agents through the end -to -end developer workflow and into adjacent categories like code security. He even hints at the progress he thinks the industry will make on sweet bench over the next few years. Some categories he's excited about, Nei, outside of developer tools. And whether he thinks a new architecture will overtake the transformer. Today we're so excited to introduce our special guest, Thomas Domke, CEO of GitHub. Hey, and thank you so much for having me.

1:16Thomas, we're so excited to dive into the GitHub and Copilot story in particular today. Maybe to kick off, we'd love to learn a little bit about your personal background. You have a very interesting story having grown up in East Berlin before the wall fell. And then starting your first company that brought you into the United States when Microsoft acquired the company, how did your background and upbringing really shape who you are today? I think you know, I'm living a very normal life of the American dream now, it's with a wife and two kids. I think what shaped really my journey was the passion for software development early when I was 11 year old or so.

1:54It was still East Germany, and West Germany, so there was the wall between the two parts of Berlin and I saw computers for the first time. I couldn't buy one, but I, in school, we had one in the geography lab and a friend of mine and I, we started playing with that, learning to code. You had to code to even do anything with a machine, you know, you understand some basic to even load a program and then as the wall fell, I bought a Commodore 64 and later my first PC, a free 8060X40. And so as a teenager, I spent most of my time coding and started a company. At that time, we really started, we just started insurance software.

2:33As in the late 90s, most of insurance agents didn't have software. At some very working on mainframes and others just had people in front of them. And then I moved to South Germany to work for Mercedes. And then I had the startup that got acquired by Microsoft. But it's really this passion for doing stuff with software, being creative with software. And I think the fascinating thing back in the 90s and it's still true today is that you can start very easily. There's not a lot of capital investment required. And if you make a mistake, you can just start from scratch. you know, and then I think that's what makes this so it's so cool to build software.

3:09And that gave you the love for building and fixing things even today with robotic lawnmowers in your own home. Yes. Well, and it gives me the love, you know, as the CEO of GitHub, to build software for software developers. I think that's the really cool thing about being at GitHub. We are building the tools that other developers are using. And we always say, you know, we put the developers first. And that I think is, you know, the dream job for me. I get to speak with a lot of developers. I get to build software for developers and I get to speak you know to to many developers here in Silicon Valley.

3:42I Think what many might not know about you outside of Microsoft is that you were actually you played a pivotal role in Sponsoring Microsoft acquisition of GitHub back in 2018 Can you share take us back to that moment and share a little bit about what was your vision for GitHub back then? Yeah, so in 2018 I was a product manager at Microsoft working for Net Freedman, who at the time was the CVP for mobile developer tools and Net had the idea of buying a GitHub and making GitHub part of Microsoft. soft and so he and a few folks in his team were kind of like strategizing of how can we pull that off and picture to Sartja and the board and as the deal got announced, actually, you know, about six years away from that at the time of this recording June 4, 2018, is when we announced the deal.

4:32I became the deal integration manager was the role within Microsoft that ran around the company making sure all the pieces you know from legal to HR finances and product and engineering come together to get that deal through the regulatory approval and ultimately now getting us to a successful day zero which then happened in October 2018 and that's that's how ultimately came to GitHub. What did you envision GitHub becoming the potential it had as part of the GitHub universe? I think you know at the time we were thinking there's so much potential for GitHub that's still to be explored and to be realized.

5:10GitHub started with the first commit in late 2007, launched in 2008. Very quickly became a new way of developers working together. Social coding was invented by Chris and the other founders. And it evolved into this two -sided product, the Home of Open Source, where many open and source developers were collaborating and the place where many startups and ultimately enterprises were building their software and often that two -sided equation was that the companies wanted to work exactly like open source developers work which is boundary less in the world of open source. You don't really care where your collaborators sits, where they're from, what their education is.

5:53They don't sit in an org chart. And often you don't even know their real name. All you know is the handle and the code that they want to contribute back to the project And I think many companies don't have that. You have silos and when you get an email, you're like, where are you? Who is this? And why are they emailing me? And why do you want to be involved in my project? And so companies want to burn down these world gardens and have a similar collaboration model. And that's what GitHub symbolized in 2018. But there was so much more to do to provide something like it up actions that allows developers not only to manage their source code and plan, but also to build their apps and now ultimately with co -pilot to take it even a step further and making development a very different experience than it was 20 years or 30 years ago when I started.

6:40Since you mentioned co -pilot, I'm dying to ask you about the behind -the -scenes view on what is not only the most successful enterprise AI application today, but I believe the first LLM native application that was really built built and launched. I guess was it part of the original acquisition thesis at the time that you might be able to build something like Copilot eventually, whose idea was it to do something like Copilot? And like, did everyone say yes, this is gonna work? Or was it like, this is a crazy idea? There's a moonshot, it's never gonna work. Take us back to the origin story. So the original acquisition thesis had like a little paragraph in it about AI, but I think that was more like a moonshot than like the pop idea at the time.

7:24What really happened in mid 2020 is that and no transformer models. And the paper came out a few years before that, but the first really working transformer model so GPD3 was about to launch. We got early access. We were all in lockdown, June 2020, on a call and one of our team members, Uge, DeMoa started typing things into the model. And everybody else was just looking what Uge would be doing. And then in the actual question, what can we prompted to write code and can it write proper code? And I think that was the first kind of a harm moment that it was actually able to write the real syntax.

8:06And then we tried different languages and we also found flaws in the model. And so we started exploring the deeper outside of that Zoom call in a research process, doing analysis. We asked some of our staff and principal engineers to submit coding exercises. we looked at Python functions that were in open source repositories on GitHub. And we worked with OpenAI to take GPD3 and find you in the model to be better at these coding tasks. And in August, we had a model that was able to solve 92 % of these coding exercises. And in fact, the Python bodies that we extracted from open source projects was like 52%.

8:48Now naturally, that percentage is lower because you have less specified code than in the coding exercise for an interview loop, right? But that I think gave us this, this moment of confidence saying we can build a product around this. The second moment I'd say was when we rolled it out to our internal engineers in early 2021 and they came back with saying this is, this is fantastic. I think the Net Promotor School NPS was somewhere in the 70s and which is I think for developer tools really really good Most developers are skeptical, you know don't touch my system, you know never never touched a running system or process and And many folks are you know kind of like have created their work setup not not only on their Physical desks but also on their virtual desk of how they want to work and so we were really you know and tweaked by the in internal responses and then we launched the preview and And the team came back and saying, it's writing 25 % of Python code in those files where it was enabled.

9:47And I think we sent them back, say, go and verify the telemetry that can be true. Like because we couldn't believe it initially. And then as we saw this progressing, I think in my first keynote as CEO was in June 2022. So now two years ago, and I said, it's writing 40 % of the code. And I think in five years it's going to write 80 % of the codes in those files where it's enabled. So it happened really organically. It wasn't like you were sitting in the room whiteboarding. Like, Copilot is going to be the next iteration. It was like the model proved to you how great it was and just seeing the model performance and seeing usage, like really like it organically built up from it.

10:25Going back, you know, to the digital thesis for GitHub, we wanted to make developers live easier. And as we are company building software, we have our own software developers and the Microsoft has, you know, 70 ,000 or so of them. And so we understand how software developers work because we have so many of them. And we live the life of many of our customers, which is we have way too many ideas. We are moving way too slow, at least in our feeling Amazon delivers my picket package faster than we're implementing some features. Also the expectations have shifted significantly, but the backlog is endless.

11:01The amount of ideas that we can brainstorm on virtual whiteboards get up this remote company. So we don't often meet in real physical bite in front of free physical whiteboards But and then the other side is all the other work that we also have to do, you know compliance security accessibility You know enterprise requirements privacy regulations European, you know AI act and digital markets act and all these things also cost developer work And so we're constantly everybody's constantly struggling with the length of these backlogs and so So if you will, the intrinsic motivation was, let's bring the effort down to write software and make it joyful again.

11:41What do you think made Copilot so good at the time and also going forward today? Obviously, GPT -3 was great even back then. But also, I think a lot of people might not know all the value that you brought or GitHub brought in both public and proprietary data around code that GitHub owned. Can you share a little bit more about that and also how you think about that going forward? I think the key ingredient of the original co -pilot, which was on the autocompletion, right? Like it would type in your editor and it would complete the next line, but it could also complete multiple lines of code, complex algorithms or simple algorithms.

12:16Some of the demos we often chose to implement sorting algorithms like BabelSault or Prime Number Detection. And it can just write those 10 lines of code by just a simple prompt, which is a comment in the code or just writing the method declaration. And so getting into the editor where developers already write code, not changing the way they work, but giving them ideas while they're typing, I think that was the key moment, other than obviously the model being good enough and in OpenAI, tuning that model on publicly available source code from GitHub. GitHub didn't give special access to OpenAI. OpenAI was just able to access our source code, in the same way that many other startups are not doing that either through direct access, through API or through archive programs, like the internet archive and the software heritage.

13:06And we actually have an established partnership with them to stream our open source code over there. So it can be archived for until the end of time. And so of course, the model got tuned to be good enough. But then the UI and the user experience, I think, was crucial. It wasn't AI is now on everybody's mind. But the truth is our cell phones have you know some kind of AI build in for a long time your keyboard is predicting the next word with some kind of machine learning algorithms Your photo library you can just go in there and search for license plate and find all the photos of the cars that you took to remember what the license plate you have And then and that's AI you know image recognition But that nobody perceives that as AI is just a co -user feature And so I think that also was the the core ingredient of of co -pilot We're meeting developers where they are and we're making their life better and then I think the name itself was also a stroke of genius.

13:59One of our other developers, Alex, came up with the idea to name this co -pilot as NAT, is a hobby pilot. And so that's where the name is coming from. So it's like, I'm thinking about what could I name this? So my boss is resonating with him. Wow, that's so interesting. I didn't know that. But if you could go back to 2020 -2021, is there anything they might do differently? You know, on hindsight, you can always move faster. And then be, I think, more convicted of those ideas. I think in the beginning, we kept the team intentionally small, small teams can move faster. We call this... Well, big was the team.

14:39I think the original staff as well, like three people, but that's obviously a staff researcher, sorry, or a principal researcher. But I think that that's cheating a little bit But in the sense that of course there was a team at OpenAI, there was a team in multiple teams in Microsoft, both on the research side and on the inference side, the model inference side, in fact on the model training side to even enable the model. So of course in the bigger partnership between Microsoft OpenAI and GitHub, it was a larger team. But the original paper was written by three researchers and then a hundred people are so mentioned in the credits.

15:14And then we move fast with I think a step of five and then I think it increased to 10 teams and of course today The team is much smaller, but we still have what we call get up next and incubation Team that now works on on co -powered workspace and iterates on on new ideas It's almost like you know start up incubator within the country Yeah, and they're picking up ideas and the main difference to you know our mainline engineering teams and product management teams are that they got to have the mindset that most of their ideas will never go into production, right? It's kind of like this okay -ass won't -work because your key result is to throw away most of their ideas and start fresh with another idea.

15:53And I think that's where a lot of the innovation speed is coming from. I want to go back to what you said a minute ago about how you hand over control of the model effectively to open AI. Was it scary? The brain of your AI application is actually being built by another company, not developers under your payroll, your control. How do you think about, was it an easy decision to partner with a different external model provider? I'm curious how you think about the value that Microsoft and GitHub provide to end users versus the value that OpenAI provides to end users and then where you seek to really bring value to users.

16:34to me it wasn't scary at all. I'm sure they were folks in the team and in the company that thought we should have our own models instead. But in reality, if you look at GitHub as a company it was born in the cloud. Of course, we have always relied on partners to build our stack. To my memory, we have never built hardware ourselves. And while we have metal in data centers or had metal in data centers for a while, the data center itself wasn't built by us either. Neither was the CPU and the memory and all the network infrastructure. And then even if you go higher in that stack, GitHub is built on top of open source.

17:12And so the majority of software applications, in fact, we love sharing a statistic that says 90 % of the stack of most applications, even if the application itself is close source, is in fact based on the work of the open source community. From the operating system, the Linux operating system the Mississippi Brickivitis today on service, to container technology like Docker and Kubernetes to thousands, sometimes 10th of thousands of open source libraries. And so the model just flows naturally in that stack. And you know, we at Microsoft think about this as the co -pilot stack with different layers hardware, the model, the kernel, if you will, like the infrastructure response to the AI filtering and whatnot, then you get into the application layer with the AI co -pilot and then the extensibility on top of that.

18:00So if you look at these layers in the stack, Microsoft has strengths and partners. In some form, Microsoft is involved in all parts of that stack. The co -pilot PC has a custom chip that Microsoft is developing with partners. We have our own models with 5 .3, We have partnership models with OpenAI, but we're also hosting Mr. Trial and Lama on Azure. We of course have a large cloud, and we have a lot of expertise in response to the AI, and then we have lots of applications. We are building ourselves and enabling others to build those applications. Since two -part questions are always hard for me to forget the second part.

18:41But I think that actually describes the relationship very well. It allowed us to move really fast because we could rely on partners like OpenAI, not only building GPE3 and then codex, but also then innovating with GP3 .5 and Shatchy PT, GPT4. Now we have GP240, we have Microsoft with a large infrastructure that builds super computers for training, but also infrastructure to uninfluenced and co -pilot today, runs in multiple data centers spread around the world in different regions. So the developers that sit in France now connect to a GPU to an Azure instance that's much closer to them to enable low latency, right?

19:19And so Microsoft gives us a lot of infrastructure, a lot of expertise and responsibility, I and of course a lot of commercial distribution. Yeah, very complicated layer cake that makes the magic come together. Would GitHub ever want to build its own models or just use best -in -class models out there? You know, obviously there's always the desire of engineers to build their own stuff and I would you know, I would not deny that we have played with all what ideas are models. I think the almost senior learning team goes back. I think it actually had it before Microsoft acquired GitHub. And then we obviously have fine tuned models ourselves.

19:59And we have fine tuned models with OpenAI and Azure. We are working with customers on them being able to customize models based on the code that they have in their repositories. And you know, never say never what the future may bring. But today, we're really happy with the models that we have. and we're constantly looking into the market or for not only opening I provides to us, but also what others have. So co -pilot is already one of the most successful generative AI applications in terms of user scale, usage, et cetera. What are some of the latest metrics you can share? And what are the metrics that you're most proud of?

20:34I think the one I most proud of is the developer happiness as scores. And if you look at survey data, most of the surveys that we have done, but also the surveys that now are customers, either publishing themselves or bringing back to us. It's clear that software developers after they have tried co -pilot after they got over the initial adoption hurdle or skepticism, they most of them love using co -pilot and most of them report that they are more fulfilled, you know, they're more satisfied, more happy. They feel like they're requiring less mental energy to get the job done. They need to do less boilerplate and I think that alone is really making me happy and there's lots of numbers that I can throw out.

21:14But I think the general just is no matter what developer I talk to those that have used co -pile for a while, no longer want to work without a co -pilot. And then the other side is the productivity metrics of making developers more productive, which I think matters to the developers too, but it also of course matters to their management chain and their leadership in the sense of getting more stuff done delivering more value to their end customers. And so, you know, today we are happy to say that we have more than 1 .8 million paid subscribers on co -pilot in more than 50 ,000 organizations. And that really makes us happy looking at that growth.

21:56And you know, we're here at the Sokriya office. And it feels like we're like a high growth startup. And that's a good place to be in. It's awesome. Well, we're still on our wall somewhere. Actually, we know exactly where we'll show you. Me too. The creative minds. Was there anything that surprised you in terms of co -pilot's impact after its launch and even today? I think you know it's the 25 % certainly surprised us. The quick turnaround from the skepticism after we announced this in June 2021. I don't even... I think we had a very sharp blog post and then just a web page with examples and animations, story, how it would work.

22:35And I think folks were looking at this and saying, this is like a cool tech demo, but it doesn't actually work for me. And I think the skepticism was that people had seen how GBE3 at the time would work, and they couldn't understand until trying it that it has the context of whatever you would in the file before, before corporate suggestion comes, and it considers adjacent taps and things like that. And so it magically picks up your style and it knows about open source libraries that you're using not because you have open those libraries Just because you have an import statement at the top and because the modern was trained on such a large corpus of data that It can provide you know the calls into these open source libraries and and so kind of like it feels to you that the co -pilot it understands more about your project than your thought GP3 free can do it.

23:27I think that's where the digital major came from. The other thing is today, you know, when I observe people using co -pilot and obviously chat GPT changed the whole game and brought in chat as a component we have now co -pilot chat is this natural language component and like using not only, you know, code and comments as a trigger, but you know, English and German and Brazilian Portuguese and we have demos in India where Karen and V, one of our folks there, is demoing this in Hindi. And so, and you can actually speak into into the co -pilot with voice detection in British Studio Code. And it gives you the response back also in Hindi.

24:06And so it's really cool, you know, for anyone that wants to explore coding, even if they're not fluent in English or in programming language, my kids are using it to find their own bugs and Python. So they're only coming to me and it's like, they already have to find my bark. It's kind of like, well, go and find your own bag. And that also obviously helps them to develop, you know, develop their skills. And it's a bit like, you know, I often talk about, you know, natural language will democratize access to software developers, but it doesn't mean that everybody is immediately a senior principal software developer.

24:43was the same way that just because I buy a guitar, I'm not as good as Keith Richards playing with the Rolling Stones, right? And if you look at any professional band that's touring the world, they're all still rehearsed over and over again. And I think this is like this idea that to be good in a craft, you have to keep doing it. That cupada does not take that away. It just gives you another tool in your toolbox. I really like that analogy. I still believe in teaching your kids to code. Because that's a debate on the amendment now. Oh, absolutely. I mean, the first of all, you know, the human language is not deterministic.

25:22Right? You mean different things? You can mean different things by saying the same sentence. And even, you know, the... That's very German. Even the yet... Well, now we can get into off topic debates about yeses and noes when you're answering in a question with a negative in it, right? Like, you have not been to the grocery store, do you answer that with yes or with no, right? And Americans expected no, even though you mean actually yes to that question. But like, look, you know, human language is not deterministic, and so code is. With code, you can very precise describe what the machine does.

25:58Code is an abstraction layer on top of, you know, assembly language on top of the instruction set of the CPU or GPU that, you know, the processor or manufacturer, like Interlo and Vidya has created. So it's just another abstraction layer. Human language is something completely different. It's creative. And that's the power, but it also means that there will be code involved one way or another. And we're moving up the abstraction layer, but we're also spreading the meaning. And that's truly powerful, but it also means that there will be some conversion to code somewhere because the chip itself, at least today, is requiring a deterministic instruction set.

26:39Yeah, I love that. I'd love to talk about the future of co -pilots. You've been announcing new products in rapid fires, accession, I think co -pilot X, co -pilot enterprise, something around code security, I believe, and then work spaces most most recently. Can you tell us maybe about what each of those things does and how you see them all fitting together in the grander vision for what you hope co -pilot becomes? You know what you describe with all these product names is one of part of our mindset is that momentum is our energy. In this age of AI moving fast and iterating fast is crucial. And so we are having developed Copilot from this original idea of autocompletion by adding chat.

Read the full transcript

27:20We were developing autocompletion and then chat. And then with chat, we also announced something that we called Copilot X, which the idea was we're bringing AI features into every part of the developer lifecycle. We're bringing Copilot wherever developers are. So, you know, while we added chat to the editor, we also added, you know, a little copilot I can into the input field where you write your commit message. And that might be trivial, right? Like, everybody can write a commit message. But it also means I reduce my mental workload and I reduce kind of like the bias that I have for the work that created myself, right?

27:55Like, for me, everything is obvious that I just did for the last hour. But for you, when you want to review my commit or my pull request, it's not as obvious. And so having an AI described that in a neutral form, kind of like in an outset, I'm describing what I just did is incredibly useful and it just keeps me in my flow. And we added it to the debugger. We added it to many different parts of the lifecycle already. And with Copial Enterprise, we bundled it into a higher price product that allows enterprises to customize Copial it based on their institutional knowledge. And Enterprise here means really any company that has gone for more than a few weeks, because they're all immediately built institutional knowledge, right?

28:38How we work as a team, how is our coding practices, these are the libraries and languages that we use. And so, unless your student at university that gets to have the free range of technologies available, at least when the professor allows that, every time you join a company or join a different project, you have to ramp up again on how they are doing things. And so, co -bought enterprise, let's companies customize the co -pilot to their institutional knowledge and it makes it really easy for me to join that company Because I can now ask them questions without you judging me like you know imagine I would you know join here My first day with like why is Thomas asking all these questions?

29:18Should he already know all of the activities? You know been in professional life for a long time That's the challenge that we have in we join companies and we have the anxiety in our head that we can't ask too many questions before Steph says what the hell Right? And so that's I think the power of co -pilot enterprise, that's the power of bringing co -pilot into every part of the developer life cycle and ultimately into every part of our lives. You've also mentioned that agents are one of the most important things for GitHub. Maybe just to set the stage, how would you describe an agent versus a co -pilot?

29:49And can you give us a teaser for what types of agenteic capabilities we should expect come into co -pilot soon? Yeah, I would say, you know, co -pilot in agents is kind of like the same thing. And an agent is using a model to get a task done, right? Effectively, it's looping with a model to solve something for you. And a co -pilot is an agent of agents, and it has multiple features available to it. You know, if you think about auto completion, well, it's an agent that takes every keystroke you did. And the context that you have, and you added a sensor to model inference, that gets the response back, it might pick the best prediction, and then it shows it to you.

30:27So we are going to see more of these agents that take over more of our tasks. One of them that I'm most excited about is autofix. The very works is so you submit a pull request and traditionally some security scanning feature that you have integrated into your pipeline, find security vulnerabilities, SQL injection or cross -site scripting. Well, that's great, except now I cost more work for myself. It's kind of like you have a Wumba, but instead of vacuuming your house, it just shows you where the dirt is. And then you have to go and vacuum yourself on that position. So now with autofix, we actually only showing you security vulnerability.

31:05We're also giving you the fix and that uses the AI model together with the vulnerability and the description and the code to basically solve that vulnerability for you. And the initial results are really impressive. with some customers, we see that we can burn through like 75, 80 % of their open alerts. Everybody has those alerts. And if you don't have any alerts right now, I bet you you have them by Monday. That's the challenge in this world of software security. Everything is around us moving so fast. There's always a new version of open source library. There's a new version of Linux or a new Windows patch.

31:40There's a new device coming along the way or new NVIDIA GPU. And so we constantly are behind just keeping our applications up to date, you know, to the standard that is expected by our customers. And at the same time, we have to build all that innovation and all that. Yeah. Super interesting. Close stuff. What else do you think is missing in the product roadmap? Like if you could wave a magic wand, like what else is there to build that you're really excited about? We think there's still a lot of work to do on these agents. I think there's a lot of agents you can think about. We talked a little bit, or you mentioned workspace before.

32:20What co -pilot workspace does it provides different agents to get you from idea to your pull request, to get you from idea to the code. And the first one is the spec agent and what that actually does, it helps you with your thought process. So you know, you write down an idea, implement some feature. And it looks at your existing code base, and it basically helps you then to reframe that idea. Now, that's not only useful for developers, it's actually useful for product manager, right? Because it may might tell you, well, Thomas, this idea is no way you can describe that with a single sentence and a developer cannot implement that in just a single ticket.

32:54It needs to be an epic or multiple different user stories, right? And then the next step is the plan agent that, you know, helps to figure out where to make the changes in the code base. And again, you can kind of see here, but there's a lot of other benefits you get from that because it helps you to understand the code base. Because most code bases that are older than a few days have hundreds of thousands of files. And as developers, we have to navigate all those files. And even if you have been in a code base for a long time, you still might miss out that one file that you haven't touched for a while.

33:28And you have to add a config statement there. So it helps you understanding the code base and then the implement agent helps you implementing the code change. And every step in that way, you're still in charge. You can, you know, with natural language, modify the bullet points of each of these agents. And then obviously you can modify the code at the end. And so if you look at just these three agents, you can easily start thinking about other agents that you might have along the way, right? For example, the one that estimates the size of a ticket, the story pointing agent as one example. Or another one is that, you know, once you have implemented the file, Well, now you want to build Run and Debug the file.

34:06And maybe you have an agent in the future that will just automatically fix any bugs that they introduced by the previous agents. And so I think we're going to have more of these building blocks, Lego blocks, if available to us. And in fact, if you look at Lego, they have way more types of pieces today than they used to have. Trusting models are much more complex. and then you can buy NASA rockets and whatnot, they need different pieces for that. And I think that's kind of like the same way we should think about co -pilots. They will have more of these building blocks that enable us. In addition, to more powerful models and mix of models, these building blocks will enable us to do more.

34:48Increasing modularity, interesting. Where does your ambition for GitHub take you, or maybe even with GitHub co -pilot specifically take you, as you think about what you alluded to from the perspective of deepening where you can go with just the software engineer, to also expanding into potentially different personas, PMs, you mentioned maybe an SRE, maybe a security engineer. Where does that, you know, the breath also take you? Yeah. I mean, first of all, I think all those roles today are already collaborating on GitHub. In fact, GitHub had always that mantra that we are building GitHub on GitHub.

35:21And it's sometimes, We have pushed it a bit too far, but today, most of GitHub employees, we call them Hubbers. Hubbers are engaging on GitHub and GitHub discussions and GitHub requests. Our legal documentation is all on GitHub, which if you think about it's actually much better than managing red lines in Word. Because you have a version history and you can see who made what changed it. In fact, you can see soon a future where maybe your legal document is explained by a co -pilot in human language, you know, in actually understandable human language, not the lawyer language, right? And so, so we're using GitHub, you know, to our, our company, but yeah, we, we, it's, we are all the developers and all the supporting functions collaborate on a project.

36:05So that's, I think number one, number two is we want to democratize access to software development. And, you know, I recently gave a TED Talk and I talked about that. I think our goal is to get to 1 billion software developers on the world. Now, it doesn't mean 1 billion professional software developers, although that might not be a bad thing, necessarily, given the demand is still very high. It's sometimes hard to find qualified software developers. But it's really about democratizing access to writing software on these devices that are with us. You know, our mobile phones are, you know, a really important part of our lives today.

36:43you can't really imagine a live, an urban knife for sure without a mobile phone. And so then also being able to write the applications or little scripts or just using natural language to control the phone, I think is incredibly empowering. And so bringing that into 10 % of the world's population by 2030 is so assuming that then 10 billion inhabitants on this planet, I think it's going to create a better world. And it's going to unlock a creativity everywhere. and hopefully, you know, we see cool venture backed startups in India and in Brazil, and maybe, you know, the next big tech company is coming from one of those countries instead of the US West Coast.

37:25We hope so. Maybe zooming out of GitHub Copilot to broader GitHub itself, GitHub Copilot itself is driving so much innovation within GitHub. But what are some of the other key initiatives that you're leading across GitHub overall as well? Yeah, we already talked a little bit about, you know, autofix and security. I think security is securing software supply chain is, is dear near to our hearts. Um, there is, there is no future of, you know, human progress and with software, if you're not also able to secure the supply chain, you know, today, you know, there's this XKCD comic, um, uh, of the internet's infrastructure.

37:59And there's this one building block that says, you know, the guy in the map, the braska maintaining this one library alone, right? That actually is funny, that is a reflection of the software world today. So we have to make it sustainable for those maintenance to build that software and keep it joyful. And then also we have to make sure that all these building blocks that are on our stacks that have become system critical to be secure. And so we're investing a lot in platform security and application security and of course in our security products. and I think that's going to be crucial combined with co -pilot and AI to not only create all these work items, but also enable developers to burn them down to fix all these issues.

38:42Yeah. I want to zoom out from GitHub, her second and just talk about how you see the future of AI and coding overall. Like you mentioned, there's been a billion casual developers around the world. Like, well, what will it look like? Will everybody be kind of coding applications for themselves to use? Will there be some number of professional developers who are super developers? Like, have you read in the world looks when you so kind of democratize the craft of coding? I mean, I think it's an incredibly creative world in a world where you're not dependent on, you know, when you're a kid on your parents having technical knowledge or your school having a teacher that knows how to do this thing.

39:23So we're going to have much more access to those that interested in learning about this. I mean, it's easy today to take a sheet of paper and paint something and every restaurant, at least in this country, gives you crayons, if you come with kits and a coloring sheet. Life saver. Life saver. Or you have your mobile phone and they use your mobile phone. You know, it's easy to learn in the sense of accessible to learn a musical instrument. And I think it should be easy to learn coding. And so, first of all, I think that should be something we are excited about and not concerned that we are inflating the number of developers because just because kids learn it doesn't mean they want to become a developer.

40:03I think there's still a world where people want to do something else in software. But then if you think about many other professions, physicists, for example, they use a lot of software. The first image of a black hole was rendered by the help of Open Source Project. The Mars helicopter, run on open source. And so, yeah, it's space, space engineering, but they're using software and they're building software. And so the professional itself is everywhere. Every company is a software company. Banks are software companies. Energy providers are software companies. Farmers are software companies predicting what seed to plant is here, what the weather is going to be like, what was the soil quality from last year and things like that.

40:45But of course, you know, that the hobby scenario isn't is also important. Like, you know, a text season is over here in the United States, but that doesn't mean that I couldn't think about next year to automate a lot of that. If I only had an AI agent that does all that work for me, you know, and then downloads all the PDFs and extracts all the numbers. And I don't think we're too far away from that. And you know, I'm now in software for almost 30 years or almost 30 years. And as a professional software developer, and I don't have a lot of time to code. I have a company in Toronto, I have podcasts to give.

41:22And things. But the problem with today is you find an hour on a weekend and you have a project. And the first 20 minutes you're spending with updating everything to whatever you missed. and the burden is actually, the fun is gone to certain degree because the burden of maintaining software is so high. So having something available to you that gets you quickly into the hobby and out of the hobby or out of that task, I think, is incredibly empowering and brings the brings the fun back. And you know, that's where the Lego comparison is so useful, right? Because Lego is just incredibly accessible.

41:58And even if you, the best Lego is the one where you don't have of instructions. They just have a table full with Lego brakes, even in random colors, right? And then have this excitement of play and even professional workers at their off sites or workshops often have little gadgets or bricks on the table so you have your fingers do things while you're thinking. So I think that's where that word is leading us and we will have more access to the technology. We have more people that can build software that doesn't mean that they're taking jobs away from professional software developers. On what timeframes do you think we'll have coding agents that are as good as maybe the average professional software developer and and you know there's the legend of the 10X software engineer like at what point do you think AI will be as good as the 10X software engineer in capability?

42:50You know the trick in that question is as good as and what does that mean? So I think you know is a model today able to write better code than the average developer. If it is prompted in the right way or given the right context, I'd say we are already there on average. Because often, the model just knows more about that whole space than I as a human do. And you see that the students, if they have to implement a conversion from binary to decimals and that, and they might write 100 lines of code and then they go and ask co -pilot how to do that and they get probably an open source library and one line of code and then you can kind of say, well, I'm not allowed to use open source.

43:34And then you would probably still get a better code than they would. And I think the tools, the same as tool for the professional software developer, because look, we're not perfect. We are human and I think that's part of our nature, that's part of creativity. Now, that's the key thing though that the model is not creative. And the model cannot, today, the model cannot make decisions for us. Or if it does make decision, it doesn't actually take all the constraints into account. Like if you think about software development, other than writing code, which I think that fun part, it often means I take a very complex problem and you break it, decompose the problem into small building blocks.

44:14And the block size is increasing over time. It used to be, all the completion used to be just the next word, and then it was maybe a full command and it's multiple lines of code and maybe it's whole files in the future. But along that decomposition process, you still have to make a lot of technical decisions what database am I using and you know, you probably know better how many database startups Sequoia has invested in and how many infrastructure startups and how many serverless startups and obviously there's all the incumbents in all those spaces. So there's a thousand or ten thousand decisions to be made and the engineer is the system's thinker that is making those decisions or the team of engineers and companies.

44:54I think, you know, we have been building houses, you know, as humans for thousands of years. And if you have ever built a house, it's still not a solved problem. But yeah. But what at what point do you think that creativity in that systems thinking gets built into co -pilot? Or do you think it never does? I mean, you know, it's a bit of predicting the future. I don't know if I would say never, never, never say that's a dangerous thing on a podcast, you know, you invite me back in three years and say, well, Thomas, you know, last time we asked you about this and Kelly has happened since no, I think, you know, we'll see where the research goes and where the monogamy goes in kind of critical thinking and systems thinking and those kind of questions are also learning, you know, learning, you mentioned your two -year -old, your two -year -old and my kids, they learn, you know, as they mimic the humans around them, they have so good at learning language and especially in young Asian or they can learn multiple languages, mine speak English and German because we speak German at home and they don't have an accent in English, well they have an American accent but they don't have the German accent right, they don't have an accent in German either.

46:04And I think this show is like that the human brain is still so much more advanced than the transformer models and the diffusion models and the other types of models that we have to image recognition and whatnot that we have today. And you know, it remains to be seen if we can kind of like add that sentience piece to it. But today I'm not seeing it and I haven't seen any research that telling me that that's coming anytime soon. Mm -hmm. That's a really clear, Dwayne. Switching gears a little bit, I mean, I'd love to hear your thoughts on the overall ecosystem of startups right now. AI Code Gen is the hottest category with a lot of ambitious founders.

46:40and there are so many different attempts that they're taking, whether it's folks who are trying to build a better model, folks who are trying to build a better IDE, folks who are trying to build kind of an all -in full -stack engineer as an agent. And you know, but the big elephant in the room is GitHub Copilot and all the adjacent products that you have around it with Copilot workspace, with Copilot Enterprise, with autofix and owning the S code as well, amongst many other things. How do you think about what white space there is for existing or sorry for new founders? And if you were a founder yourself, trying to build a space, what would you do?

47:20I mean, I love developer tools. So I probably still do developer tools. And I'm not sure I would worry too much about what's white space that's taken by incumbents because that can't change quickly. When Github started SourceForge, was the big elephant in the room, and SourceForge had all the open source projects, and then came Gith and Gith accepted that space, and then the founders of Github took Gith and built Github, and all of a sudden, that elephant in the room was no longer the elephant. And I think it is often fun to compete in the same space, and we love competition because it pushes us forward.

47:55But it's boring to do a race or a game if you don't have an opponent and if you don't have other teams in the league who would watch the Super Bowl if there's only one winning team every year. So I think, I don't think competition should hold you back as a founder from going into that space. I think the software development space is wide open and there's lots of problems to solve. There's lots of problems in different industries and categories to solve. We haven't really solved modernization of source code. Cobalt runs still on mainframes and you can use a co -pilot and we are heavily looking into that and because it's such a pain point for many financial service institutions.

48:39You know, the credit cards, your bank account, Wallsweed all that runs still, Cobalt I haven't met a single bank that doesn't run some cobalt on some mainframe. What would you do with co -pilot and cobalt? So today you can explain that which is often helpful because the cobalt was written 60 years ago and so the people that wrote that code are retired. Yeah exactly. Would you rewrite all the code with co -pilot? Then you can ask it to write unit tests because nobody would unit test in the 60s and 70s either. Let alone that there were unit testing frameworks for those languages. just like keep in mind, you know, the 60s that was before hard drives, right?

49:17Like, you know, before before we had, you know, personal computers, it was a very different world back then. And of course, those companies have done work to modernize to certain degree, but it's far behind Azure software development. So you can support that transformation process today, but there is, you're not at the point where you can just click a button and you have a transform. The same is true, you know, for many more modern languages, you know, there's large PHP code basis, there's lots of Java out there. There's lots of optimization that we can take to just make our existing stacks more efficient where agents can help.

49:52There's lots of things to improve in every part of the software development lifecycle and in this ecosystem around us. GitHub, you know, is I like to think about GitHub as one planet in this universe of software development tools and there's smaller planets around us and then equally or almost equal size planets in our space and we consider them partners and we're happy that they're there. Yeah, so interesting. Agents are just pulling that thread a little bit. It's also an area of excitement for us. And I think you have a lot of the benefit of owning so much of the data and everything you can do on the post training side.

50:30Opening I itself is also getting better and better with each new model class as are or every other model company out there. Would you ever want to invest into building your own agents, maybe from scratch, by building your own agentic models, or just to partner with some of the others out there? Me as GitHub CEO, or the rest of your business. Yes. Or me as a agent investor. You as GitHub CEO. Yeah, I think we are probably doing both. We are going to, we are always, you know, in a way we always have done both things as we have invested into our own things, the thing that we consider as core part of our platform and of our offering, part of our primitives.

51:14And we have partners, partners with companies. Just earlier this week, we announced the partnership with JFROG, which covers spidery artifacts, scanning of containers and those kind of things. And they are obviously very naturally our space. We have the source code and we'll do a source code value, either compile it into binaries or you combine it with binaries before you deploy it into the cloud. And so there's a natural value chain there where we have things where we invested ourselves, things like releases that you see on GitHub and packages, we own NPM, the largest package service tree in the world for the JavaScript ecosystem.

51:53And NuGet, who are partners at Microsoft, the largest .net, where I just see in the world. But that doesn't mean that we cannot also partner with the J -Frog to ultimately enable that secure software supply chain that I mentioned earlier and that I think is crucial and that Figma, you know, verse sell like there's so many other companies in our space that will play part in the lifecycle and I don't see where somebody covers all of that and can convince every developer that using all these tools is better than picking, you know, what what analysts might call best of breed. And like the tool that I consider the best is all subjective anyway, right?

52:34Like it's all those, does it meet the expectations of the developer in the environment? Yeah, makes sense. That's great advice for startup founders and I think really encouraging. What about for incumbents? I think you are such a beacon of hope for incumbent companies. I think Satsya said in the last earnings call that GitHub is now growing 40 % every year. or thanks to the co -pilot acceleration. And so like, and to your points earlier, like you feel like you're a young startup again, like walking into Sequoia offices. Like what advice do you have for the Sony incumbents that are trying to reinvent themselves around AI?

53:09What advice would you give those folks? Sajja actually said 45%. So we're really excited about that. Okay. All up on our revenue equal 45%. You know, I got an email from somebody last week who was like looking at GitHub, I'm losing the belief that large companies is cannot move as fast as startup can. And I think the key ingredient on this is radical photo -cookers. And basically focusing on a few small things just because you have 1 ,000 engineers or 50 ,000 engineers doesn't mean you can do it all. That's just a false assumption. And I think it's in a way misleading as you manage larger teams.

53:46You're losing the unit of side team size that shows you how much you can actually get done and how much friction you have in the system if all these teams work on different things. So I think focus, you know, lots of notes on all the ideas that people have around you and customers, that's I think the key piece to move really fast. And then obviously taking in some strategic bets and strategy means you're thinking about it as how do I differentiate from others, you know, what makes me specific, It makes me special in this market, but it lets me charge the prices. I'm going to charge and not fight, you know, race to the bottom.

54:26And I think that's this kind of like thinking about, okay, you know, in software, we like to think about, well, if I add just three more features, then I'm going to win the space until you realize, well, everybody else can also add those three features. There's almost nothing in GitHub itself as a platform that you couldn't rebuild with significant investment and time. But I think it's really hard to mimic our culture. It's really hard to mimic our experience, our obsession about developers, and ultimately our focus and the way we're approaching these things. I guess very tactically, do you recommend staffing a Tiger team to get to the product market fit on AI?

55:05Do you recommend pulling half your engineers off, whatever they're working on, and like, hey, you guys are the AI team now. We gotta go bigger, we'll go home. like, tactically, how do you work when you're losing? Well, as an incumbent, you always have the challenge that you have to sustain whatever the business is you're in. And so you can just pull everybody into a new topic, unless you're willing, you know, to disappoint all the existing customers, you know, no enterprise business has not made promises to enterprise customers of what's coming next on their roadmap. You know, lots of conferences, including our own is, is, you know, stuff they're shipping right now and stuff they're announcing for the next six months.

55:40And if you're not delivering on these announcement, your customer base is not going to be happy. And so you can't really make that drastic move right away. And so we love this idea of a Tiger team or an incubation team. We call it GitHub Next. And when we set that team up, and we actually thought they're going to work on projects that are like five years out, or in the horizon three, as space. And then it turned out, well, it was more like six months ahead of the curve. The future comes really fast on us. And so as that future then comes fast, you really also need to move fast and handing things from the incubation team over to your mainline engineering team.

56:18And then it's all about, okay, so we're funding AI because we're seeing the traction there. And that means we're leaving some of our previous bets in, you know, keep the lights on mode KTO or, you know, saying goodbye to these ideas and shut them down. I think that's the hard part of the strategic pivot. And that's easier for a startup. At least it often looks easier from the outset when a startup pivots. Like there's lots of startups on the wall downstairs that have gone through that as well. But obviously, internally, it's also very hard. Emotionally, you're tight to ideas. You remember the workshop under the Sequoia trees where you had those ideas.

56:59And then six months later, you're realizing we never got to product market fit. And the time is now to move to something else. So that is the same for large companies as well. Small companies, except that small companies have more of a forcing function to give up and move to something else. The innovation and success that you've created around GitHub Nex is amazing. How does a kernel of an idea start with in GitHub Nex? How do you then resource and invest into it? And then how do you, at what point and what's the process in which you decide whether or not something should be continued did Mestan or shut down entirely?

57:36So I think this start is always the employee, the hub that has an idea and we have lots of ideas in the company. We do hack weeks, hack -a -tons, passion projects, whatever you want to call it, 20 % time. And then the next team specifically, there's lots of demo meetings, demos and not memos. It's much more useful just to show a working prototype. It's so easy these days to just use some design system, react components and still, or figman and stitch something together, even easier with co -pilot. And then it's strategic decisions that the leaders of these teams, all the way up to me, need to make many ways very similar to any other creative industry.

58:24You know, like at Disney or Pixar, they have to decide what movies to produce and which ones are probably not going to gain traction. And part of that is customer research, talking with developers. And that then keeps going as we go through the initial idea and the first prototype and then going into a technical preview. And then the preview is all about that 5 -wheel, that feedback loop with the people using it. And quickly you see, are they trying it out and then they are churning or are they keeping the energy high and then keeping the ideas flowing is great, you know, any project if people just sending you more ideas and more feedback.

59:03And I think that's then the decision whether we are keeping that project and making it a main project or whether we are deciding okay, the X -ray rate is over, we learned a lot and we're moving to the X -ray button. And of course there's commercial aspects as well. Maybe outside of the world of code generation and anything in your current purview, what else are you excited about in the world of AI in the span of one, five or 10 years. Well, outside of developers. You cheated a little bit on me. I mean, I think in the context of one year, within the space of developers and outside of the space of developers, I'm excited about agents.

59:42And we're still very early in this journey. I think we have high expectations of what the agents could be. Maybe too high expectations to some degree. And so things will probably take a little bit longer. but I think in the next year or so we're going to see more of these help us within the chat interface and out that of the chat interface that will will solve tasks for us, you know like I look forward, you know, to that travel agent that often gets demoed by big companies to actually materialize and it can just go into my chat interface and say, you know, I want to have beach vacation over spring break and then figure out, you know, when spring break actually is because that's all on the internet and And you know what my name is and what my family's names are on their birth dates and their passport numbers.

1:00:26And so I don't have to enter that into a cumbersome interface anymore. It should be the price points. And probably we're going to the same hotel as every year anyway. And so I think that those travel agents or those kind of agents are going to happen in the next year plus I think five years is my national language vision and unlocking the world's knowledge, including software developers to everybody in any language, any human language and maybe that's even happening sooner. It's 10 years is hard, 10 years is so far away. But I think that's the AI of things, the material, the mechanical world of AI.

1:01:06So many things that we do in life, you need to grab something, you need to push something and go and check into any hotel. there's an AI involved once you get your own key. And maybe the elevator has some kind of AI because you push a button what you want to go to and then it's also to take elevator C and so you no longer push the button within the elevator. That's an optimization problem in itself. But I think there's so many physical things in life, you know, and we are still not at really self -driving cars. We have a dishwasher, but I still have to put the dishes into the dishwasher and out of the dishwasher, it's better with nine and 12 -year -olds and over two year olds.

1:01:46And there's so many other things in life where I think whether it's a robot or some other form of physical AI is going to take over some of the things that the consider is towards. We're really excited to hear that. And I think we have a very similar view of what will happen for one, five, and 10 years from now. Who do you admire most in the world of AI? I think I admire those that are building new stuff AI and software. Those that have a dream of what they could build. I think those that obsess about a problem and not about the technology, we're talking a lot about AI, but at the end of the day, it's what's the problem I was solving for the world.

1:02:32There's lots of biotech companies that use AI to try to cure diabetes or cancer. I'm sure there's companies trying to sort of climate change with technology. And I think those builders, the founders, those that have big ideas and that can change the world, those other ones I admire the most. And often when I meet with them in their offices or on calls, I'm like, this is so cool. And obviously, as GitHub, we are enabling a small part of that. And so we feel free to be the part of that journey. and we're really excited about building more for them. I think you're enabling a huge wave of new AI companies, especially those that are born open source.

1:03:19It's amazing to see. What advice do you have for the founders listening in the audience who are building in AI today? I mean, what are you, Sonia, ask, I think focus is everything. Like it's so easy to get lost in the all the ideas that you can put on a whiteboard. And that's the danger of a whiteboard that it has covers, you know, so much space where you can put ideas But focus ultimately is everything, you know, finding very quick market validation Often on the developer space that means going product -led growth Enterprise growth can come later, but like from my experience like There's nothing then, you know, a few excited developers spreading the word about your product even though the big revenue number then later comes from big enterprises buying you.

1:04:05But the reverse is often much harder of going enterprise first and you might find excited people there as well. But the feedback loop is just so different. So it's focused trying to find that flywheel, the product market fit, you know, and then I think the other one is to think big. I think it's like, like, it's easy to find smaller ideas on top of, you know, model today that get, you know, commoditized tomorrow. And so you have to think forward in that, you know, 10 years is a long period of time, but that's, you know, a good period of time for startup to build something that is actually meaningful in this world.

1:04:42And so you have to think big, you have to, you know, create a vision that may be much larger than the MVP, you know, the first thing, the prototype that you're building right now. And I think that's really hard as a founder to draft out that vision. And then decompose right and go back to that small problem that you can solve right now. So we'll close with some rapid buyer questions. One more answer. One more answer. One more answer. You change the blue. It's good. OK, say one more answer. One sentence if you need it. No, I say. I'm going to answer this. Yes. OK, let's go. OK. Well, anyone, meaningfully, disrupts Nvidia and AI chips in the next call it 5 to 10 year.

1:05:21Yes. In what year will we pass the 50 % threshold for sweet agents? 2025. And what about 90 %? 2028. We'll get hub primarily. There was too pessimistic. That last one. B. We can hold you to it. We'll get hub primarily be using open or close -source models in the next five years. Both. Both. Where does the majority of value accrue in AI? Models, compute, infra, applications. A cost of whole stack. That in high -end, so it was one word. Is systems thinking and creativity going to get baked into the models in the next five years? Maybe. And will there be a new consensus architecture beyond the transformer in five years?

1:06:13Of course. Yes. Wow. Why would you think the other way around? Like that's said that it is a much easier bet to think that there will be a new architecture because there was other architectures before Transformers and like that doesn't mean it replaces Transformers. You know your cell phones do as a CPU, even though GPUs are the hot commodity right now. And so I think yeah, there will be new architectures and they might be bigger than Transformers today. So interesting. I mean that would bring a lot of new oxygen for the builders and the ecosystem and a lot of things that we have to get reworked, rebuilt, re -architected.

1:06:47Yeah. Amazing. Thomas, thank you so much for joining us today. It's been a wonderful digging into the history of GitHub, the birth of GitHub Copilot, and the ambition that you have going forward as well. Thank you. Yeah, thank you so much for having me. It was so fun to talk to you both. Thank you. Thank you. Nice, thank you.

From the publisher

GithHub invented collaborative coding and in the process changed how open source projects, startups and eventually enterprises write code. GitHub Copilot is the first blockbuster product built on top of OpenAI’s GPT models. It now accounts for more than 40 percent of GitHub revenue growth for an annual revenue run rate of $2 billion. Copilot itself is already a larger business than all of GitHub was when Microsoft acquired it in 2018.

We talk to CEO Thomas Dohmke about how a small team at GitHub built on top of GPT-3 and quickly created a product that developers love—and can’t live without. Thomas describes how the product has grown from simple autocomplete to a fully featured workspace for enterprise teams. He also believes that tools like Copilot will bring the power of coding to a billion developers by 2030.

Hosted by: Stephanie Zhan and Sonya Huang, Sequoia Capital 

Mentioned in this episode:

Nat Friedman: Former Microsoft VP (and now investor) who came up with the idea that Microsoft should buy GitHub

Oege de Moor: Github developer (and now founder of XBOW) who came up with the idea of using GPT-3 for code and went on to create Copilot

Alex Graveley: principal engineer and Chief Architect for Copilot (now CEO of Minion.ai) who came up with the name Copilot (because his boss, Nat Firedman, is an amateur pilot)

Productivity Assessment of Neural Code Completion: Original GitHub research paper on the impact of Copilot on Developer productivity

Escaping a room in Minecraft with an AI-powered NPC: Recent Minecraft AI assistant demo from Microsoft

With AI, anyone can be a coder now: TED2024 talk by Thomas Dohmke

JFrog: The software supply chain platform that GitHub just partnered with

00:00:00 - Introduction
00:01:18 - Getting started with code
00:03:43 - Microsoft’s acquisition of GitHub
00:11:40 - Evolving Copilot beyond autocomplete
00:14:18 - In hindsight, you can always move faster
00:15:56 - Building on top of OpenAI
00:20:21 - The latest metrics
00:22:11 - The surprise of Copilot’s impact
00:25:11 - Teaching kids to code in the age of Copilot
00:26:38 - The momentum mindset
00:29:46 - Agents vs Copilots
00:32:06 - The Roadmap
00:37:31 - Making maintaining software easier
00:38:48 - The creative new world
00:42:38 - The AI 10x software engineer
00:45:12 - Creativity and systems engineering in AI
00:48:55 - What about COBOL?
00:50:23 - Will GitHub build its own models?
00:57:19 - Rapid incubation at GitHub Next
00:59:21 - The future of AI?
01:03:18 - Advice for founders
01:05:08 - Lightning round

More from Training Data

All 110 episodes
GitHub CEO Thomas Dohmke on Building Copilot, and the the Future of Software DevelopmentTraining Data · 1 h 8 min
Listen in VO