In short
The Neuron: AI Explained - Episode Summary
Episode Title This 24-Year-Old Raised $64M to Build an AI Smarter Than the World's Best Mathematicians
Episode Description In this episode, hosts Grant Harvey and Corey Noles converse with Carina Hong, the founder and CEO of Axiom Math. Carina discusses her ambitious goal to develop what she calls "mathematical superintelligence." This AI aims not only to solve math problems but also to discover new theorems, prove them formally, and continuously improve its capabilities.
Key Themes and Discussions
- Introduction to Carina Hong and Axiom Math
- Carina Hong dropped out of Stanford's PhD program.
- Axiom Math's mission is to create an AI capable of mathematical reasoning that surpasses current capabilities.
- The AI will solve problems, discover new theorems, and learn from each iteration.
- Mathematics as the Foundation of AI
- Carina emphasizes that mathematics underpins various fields including chip design, quantitative trading, and coding.
- Mathematics is described as a "bedrock" for technological advancements.
- Neuroscience and AI
- Carina's background in neuroscience informs her understanding of pattern recognition and learning.
- Connections between neuroscience and mathematical reasoning are explored, including grid cells and their hexagonal firing patterns correlating with mathematical concepts.
- Superhuman Mathematical Intelligence
- The episode discusses the concept of a "superhuman mathematician" AI that can generate and prove new mathematical problems.
- The potential to inspire and assist human mathematicians is highlighted, aiming to close the gap between human capabilities and top mathematicians like Terence Tao.
- Practical Applications and Challenges
- Practical applications include aiding quant traders and accelerating mathematical research.
- Key challenges include data scarcity and the need for effective auto formalization—converting informal math statements into formal proofs.
- Technical Innovations
- Pattern Boost: A methodology for generating novel mathematical examples and intuitions.
- End-to-End Toolkit: A code base for solving various mathematical problems through a translative approach, effectively learning problem-solution pairs.
- The Future of AI in Mathematics
- Carina discusses the potential future where software engineers and financial analysts will use AI to enhance their workflows significantly.
- A vision for a collaborative platform where complex mathematical reasoning tasks can be simplified and automated is presented.
- Differentiators in Axiom's Approach
- Axiom's use of synthetic data generation to overcome data scarcity.
- Focusing on building a strong foundational engine that can later be adapted for various applications.
Key Takeaways
- Mathematical Superintelligence: Axiom's goal is to create an AI that not only competes with the best human mathematicians but also inspires and enhances human creativity.
- Interdisciplinary Connections: The conversation emphasizes the interdisciplinary nature of AI, mathematics, and neuroscience, suggesting that breakthroughs in one area can lead to innovations in another.
- Future Implications: If successful, Axiom's AI could revolutionize various fields by making complex mathematical reasoning more accessible and efficient.
Conclusion Carina Hong's vision for Axiom Math signifies a significant leap toward integrating AI with mathematical research and applications. As she embarks on this journey with substantial funding and innovative approaches, the potential for transforming not just mathematics but multiple industries becomes evident. The episode closes with a call for collaboration and exploration in this burgeoning field.
---
For more insights, subscribe to The Neuron newsletter [here](https://www.theneurondaily.com/subscribe) and learn more about Axiom Math [here](https://axiommath.ai/).
Written by AI. May contain mistakes. Listen to the episode to check what was said.
Chapters
Tap a time to open that second in VOIntroduction to AI in Mathematics
0:00 to 0:41
Explore the role of AI in mathematics and its potential.
“The gap between Terence Tao and Carina Hong is actually the sort of verifying a technical lemma, that step.”
Karina Hong's Background in Neuroscience
1:20 to 2:48
Karina discusses her academic journey in neuroscience and its links to AI.
“So, Karina, you're here on The Neuron, AI Explained.”
Connections Between Math and Neuroscience
2:48 to 5:00
Karina shares fascinating connections between mathematical concepts and brain functions.
“that it is the energy minimizing function.”
The Role of AI in Mathematical Discovery
5:00 to 7:20
Discussion on the potential of AI to enhance mathematical research and creativity.
“Because topology is another thing that's close to my heart.”
The Vision of Superintelligent Mathematics
7:20 to 10:11
Karina explains the concept of a superintelligent AI mathematician and its capabilities.
“suppose it's not bridged into sort of experiment like animal testing, or it's not bridged into modern machine learning deployment, it's at least something that's very beautiful to study.”
Challenges in Frontier Math Research
10:11 to 13:13
Karina highlights the significant challenges faced in mathematical research today.
“Superhuman is, you know, an AI that can inspire great mathematicians like Terence Tao, an AI that prompts you to think out of the box, that generate new knowledge at scale, incredible scale and speed.”
Episode Discussion
14:00 to 28:00
“the sort of Python for math proofs that we are relying on.”
Axiom's Comprehensive Vision for AI in Math
28:00 to 28:30
Learn about Axiom's goal to integrate different AI approaches for mathematical discovery.
“And Axiom's vision is formal math is great and mathematical discovery is great.”
Understanding Pattern Boost and Its Applications
28:30 to 29:26
Explore how the pattern boost technique generates examples to aid mathematicians.
“And the pattern boost led by François Chartrand and Alberto Aferino that's on other works such as End to End, these are the two toolkits we have on the mathematical discovery side.”
The Int-to-Int Translation Method
29:26 to 30:46
Delve into the translation approach of problem-solution pairs in AI.
“It's that sort of like translation approach.”
Show all 27 chapters
Exploring Liapunov Functions in Mathematics
30:46 to 31:24
Discover the significance of Liapunov functions and their challenges in finding solutions.
“And we take advantage of that in some of the works where int to int is applied to.”
Training AI on Mathematical Examples
31:24 to 32:58
Understand how training AI on synthetic examples can solve complex mathematical problems.
“And these sort of dynamical systems and Liapunov functions have been studied.”
Generating Non-Trivial Theorems with AI
32:58 to 33:57
Learn how AI can generate meaningful mathematical conjectures without trivial outputs.
“So you describe a loop where your AI generates new conjectures, tries to prove them, learns from successes and failures, and gets better, which is super amazing on its own.”
Programming Languages and Their Impact on AI Math
33:57 to 35:52
Explore the role of programming languages in producing valid mathematical results.
“For Lean, because I think it has seen a lot of math, it's a pretty sort of robust language.”
AI's Role in Diffusing Ideas Across Fields
35:52 to 37:09
Discover how AI can bridge gaps between different mathematical domains and enhance collaboration.
“And the same sort of way I think about it is machine-assisted mathematics or science actually promotes a diffusion of ideas between the differences.”
The Potential of AI in Collaborative Mathematics
37:09 to 38:27
Understand how AI can transform the way mathematicians collaborate and work on problems.
“Yosha Bengio has a really good paper on that.”
The Importance of Collaboration in Math Projects
38:27 to 40:07
Learn about the significance of collaboration in math and how AI can facilitate this process.
“But those things also sometimes hold us back.”
Lowering Barriers for Mathematicians with AI
40:07 to 42:01
Explore how AI tools can make advanced mathematics more accessible to researchers.
“That's in the informal math side, right?”
Verifying AI-Generated Proofs
42:01 to 43:42
Explore how AI can generate and check mathematical proofs and the challenges involved.
“and know that this is correct and not just something that looks correct.”
Applications of AI in Code Verification
43:42 to 45:10
Discussion on AI's role in verifying legacy code and its importance in critical business functions.
“Mom, all Chinese restaurants have chopsticks.”
Building Towards Practical Applications
45:10 to 47:27
Understanding what practical applications Axiom aims to deliver to businesses and researchers.
“One is we really want the model to do induction very well.”
Creating an IDE for Complex Reasoning
47:27 to 51:13
Conceptualize how Axiom's platform will function for users engaging in complex quantitative tasks.
“And that middle layer is actually not the blocker, right?”
Synthetic Data Generation for AI
51:13 to 54:04
Learn about Axiom's innovative approach to creating synthetic data for training AI.
“You've been building these out as a team, I assume, and gathering them elsewhere as well from places you trust?”
Integration of AI in Science and Math
54:04 to 55:30
Discuss the intersection of AI for science and its implications for mathematical research.
“Like from, say, Hardy in a mathematician's apology be like, wow, the stuff I work on will have no use whatsoever.”
The Future of Coding Technology
55:30 to 56:00
Exploration of how AI can enhance software development and the challenges it faces.
Building Strong Coding Technology
56:00 to 57:08
Explore the connection between hierarchical planning and coding technology.
“there but what you're doing is is leaps beyond that i feel like yeah yeah i do say that you're Right, in that it requires the same sort of hierarchical planning.”
Axiom Math's Community and Initiatives
57:08 to 57:59
Learn about Axiom Math's recent updates and community gatherings.
“If people want to learn more about Axiom Math, keep up with what you all are doing.”
Transcript
Automatic transcript. May contain errors.0:00Carina Hong:The gap between Terence Tao and Carina Hong is actually the sort of verifying a technical lemma, that step. Superhuman is an AI that can inspire great mathematicians like Terence Tao, an AI that prompts you to think out of the box, that generate new knowledge at scale. People are really excited about AI for math. It's that people think of AI for math as the algorithmic pillar of AI for science. The axiom is like a very natural choice, and especially in this grand market opening of us being one of the leaders in the startup space for AI for math.
0:40Welcome, humans, to the latest episode of the Neuron Podcast. I'm Corey Knowles, editor of the Neuron, joined as always by our writer, Grant Harvey. How's it going today, Grant? Doing great, Corey. Doing great. Cool. Well, today we're talking with Karina Hong, founder and CEO of Axiom Math. She's building what she calls mathematical superintelligence. It's really fascinating. It's an AI system that doesn't just solve math problems, but discovers new theorems, proves them formally, and gets smarter with each iteration. Today, we're going to talk about what that actually means. Karina, welcome to The Neuron.
1:20How are you?
1:21Carina Hong:Great. Great to be here. So, Karina, you're here on The Neuron, AI Explained. And I hear that you have a background in neuroscience as well. Yes, I did a one-year master in neuroscience at Oxford as a Rhodes Scholar. That year actually was fascinating because there are so many, there are at least five things that are connected between, I guess, neuroscience, AI, and math. Just to talk about neuroscience and math as a starter, the most stunning example is that in 2005, a Nobel Prize, was awarded to the discovery of the firing pattern of grid cells in the hippocampus. So grid cells and play cells are sort of rats have these cells firing when it's doing spatial navigation.
2:11Carina Hong:And when scientists look at that neural recording of the firing pattern, they realize that they fire in the hexagonal pattern. So the honeycomb pattern is actually perfect, like hexagon styling. And that's just like shocking. and people were like, this is very beautiful. And like, it almost proved that God exists. Like, it just, it's so designed. Yeah. Perfect. And there's actually a mathematical proof behind it. I think work done by like, I think it's Will Dorrell and James Whittington and Tim Barron's lab at Oxford and Oxford group. And I worked closely with them during that year that it is the energy minimizing function.
2:55Carina Hong:Like that tiling makes sense from a mathematical theoretical standpoint. It's also, I think, the two-dimensional sphere packing is optimal tiling. So that's one really cool fact. The other cool fact is Chinese remainder theorem, a number theory, elementary number theory result that show up, I think, constantly in like actually like math Olympiad, it can be used to explain the neural capacity in your brain. So kind of like how much neurons can I stack in a certain space? That neural capacity calculation is connected and guided by the Chinese remainder theorem formula. I think it is an MIT group's work.
3:35Carina Hong:I think it's Ila Fietz. It's her group's work. And that's just like very interesting to me personally because I'm a number theorist. Like that's, you know, what I did before that Oxford year. And I was just like looking into Professor Fietz's work. And I was like, oh, like that's something I know. It's fascinating. Third thing is the persistent homology, which is coming from applied algebraic topology, can be used as a topological data analysis tool to analyze a lot of the neuroscience things, especially in fruit flies research. So there's this research I did at the Stanford School of Medicine where we look at the connectome of the fruit fly drosophila.
4:17Carina Hong:and the connectomes are static graphs, which is how, you know, synapses are connected, like how neurons are connected via synapses. You can, like, increase the connectivity threshold. So, you know, you can call two neurons connected only if they have at least 10 synapses connected, not three, right? And you would imagine, for example, the fruit fly, suppose it just, like, casually lost, like, 12 synaptic connections. It wouldn't be dysfunctional. So you would probably think that only robust links are links, right? So you can increase that connectivity threshold and you will see the connectome time series.
4:56Carina Hong:And you can run persistent homology on that. Just a lot of interesting connections of math and neuroscience. Because topology is another thing that's close to my heart. I took the Khan seminar at MIT. So yeah, I think neurons are great. It makes sense that AI would have been where you landed. it makes so much sense then that AI is where you would have landed it is actually that trajectory so I went to Oxford thinking I want to understand neuroscience more and little did I know that the UCL Gatsby Computational Neuroscience Institute is the premium AI hub in London and it was founded by Jeffrey Hinton and the DeepMind founder spent his significant number of academic years there in a way Gatsby is where DeepMind came from So and so I was, you know, doing my master dissertation at Gatsby thinking I would learn more computational neuroscience.
5:51Carina Hong:But the AI was just so fascinating. And we like looked into the neurodynamics of like one layer linear transformer, which is already hard enough to understand, like and using a lot of math and a lot of linear algebra to go harder. you can use some like random matrix theory, exactly. And there are like other tools such as like DMFT, like very interesting literature that I later on studied because of the neurodynamics work. Wow. Do you think that there's any merit to trying to recreate an AI architecture that's based on the human brain, given your understanding of it and how it works? I think there are like people doing that.
6:27Carina Hong:I also think that in the sort of like space model for the audio generation part, there's like more things to play. in that realm rather than like the standard transformer. But I also think there's a lot of literature on the similarities of like the transformer architecture and the hippocampus. It wasn't that satisfying as I wanted it to be, but like they do actually, there are certain things that you can look into the transformers like neurodynamics and then try to connect it back to the hippocampus. But I haven't seen the other way of using sort of neuroscience understanding to guide machine learning research.
7:04Carina Hong:That probably hasn't seen as much. Yeah. And it's still in development if it ever takes off. In better lesson, we'll just let the AI decide what's the best method. I think the radical computational neuroscience is something that even if it's not necessarily, suppose it's not bridged into sort of experiment like animal testing, or it's not bridged into modern machine learning deployment, it's at least something that's very beautiful to study. So similar to why do we study classics? like you know you will eventually go to law school but why do you study classics and undergrad if you're like a humanities like social science kid yeah because it's beautiful like that year to me is a beautiful you know less useful year like it's a very beautiful sort of like intellectual exploration it's like you go to Florence but yeah it's science I love that and it's important to be to have have a diverse skill set like that I think to to look that way to your other point about um You know, the diffusion of ideas, it's like that's where like a lot of weird ideas come from, right?
8:07Or unique novel ideas is that it's coming from the combination of different things in different areas and putting them together. So your stated mission is building a self-improving, super intelligent reasoner, starting with an AI mathematician. When a lot of people hear super intelligence, I think they always go straight to sci-fi. But in this context, what does that actually mean? And what does a super intelligent mathematician do that today's AI can't?
8:35Carina Hong:Yeah, 100%. So I am a mathematician. I am a human mathematician. I do all right in like math Olympiad contest. When it comes to research level, I will think about some technical lemmas for days and weeks before I'm able to sort of let my intuition guide me to the next step. That is really painful because you're stuck on something that you guess is right for about a couple of days before you can go to the next state of the proof. Some really good mathematicians like Fields Medellus or really child prodigy, they don't need to verify it so that they can just confidently move to the next one because they're just so sure that the current state is right.
9:20Carina Hong:And for example, that's Terence Tao. And Terence Tao is like the top sort of human mathematician. The gap between Terence Tao and Karina Hong is actually the sort of verifying a technical lemma, that step. And so if you have an AI system that can give you the partial proofs, generate correct intermediate steps to the technical lemma, a reasonable lemma, not the sort of out-of-the-box crazy problem, but a reasonable lemma, then that closed the gap between Karina Holmes and Terence Tao. So all the quant trading firms that are currently employing Karina Holmes can basically, the dream is to have the AI Terence Tao at their fingertip.
10:05Carina Hong:So that's like first step, which is to sort of match the top human performance. And then we talk about superhuman. Superhuman is, you know, an AI that can inspire great mathematicians like Terence Tao, an AI that prompts you to think out of the box, that generate new knowledge at scale, incredible scale and speed. So, for example, the best IMO, International Maths Olympiad problem setter, those people who are good at sort of creating the problems, they can generate like five really, really good problems a year. And that will be like, you know, inspirational. And if you think about an AI mathematician system that can generate like five problems just, you know, at any like given minute, second.
10:51Carina Hong:And those problems are high mathematical merit. And the same system can go and prove those problems that it generates and then increase the difficulty of the curriculum as it goes, reflecting on what it did right or wrong the last time. That is better as it goes. Yeah, exactly. And that's a self-improving part. You have a conjecture sort of hypothesis, mass hypothesis generator, and you have the prover in one system. And this system also has a knowledge base to sort of look up what is already proven in the human history, right, in its database. And so you know where sort of the boundary of the convex hall of knowledge is, and then you can confidently push the boundary of that.
11:37Carina Hong:That's kind of the sort of three things in one, prover, conjecture, knowledge base. And there's like a fourth bit, which is a very very interesting bit that we haven't kind of got to sort of weaving all these together. That's awesome. So you mentioned like quant traders. Is that sort of like the idea like that you could go after, you know, some of these really high value, you know, like jobs or roles where people really need math to be like as good as possible? Is that one of the target audiences that we're looking at here? Yeah, I think the idea is to sort of unleash the creativity of research mathematicians.
12:18Carina Hong:If you think about the people who are like Ramanujan, for example, before he met Hardy and Littlewood and started being a mentor, sorry, being a mentee by them, he actually had all these amazing intuitions without having learned how to do formal proofs. So, and then Hardy and Littlewood came in and looked at those formulas on these scratch pads and be like, oh my God, these things, if proven to be true, are going to be the next step function jump in classical number theory, as they did. So if you have currently humans who are great quantitative researchers, they are slowed down or they are blocked by the ability to work out those technical lemmas proofs.
13:05Carina Hong:The formal math system can really help them out and sort of enable them to move a lot faster in their productivity cycles. Gotcha. That's cool. It is. What kind of, I guess, neither Corey or I are frontier math researchers, right? So what type of problems still exist on the frontier research stage for math? In terms of the technical challenges, there are actually a few pretty stubborn bottlenecks. That's, I think, why, for example, we see a pretty exciting grand market opening where not every team is doing this because it's too hard. in a way, first of all, is data scarcity. When there are more than one trillion tokens of code, like Python code on the internet, you have really about like a dozen million tokens of Lean code.
13:58Carina Hong:Lean is the programming language, the sort of Python for math proofs that we are relying on. And that means models don't know Lean. It's very hard to start the sort of iteration cycles if models are really bad at Lean. you have a cold start problem. So that's one. Number one is data scarcity. The second one, I would say that's really hard is called auto formalization. It's the process of auto. So automatically having the system, the model to convert the existing math proofs in English. So like I can, I can tell you a math proof in English and you'll be able to understand it. That's very different from the programming language version of that math proof.
14:43Carina Hong:So it's actually harder than a translation problem because in a way, English and French are on the similar sort of abstraction level or English and Chinese, but English and Python are not. Python code is much more low level than the natural language abstraction level humans are operating in. So this being harder than a translation problem is actually pretty stubborn, also especially because models have not seen that much lean. So that kind of connects to the first data scarcity point, which is problematic because if you can't automatically convert all the existing math data into, which is not that much, first of all, into link data, then you can't solve the data scarcity problem, right?
15:27Carina Hong:So these kind of like get you stuck in a chicken and egg co-start situation. Yeah. Do you think that that's like impacting a lot of the companies that work at like Frontier Labs is that it's just like so like the scale of which we're trying to solve problems now is so complex that this is... I think a lot of the frontier labs are actually because of the data scarcity and because they believe in sort of, you know, scaling when we can. And in a way, when they have a lot of resources, they don't really need to sort of care as much about sample efficiency. The gain, you know, brought by verified reasoning, as we do.
16:07Carina Hong:And so they would just continue the informal math approach getting by this sort of data scarcity problem. Something I feel like we've been seeing is this idea that what the Frontier Labs are doing is taking this very general approach and trying to push the finish line farther. And then companies doing things like you are in specific niches are coming in and building out these much more fine-tuned data sets to train on going forward and being able to really take specific niche subjects to a new level. Is that something you feel like you see as well? is that? I think there's a slight nuance here.
16:58Carina Hong:Yeah, so if you think about the word problems at one big plate, and the frontier labs sort of approach, they have infinite resources, assuming they would just go from the middle, which is like the easiest task, say print hello word, you know, like make me a grocery list, I don't know, like one plus one equals two, and the edge are like some really hard problems, like cure cancer, like prove Rima hypothesis, You know, like write a novel that that is like Shakespeare that will win you the Nobel literature prize. All of the trillion dollar questions. Exactly. And they want to like push it like an annulus, like like that.
17:34Carina Hong:Well, the one challenge is, well, you kind of are losing your ability to write Shakespeare if you push really hard on, say, like your cancer or like math. So that's one pretty, you know, that's why the move is a lot slower. Right. But, you know, they they they have a lot of resources, too. So they can try to have multiple teams, right? Like they can have many ways to de-risk that. Sorry, there's like a fire alarm. Yeah, we're here and it's all good. And the Axiom approach, which is different from, I would think about some other vertical company, is so, you know, they pick a point and we pick a point too.
18:11Carina Hong:And we just directly go there, right? Like we move much faster, small team focused, move fountains. The difference is math has this sort of capability of transfer learning. So a person who's good at math, likely good at physics, likely good at coding, right? Likely good at finance, likely good at some sort of systematic parts of law, like contract, like tax, bankruptcy. And a person that, you know, the sort of transfer of learning ability from the other direction is less clear. It's harder to argue that like the top law student will be good at math, right? Versus the other way around. So when we reach that point, we can actually still expand the surface from that line that we occupy.
18:53Carina Hong:Versus this other company that goes directly to the vertical application, kind of stay there and they continue moving sort of, you know, along and, you know, have good distribution and have good product market fit. And that's still a really great business. But how we think about our business is actually a lot more horizontal than it might seem. So that's why AI mathematician is the starting point of the self-improving super intelligent reasoner. It is not the sort of end-all be-all. That's, I think, the interesting bit. And that's why a lot of people are really excited about AI for math, is that people think of AI for math as the algorithmic pillar of AI for science, which they believe is the future.
19:30Carina Hong:You have theoretical breakthroughs, and people who are doing empirical, you know, real-world testing brings it and take it home to see whether the real-world testing part, that iteration cycle is good. Two, a lot of people believe that verified reasoning can extend to formal verification of hardware and software. In a way, the auto-formalization that we just talked about, the same process of bridging across different abstraction level actually show up in other contexts as well, such as chip design, chip verification. That's really interesting. and third I think many people just believe in sort of you have the strongest math model the coding capability is like amazing but you know and other stuff so for example we know that a model that's really good at math and coding are really good at like legal bench that's something that works I mean like at the beginning of the the reasoning era people were surprised by that finding so so all these things like in combination make us sort of a it's interesting because it's so defined.
20:32Carina Hong:The problem is that we are going to crack these technical bottlenecks that we just talked about relating to this stubborn programming language for proofs. But on the other hand, it is a very exciting sort of go-to-market renaissance game where we can go many directions. That's awesome. That's cool. You can basically, if you have a super intelligent math reasoner, you could then apply that to all these different use cases. That's awesome. It's basically the bedrock. Yeah. In a sort. Wow. I've been touring in the Computer History Museum, actually, here in California. I almost went to that two weeks ago when I didn't get to.
21:12Is it awesome?
21:13Carina Hong:Yeah, it's great. There are a few things that are quite shocking. I mean, it's just like a place of inspiration. One is a lot of the initial computer prototypes are PD solvers, partial differential equation solvers. A lot of the people, when they were designing those prototypes, the dream is to solve math. It's fascinating. Like, you know, in the way, math and programming have always been these two pillars of the digital world. So, and we look at like, you know, now the landscape, like coding is so heavily invested in. Math is underinvested in, right? And you can't have one without the other. You have output, you know, done by computation.
21:53Carina Hong:And you have property. done by logical proofs. These are the two parts of the digital world. And that's why, for example, I heard Eric Schmitz talk about this, actually. Folks there at Google also have this very compelling vision of these two pillars being super important. In fact, that's why AlphaProof came along. And that's why actually Gemini has incredible amount of formal data, an incredible amount. And one would ask, you know, like, is that related to the amazing performance we see on those reasoning benchmarks? I would say that there is a correlation. Yeah. What about, so you say like we need AI, we need programming language and mathematics all working together, right?
22:40That's more or less what you're saying. As far as the programming language side, you mentioned Lean. Are you improving upon Lean or are you creating your own programming language? How does the programming language fit into what you're doing exactly?
22:53Carina Hong:Well, yeah, we have lean data. We are proving the output are lean. Of course, I think the final, so when it gets to the product phase, we should have the lean part hidden almost and then have people choose to see it or not because it is indeed not the sort of human readable abstraction. Yeah, I think if I was looking at it, I wouldn't know what I was saying. Yeah, it's actually fascinating. We have seen, for example, the very early builders of Lean, they are currently very excited about the landscape. There are about like two to three folks who are initial group, the batch of people who, you know, built all the undergrad knowledge into math slip together with Professor Kevin Buzzard at Imperial College London.
23:41Carina Hong:For them in 2019, 2020, it was like a hobby in COVID. I have this friend, And Kenny, he's like, hey, Karina, like, you know, we were talking actually back then. We were taking the same class at MIT. He was an exchange student. And he's like, you know, like, my leisure time is like chess and lean. And I'm like, oh, I know chess was lean. And little did I know that now Kenny's working with us. You know, here at Action. That's awesome. And that's just incredibly exciting. And there are other people who are lean developers that have all sorts of interesting occupations. We have one guy reach out. he's a lawyer and so he's like website is like ip law practice my link github repository so if you click the github page you will see like all these link code and like you look at that part and you know the traditional law practice just very interesting there's another person who currently are you know like sort of streaming a lot of video games and besides streaming a lot of video games He streams competitive mass problem solving.
24:44Carina Hong:And people just love watching both. It's a very interesting subculture, but it kind of reminds me of the early days of GPU or when people did not realize the power of CUDA. It's like a group of people with not so much conviction. They are not doing lean because they believe this is valuable, just passion, just pure joy that, you know, programming in Lean brings them. Like a lot of them come from math background, love computer science, software engineering, and they're just enjoying coding of their favorite math result. And I think that community is really special. And then being able to, you know, work with a lot of them, collaborate and, you know, like hang out in conferences is like, I think one of the best parts of this job.
25:33That's great. Well, let's talk. I'd like to talk a little about Pattern Boost. I understand it disproved a 30-year-old conjecture in graph theory. Could you maybe explain a little bit of what graph theory is? Elaborate on both that you don't mind?
25:52Carina Hong:Yeah, I think like, you know, like sort of mapping out where we are, we have talked about the formal math side, which has proving, conjecturing the knowledge base and, you know, interweaving them as auto formalization. Then there is like this other island that is not related to Ling. That's called mathematical discovery. Mathematical discovery is not about sort of finding proofs. It's about finding constructions. So constructions are interesting things. They are mathematical objects that give you intuitions. They play a critical part usually in the problem by, you know, one of three ways. One is it can suggest that your direction is either totally right or totally wrong.
26:35Carina Hong:So it sort of stress test the lemma that you have in mind, the next step you go to. Number two is working together with a proof is sometimes completely solve a problem. So usually you have an example and you show, hey, I can do at least this well, because here there's an example that is, you know, exactly the number. And then I prove that you cannot do better. So these two things establish upper bound and lower bound and sort of, you know, OK, so maybe the number is K equals seven because you can do seven. You cannot do eight and above. That's number two. Number three are like when things are just very undefined, you're trying to explore, you know, you don't even have a conjecture in mind to stress test.
Read the full transcript
27:20Carina Hong:It's sort of the pre-conjecturing step. That's the fascinating part of, I think, mathematicians. Like their reasoning is a very like specific and specialized process. And these examples guide their reasoning. um it's it's very difficult i think if you do math without being able to do any constructions or examples some of the best mathematicians um they are great at generating examples that go one way or the other so either examples that tell them hey that's a direction worth pursuing or constantly having examples to eliminate all other possible routes you can you can sort of search your space that way.
28:05Carina Hong:And Axiom's vision is formal math is great and mathematical discovery is great. And the sort of informal approach of like, you know, like literature search, explaining concepts, quick, you know, like quick query in the knowledge, that's also great. It's not a one size fits all like AI for math shoot. We have a very comprehensive vision that We need all these. So we need to build all of them out. And the pattern boost led by François Chartrand and Alberto Aferino that's on other works such as End to End, these are the two toolkits we have on the mathematical discovery side. So pattern boost is a generative method.
28:47Carina Hong:It generates interesting examples that play a pivotal role. And those examples are novel. They are out of the box examples. they sort of help mathematicians derive interesting intuitions just by looking at them and the into in part is the translative methods into in is like int to int the idea is if you have a problem and you have a solution right then you have a problem solution pair and you learn all on all these problem-solution pair. And so next time you have a problem and we want a solution, the model just predicts that solution. It's that sort of like translation approach. And there are interesting tricks related to this translation as to which direction.
29:37Carina Hong:So back then in like natural language processing, people find, you know, one direction of translations usually easier than the other. So, you know, a model that has seen a lot of English likely find French to English being easier than English to French, right? We have currently auto formalization being harder than auto informalization. So lean to English is a lot easier than English to lean because model has not seen much lean. In these sort of problem solution translation problems, if you have, for example, taking the derivative, the first derivative or the differentiation of a function, if you think about it in high school, like in K-12 education, we are asked to take the derivative.
30:21Carina Hong:It's actually relatively easy. Do the integral is hard. Like the integration part is difficult, right? Because like, that's why you have these integration bees, you know, having the math widths, like trying to crack those hard integration problem. And they're sort of inverse of the other, right? Like you take the integration and then you take the derivative and then you have the same thing. So one direction of the translation is easier than the other one. And we take advantage of that in some of the works where int to int is applied to. So, sorry, you asked about pattern boost. That's okay. No, that's good, yeah.
30:54Carina Hong:Yeah. Specifically, we were asking about that. So speaking of pattern boost, there was the 30-year-old conjecture in graph theory. And then I think in int to int, you solved a 130-year-old problem, right? About the Liapunov function, if you want to go into either of those. Yeah, yeah, 100%. So Liapunov functions are important mathematical objects. They show up in the three-body problem. That's kind of like a very famous, you know, case. And these sort of dynamical systems and Liapunov functions have been studied. And there are many kind of like semi-global Liapunov functions, like many different things.
31:35Carina Hong:Poincaré, Newton, Lagrange have all studied on them. so like we have found you know these mathematical objects to be extremely hard to find like humans generally relate on like you know pure luck to to find them or deep intuition like but no one notes those intuitions down it's like you know like i don't know if their their notebook that has like run out of like space like the famous for mass joke it's very hard to figure out how to find them. There's no general algorithm. And, you know, Leopoldo functions, they represent the global stability of a dynamical system. There are cases like, you know, polynomial system, non-polynomial systems, and both are very, very hard.
32:21Carina Hong:By training on a dozen million synthetic example, like Francois and Alberto, they taught the model to reliably guess these functions, something that humans cannot do. And it's, you know, it's a dozen million, which is actually not a lot. So a smaller model, not a lot of compute, can actually crack something this sort of fundamental that bothers humans for many decades and centuries. And they went for even harder cases like the non-polynomial systems that were previously just considered completely out of reach and not tractable. So I think it's very interesting where the Liepunov functions case is solved, but it's also very interesting that the end-to-end, it's a code base, it's a toolkit that you can apply to many problems that will benefit from the translative method.
33:12Carina Hong:So if you have another problem that people are excited about recently, we're thinking about something along the line of number theory, keep it awake, but the end-to-end code base likely is going to be equally useful there as well for all kinds of problems that will benefit from the translative approach. That is so cool. It is. So you describe a loop where your AI generates new conjectures, tries to prove them, learns from successes and failures, and gets better, which is super amazing on its own. But how do you prevent it from getting millions of trivial, useless theorems as well in a thousand different ways?
33:57Carina Hong:That's a key question. That's a very, very good question. so first of all is there are different programming languages in the past that we have seen provide interesting math results that are in a way disappointing i actually had this conversation with um stephen wolfram and um the the wolfram program language is like really amazing but there sometimes are like you know results that you look at him you're like why why does it you know he he wrote it in the blog himself that there are moments like that. For Lean, because I think it has seen a lot of math, it's a pretty sort of robust language. It has seen a lot of undergraduate algebra and analysis.
34:42Carina Hong:And by a lot, I mean, compared to some other programming languages and the sort of abstraction level that it functions is, I don't think it's necessarily the optimal abstraction level, but it's passable. It's pretty good. It is actually able to do some independent exploration and to generate new theorems and that of reasonable mathematical merit. Of course, when it comes to taste, there are many ways to do it, right? One is to, you know, have LMS judges to see, hey, like, you know, how would you rank the interestingness of this mathematical result. There are other ways to more programmatically program them.
35:24Carina Hong:Like we can look at the dependency graph of that proof. So, okay, well, this proof is the child of two previously unconnected branches, algebra and combinatorics, you know, like just like the 2022. We should check this one out. Yeah. Yeah. Then that would be novel, right? If you can have actually a correct proof that that bridges two previously unconnected views. That's novel. And the same sort of way I think about it is machine-assisted mathematics or science actually promotes a diffusion of ideas between the differences. It doesn't kind of get bounded by the human boundary of like, okay, well, this is a probability conference.
36:09Carina Hong:This is a geometry conference. I remember I was invited to a conference called the Doktor Seminar in Germany. and we our conference was i think it was called like pattern avoidance you know it's a combinatorics like serratical computer science one and there's one next door on like continual learning my math research at the time was on continual learning so i was very excited i would like sneak into their talks all the time but that's sort of like diffusion of ideas right like it doesn't happen unless you literally put like you know two adjacent like workshops next to each other in the same castle in the rural area in Germany.
36:48And they're drinking coffee together and having weird conversations.
36:51Carina Hong:Yeah, exactly. So I think that's something I'm really excited about, about AI for math and AI for science is for the diffusion of ideas across fields. One could also, I think, you know, look at how many new theorems or notes in the knowledge base that got extended because of introduction of one definition or one lemma that I think Yosha Bengio has a really good paper on that. It's about thinking about AI mathematician from a compression lens, like first order logic lens. And you can say that something is good if it's useful, that's reasonable, isn't useful in the mathematical playground. Yeah, I think that Those are like some, and you can have also sort of ideas where you have a conjecture and that because that is plugged with the prover, you can have the prover provide reward for the conjecture.
37:48Carina Hong:So something that can be proved, you know, and suppose, okay, suppose something is there's some rough proxy of that thing being interesting and that thing can be proved, then it's likely to be a good thing, right? And if you have something that just cannot be proved, when it shouldn't be that hard, could it be wrong? There are interesting disentanglement mechanisms one can do that we consider very interesting. That's awesome. Something you said sparked something. So you were talking about how the diffusion of ideas, AI can move beyond our human boundaries, which I think is really accurate. it.
38:31Do you think that we as humans have sort of one of our skill sets, right, is that as a collective, we have all specialized into all these different subfields and subdomains and organized that well so that we could work within it. But those things also sometimes hold us back. And do you think that one of the better things about AI is that it can then take all the information and go and actually find new patterns that we humans are sort of like stuck on?
38:56Carina Hong:Yeah, I think there are many exciting opportunities when AI comes into the game. So first of all, AI can be deployed, AI mathematician can be deployed to work with applied scientists. That's very exciting. If you have the best brilliant math human mind, they likely are in Princeton IAS and do advanced study and staring at the deer thinking about their pure math problems. They're not collaborating with mechanical engineers or people who really need their hard partial differential equation to be solved to make industrial real societal progress. So that's number one. Number two, they don't even necessarily collaborate within mathematics if there are different fields, as we talked about.
39:44Carina Hong:Now, the third thing that I find interesting is like when software engineering projects are like sometimes like hundreds and thousands of people working the same one, you don't have math being that sort of collaborated and refactored that's suited for collaboration. We don't have... Polymath projects actually are the first instances of mathematicians or even math enthusiasts from all over the world collaborate on pushing the bound, squeezing the bound of the prime gap to smaller. And that is really amazing. That's in the informal math side, right? They are reasoning in the natural language for that.
40:21Carina Hong:And then you have the lean, big formalization projects led by Terence Tao, Alex Kontorovic, and others like the Prime Number Theory and Project. They are able to divide the task to very fine-grained levels. So people who don't have the big contacts, who don't have necessarily the mathematical ability to see the 3 ,000 feet view of the problem can contribute on those tasks. that they have the sort of polymath but lean version. That I find very exciting. What we want to do at Axiom is through product. That's why we really think that we should be a product company after we have a really good model and technology.
41:06Carina Hong:And it's to bring these into people's hands for them to be using and collaborating and to work on generating these large-scale collaborative lean effort like at a much faster like speed and hopefully you know people can find it more and more accessible so that will sort of lower the entrance bar because now I think a lot of very good mathematicians use lean but not not all of the mathematicians they're necessarily there isn't like necessarily a you know correlation between mathematical ability and lean proficiency but one could argue that if you know, someone is just like learning how to do proof, then it might be challenging, right?
41:46Carina Hong:So how do we sort of serve those people for them to be generating these very exciting work products? And that will also in turn, like data flywheel, makes the system a lot more intelligent. Okay. So when your AI finds something new that no human has ever verified, how do you go forward and know that this is correct and not just something that looks correct. Like, who checks the checker, of course? Yeah, exactly. So suppose the statement is correctly formalized and the model finds a proof and then it compiles. Yay. Like, by the Curry Howard, like, you know, correspondence, like, here you go, you have a proof.
42:35Carina Hong:That's really amazing. What has happened in the past, and we have seen some other companies model release is that the statement are not correctly formalized. Not all of them, say like two out of 49 in one instance were not correctly formalized. So I think that part is, you know, you need checking. But interestingly, right, the proof is like, sorry, like the statement is like this long. It's like two, three lines. Okay, your proof is like this long. And this thing does not have to be checked. Like, isn't that like amazing already? Like, I think that's - Oh, it's one. Yeah. Yeah. And that's because it can be verified through the system.
43:09Carina Hong:Yeah, exactly. And purge can go on and on and on. Exactly. And suppose we have a really good construction engine baked into it, and we ask the construction engine, hey, I don't know if this statement is right. Find me a counter example. And they found one, and then, okay, well, there's a problem. That's why what I mean by construction stress test like lemmas. It's very exciting. And any logical argument, if you think about this, any logical argument can be refuted by counter example. Like, yeah, I don't know. Mom, all Chinese restaurants have chopsticks. Here's one that doesn't. I don't know. There will be one, yeah, inevitably.
43:55Carina Hong:And that's really like if you apply that to these sort of more general domains beyond math and like, you know, coding, like edge cases, code verification. Suppose you have like legacy code at a company that serves critical business function. You want to, you know, take them out. You want to like replace them with state of the art. And I want to make sure that all my core business function use cases are still covered. You really need to verify that code, especially given we have so many AI agents, coding agents now generating code. And the model that can do formal verification while en masse can formally verify code.
44:34Carina Hong:That is a huge opportunity, similar to other cryptographic protocol verifications, smart contract verification, et cetera. So you're able to do those verifications from multiple angles over time? Yeah, and we intend to diligently sort of pursue them one at a time. But they're all built on the core technology, starting with AI for formal math. Gotcha. So you raised$64 million to build this so far. You're solving 130-year-old math problems. That's intellectually very cool. but what's the first practical thing that you expect Axiom to do that makes someone you know want to write a check like you mentioned productizing this at some point like or maybe you're there now and what problems do you expect to solve you know this year or 2026 that could potentially directly immediately be used in business or industry research lab etc yeah 100 % so we want the model on the technology and we wanted to have a few important capabilities that are practically grounded.
45:39Carina Hong:One is we really want the model to do induction very well. That will have very important implications in, say, circuit property testing. These are... So in a way, the model is going to be smart and right, like verified superintelligence sort of have these two goals. If the model is smart and right, it can help, say, quant trading. if the model is right and not that smart yet, it can already solve a lot of problems. If you think about other big tech companies like AWS, they have a whole neurosymbolic reasoning team doing very similar things. And a lot of customers actually chose them because of this feature, especially heavily compliant, required or regulated enterprises.
46:32Carina Hong:We need to prove a financial audit, et cetera. they actually have the sort of considerations of formal verification in mind. Now, LM together with formal verification is going to make formal verification a lot less painful than 1980. That's the bet that Axiom is taking. And so, I mean, by I think like, you know, next year, we should have an extremely strong math system. And this system is going to have really good transfer learning capability on other important benchmarks that have commercial relevance. And then partnering with very selective folks, we are going to try to see if these technology gang can, how much we need to build to bridge from what we have to what they want.
47:27Carina Hong:And that middle layer is actually not the blocker, right? Like the core engine is the blocker because that is something that is differentiated and very difficult for these customers to. I mean, if they can't have it in the Frontier Lab models and they are definitely not going to build it themselves, then Axiom is like a very natural choice. And especially in this grand market opening of us being one of the leaders in the startup space for AI for math. Yeah, for sure. Well, let's say Axiom succeeds with its main goal, which is to build this mathematical superintelligence right now. Five years from now, how does, let's say, a software engineer, a financial analyst use what you've built?
48:14Can you kind of paint us a picture of what their workday would look like?
48:19Carina Hong:Yeah. So you open up your laptops like, you know, like an interface. And we want to build the default reasoning platform for these people who are engaging with very complex quantitative reasoning tasks in their daily workflow. It's some sort of, you know, IDE. And you can put in like the problem you're solving, a spec. Sorry, like you put in the problem, you put in like a spec, which is some sort of, you know, your preliminary intuitions of how to go about it. And then the model immediately starts suggesting the intermediate steps for you to proof-reject. That could be like the first sort of co-pilot thing.
48:54Carina Hong:It will still require the very smart person's supervision, but it will be more and more automatic as time goes and as we collect more high-quality data. I think also the model is going to have the computer program, right? It's a LIMP program underlying that mass proof running for the tracker. and then you can see that checkmark knowing that output is sound and hallucination-free. The model can help you explore. If you don't have that spec intuition, you can have the examples, the discovery part that we just mentioned, pattern-boost generative methods to help you generate interesting examples or translative methods that help you find the function by learning previously the problem-function pairs.
49:40Carina Hong:and you know it can handle all sorts of like translative like tasks it can be numeric to numeric it can be symbolic to numeric, numeric to symbolic and symbolic to symbolic right like it's really symbolic are like things like functions, numeric are things like values so give me a function, give me a degree output is a degree that's symbolic to numeric give me a like you know give me a, this is another example of like numeric to symbolic I mean give me some sort of a I guess a give me a give me a matrix I guess I give me a matrix and then I'll give you like the set of set of equations like that that will be like numeric to symbolic and these are very important objects in that quantitative researchers like daily workflows and you can you know have that part of Canva to explore it requires a lot of things going together I mean the we have tried different sort of, you know, explorations.
50:39Carina Hong:And because the core technology has really not been in place for some of the obvious choices of big companies, big labs, we couldn't get it to work. I mean, we couldn't have GPT generate a Fourier, like, transform with the symbolic, you know, like, notations baked in, like, reliably or correctly. That's quite interesting. So have you been building out like your own data sets of mathematical equations and proofs and solutions to put together? You've been building these out as a team, I assume, and gathering them elsewhere as well from places you trust? It seems like your step one need is a lot of math.
51:27is the way.
51:28Carina Hong:I'm so glad you asked this question because one thing that we do very differently from, say, our competitors is we take a very bold synthetic data generation approach. While there is a co-start problem, we are totally solving it. We are converting the informal mass data into formal mass data by the system. And we are generating more examples, synthetic examples, based on the existing formal data that we have. Oh, wow. Instead of sort of paying all the lean developers from all over the world to gather the proof. We do some of that as to solve the cold start problem, similar to when you develop Chats and Go at the beginning.
52:11Carina Hong:You would have Chats and Go players, experts to give you certain configurations, the starting point. We do a very tiny part of that. And we most do that with statements. So we are taking a very different, I think, in both data bet. We're feeling pretty good about it. Yeah, that's great. That's awesome. Well, we think AI for science is really cool. What do you see as being the biggest bottleneck in the way of building this super intelligence for both you at Axiom Math and in general for the entire industry? Is it the data or is it the compute? What do you think? Yeah, so I think AI for science is like a big, you know, word.
52:58Carina Hong:It has multiple parts. The digital part, the algorithmic part, that axiom, AI for math, we are totally dedicated to solving. I think a lot of the AI for science companies like, you know, periodic labs, et cetera, they are actually building more like real world part. So we do not have, I mean, like Laila said, we, for example, we do not have robotics. At this company, there's no robotics labs. We cannot have robots do the biology experiments for us. But we can solve some of the hard theoretical problems that they will encounter. So it's not so much an AI for science company. I wouldn't put us in that category just because we don't have the real world testing part.
53:44Carina Hong:But a lot of the similar philosophies and intellectual journey of how we got here, it's similar to AI for Science, which is that do not take for granted that fundamental science transform into real world application. That timeline is what it was before. It's no longer what it was before. It's no longer 300 years. Like from, say, Hardy in a mathematician's apology be like, wow, the stuff I work on will have no use whatsoever. And he's, I mean, like you couldn't see it, but we all got surprised when that was the sort of the backbone of cryptography, right? And that number three, the big part in that, a lot of the fundamental science can be, in a very short amount of time, transformed into real world applications.
54:32Carina Hong:And I think investment in that space generally are very bullish, like AI for science, AI for math. The one thing I find interesting is people who are bullish about the AI for science part. And I think it really needs a coherent thesis to also be bullish about AI for math. You kind of can't, you'd be like, okay, hey, I am bullish about the root word testing part. I'm not bullish about this radical breakthrough. So then, you know, making try and error like engineering approach without any sort of theoretical guidelines, guidance only in the in the real world. And that's incredibly expensive. I think that's that's like one part that's missing.
55:16So I think I say, don't you need one for the other? I would think you need. I would say programming, too. You would think. it's interesting to me that software development through through ai has moved as far as it has without a product like yours at its base but do you mean like a symbolic like math kind of prover at the base not like in a symbolic logic way i'm meaning like like you you would think that that math bedrock again for lack of a better word i'm gonna use bedrock again uh yeah would have been such a necessary step for tools like quad code for uh for codex to have that built under there and i know there's definitely a strong math core under there but what you're doing is is leaps beyond that i feel like yeah yeah i do say that you're
56:10Carina Hong:Right, in that it requires the same sort of hierarchical planning. And that's the high-level planning. Also, I guess, like low-level, like detailed execution. You want to bridge them together to build a very strong coding technology. That I agree. And the similar ability of having many lemmas forming a huge complex mass proof is a little bit also similar to blocks of code forming like a big comprehensive query. And we have seen coding models being great at making local changes and suggestions. The ability to understand multiple files, make changes to them, that backbone logic, we have not seen that.
56:58Is that something that you think what you're building could solve, especially with long context stuff?
57:02Carina Hong:I think so. That's amazing. Karina, this has been absolutely fascinating. I thank you so much for being here. Thank you so much. This is a fascinating conversation. It's been a lot of fun. If people want to learn more about Axiom Math, keep up with what you all are doing. What's the best way to find you? I think our blog recently updated with the discovery part. We are going to introduce some key members of our discovery team through multiple videos over the recent three weeks. And we are organizers of many big AI for Math conferences and sponsors of many conference workshops as well. You can find us at NeurIPS.
57:43Carina Hong:We are a sponsor of AI for Math workshop at NeurIPS. And then at the joint math meetings in January, we're also going to give some invited talks. After JNN, we have ARHUS, which is an AI for Math discovery workshop that we are co-organizing. And that is the sort of next thing after Oberwolvog, which we also co-organize. So we are having a lot of community gatherings, and please do find us at one of them. That's so amazing. We'll make sure we have links, right, Grant? Yeah. Awesome. Great. Thank you so much. Excellent. Well, I'd like to thank everyone who took the time out to watch or listen today, wherever you're viewing this from.
58:22Mathematical superintelligence might sound abstract, but the applications from chip design to aircraft safety to furthering science are so concrete. And the good news is if you're watching this, you're already thinking about the future and where AI is heading. And hopefully they'll give you a leg up. We hope you enjoyed today's show. If you don't already, please like and subscribe so we can continue to bring amazing conversations like this to you every week. And join more than half a million others who read the Neuron AI newsletter every morning. Just visit the neuron.ai today to sign up. And on that note, until next time, farewell, humans.
59:06Thank you.
From the publisher
Carina Hong dropped out of Stanford's PhD program to build "mathematical superintelligence" — and just raised $64M to do it. In this episode, we explore what that actually means: an AI that doesn't just solve math problems but discovers new theorems, proves them formally, and gets smarter with each iteration. Carina explains how her team solved a 130-year-old problem about Lyapunov functions, disproved a 30-year-old graph theory conjecture, and why math is the secret "bedrock" for everything from chip design to quant trading to coding agents. We also discuss the fascinating connections between neuroscience, AI, and mathematics.
Lean more about Axiom: https://axiommath.ai/
Subscribe to The Neuron newsletter: https://theneuron.ai
