The AI Product Going Viral With Doctors: OpenEvidence, with CEO Daniel Nadler

4 Mar 2025 · 1 h 5 min

Ask about this episode

Ask anything about it. ChatGPT or Claude reads this page and answers with the times it was said.

Connect VO and ask about every podcast you hear, including the moments you saved. Add to ChatGPT · Add to Claude

In short

Podcast Episode Summary: The AI Product Going Viral With Doctors: OpenEvidence, with CEO Daniel Nadler

Podcast Title: Training Data Episode Title: The AI Product Going Viral With Doctors: OpenEvidence, with CEO Daniel Nadler Host: Pat Grady, Sequoia Capital Episode Description: This episode features Daniel Nadler, the CEO of OpenEvidence, which is revolutionizing the way doctors access medical knowledge. Nadler discusses the advantages of training smaller, specialized AI models on peer-reviewed literature, the platform's rapid adoption, and the critical role of accuracy and transparency in AI healthcare applications.

Key Concepts

OpenEvidence Overview

  • Mission: To transform access to medical knowledge for doctors, enhancing decision-making at the point of care.
  • Notable Feature: The platform is widely available for free to all physicians, leading to organic adoption and partnerships with major medical publishers.

AI Model Training

  • Specialization Over Generalization: Smaller, specialized AI models trained on peer-reviewed literature outperform larger, generalist models in medical applications.
  • Publication Reference: The paper "Do We Still Need Clinical Language Models?" demonstrates the effectiveness of this approach.

Rapid Adoption

  • User Base Growth: OpenEvidence has attracted over 100,000 physicians in the U.S. and hundreds of thousands globally, a significant increase from minimal usage a year prior.
  • Word-of-Mouth Marketing: The app's success is attributed to its utility and word-of-mouth promotion among physicians.

Impact on Healthcare

  • Addressing Information Overload: OpenEvidence helps doctors manage the overwhelming amount of medical literature, which increases exponentially.
  • Real-life Examples: The app assists physicians in complex cases involving rare conditions or comorbidities, enhancing patient care and outcomes.

Key Discussions

The Challenge of Keeping Up with Medical Knowledge

  • Information Overload: Two new medical papers are published every minute, making it nearly impossible for doctors to stay current.
  • Specialized Needs: Doctors like dermatologists often face challenges when treating patients with multiple health issues due to their limited specialty knowledge.

OpenEvidence's Unique Approach

  • Direct to Consumers: The platform bypasses traditional healthcare marketing methods by directly connecting with doctors as users.
  • Focus on Accessibility: OpenEvidence aims to provide equitable access to the latest medical research, especially benefiting those in rural or economically disadvantaged areas.

Accuracy and Transparency

  • Data Integrity: OpenEvidence only utilizes peer-reviewed medical literature for its AI training, ensuring high-quality, trustworthy information.
  • User Trust: The platform allows users to trace back the AI's recommendations to specific references, enhancing transparency and trust.

Insights and Takeaways

Future of AI in Healthcare

  • Life-Saving Potential: OpenEvidence aims to save millions of lives by improving decision-making through accurate information.
  • Personalized Medicine: Future advancements may enable highly personalized treatment plans based on individual patient data.

Importance of Team Composition

  • High-Quality Talent: Nadler emphasizes the significance of recruiting top-level talent from reputable institutions to drive innovation and accuracy in medical AI applications.
  • Collaborative Environment: A culture of excellence attracts elite individuals who seek to work alongside other high achievers.

Pivotal Moments

  • Rapid Growth Recognition: OpenEvidence's overnight success is highlighted as a stark contrast to the slow adoption typical in healthcare technology.
  • Medical Partnerships: Formation of strategic partnerships with leading medical journals, such as the New England Journal of Medicine, enhances the credibility and utility of OpenEvidence.

Recommended Readings

  • Research Paper: "Do We Still Need Clinical Language Models?"
  • Chinchilla Paper: Discusses the scaling laws of large language models.
  • Ted Chiang's Novella "Understand": Suggested for understanding non-linear acceleration in intelligence.

Conclusion Daniel Nadler's insights on the application of AI in healthcare demonstrate a transformative approach to medical knowledge access and decision-making. OpenEvidence stands as a pioneering effort to bridge the gap between rapid medical advancements and practical physician applications, heralding a new era of efficient and personalized healthcare solutions.

Written by AI. May contain mistakes. Listen to the episode to check what was said.

Hear the part that matters, and keep it.Open this episode in VO. Double tap your headphones to save a moment as you listen.
Get VO free

Transcript

Automatic transcript. May contain errors.

0:00One of the things we hear so frequently from doctors about open evidence is, you know, I used it to look up this thing for a patient case that is maybe a patient case that I would have seen one or two times in my career. And then the same doctors are saying that about a different patient case and then about a different patient case and then about a different patient case. And then you realize just how long the tail of this thing is where it's like, Well, if the majority of your uses of open evidence are patient cases that you would see once or twice in your career, then that really captures what the thing is doing.

0:55One of the questions on everybody's mind as it relates to AI is, well, this actually is inarguably good, his medicine. We have Daniel Nadler, co -founder of Open Evidence on the show today. Open Evidence is trained on peer -reviewed medical literature to provide an AI co -pilot that helps doctors make better decisions at the point of care. This is inarguably good for humanity. It doesn't take crazy assumptions to believe that open evidence will save a million lives over the next decade. Today we'll hear from Daniel on how they built the product. What's different versus some of the other application layer AI products out there.

1:51And some real life examples of how it's being used in the field to the benefit of everybody. I hope you enjoy. Daniel, welcome to training data. Thanks for coming on the show. Thanks, Pat, for having me. All right. How many doctors will use open evidence today? Today, probably over 100 ,000 physicians in the United States and more globally. And what would that number have been about a year ago? A thousand fewer than zero. You know, like most people aren't aware of this, but there's only about a million doctors in the 40 million people, which is itself an issue that we'll probably talk about later on.

2:37But there's only a population of about a million doctors. Today maybe a hundred thousand of them are going to use open evidence on a monthly basis, about three, four hundred thousand monthly active users touch our system, including over 200 ,000 that log in and ask questions. So, you know, you're talking about 10, 15, 20%, maybe even 25 % of doctors in the United States that are using open evidence in some form or another. And we're not healthcare investors. We're technology investors here at Sequoia. But my understanding is that it's not normal for 100 ,000 doctors to be using something, you know, overnight.

3:24Like, my understanding is that healthcare normally takes a lot longer to get to that sort of scale. So what did you guys do right? Well, that's what we get along so well because you're not health care and but you're not health care investors and our approach is not going to health care approach. What we got right is we realized that doctors are people too. Doctors are consumers. In fact, everyone's a consumer. I think that's what you get right in your investment strategy, which is you don't sort of think about consumer internet applications is one category and then a bunch of stuff over here as its own kind of weird quirky, opaque, siloed industry categories over there.

4:02You think about everything in terms of consumer internet growth curves. And that's exactly how we thought of it. Obviously, if you try to go top down, so everyone says it's such a refrain, healthcare is impossible to break into. Healthcare is so hard. Don't start healthcare. And I think the evidence generally supports that. Of course, of course, because they're all trying to do the same, they're all trying to bang their head against the wall in the exact same way. They're all trying to go to the top of some integrated delivery network, which is like a large network of hospital systems. Score a meeting with the CMIO or the CTO or the, you know, all these acronyms.

4:41It'll take them three months to four months, even if, you know, if they're properly networks and connected, It would take them three or four months to get meeting one on the calendar. Meeting one will be great. They'll high five each other. It will be like, that was a great meeting. We got great feedback. What's the follow up? Whether you're going to schedule a follow up meeting, which will probably be with a responsible AI committee, that will take three months after the first meeting. Then you'll present the responsible AI committee at that hospital. Along the way the committee members will have changed.

5:08Their strategy and responsible AI will have changed. Maybe the presidential administration will have changed. and now J .D. Vance is saying actually have to change your approach to responsible AI, so that gets delayed. And you're a year into it before you're in meeting three or meeting four. And by the way, no doctors, they're all along the way or getting the benefit of using the application. I had a lot of experience, this wasn't my first rodeo. I had sold a very successful AI company before starting OpenEvidence, Ken Show. And so I was very familiar with how corporate America works and how large organizations work.

5:43It's not specific to the healthcare system, it's just called large organizations. And I was very familiar with that. I had pattern recognition to that. And so I realized that that wasn't really a viable path forward for us, especially this is my second company was very mission driven, it was very impact driven. But it would not have been much a sense of accomplishment for me to have nominally started a second company that was mission driven of an impact driven in healthcare, but then have no doctors using it because we're waiting for meeting number six or seven or eight with the hospital system.

6:19So long story short, we just took a radically different approach. Doctors are people too. Doctors are consumers too. And if you make something awesome, that is life changing and game changing and profession changing for knowledge workers, and it's really good enough, and you put it out on the app store. It sounds 101, but it really works people. You make something awesome, you put it out on the app store for free and it turns out that without fancy marketing campaigns or large marketing budgets or anything like that, all of our growth is worth of mouth. Doctor to doctor to doctor to doctor. People will start using it and people will discover it and then they'll start using it and when they start using it and if it's really awesome, they'll tell other people about it.

7:05And then you get just sort of the network effects that, you know, you got with Tesla early on. Tesla early on famously spent, you know, almost no money in marketing. They didn't, you know, as I understood, car commercials were kind of the largest category of advertising. It was taken as dogma that if you wanted to have even a remotely successful automobile, you needed to spend enormous sums of money on advertising of those cars. And Tesla early on said, we're just going to make a product that's so awesome that people will tell other people about it. Someone will drive it. They'll be like, oh my god, this is so much better than other cars.

7:42And tell other people about it. And that sort of word of mouth network effect that Tesla had happened with open evidence with doctors, where doctors downloaded from the App Store as I said, a year ago would have been, I don't know, somewhere between zero and a thousand doctors using it. Today it's hundreds of thousands. It's, you know, 10, 15, 20, maybe 25 % of of the act of physicians in the United States. It really, the denominator, it depends on how you calculate it because there are more physicians that have a medical license that are necessarily active at any one time. But it's as little as 10 % and as high as 25 % of act of physicians in the United States.

8:22Use open evidence today. And all that is just the sort of tesslaw logic of like make an awesome car. It'll spread through word of mouth. And I think it's intuitive to people what it means to have an awesome car. It's probably not intuitive to people What it means to have an awesome app for doctors. Yeah, so word doctors actually doing in this app. Why do they like it so much? so I think something is awesome if first and foremost it solves a real need and a real pain point right so much of technology is a solution in search of a problem It's important to be able to word problems that That are real and have a solution that addresses a real problem.

8:57So So you've got to begin from, well, what's hard about being a doctor. One of the hardest things about being a doctor besides the hours having to go through medical school and all the rest, the fact that there's stretch to thin and there's too few of them for the population, is that they're expected to keep up with a fire hose of medical information. So this is really not appreciated by people who are not doctors. But there's two new medical papers published every minute 24 hours per day. Two new medical papers published every minute, 24 hours per day, seven days a week. There was a study done in publishing nature that said that medical knowledge doubles every 73 days.

9:39That's probably, that methodology was probably a little aggressive. We did our own internal study to open evidence of the rate of doubling of medical knowledge. We came up with a much more conservative number, but that's still five years. Our conservative number is medical morality, doubles every five years. There's a lot of methodology in how you think about counting all citations. If it's all citations, yeah, doubles every 73 days, but not all citations and medicine are equal. Even if you really just count what you should count, which is the stuff that doctors really need to know, like top tier journals that have the highest impact factors, let's say the top third of journals, something like that.

10:18even with that very conservative methodology, you're talking about medical knowledge doubling every five years. So if you think about the math of that for a second, so in 1950 medical knowledge doubles every 50 years, today doubles every five years. What that means is if you graduate medical school in 1950, the half -life of what you've learned in medical school, meaning the time it takes for half of what you learn in medical school to kind of be at a date. And we're not talking about anatomy or, you know, that anatomy, cellular biology, that stuff doesn't change, or doesn't change that quickly.

10:53But the rest of it actually does change. And so in 1950, the growth of medical knowledge, meaning new treatments that they need to be aware of was every 50 years, which means the half -life of what they learned in medical school, nicely overlapped with the length of their career. So by the time they retired, maybe half of what they learned in medical school in terms of the efficacy of new treatments and some new treatments that were available was kinda out of date, but they were retiring. So that's kinda okay, right? And they tried to keep up along the way, and it was easier to keep up along the way because it was so much slower.

11:26Today, if you think about that same framework, by the time they're, like, depending on their specialty, going through their residency and fellowship, half of what they learned in medical school is now out of date in terms of new treatments, the efficacy of those treatments and so on. So it's impossible for doctors to keep up with that because medical school, which is what most people are not doctors assume, is the information transmission mechanism for medical knowledge, only sustains a doctor for a couple of years these days in terms of the half -life of their knowledge. You have a patient coming to the dermatologist who has psoriasis.

12:11Okay, maybe say fine, just read up on the new classes of biologics and pick one based on efficacy and safety. And in this example, you see that the specialization of medicine becomes very challenging because the dermatologist maybe is keeping up with the dermatology journals and all the new biologics for psoriasis that are published in the dermatology journals. But MS is a neurology condition and it's ludicrous to expect the dermatologist to also read every single page of every single neurology journal. Let alone the border region or the interaction between those two specialties. So the dermatologist in that situation in that scenario is in a real pickle because they don't want to make the MS worse.

13:02They don't want to just send the patient away and say, hey, everything's too risky, so we're not going to treat your psoriasis because that's a quality of life issue for the patient. And they need to sort of figure out what is the latest evidence, hence open evidence. What is the latest evidence on the efficacy of yes, isle 17 inhibitors and isle 23 inhibitors, but specifically with the lens to what is the efficacy and safety of those inhibitors for patients who also have the core mobility of MS. And that information hunting gathering exercise is in a traditional pre -open evidence, is just very painful.

13:43The traditional way of doing that, you would go on Google, try to Google this, you'd go on PubMed, none of those searches work particularly well. They'll sort of give you the titles of the articles, but this is such a specific question. There's a very specific question. This is not like a generic article title, like what is the efficacy of IL -17 inhibitors? There's a very specific question. What is the safety of IL -17 inhibitors versus IL -23 inhibitors for a patient with those psoriasis, NMS? And that was a real need to come back to your question, what makes something awesome for doctors? Not just this one specific case, but as you can imagine, for every example example, you can give like this of, you know, a comorbidity psoriasis, MS, seeing a dermatologist.

14:31The surface area of medicine is so enormous that you have millions and millions and millions of cases like this, you know, engineers that are listening to this can immediately understand this. Everything is an edge case. Everything is a corner case, right? So from an engineering perspective, the way to think about medicine is, you know, the surface area is not truly infinite, but it's for all intents and purposes enormous and everything is an edge case and everything is a corner case and you're trying to always look up the edge case or the corner case That's the experience of being a doctor put in engineering terms and so if you can solve the experience of being a doctor framed in engineering terms of everything is an edge case Everything is a corner case go find solve the look up for that edge case and that corner case meaning go find the reference somewhere in a medical journal that is a peer reviewed top tier medical journal that answers the question of the comparative safety of aisle 17s versus aisle 23s in a patient with psoriasis and MS, which is never going to be in the title, which is what PubMed or Google could find.

15:35It's always going to be buried, you know, on page five or six or seven of that 30 page medical journal article. Then you have made the experience of being a doctor that much better. You have made the lives of doctors that much better. And most importantly, you've improved the life of the patients that they're treating because then you've prevented a scenario where the MS is getting worse because the doctor didn't know, hey, you know, IL -17s are very promising generally for psoriasis, but if a patient dies MS, IL -23s are actually a lot That's safer, right? If the doctor didn't know that, which is no reason for them to know, because the average, you know, given the average age of a doctor, neither of those two things existed when they went to medical school.

16:23They couldn't have, it's not even like a study question. They could not have learned that in medical school. I'll 23 inhibitors came out in 2017, 2018, 2019. There's no way, even if doctors my age, and I'd be a young looking doctor, most doctors you see, you know, are older than I am, and even if a doctor wore my age, I am old enough that where I doctor I would not have learned that in medical school. There's no way a doctor can learn that in medical school. They would need to sort of keep up with post medical school and because it's an edge case or corner case and because for every one example like that example there's 10 ,000 other examples that they would also need to stay on top of.

17:01They probably would have had a hard time keeping up with that data point pre -open evidence and that would have resulted in a worse outcome for patients. And one of the things we hear so frequently from doctors about open evidence is, you know, I used it to look up this thing for a patient case that is maybe a patient case that I would have seen one or two times in my career. And then the same doctors are saying that about a different patient case and then about a different patient case and then about a different patient case. And then you realize just how long the tail of this thing is where it's like, well, if the majority of your uses of open evidence are patient cases that you would see once or twice in your career, then that really captures what the thing is doing.

17:51It's essentially running search and discovery and knowledge retrieval on a tail that is not, nothing is infinitely long, but it's so long that it fraud intents and purposes is to a wet human brain might as well be infinitely long. Yeah, the data on the rate at which medical knowledge is increasing, it's a very positive data point, right? Like it's great that medical research and medical knowledge is increasing so quickly. It's like this keg being filled with potential energy that hasn't converted into kinetic energy because we have this choke point, which is a human's ability to ingest and make sense of all this information.

18:27So it makes sense that now that AI is here, AI is great at looking over enormous amounts of text and doing reasoning across enormous amounts of text. It makes sense that AI is a little bit of an unlock to sort of convert that into kinetic energy with the system level view. The question, we talked a bit about some of this evidence that's going into the system. Do you compose the name of the company real quick? Open evidence. Why is being open important? And what exactly is all the evidence that's going into the system? Sure, so the evidence is peer -reviewed medical literature, and it's most important to say what it's not.

19:04One of the reasons you got so many egg -on -face situations from large publicly traded tech companies that put out AI systems in the area of medicine. You got these sort of egg -on -face situations that I won't say specific examples, but I think we all know what they are, is because because they were doing retrieval across the public internet, which means they're doing retrieval across health blogs, or health blogs on the public internet. They might have been doing retrieval at the time on Twitter before Elon caught off access to that. There's a lot of stuff on Twitter that you wouldn't want to be the basis for a doctor's decision.

19:47But even if you just take the health blog thing, it's amazing how many health blog writers there are on the internet. I only discovered that when I started working on this problem. And most people assume that the people writing health blogs are doctors or at least have some connection to medicine. That's actually not the case. These are not bad people. They're really well -meaning people. But what you'll find is a lot of these people are only part -time health blog writers and they're also part -time travel writers. or their part time cooking recipe writers. They're basically, you know, they're sort of journalists, bloggers, where their core skill set is writing.

20:24They've ever got a writing. They don't have any domain expertise in medicine. They don't know any more about medicine necessarily than they know about planning an itinerary for a trip to Mexico. And that's what goes in to the training data, this thing's called training data. And then we're shocked when in the early days of large language models, they said all sorts of crazy things. Well, they didn't say crazy things. They regurgitated what was in the training data. And those things didn't intend to be crazy, but they were just not written by experts. So all of that's to say, you know, where open evidence really right in its name and then in the early days took a hard turn in the other direction from that is we said, all the models that we're going to train do not have a connection to the internet.

21:19They literally are not connected to the public internet. You don't even have to go so far as like what's in what's out. There's no connection to the public internet. None of that stuff goes into the open evidence models that we train. What does go into the open evidence models that we train is the New England Journal of Medicine, which we've achieved through a strategic partnership with the New England Journal of Medicine. Say, what about that for a minute? Because my understanding is that New England Journal medicine doesn't just give all of its research to everybody for free to go train on. They don't, to the best of my knowledge, were the only AI company that they've done this with and without getting into the specifics, were not the only AI company that's asked.

21:58They've said no many times. Why do they seemingly trust open evidence when they don't trust other folks? like what what makes you particularly appealing to them? Well, we're looking into the exact play by play. What happened was a number of other well -known AI companies showed up at their door and said, can we train on the England Journal of Medicine and the England Journal of Medicine said no. I wouldn't get to the reasons of why they said no and I'm not them so I was begun to be out, but they said no. In our case, we didn't show up at their door. A number of the very senior people on the editorial board, the England Journal of were power users of open evidence and they wanted their content to show up in the thing that they were using.

22:42So it's beautiful, right? And so they came to us and then we spent a lot of time really getting right what a framework for cooperation collaboration which prioritizes and privileges, the importance of their brand and the sanctity of their brand and you know, they're They're the pinnacle, they're the apex medical journal, and the Massachusetts medical, they're nonprofit, they're not commercially motivated, there's no amount of money you could throw at them that's going to make them make a perfectly mercenary decision. And in fact, without getting the specifics of it, some of these really well -funded AI companies through enormous amounts of money at them, and they said, no, if they're a private company, they probably would have said, yes, but they're a nonprofit.

23:23So they said, no, because the Massachusetts Medical Society, which is a nonprofit organization, cared more about the sanctity and the pristineness of their mission as a nonprofit than they did about just trying to score some sort of quick commercial contract. In the case of open evidence, again, it was beautiful. It's very senior people there were users. And then this sort of circles back to what we talked about right at the start, which is, had we waited, had we taken the top -down approach, had we taken an enterprise SaaS approach and been in waiting mode for meeting number 17 with the hospital system and no one was using it.

24:04Well, if no one was using it, that would include no one at the New England Journal of Medicine using it, which would have meant that they wouldn't have fallen in love with it, which meant that we would have never had an opportunity to strike a content partnership with them that would have been, you know, that in turn made the whole thing that much better and more awesome to the people using it. So you get into vicious cycles versus virtuous cycles. In our case, the whole thing was a virtuous cycle. We put it out there. People downloaded it for free. Some of those people included very senior people at the New England Journal of Medicine.

24:36They started using it. They fell in love with it. They reached out to us. We did this deal and now the thing is 10 ,000 times better because it is trained on the full tax of New England Journal of Medicine, which no AI today in the market. I can tell you with certainty, no way I today in the market is trained on the full texting and withdrawal medicine other than open evidence. So we talked about the evidence part. Let's talk about the open part a little bit. What is the open piece of open evidence mean and why is that part important? Open meant a lot of things to me in the early days. One of the things that it meant was capturing that go -to -market strategy that we talked about, which is, for me, open was almost a reminder to myself that this was not an enterprise SaaS company.

25:21You know, my first company was enterprise SaaS company. Those can be great businesses. I don't need to tell you phenomenal success with enterprise SaaS companies. They can be great businesses. But for my second company, I didn't want to just have a mission -driven, impact -driven company. I also wanted to have a company that was different from my first company in every respect, because I don't like repeating myself. Specifically, I wanted to be sort of direct to consumer, or in our case direct to prosumer. So, the open for me sort of symbolize that, that we would go directly to doctors, that we wouldn't go to their gatekeepers, we wouldn't allow people to be gatekeepers to doctors.

25:59We would go directly to doctors, we'd appeal directly to doctors, we'd appeal directly to the pain points that they experience on a daily basis, which is that they're overstretched or overworked, they're not enough of them, they're stretched far too thin in terms of the number of patients that they need to see in tree, but also that they're forced to drink from a medical information fire hose, and we were going to make that better, and we were going to help tame that medical information for our homes, and we were going to make that appeal directly to doctors as consumers and as people specifically.

26:27And that was a big part of what open meant. There's enormous inequality in the healthcare system in the United States, as there is in everything in the West. And they're the halves, and they're the have -nots. And the best hospital systems in the United States, which have enormous endowments and unlimited funding can afford to buy not just like one tool or two tools or three tools. They can afford to buy every tool in the category and try them all out and they can afford to have like doctors not really use most of them and that's okay because you know if a if doger Elon went and did an audit of the SaaS spend of some of these really well -endowed hospitals he would have a field day because he would find is they're buying everything and they're using almost nothing.

27:19And that's happening over here. While over here you have doctors in rural parts of the country or urban parts of the country that just are socioeconomically disadvantaged or you have doctors that are in private practice or in groups of, you know, practices of ten or fewer doctors. Most people don't realize about doctors. A lot of doctors are small business owners. They don't work for enormous hospital systems of a lot of money. A lot of doctors are self proprietors, they're small business owners, they have a practice. It's almost like the 1950s, but it persists. They have a practice, they might have one or two people helping them in an administrative capacity or a secretary or something like that, but they're the principal and they have to deal with all the administrative stuff, plus C -patients, plus, plus, plus, plus, and they don't have these enormous technology budgets.

Read the full transcript

28:09They certainly don't have endowments, like universities don't endowments, like some hospitals do. Then they can't afford to go pay $10 ,000 for an enterprise SaaS subscription to some software product. So that, all of that is what opened men. We got a letter from a doctor in Albany, Georgia, who said he's the director of a cancer center in Georgia. And he's in community practice, he's a community oncology practice. And that open evidence has become a lifeline to his daily practice in his cancer center, and has been a game changer for patients in treating his cancer patients. And like most people, I didn't know much about Albany, Georgia.

28:51So I looked up Albany, Georgia. And very quickly on Wikipedia, I discovered that Albany, Georgia is in Southwestern, Georgia. It's 75 % African American. It has a median household income of $43 ,000 a year. And I started to piece together the situation. You know, there's doctors probably the only oncologist in a 50 mile radius, maybe there's a second one. And they're serving an enormous geography of fairly poor people. And there's no way that this doctor has the resources to pay 10 or $20 ,000, SAS, subscription, software rates for anything. And that to me is what Open means. It means the doctor in Fairbanks, Alaska, who wrote us a letter saying that she practices in, again, a community setting in Fairbanks, Alaska, very limited access to subspecialists and open evidence has been a game changer for her in allowing her to sort of access a sub -specialty level medical knowledge without direct access to human sub -specialists in Fairbanks, Alaska.

30:04Again, if you look up that situation or just even think through that situation, she's not paying, you know, she's in a community practice. She doesn't work for a hospital that can afford this kind of stuff. So that's what open means. It's every doctor in the country, we're really proud that we're used, not just at Mayo Clinic and Cleveland. We love the Mayo Clinic. We were partly incubated at the Mayo Clinic. We love these sort of elite hospital settings. We have a lot of users at these elite hospital settings that also use it for free. But we're not just use of the Mayo Clinic. We're not just use of the Cleveland Clinic.

30:38We're used across the country. We're used in the middle of the country. We're used at Walter Reed where our nations' warriors and veterans are treated without the government having to go through a three -year procurement process to decide whether they want to use open evidence. You know, that's another example. So one of the biggest health systems is the VA. To me, that's one of the most important health systems because it treats our warriors and our veterans. For the VA to decide to do anything is probably a three -year exercise and we're open evidence, not open to answer your question. We would probably still be in year 1 .5 of three to four years of a government procurement process to decide whether doctors in the VA could treat their patients who are warriors and veterans with the benefit of open evidence.

31:24And thankfully, we didn't go that route and we're getting letters from doctors in the VA talking about using open evidence to make a treatment decision at the point of care for a wounded warrior. You know, that's, it just energizes me waking up every day. So that's what open means. Okay, so you guys, you built something of a killer app from medicine and it's working. It's working really well. And we have a lot of people typically who listen to the show who are themselves trying to build killer apps of some sort for AI. So I'm curious using AI. So I'm curious, how did you build it? Like what, you know, is this a wrapper on top of GPT3 or GPT4?

32:07Like what is the, what's going on under the hood? How did you build it? So I think what I'm going to, I'm going to sort of have two parts to what I say. what is applicable for a lot of people listening to us. Now, I'm guessing a lot of people listening to us are building applications that don't necessarily have the same requirements that medicine has. So I do wanna address that. In the case of medicine, the way we attack the problem is by bringing together a team of PhD level scientists who are working in the field. We, you know, my co -founder Zach Rizegler who's a brilliant computer scientist is from Harvard, studied with Alexander Rush in his natural language processing lab at Harvard.

32:55That was one of the leading labs before ChatGPTV and came out. Evan Hernandez comes from Jacob Andres's lab at MIT. So I could go on on Eric Lehman from MIT as well. I mean, we've put together a team of elite scientists who are working at the frontier of language models at the top, you know, two of the top three maybe labs, if not two of the top two labs, at the time in the country, in the world, actually. And we needed to do that because we're trying to solve medicine. And we're trying to solve the application of language models in medicine. And that was a very high standard and a very high bar.

33:35And it hadn't been solved. And what the very large consumer companies were putting out was creating all sorts of embarrassing moments in medicine for those companies at the time, sort of recent and out that we probably all remember this. And so we needed sort of that level of almost the intersection of academia and engineering to go after this problem. And we needed to, in our case, produce original research and original knowledge. So we attacked the problem in a different way. Everyone was trying to, at the time, focus on us, you know, scaling these language models, larger and larger and larger and larger.

34:15And we were very, very early. You know, now this is sort of consensus with deep seek and all this stuff, but rewind, this is 2022. We were very early to the insight that smaller, highly specialized models over trained on in -domain data without performing much larger models on those in -domain tasks. They were very rigid. They wouldn't write you a poem. They'd fall over very quickly. The second you go outside the domain, but in the domain they were beautiful. They outperformed. And we published our work. We approached this very academically. My background is, you know, academic as well. I did my PhD at Harvard.

34:49And we were all academics by background. And we published our work in this paper. Do we still need clinical language models? Which was awarded of the best paper and machine learning in 2023 at the leading conference and machine learning and healthcare and attracted a lot of attention. It was really the first paper in the field altogether that showed that in medicine, the best way to attack the problem was these smaller, more specialized models. Again, that's become consensus today, but you have to sort of pretend you're not listening to this today, pretend you're listening to this in 2022, pre -chat GBT.

35:29It wasn't obvious because what was coming out at the time was like the chinchilla paper from DeepMind, and everything was about larger, larger, larger scale, scale, scale. And we just took this very different approach. And in a way, like, is very, with the benefit of hindsight, everything's obvious. With the benefit of hindsight, it's kind of obvious, right? If you go and listen to Jensen's interview of Ilya, Ilya uses the metaphor of JPEG compression, basically. It's like these language models basically like a JPEG compression of the world. And that's okay. Well, if they're a JPEG compression of the world, what's the world?

36:07What's the world that you're compressing? And it goes back to what we talked about public internet. If you're doing a JPEG compression of the public internet, then what, which is what these large language models that we're focusing on scale, where we're basically they're token limited. They're like, give me as many tokens as possible for me to train on. And so, well, Where do you find all the tokens in the world you find them on the public internet? Well to go back to Ilya's point. Well, what are you compressing then? What are you JPEG compressing? You're compressing the public internet and then you get all these sort of embarrassing outputs that that were sort of of that late 2022 or early 2023 vintage in our case we sort of said Let's make a JPEG compression of medicine and so let's let's over train on Again peer -reviewed medical science stuff that comes out of the FDA the CDC We had the advantage, this is way before the New England Journal of Medicine partnership, but we had the advantage of that under copyright law anything created by the US government is public domain.

37:02That's how Wikipedia does a lot of what it does. So in the early days, we started with sort of like creative commons, public domain stuff that was available. And we were very lucky that in medicine, this wouldn't work in every other field because in other fields like law or counting or tax, there's a lot of stuff that's behind walls. But in medicine, it turned out that a lot of the, the really great stuff was created by the US government in the form of the FDA and the CDC and what they had put out. So we over trained on that stuff and saw the copyright issue that way early on, which then allowed us to bootstrap something awesome enough that people could download it, which then one over users at places where there were copyright considerations like the need of general medicine, which then started the flywheel of them reaching out to us and then now it's having the benefit of the stuff that is under copyright the need of general medicine.

37:59But that was our approach. It was very technical and it was very academic and was very scientific because accuracy mattered that much given our domain in medicine. Yeah, I was going to ask you about that. So, you know, you have doctors using open evidence to make clinical decisions at the point of care. Yeah. So in most applications, a hallucination is annoying. With open evidence, a hallucination could be literally life -threatening, given how it's being used. So how do you do with hallucinations in particular? Well, in just a reiterate, the first thing you said, you know, and maybe this is advice for entrepreneurs or engineers who are listening to this, There are scenarios where hallucinations are not even annoying.

38:42There are scenarios where hallucinations is a feature. One of my favorite applications is mid -journey. Yeah. Illucinations of feature. Yeah, yeah. Of mid -journey. Maybe one takeaway is find applications where the biggest hesitation actually gets judo moved into a feature as opposed to a limitation. And just to total aside, an example, and someone should go start this company. Again, my first company was in finance, and I feel like I kind of grew up on Wall Street, and I think that way. And if I wasn't running open evidence, I wouldn't run another company because I'm going to work in medicine, I think, for the rest of my career because of the impact.

39:28But if I were pressed to sort of like, what would, what would I do in finance now that large language models exist, I would actually begin from thinking about hallucination as a feature as opposed to a limitation. So where is hallucination a feature in finance? Well, it's certainly not in like doing retrieval on the PE ratio. You need that to be right. Well, where else could it be used? What about risk management? A lot of finance is about figuring out what the Black swans are. A lot of finances, what could go wrong? And then at the extreme tail, there's a lot of money at stake. What is very unlikely, but that could go really, really wrong.

40:11And the first two questions most people can reason through without the aid of computers. What can go right and what can go wrong? You can kind of reason through that with your web brain. But in terms of like what could go really, really, really wrong at the level of the 2008 financial crisis. This, that's harder for most on -aided brains to imagine that. But these language models would be pretty good, and I've tested some of this in my own portfolio management at hallucinating those things. I've actually, as an experiment done this in my own portfolio management, just use these language models in a way that the hallucination is a feature where I give it certain details of my portfolio.

40:55I talk about the company, I give it in the context window, enough information so that the company does and so on. And it comes up with all sorts of scenarios that are kind of on the long tail of what could go wrong. And I'm like, huh, I never thought that I love Nvidia, but I never thought about that happening to Nvidia. That's interesting. So at a high level, I think there's enormous opportunity. I think we're like 1 % of the market captured today in 2025 in terms of applications built that even begin to think about hallucination or riffing as an advantage as opposed to as a limitation. So that's for all the entrepreneurs listening There's 99 % is still up for grabs.

41:45Yes, in my specific domain medicine, none of that is fair game And so the way, you know, we had to deal with that is by not connecting open evidence and models that we train to the public internet is by only training on peer -reviewed medical knowledge and go back to Ilias Point. The JPEG compression that we made in our models, in our smaller specialized retrieval models and ranking models, you know, we don't use one model without getting into our sort of trade secrets, like it's an ensemble architecture. There's multiple models that do different things. There's half a dozen models. They hand off tasks to each other.

42:29You can't get the accuracy level of open evidence by training one large language model. It's under the hood gonna be this sort of cooperative ensemble architecture. And those are made up largely of smaller models that do very specialized things like retrieval and ranking and other things. And for those models, the JPEG compression is exclusively of peer -reviewed medical literature. So it's never going to be at risk of regurgitating or surfacing something that is not in the peer -reviewed medical literature, which is, as they say in GI Joe, more than half the battle, right? And then the other half the battle is allowing transparency and interrogation of the answer.

43:11And we were very early to that. I've seen now that Chattach and PT and others start to do that, but we're probably the first application. I would go on a limit and say, we're like the first application that grounded our answers and references that you could drill down and drill through to see the underlying sources of we did that in early 2023 long before Chat and others started to come out with similar features and that's how we won over users in the early days because doctors saw that not only is this not saying anything egregiously wrong in terms of regurgitating something on the public internet, but it's also even within the domain of the answers that it gives based on peer -reviewed medical literature, allowing me as the physician to go interrogate where it's getting that thing that it's saying, where it's getting that source of information from and drill down all the way to the reference and then go and read the reference, which by the way also created a beautifully symbiotic relationship with the publishers, because instead of just compressing all their knowledge and then giving it away as some folks did.

44:17As a result of just trying to make this as accurate as possible, inadvertently stumbled upon a model of cooperation with publishers that ended up being very good for them, too, because we send an enormous amount of traffic to medical journals. We send millions and tens of millions, tens and tens of millions of visits from doctors to medical journal pages hosted by those medical journals, including traffic they might not have otherwise have gone because the doctor is going to that journal because of some detail deep in the methodology section that the doctor would have never known to go to that journal for.

44:58Really this virtuous circle kind of all around. And then we had medical societies that write guidelines reaching out to us saying, hey, we notice that you index this other society's guidelines. Can you go index our guidelines? Because we want the traffic. It's beautiful, right? So you get accuracy. You get a symbiotic and a mutually beneficial relationship with medical journal owners. But critically, you get the right information back to the doctor using open evidence who then will make the better decision as a result of having better information for their patient at the point of care. And it's been a decade or so since Kinsho got going.

45:39And obviously there's been a lot of progress in the field of AI machine learning since then. If we were to inspect the underlying architectures of Kinsho and open evidence, how much is the same and how much is different? And I guess part of the question behind the question is, how much of what goes into making and AI application that actually works is recent breakthroughs. And how much of it is more sort of classical engineering machine learning principles? Kenchia was pre -large language models, pre -language models, pre -small language models, pre -burt, pre -anything, almost pre -fire. So it's hard to compare, right?

46:24I mean, Kenchow was very early in LP. Not when I sold the company by the time I sold the company was much more sophisticated, but I'm talking about when I founded Kenchow in 2013. So it's very different today. What they have in common is there's an enormous infrastructure component to building this stuff. So, you know, we train our own models, I talked about that over the last few minutes. But even if you're not training your own models, even if you're just like using an API to one of the usual suspects, you know, that's gonna fall over at some point if you're successful. And you want to be successful and you want to get to the point where it falls over and it will fall over.

47:06And at that point, you need to have all the traditional things that you have in traditional software engineering like infrastructure and really good infrastructure. And that is very similar to Ken Cho, because both were critical systems, you know, in the case of finance, There's enormous amounts of money being moved around on the basis of this information. You can't have it just stop or fall over in the middle of a trade. And I think that's a good thing. I think that one of the things that everybody was concerned about post the chat, GPT moment was that all the rules of the game had changed. And I'm here to sort of tell you that they haven't.

47:44Yeah, the technology is better, but that's a continuum. The technology has always been better. The technology was better from 1982 or 1983 to 1987, right? And from 93 to 97, right? The technology's always gone better. Yes, there's a step function now. Yes, there's non -linearity. Yes, there's an exponential rate of increase. Yes, everything Ray Kurzweil said is correct. Turned out to be correct. But it's a continuum. Even Ray Kurzweil thinks about the stuff as a continuum. And when you think about something as a continuum, It's very, it's a relief in a way because a continuum is something where the laws of physics aren't changing along the continuum, even if you think about the metaphor of travel toward the speed of light.

48:29Yes, the technology that would get us from one tenth of the speed of light to one half, the speed of light, in a spacecraft is highly non -linear at its sophistication. But the laws of physics in that acceleration are not changing. It's just the technologies on a non -linear continuum, but it's still a continuum. And that same continuum, not linear, but continuum exists in engineering and entrepreneurship more broadly, but specifically in AI, where everything that mattered at Kenchow continues to matter today. And the intelligence level of the people that you're bringing to bear on the task matters, you know, Ken show in Open Evidence are identical in that we were able to be successful because we brought people with really high IQs to bear on the task.

49:18Let's talk about that. Yeah, you mentioned Zach in Evan and Eric and Micah. How do you attract people like that? Why do they choose, for all the options they have, why do they choose to work on Open Evidence? It's impossible for me to answer that without just repeating what Steve Jobs has said, which itself has been repeated so many times, but I don't have a better way of phrasing it. A -players want to work with A -players. It's that simple. Elite people want to work with elite people. A lot of people who sign up to Buds, which is the sort of screen process for Navy SEALs, do so because they just want to see if they can keep up with the other people that are doing it.

50:06They want to test themselves. They want to see what their limits are. That's as old as Achilles. That's not new. It doesn't matter whether it's warfare or engineering or sports or any other domain finance. The very best people in the world want to see just how good they are. they want to see what they're made of and the only way to do that, the only way to learn that, is to put yourself around other elite people and see how you stack up against those people. So, that's the common denominator to what I did. A catcher that worked very well to what I'm doing here that's working out very well, which is, you know, and it's kind of controversial or at least was controversial for a minute.

50:50You know, you couldn't talk about IQ. You couldn't say out loud for a while like I just want people with really high IQs. I don't care about anything else. I don't care who you are, what your background is, what you look, I just want someone with a really, really high IQ. But that's the honest truth. I just don't know how to sugar code it. I don't know how to say it differently. I don't know how to talk around that fact. And so, you know, if you think about the people on, you know, the first four or five people, Zachary Ziegler, Jonas Wolf, Evan Hernandez, Eric Lehman, Micah Smith that came together sort of senior people on my team initially.

51:35Yeah, every one of them, if I have to sort of classify this way, you know, came from a PhD program at Harvard or MIT. But that's not because I'm like, I'm only going to recruit from Harvard and MIT. It was because I had the country experience, and I learned from that experience that if you bring very high IQ people with very high velocity of learning to bear on a very difficult problem, they make more progress far more quickly than a team 100 times that size. That's a more normal team. And I think the really reassuring thing for everybody listening in this moment is the rules of the game haven't changed.

52:18The physics haven't changed. All the things that used to matter, still matter. You know, an elite team, high IQ people, high velocity people, hungry people, very motivated people, people with very high neuroplasticity. And by the way, when I say high IQ, what I mean is high neuroplasticity. I mean, something very neurologically specific. I don't mean speed at solving a Rubik's Cube which actually doesn't necessarily correlate very highly tight Q. So the Francois Chellet definition of the ability to efficiently acquire new skills? Absolutely. It's the ability at which you can learn completely new information and assimilate that new information.

52:58That's what I mean by very high IQ. And guess what? That mattered a thousand years ago. That had three thousand years ago. The domain was different. It showed up in warfare and tactics and sunsue and other sorts of things. but whatever humans were doing at any moment in history, what mattered was neuroplasticity. You know, I spent a lot of time reading in my personal life of on -cloudswits and Machiavelli and Sunsu and the history of warfare. It's a subject I'm very interested in. And the history of course Napoleon and Alexander the Great and these folks. And it's all just neuroplasticity. You know, But if you had to sort of say in a few words what differentiated these people, I mean none of these people were the physically largest people in their armies, not even close.

53:52What they all had in common is the facts on the ground could change very rapidly as tends to happen in war. And they're not just their decisions, but their entire frameworks for thinking would just like adapt. That's the quality that like an Napoleon or an Alexander the Great had, which is, you know, yeah, they overprepared for the battles that they went into and thought through every single thing that the adversary could do. But then none of that preparation would exactly match to what happened in the battle and what differentiated down from even very good generals or very good military leaders is they would just completely adapt the way of thinking about the battle to the facts on the ground that we're developing in real time in the battle.

54:43And that's, you know, the standard way of describing that as neuroplasticity, or at least in some branches of cognitive science, which is very high in neuroplasticity individuals. So what humans have been doing over the last, let's say, 3 ,000 years has kind of changed a lot, right? I mean, unfortunately, there are elements of what humans were doing 3 ,000 years ago that persist to this day and the war does persist. But not everybody today in 2025 is engaged in warfare in a way that might have been the case during the time of the Greek city -states. People, thankfully, today that are engaged in things other than city -state warfare.

55:20But what hasn't changed are sort of the the neuro processes and cognitive qualities that are required for outlier success. Awesome. Let's jump into a lightning round. Sure. Okay. Question number one. I know this number is impossible to measure because it requires a counterfactual. But we suspect that the way open evidence is being used, it's saving lives. Like it's helping doctors make better clinical decisions. On what date will we be able to say that open evidence has saved a million lives? A million lives. Well, in a way this feels like a McKinsey interview because you got a sort of reason through like, well, if you have 150 ,000 or 500 ,000 doctors using it in those doctors each see a certain number of patients and what percentage of those patients are in life threatening your situations.

56:19I'm doing this sort of kind of thing. Yeah, yeah. You told me you're a math. My math is, you know, it depends on where you look, but kind of 300 ,000 to 800 ,000 lives per year lost due to just straight up medical mistakes. Not all of those are going to be attributed to doctors making decisions at the point of care. There could be other things that happen. But let's take the low end of that 300 ,000. Let's cut it in half. That's 150 ,000. That says it's about six and a half years. You know until you get there and that's a fully ramped open evidence So we'll give you a couple years to keep growing I don't know maybe eight or nine years from now So we'll call it like 20 we'll call it November 4th 20 34 I'm gonna use this as an interview question The only thing I would add is is you know, maybe in the 20 30s You have a million lives saved through the use of open evidence, but what that doesn't count is the patient today, who's amassed and get worse because the dermatologist used the wrong biologic and that's happening today, right?

57:19And for every black and white life saved, you know, there are those examples. There was a doctor who uses open evidence in Rhode Island who wrote us that he saved his patients life by using open evidence to reason through whether the patient's presentation of symptoms was consistent with appulmonary embolism and literally used up an evidence as like a curbside consult to sort of reason through that patient's presentation of symptoms, realizing that actually it was the patient's presentation of symptoms was consistent with appulmonary embolism. They rushed the patient back to the emergency room and saved that patient's life.

57:54So, lives have already been saved through the use of open evidence and we know that because doctors tell us that. But for every one of those things that happens, it's just, you know, the MS not getting worse or it's some comorbidity not getting worse. That's in the order of millions today. Yeah. Yeah. Yeah. Broad domain general purpose foundation models. They are commoditizing. Yes or no? I think you're getting better and better. I think the costs are coming down. I think everything raker as well says is typically always right. So, you know, the frontier of the frontier doesn't get commoditized.

58:29It's always the frontier, but, you know, the, yeah, the costs are going to, The costs of the wow factor that the first chat GPT produced are going to converge to zero, which is why I think all the interesting stuff is going to increase in business perspective. There's still phenomenal interesting work being done at the Foundation Model Layer intellectually, academically, scientifically. From a business perspective, I think so much of the interesting work, the great companies to be blunt, are going to be at the application line. Yeah, we'll put, we'll put.

59:02AGI, on what date, did we or will we reach AGI? I think we've already reached, we keep moving the goalposts. We've reached AGI, we've passed the Turing test. And even, so we just keep moving the goalposts and what AGI is, what people really mean when they talk about AGI is consciousness and they don't know how to say that. So they're, what they really, because like they try to sort of say, Well, it's this thing or it's this other thing and then the AI does that thing and like what's the ability to have High school level expertise in multiple different fields. Okay, it reaches that fine fine It's not that a GI is college level expertise and then it reaches that and now it's like you know PhD level expertise in everything from coding to medicine That would be a GI that's never gonna and then it reaches that what they really mean is consciousness That's what people I think I think underneath it all mean, when do you get where you get in the movies when an AI becomes aware and conscious?

1:00:01I'm not sure that ever happens because I don't know that consciousness is an emergent property of sufficient density of an neural network. That's a philosophical question. Yeah. Yep. For AI founders, AI builders, AI fans, other than this podcast, what one piece of content should they consume?

1:00:25Ted Chang's novella understand. Okay, tell us why. I want you to have the joy of experiencing it. I won't spoil the story. It's a Ted Chang's one of the great science fiction authors of all time. He wrote a rival which became a major major motion picture and the novella understand was written in the early 90s and it is the best encapsulation of what without any spoilers. It is the best encapsulation of what non -linear acceleration and intelligence looks like. It's my touchstone for everything that I do. Most people expect a non -negative fiction answer. There's great nonfiction, there's tons of nonfiction reading, including just like go read the chinchilla paper, gray paper.

1:01:24If you want really just a touchdown for what it is that's happening in our civilization right now, it's this Ted Chang story, understand, because that just captures narratively really the feeling of nonlinear acceleration. Yes, awesome. Love it. All right, last question. What is the most optimistic or positive thing that you can imagine AI bringing to the world in the next couple of decades? How are all of our lives be better thanks to AI? I have to go with a kind of an extrapolation of the field that I'm kind of obsessed with, but which is not truly possible today, which is personalized medicine by which I mean.

1:02:12So personalized medicine has been just over the horizon. It's kind of like quantum computing. It's kind of like fusion. You know, it will happen on some civilization scale. It's been just over the horizon for a very long time. What it means changes in a way we've been talking about at this whole time because using open evidence to say that, hey, if you have psoriasis and a mass means you should use this biologic versus this other biologic, that is the beginning of personalized medicine. That's personalized to your comorbidity versus any other person with psoriasis. But that's just scratching the surface of what personalized medicine can be.

1:02:46I think in 10 years from now, whether it's open evidence or whether it's a constellation of these types of AIs, the exact specific fact pattern of your specific medical case is going to be matched to everything that is known in the entirety of medical knowledge about everything that is relevant to your case and a plan of care is going to be formulated that is hyper tailored to everything that is specific to you and that is specific about your case. And I mean to me that's just enormously exhilarating and I think that is just over the horizon but that is feasible and that will change. That's how you really start to push the ceiling on life expectancy.

1:03:33That's how you start to get into maybe 120, one 30 is no longer the ceiling anymore. And you get into these sort of ancient Greek metaphors and paradoxes of a thesis's ship and replacing every plank on the ship to the point where there's no plank in the ship anymore that was the original plank, but you're walking around and you still have of your memory of your wife and your child and your relationship to them in the destroy life to watch your own child turn 100 and those things. And I'm an optimist in that regard. I have an atomistic view of human biology. And I think the feceship approach to human biology is just over the horizon and a lot of it turns on the sort of personalized medicine stuff.

1:04:18Awesome. Daniel, thanks for joining us. Thanks, Pat. thoughts.

From the publisher

OpenEvidence is transforming how doctors access medical knowledge at the point of care, from the biggest medical establishments to small practices serving rural communities. Founder Daniel Nadler explains his team’s insight that training smaller, specialized AI models on peer-reviewed literature outperforms large general models for medical applications. He discusses how making the platform freely available to all physicians led to widespread organic adoption and strategic partnerships with publishers like the New England Journal of Medicine. In an industry where organizations move glacially, 10-20% of all U.S. doctors began using OpenEvidence overnight to find information buried deep in the long tail of new medical studies, to validate edge cases and improve diagnoses. Nadler emphasizes the importance of accuracy and transparency in AI healthcare applications.

Hosted by: Pat Grady, Sequoia Capital 

Mentioned in this episode: 

Do We Still Need Clinical Language Models?: Paper from OpenEvidence founders showing that small, specialized models outperformed large models for healthcare diagnostics

Chinchilla paper: Seminal 2022 paper about scaling laws in large language models

Understand: Ted Chiang sci-fi novella published in 1991

More from Training Data

All 110 episodes
The AI Product Going Viral With Doctors: OpenEvidence, with CEO Daniel NadlerTraining Data · 1 h 5 min
Listen in VO