Flourishing in the age of AI, with Eric Horvitz

0:00Starting a business comes with its share of ups and downs, which is why staying true to your vision is essential. a non-negotiable for Romeo and Milka Bregali, Capital One business customers and co-owners of Ra's plant-based restaurant in New York. Romeo and Milka took a leap of faith when starting their own restaurant, gutting an empty space and building it from the ground up. Every pipe, every wall, every detail. But building from scratch came with a heavy financial burden, which is when they turned to their Capital One business card. With the flexibility of the card's no preset spending limit, they were able to spend more and earn more rewards while bringing their vision to life.

0:36Today, Raz's success is proof that with passion and the right support, it's possible to make your dreams a reality. Learn more at CapitalOne.com slash business cards. AI is revolutionizing the way we work, the way we learn, and even the way we communicate with each other. And in light of all of these changes, Eric Horvitz has been asking himself several very big questions. How will it feel to be human in a world where machines are really smart, like people? We have to ask the question, what's the nature of human dignity, human agency, human authenticity? Eric is the chief scientific officer at Microsoft.

1:23In his role, he's not only thinking about where to apply AI today, but also how AI will impact humanity at large. If you know me at all, you know these are questions I think deeply about too. There's a joy of living, of experiencing, of being with people, creating as human beings. You know, we have these incredible chess machines now, but people still like playing people in chess. And we still celebrate people for being excellent chess players without computing help necessarily. You know, we all have getting access to tools now that say, hey, can I help you write this email better? Well, I find myself in some ways longing for the days when you saw words and that really came from someone's brain as they edited and thought through how to write something.

2:14So once in a while when I write a long message that I'm kind of proud is well-crafted, I put at the bottom of it forward slash handwritten. Perhaps it's surprising that one of our great AI scientists yearns for human-crafted emails. But to me, it makes a lot of sense. AI puts into question so much of what we claim to be human. And many of us in the field are not only thinking about how to cohabitate with this technology, but also how to flourish alongside it. I'm a longtime admirer of Eric's work, and I'm so pleased to share my conversation with him about flourishing in the age of AI, Microsoft's approach to AI ethics, and where AI will make the biggest impact in our lives.

3:07I'm Rana El-Khalyubi, and this is Pioneers of AI, a podcast taking you behind the scenes of the AI revolution.

3:24Welcome to the show, Eric. It's great to be here, Rana. So I was doing the math, and you and I first met almost two decades ago, back when I was a postdoc at MIT. And then we got the chance to work together through the Partnership on AI Consortium, which is this multi-stakeholder organization that examines kind of the societal implications of AI, which you were a founding chair of, I think it was 2016, is that right? Exactly, yep. Yeah, that's amazing. But you've been in this space of machines and cognition since the 80s. What is so special about this moment in time when it comes to AI? Oh, I think it's the inflection.

4:02It's the power and capabilities we're seeing now. You know, I and many of my colleagues are surprised by the power of these deep neural networks. during my graduate work in the years when I first met you. I would call it the time of the science where we kind of understood everything about what we were doing, the nodes and arcs in a Bayesian network, the semantics. It was very clear how things worked. Bayesian networks. I did my PhD in this so I could easily spend the whole hour talking about them. But essentially, they're a mathematical model that represents relationships using probabilities. It's a type of machine learning approach that was very popular back in the day.

4:52And in my mind at the time, there was a certain sense of we understand the foundations from the atoms to what these systems do when you throw them at real world problems. And, you know, we always had friends and we were always very intrigued by connectionist models. That's what we used to call neural network models, the connectionist group, the connectionist approach. We had debates on stages at AAAI meetings at the big AI conference. The connectionist versus the logic heads versus the Bayesian network people. I was definitely in the Bayesian network camp. Yeah, I know you were. And all of a sudden, we are mystified in ways, which is exciting to me, in the same way we're mystified about our own minds.

5:44Eric is describing where this debate has landed today. Basically, the connectionists were right. Or rather, it's their way of thinking that has led to the biggest recent breakthroughs in AI. creating computer models that don't take a totally linear, rational approach, but rather they mimic the complex connections our human brains make, even when those connections are not 100 % deterministic. I used to always frown upon, don't call, don't say neural networks are like biological neurons, because they're not, they're very different. But all of a sudden I found myself today saying, for the first time in my career, the reasons that I was motivated to begin with to enter into the field of understanding the mysteries of mind.

6:33We're going to come back to kind of some of the applications of this and also what it means for our humanity in a second. But first, you're the chief scientific officer at Microsoft. And I know when we caught up recently, you also mentioned that you head up the safety board, which basically like you approve the AI products coming out of Microsoft. Tell us more about your roles within Microsoft. I chair the Ether Committee, which was an acronym that stood for AI and Ethics in Engineering and Research. Ether was formed by myself and Brad Smith, our chief counsel, in 2016 when I reached out to Brad to say, we need to start thinking about the implications of building systems that will be entering into the realm of domains that have been solely the domain of human decision-making in the past.

7:25And we set up a committee. One of the first things we did was come up with a set of principles. These six principles are accountability, transparency, fairness, reliability and safety, privacy and security, and inclusiveness. And we could talk about each one of these things because we actually ended up writing a book that's freely downloadable that's still available called The Future Computed. from Microsoft that talked about why we factored things in that way and chose those six. Microsoft then implemented these principles and began creating tools to combat deepfakes, guard against cyber threats, and place safeguards for children.

8:08The company also runs internal audits where ethicists, engineers, and scientists assemble to vet the risks of new AI tools. Sometimes they'd stop projects, other times they would modify them and give guidance. And they came up with three considerations for how you'd categorize AI application as sensitive and requiring study and deliberation. The first consideration for why something might be sensitive, an AI system, is that it put people at risk for physical or psychological harm. The way I look at this is like there's like rings around a human being. The first ring is like, actually, will this harm me physically and then psychologically?

8:52Then the next ring out is, does this AI system have a consequential impact on someone's life opportunities, loans, healthcare, education? And then the third ring out is, does this AI system pose a broader threat to people in society, in particular, a threat to human rights, including civil liberties? So we look at all those three dimensions and make recommendations. So we ended up reviewing hundreds of cases, and we have now a case library. So we both share this conviction that AI should really be in service of humanity. And it's clear that a lot of the work you've been doing kind of falls in that realm.

9:32But you also take it a step further. You really kind of advocate for applying AI for human flourishing. How do you define human flourishing? It's a really interesting question you ask because there's so much more written about challenges to human health and well-being than there is about what it means to flourish as humanity, as people, as individuals. Some of the best work, by the way, was done on flourishing by, believe it or not, by Aristotle, who talked about pneumonia. He had a word for this and he talked about, I'll put it in my own words. When you look back at your life from when you're in your 80s or 90s and think through what was that really brought you happiness and contentment, a sense of warmth and wellness with being a human being on planet Earth, what are these things that you've accomplished?

10:35It's not necessarily going to ever be in someone's like their bank account statements. In fact, people would say, boy, I did the wrong thing all my life. I really should have worked on my relationships more. Or, you know, they'll think, like I always think back when I think about what makes me happy and content. I know I'm a geek, but I think about like the time I was sitting quietly in a conference room at Stanford as a grad student. And I had this rush of intense ideas. And it was there with me in a very small little conference room late at night. I was there and it was like a conversation with the whiteboard where I covered it.

11:11I said, I had my thesis direction and I was so excited for like the next four years about that whiteboard. And that was the moment of the idea of creative breakthroughs with a certain goal at my, you know, to understand human intelligence. But also we think back, it's like, you know, the first time I kissed my wife, you know, these moments that change everything. You know, having a child and raising my son from birth to where he is now, a PhD student at Columbia, watching his growth and just being there as somebody who could do his best to try to mentor, that's like a major part of my life and a major part of my flourishing.

11:55And I think I'd love to see as humans, us thinking more deeply about that when it comes to everything from elections to a democracy to participating in civil society, organizations and movements to charity, to helping others. I recently came across Harvard's Human Flourishing program, a social science effort that seems right in Eric's wheelhouse. They defined five points of flourishing, so I wanted to get Eric's take since he hadn't heard about them before. I'd love to get your thoughts on how might AI influence each of these. So physical and mental health, happiness and life satisfaction, meaning and purpose, character and virtue, and then social relationships.

12:45A, do you agree with those? And B, how might AI play a role? Well, those are all very big swaths through the goodness of a life well-lived. So we might pick one topic there, for example. In education, for example, coming to understand the world, I think these AI systems, whether it be answering a question like what's the scoop with human flourishing and edamonia, what did Aristotle do, give me an answer that I can digest at my level of understanding given where I am. I think these systems will be incredibly valuable for giving people in more efficient ways answers to their questions and pathways to ongoing sequences of cycles of curiosity and growth when it comes to learning.

13:41And I think that this will add to meaning for comprehension and understanding. I should back up a little bit and just say that my team was like one of the first teams at Microsoft and thereby being one of the first teams on the planet to get access to GPT-4. And one of the deep dive we did was in what I would call how might these systems be useful to bring people together. So we have a paper called Sparks of Artificial General Intelligence. We wrote back then to capture the dimensions of what we were seeing. And you can almost read this paper and see the electricity and the surprise we had as we went through these examples.

14:22But one of them, we asked the system to help with the situation. You're at Thanksgiving and it's your mom and her brother, your uncle. And they have very different feelings about getting vaccinated. And, you know, and they're having a debate because it's Thanksgiving and these things come up. We give the example where the system did a beautiful job of saying, you know, here's the perspective I would take. You know, make sure they both know you love them deeply and listen to what you have to say about your care, about their health and what you believe. And since then, there have been some formal studies of these systems having the ability to facilitate conversations.

14:59In fact, Science Magazine just, I think, had two articles talking about how these systems can help people better grapple with what are called conspiracy theories to understand maybe the basis for some of the findings they see in the world. And the other was on helping facilitate different points of view in conversation. That was a long answer about flourishing about education, but I thought you'd appreciate that. I'm with Eric. AI can help us flourish as individuals. It will help us learn more and communicate better. But there are still plenty of unknowns. For example, if you collaborate with AI to create a piece of music or art or even write a book, who's the real creator?

15:45How much of the work is yours or the machine's? We'll get to that after a short break. Stay with us.

16:24Transcription by CastingWords AI agents in Rovo, which connects the dots across your work so nothing gets lost. It's one AI-powered teamwork platform designed for how modern teams actually build. Learn more at atlassian.com slash teamchanger. That's A-T-L-A-S-S-I-A-N dot com slash teamchanger.

16:53as we use these tools as collaborators and thought partners the line of authorship and ownership becomes really blurry right if i use chat gpt to kind of think through an essay or a scientific experiment or create a new film or music or art piece right who owns this work do We need new frameworks. So interestingly, I was pulled into a national academy, but the study was, it led to a paper which came out in May in the proceedings of the National Academy of Science called Protecting Scientific Integrity in an Era of Generative AI. Now, you're talking about more the creative arts, but let's start with science for a second.

17:39If a scientist uses one of these tools and ideas come through in response to a query without attribution to the authors of the ideas, is that an okay thing to be doing? And alternatively, these systems are creative. If they put two and two together and come up with a new concept, does the scientist say, well, it was my prompt? Or attribute the idea to, you know, model 17.3 on this date. Also, in the world of generative AI, their ability to synthesize data is becoming so high fidelity that data is coming out that you can't discriminate necessarily the synthetic data from empirical data that you get from an experiment.

18:32What kind of metadata do we need to have on data moving forward so we don't confuse the two? So there's a whole set of, in that paper, agreed upon key principles for moving forward for doing science with integrity. One of the recommendations was we need to stay on this because things are moving so quickly to create a strategic committee at the national academies that will be overseeing and looking at implications of these tools for the sciences, making recommendations to different stakeholders, to model creators, to model users, to scientists in different fields. Another recommendation was be very cautious about using models to guide key decisions in academia, including promotion and recommendation letters, for example, reviews of papers.

19:27And the same for creative arts. So it could be really interesting where we move forward with copyright deliberations to understand, you know, what's the right thing to be doing in the changing world? Where these systems can do creative things, but they also are drawing upon the creativity of humans in different ways. It's raising questions that we need to answer as a society, I think. Do you think this will put more premium on human-generated stuff? Yes, I do. And going back maybe to six or seven years ago, I was asked to give a set of predictions by the AI magazine. But one of them was someday people will seek out art, whether it be music or literature, that is certified, created by humans without any computational tools.

20:21And they'll pay more for these things. And shortly after that, I was sitting at a meeting at Microsoft where this beautiful song was played. And the lyrics and the music were created by an AI system. And it was really this heartfelt song. And I thought to myself, you know, I know it was a beautiful song. And I know it was creative and it's celebrating AI. But, you know, something, I want to have somebody sing about their life and what they've experienced as a human. and I'll pay more for that. That's fascinating. Like, to know that it stems from this, like, authentic human experience. Yeah, that's super cool.

21:05And the question is, will society feel the same way over the decades coming forward?

21:15So I want to move us on to AI innovations, but I want to cover as many of these as we possibly can. So I want us to kind of rapid fire them. So one of the areas I'm particularly passionate about is the intersection of AI and the biological sciences and health and wellness. Oh, gosh. Yes. Yeah, I know we can spend a whole episode on that. But what are some of the key things you're excited about in this space? These AI tools are providing us with new computational microscopes where we can see molecules. and seeing them not just their shape or their structure, but how they move. We can now design them to go after target proteins and receptors, including those that could disrupt disease.

22:01I believe we will see in our lifetimes breakthroughs in medicine that will be clearly called out as AI breakthroughs. For example, I think we're going to be able to disrupt immune diseases, a lot of them in our lifetime. I think we're going to be able to transform more cancers into chronic diseases that are managed. I think we're going to get to the core of the mystery of neurodegenerative diseases in our lifetime. I think we're going to get to some sparks of understanding about what's going on with Alzheimer's disease and frontotemporal dementia. I often say that the biggest impact of AI in our lifetimes will be on the biosciences.

22:39I think we probably agree on that, yeah. Yeah, we do agree on that. It's an area, as you know, I'm very interested in kind of identifying transformative companies in that space and backing them. So another area that I'm super fascinated about is how AI can take us to more sustainable living and in particular reimagining food systems. So again, what do you see in terms of innovations in that space? Well, I mean, certainly the biosciences will read on agriculture, the guidance for how to farm more efficiently and effectively for growing plants without poisonous insecticides, for making them resistant without imposing on their genetics in a way that makes the foods less safe.

23:29I think we'll be seeing work in this space. It's happening now. I'm thinking about the agricultural possibilities. We have a project we've called FarmBeats over the years using AI and communications technologies to change the way farming works. You know, with climate change, we're going to see some interesting and unfortunate challenges to where we grow food and how we distribute it. So we'll have to get creative about sustainable agriculture and food and its distribution. Yeah, absolutely. And then one of the things I also think a lot about is I don't think kind of the next generation of a human-machine interface is going to be a phone.

24:12My thesis is it's going to mirror human-to-human communication, which is based on perception and conversation and empathy. I'm curious, like, what do you think the evolution of a, you know, an interface is going to be like? So, Rana, now we're getting into the field you studied and you have led on with your affectiva work and so on. When it comes to systems that can actually communicate in more natural ways, my initial reaction is the following. Many people have first come to understand AI through the chat interfaces because it exploded onto the scene just a couple of years ago. That's what AI is.

24:50But beneath the hood is this incredible spark of increasingly general intelligence. which can power up so many different kinds of interactive experiences. We need to think beyond simplistic interaction modes and interfaces and get really creative about the possibilities of creating deeply human-AI collaborative fluid experiences. And you might say that there's a huge opportunity in given how well we work with other people, other humans, and that's part of our evolutionary history, of thinking how to do that better. But even a few years ago, we built a system. It was my computational assistant that would understand all about my schedule and help people that came by to find out where I was and how they penciled me in for meetings and so on.

25:40And at one point, we took some of the uncertainties at different levels. Did I understand well? Can I hear well? Am I seeing you well enough? And we said, instead of having these scores inside the system that are like log functions of looking at entropy levels. We basically pushed out the uncertainty to eyebrows, to tilted head, to asking again, to say, you know, like for confidence and for uncertainty. And all of a sudden we took this set of mathematical principles and had them controlling expressions in a natural way. And you realize that we all the time communicate our uncertainty to each other and our understanding and our confirmation and our happiness.

26:24And if we can't see well, we'll squint. And in the paper we wrote with videos, we showed how this can all work as a much better interface to human beings than bar graphs or numbers. Yeah, absolutely. And I think exactly to your point, all these different, you know, I've been doing research in this space for many years. But now I feel like it'll finally come into place because we've got kind of the large language models. We've got these different modalities finally ready to all be combined in a multimodal context. So I'm excited to see kind of AI move from chatbot world to like physical embodied AI.

27:05I think that's going to be our next leap. You know, when I see that, you will be in the cloud over my head when these things are happening. Oh, this is what Manu was talking about over the years. I think, though, along with that, a close friend just showed me these startups that are now, they said, give me your video and I'll synthesize a version of you for a Zoom call. I said, you know, we also want to think deeply about all the implications on the dark side of the wonders of having human-like agency and agents in the world. So what are some of these negative implications of AI that Eric thinks we need to address?

27:46We'll get to that after a short break.

27:58Meet Nicole Nicholas, Capital One business customer and co-owner of Ansett Uncles, a plant-based restaurant and community space in Brooklyn, New York, that got its start from a need for unity. The inspiration, it was born from the desire to create a space that felt like home, where we can connect community culture, good food, and come together with family and friends. That's how we birthed aunts and uncles. Nicole and her husband, Mike, were fulfilling their dream of bringing people together out of their home kitchen. But they soon learned that the demand for community was greater than they knew.