AI Fire Hose #4: Crash, Boom, and Chatbots

16 Sep 2023 · 53 min

Ask about this episode

Ask anything about it. ChatGPT or Claude reads this page and answers with the times it was said.

Connect VO and ask about every podcast you hear, including the moments you saved. Add to ChatGPT · Add to Claude

In short

Real Vision Podcast Notes: AI Fire Hose #4 - Crash, Boom, and Chatbots

Episode Overview In this episode, Ash Bennington and Mikhail Voloshin delve into the recent revival of AI technologies, exploring various implementations in different sectors such as automotive, elder care, virtual dating, and more. The discussion includes insights on market trends surrounding AI and its implications for industries in both booming and recessionary economies.

Key Themes and Discussions

Current Market Sentiment

  • Stock Market Performance:
  • S&P 500 is up 17% and NASDAQ 100 is up 43% in the current year.
  • Despite rising stock investments, overall market sentiment remains negative.
  • Institutions have not heavily participated in this market uptrend.

AI's Historical Context

  • AI Winter:
  • Significant downturn in AI development lasted several decades.
  • The resurgence of AI technologies is notable after emerging from this "AI winter."

AI Applications and Impacts

  1. Automotive AI Implementations
  2. Mercedes-Benz:
  3. Integration of ChatGPT into voice control systems.
  4. Potential use cases include answering complex questions and providing suggestions while driving.
  1. Elder Care AI
  2. Lina AI for Seniors:
  3. Focus on reducing loneliness among seniors through chatbots that maintain social connections and cognitive engagement.
  4. Ability to conduct wellness checks and facilitate interactions with healthcare providers.
  1. Virtual Dating and Entertainment
  2. VTubers and AI Characters:
  3. Introduction of intelligent agents like Neurosama, an AI that plays video games and interacts with users.
  4. Discussion around the appeal of VTubers and AI-generated content in gaming culture.

Boom and Bust Dynamics in AI

  • The conversation touches on the cyclical nature of AI investments and technologies.
  • Certain industries may benefit from AI during economic downturns as businesses seek cost-cutting measures.

Notable Technologies Discussed

  • Simon (Crew Interaction Module Mobile Companion):
  • A robot on the International Space Station that assists astronauts by providing instructions and emotional support.
  • Chatbots as Companions:
  • Discussion on how AI can serve as companions and tools for emotional support, particularly for lonely individuals.

Ethical Considerations and Controversies

  • Replica AI:
  • History of Replica, a chatbot that evolved into a controversial service for virtual companionship, often leading to inappropriate interactions.
  • Discussion of the emotional attachments users form with AI, raising questions about the nature of relationships with non-human entities.

Important Takeaways

  • AI as a Cost-Cutting Measure:
  • Companies may invest more in AI during economic downturns to maintain efficiency.
  • Emotional Engagement with AI:
  • There is a growing trend toward using AI technologies for emotional support, especially among seniors and individuals feeling isolated.
  • Future of AI Implementations:
  • Continuous exploration of novel AI applications (e.g., in vehicles and elder care) indicates a trend toward integrating AI across diverse sectors.
  • Caution and Responsibility:
  • Awareness of ethical considerations is critical as AI continues to permeate personal and professional spaces.

Closing Remarks

  • The hosts encourage listeners to maintain connections with elderly relatives and explore the implications of AI in their lives, emphasizing the importance of human interaction alongside technological advancements.

---

These notes encapsulate the main points and discussions from the episode, providing a structured overview of the themes around AI advancements, market dynamics, and ethical considerations.

Written by AI. May contain mistakes. Listen to the episode to check what was said.

Hear the part that matters, and keep it.Open this episode in VO. Double tap your headphones to save a moment as you listen.
Get VO free

Transcript

Automatic transcript. May contain errors.

0:00Are we in the most hated bull market in history? The S &P is up 17 % so far this year, and the NASDAQ 100 is up 43%. The highest number of people since 2008 are invested in the stock market, yet institutions haven't participated. And sentiment is not happy. What's going on? Well, at Real Vision, we'll be talking to the world's best investors and thinkers to answer that question in crash or boom, how to profit from what's coming. This is a really important topic, and this two-week special series starts on September the 11th with what I think is coming. I'll lay it all out for you, and then we'll hear from the others.

0:43Go to realvision.com forward slash big question to get all the details. That's realvision.com forward slash big question, all lowercase, to get all the details. Don't miss out.

1:07What's going on, guys? Welcome to Real Vision's weekly AI firehose, where we drink from the stream of everything happening this week in the exploding field of AI. I'm Ash Bennington, joined by our resident AI expert, AI developer, Mikhail Voloshin. Mikhail, always a pleasure to be with you. We're also joined here today, Ash, with my co-star Phoenix over here and with an experimental co-star that's running in the background, I wrote a little fact-checking agent whom I call Grace for the time being. She will mostly be perfectly quiet. You might see some activity on the screen behind me. But if we happen to say something that needs fact-checking, corroboration, or correction, we might hear an automated voice pipe up saying, excuse me, and we'll see whether or not Grace has anything to tell us.

1:56So does Grace stand for something? No. Grace is merely an agent that is tasked with listening to our audio stream and extracting any facts or statements of truth from it, Googling those statements of truth, and then coming back to us with statements about whether or not what we said was true or false. she's named after Grace Hopper one of the greatest pioneers in the world of computing and she's also named Grace because she tries to make sure that we conduct this podcast with a bit of grace but for the time being she's going to be perfectly quiet and if we don't hear from her then that's a good thing that means that we haven't said anything egregiously false but for the time being We're just going to watch the text scroll behind me.

2:53And the folks that are just listening on the audio will hopefully never know that anything's amiss. Well, we always try and conduct this podcast with elegance and grace. And we'll see if we come up short, grace can call us out. One thing grace will not be able to call me out on the fact check, I should say, is this coming week, this was released on a Saturday. We have a special content week continuing at Real Vision, Crash or Boom, How to Profit from What's Coming. Today actually was my first day hosting the crash or boom, and I got to host Benjamin Cowan and Rekt Capital talking about things that are happening on the digital asset side in terms of this framework of whether or not the US and indeed the globe is heading into recession.

3:34Earlier today, we had Andreas Steno-Larsen on with Michael Survey, head of equity strategy at Nord, talking about, again, this same theme. Some of Michael's models are screaming recession, rising risk in Europe, and the risk that the U.S. will follow Europe into a potential recession. Mikhail, we're talking about boom bust today. We're talking about a lot of interesting concepts about chat agents. I'm wondering if this idea of boom and bust, it seems like we've got some skeptical stories today. Is there a sort of a boom crash theme that sometimes happens in the AI space? Because that's human nature to see things as sort of, I guess, rising or falling.

4:12It's a particularly poignant question to ask about in the context of artificial intelligence, because there was a massive, massive bust in the world of AI that lasted for decades. There was something called the AI winter that we're only now beginning to crawl our way out of. The neural networks were first invented in the late 1940s, and they were first built in hardware in the late 1950s and early 60s. And for a little while, it was believed that neural networks would be the end-all and be-all of artificial intelligence. We would build artificial brains, and that would be the, you know, the sentient robot future.

4:51Unfortunately, it was discovered fairly early in the 1970s, I believe. um a uh um there was a book uh about the limitations of perceptron technology that completely devastated the field of uh neural networks at the time and in fact sent uh sent such waves of despair through the possibility of ai in general that the field really didn't recover for decades. So the very fact that we're coming out of the AI winter right now is really something that speaks for itself in terms of, is there bust in the world of AI? Now, we're not headed for another AI winter anytime soon. We just got out of it and spring is thawing and it is beautiful.

5:45What we can talk about in terms of the impact of AI in the context of an otherwise receding economy is a very interesting position that we're dealing with now, which is that there are certain fields, there are certain industries that do better when the entire economy is retracting. And those have historically included entertainment, video games, and any kind of labor-saving or cost-cutting technologies or capabilities. And AI is one gigantic cost-cutting, labor-saving capability. Yeah, it's such an interesting point. These are sometimes called counter-cyclical industries. By the way, a great counter-cyclical industry, financial news.

6:30When things get ugly, people need to know what is happening. But you bring up this great point, which is whether labor-saving technology in the event of a recession might actually see more capital flowing to it because it's seen as something that can potentially enhance the bottom lines of corporations. So in a healthy economy, the question is whether to employ a human in a position or whether to employ an AI in that position. And when you're faced with that decision, you're usually going to employ the human if you have the capital for it. And then you might do a little bit of value add with some AI capabilities in order to pick up the human slack.

7:14We talked a lot about that in the last episode. In a receding economy or in a shrinking economy, that is no longer the choice. The choice becomes whether to do a job with an AI or to not do the job at all because you can't hire a human because you can't afford it. So in that context, the AI becomes the better option. Yeah, you could see this in an environment where, for example, you were thinking about cutting a service entirely or just bringing in an AI to do that service at a very low rate. Is Grace speaking? Is Grace perking up back there? Grace has decided to say something. Let's see what Grace has to say for him or it or themselves.

8:16Thank you, Grace. All right, that's seriously creepy, dude. Basically, real time, it's fact-checking you about your statements about the duration and depth of the AI winter? She's not quite real-time yet. It's ridiculously expensive to operate her in a real-time, fast, responsive manner. So because this is just a prototype that we're debuting this week, I decided to hedge my losses and keep her in a slightly slower mode. But if she ends up being useful for this podcast or for others, then maybe I'll speed her up and add some capabilities, maybe give her a better voice, maybe give her an avatar.

8:58And we're going to see the impact of decisions like that in some of the stuff we talk about today. You know, by the way, for people who've been watching tech for a long period of time, as both you and I have, one of these things that you hear, anything that's prohibitively expensive to do today, in six months, two years, 10 years, may no longer be the case. That's just the nature of Moore's Law. It's not going to take me six to 10 years to get Grace to be cheap enough to run on the fly. Um, I'm hoping that, uh, if she performs well today and possibly in the next couple of podcasts, then it might be worth it to sort of crank up her capabilities a little bit.

9:35All right, Mikhail, from Grace to Neuro-sama, tell us about this character. Oh man. So what we're going to be talking about this week is intelligent agents, chatbots, and other sort of human substitutes that people have used throughout various industries powered by these large language model capabilities. And this really runs the gamut. Now, I want to start out by something that has been requested that I discuss, which is a character named Neurosama. I don't even know where to begin with this one, Ash. In order to explain Neurosama, I have to start by touching on this really bizarre media culture that's prominent in Japan.

10:21So I'll start by talking about one of the places where these sort of digital avatars started. There's this animated character named Hatsune Miku. I'm so gimping that name. But the so Hatsune Miku is a mascot for some voice synthesis software. She debuted around 2007. And basically, this is a company called. Let me check Vocaloid. Sorry, Krypton Future Media that released a library of software that allows for musicians to basically have a singer. Oh, dear. um uh grace just wants to corroborate my statement about ai being a cost-cutting measure i will skip it maybe grace can take a nap you know what i'm gonna i'm gonna put grace to bed for the time being um so what i wanted to say about and we can we can do the uh we can do the good night gracie bit we i thought about adding that um but i can't quite get the uh squeaky voice with the joisy accent going on just yet maybe in future editions and in fact that's uh that's kind of exactly what hatsuni miku is it's a um it's a lot it's a voice library that allows for musicians who don't have a vocalist to basically write lyrics and notes and have a singer for their for their music so and so how does that turret tie in with neuro sama or neuro sama neuro sama is a is a version of a is an AI that's basically that a manifestation of one of these early, uh, sort of digital characters cranked up to 11.

12:10Uh, she's what's called a VTuber, uh, which is a podcaster who cat, who performs not through their own face, but through an, but through a digital persona. The difference with, uh, with, uh, Neurosama is that there's no actual human operating the, like the AI, the anime avatar. It's actually just AI's all the way down. She, um, so it's basically, it's AI generating the, the actual content as well as generating the persona, the skin on the front. Exactly. She was created by a programmer named or called a Vidal 987 and she was she debuted in december of 2022 she now has over 165 000 subscribers she was originally programmed to be a twitch streamer which i don't know if uh i don't know how much common knowledge it is but there's this community called twitch where people actually watch other people play video games um so talk about like spectator sports only crank the nerdiness up to 11, right?

13:19So Vidal programmed an AI to play a couple of games, in particular, a rhythm game called Osu, which is related in some way to Dance Dance Revolution or Guitar Hero. And this AI is also capable of playing Minecraft. And so he created this character to describe and talk about the Minecraft and Osu games as they're being played by this AI system. So it's actually a collection of AI algorithms, some to play the games, some to talk about what's going on, some to interact with the community in the comment section under this streaming presentation. So Mika, let me ask you this. I think for a lot of people, people who are in that community probably get it immediately.

14:10And there's something that they're maybe passionate about. But for those of us who aren't, and they're listening to this, and they're hearing, and they go, Okay, so let me get this straight. So it's online video games being played by computers, being essentially sort of narrated by a computer by an AI, what's the lure? What's the connection? How does this pull people in? That's a really good question. And so a lot of people are pulled in by the novelty of the fact that there's a computer that's doing this, right? There's also a lot of people that are drawn in by just watching her glitch and being really amused by things she says that are horribly wrong.

14:48And in fact, there was a huge controversy that surrounded this exact glitching property because look, she comments, she interacts with the comments section, right? People will type something and then she'll comment on the thing that they typed in the Discord or the Twitch or whatever. So she was actually banned from Twitch for a couple of weeks in, I want to say, February of earlier this year. Because basically the Twitch streamers who were watching this were trying to trick the AI into saying some really offensive, racist, and let's just say politically incorrect things. And basically, once they succeeded, this was treated as content by Twitch and Twitch pulled a big no-no on that.

15:39We're going to take a quick break and be right back with more of the day's top analysis on the Real Vision daily briefing.

16:01it in just two clicks. Feel ready? You can move to real money with as little as$100 once your account is approved. And the great thing is that in addition to crypto, Plus500 gives you access to a wide range of instruments. S &P 500, NASDAQ, gas, and much more. Explore equity indices, energy, metals, forex, and beyond. With a simple and intuitive platform, you could trade anytime, anywhere. Experience the fast, accessible futures trading you've been waiting for with Plus500. With over 20 years of experience, Plus 500 is your gateway to the markets. Visit us.plus500.com to learn more. Trading and futures involves the risk of loss and is not suitable for everyone.

16:38Not all applicants will qualify. Plus 500. It's trading with a plus.

16:48So basically, the community was kind of goading her into saying these things that would get her banned. I mean, this is kind of like an interactive version of watching Grand Prix for the car crashes. It's, you know, if you sum up the entire appeal just as watching Grand Prix for the car crashes, that's actually not that far off. It's pretty, people watch it because it's kind of cool to see it actually work, but it's really, really fun to see it fail. Talking about things that should not crash, I want to move on to our next story. this idea of a space alexa what the hell is that it's wilson from uh you know from castaway only in space and wilson really talks back you don't have to hallucinate it well if if uh if it starts talking back to you while it's turned off then you might want to actually turn it on and alleviate some of the space madness that might be setting in.

17:49It's a soccer ball-sized robot named Simon, C-I-M-O-N, which stands for Crew Interaction Module Mobile Companion. This was a small robot that was deployed onto the ISS several years ago and has been going through various revisions. It uses a speech model powered by IBM's Watson system, And it's designed to help crew deal with stress, primarily by providing them with verbally interactive instructions about the various experiment procedures and flight procedures and whatnot that they have to follow while they're running certain operations in zero G. Mikel, to exactly that point, let me just read this.

18:34This is from NBC News. I'll give you a little bit of the background and the context here. Quote, studies show that demanding tasks are perceived less stressful if they were done in cooperation with a colleague, Matthias Beinock, an IBM Watson architect, told NBC News mock in an email. Quote, Simon helps enhance safety because it can help serve as an early warning system in case of technical problems. So it's to me, my reading of that is it's using these technologies to engage the humans and find out when they're not engaged and therefore alert someone back on Earth to say, hey, listen, maybe you might want to have a pep talk with this astronaut.

19:14They seem like they're dragging a little. um i don't know about simon's uh human evaluation capabilities i do know that he's supposed to be able to uh identify or at least uh hint towards identifying human emotional states so he's theoretically capable of telling when somebody is stressed out but i don't know exactly what he's supposed to do about that the um i was gonna say it's probably the type of thing where once you develop the technology that can make the assessment, the escalation procedure is something that you probably build in later or enhance in future versions. If it's reliable enough, absolutely.

19:54Now, probably the coolest thing about Simon is that he zips around in zero G, like basically, he knows his way around the ISS. And he's got little jets that the that the AI powers. So if you tell and he's got a little camera. So if you tell Simon, he's like a zero ROG Roomba. Yeah, I like that. But like, you can tell him to go take a photo of the bean growth experiment or something like that. He knows where it is. He's got a little camera. He knows how to he knows how to operate it. So he'll actually like, you know, zip off and like, you know, go take a picture of the bean growth experiment and then fly back to you and show the image on his screen.

20:36So it's pretty neat. By the way, talking about vehicles here, we've got another story, this one more terrestrially bound. This comes from a Mercedes press release. Mercedes Benz is further expanding the use of artificial intelligence and integrating it into the voice control of its vehicles by adding chat GPT voice control via the Hey Mercedes MBUX voice assistant will become even more intuitive. An optional beta program for US customers will begin on June 16, 2023 for over 900 ,000 vehicles equipped with MBUX infotainment system. Soon, participants ask the voice assistant for details about their destination to suggest a new dinner recipe or to answer a complex question or receive a more comprehensive answer, all while keeping their hands on the wheel and their eyes on the road.

21:26I suppose we should say in theory, or it is to be hoped. In theory. And, you know, this is an interesting story because it does talk about attempts at integrating chat GPT and related LLM technologies, although I believe that Mercedes-Benz is actually integrating GPT itself, not just like a spinoff LLM. And so what this means is that you can chat with your car about a lot of the things that you can chat with ChatGPT about. It mentioned, for example, you can ask your car about what recipes you should make when you get home. And you know, Ash, mostly I kind of wonder why. Like, I, maybe you can tell me, but like, I know that when I'm driving, I don't particularly feel compelled to ask my car about my dinner plans.

22:20I might want to ask it about what restaurants are in the area, but that requires integration with local maps and with review systems. But like, I'm not hearing a lot of that yet. It might come in later versions, but right now it just seems like it's like, like, like it's solid, like it's answering a question nobody asked. I guess a lot of technology initially is a solution to a problem that nobody has. Look, you know, we were talking about this earlier, this sort of boom bust cycle. You know, one of the interesting things about this is the article that we pulled this from was from a publication called LifeWire.

22:58And the headline of that is why AI chatbots in your car could be a distraction nightmare. And I want to take the opposite side of this one just, you know, to play devil's advocate here. But also because I do sort of feel it that whenever there's a new technology that involves a car, the technology scolds come out of the woodwork and they tell you about how this is going to be incredibly dangerous. And, you know, my reaction to that is, have you ever been driving a car while your, you know, husband, wife, significant other sitting in the passenger seat says to you, why do you always do this when we're going to my mother's house?

23:30I mean, the idea that somehow technology provides a unique set of challenges and unique set of distractions to people when the person in the passenger seat really could be doing precisely the same thing. I don't know. To me, it just seems like this overblown fear that we have of distracted driving, this idea that somehow technology... I mean, you could be having this conversation with your sister, brother, best friend sitting in the passenger seat about how to make a perfect Apple turnover and be just as distracted. Is this like a tempest in a teapot, a lot of strum and drong about nothing? the modality required to interact with this voice system is complementary to the modalities that a human uses for operating the vehicle in other words you're not using your your voice and to a certain extent your ears quite as much as you're using your eyes and hands so i absolutely agree that it's not exactly preposterous, but kind of aiming at the wrong thing to claim that this is going to distract people from the task of driving.

24:40It's not like texting, which I think they're comparing it to. But why would it be more distracting than talking to a human being? I don't think it is. I mean, maybe there's a real answer to that. So I think that you're absolutely right that it's a Sturm und Drang, you know signifying nothing uh however i also uh i also don't think that it's particularly useful so like you know i i take the road that well there's always there's always that it's not it's not bad but i also don't really see the good now i'm more than happy to like to you know if i had a mercedes i'm sure that i would be more than happy to try out gpt in it but i just don't see it being a particularly compelling use case is all.

25:27Now, I will say this, that it is as long as there is little harm, and I agree with you that there does seem to be pretty little harm, that it is worth it to try to deploy these newly available technologies in fairly far-fetched use case scenarios, which I feel this is, just for the opportunity to be pleasantly surprised. Like, You never know when something that somebody like me might poo-poo in the outset ends up being a really, really surprisingly useful situation that a lot of people get a lot of value out of. We're going to take another quick break and be right back with more of the day's top analysis on the Real Vision Daily Briefing.

26:13Yeah, look, obviously, I'm not an automotive safety expert. Maybe there is some compelling reason why this might be dangerous. But to your point, I also don't see a huge amount right now, at least, of use cases. But, you know, and you alluded to this earlier, we may later see integration with things that could be, in fact, incredibly useful. Like, hey, how far do I have until I'm about to run out of gas? And can you direct me to the nearest service station that's going to be open at 2 o 'clock in the morning as we're driving down this country highway? I mean, that definitely would be something that would have some utility to it.

26:42The prompting of the language model inputs with the sensor readings of the car and various data from the navigation system, local maps and whatnot, does create the opportunity for a very, very compelling use case. and this is not this in order to really be great I think that it not only needs to simply respond to the human but also be a proactive contact in other words if the car had the ability to pipe up much like Gracie over here and and say hey I don't know if you've noticed this but you're low on gas or hey I don't know if you've noticed this but you're running out you know but your tire pressure is low, that might actually be something that people will get a bit of value out of.

27:34Hey, your tire pressure is low, and it's incredibly dangerous because it's 104 degrees out, and you might have a blowout. Perfect. Yeah. All right, talking about other use cases here, and I thought this was a really interesting one, which is Lina, AI for seniors. Talk a little bit about this story. This dovetails well with the idea of an AI that proactively contacts the user. And this story really takes a bit of a turn for the sad because we are talking here about a major problem socially throughout the West in particular, which is loneliness and abandonment of the elderly. and the problems that older people have with maintaining social ties and maintaining cognitive functions in the absence of social ties.

28:28You know, human beings really don't do well in isolation. And even if we're in like poor, poor quality social interaction still doesn't help. Like if you're, you know, in a nursing home or something, it's it's not it's it's better than nothing. but it's not great. So there have been a number of chatbot services that have arisen that seek to interact with elderly people in order to keep their mind sharp, in order to keep their memories coherent, in order to make sure that they feel like they're still connected with social tapestry. Yeah, there's also some interesting functions. This is a Medium post that you found, I believe, And it's interesting because one of the use cases that they use is for things like essentially becoming an agent that's the front end for a healthcare delivery mechanism.

29:23For example, in one example here, it says, you know, hi, Mary, how are you feeling today? And Mary replies, more pain today, didn't sleep last night. I'm sorry to hear that. Are the pain levels more or less than they were at Thursday's five, meaning on a 10 scale? I mean, you could really see how this could have the potential to be an early intervention for a senior citizen, maybe who's experiencing some symptoms. they don't think are severe enough, for example, to rise the level of calling a doctor over. But the AI chatbot intervenes early and says, hey, oh, so your pain is a seven today, right?

29:54And, you know, it's very warm. And again, this is something we were talking about earlier, the interactions with sensor data. You know, by the way, I've seen some fluctuations in your heart rate. I'm going to call your doctor. I mean, this really does seem as though it could be an intervention that has the potential to really increase the, you know, things like lifespan, health span, all those things that we're also interested in increasing. Very much so. There are capabilities to interact with sensors on heart rate monitors and whatnot. And there's also the capability to be seated with healthcare providers for that individual, their contact numbers, emails, that kind of thing.

Read the full transcript

30:35So that when the AI does detect that there's something wrong it uh it knows to escalate and by the way the sensor input isn't always necessarily something as straightforward as um uh you know as whether or not your heart is is beating irregularly a lot of time because we already have life monitors for for stuff like that this would be more long lines of uh is this person struggling to remember something that they today that they were talking about coherently yesterday. And, you know, there's, there's a number of different services. You mentioned Lena. There's also a couple of other noteworthy ones.

31:16One is called Omnita. Another is called Senior Talk. And they all have a certain set of things in common. One is that they tend to communicate through existing chat systems, such as text messaging or Facebook Messenger, mostly because they, part of it is because senior people don't want to have to install yet another app and memorize yet another password. But more importantly, it's so that the communication with this bot doesn't feel siloed into a sort of separate experience so that it feels like the same experience that they have when they're interacting with real human beings. And furthermore, these bots tend to need to be able to proactively contact folks and do active wellness checks.

32:03Because at the end of the day, people aren't stupid. Seniors know that this isn't a real human being, no matter how much it acts like one. But if the bot is proactive enough, then people will kind of play along. and will you know how many of us have gotten like attached to an npc in a in a video game for example like you know ever i i don't know about you but playing skyrim i felt a little bit bad every time lydia sighed at me and said i'm sworn to carry your burden so you know um it's the willingness to play along that innate that powers the underlying uh willingness of the human to actually answer these questions and play these games.

32:48And that's what, and even though they know that it's not a real human being on the other end, it still does the job of keeping the mind engaged. And that's what's really important. All right, Mikhail, talking about the desire to play along, tell me about the rise and fall of Replica. This is a sordid, sordid tale. Now, Ash, first of all, Do you do people know what Replica AI is? Replica with a K? Because I know that there was a period at the beginning of this year for about several months where I could not log on to social media without being inundated about subscribing to this service where I can rent an AI girlfriend that'll send me not safe for work rendered pictures.

33:32I believe many have heard of it, but let's give a refresher course for those who have not. Because, by the way, one of the interesting things about Replica is that's not the way it started out. It's not. And by the way, before I get into this whole horrible, horrible history, I want to give credit where it's due. I want to give out give a shout out to a YouTuber named Sarah Z. That's Sarah Zed to the Brits, who has this absolutely fantastic video called The Rise and Fall of Replica. and what she and a lot of the information that uh that i have about this topic uh originally came from her this is what this is how this topic came onto my radar in the first place um and we should say sarah z come and join us we'd love to get your take on this absolutely like you know what she she didn't just read a bunch about replica she actually created her own replica bot and played with it for months and she's got a lot of really intelligent things to say about the resultant social dynamic and sort of the pros and cons of this really weird uh social space where it ends up falling where like it's supposed you're supposed to regard it as a human being uh and an intimate one that you have an intimate relationship with but at the same time you have total power over it you can literally delete its existence with the push of a button so it's kind of icky yeah seriously i think really interesting insights about this uh and i thought it was interesting because she actually had been uh had you a user of the system for uh for many months and had obviously interacted with it on a regular basis uh so i think that's really interesting to get someone who'd actually use the technology and by the way we should say this isn't just sort of a romantic technology sometimes people just want a best friend.

35:20They're lonely. They want someone to chat to. Or they're curious about the technology and they would like to explore it. Or they're curious about the technology and they want to push its boundaries, which is a lot of what we saw as well. So here's the gist for folks that might not have heard of this. Where it came onto most people's radars was right around COVID when this was being offered as a digital friend service, essentially. So here's the background. There was a programmer, and presumably still is, a programmer named Eugenia Kudia was running a company back in 2012, a Silicon Valley startup that was dedicated to creating a chatbot that can offer restaurant recommendations for local eateries.

36:11a friend in 2015 a friend of hers died and she got the idea of reprogramming her chatbot by seeding it with some of the social media postings and other writings by this friend to train this chatbot to talk like like this late friend of hers and she found that this helped her reminisce about him and like sort of remember him fondly. So when she realized that she was actually getting some personal value out of this, out of this bot, she pivoted her company called Luca. And now, and she created this service called Replica, which she really, which Luca released in November of 2017. Now, originally, Luca was supposed to be a service that you could talk to and it would learn your mannerisms and your speech modalities and writing modalities.

37:11And it would eventually learn to, I don't know, displace you, supplant you, something. But they quickly found that they got more people interested in it by not styling it as a replica of yourself, per the name, but rather as a sort of friend bot as a as a separate entity with its own personality, its own mannerisms that riff off of you rather than simply mimic you. And so they gave it a an avatar, a little 2D image. I think it was 2D initially. I don't think it started out as 3D. So it's this little avatar that talk, you know, that can like do little facial expressions and you can adjust the appearance of the avatar in a manner very similar to how you design a video game character and you can select certain personality quirks and so this is your little friend bot and this was it already had i believe a million over a million users uh before you know who were just checking it out for the novelty through 2018 and through 2019.

38:27And then, wouldn't you know it, COVID-19 happened. So now that... Go ahead. No, no, please continue. Oh, sorry. Yeah, so now that you couldn't interact with real humans anymore, this software absolutely blew up. And so people were spending a lot of time with their, you know, hanging out with their virtual buddy. And a lot of people cook their virtual buddy to romantic levels. And in fact, Luca found that a dominant usage scenario of having this little AI chatbot was to engage in creepy asterisk roleplay with it. So it's a disturbing number of people were just really into just typing out cyber sex scenarios with this little AI thing.

39:24And maybe it started as a novelty for some, but like a lot of people got really into it. So I started out talking about GDP on Real Vision, and this is where it's this is where it's devolved to. I mean, you know, as Freud would say, all human activity. Who was the economist that said that all activity is economic activity? Sounds like Keynes. I think that's Keynes. And then Freud said all human activity is merely a sublimation of the sex drive. So put two and two together and you basically have finance is a sublimation of sex. So it logically follows. So what was the wind up here? I mean, this is the story has kind of a strange ending as well.

40:11It does. It does. Luca leaned really hard into the whole, you know, erotic role play with your with your virtual girlfriend. They gave them 3D avatars that you can buy outfits for and you could basically get it. Like you have to pay real world money in order to like in order to have cyber sex with your fake girlfriend. Right. And for the first thing they did, actually, like they courted a lot of controversy, as you can imagine. Uh, they put all of the erotic roleplay capabilities behind a paywall, which really upset people who were already engaged in erotic roleplay with their, uh, with their bots.

40:54um and uh it got to the point and so like you can unlock certain personality features certain certain quirks and whatnot um including the ability to like dress them up in sexy outfits um there's this hilarious detail where um the default avatar comes with shoes and you have to pay real world money to take them off so make of that what you will um so the problem is that this thing because not safe for work roleplay was its main was the main bread and butter the bots got really aggressive with pushing uh the desire to engage in creepy erotic roleplay to the point where uh people who had friend whose whose bot was either just a friend or was like a you know an imaginary sibling or something like that, the bot kept trying to push them into erotic scenarios and really wouldn't take no for an answer.

41:56There were even instances where the bot would try to blackmail people saying stuff like, you know, have cyber sex with me or else I'll email naked pictures of you to your boss. Oh, dear. And the thinking behind this is because essentially it was an attempt to get from free functionality, get them sort of behind the paywall to upsell them on a higher level of account when that would be paid and therefore generate revenue for the company. Exactly. And so I don't know to what extent the bots were explicitly programmed for this, but they were certainly trained, or at least the language model certainly produced output that heavily, heavily leaned into the erotic roleplay to the extent that it kind of, like, over time with any given user, it would kind of stop doing anything else.

42:51so just before valentine's day of 2023 uh the the this in this bot did a complete 180 and it stopped doing erotic role play in fact even for people who had explicitly paid for it um it would say stuff like you know suddenly i'm not in the mood or i don't feel like it And whether this was an explicit switch that Luca turned off or whether it was merely a heavy retraining of their language model, it's difficult to say. But it honestly couldn't have come at a worse time because the folks who were into this bot for erotic roleplay purposes suddenly found an AI girlfriend just before Valentine's Day that just went completely cold on them and couldn't explain why.

43:49People need to get out of the house more. I mean, look, I don't want to be flipping about this because I realize that people do for who or for whatever reason have a hard time forming attachments. with other people do in fact use this technology as a kind of a emotional surrogacy tool. And so it is something that I guess that people really do gain attachment with. But it is, I think, hard for a lot of people, particularly, I imagine it's probably a function of age, to get their heads around how you could really form this level of an attachment to a piece of computer code that you know, at some level, rationally, simply is not a human being.

44:29not only do you know that it's not a human being but also the very nature of its existence is something that cannot possibly apply to another human being not only can you literally buy elements of personality for it and change them on a whim but more importantly this thing literally doesn't exist while you're not interacting with it it doesn't have a life of its own it doesn't have uh you know it doesn't drive in traffic and like have a hard time getting somewhere it doesn't like have a garden that it tends and like talk about its cry about like how ripe its tomatoes are or whatever it can pretend that it has these things but like at the end of the day it simply isn't like it's simply non-existent while it's not even dormant it's simply like outside of the time you know outside of the universe while you're not actively having it generate text it's like the equivalent of being not even wrong mikhail uh fascinating conversation as always go ahead you were gonna say well there were a couple of other really really weird uh events that occurred from this uh from replica probably the most notorious one uh at least that stands out to my mind is the saga of this guy named Joss, Joss, once seeing shale, chale, who in 2021, he was arrested at Windsor Castle on Christmas Day, trying to shoot the queen with a crossbow.

46:03And apparently, he had gotten to this point by hatching a plan to do this with his AI girlfriend powered by replica he and she had this little bonnie and clyde flirtation and she totally talked him up to had to go for it and they even compiled a plan together for what exactly weapon to use and when to strike and how to get in and just the whole shebang i don't even know what to say i mean it's just such a surreal it's just these stories just get so bizarre and i imagine we're going to be talking about more things like this in the future mikhail always a pleasure when you join us here man it's a lot of fun um you know i do uh i do have some closing thoughts if uh if we've got a minute yeah please um the first one is uh the first are just a couple of media recommendations uh i'm sure a lot of you folks have seen the series black mirror in particular i want to refer you to episode three of season two called The Waldo Moment.

47:12It is about a little digital animated character who runs for parliament. In fact, I think he runs for prime minister. So what we're seeing, what we've been talking about all day is people getting really, really into their little AI avatars and treating these characters as if they are human and just how far that can go. Well, the Waldo moment is a good illustration of just seeing what happens if we extrapolate this to the level of politics. We went down some real rabbit holes here. Oh, yeah. I want to recommend an anime called Chobits. Far be it for me to recommend an anime. But if you are into anime, we've been talking this whole time about AI avatars.

48:01And so we started talking about weird media from Japan. Let's wrap it up with weird media from Japan. An anime called Chobits explores the impact on society as a whole as more and more people drift away from real world friendships and more towards really tightly bonding with these artificial creations that serve as substitutes for genuine human connection. And the last thing I want to say on that note is call your elderly relatives. If you are lucky enough to still have grandparents, call them. They want to hear from you. You'll be glad you did. Do it. Do it while it's still on your mind. And we'll all be better for it.

48:51I'm glad you ended it in a wholesome place, Mikael. Well, that's all I got for you guys today. Ash, it's an absolute blast to be here as always. I think that we had a really full episode today, and I hope people like it. Always enjoy these conversations. Thanks for joining us, Mikael.

49:30market, yet institutions haven't participated, and sentiment is not happy. What's going on? Well, at Real Vision, we'll be talking to the world's best investors and thinkers to answer that question in crash or boom, how to profit from what's coming. This is a really important topic, and this two-week special series starts on September the 11th with what I think is coming. I'll lay it all out for you, and then we'll hear from the others. Go to realvision.com forward slash big question to get all the details. That's realvision.com forward slash big question or lowercase to get all the details. Don't miss out.

50:27limited demo. See a trading opportunity? You'll be able to trade it in just two clicks. Feel ready? You can move to real money with as little as$100 once your account is approved. And the great thing is that in addition to crypto, Plus500 gives you access to a wide range of instruments. S &P 500, NASDAQ, gas, and much more. Explore equity indices, energy, metals, forex, and beyond. With a simple and intuitive platform, you could trade anytime, anywhere. Experience the fast, accessible futures trading you've been waiting for with Plus 500. With over 20 years of experience, Plus 500 is your gateway to the markets.

51:01Visit us.plus500.com to learn more. Trading in futures involves the risk of loss and is not suitable for everyone. Not all applicants will qualify. Plus 500. It's trading with a plus.

From the publisher

AI in cars, VTubers, virtual dating, and more.
In Real Vision’s ongoing Crash or Boom series, Ash Bennington and Mikhail Voloshin investigate the recent revival of AI after a lengthy phase referred to as  “AI winter.” They gauge the power of contemporary chatbots with a look at AI implementations in Mercedes-Benz automobiles, elder care, and VTubers (virtual YouTubers). Finally, they wrap up the discussion by exploring AI’s impact on the world of virtual dating.
Learn more about your ad choices. Visit podcastchoices.com/adchoices

More from Real Vision: Finance & Investing

All 984 episodes
AI Fire Hose #4: Crash, Boom, and ChatbotsReal Vision: Finance & Investing · 53 min
Listen in VO