AI Demos: Big Drops This Week from OpenAI & Google | E1950

0:00let's cover what they really launched this week. And then we'll do a demo with some of their latest stuff. They launched a desktop app, ironically, a Mac app before a Windows app, given all their investment. A minute ago, you were showing me the charger. It can take a screenshot, actually, right? And here you take this and you see this. It can take the screenshot or you can take a photo. Photo file, yeah. Yep. So I said, can you explain what you think is going on here? Let's see what it says. The image appears to show a video call between two individuals. This person in the top frame is holding up a device, possibly explaining or demonstrating to the person.

0:33He looks somewhat confused or concerned. That's typically how I look. It could be a virtual minute of tech discussion, perhaps a product demonstration. Yeah, I mean, it knows what's up. Yeah. So that is, yeah, kind of bonkers. This Week in Startups is brought to you by LinkedIn Jobs. A business is only as strong as its people, and every hire matters. Go to LinkedIn.com slash twist to post your first job for free. Terms and conditions apply. Eight Sleep. Good sleep is the ultimate game changer. The newest generation of the pod, the pod for ultra, has arrived. Head to EightSleep.com slash twist and use code twist to get $350 off the pod for ultra.

1:19And Hidden Layer. Generative AI is revolutionizing industries. Hidden Layer's AI detection and response solution secures your generative AI and LLMs from malicious attack, helping you generate more by enabling seamless and secure generative AI. Visit hiddenlayer.com slash twist to learn more. All right, everybody, welcome back to this week in startup. Sandeep Madra, Sonny, my guy, is here with me, and we're going to do AI demos. It's been a huge week. you're going to want to get a notepad out or your chat gpt assistant and you want to take notes because we have a ton of demos to show you today welcome back to the program sandeep madra from grok formerly definitive intelligence which was purchased by brock which you can access at console.grok.com if you want to be one of the 250 billion developers who are working on it now it's 150 250 some great number 175 000 it's a lot of devs okay let's get right to it we know open ai did their big reveal on monday after sam altman was on all in and didn't tell us uh and he had all this stuff launched actually true story he was i think um he had told freeberg that they had some stuff to demo but then that they pushed it back so that was our mistake we should have rescheduled him so that we actually had the demos but we'll give you the demos right now yeah did you see the discussion with him on all in i did i thought what do you think i thought it was really really good okay i think he got trashed in the comments and online i was kind of saying anything what do you think of that feedback people were upset that he didn't say enough i think like the people that watch all in are always expecting you know something big and you know he said three or four important things here's what i'll kind of say he said the next versions of chat gpt may not be numbered or gpt may not be numbered right that's big that's big he talked about the story of what happened right and gave information he had never given before that was one breaking news story the second breaking news story was that all of these projects like the chips and the phone were part of open ai well that's where i was gonna go i never told that to anybody and he was like yeah well i mean nobody asked me and i was like well okay well i just asked yeah and i thought the third thing that was breaking news was what do you think it was was there anything else you thought was kind of breaking or new for you the story of how he got fired yeah like he was at the f1 yes and he got the call and then he sat around for a bit then he became okay with it and he was flying back like just that whole story was pretty good what else are people looking for well and then also the stuff he talked about with uh inference and training data versus and copyright i thought was really revealing the fact that he wasn't going to touch music and that he respected people's copyright he'd never talked about it in that kind of detail so that's like four or five pieces right there yeah i think people might be mistaken his general and i guess i've heard two different versions of this like cynical people are like he's not being humble he's being aloof or evasive and holding his cards close to the chest and you know maybe i guess the most cynical interpretation was he you know he's being uh sly or something and then on the other side people are like he's being humble and he you know doesn't have all the answers and he's trying to explain that and then some people are like it's both he's always being fake humble like he actually knows what he's doing and you know all this humility is like he's a james bond villain and i was like i don't think he's a james bond villain i do think he's figuring it out i've known him for a long time and yeah i do think he's actually pretty calculated but another word for calculate is thoughtful or strategic so anyway i don't like you guys you could have kept it you know and the reality was you know some of the videos we're going to pull up today because all that functionality is not fully released to the public they were recorded on the friday uh so the day before day after we tape we tape after you guys tape because in some of them people are asking hey what day is it it's like oh it's may 10th right so got it um i think that was the issue is that they were still working on it again working on it yeah yeah okay let's get right into it then great job uh breaking down the all-in episode great job for freeberg for getting them on the pod i don't have any problems with it so let's get started so many uh different ways to start here and i'm curious where you're going to go first let's cover what they really launched this week and then we'll do a demo with some of their latest stuff right so here we are on the open ai youtube channel and if you're not watching go to our youtube channel this week in startups on youtube and i'm going to pull up the ones that are kind of novel because you know there's a bunch here and some of them we've seen before like you know there's a demo here where someone makes it count this gentleman makes it count then he makes it count slower and faster which is actually very hard to do technically but you know it's not that interesting a dad joke you've probably done this a hundred times well i thought the going faster and slower on the counting where he tells it hey can you count faster and it counts too fast so somewhere in between that actually is something that i think it does need to understand so it doesn't feel like and i talked about that on all in with sam altman was right now when you're talking to it it feels like cb radio where i'm like can you talk slower over and then the other person can talk but if you try to talk at the same time i do think they're teaching it to be interrupted can you count from one to ten for me please?

6:48Of course. One, two, three. Hey, actually, that's a little slow. Could you count faster? Sure thing. One, two, three, four, five, six, seven, eight, nine, ten. Okay, that was a little bit too fast. Can you count somewhere in between those two? Got it. One, two, three. And now even slower please okay one two okay we get it we get it i think it's important you know that the interface for voice works because when you use siri we all know when you use siri it's like you're giving it one command and you're waiting 30 seconds 60 seconds for that to get deployed and come back to you it just kills the whole experience totally does so yeah i think the ability for it to understand and adjust itself, which we hadn't seen before, is a really big new feature.

7:43One of my favorite ones, which I hope a lot of people start using, was math problems with GPT-4. I'm just going to start it. And this is Sal Khan. Yeah, Khan Academy. Yeah, so I'm going to just start with this one. OpenAI invited myself and my son Imran here to try out some of their new technology. And so we're curious about how good it might be at tutoring someone in math on Khan Academy. So let's get it started. It's loading up. So it's loading the iOS app, correct? On an iPad? Yep. Actually, in this form. Hello there. I'm here with my son and I'd love you to tutor him on this math problem, but don't give him the answer.

8:25You can ask questions and nudge him in the right direction, but I really want to make sure he understands it himself. And he's here in the room so you can talk to him directly of course i'd be happy to help let's look at the problem together can you first identify which sides of the triangle are the opposite adjacent and hypotenuse relative to angle alpha all right so we get the idea here and so i think again this is really important because they've done two things They've made it such that it can look at your device screen. Right. So the app, just to make this crystal clear for people, the ChatGPT app is open.

9:09It's taking up about a third of the screen. The other two thirds of the screen is like a drawing program where they've drawn. I think it was on Khan Academy. It was just a website. Yeah, it was just a website. So it's on the webpage. But it's seeing what you're seeing on that webpage. So it's asking to read your screen, which is something that's allowed in iOS or on your desktop now. So it's watching what you're doing. therefore it's kind of the guide on your side and it's there and it's being able to watch the screen and then help you which you know for me sal khan has a very famous ted talk where he talks about you know two sigma and basically what that talk is about says if you give any student at any level a tutor they improve two standard deviations two sigmas and so imagine this now available for free for anyone on the planet to use.

10:00Pretty awesome. Now we just have to get them off TikTok or Fortnite. Yeah. And everybody on the planet's going to be, you know, yeah, two years ahead in math. Hey, founders. Hey, startups. When you're hiring for your small business, you want to find quality professionals who are right for the role. But I understand it can be tough to find the time and resources to find that perfect hire. That's why you want to check out, you guessed it, LinkedIn Jobs. LinkedIn Jobs gives you the tools to find the right professionals for your team faster and for free. And LinkedIn isn't just some simple job board.

10:32It helps you hire professionals that you cannot find anywhere else. There's over a billion members on LinkedIn now, and they're in more than 200 countries. And I know many of you are leveraging different time zones to get work done, different geos to find talent. And LinkedIn is the best place to get eyeballs on your job posting. You know that. Even those who aren't actively searching for a job will see your ad. Why? Because LinkedIn knows who might want your job. You know, they got a lot of AI, machine learning going on over there. So even if they're not actively searching, they're going to see your role.

11:01And you know what? Those are some of the best candidates. And did you know that 70 % of LinkedIn users don't visit the other leading job sites? If you're not looking on LinkedIn, you're looking in the wrong place. And the best part is when you use LinkedIn Jobs, 86 % of small businesses get a qualified candidate in 24 hours. So hire professionals like a professional on LinkedIn. LinkedIn Jobs helps you get the right people faster. And guess what? The first one's on your boy, J-Cow. Post your first job for free, linkedin.com slash TWIST. That's right, linkedin.com slash twist to post your job for free.

11:33Terms and conditions do apply. And so that is the truth. As we move on, and now what is your excuse for not wanting to get smarter becomes the question because not only is all the reference material on the internet, not only are there videos, now there's a coach that can walk you through those reference materials and do what's called adaptive learning. Adaptive learning has been something they've wanted to create on computers for a long time. And it's just been too hard because you had to manually hard code it. Here, a language model is doing the adaptive learn, correct? That is exactly it. And doing it at your own pace, it's not a person, you don't have to worry about their time and their tutoring, you know, cost.

12:15It's just the smartest, most powerful tutor in the world that can be customized to your learning level. And so while we worry as a species about AI taking all of our jobs and all this kind of stuff, AI is also going to make us smarter. Every single person who wants to learn how to play chess or do math or maybe cooking or play guitar, this thing's going to be able to watch you play guitar on your camera and tell you, hey, you know what? When you're doing that C chord, there's two different ways to do it. Here's some visualizations of that and just, you know maybe press a little bit more gentle on your fingers so they don't hurt and like this is stuff that a teacher would do and now anybody billions of people on the planet are going to have a custom tutor this is a plus yeah for me one more just along those i want to show what would you rate this one did you rate you want to rate this one don't rate it yet we'll rate the whole thing as a thing because otherwise we're going to end up with a lot of ratings here i like a lot of ratings okay i don't vote so here which is kind of going to your point um Hey, how's it going?

13:18You can see here he has a video open. How about you? I see you're rocking an open AI hoodie. Nice choice. What's up with that ceiling, though? Are you in a cool industry-style office or something? Well, can you take a guess at what I might be doing based on what I'm showing you here? Hmm. From what I can see, it looks like you're in some kind of recording or production setup with those lights, tripods, and possibly a mic, it seems. yeah so again we get the idea here the presenter has the iphone app running the latest version of chat gpt and it now has a mode where you can start a video a live video stream to it so it's not a picture anymore because we got used to that so he just basically opened a camera and he initially had the camera pointed at himself and it described him and what he was wearing and it got a little bit of the ceiling so i guessed that he was an industrial office and then he flipped the camera around and he had like a recording setup and it said oh yeah it looks like you're recording there's a lights and some cameras there so what is there a mode this is called is it called camera on mode is there a mode for this environment mode where do they call it i haven't seen this released in the app yet it's not in the app yet i looked for it exactly so my guess is like you know today you're you have the ability to give it a picture or you know audio or other things they're gonna to add a sort of like a record button and it's going to open up and it's going to create that recording got it so i wonder if it can turn on both cameras because i'll just call this environmental awareness mode environment awareness mode eam em so when you're in em mode environmental awareness mode it knows what's going on around you so why would this be important well if you had it in a your phone in a cradle let's say you know like i have a qui charger on my desk here yeah i'll actually show it to you so i have a charger you know like this from anchor so this is my anchor charger and my phone's on it right so if i had this and it was looking at me then i could uh if i was holding my guitar it'd be like oh are you looking to do guitar lessons and we would be skipping the step of me opening you know the app and saying hey i want to do guitar lessons because it would be aware of what's going on around me which i think is super powerful if there was this environmental awareness mode okay environmental awareness so it's kind of setting the context for you saying here's what's going on around if you were in the kitchen it would see that you're in front of the stove on your ipad in an ipad stand and it would see if it was tilted down all of the ingredients and it would see chicken and say oh you're cooking chicken do you need some help oh i see there's you know breadcrumbs and i see mozzarella and i see some tomato sauce are you making chicken parm like this is kind of like whoa just like a human might walk into your kitchen you know you might walk in and your spouse is cooking say oh you're making chicken parm that's kind of mind-blowing when you think about it just to understand the context of where you are what's going on oh you're in an airport are you looking for instructions of where to eat oh i see you're in tokyo oh you're in shibuya district oh i see you're in you know ginza are you looking for a sushi place i mean this is crazy when you think about it being aware of the environment around you and just how much friction that takes out of the world and plus sound you can also listen to sound right it can now yeah it's going to have that full ability to listen all the time and provide that context to you yeah chat gpt can now see hear and speak we're beginning to roll out new voice images capabilities in chat we offer new more intuitive type of interface by allowing you to have a voice conversation or show chat gpt what you're talking about voice and image give you more ways they don't have a name for this they should it's actually an interesting thing because people are saying hey maybe they should name it because they have all these kind of new functionality two more things i want to show this wasn't part of the release but we never got to demo this so i want to pull this up so one of the things that they've added if you go on your settings in chat gpt now yeah jason you're going to really like this if you turn on memory yes i have memory turned on yeah do you have it where it's starting to remember different things yes remember that i like this not custom instruction not i like things in a table we did that another time yeah but hey i've got a puppy and the puppy's name and you remember you know all these kind of little things okay that's another really interesting feature that they launched and you can ask it what do you remember about me correct and it will tell you what it remembers about you which is super cool so the last thing we're going to show from them and then we'll give them a grade on all these things is they launched a mac app desktop a desktop app iron ironically a mac app before windows app given all their investment yeah a minute ago you were showing me the charger it can take a screenshot actually right in here you take this and you see this you can take a the screenshot or you can take a photo file yeah yep so i said can you explain what you think is going on here let's see what it says the image appears to show a video call between two individuals person in the top frame is holding up a device possibly explaining or demonstrating to the person he looks somewhat confused or concerned that's typically how i look the background suggests a room musical instruments some posters correct the person on the bottom is listening attentively possibly involved in the discussion about the device he's wearing glasses and has headphones on earphones on with blurred background indicating a focus on his face it could be a virtual minute tech discussion perhaps a product demonstration yeah i mean it knows what's what's up yeah so that is yeah kind of bonkers now is it continuously monitoring what's on your screen and it does not have a mode i could not figure out a mode basically all i could see here is um you know pretty much this is like a chat gpt mac app it has the same mode of like you can go in with your phone app or it can be constantly going back and forth with you but it does not have a mode for continuously monitoring your continuously monitoring yeah yeah because that would be very interesting that if you and i recorded this whole episode and instead of just giving us a transcript and a summary it added the screenshots it annotated the screenshots and all of that you know and now you start thinking three months away they're gonna have that now that they have this they're gonna have that you've heard me talk about how great my sleep is sleep is a superpower and my superpower is eight sleep they've got the amazing pod that you add to your existing mattress it will cool you down or warm you up depending on which side of the bed you're on i like it nice and cool I sleep deeper.

20:01I am a sleep king and you might be a sleep king or queen too. And you can be one if you get the Pod 4 Ultra. That's right. Pod 4 Ultra is out and it is definitively the greatest tool for helping your sleep. Pod 4 Ultra can cool down each side of the bed to 20 degrees Fahrenheit below room temperature. It's a better cool than the air conditioner. So I can put the air conditioner on a reasonable temperature and then keep my Pod Ultra even a little bit cooler than that. And they also introduced an adjustable base that fits between you and your mattress and your bed frame. So you know when you want to read and your partner wants to sleep?

20:35Well, now reading and sleeping positions are right there to help you unwind after a hectic day. You can even elevate just a few degrees automatically to help with your snoring if that's one of your challenges. Not only that, it has sensors that will track your sleep time, all the phases of sleep, your HRV, and your heart rate. So it's basically a wearable that you don't need to wear. I think I get like an extra hour of deep sleep every night because of it. I'm coming into the game with good energy. So here's what I want you to do. Get the sleep you deserve at eightsleep.com slash twist and use the code twist to get 350 bucks off of the pod for ultra currently shipping to the US, Canada, UK, Europe, and Australia.

21:15I love this product so much. I designed it to invest in the company. Well, now imagine we're on a call and it's researching it, or let's say we were taping an episode this week and started and said, Hey, you know what? Give me all the links for the show notes and write a blog post about it and post it to my linkedin and put it in my drafts folder it could make like a whole blog post an email newsletter and you can say and tell us what we got wrong or give us suggestions for future topics for the podcast i mean this could be really powerful it could be like a virtual um podcast producer watching you work or if let's say i did five meetings with startups today and i had two meetings with the investment team like i say just give me a summary of the day and what i got accomplished and it was just sitting there and it was doing that and then you're like and you're like oh you know what remember during that meeting so and so was saying this yes about yeah what was it again exactly you could be like hey is there anything i forgot to put on my to-do list yes and it would just go back and be like yeah you know you did mention the to-do list seven times last week or this week here are the seven items and here's the video clip of it i already put them on your to-do list so like just listen to my entire day with to-do lists or just be listening and you and i are just sitting there working and i'm like you know what remind me next week to do this and those kind of things exist in task management software there's a to-do list but a persistent assistant listening to you is a whole different level of power yes that you could have and i've actually um i'll just mention it here on this podcast so i invested in a company called athena you can go check out athenawow.com and what it is is it's assistants, like real assistants, but they're based in the Philippines and they're about$3 ,000 a month.

22:53It has changed my life. And so I will have this real world assistant, which costs me only$36 ,000 a year. I'll sometimes have her on Zoom with me, with my desktop up, showing her what I'm working on. And she's learning what I'm doing. And then there's this learning - There's a real life person. There's a real life person. Okay. And so we are in the process of documenting and learning everything. And I think there's going to be this merger between like my EA in Manila, who works with me for, you know, eight, nine, 10 hours a day and this. And if you go to Athena, W-O-W, Athena, wow.com, they'll let you jump.

23:31There's a wait list to get on this thing. If you talk to any CEO in Silicon Valley, they're using this because it's hard to get a personal assistant. And they're, they basically skim the cream of the top 0.1 % of knowledge workers in Manila. um and it's by the same founder who did thumbtack and so you'll get like uh 1500 off if you go to athena wow just and there it is boom i was the first investor in thumbtack and i'm the first investor in athena so go to athena wow and you'll see uh yeah and uh it just will make you so so efficient and then you add this to the mix that my assistant plus this virtual assistant would be sitting there you know collaborating on stuff and that's what i'm really trying to do is i think the feature you talked about yeah it's so killer right because think about you know zoom has this feature now right where you can come in and you can do all that but you know what's with me is not zoom all the time but chat gpt or you know take your pick of whichever one you want to use so to be able to recap the day how how powerful would that be insane yeah especially because then i was sure my athena assistant and then she would nikki would be like oh okay i watched your day i watched the recap of your day and i guess i just give she'd be like give me a 10 minute recap of jason's day and wow yeah okay let's keep going awesome okay well let's give them a score because we're done i'm gonna i'm gonna um you told me not to but i'm gonna do this anyway i think the persistent app watching what you're doing is a plus plus plus the fact that it exists and it works and it's doing this right now is the game changer of all game changers and i know a lot of people were thinking about like monitoring desktop and doing stuff but this thing's out now so this is like one of the best things i've seen in ai to date because it's closing the gap between like a toy that gives you you know hallucinations and like some you know basic web research to not watching your behavior um i think the ability to talk to it better i give that a b like the the speed which is doing it but the the contextual awareness of your environment and watching us work that's an a plus feature for me yeah i'm i'm in the a category as well for some room like we don't have all those features yet but like we're close now yeah i mean this it was a great release yeah yeah is it any better like is the model any better or is this just new features yeah existing no no the model is faster which is important right obviously we spend our time thinking about that so they've made it they've made it a lot faster which is good it's low latency but the important thing about the model is it's truly and they call it omni it's truly multimodal so a lot of times you see some people doing voice and images and obviously llm type stuff and what that's typically been is what's called kernel fusion kernel fusing but here they trained a model from scratch with all three of those things so it's not three different models that they kind of fuse together it's a model that was trained on text on video and on audio so that is you know some underlying underlying technology uh that i think you don't see in the interface explicitly but if it is listening and watching you you know that's what the o is for the o is for omni so exactly and the omni means audio visual text all in real time at the same time time and it knows how to move between those which is kind of incredible yeah and so with the mac os app yeah you just can open it up and boom uh and also on the desktop app you now have the voice conversations it's only for plus subscribers which i'm one but i don't see it here so i think i have to get it turned on or something twice as fast for 50 less cost for businesses i think just talking about a big picture the costs are going to continue to plummet on this thing and they said they want it to be free for all users and he wants to give everybody access to this so is it now free for chat gpt4 on the website like if you're not logged in i noticed that everybody is now starting to let people use these services when you're not logged in.

27:51Did you notice that? That you can start playing with these? So it used to be you had to be logged in. So I just launched a private window. And if I type in ChatGPT, I can ask it a question. Hello, what can you do? Yeah. And in which model? Yeah, that's ChatGPT 3.5. And then if I... I think you can change it to 4.0. You have to... For 4, you have to log in and create an account. Oh, you do. Okay. But the point is, it does seem like there's a path here. But I think for ChatGPT 4, not omni i don't think you have to pay now so it seems like they're going to it's almost as if whatever the last version of microsoft office was would be free free the new version is paying so that's kind of an interesting model it goes back to their non-profit roots i think what's going to happen is when we talked to sam altman on the all in podcast last episode i asked him about ubi and his experiments there and he said he wanted to give a certain amount of compute ai or ai resources to people that seems really interesting i think open ai maybe part of their mandate is going to be to make all this stuff free so while they have a paid version whatever the most recent is is paid so you get a little bit of edge so maybe like this year's version you have to pay for but last year's version everybody gets for free unless your version shouldn't cost them that much to service because inference and everything's getting cheaper and they'll have optimized the model.

29:13So it's expensive to serve up chat GPT 4.0, I would expect, right? So Omni is going to be expensive. Yeah. And 3.5 is cheap, right? What would you say the difference in cost is in a multiple for them? Well, in this case, 4.0 was a very specific, it's actually cheaper. It's half the price. Listen, we all know generative AI is revolutionizing every industry. In fact, we talk about it here on this podcast every week. And companies that or slow to leverage this technology, well, they're going to risk falling behind their competition. But new innovations also bring new threats. How do you safely accelerate your company's gen AI adoption while also managing the risk?

29:51Well, let me tell you about Hidden Layer's AI Detection and Response Platform. It's a security solution specifically designed for generative AI and large language models, LLMs, you know that. It provides your security team with visibility and tools necessary to detect and prevent threats, like leaking of confidential information. We've well as malicious prompt injection. That's a serious threat. And model theft, right? People are starting to steal. That's just the truth of it, folks. People will steal your innovations. That's going to enable your company to harness the power of AI and to do that securely and confidently.

30:26It's trusted by leaders in finance, tech, healthcare, and even the U.S. Department of Defense, the DOD. Hidden Layer helps you generate more by enabling seamless and secure generative AI. So here's your CTA, the old call to action. With Hidden Layer, go from pause to possibilities and step into the future of secure AI innovation. Learn how to protect your generative AI today by visiting hiddenlayer.com slash twist. That's hiddenlayer.com slash TWIST. There's a couple of interesting intersecting forces here. Let's just talk about them. People have been saying, and I'm not in agreement, that models will keep getting bigger.

31:03okay i feel like the folks that have been saying that are trying to do it as a moat because the models get bigger becomes harder and harder for anybody else to enter that but as the models get bigger they become way more expensive to run so it's also it's also like a perverse incentive as in oh let's make one that's twice as big as gpt4 well then it's going to be twice as expensive to run right so yeah i think what we're seeing now is tech usually gets more efficient not bigger and more expensive okay and so we may see a bit of a shifting landscape here where future models are actually cheaper to run than older models right older models become worthless so that's what it really it's not working for them czar hold on let me i have to really grok what you're saying with a cube with a cube grok with a cube if you make a new model they're becoming so much more efficient that the new one has better gas mileage than the last one but not just better gas mileage like 100 miles per gallon instead of 10 therefore if i gave you a new car and it was 100 miles per gallon and your previous one was 10 miles per gallon you would stop driving the one that was 10 miles per gallon because you'd make up the cost so quickly yeah so in other words all these previous models are going to get thrown in the garbage they are depreciating super fast like I can tell you from our experience at Brock, the day Llama 3 came out, 48 hours later, we deprecated Llama 2.

32:32We just took it off the site. Everyone moved over. And we can see the prices right here. Producer Court will pull them up. The pricing is plummeting. What is the pricing trend line here when we talk about this, Sunny? Talk about pricing. GPT-40 is 50 % cheaper than GPT-4. Okay. Where GPT-4 was$10 per million tokens input and$30 per million tokens output, it's now gone. If you scroll back up a little bit, it's gone to$5 and$15. But just to let you know, open source is still cheaper. Okay. Open source is$0.60 per million tokens input and$0.80 per million tokens output. Okay. So that's a fraction of that.

33:14Yes. And the open source ones hosted are that price, right? Yes. And look at where the original GPT-4 was,$120 and$60. Okay. So$120 dropped to what? $120 dropped to$15. Over what time period approximately did that happen? So GPT-4 came out last March. Okay. So in a year? Yeah, year and a month. So you think that these things will get 90 % cheaper year over year? I believe so. So that means over two years, it'll be 1%. So every two years, it will be 100 times cheaper. But we're going to use them 100 times more. Now, think about all the stuff we did today. And if it's running all the time, it's not viable to pay that much if it's listening to everything you're doing.

34:04Because we're entering a world where before it was sort of limited interaction, you're typing some text, you're doing it. Now we're talking about a world where it's recording you all day long. so what you'd have to do is say you know what record every word i say because that's just going to be 10 hours of audio and maybe i only talk for two hours of the day so it's two hours of audio but take a screenshot of my desktop every second means 60 seconds uh let's say 600 minutes 3600 screenshots or something like that processing 3600 screenshots that doesn't seem that expensive yeah it adds up it adds up now and especially if you were going to record video you would need at least i don't know how many frames per second but typically 30 frames per second maybe less maybe you could do it in 10 skip around you know film is 24 frames per second so yeah you know you probably do it uh zoom obviously does less maybe like 10 or 12 would work so interesting what's gonna happen is we're gonna be processing a lot more data with these um you know with these technologies which is good have like a they should have you know i have this um portfolio company that i'm really enamored with it's called recall and let me show it to you here and i'll get your view on this this company and i'll actually i'll get you to give a letter grade hold on let me just share my screen oh a jcal demo a little jcal demo here of this company recall um because i know that you like this category this is called recall so here i am on a youtube video right um and let me just go to the open ai page here okay here i am on open ai and uh here's that one we just played right but i will click on recall here you see it's doing its work and it's recalling this page it's analyzing parsing the data of this youtube video and then it gives me a summary of the youtube video and then i can save this and then when i save it it saves it to my knowledge graph and then it automatically is building a knowledge graph for me of all this stuff and yeah um then i can click on knowledge graph and i can see the all-in podcast i can see open ai say hello to chat gpt4 and i can start to move around and see what are all these here's universal basic income right which is the ai we're just talking about universal basic income here's the ubi page and this came to it because we were just on i have the all-in podcast on here from youtube and these are the themes that when i come to my knowledge graph you can see here are the themes all in conversation with sam and here's what came up here's google masayoshi san i mentioned stripe i mentioned peter teal uh sam altman wow and that's berkshire hathaway y combinator really from my introduction here's ubi and then you see ubi can go out and here's chat gpt and here's open ai and i've only put a couple things in here but as i add stuff here like if i were to do a search for uh ubi experiments and find a video about a ubi experiment right south korea's ubi experiment here then i add that to my recall and this is a company we've invested in we incubated so now it's discovering the connections it's summarizing the main ideas boom it's going to put it into i'm saved it into my um knowledge graph now when we go back to recall it now has that one here do they do it via the youtube transcripts or like i don't know but here we go now if i find ubi here's open ai and when i find that ubi one eventually there's dolly overton window and at some point you'd be there's ubi it's going to have for ubi you know the two or three places we talked about it and i can expand the card thing here right and uh see more things related to it you get the idea yeah so what i asked them to do was to monitor every single web page that i visit in recall and they said that's too expensive and i said well how expensive they said it would be like hundreds of dollars a year and i'm like charge me a thousand yeah i would pay for that give i mean come on what are we talking about here if you're a business executive let's you know you know where i would pay for that jay count get recall.ai you would pay 10 000 a year a thousand a month you pay a thousand how many times i've been to a tweet and i forgot to like it or do and i can never find it again and it's like i really need it for something oh my god rate that uh startup that we just invested in what do you rate that get recall i'm gonna give them a b perfect yeah i give it a b right now and if they had the feature where they did everything i would give it an end yeah you know chat gpt will have some of these features but i do believe as we look at this space that dedicated products that are gonna you know that have features and interfaces for a particular vertical bookmarking and knowledge graph writing a screenplay and doing storyboards doing math like it's just going to enhance those things so you'll have chat gpt underneath khan academy you're still going to want to go to the Khan Academy website, I think, and have like a full experience there.

39:14I think those things are still going to exist. Exactly. What's not clear to me just yet, because there's so much happening right now is, and, you know, what's really kind of got me thinking a lot is, you know, we're going to get into the next set of demos. But what we just finished with is if I have that Mac app and it has now access to everything and then I do something on my phone, it has access to a bunch of things. and then the flip side you know one of the things google did today or yesterday right when google i o was on they talked about um the generative experience being part of their court search engine so everything you're doing from that and as part of the browser gmail youtube they're going to have their own knowledge graph wrong oh and in chrome okay wow so here it is the your everything you do is going to be surveilled and inside of google or open ai pretty scary and insane if that got hacked but i guess the benefit is the language model know everything about you but at some point the fbi could come or a quarter or come and say hey tell me everything you know about sandeep and it'd be like yeah we know sandeep likes these websites and really likes this actor and watches these tv shows listens to this music i mean it's kind of crazy when you think about it yeah they It's the end of privacy.

40:30They could get that from your search history, but if you go in Chrome right now... If your search history is on... For Google, it wasn't even on, and they were still doing it for some people. They got in trouble for that recently. They got in trouble for... What's that mode called? Incognito mode. The big joke inside of Google was incognito mode was not incognito. But Chrome has helped me write built in now. Oh, wow. You can create custom images. You can organize your tabs in a smart way. so they're already starting to add the high level ai features amazing so help me write is like grammarly inside of chrome that's interesting yeah so yeah i do think like i wonder um i love grammarly but i think like 60 70 percent of grammarly will be built into other products so grammarly is going to have to keep figuring out what unique features they can add for writers that aren't going to be in like sort of native products.

41:26Yes, exactly. So, you know, it's an entire journey that's happening very quickly. I do think like you will be able to build apps that are 10, 20, 30, 40 % better than whatever is in these, just like ChatGPT keeps making things that are 20, 30 % better than what's in another person's model. So you just have to keep adding features and listening to your customers. Okay. All right, talk to me about Google. So Google, Google at Google.io, A lot of things talked about there from developer stuff, which is at the core of what they announced on the developer things, which we won't bring up right here.

42:01They've expanded the context of Gemini to 2 million. They launched a new AI chip as well, which is awesome. And they're continuing to make more services available within Vertex. From a consumer standpoint, we're just going to talk about a few of the things that they've put out. and the best way to kind of get access to these back at labs.google okay so if you go once again google making it impossible to navigate to find stuff i mean this is something i mean what bar.google gemini.google now it's labs.google.com okay yeah so here you can see google right yeah labs.google is not even.com now right so i think we and so what we're going to do here is we're just going to start going into a few of the things that they launched i know you like this one jacal notebook lm so what they did in notebook lm is it can take up to 1.5 million tokens and contacts now so if you have a bunch of contact here you can put it in here and it can then basically create a summary for you on that content right i did this i had uh steven uh johnson on this week and start up she can look it up and um i showed myself taking the screenplay for founder the founder and the book grinded out the pdf of the book grinded out about ray crock and a bunch of other ray crock business case studies i found from like harvard and other places like pdfs i found and i put those all in there and when we did an episode i asked it give me key moments in the history of mcdonald's and what lessons they learned and it really started to act as a research assistant the job of a research assistant who would compile all that read that and then sit in a room with the writers it kind of acted like that and you know that's like a you know basic research position in the world the 50 60 70 000 a year is what researchers get paid you know i've employed them for many years in publications and journalism starting pay by you know maybe 40 50k you know if you're an expert researcher you can get up to 60 70 80k in the world after 10 years and those exist in all number of modalities like a magazine a newspaper a consulting firm a law firm whatever just a general researcher seems like that function is going away in the world anybody who needs a researcher can use notebook lm gemini chat gpt the researcher mode so that means we all get to do other things right and i can tell you my producers have been using chat gpt since it came out at my insistent to summarize things and the summaries that they do versus what chat gpt can do essentially the same so then what it comes down to is them understanding my personal taste or the the gestalt of the show fancy word for the the vibes of the show the vibes and then kind of cross-referencing them right and so eventually will put into one of these llms all 2000 episodes and say what would jcal find interesting about this startup or this person and it will go out find the 20 interviews this person has done and then you know surface the things that they think i might be interested in it's really going to be very interesting yeah yeah so now it's all of that just with 1.5 million tokens of input context you can imagine jay cow that should cover almost all the things you've ever published everything i've ever published wow two thousand you think four thousand hours of podcast would fit in that maybe no let's leave the podcast out oh okay everything i've ever written blog posts maybe all the transcripts right yeah yeah i mean a book is basically six to ten hours right yeah um so if you think about it like every podcast maybe every five podcasts is a book in terms of the transcript so there you go 60 000 words whatever amazing wild we're going to keep going through their stuff so the next thing they did is they've made a generative search experience i don't know if you use this but like this is sort of my go-to these days more so which is the gen search experience and so they've made this uh generally available and so when you do something uh and we're going to just show this example here so again i'm in the google labs showing off ai overview on more searches overviews and search okay and this doesn't work you have to use your gmail address for this to work once again and you have to use google chrome god damn it how can i get better improv or how can i keep bananas fresh longer what you're going to see is and see they've got it the ai overview right here now this is interesting now jcal right because they're calling it a overview yeah it's perplexity yeah i mean perplexity yeah well you know i think they're they're innovating too so don't don't don't count them out but this experience is zippy so yeah do it one more time i want to see i didn't see where should i go on vacation with my 10 year old in january that's warm and fun i mean i got really detailed here let's see that that was that was too much for it okay tell me about turks and kekos there we go turks and cake there you go perfect yeah and then if you show more it's kind of instant i wonder if it's pre-cached i don't know yeah what's interesting is this one is different than the banana one this one's called ai overview it's different color that one was blue that was a little bit different interesting so they maybe have just cashed up all the most popular ones right yeah see how this one is red oh yeah look at that huh yeah i mean this one was this one was instantaneous they make everything so hard god it's just yeah oh see this one this one went into generating interest ai overviews in search okay i gotta sign in i gotta use my gmail account i talked to sundar about this actually i said okay you just do you see jake like like so much stuff has gone below the fold like previous google was so much harder to use yeah i mean this is the end of seo uh so if you wanted to get traffic from google the reason google didn't do a lot about this uh or one of the reasons um they didn't do this was because they were in a very fragile balance between indexing people's content leveraging it to make money intercepting search traffic google becoming the starting point and then sending traffic to people now they're going to train on your data give the answer and not send anybody to your website and this is going to result in people saying i want to get paid for my content if you're just going to use it to rehash this stuff you know i'm saying because here when it's doing it um let me show you mine i just used one of theirs or actually yeah so if you show more here one of the interesting things is they i think they'll put uh scroll down let's see if they put uh links so see what they did here they made an overview but because they're in a very fragile relationship with publishers they gave a carousel at the bottom of their sources they didn't quote them but click the first one and you know on that list and i bet you of the six they did here you know this ai article from forbes was probably where they got the information from so i wonder if they're just giving you the top six google results or the top six google results that created that summary wow what do you think i don't know that wouldn't be useful i mean i i think what they have to do if they want to be competitive here with folks like perplexity they have to look through a few of the results summarize it and then spit that out so that's what i think that's what they're doing i think that's what they just did so if you typed in here what are the top science fiction films of 2023 and it if it does summarize this you know that it doesn't know that without having indexed a page right that's not the type of result that they're going to know interesting here see this yeah well that's because yeah you got the it asked you to generate it because they already have what to watch like they have their own yeah thing here but here look it did i b it it gives you some of them and then it gives you immediately imdba and then it says according to rotten tomatoes and look there's a down carrot there if you click it it gives you the link so they're doing sources and they're making the sources a little robust you notice that yeah why are they doing that this is the fragile relationship that happens when you steal people's content without their permission google has stolen this content and made these summaries without the permission of those sources so what they're hoping is and i'm using the word stole to be a little provocative here but you could say they've leveraged they've utilized without permission we know that they don't have permission to utilize these okay they utilize these without permission to create summaries in order to not get sued they're hoping slash film and imdb are good with that high profile link yeah see what i'm saying what the ultimate test will be is how many people continue to click these links and yes how imdb looks at it says oh you know they're still sending 80 or 90 of the traffic they were before fine but if that goes way down there's going to be chaos i'm investing in a startup that is creating a clearinghouse for the rights for content holders in ai mark so like someone does this for yeah exactly someone was going to say someone does it for music right yeah and people do it for movie clips uh people do it for social clips like you know those viral clips where you see when somebody posts some breaking news story on x.com formerly known as twitter and then all of a sudden all the reporters reply back hey it's abc news hey it's nbc news hey it's cnn can we use have permission to use your clip there's a company i think it's called storyful and what storyful does is they look for those moments they tell the person we will monetize your clip they'll put the clip on marketplace and tell everybody you can license this for this amount of money to play on the local news or your website and like i don't know if you know that so if i take a picture of like a car on the fire or something on the highway and it's i get the video i can monetize that wow of course you can and so here is storyful this company makes a lot of money and the only reason you would know about storyful is because you would have shared one of these but story storyful sources verify and license breaking news and viral video content in real time and so if you are you know a news program you know with editors a new york times a cnn you know that you have to get permission for these social videos and so they have relationships and they pay you can see here they have 300 plus broadcast clients etc and so when these crazy you know like that well humpback well coming out of the ocean all those citizen journalists did that submitted it to them to say storyful has people out there watching and then uh you can't submit the video they'll get yeah they see your things trending they'll get in touch with you or you can just go there and submit it and make money from your video so you gotta have a submit thing so that's storyful yeah so you know if you or i as non-commercial entities retweet something yeah you're not going to get in trouble for that a retweet is not taking it and then commercially using it yeah and so nobody's really going to sue you for that and if you put it on a social media platform that has retweeting that's considered like safe harbor no big deal but if i take it and i put it on cnn or i put i download the video and then put it on my re-upload it to my account yeah and i monetize it then you're in trouble and that's what storyfold does is they've created a way to be a clearing house for all of this so those 300 broadcast channels go on to storyful and they say you know what we need something for the 11 o 'clock news just grab hey you're never gonna believe what happened when this couple went to sea world oh my god they got splashed with a bunch of water how crazy is that susan you know that kind of kooky yeah you know you should do all episode in that voice oh god yeah i can only keep that voice up for like 90 seconds before it actually hurts because it's so high energy oh whoa it's crazy this is the innovators dilemma when you're open ai or an open source model you can do whatever the hell you want you got nothing to lose when you're google and you already have these relationships and you have deals they're they're just really scared of getting sued or having a class action lawsuit and they know better because they've got 20 years of lawsuits and legal actions and you know the people at google indexing stuff have had the people at the new york times come and say here's what you can take here's what you can't take and you know these this is what happens after multiple decades open your eyes like yolo bring on the lawsuits we're brand new they they don't have the induction the institutional knowledge relationships and or scar tissue well i was going to say scars are the biggest ones right where yeah they make you gunshot right yeah the one thing sam said is hey we're not touching music right now and he was like yeah i just believe in artists i wouldn't do it in the style i wouldn't say do it in the style of dire straits or rolling stones because they know they're gonna get sued everyone understands the history of napster and you know bingo the music industry understands the value of their content and their rights and they are predicated on protecting those rights yes the news industry and content sites they don't bother photographers sometimes they bother sometimes they don't video if it's disney yes they do right well you know why if you think about content as these like concentric circles or pyramid or whatever there's not that many a big artists so it's easy to protect them yes there's a small number of artists on the fat tail of the long tail yeah whereas forbes articles they produce 10 000 a day of the schlock articles on fortune forbes all these places yeah you know whatever you know there's a 10 000 sub stacks get published today that kind of stuff those people are not fighting to protect their rights but yeah every single rolling stone song is violently protected every single star wars and marvel character is violently protected and he said i said you know i noticed you can't um do darth raider but i did know you could do the concept of a sith lord and he's like yeah that kind of makes sense doesn't it like one's a concept a jedi one's a specific character and so you know they're i guess their red teams are doing all that but anyway i think you know google i get it you know kind of i think google concepts within star wars yeah but the concept of a hero or a villain is not the concept of a laser sword probably existed before star wars or a sword certainly did or a sword that's got superpowers excalibur has superpowers yeah so like a powerful sword or a sword made of fire has existed before star wars right what's the tale on content uh content protection 50 years i think it's 75 after the life of yeah laying uh let's ask what is the length of protecting characters in the united states whatever copyright there you go what does it say the author plus 70 years yeah that's what i said left the author plus 75 years 70 so the reason that keeps growing is because of um mickey mouse so they kept they called it mickey mouse rule right so for works published before 1978 the term is 95 years from publication right so they kind of grandfathered everything in yeah so whenever you published it 95 years and the sorcerer mickey uh will not enter the for example 1940s film fantasia version of mickey mouse known as sorcerer mickey will not enter the public domain into 2036 the cartoon style shorts will not enter until 2100 so steamboat willy in black and white is now uh so see that the steam i know more about this than i should the steamboat willy version of black and white features a more simplistic style that was the one that just became public domain on january 1st 2024 in 1928 so this is why they keep updating the style of the characters they keep updating the style so that they reset it that's why you see new versions of thor or slightly modified versions of iron man if they keep changing it they can keep protecting it and then you might be using some old one that doesn't look like the old one right clever right yeah jake i think we have to part two this there's we're definitely part two this thank you everybody for tuning into this week in startups part one please this is part one we got a lot more to do console.grok.com with a q sign up as a developer let's get sunny's uh equity position and my equity position in grok to the moon you You can follow Sonny, x.com slash Sundeep.

58:53I'm x.com slash Jason. Joining us as co-host of this week in Startup shortly, Alex Wilhelm, formerly of TechCrunch. Congrats on that. x.com slash Alex. I cannot wait to get a new co-host in here. Sonny will still be doing AI, by the way. We'll be the co-host for the other couple episodes every week. We'll see you. And by the way, Mark Suster of Upfront Ventures has been doing four episodes for me. So like Johnny Carson or Jimmy Kimmel, I have some people sit in and do hosting for me. Okay. Mark Suster, thank you to my pal, Mark Suster. he's doing four episodes i think two of them are up already they're amazing go check them out and you'll see them in the feed so if you don't see me on an episode don't worry not going anywhere but with four episodes a week 200 a year plus all in that's 250 episodes a year i'm going down to like 150 and then 100 will be done by uh people in my network can i say something and jay kel's team makes it quite easy you gotta do your work you show up with your microphone and your computer and that's it so everyone that's wanting to do pods that has to go through the entire arc of the content then you have to record it then you have to edit it then you have to publish it marketing you've got a machine yeah yeah i'm trying to make this week in startups twist into a platform so i think i'm going to start referring to it just as twist and then it'll be like twist with mark sooster twist ai whatever just you have this week in startups and you know if it goes to seven days a week because it was at six days a week at one point if it goes to seven days a week again that would be okay with me i just can't do seven days a week and all in because that'd be eight and then i have no life and then you know you look at these people who do a daily talk show at night they lose their minds yeah they eventually james corden you know charlie rose howard stern anybody who does this every day the burnout is too much yep see you all next time bye