In short
Podcast Summary: This Week in Startups - E1774
Episode Title
Threads, ChatGPT usage drops, and AI demos with Sunny Madra
Episode Description
In this episode, Jason Calacanis and Sunny Madra discuss various topics in the tech world, including the decline in ChatGPT usage, demos of innovative AI tools like VenturusAI and AutoGPT, and the launch of Meta’s Threads.
---
Key Discussions
- Decline in ChatGPT Usage
- Overview: ChatGPT has seen a notable drop in usage.
- Factors:
- Seasonal patterns (kids out of school).
- Introduction of new features like the Code Interpreter by OpenAI, which may later boost engagement.
- Market Implications: Media narratives about waning interest are premature; the technology is being integrated into other products.
- Demo of AI Tools
- VenturusAI:
- Provides business analysis and frameworks from startup ideas.
- Demonstrated using a whimsical idea (selling iceberg ice) to generate comprehensive business insights (SWOT and PESTLE analyses).
- AutoGPT:
- Described as an agent that works through tasks using LLMs (Large Language Models).
- Demonstrated building an NBA summer league schedule, showcasing the practical usability of AI in task management.
- Meta’s Threads
- Overview: Launched as a competitor to Twitter, aimed at leveraging Instagram's massive user base.
- Critique:
- Threads lacks features and depth compared to Twitter, potentially limiting its appeal.
- Concerns that Threads might just replicate existing Twitter functionalities without significant improvements.
- Strategic Insights: Suggestion that Threads could evolve into a feature within Instagram rather than a standalone app to leverage existing user graphs and content.
- Google’s AI Strategy
- Discussion about the contrasting approaches of OpenAI and Google regarding the openness of their technologies.
- Google’s historical attempts at social networking (e.g., Google Buzz) and missed opportunities highlighted.
- The importance of companies leveraging unique data sets for training language models, alongside the implications of changing data access policies.
- Inflection AI’s New Supercomputer
- Inflection AI has raised a significant amount of capital to build a powerful AI supercomputer infrastructure.
- The potential for this hardware to enhance AI capabilities and its implications for the competitive landscape.
- Investors include notable figures and organizations, highlighting the widespread interest in robust AI technology.
---
Key Takeaways
- AI Integration: The integration of AI into various tools and platforms is accelerating, showcasing its potential to enhance productivity and efficiency.
- Market Dynamics: Media narratives can sometimes misrepresent technology adoption trends; understanding underlying factors is crucial.
- Competition in Social Media: The success of a new platform like Threads will depend on its ability to provide unique value compared to existing services.
- Data Utilization: The ability to leverage unique data sets for AI training will be a critical factor for future advancements in AI technologies.
---
Time Stamps
- (0:00) - Sunny joins Jason
- (1:49) - Discussion on ChatGPT decline
- (10:22) - Introduction of Fin by Intercom
- (11:01) - Demo of VenturusAI
- (34:38) - Discussion on AutoGPT
- (49:08) - Meta's Threads discussion
- (1:00:13) - Google’s social network attempts
- (1:03:28) - Inflection AI's supercomputer insights
---
Additional Resources
- [Visit Intercom for Finn](https://intercom.com/fin)
- [Eight Sleep Offer](http://eightsleep.com/twist)
- [Get 10% Off SPVs with Carta](http://Carta.com)
---
This episode provides a blend of innovative AI demonstrations, insights into market trends, and critiques of emerging platforms, making it a compelling listen for tech enthusiasts and startup founders alike.
Written by AI. May contain mistakes. Listen to the episode to check what was said.
Transcript
Automatic transcript. May contain errors.0:00the best way i heard it explained to me was when you're behind you open source when you're ahead you're closed and if you look at say um windows they had a monopoly on the desktop closed they don't need to be open source um but then you look at google very far behind they have a monopoly on search so when they talk about search their algorithm for search is closed you can't understand how pages are ranked but then you look at android they went open because they were so far behind ios uh and stuff like that so they went open source and they wanted to be on everybody's phone so i think facebook going is closed when it comes to their graphs and everything right facebook instagram they used to be open when all the companies like were created you know like zynga and all and then they close the graph up you know at some point when they had a lead and nobody can compete with them which is exactly what open ai did they became closed ai so fascinating this This week in startups is brought to you by Finn can't burn its mouth on hot pizza or wave at someone who wasn't waving at them.
1:03Finn can resolve half of your customer support tickets instantly before they reach your team. Meet Finn, a breakthrough AI bot by Intercom. Ready to join your support team today. Visit intercom.com slash Finn. Eight sleep. Good sleep is the ultimate game changer. Now you can add the pod cover to any mattress. Go to 8sleep.com slash twist to check out the pod cover and get$150 off at checkout. And Carta now lets you launch and administer SPVs for your syndicate. Share your knowledge, capital, and network to launch your syndicate SPVs through Carta. Get 10 % off your first SPV with promo code TWIST.
1:49Hey everybody, welcome to another episode of This Week in Startups. And Sunny Madras here. my guy sandeep madra from definitive intelligence if you don't know what that is i placed a little bet on that company like i was able to get a little little tiny sliver of sunny's cap table uh serial entrepreneur and one of the smartest most fun guys i know welcome back to the program sunny to be back good to be back very excited all right missed you guys last week i know i know and I wasn't on all in and these guys did a rogue podcast without me go on vacation crazy these guys are out of their minds um but it was pretty good did did did Friedberg really do it in iMovie uh no I think he was no I think it was joking to do an iMovie but he did edit it himself I mean that's why it's like a little bit janky but I mean if you record a zoom podcast and people have good microphones yeah you you know it takes a bit of the visuals weren't edited so you get that four by four frame which i hate yeah it's like a bad experience to watch people drinking coffee or like checking their email or you know pulling up the next topic um it's much better when it's a single or you sometimes go to it um but yeah i mean i was impressed it it uh you know having hundreds and thousands of edits from sacks and everything like these guys really edit the pod so uh to make themselves like they they like focus on every little sentence and edit it in post like lunatics um i don't i just i'm just like whatever i said i said but these guys are like super precious and have their marketing and comms people like review everything for compliance which i understand like if you have funds you have to be careful but yeah they i mean we all agree to be off and then they're like at the last minute and i gave everybody producer nick and i tried to shut my company down that week and yeah i guess like i gave everybody the week off you know like they deserve to get a vacation day um but yeah not a bad episode uh but we should talk about there was one thing on there about ai which was the drop in ai usage um which i would have liked to comment on because i do think you know that whatever 10 or 20 drop is notable um in some ways and not notable in others what's your take on that i mean obviously kids out of school is a major portion so that's super interesting yeah so i think there's the kids out of school problem and then And I do think, you know, if we look back and it's kind of really timely in the next, you know, in the last 48 hours, OpenAI just released Code Interpreter, which, you know, we've demoed here early on because we had early access to it.
4:20But they just released that to everyone. And so I think it's there isn't there's a definitely part of this being impacted by where we are in the school cycle. And obviously, that's going to impact things. But I think more so having code interpreter available to all paid users is going to create a massive uplift for them. Because that's, you know, we've seen the functionality before. We don't have to demo it again, but it's been really powerful. Well, explain to people who maybe are hearing about ChatGPT's code interpreter. What is that used for? Just one more time for the audience. into it. Yeah.
4:53So the code interpreter allows you to give some data, usually in the form of a CSV file into chat GPT, and then have chat GPT help you with analyzing that data. And, you know, the example that we did was like some output of electric car registration data. And then we put we input it and we had we asked some questions, we had some charts created. So it's a way of like, having like your own personal data assistant around a smaller data set available to you. um and that is now available code interpreter to the people who are paying the 20 bucks a month 20 bucks a month exactly how many people you think are paying the 20 bucks a month now you think it's a million two million yeah i would say it's yeah my guess would be somewhere between two and five million if you think about that uh it's going to blow past the new york times which is i think at 9.7 million last i checked they might be yeah they're about to pass 10 million yeah uh and that's not insignificant if 10 million people well 5 million that's 100 million a month yeah 100 million a month 1.2 billion a year in subscriptions and subscriptions are generally 100 profitable right yep they do have some infrastructure costs but i think they could become if people are willing to keep paying the 20 bucks a month that'll be the real test yeah i also people don't understand that all web traffic youtube twitter facebook everything goes down a certain percentage during the summer because people are on vacation they go outside so um i that's the obvious thing i also think there are some people who and i guess this is the more interesting topic the press immediately went to oh it's waning uh people are less interested in it which is such a stupid take uh because obviously when a new technology comes out everybody tries it because there's no cost to trying it but you find your natural audience for your podcast for your software whatever so what are your thoughts on um that angle that some of the press were like oh it's a fad it's a fad it's crypto well you know like it's definitely not right i mean the use cases are there you know we've talked about this the origins of this podcast was in crypto and so yeah look um the other thing that that it's hard to take into account until open ai starts publishing some type of data is many use cases have made their way into other products.
7:09So where you may not have to go to openai.com and, or, you know, chat, you know, chat GPT.openai, you may be using open AI indirectly, either through Notion or through any number of products that now offer integrated experience with their APIs, right? And their underlying LLMs. And so So I think it's like almost like let's think about AWS, right? When, you know, AWS initial customer was primarily Amazon, but then as they made it available to others, you have to look at AWS as, you know, from a revenue perspective, not just as a, you know, sort of a end consumer site. So I think, I do think, you know, these numbers and the way to look at it until we get some data or like maybe someone publishes something around their API, I don't think we have the full picture.
8:00So I think it's, I think people are just jumping to a story, which is easier to do than saying, because my guess is their API usage through all the startups and enterprises that are out there is, you know, increasing week over week at a pretty significant clip. Hmm. uh that is i think where the rubber meets the road when developers use an api that means yeah in some cases they are playing with it but in majority of cases i think there's some application that's going to hit consumers and they just don't see it and so you do not judge amazon web services or azure or google cloud by the number of consumers talking about it it's the number of developers talking about it and that is yeah and then ultimately their revenues you know those things report now separately and we can see you know what kind of huge impact that they've had on the you know top and bottom line of those companies well i mean the the growth of cloud computing was spectacular up until 2022 when it still was spectacular over 20 growth month or year over year but it did slow a little bit um i think because of belt tightening people during a recession or recessionary ish kind of thing we're in a in a down market in tech a tech depression
9:20yeah and you know what it's like a good kind of tie into this topic like a lot of folks have been pushing to the cloud for years right and we've seen those phenomenal growth numbers the one thing that i think companies struggle with as they were moving to the cloud was the benefits that the cloud provides because if you were a legacy business right and you were running either something on prem or maybe in, you know, your own, um, uh, data centers, um, those things are probably really efficient and moving to cloud doesn't immediately get you that efficiency where the efficiency starts to amplify now is when you want to start using like additional services, whether the services came from, you know, the cloud providers themselves or like third party services, which requires your data to be in the cloud.
10:03So I do think what we're going to see very shortly is a huge uplift in workloads in the cloud being driven by AI applications because that's the place you have to drive it. And so I think that's something we'll see that will play out, I think, in the next 18 months. Finn can't go through a goth phase or still be haunted by a bad haircut they had in middle school. Finn can resolve half your customer support tickets instantly before they reach your team. What is Finn? Finn is a breakthrough AI bot from Intercom. Designed for customer support teams, it learns your entire knowledge database and has the ability to carry conversations, remember context and nuance, while slashing your resolution times and support volume.
10:51Meet Finn, a breakthrough AI bot by Intercom, ready to join your support team at A. Visit intercom.com slash Finn. i mean let's just get to demos that's why everybody's here we did a little couple of minute preamble we got we got on the same page here but i love the fact that you're obsessed with this like i am i have been doing a couple of projects myself uh over at inside.com i won't talk about them yet uh but one of the things i'm was doing i want to get some advice on is how to tag things by category you may have seen i'm trying to have instead of human editors tag the stories i was trying to see if i could get oh yeah gpt4 to tag the stories correctly yes and i need to get a prompt that really does a good job on that so we talked about that offline or if anybody listening i'm trying to find like a database of like the most important topics in the world that yeah like somebody has come to the conclusion that these are like the actual topics so google has one it seems for advertising because yeah the 2700 yeah 2700 verticals that kind of represent almost all kind of topics i'm trying to figure out where to get that list from exactly and if google lets you use i can send you a link yeah no they publish it i'll send it to you they publish it because they want people to be able to download it incorporate it into their websites exactly exactly yeah i'll send you the first demo is coming up of course we'll sports guest says if you're listening um and not watching well go to go to youtube and type in this week in startups and go find the channel subscribe to the channel put the alert on because i'm going to be doing some breaking news alerts over the summer from time to time, but go ahead and check that out.
12:27Okay. All right. So this is a fun one and actually quite useful. I'll speak to this. When I was earlier in my career and I needed help and so I'm kind of creating a basic framework, I don't have an MBA. When you're trying to basically understand other aspects of the business other than technical, you want to have some framework. So this Venturist AI, you come to their website and basically you can give it a topic and it will come up with either an advanced or simple. The free ones are the simple thing and it'll do a business analysis. And so, you know, there's a great movie from the 80s called Brewster's Millions.
13:09And I don't know if you remember Brewster's Millions. One of the ideas that Richard Pryor's character is pitched on is a guy wanting to sell ice that's breaking off of icebergs.
13:22Artisanal ice. Yes. Yes. Your artisanal glacier ice. I mean, I'm crazy, but I think I literally heard a pitch on people who wanted to get artisanal glacier ice to put in fancy cocktails. I don't know if that was real or I imagined it or it was from Brewster's Millions, but okay. Yeah. And so basically, here is it generated by me. So what's this website called? Venturus, V-E-N-T-U-R-U-S-A-I, Venturus AI. Terrible name. Okay. Okay. um i kind of liked it but uh insurance oh i like adventurous but adventurous okay i get it or maybe like a venture you know as well okay so you put your startup idea in as i want to start a company that sells ice uh that breaks off icebergs very simple prompt and it basically turned that into a business analysis and feedback so it gave me a brief description it it basically you know did that on its own then it did a swot analysis for me oh wow it subsequently did a pestle analysis right which is uh you know political economic sociological technological environmental legal right the target audience and user stories um you know business strategies business frameworks and you know i'll just i won't read off all things here but it basically gives you a solid framework for a business and in many ways jacal you know you guys do this at inside right when folks or launch i'd say right at launch when when folks show up with something i thought they did an incredible job and this was the free version they have orders five forces analysis this is what's really interesting about this is they went into subcategories or other other people's frameworks for analyzing a business one of those is port is five forces analysis i've heard of that before i've never actually used it um but can you maybe read some of those yeah sure so that's like number 13 here it's like so threats of new entrance moderate as barriers to entry include sourcing ice from iceberg established partnerships and brand reputation you know bargaining power of suppliers right like do you have some kind of edge there with the suppliers right bargaining power of the buyers like who's going to buy this uh you know threat of substitutes how easy will this be for someone to choose another party that's doing it uh intensity of competitive rivalry like how what does it say about this threat of substitute products i.e the ice machine in your refrigerator that's already there and you've already paid for it no the five forces so people know um i'm just reading from investopedia here competition in the industry potential of new entrance into the industry so the first two are about competition the power of suppliers the power of customers In other words, how much power do they have over you as the provider of these?
16:15And then threat of substitute products. So a substitute product would be slightly different. It would be something to cool drinks, right? As opposed to ice itself. That'd be a direct competitor, right? Yes, correct. That's super fascinating. So essentially what this is doing is they have a series of prompts they run your idea through, is what I'm guessing, right? Is that what this is? My guess is like sort of the rough structure behind this is, yeah, they take a prompt and what they do behind the scenes is they have a set of, you know, prompt templates that walk your idea through each of these and they have 14 sections here.
16:50And so they take the idea and then they work with an LLM to create a brief description and then each of those 13 sections, which I think is really powerful. like i i i think it's this is great i mean this is like this would be a whole semester at a business school you would work on something like this yeah and now you can basically do an approximation of it who knows if it's actually of the quality of what you would get in a course right to you know do your first mock-up of a business yeah but it would literally whip you through multiple of these so i just did one yeah i said yeah pull it up let's see yours yeah let's see what mine does because this is actually something i'm thinking about doing so i'll make a little bit of an announcement here venture capitalist training school comprehensive analysis and feedback so you know i have angel university where i teach people to be angels and we've donated 200 000 to charity i've taught it 35 times i think and we've basically got maybe i think four or five thousand people have taken the course now and so we've created a lot of angel investors in the world but my idea is now that i'm going to have my uh venture studio my accelerator in san Mateo, I'm trying to find a nice garage or something, put it in a big open space.
18:00I was thinking of starting a competitor to Kauffman Fellows. You know that program? It's$80 ,000 for two years. So I want to create a Kauffman Fellows killer. That would be half the price or maybe one year intense or six months intensive and maybe be 20K or something. Have 10 people come to each one and create a program where they basically get to draft off my deal flow. And And the core of it would be they would sit in on all the investment team meetings and do all the frontline meetings. It's like a launch EIR program. Like an EIR program, but like an associates in training. Yeah. Instead of EIR, AIR, associate in residence or AIT.
18:40So anyway, here's the business idea. The business idea is to establish a school that offers comprehensive training programs to individuals aspiring to be venture capitalists. So it took my, my prompt, by the way, was venture, uh, what was, where's my prompt? Oh yeah. Um, yeah. Venture capital training school. Um, the school aims to provide participants with the necessary knowledge, skills, and practical experience required to excel in a highly competitive field of venture capital. So we'd edit all that. It ad libbed that, which is quite accurate. Um, the venture capital industry has been witnessing significant growth in recent years.
19:12That's true. Fueled by increasing startup activity. True. and continued interest in of investors in high potential early stage companies however there is a shortage of skilled venture capitalists that's true who can effectively identify a value in investment this is very true by establishing a dedicated school for venture capital training this business can tap into the demand for professional education field and potentially bridge the skills gap this is true swot analysis strengths unique business idea with limited competition in the market tailored training programs can address specific gaps in the industry potential to establish strong industry partnerships for internships and job placements and jacob i can pause you for a second here you know some of these things also just a framework is good like if you're trying to do this like yes these the swat may not be fully right but it can get you thinking and get you going right as well yeah i think that's the key point is that um you as somebody who didn't go to business school and just a bit of a swat analysis strengths weaknesses opportunities and threats um i had to go take a look at that because i oh didn't really i know it's been so long i you know i don't go through that um limited market size venture capital training is in each field that's true this is weaknesses demanding and resource intensive curriculum requiring experience instructors um i don't think it has to be resource intensive but okay but maybe um and i don't know well you do need to have somebody like myself who's been doing it for a while you need to continuously adapt programs to incorporate changing industry that's actually very true huh threats highly competitive high competition for top talent from established venture capital firms that's not true yeah i know they're they're gonna i don't think it's a threat to our business okay right like if there's actually high competition for top talent from venture capital firms that's actually a benefit that's true yeah because then these people graduating would be uh rapidly evolving industry dynamics and regulatory changes nope the last one economic downturns affecting investor confidence and startup funding availability that's it nailed it so it must have just said what are the threats to a business that did this yes wow this is incredible and i see that i've never even heard of a pastel analysis yeah yeah you didn't spend enough time in corporate america i did not political economic sociocultural technological environmental and legal when you were what was the name of your consulting firm called um extreme labs extreme labs so when you did extreme labs when you had customers they would pay you massive amounts of money to write this kind of stuff up and include your analysis or they did it themselves they were doing this themselves like we were more of like on the development side right so they would come to you with this stuff Yeah, but as our business expanded, we were doing more product management and product incubation.
22:06Then we would do these type of things. Got it. Yeah. Oh, my Lord. Suitable business strategy. Yeah, this is incredible. What a great - And Jacob, this is the free version. They have an advanced. I didn't get to try the advanced version, which they don't allow for free. You can do 10 of these for free. The advanced version is maybe something you should try for your business idea. And it lets you make the report visibility public or private. I just put it on public so people could go see it. with books to guide you along the way. Venture deals. The lean startup. Angel. How to invest in startups.
22:34Timeless advice. Wow, I got to pick that one up. Who's the author? This book offers a first-hand perspective on how to identify, evaluate, and invest in problems in technology startups making it highly relevant to your business idea. Who's the author? Oh, Jason Gallagher. That's pretty funny. You can download and export to a Google Doc. Wow, what a great service. So shout out to whoever made this. Yeah. Venturous AI. Congratulations. applications and let me see the pricing here let's go on the pricing tab starter free yeah 10 standard reports a month got it pro 20 bucks a month uh 40 standard reports is great um i could see doing this with um and you could you know every startup yeah yeah no i was gonna say you could use it as like you could do this as part of you know the university and all the things you're doing yeah yeah i mean what's interesting about this oh it says you own the commercial report rights that's interesting um what i like about this is i could do this if they had an api every time we meet with a company we put in our database we have a summary of that business so what i have api access right there look at that right oh it says contact us for api access perfect yeah what i've been doing now is um in preparation for the great ai uh overhaul of our industry is we have a programs team call every day where you know the people who run founder university launch accelerator get together for a 30-minute stand-up and then we have two investment team meetings for two hours each twice a week tuesday and thursday because we process 60 new companies well we do 60 new meetings per week intro meetings and so i'm gathering all of those and i am recording the zooms now storing the zooms transcribing because zoom does transcripts automatically putting the transcripts into notion and then i'm summarizing i think we're using the Notion API, or we're using chat GPT-4, I'm not sure which one, to summarize the call transcripts for our internal meetings.
24:29Summer is reaching its apex, and there is nothing worse than tossing and turning and sweating in the night because of all that summery heat, don't I know it? But the pod cover by 8sleep will keep you cool all night, all the way down to 55 degrees Fahrenheit. This is going to help you wake up fully refreshed. And it's so easy. The pod cover by Eight Sleep fits on any bed, just like a fitted sheet. And it improves your sleep by automatically adjusting the temperature on each side of the bed based on your and your partner's individual needs. You just set your Eight Sleep side of the bed to the cool temperature you like.
25:05And maybe, hey, maybe your partner wants it hotter. Okay. Viva la Difference. It can cool down and warm up and adjust based on the phases of your sleep as well as your environment. I love my eight sleep. Got one up in Tahoe, got one in the Bay Area. You know, sometimes I'm in Tahoe, it's freezing. I need to get nice and toasty warm. So I get a nice sleep and I get cozy, woezy. Hey, but then sometimes in the summer in the Bay Area, we get this heat waves in August and September. Oh my Lord. But then I bring my eight sleep way down 55, 60 degrees. I love it. Freezing cold. Those crisp, cold sheets are waiting for you.
25:39Eight sleeps cooling technology is a lifesaver in the summer. Take it from me. Go to eightsleep.com slash twist for exclusive summer savings on the pod cover until July 10th. That's today. Today is the last day to get that July 4th deal. So go right now. Eightsleep.com slash twist. Hey, they're now shipping in the USA, Canada, the UK, and select countries in the EU, as well as Australia. Way to go, Eight Sleep. What should I do with that data eventually? Well, it's a good segue, J. Cal. I think, let me show you this. That's why I'm the world's greatest moderator. yeah exactly um let me get my c3po uh moderate your podcast yeah so similar to um you know kind of what we are talking about here what a team launched is a chat app specific to the hacker news hacker news and what they've done is they've taken all uh what's going on in hacker news one Oh, yeah, sure.
26:41Yeah, we can update that a bit. Welcome to Chat HN. So this is chat HN dot. Vercel dot app. So Vercel. Explain Vercel. Yeah, so Vercel is actually crushing the game. We should spend a little bit of time giving them a shout out. They are a modern hosting, like an app hosting service. And they've been doing this for a while. But in the AI game, they're the go to. So if you want to host any type of AI app, most of the frameworks that people are using are designed for like sort of one click deployment into Vercel. And they do a great job. They have very flexible plans. And so they're like sort of the modern up and comer in the cloud war.
27:24I mean, you know, they're more than up and comer now, but they've been really crushing it. And so and they have a bunch of their own additional frameworks. like in this case, they have an AI SDK to help you with, you know, sort of the chat and all those other things that they're doing a really good job of as well. So big shout out to the Vercel team here. um and so uh you get this prompt give me the top five stories on hacker news in markdown table format seems like doing tables and formats is like a great use for ai you click that uh and it gives you the title link score and comment score is something they use on hacker news to kind of give it um you know how uh how popular something is and it gives you the first uh it gives you the top five and then it says hey send me a message um so i guess we could ask it uh what's the give us the top give us the five funniest comments on the first story let's see if that does anything uh so not enough amusing comments to provide the complete five list yeah oh interesting uh how about give us the most um how about this oh what is the sentiment on threads.
28:38Interesting. So this is a proprietary data set. And it just gives you a new interface for how to process all that information. And this is the work of an analyst. So when I see this work, I don't know what you see, I see a$40 an hour person. And if you ever want to, when I talk about hourly wages, I always extrapolate as a business owner and somebody who invests in businesses as the hour of what an hour of work costs and then you just times that by 2 ,000 right because it's 50 hours a week 50 weeks a year 40 hours a week 2 ,000 you know listen if you work 50 hours a week it's 2 ,500 you've worked 60 hours a week it's 3 ,000 but 2 ,000 is a pretty good multiplier 40 bucks an hour 2 ,000 hours 80 ,000 dollars a year that's a really good paying job especially from home and that's what an analyst would get a researcher would get 20 an hour and a data processing person like an offshore kind of person would get five to ten in manila so five times two thousand is ten thousand dollars twenty times two thousand hours is forty and forty times two thousand is eighty just so you get an idea eighty thousand dollars is a u.s you know smart person who reads books you know um english as a native language researcher is somebody just out of school or maybe went to a two-year and then offshore they don't understand the context in america probably and it's english as a second language in many cases so whose job do you think this replaces most and because we keep seeing this and i say the researcher analyst and the data formatting person keeps coming up yeah um so let me let me let me answer your question a little bit indirectly which is so first i think given large proprietary data set you can see the value of putting a chat interface on top of it, right?
30:28And so I think for you guys, what you need to do as a next step is you have all this proprietary data now, which some of it's even being created by AI or enhanced by AI. We need to stick a chat interface in front of it. So that should be sort of one of our projects so that you can go through that and ask a general question and say, hey, have there been any other companies that have come through that have pitched us on selling ice from icebergs? And then it can go through that data and then you can get that answer quickly and you can see what was the call about and things like you can kind of dive into it.
30:57So I think that's the first thing we're trying to show there is that the world of deploying your own chat app on your own data is really simplistic now. And I think it's something that we should explore for launch. And so we should kind of kick that off. Yeah. I think the value is, in one sense, in a replacement, but I think it's the enhancement. I think if you put this in front of everyone and ask yourself how many times, J.K. How much are you relying on your memory to go back? Oh, there was a company that did that. Or where did these guys end up? Got it. And now to basically have that enhancement is more valuable rather than a replacement of a person or an analyst, but to basically kind of give yourself that superpower.
31:43I think that's where it's a much better framework for value. Yeah, so let me explain this to folks because I think you just hit a key insight. When you're running a business, an at-scale business like ours, 15 ,000 people emailing us and filling out our form and sending us a pitch for a company, over 1 ,000 people coming to founding university a year. We have so much data, and we have 19 people in our little investment team, our little company. Now imagine with those 19 people, we then do an analysis. We do that analysis, and if we do that analysis of what we're doing, I would normally go to somebody on my team and say, hey we met with that company they were doing a marketplace of diamonds but we had heard two other pitches about diamonds the one who was doing the fake diamonds and another one who was doing you know setting your diamonds it was using ar i can't remember any of them now normally you just search for diamonds and then you get all this cruft diamond in the rough somebody would be saying like oh this person's a diamond here you could say tell me all the startups that are working in the diamond industry that we've met in this over the last five years and pull clips from their video because we have the video now and make me a little dossier of that yes or show me all the marketplace companies we met myth last year yes then go on the web and tell me uh if they how many employees they have on linkedin and this is where linkedin has to start in paid api i don't know this is you know twitter and reddit having their apis i think the linkedin api for linkedin team please let us just give you money because everybody's scraping your data anyway and we can buy your data from like israeli or you know companies in the philippines have scraped all of linkedin already they have it all and you can't stop the scrapers and it's legal in other countries to scrape this stuff so your terms of service means nothing and those are the jurisdictions so now you're left with going with gray hat people for data sources and i'd like to put this um on you for next week if you could find some gray database sources of like instagram facebook profiles whatever i'm curious about the gray market underground so anybody has information send it to producers at this week and startups.com or uh sonny what's your twitter sundee at sundee that's what i think is going to be super interesting is um some of this gray market data but imagine if i could ping the actual api and it would come back and tell me hey this company has 60 employees when you met with them they had 20 and i would pay for that i would pay some amount for database calls it could be an incredible revenue stream for linkedin and i get pinged by people who are like would you like a billion linkedin reference you know database records of ctos of founders like this stuff's all been scraped already so don't be precious but yeah all of that back and forth in meetings and research somebody oh i'll get back to you in an hour yeah it's gonna be like i didn't even need to waste somebody's time so jake i know you've been on this for a bit and one new segment i wanted to start and so we're not we're not fully up and running with this yet but we have the framework and i think we're going to start building this out we're going to start building this out over the next couple of episodes.
34:48And so you've been going on about auto GPTs. And so what I have here is a basic framework of an auto GPT that I've created. Define auto GPT for the audience who's catching up. So yeah, an auto GPT is an agent that uses LLMs to work through a problem through what's called like a chain of thought. So you'll give it like a high level problem statement And then it will come up with a set of tasks to solve that on its own. And then it will use its access to different sub agents. It has to solve that task. And so this is, you know, in a, from a demo sense and Jake, I'm going to add you actually to this, to this replet.
35:32So you can basically participate in the, in, you know, kind of in the live, you know, kind of the live experience that we're going to have. And, and so like, I'm going to just start with this. This isn't with LinkedIn and you'll just see the power of what we can do here. So you can say, can you come up with a schedule of summer league? Let's, let's say, let's call it NBA summer league games for me to watch. And so what this is going to do is, so I just gave it something generic and it's going to say here really quickly. Well, I don't, I need to start by searching for summer league games and then it's going to figure out, okay, I found a place to get it.
36:15So I need to analyze those results. And then it, and it found that it can get it from this MBA page. Right. And then it'll start working to put it into. Now this is just, it's a basic framework. We're not like, it's not fully running here again. One more time. What is this called? So, so this is basically something we've built from scratch, but it's using two main it's, it's, we're running it in replets. We want to give them a shout out. It's using language. Yep. and we're using lang chain which is sort of like a um language model by facebook no no no no it's not like we're using open ai that's um that's the other one yeah yeah lang chain is a uh scaffolding framework for working with llms yes right and we're using another uh another server called serp api which is basically a search engine results api and so it basically interacts with google And so that's what the two keys you see here.
37:11Does Google allow that? Or it's just, how does it actually do that? It has your machine do the search and then rips the HTML page apart? No, no, no. There are whole companies that exist for this now, right? And so this is a company called Serp API. Wow. I've never heard of this. I'm learning. Yeah. And so they exist. Obviously, you have paid use cases with them. and they basically, you give it a search and they'll return you back like the search engine results in a consumable format, which is like sort of on the right hand side of what I'm describing here. Like as JSON. Search S-E-R-P-A-P-I.com, which is search engine result page.
37:49Yes. Wow. You're very familiar with this, J-CAL. Yeah, sure, of course. Yeah. Yeah. And there's a few of these, but this is the one that I've decided to use in this particular demo here. And then, and that's how this auto GPT, which, you know, I gave it, Like, can you come up with lists of summer league games? Obviously this is not, it doesn't have the 2021 limitation. It uses a SERP API to figure out, well, that result is going to come from this NBA.com page, summer league schedule. And then it will start to kind of parse through that, that document to come up with your list. And so this is sort of the beginnings of our auto GPT and we're going to start working through this, but so I wanted to kick this off today for us.
38:29Correct. Yeah. so how do you propose what's the next step in this well the next step is like you you've had a bunch of different use cases right you rattled one off today but let's let's just build towards now that we have the basic scaffolding and and you know we're going to get you back to writing code again jcal we'll basically yeah so and you can see this thing is not very long it's only like 60 lines of code that's the beauty here and you know because all of that is being abstracted by api calls so exactly exactly these days writing code is really like hitting 20 different apis and blending whatever you get back right i mean it's really fascinating how it's really fast code has changed yeah and honestly like in this particular case like the the the code to use that serp service is right here right this serp api wrapper and then this is my api key that i have with them in the example you were talking about with linkedin if linkedin would want to work with us they would offer a key that we would pay for we would import their agent and then we have another agent here that wasn't searched but that was like linkedin that we would go and get that information from but there's plenty of other services out there linkedin isn't there yet but that's how we're going to get back into it all right so here's what i would like to do i want to create one of these okay i'm going to we're going to run this up the flagpole that finds new startups that aren't in our database already okay um and then finds the founders puts them into a category does some sort of analysis of their business right like finds out what the startup does sends it to that other api from the people who do uh venture what's it called venture insurance so we find a startup somewhere that didn't exist before so an announcement of a new startup that could happen on hacker news reddit uh twitter linkedin people could announce a new startup so we find announcing my new startup date being today so it was published in the last 10 days let's say so in the last 10 days somebody publishes i'm announcing my new startup and we could do that with the search engine result page by passing a query to it so we could say google uh you can do this in a chat window or i could do one we would say to google new startup announcement and then you would go to advanced search advanced search yeah no no where is it uh you go to tools and then i would pick uh not anytime but i would say in the past week it would come up with a search result which is crunch base eu startups alley watch yeah um and we would try to find on those sites new startups and find the url of the startup once we have the url of the startup then we could find their linkedin profile page we can find their twitter profile and then try to get some information on that startup and then propose them to a researcher analyst inside our team and then click book meeting that would be amazing that would because by the way we do that we call it qualified hunting uh we look for we try to have our researchers and analysts hunt for companies that never apply to our programs and so that's hunting.
41:43And you know, Product Hunt, speaking of hunting, Product Hunt has like every day new products coming in there. So we just look at the URLs of every new product on Product Hunt, which is why I think AngelList bought it. It's because they wanted to have first dibs on all the new startups and technology. So very cool. All right, listen, you're in the technology industry, you know what Carta is. Carta is the leading venture capital and equity management platform. What does that mean? That means they manage your cap table, they manage your venture fund, they are the experts at that. And they do such an amazing job.
42:13All of my startups use it, they all love it. But I've got huge news to share with you. Carta now lets you syndicate an SPV. So you can create your own syndicate through Carta. That's right. That's what I've done. I have a syndicate. When I have a great investment, like say calm.com, I put a little bit of money in 50k income, and then$328 ,000 came in with the syndicate, you can then go build your own SPVs and use Carta as your partner. They are one of the most trusted names in business. You know that. And they're used by more than 4 ,500 funds that represent over$120 billion in assets under administration.
42:48And they will support you on every stage of the fundraising journey from your first syndicate to building your global venture capital firm. You can raise and deploy from anywhere because Carta offers US and international SPVs and they fund in different domiciles. That means different locations, right? fancy word for locations, geos. Carta provides this automated back office solution so you can focus on what's important, building and finding great startups, building these amazing relationships, investing in great startups. So it's a very simple call to action. I want you to go to carta.com, C-A-R-T-A.com, you know that.
43:21But use the code TWIST to get 10 % off your first SPV. That's carta.com and use the code TWIST. Yeah, so that's our, I think that's our little project so we'll take that and we'll kind of expand it out and and we'll kind of work through it we'll show the results every every uh every episode you know i'm very interested in facebook's approach to ai uh there was this they have their own language model that was leaked quote unquote llama llama and uh it's very popular on hugging face and other places so llama they claim was accidentally by facebook itself um so that it would kind of undercut google bard and proprietary stuff like closed ai um chat gpt4 who knows if that's true but they keep putting out public stuff so they're still on the public releasing of information open source tip correct or are they now circling the wagons and being closed they've been very open in public um you know if there's things that they haven't released yet they've just said they're going to release them they've there's one that they did recently we can pull it up um as well but i think you know this is probably a better segue into threads and you know i actually was having this thought over the weekend which is you know is threads perhaps a way to get the data set for a hive mind because if you look at any of their existing products they've all evolved right um you know instagram is yeah oh yeah there we go and um you know instagram is not going to give you sort of hive mind because it's going to give you video and pictures right yeah um whatsapp if you mine that data it's going to give you proprietary chats and facebook has just evolved into something i don't really understand anymore maybe you can you can chime in there if you want birth announcements and bar mitzvahs and retirement parties you know kid photos it's basically for moms and dads and grandma i use it like a i use it like our yahoo groups there's some great groups i'm in there um but yes the group's product is um very subtly i think put a lot of new life into that because the general feed is kind of like boring and repetitive oh it's your birthday happy birthday literally it's a birthday announcement website um or a birth announcement website even um so why let me ask you one question here and we'll get back to threads face i have my own theories but i'm curious of yours open ai went closed google published all this stuff including tensor and kind of regrets it i think now they're kind of transformers transformers and everything so they're closed um or somewhat closed and they're not doing they're not announcing the papers anymore is what i heard the scientists are not announcing their work as often no that's I would say that's not fully true.
46:20You know, they just launched a paper that we're leveraging like around SQL Palm just a few weeks ago. So I think they're continuing to do that. You know, their approach from a cloud perspective, Google Cloud perspective has been, hey, we're going to have our own proprietary models. And we'll also host open models and models from other proprietary companies as well. So if you are a Google Cloud user, you can use their Palm models, which are their proprietary ones. they also support all the open models inside of um their um uh you know inside of their frameworks right got it and uh also they have models from companies like anthropic right and so i feel like they have a really kind of a kind of a great why do some people choose open and some people choose closed um it's sort of the you know the the natural arc of the tech industry right like when operating systems first started, they were all closed, right?
Read the full transcript
47:16And then quickly, we had an evolution to more open source Linux, or Unix based operating systems, right, you know, BSD, and then Linux. And so I think people try to build now, there's always these these conflicting forces, I'll speak from a developer standpoint, right? When something is closed and owned by a company can move very, very fast. Because when it's open source, you have to work your way through the community. Now, the way companies have got around this, let's talk about, say, Red Hat and Linux, is that they represented almost like 90 % of all the folks that had the control on the project that were the developers.
47:53And so big companies can embrace open source and not get stuck in sort of some of the politics that emerge inside as well. And then there's the reason that, you know, you think you have a lead and you want to basically create a moat for yourself. And so those are the the main reasons that generally pop up the best way i heard it uh explained to me was when you're behind you open source when you're ahead you're closed and if you look at say um windows they had a monopoly on the desktop closed they don't need to be open source um but then you look at google very far behind they have a monopoly on search so when they talk about search their algorithm for search is closed you can't understand how pages are ranked but then you look at android they went open because they were so far behind ios uh and stuff like that so they went open source and they want it to be on everybody's phone so i think facebook going is closed when it comes to their graphs and everything right facebook instagram they used to be open when all the companies like were created you know like zynga and all and then they close the graph up you know at some point when they had a lead and nobody can compete with them which is exactly what open ai did they became closed ai so fascinating um yeah so on threads what are your i logged in i immediately got dunked on because they're like oh friend of elon is on uh so i like literally did like two yeah i did like two posts to it just like hello world and then i was like oh my god zucks such a little copycat and then zuck winds up replying to me oh okay yeah and he put concerning what was his reply he's like oh i think he did concerning uh with a wink you know how elon will just give a one word uh reply yeah like interesting uh so not not only is zuckerberg copying twitter now um which in fairness is copying jack more than copying elon right yeah but he's obviously still obsessed with elon as well and twitter he's i mean zuck's been obsessed with twitter from the beginning he was going to buy it and he's got a lot of comments but he actually took on elon's replying with one word replies which i thought was hilarious um super elon thing to do huge engagement with like people right well no now he's like yeah i'm going to engage to get my social it's like okay yeah we know that like and then he's like i'm going to be outrageous i'm going to fight elon in the octagon so zuckerberg is clearly like obsessed with elon and you know copying him um yeah just like he was with snapchat for a while and well before that i guess instagram which he bought he was obsessed with that for a little while um but i think it's a perfectly serviceable copy of twitter they obviously rushed it because it's feature light it doesn't have a lot of the features um but it's a different graph i found it was like a lot of people who don't have interesting things to say trying to say things with words instead of pictures does that make sense you you nailed it like that's the issue right is that look i think instagram has a huge community i think they have a ton of engagement probably you know maybe orders a magnitude more than than twitter does but it's for a different purpose yes um and it's kind of focused around video and photos yeah um many a times those videos and photos are not a real representation of what's happening it's sort of like hey look at me and then on a stage yeah they're staged right pretty highly produced yeah highly produced and so um and look people want that and i think it's it's great and i think subsequently the graph you create when you have an instagram account is around that as well right you you're you've decided to curate something there and i think when you go to twitter whether you have um you know your list of folks that you follow or like a for you feed it's a completely different input into the system right which is you know no one on instagram is sharing archive papers right you know from from the these research papers right no but like debating the subtle points of the ukraine war yeah of russia's invasion uh china taiwan is not a big topic or yeah and you know it's so funny like uh what i i kind of posted this thing um which was like oh like for For like 24 hours, it felt like all the threads were disappearing on Twitter, like how to make money from AI or UCO.
52:13They were gone for about 24 hours, and then they all came back. Because again, vice versa, that community there doesn't want to read that stuff, right? They don't want to read the, what's the latest in AI, and let me see the last five cool AI tools that were launched, and how can I make money using them? This is the key thing that, for founders who are listening, this is the key thing you have to understand about making a clone. if you make a clone of another product and that product is doing a good job and it's like it's servicing its purpose and it was the first it's the at scale one i wouldn't say the first you have to be so much better and it might be that the team that built that product has already gotten it to so much better that the users can't tell the difference and so if you look at threads versus um twitter there's nothing there that's different or better and in fact obviously they're still playing catch up until they have something that's dramatically better for some reason it's going to have a moderate success right it's um the same thing held true for search engines for a long time people just kept making search engines until page rank came out and the results were noticeably better like 10 times better yeah there was no reason to go over to google yahoo got you or lycos or excite excite yeah they all got you altavista magellan these things all got you to a similar result you type in pepsi or coke and it would get you the peppy or coke website yeah but when you typed in pepsi versus coke and it got you to some scholarly article about the pepsi challenge you're like oh wow this is interesting yeah it's better um which is why chat gpt feels so uniquely different so there has to be something uniquely different for people to change i've learned this the hard way many times uh building products yeah now look the one edge where, you know, Instagram threads, you know, meta will have is brands.
54:05Because a lot of, you know, when I look at accounts, like it's a mix of things you follow. And if you follow, you know, like kind of larger brands for a reason, then, you know, I think Instagram is starting to surface that a little bit better. And at least from my understanding from a few different folks I spoke to is they went and targeted folks. And I don't mean brands just by company, but brands that are people as well. Because, you know, they had Mr. Beast on there. and other folks and so did they pay for him to give away a tesla that was like a very specific troll yeah i'm i'm not sure what the the like the economic arrangement was gave him a million dollars or something to start posting over there or paid for the giveaway well i i definitely heard that from someone you know is is reliable to say like they definitely had a pretty uh it started actually when the whole thing happened with the subscriber ticks uh the um the verified ticks the verify was the start yeah they copied the verified checkbox no no no it's saying when when sorry when twitter started no when twitter started to change the policy around yes that's when they started going after the high profile folks got it smart yeah yeah because they they saw that as like sort of a like a or misstep yeah it's an attack vector yeah and so that's where they've kind of went after these brands right and and so um now the challenge is is like so mr beast is the most interesting on youtube of all places and yeah his twitter and his you know threads are sort of okay i don't know where to go i also think yeah yeah they're secondary the struggle also is and you know people start saying this thing well you'll just post in both places but if you're trying to maintain a conversation and you're trying to very hard kind of it's very hard to do that across both platforms now and so i think that's that's going to be the challenge and what will end up emerging and i think um i think we had it in our show notes i think adam had a really good post saying look i just think we're they themselves are saying i think we're just going to become two different things i don't think they're trying to yeah here we go right and so why don't you uh read this out jay cal um the goal isn't to replace twitter the goal is to create a public square for communities on instagram that never really embraced twitter and for communities on twitter and other platforms that are interested in a less angry place for conversations but not all of twitter politics and hard news are inevitably going to show up on threads they have and on instagram as well to an extent but we're not going to do anything to encourage those verticals so he's basically telling journalists we really don't want you on here talking about ukraine talking about ai threats yeah because that debbie downer news is not where advertisers want to be so this is another i guess if you were going to make an a if you're going to list all the attack vectors for twitter even pre-elon owning it um the fact is this highly intelligent people debating very controversial subjects gender woke politics politics wars geopolitics technological edge cases and dark stuff advertisers don't always want to be next to that some don't mind they just want audience but other ones might be very brand conscious right so that's another attack vector but i'm surprised they didn't embrace journalists because journalists are tend to be on the woke side of things there may not be fans of elon and they probably feel very bad about losing their blue they i know they felt very bad about the blue check mark thing i mean caris wisher talks about and professor cole takes like they talk about elon incessantly on twitter yeah and they've invested in post news or something like the competitor and i'm like Why are you guys on Twitter if you're investors in post?
57:46Go to post news, news post. Well, and also Meta's had this like battle with news organizations. Yes. Like the big thing happened in Canada recently and Australia as well. Very good poll. Right. Where, you know, they have this challenging relationship with news organizations now. Which is I think why that was called up. Where news organizations want to get paid and Zuckerberg does not like to share revenue. So I have a prediction here. you know what i think let's hear it well um i think this is a fight that zuckerberg does not want to lose so i don't think like remember he came up with like poke to attack snapchat and he yeah he did it like i think he did four or five competitors to snapchat before just saying you know what screw it put it in instagram i give up i'm not gonna make a standalone thing i have a feeling that threads will become a feature inside of instagram and they'll just be like threads next to photos just like they've like a tab kind of a situation because i think as a second app it doesn't work yeah i would rather have a single app like instagram i don't want to give him like the roadmap here but um i think having a tab with threads without images so images are not allowed in it yeah it's you know you can't attach an image you can only do text that would be a better place for it to live and then you get 100 i don't have to rebuild the graph like i literally did not check follow everybody because i don't yeah i didn't want to do that and send a bunch of alerts out i accidentally did it and it was like it's been a mess well yeah so i was like i'm not just gonna follow everybody or i'll restart my graph and then i was like i do not feel like playing the rebuild my social graph for the 50th time in my life i don't know how many times i don't know the last time i had oh clubhouse was the last time i started rebuilding i was like this is just not worth it i think the audience is exhausted with that but i do think he's i i do like your angle of this is how to get a data set so if if they did this and it didn't make any money for them but they did get like more text and discussions uh that they could use and and topics of today's like what are people talking about that we can use for an llm because remember right that's what this is all going to go to is having these llms to help people and decision making and things like that and i think this is a great way to get one of those data sets this is why google should have not given up on doing social they should have kept doing it they did google buzz which was an extraordinary social network before google plus which was actually very well designed yeah um but when they did google buzz they had another one with a weird they had another one with a weird game too or it was one they did in south america during 20 time when you could just release products yeah like you're on your fridays at google there's something called 20 time where larry and sergey let you work on whatever you want on fridays pretty cool idea but what google buzz did was and maybe producer nick you can go find google buzz screenshots and i wrote a blog post about this holy cow google buzz is gonna like kill facebook now of course it's easy to dunk on me but they gave up on it for privacy reasons which they shouldn't have what you see here um when you look at google buzz and this is um your inbox right gmail and then right under it was buzz and it told you how your updates so you get in there and you get like a twitter or a facebook box hey what are you doing you type into it and then you see everybody else's it was brilliant it lived in your gmail box google should go back to this because you can write an email or you can just give an update inside of your email and it's right there it lived in a perfect spot google gave up too early sometimes it takes five or six swings to get something right google did three swings orchid buzz google plus if they had done the fourth and the fifth swing i believe they would have built um a coexister maybe not one that beat it and then do you have my blog post where i uh i wrote about this uh google bug is brilliant like groundbreaking game-changing brilliant this is when uh business insider used to ask every 2010 this 2010 google bus one point bow was better than facebook after six or seven years true statement facebook's history is one filled with stealing other people's innovations i wrote this in 2010 13 years ago and doing them better i zuckerberg has stolen every idea evan williams and the twitter team have released how ironic that now google has out facebook facebook 3 google has an excellent privacy record and facebook is a disaster most folks do not trust zuckerberg and facebook because of their privacy record it's pretty crazy google buzz auto generates your network this is much better process than facebook's google buzz is way faster than the sluggish facebook this is a huge advantage google buzz puts relies and updates into your gmail as threads this is brilliant and a huge advantage anyway my assessment was perfect they just gave up they turned off google buzz because they got too many privacy complaints and this is what happens to a big company oh look at this they wrote you can sign up for jason's excellent email here that's hilarious um anyway there you have it folks i and so i think if threads just keeps going and zuckerberg well is really good it's even and so social like no one knew at least you know obviously back then the end game now is for the world's best llm which will be sort of the underlying api for everything and it you know circles back around to what twitter's real value means in this ecosystem today versus everyone else especially with all the work that's happened around you know scraping and turning off scraping and monetization from scraping i think it's really really fascinating uh all right any lightning round stuff you want to go through here i know i had a couple of other items of docket or we can leave them for next week the other story that i thought was really good was the inflection ai oh yeah explain this yeah this is a huge number of gpus right yeah i saw this go by yeah yeah so uh inflection ai it started by a co-founder of deep mind mustafa and reed hoffman and um you know they raised a massive amount of money i think uh 1.3 billion dollars on a significant valuation maybe four billion dollars um a couple of interesting things here right the list of investors like microsoft nvidia reed bill gates eric schmidt wait a second so wait bill gates and microsoft are mortal enemies with eric schmidt and google and microsoft and bill gates are massive investor or microsoft's massive investors in open ai so they are obviously hedging their bets here why not invest in two language models two better than one is that what i'm seeing here yeah and this one's even more interesting because alongside of the language model bet This one is a significant hardware spend, right?
1:04:35And I believe they kind of are planning to have something like 20 ,000 H100s available in a cluster. These are NVIDIA's AI computers, cards, whatever you want to call them. Exactly. Yeah, their AI system on a chip or something, more than that. So they're going to spend hundreds of millions of dollars building that cluster. Correct. and now is maybe even close to a billion i think if you do the numbers like the majority of that 1.3 billion will be consumed by the creation of that cluster wow because those cost how much now 150 000 or something 40 000 i think i think retail like no 20 000 oh 20 000 okay so a thousand would be um 20 million 10 000 would be 200 million 20 000 would be 400 million so 400 million as a just a floor number yeah yeah and you know you got to add on other things that's just the and you have to rack them somewhere so wait a second why why isn't this part of azure why don't they just i wonder if they're buying them and putting them in azure's cloud or if they're buying them and building their own cloud location facility why do microsoft's part of a deal that involves you know some kind of cloud infrastructure it's usually part of their you know trade is that hey you're you know you're going to use our infrastructure in some way shape or form right and they've been really good at that so that that could have been part of the deal but we don't know i wonder if that would fall into round tripping uh you know where these deals could greatly enhance microsoft's and nvidia's these kind of deals could optically make nvidia stock and microsoft stock look more valuable and the value of the stock would go up because you just got a 400 million dollar order remember they said they were gonna actually in the notes here it's it's 40k so it's actually 740 million so 700 so 800 million dollars comes in right or something like that in new orders that's gonna make nvidia stock a way up so let's say nvidia gave them 500 million dollar let's say of the 1.3 billion nvidia gave them 400 million a third of it yeah they gave them 400 million and then they bought 800 million worth of hardware they're basically just shipping the 400 million back to them yeah and they must have a 50 margin on those machines so essentially nvidia stock goes massively up by billions of dollars because of that order yeah and they got their money back and the startup is essentially in a way painting the tape or wash trading in some way nvidia stock now this could be completely inadvertent but that is the result that will happen here is this order will make more people buy nvidia stock and the money comes right back to nvidia this is something the sec is going to be all over yeah well the nvidia is the real winner here and even microsoft right because maybe all of those end up in a microsoft data center right so if they're a big part of this microsoft put in 400 million yeah and then they host them and then they send the credits back and they give yeah 200 500 million back to microsoft over the next couple of years that's a round trip too yeah this is uh i i don't know how people who are so sophisticated are doing something so something that sends up so many red flags they must have some plan to well it's really make this clean it's fascinating and that we're just talking about the hardware side of it jaykel but like you know flipping back around i don't know if you've had a chance to talk about it but you know twitter twitter did shut off access to uh like basically almost every service right and and it was even breaking i message and signal and everything else and so um in today's world like how do you stand something up and i know you had a tweet you asked hey what's the go-to service and i think i linked to something there right there's a yeah there's a couple of things out there but it's also fascinating where are these folks going to get data from and then we had a follow-on saying hey look if you've ever trained a model um if you've ever trained a model and you have some type of restricted data in there it is in the model forever until you retrain and so this whole world is super interesting because if you have that much investment on hardware where are you getting the associated data from that is not restricted at this point such that you can leverage such a huge amount of hardware that you need do you think the next set of models will be weaker than the previous set because of this i i think if you're creating a model from scratch, the answer is yes, because when the models were previously created, so I think, um, and you know, I say this with about like 90 % certainty, Twitter changed their policies post Elon's takeover.
1:09:23And, and so if you were trained off any data from before then, and you're, you know, your models are using that for, um, you know, their training data and they can use it for their own reasoning, I think it's fine. But I think if If you have any data beyond that point, you can't. And I think it's going to create a real problem for folks that are starting from scratch today. That's what I want to be. Let me ask you a technical question. If you did train on Reddit, Twitter, or Core's dataset. In the past or previously? Yeah, previously. In the past. And we know they have because people have proven it, right?
1:09:57Yes. Because you can ask the LLM and it will pull information from it, right? So there's no doubt that they did that. Correct. I'm not going to pick any particular company. um so if you did train on that does that mean you have that information stored in some giant database in other words you took every single core question and you're storing them somewhere or you have the resulting hashes of those so it's masked therefore if you were to say give me um i want you to go into your llm like i have a cause of action like a legal action against somebody who made an llm um let's say an open source one even you know um and let's say the facebook one which is called llama llama let's say llama had crawled reddit yeah and uh we know that could they rip out what it learned from llama knows what data is still stored in the language so so you know it's probably worth a longer discussion with some demo and we'll queue it up for the next one and i'll i'll put a demo together um when when these things are used when data is used to train a model, the data is basically turned into an embedding.
1:11:08And that embedding looks like a number between minus one and one. And so I don't know if you remember from the summit, I kind of gave an example. So it's never stored as it's kind of holistic nature of whatever you took. It's basically broken down by the model tokenized and then turned into a probability, which is then tied into, you know, what probabilities does this mean to the previous word the next word and so it's not kind of stored as a holistic thing where they can that be untangled could it be reverse engineered to prove that these words it's giving in an example came from yes you will be able to do that right because in in those cases you can ask it a question and you'll just use an example like you can go to open ai and you can ask it a question about you know what does it know about elon's tweets and they'll say well i don't know anything after September 2021.
1:12:00But before that, I know the following. And I think the tweet thread that I had that you retweeted that Elon commented on, I had a little share, you know, like the OpenAI share in there that showed it's kind of data. I don't know if Nick, you want to pull that one up. But that one showed the history of what it understood of the training data from tweets that it had prior to September 2021. Yeah. so this is kind of interesting because i think they know this and now when you ask it to give you tweets it says as an ai language model i don't have real-time access to specific individual social media accounts or tweet history or their tweet history therefore i don't have information on jason calacanis's top tweet topics from 2019 to 21 so they are preparing at open ai i think for eventually having to rip out all the tweets so the balkanization has happened it's so funny the The guys on All In were like, this will never happen.
1:12:55And I was like, I think this is guaranteed to happen. They don't have to rip out all the tweets, right? Because it'll depend on when the terms changed. You know, they could argue, even if the terms of service didn't say that, that they've created a derivative product and they want them to remove it. Yeah. But prior to Elon's takeover, what if they were paying for... Oh, that's different. Yeah. Who knows what that contract said? Yeah. Exactly. we don't know if there was a even if there was a contract the contract might not have taken into account ai so yeah they can then but it is interesting like you can't get tweet data any or i don't know if you ever could but i'm using gpt 3.5 so here here's my uh you know from the tweet that we had together um which is you know this one um and so this is what i said i said hey summary of the last five tweets email elon speech i've accessed okay and it says i don't and then i said what is the general theme of elon suites in your training data and then it says you know as of the cutoff spacex tesla ai cryptocurrency humor and pop culture personal benefits and opinions i wonder if we got that from like business insider wall street journal topics about his twitter or i mean twitter data itself so being able to rip it out possible not possible do you think they built in a kill switch to be able to remove stuff knowing that this would happened i mean sam altman and greg are smart they had to anticipate people would not be happy about this and they did it anyway they broke the rules yeah to make the model as far as you know my my understanding and experience you have to retrain from scratch you cannot take things out now are they going to retrain from scratch anyway is that the best practice when they make gpt5 are they starting from scratch or are they taking gpt4's learnings and then building on top of it what's the better thing to do so this is an interesting topic uh maybe we're spending a minute or two on one of the things that sam has been saying and others have been saying something similar including you know brad and he talks to a lot of people um there sam has been pretty open about they're not training another model right now and where the majority of their energy is focused on is taking the models they already have and enhancing them so that they can have more memory and become personalized.
1:15:14And so, you know, today, whenever you go to open AI, it's sort of, you start from scratch. You have a history of everything you've done, but there's no collective learning from all of what you've said to say, okay, I kind of know the theme of what Jason wants. And maybe he wants me to always answer things like a pirate because every time he comes in, says reply like a pirate, right? And so he always wants things in table format with short sentences. Exactly. And so the, you know, one of the things that he's been very explicit about, they're not training a GPT-5 yet. but they're spending their energy around these kind of ancillary things to make the model much more personal and have memory related.
1:15:51Yeah. If they have customers now, see, this is the burden of customers. Yeah. Because they have customers, the customers are pointing out all the weaknesses. So now they start getting into the edge cases or how do I make this more polished? Once you have a car on the road, you know, when the Tesla Model S comes out, now all you've got is feedback about the model s this should change this should change and you start going down the punch list of to-do items as opposed to making the model three or the model y and having a fresh start with a new platform so this is well this is going to be their challenge i think it's it's partly that which is they've got customers and they're they're stuck on it i also think it's partly maybe it's good enough and it's become such a great reasoning engine like our little experiment we're going to work on jcal where it already knows sort of how to take on tasks and figure things out it just needs a set of sub agents to do what it needs and we don't need to make the larger model any better because we don't want it to be an information retrieval system we'll have agents use serp api and other things we've talked about and it's good enough like they may have just realized that at this point yeah okay this has been another episode of this week in startups our ai edition sandeep madra sunny you're so great um please don't sell your company make it into a unicorn let's get to a billion dollars on this one please okay i don't know what i invested i'd probably invested a 30 40 million dollar valuation i need to get anything for you please i mean i just want to turn that 250 i put in into 25 million is that too much to ask you're an lp in the funds i mean just get me get Get me a hundred X on this.
1:17:27A hundred X is just so great. What you, I know you're working with some companies. You can't say the majority of the names, but if there is a corporate enterprise company out there or a category of company that you can do, definitive intelligence can do great work for right now. And I know you have a short, you don't have an unlimited list of open slots on the dance card as it were, but if there were one or two dream customers for you, which would be the dream customers? Yeah. I think folks that have made giant investments into data infrastructure. So, you know, folks that have put a lot of money into creating data lakes or warehouses, and they want to extract more value from that.
1:18:04And they want to do it in a way that leverages AI, not just from humans, but AIs automatically. So imagine there's, you know, agents that can look at your data, whether, you know, all day, all night, and kind of find the insights you're looking for. I think those are the ideal set of customers for us. So I could see an e-commerce company with a lot of data, a finance or a fintech company with a lot of data, your Robinhood, you got a huge amount of trading volume. Yep. Can you just sit there and ask questions to the Robinhood data set? It would be incredible, right? Tell me about trades. Tell me about what was popular, what were the most popular stocks last year compared to this year?
1:18:41Yep. Which ones have fallen the most, which ones get the most amount of chat? Or people with a lot of data like Reddit. Yeah. Someone like Reddit needed AI help. They could hire your firm to make interface. Or even Twitter needed people help with data. They could hire your firm. Yeah. Yeah. Got it. That's kind of the ideal type of customer. And look, that's what we're working on. We're very excited. So you're Sonny at definitive.ai or io? Definitive.io. Definitive.io. All right, everybody. We'll see you next time on This Week in Startups. Bye-bye. Thanks, partners and sponsors.
1:19:19Thank you.
From the publisher
Fin can’t burn its mouth on hot pizza. Or wave at someone who wasn’t waving at them. Fin can resolve half of your customer support tickets instantly before they reach your team. Meet Fin. A breakthrough AI bot by Intercom – ready to join your support team today. Visit https://intercom.com/fin
Eight Sleep. Good sleep is the ultimate game changer. Now you can add the Pod Pro Cover to any mattress! Go to eightsleep.com/twist to check out the Pod Pro Cover and get $150 off at checkout!
Carta now lets you launch and administer SPVs for your syndicate. Share your knowledge, capital, and network to launch your syndicate SPVs through Carta. Get 10% off your first SPV with promo code TWIST at http://Carta.com
*
Today’s show:
Sunny Madra joins Jason to demo VenturusAI (11:01) and other tools, before discussing Sunny’s new AutoGPT project (34:38). They wrap up talking about Meta’s launch of Threads (49:08), Google’s attempts at building a social network, and Inflection AI’s new supercomputer (1:00:13).
*
Time stamps:
(0:00) Sunny joins Jason
(1:49) ChatGPT sees a decline in growth
(10:22) Fin - Try Fin, Intercom's new AI customer support chatbot, at https://intercom.com/fin
(11:01) Sunny demos VenturusAI
(24:29) Eight Sleep - Go to https://eightsleep.com/twist to check out the Pod Cover and get $150 off at checkout!
(26:01) Sunny demos Vercel
(34:38) Sunny's new AutoGPT
(41:58) Carta - Go to http://Carta.com and use code TWIST to get 10% off your first SPV
(43:29) The decision to be open-sourced or closed
(49:08) Meta’s new platform Threads
(1:00:13) Google’s attempts at a social network
(1:03:28) Inflection AI's supercomputer, roundtripping and training LLMs
*
Read LAUNCH Fund 4 Deal Memo: https://www.launch.co/four
Apply for Funding: https://www.launch.co/apply
Buy ANGEL: https://www.angelthebook.com
Great recent interviews: Steve Huffman, Brian Chesky, Aaron Levie, Sophia Amoruso, Reid Hoffman, Frank Slootman, Billy McFarland, PrayingForExits, Jenny Lefcourt
Check out Jason’s suite of newsletters: https://substack.com/@calacanis
*
Follow Jason:
Twitter: https://twitter.com/jason
Instagram: https://www.instagram.com/jason
LinkedIn: https://www.linkedin.com/in/jasoncalacanis
*
Follow TWiST:
Substack: https://twistartups.substack.com
Twitter: https://twitter.com/TWiStartups
YouTube: https://www.youtube.com/thisweekin
*
Subscribe to the Founder University Podcast: https://www.founder.university/podcast




