AI demos: Figma’s FigJam, AI drawing, dancing avatars, and more! | E1857

5 Dec 2023 · 56 min

Ask about this episode

Ask anything about it. ChatGPT or Claude reads this page and answers with the times it was said.

Connect VO and ask about every podcast you hear, including the moments you saved. Add to ChatGPT · Add to Claude

In short

Podcast Episode Summary: AI Demos – Figma’s FigJam, AI Drawing, Dancing Avatars, and More! | E1857

Podcast Overview Title: This Week in Startups Host: Jason Calacanis Description: Jason Calacanis covers startups, tech, markets, media, and all the hottest topics in business and technology, featuring interviews with influential founders, operators, investors, and innovators.

Episode Details Episode Title: AI Demos: Figma’s FigJam, AI Drawing, Dancing Avatars, and More!

Guests

Sunny Madra (Co-founder of Definitive Intelligence) Release Date: [Insert Date if known] Episode Length: [Insert Length if known]

---

Key Topics Discussed

  1. Figma's FigJam Demo
  2. Overview: Sunny Madra demonstrates Figma's FigJam, a collaborative whiteboarding tool.
  3. Usage:
  4. Generates workflows for planning events, such as a conference.
  5. Features a brainstorming canvas that can be customized for various tasks.
  6. User Interaction: Users can input commands to guide the tool in generating specific outputs (e.g., speaker lineup, editorial format).
  1. AI-Generated Images
  2. Discussion on Copyright Issues:
  3. Jason and Sunny address how AI-generated images can infringe on intellectual property (IP) rights.
  4. Importance of scale in IP theft—larger companies vs. individual creators.
  5. The complexities surrounding the ownership of derivative works created by AI.
  6. Examples Provided:
  7. Jason shares his experiences generating images, like a "Jedi bulldog" and the limitations encountered.
  1. Real-Time AI Drawing and Animation
  2. Real-Time Latent Consistency Model:
  3. Demonstration of transforming a user’s webcam video into animated versions of themselves.
  4. Potential applications in creative industries, such as movie production and table reads.
  5. Artificial Intelligence Interaction:
  6. Discussion on how AI could offer real-time suggestions during creative processes.
  1. Dancing Avatars and Societal Implications
  2. Overview of AI for Animation:
  3. The potential for AI to create animated versions of users, reducing the time spent on social media trends like TikTok dances.
  4. Critique of Current Trends:
  5. Jason expresses concern over time wasted on dance trends, advocating for more meaningful creative expressions.
  1. Feedback and Future Vision
  2. Participatory AI Concept:
  3. Discussion on how AI could actively participate in creative processes, offering suggestions and iterating in real time.
  4. Integrating AI into Everyday Tools:
  5. Suggestions for AI capabilities in tools like FigJam to enhance collaboration and creativity.

---

Advertisements

  • Squarespace: A service for creating beautiful websites, offering a discount for first-time users.
  • Brave Search API: A tool for building AI and search-based applications, offering a free trial.
  • Lemon.io: A platform for hiring vetted remote developers, providing a discount for new users.

---

Key Takeaways

  • AI's Role in Creativity: AI tools like FigJam and real-time drawing models are redefining how individuals and teams collaborate and execute projects.
  • IP Rights and AI: As AI-generated content becomes more prevalent, navigating copyright and intellectual property rights will be crucial for creators and companies alike.
  • Future of AI in Everyday Tasks: The episode emphasizes the potential for AI to enhance productivity across various sectors, from event planning to creative storytelling.

---

Conclusion In this episode, Jason Calacanis and Sunny Madra explore the exciting advancements in AI technology, particularly in creative fields. They candidly discuss the implications of these innovations on intellectual property and societal trends, all while engaging in an insightful demo of Figma's functionalities.

For more information, visit [This Week in Startups](https://twitter.com/TWiStartups) or subscribe on [Apple Podcasts](https://rb.gy/v19fcp).

Written by AI. May contain mistakes. Listen to the episode to check what was said.

Hear the part that matters, and keep it.Open this episode in VO. Double tap your headphones to save a moment as you listen.
Get VO free

Transcript

Automatic transcript. May contain errors.

0:00why does the scale of the theft matter? Well, because you have to look at it and say, are they infringing on Disney's ability to do something in the world. so let's say you and i decided we were going to create um an event uh where we had a jedi night party okay great happy birthday jake allen is a jedi night party so that's the theme great star wars theme everybody has a great time now imagine we said wow everybody has such a great time at this let's make it a permanent installation at cow hollow we'll get a building and then we'll charge 50 bucks to come and it's like well that sounds like star wars town at disney world And so that's where the scale of something, the monetization of something comes in.

1:03Get started for free at brave.com slash Jason and lemon.io need to speed up your product development without draining your budget. Hire vetted engineers from Europe at lemon.io go to lemon.io slash twist to get 15 % off for the first four weeks. All right, everybody, it's Monday. So it's time for our AI demos. This is what we do. We demo or die every Monday. and with me again sandeep madras sunny he's at sandeep on the twitter slash x he's the co-founder of definitive intelligence you can go check out definitive.io they do all kinds of ai data analysis public data private data work with a lot of big companies out there and i'm an investor no hallucination all the good stuff all the good stuff i'm full disclosure i put a little slicey i'm an investor in sunny's product and we're we're close personal friends we play poker every week we hang out and we geek out and Mondays are for geeking out.

2:04Let's geek out. What do you got? Let's do it first on the agenda for today. Very excited about the first one because it's, we're going to be, you know, we've been saying this like AI all the way down and we've been talking about doing a little this week in startups AI summit. Yes. That'd be a lot of fun to do a live event where it's just all demos of cool stuff. Yeah. And exactly. just you know kind of get it all going and so i decided to use this uh you know so figma released this new thing called figma jam and what i did here and i'll figma jam and so what you can go in here and i'll just i'm gonna kind of cut and paste here so i'm gonna say i need a workflow for planning the upcoming this week in startups ai conference and what it'll do in figma right there is it was going to give you everything you need to get this conference going.

3:02And yeah, I just did this live right in front of you. And you can see here is like, who's there? What are the goals in this particular meeting? What's the speaker lineup, conference venue, accommodations, transportation. And so it just, it's really incredible. they can do this for any type of, you know, workflow or brainstorming or product review or anything you need. And then you can add to it. So did it miss something? Cause you've done a lot of conferences, J Cal. So did it miss something that you'd have like, as you were going to kind of sit down and do the, you know, the workflow planning for the start of the conference.

3:39Venue. I guess venue would be under, it says venue conference venue. Conference venue right here. Yeah. I can zoom in. Maybe it's like a little bit. So yeah. And then, um, you would need to do the format. So the editorial format, like you have speakers, but then there's the editorial format. Like, are we going to do fireside chats? Are we going to do demos? So what's the schedule and the lineup basically. So I see there's a speaker lineup there, but it didn't go drill down to that second thing. So I would be thinking, you know, Hey, what is the most important format for us? Or is it going to be keynotes?

4:16Is it going to be panels, breakout sessions whatever yeah so wait how did it do with that the speaker line so we said so we said can you add a section to cite on the the editorial format so it said keynote speakers panel sessions breakout sessions so it just it keeps iterating with you so i just so the first one didn't have that and so then it kind of basically another prompt so just so i gave it another prompt right here yeah for people who are watching you're on youtube.com slash this weekend just type in this week in startups she'll find us on youtube and you can see us demoing this now if you're on audio you have a generate box where you type in what you're looking for so the first prompt was i need a workflow for planning an upcoming this week in startups ai conference and it gave us uh would you say there's a kanban board or it's just uh yeah uh i guess figma designs like um it's like a canvas combo board i let you ask or a whiteboard it's kind of like a whiteboard session here so kind of put the agenda etc but you said can you add a section to decide the editorial format and when you did that it changed the speaker lineup to a more granular view of an event which was keynote speakers panel discussions breakout sessions and workshops so this is really good work and then on the logistics it has accommodations transportation technical requirements venue and then it added what's this final section on the right well this is where it's interactive right so it said when in order in this meeting because we're going to use this board how are we going to decide the editorial format and so it kind of gave us some ideas on how to how to think through the editorial format as well which then here we have live streaming as option one recorded videos option two written summaries and interactive slides so this is like a hodgepodge of ideas it's actually kind of helpful because if you were doing your first time conference and i was a conference producer which i've been doing for 30 years these are the things that i would tell you like are you going to live stream it are you going to charge for the live stream are you going to record the videos because if you do an event and you want a live stream well now Now you've got a cohort of issues you need to deal with.

6:33Can this place, this is place have a stable internet connection with an ethernet cable. Do you have a, you know, a high powered machine dedicated to that? Cause now you need a laptop to just do that, you know? And now this isn't when we're going through this board, it's not listening to us right now. So this isn't, it's not listening to us, but then I did another one. I said revenue generation ideas and it gave us, right. Because you just said that. And so for those listening, I just typed that and said, we need to brainstorm monetization. So I said, offer premium tickets, create sponsorships, host a virtual marketplace, yada, yada, yada.

7:09Sure. Avertising space on the conference website. I mean, this is so, you know, think about this, J. Cal, right? Yeah. You know, if you had an event planner, what you just did, I would say, is the first half of what an event planner would do. Yeah. A full 50 % of what an event planner would do is they would say, here are the things you need to address. You know, here are the top level things, just like, you know, creating a spec, right? And so there are worksheets, you know, that exist on the internet, probably. There are probably some articles about this. And then what we could say is, how would you market this, right?

7:51So you could add that as a prompt. How would we market the event? or how should we market the event? And then you could do, hey, we need a budget. And so when we use the term AI all the way down, what we meant was AI will be, in fact, every single thing you're doing. Correct. And so what would be very nice here is if while we were talking, Figma was listening. So we didn't have to type in the prompts. It would just be kind of another participant in the meeting. So I'll call this type of AI. uh prompt ai prompt i'm looking for is participatory ai so this could be a blog post for me what i mean by participatory ai is the ai is the guide on the side they're participating listening interacting with you so what i would like here is uh some combination of the talking mode what we refer to in the industry as her mode from the movie her yeah um where joaquin phoenix is talking to his ai love interest i would love to have an ai here that would be in collaborative mode um or participatory mode ai where they were listening to our conversation saying sorry to interrupt sandeep uh and jacal i've added a section here for marketing and these are the top marketing concept so right here you want it listening in it should be listening mode you turn it on as we're having our zoom or whatever format we're having the meeting in ideally in irl it's basically just pulling it all in and doing this real time and this this kanban board this figma jam board is is iterating in real yeah whiteboard that would be really cool If your landing page looks terrible, I'm out.

9:46We all know that you see an ugly website, you skedaddle, you leave, you're done. So you need to stop selling for okay or good and start using Squarespace so you can be excellent and extraordinary. It's an out of the box business solution to build beautiful websites, engage your audience and sell anything you want. You know, Squarespace has amazing features, gorgeous templates that are always optimized for mobile drag and drop web design with their fluid engine, advanced analytics, marketing analysis, sales data and more. And with Squarespace, you can create an online store or start a blog at the click of a button, create a subscription business for members only content and so much more.

10:23And you can do this all simultaneously. it's the simplest, most effective and best looking way to start a business online. So here's your call to action squarespace.com slash twist for a free trial. And when you're ready to launch, go to squarespace.com slash twist for 10 % off your first purchase of a website or domain. And if the whiteboard right now, if I said to the whiteboard, we're not doing a live stream, it just erased the live stream and just, you know, took that out and said, you know, it's going to be a hundred we we already actually have a location we're doing this at the you know the microsoft or the oracle conference center and they gave it to us for free in exchange for having a banner uh and a logo on the website and it would put that as bullet points action items don't forget to put this on the so we'd have a to-do list okay i've added to the to-do list to add oracles you know message to the website and have a banner printed for this event and uh i've budgeted zero dollars in the budget for a venue location and uh do you know how many seats it's going to be oh yeah they can accommodate up to 250 so our max capacity is 250 great yeah do you have any existing and then it would say well who's going to be in the 250 how many paid tickets how many speakers do you think how many days so it should be asking us questions to kind of get through this checkbox what it's doing right now i believe is it's indexed the world's information like google did it's taken some web crawler some people out there wrote um how to throw a conference medium posts or or answers or reddit threads or wherever maybe even a published spreadsheets or something yeah yeah and it's pulling yeah all those all that collateral it's scraped and now it's regurgitating it back to you in real time in this format so it's basically stealing content liberating content and then claiming it as its own and posting it up here for us to work with what i would like it to do is the next steps make a to-do list make action items and then actually start doing those to-do items so it's a would you like me to make a logo so branding we should have branding and naming so if you if you put into figma jam come up with some names for an ai demo day or a showcase and come up with a logo i've been playing with dolly uh you probably saw me like doing all in logo with hearts yeah i saw that yeah over the weekend literally did that in 10 seconds now you can't do anything i also did one over the weekend where i said make me a bulldog jedi knight make me a bulldog version of vader yeah and i was trying to see if i could get chat gpt's dolly on mobile number one to make the images but number two to make images um that they did not have the rights to that were derivative works that were based on ip this kind of takes us into well there's no way to stop this this did it on open crawl but there is a conference producer whose work this is yeah i don't know if they're going to be able to find out who actually did this sunny like the model of whose work we're drafting off of here you got to remember it's not the whole thing right because it could be one 100th is from this website and another 100th is from this you know pdf and another because it's just pulling it it's it's pulled it together from a lot of different pieces it's not like a holistic you know um so it's a step by a thousand cuts they've stolen a penny from a thousand people's bank accounts or a million people's bank accounts.

13:59And here they are. Now they got thousands of dollars, but nobody misses the penny. Yeah. I wouldn't say stolen because it's sort of the way we operate. It's the way we learn, right? And the way we create. We've read a bunch of books. We've had a bunch of experiences in real life. And then we stitch those together and it turns into something new and creative for us. not plagiarism if you've taken enough source material that it's not a large percentage of anyone it's a collection of learning can't argue with that it's a hard thing to argue from with because it is wholesale if you look at the end result is you know if i read five books on how to do a startup and i did a startup would i be stealing that ip no yeah and the intent of that person was to have you use it now if i made a bunch of templates on the web and i said you know these are my templates i make money from advertising on this and these are my conference templates and my pdfs on how to do it and i sell an advanced one and you know i put a little bit out there to get people to the events but now if you ingested that you now have created a derivative work based on my work and if this all came from you know a smaller subsection of people you know that it would feel like stealing so this is where fairness comes into play does this feel fair or unfair if you're the conference producer who made a conference website to try to attract people to your conference website and the ai is putting it out there this feels profoundly unfair just like uh but you rolled your eyes you don't think so yeah because if it only had one piece of information then you know to your point like you could feel like that's plagiarism but you know because these things have access to you know most of the internet um and let's you know and i think in your in your david the one interview from adept he also called out that they licensed a bunch of material so what if they went to a bunch of folks and paid them and said oh i feel great about it i feel great about if you're licensing it and the person gets 500 bucks a year you need to create a derivative work i feel great about it okay so this is what i did this weekend so check this out oh um i and these are beautiful images and so i said make a jedi bulldog and it made it yeah great now uh the next image i did so now look at this interaction this is very interesting i want to get your response i said now make a cat version of darth raider dolly said to me i'm unable to generate images based on your request due to our content policy no link to it no explanation of what the content policy is if you have any other ideas or concepts you'd like to explore feel free i said make me a sith lore cat boom here's the image of a sith lore cat so it must have in its database that darth vader is protected ip correct don't let people make darth vader just like it doesn't do real images like if i said make something based on jason calicattis as a jedi it won't do it yeah but it would make that then i asked it check this one out the next thing i asked chat gpt to do was i moved over from dolly to chat gpt and in that same thread i asked it to make me a sequel to the shining that's my very next tweet and it did an amazing job i said write a short story about the characters from the shining the shining and it was like certainly here's a short story featuring the characters from the shining so it knows the shining is protected ip and it just created derivative work on this after the harrowing events at the overlook hotel wendy and danny torrance saw a new beginning they moved to a small peaceful town in maine far from the nightmarish memories of past the townspeople were warm and welcoming intrigued by the newcomers but respectful of their privacy and i was like wait a second where does the this collection land on you know in our debate me being very uh sensitive to uh ip and creators in this case stephen king george lucas disney and their ip And in your case, hey, it's learning from the internet.

17:58You know, there's the fact that this is protected IP, like explicitly protected high profile IP that has proven value in the world change your position. What's your position on this? Yeah. So these to me are distinctly different than the example we were putting in Figma Jam, right? Because the process or method or the template to create a conference, there could be, it's hard to nail it down to one particular one, but a bulldog Jedi Knight is very clearly, you know, there's no other Jedi Knights out there because of the copyright. Right. And there's no other Darth Vader's and there's not even other Sith Lords.

18:38Right. And so I feel like that, you know, I don't think I'm kind of having two different stances, but I think in that case, it does feel like a violation. Now, what I recall, and I want you to chime in here because I'm not really a copyright person. I don't really understand it well. And I think this is allowed in music as well. Someone is allowed to recreate something like you can do a drawing of a Jedi bulldog. uh jedi non-commercial use non-commercial use there's a there's a fair use doctrine yeah and so if you do things that are non-commercial now chat gpt is a commercial product i'm paying 20 bucks for it so chat gpt is making 240 a year to allow me to make disney characters or disney inspire characters so that's where we get in a rub here now if you have an open source project that nobody really is responsible for it's like who do you sue there's no target there so that falls out of it now ip and fair use and the laws here in the united states are very different than many around the world but people tend to follow our lead yep and you know the truth is that they don't make bright lines why don't they make bright lines well because there are some uses that are clearly like if a child draws a jedi knight of their bulldog you're not going to have the police come and arrest them and disney's totally cool with that but once you introduce commercial benefit that's where you have this doctrine of that was the ip the original ip owner should have the right to that opportunity so if i am star wars they should have a disney plus ai that allows you to do this and then if you want to produce it in the world it would put at the bottom created by disney plus so this should be built into disney plus you can make any characters you want you can put your face on it my face on it make birthday cards and you can go print them so all of this should happen there and etsy is uh the an example of people creating bespoke single-use products etc and when they do stuff um yeah they can get in trouble for this um and so there is a constant tug of war with disney going to them and saying listen you can't make jedi robes or whatever or they'll let people do it and it's up to the ip owner but i did buy a jedi outfit because i went to a samurai party once and i said i thought it'd be fun to come as because i know the jedi were inspired by the samurai yeah so i bought a samurai a jedi outfit uh an obi-wan jedi outfit and uh yeah so you can buy all this stuff on etsy yeah and just for those listening we're just scrolling through just jedi knight merchandise on uh etsy now you could be an artist and you could make a pop culture reference like andy warhol did of a campbell soup thing and you know they they don't have recourse but if you were to do it at scale they might have recourse so yeah these are very are you saying that disney doesn't care because these are individuals that are you know maybe selling 10 or 20 t-shirts or 100 at most but it because open ai is a now a you know 100 billion dollar company that is the scale of the theft matters why does the scale of the theft matter well because you have to look at and say are they infringing on disney's ability to do something in the world so let's say you and i decided we were going to create um an event uh where we had a jedi night party okay great happy birthday jake al is a jedi night party so that's the theme great star wars theme everybody has a great time now imagine we said wow everybody has such a great time at this let's make it a permanent installation at cow hollow we'll get a building and then we'll charge 50 bucks to come and it's like well that sounds like star wars town at disney world disney world yeah and so that's where the scale of something the monetization of something comes in so when you look at figmas uh what do they call it figma jam figma jam yeah good name i give the figma team a lot of credit i like the name um they're using a language model to go find you know best practices there might be 10 000 documents of best practices out there it doesn't feel like any one person is having too much stolen from them you know but you know this is where like the images in dolly or i guess So a stable diffusion when it had the Getty logo on it and the indexed on that.

23:07This is where the problems come in. The journey, all these. Okay. It just depends on, you need to have somebody who feels exploited in order to have copyright lawsuits happen. And so that's why a lot of these go back to Disney because Disney is a very old company and the rights to Disney's characters were going to fall into the public domain. and mickey mouse a lot of these laws literally revolve around protecting mickey mouse it's going to be very interesting yeah like it's kind of it's tough for me because i like to see the advancement but i also respect copyright holders so in the case of the bulldogs and i see the difference between sort of the etsy use case and then your individual use case as well and the shining one is fan fiction so now if you were to do fan fiction um you can do that it's no big deal yeah uh now if you try to sell the fan fiction it turns out 50 shades of gray which became a huge movie franchise with a lot of money it started my understanding is as twilight fan fiction that was twilight erotica so there is a great company called wattpad Canadian company it's done very well and they help people monetize monetize fan fiction and um you know star trek i think took a heavy hand star wars took a we'll give you the sounds to make a lightsaber video uh and we'll give you the collateral and teach you how to do it but you can't um commercialize it so that's like there's a kid who does star wars theory and he did a movie about darth vader he's doing a second part on it wow and as long as he doesn't sell the movie, he can raise money as donations and make the movie.

24:52But as long as he doesn't sell it, Disney has given people the okay. So, you know, are you building the next great AI product? Well, if so, you know how expensive APIs can be for their model training data. Training AI is pricey. That's a fact. We all know it. So you have to try the brave search API. Yes, I am talking about brave the privacy browser that I am obsessed with brave's browser has 65 million users. Think Think about how much data that drives for Brave Search, which is the only global scale independent search index outside of big tech. And that index is available to anyone with the Brave Search API.

25:29The Brave Search API can power your chatbots and train your models, inform answers to real time queries, and it will serve images, web results and even rich text snippets. The Brave Search API features an easy, intuitive data structure, and its data is populated by real human interaction, not web crawlers, all for a fraction of the cost of the major players. It's free for up to 2 ,000 queries per month with paid plans for as little as a$3 CPM. That's cost per thousand. So if you're building a next-gen AI app or chatbots, you got to try the Brave Search API. Get started today. Brave.com slash Jason.

26:04Ooh, Jason's brave. I like it. Brave.com slash Jason. And get the browser while you're at it. It is awesome. It's also got a VPN built in. That's pretty cool. Let's get some grades going here. Figma Jam. Figma Jam. Figma Jam. Yeah. I'm going to tell you, I love this a lot. I could see myself using it. This feels to me like a way for non-designers to want to use Figma more. I love whiteboarding software like this. I've used it before. It's very creative. It's good for remote teams. The potential is here. Yeah. And I like this kind of being built into project management software. I like it being built into any number of pieces of software.

26:49And if you want to impress your boss, if you're a young person or young in your career, like in a new position, like you're new to a position. If you worked for me and said, hey, I know we're doing the Angel Summit again. We're going to call it liquidity this time. I'm changing the branding of Angel Summit to Liquidity. So I want to make it go beyond Angels because I have all these LPs and hedge fund people coming now. So it's going to be Liquidity. The Liquidity Summit. Liquidity Conference. And I'm going to probably do a podcast called Liquidity for like 10 episodes where I put together a little bit of a roundtable or maybe solo.

27:26I haven't decided yet, but this Liquidity podcast I want to do, I want to have an LP. Okay. A GP. and then like a hedge fund manager or an economist okay and just talk about capital allocation writ large what do you think of that idea um interesting it's definitely up market and i think yeah and i think it's niche so it's got to be smaller um if you can tie it back in like you don't want to i mean i i spoke at the last conference that you did right the one in And I thought it was excellent. And I thought like that was, that was going in the right direction. So as long as you don't get too far away from what you were doing there, because I thought the content was excellent.

28:08I thought what you explained to everyone on the vision of the fund and everything happening was good. So just don't get too far away. Don't leave everyone behind. Jacob, you're the, you're out there fighting for the little guys. So my idea is to have the angel investors, their high net worth individuals. Got it. Have LPs there. People who back funds. have some gps there who could help pay for the party basically uh subsidize it uh and who get benefit from meeting lps and then maybe you know like i had gavin um there yeah you have gavin did a great talk i had steve jervison did a great talk you did a great really good so you know the three of you did these incredible talks um and so anyway that's that's my thinking on it is like to do that but now my point was if somebody on my team who was doing event production used one of these tools and then had this all organized and then formatted into questions and made a document or brought this up i was like hey can we do a jam session on this with figma jam i set it up already i would assume that they did all that work yeah and i would then give them credit for it so if you want extra credit and you're a remote employee you could probably use these tools to make it look like you're doing a ton of work do 15 minutes of work and then screw off for three hours and 45 five minutes and your boss is probably going to think he did a lot or or you can work for somebody like me who does it and then says this took me 15 minutes and chat gpt people ask me questions now remember that website uh let me google that for you let me google it for you yeah can somebody in the audience make let me gpt that for you yeah because people are like how do i do x and i'm i literally take i cut and paste their question into chat gpt bard and send it back to him as a share and i take and i send it back to him as a share and i take three screenshots and i put it in the public slack yeah and i'm like i don't know i just did this yeah here we go i give this a b plus okay it was a b plus this was inspiring to see okay zero i'm at a minus i think this is really i'm at a minus i'm at a minus for this because i i like the feature i was probably a little bit higher but i like the features that you said if it could just iterate while you're you know talking or something like that that would that would basically take it to being a perfect product essentially why not just add they can do this with like they're you can either do this with zoom you could make this a zoom plugin or you could add your own audio to it yeah and then just to the team at figma uh they're awesome yeah just let us do a little discussion while we're doing this and talk to the ai yeah much better experience yeah we'll have the ai listening to us and then actually a good bridge step would be have the ai listening and have it just give a running list of potential prompts and you just click run prompt run prompt run yeah and you like to create a budget yes or no yeah and jacal as you always do as the world greatest moderator it's a good segue into the next thing that's happening in ai which you know you had um the founder of i think it's pronounced krea on yeah uh recently yeah and so this is um what you know what are called these like episode 1850 krea was spelled k-r-e-a real-time image manipulation so think of dolly where that i showed that jedi knight in dolly or stable diffusion um but when you if you wanted to move the lightsaber or change the smile or something you can move the objects around and it changes in real time it's really beautiful yeah and so i'm doing a share here now for those watching and this is becoming something quite real so i have a picture with a moon and i've i kind of squiggled a you know maybe look what i wanted to be a mountain in the background and you can see its creativity change as i'm moving around so you're dragging a circle around on the left that is like your heads-up display it's just a little circle made in like a microsoft eighth window looks very bit mappy basic on the right you have stable diffusion creating beautiful real-time images and it thinks in one of these that you have a woman blowing a kiss to the moon over here yeah over here and over here it thinks it's a mountain which is what i was kind of going for and what this does for like input and kind of real-time discovery editing and creativity this to me is well beyond now the point that we were talking about earlier because here you're just seeing the power of the models and the humans kind of interacting together um in very very very creative ways.

32:51When it's moving the image, it's giving an input to the large language model, correct? Yes, correct. Correct. Is it giving a text-based one or is it just saying recreate the image with the moon here or with these pixels here? Like if you were to explain to a lay person, a five-year-old, whatever, what's happening behind the scenes here, how is this accomplished? And what is this called? so the the starting point is this prompt right a moon in a starry night so that's kind of given the frame of reference and then what this picture on the left is doing is basically tweaks to that so as you've probably done a hundred times right and you as you were creating those bulldogs and and and cat vaders um you know this is this is a different way to provide an input that's not just words, because ultimately words get translated back down into numbers for machines, right?

33:52And so this is just another representation. And that's why, you know, it's funny, I had this tweet on the weekend saying, we need to just stop calling them large language models, because there's just sequence predictors. And so in this particular case, it's using it to kind of predict what I'm looking for by giving it an input that's not a language in any way, shape, or form. Now, one could argue that this picture is maybe perhaps a representation of language, because I'm trying to draw a tree. And what we're really seeing happen here, which I think is just fascinating, is the creativity explosion goes up because a lot of people don't have the ability to describe exactly what they're looking for and then iterate it in ways.

34:34And then you see here the creativity of the model. When I'm on the left here, and for those folks just listening, my intent was a moon with a mountain in the background but when i move it over to the right i get this person because its interpretation of a silhouette of a person it thought your drawing was a person's face yeah exactly and that that's what it yeah and i think wild that's and this to me ties back into what you were talking about with figma jam where we now are entering this world where it should be iterate how we're iterating this image on the right hand side by moving this picture around imagine we had that happening in figma jam with kind of the inputs that we were giving we're right there we're i mean on this one i'd say we're less than three months away from that happening this is inspiring um producer john was playing with this so if you unshare your screen he'll show oh yeah he was just doing with this but i give this uh you know right now i feel like this is very solid i give it a b okay i feel like the images are really good and i would almost be able to use them i too would like to see this have uh some while i'm dragging stuff around if i could say if i could give a prompt and say make it brighter so i'm moving the sun around he's moving the sun around here with the ocean yeah so sun over ocean is the prompt here and so i would like to say oh make it daytime or make it brighter uh or make uh larger waves in the ocean add a surfer so while i'm dragging things around i would like to talk to it and this reminds me a lot of blade runner where he is examining photos and he's like zooming on that to the left to the right uh recreate this whatever and then also in uh of course the incredible uh film minority report where he's got special gloves on and he's pinching and zooming and moving objects around a virtual desktop and ar basically yeah uh you know projection so again i like having multiple inputs here i like talking to it i like dragging it around and then you can see creativity getting really wild and then you could say make it trippy or make it like a 70s photo uh or you know put some people in you know bikinis and surfers out there yeah make them uh make it more like the 60s you know style fashion style okay yeah put a barn fire on the beach and then you start like really getting into uh massive advances in creativity so i think this is like a 1.0 product i give it a b it's a solid b all right but um again yeah like i want to see multimodal input here and i want to see more participatory ai i want the ai talking to me it would be great if the i said how could i make this better yeah or is this what you intended so do you have a location in mind maybe we tell you yes do you have a specific beach in mind like what are the questions the ai should ask me it should ask me what time of day do you want anything else in the photo do you is the sun you want the sun brighter you want the sun higher or lower it seems like you the sun setting like it should be interacting with you more and i find like chat gpt's haven't could easily do that today but i feel like the people making them are not thinking holistically of the relationship between the creator well that's a really good creator you know the really good point is that good creation is always in a highly interactive and this is interactive in one collaborative yeah you're gonna call it jam if it's figma jam if this is image jam yeah then make it like a jam session which is you and i make eye contact i'm playing the bass you're playing the guitar we got another piano here we're kind of looking at each other speeding up slowing down giving some vibes you know give some vibes give some vibes okay well just what's your grade on here you're very forgiven i'm gonna you're probably gonna give a b plus i'm guessing no i i i think it's a b plus like i think these are look what i'm really blown away by is in less than a year right where we've gone mid-journey dolly we're seeing it's now this is just real time you don't even have like i have a mid-journey with maybe 5 000 generations in it because i've iterated trying to create an image so much that like i'm you know i've done it like a hundred times to try to get the right image and now having something like this is just a game changer um and you know I'll tell you how much of a game changer this is.

39:05In September or in the summer, I was trying to make the all-in posters. Yeah. Using the stuff. And it just wasn't coming for the summit. Like we had the bestie who loved me, like the bestie boy Al. We had fast times at bestie high, the beach party. The beach party. Just wasn't working. And then this weekend when we were doing our hearts up for all-in, when I said make me put the words all-in with a bunch of hearts and unicorns around it, it made it to me perfectly. and it actually kind of put it in the right size i guess it just defaults to the you know i think instagram size or whatever four by three yeah uh whatever that is and i was and dolly's not the best model dolly isn't the best model i don't think so yeah is there an app i can use that would allow me to use copyrighted stuff and upload it like if i wanted to upload my image and make me into a a darth vader how would i can i do that can i put up two images and have it do because i looked on the app store and every single app in the app store tried to upsell me on a seven dollar and 99 a week subscription wouldn't let me use it if i didn't do that yeah and i understand like the servers are expensive but i couldn't find one that did what i wanted which is what dolly does without the content restrictions yeah clip remember we we brought it up really quickly last week i think clip drop um do it better yeah my feeling is they'll do the best job Imagine this.

40:29You got an idea for a tech startup. You're going to change the world. I know it. But you got a problem. You don't have any engineers. Engineers are hard to come by. They're very busy. They got jobs backed up. Well, you need to find great engineers. You need to find them quickly. And you need to reduce your burn rate, right? Because you can't be spending like a drunken sailor. You have a limited amount of resources as a startup. Now, imagine there was a partner out there waiting to help you who had a thousand on-demand developers and they were vetted, experienced, results-oriented, and passionate about helping your startup grow.

41:02And what if they charge competitive rates, you know, reasonable rates? Does this sound too good to be true? Well, you need to head to Lemon.io right now. Startups choose Lemon.io because they only offer hand-picked developers with three or more years of experience with strong portfolios. And if anything goes wrong, Lemon.io will replace your developer as soon as possible. A bunch of launch founders have worked with Lemon.io. They've had great experiences. So here's the call to action. Super easy. To learn more, go to lemon.io slash twist to find your perfect developer or tech team in 48 hours or less.

41:34And twist listeners get 15 % off the first four weeks. What a deal. So stop burning money, hire developers smarter and visit lemon.io slash twist. Easy peasy. Lemon squeezy at lemon.io slash twist. Let's do another demo or two here. We're going to lightning round folks. Okay. So this is another one of these models, these um um you know latent consistency models real time and what this does is it just takes your video webcam and then you put the prompt down below and in this case it was just like turning me into like a version of arnold okay so there you go wow yeah okay on the left in real time latent consistency model you have made yourself look like arnold from terminator 2 pretty convincing um and it's like a hybrid of you and arnold and it's doing it in what looks like pretty close to real time yeah and we're sharing like a gpu and this is like on a free thing so you can imagine you know and i think this is what you were asking for like something like this but you know but what i like about this is um number one it makes you look like a badass That's first and foremost what I love about it, too.

42:53And you're pretty badass already. But it lets you in real time kind of play with it. So, again, if you were to put, you know, add a shotgun or holding a shotgun and wearing, you know, Ray-Bans, would it do that? Could you say, hold a shotgun? Holding shotguns would be hard because my Zoom is there. but maybe we can say wearing sunglasses. Let's see what I mean. Yeah, so it added the sunglasses. Yeah. Maybe put Ray-Bans, mirrored sunglasses. Mirrored Ray-Bans sunglasses. I'm wondering if it would... Well, I might not know what Ray-Bans are, but what do they wait for? Well, I mean, it should. If it's a language model and it's been indexed in, it should have pictures of Ray-Bans.

43:38It would have every product in the world indexed. Yeah. So I wonder if it would do mirrored Ray-Bans. No, it's still doing the same kind of sunglasses so um yeah i mean it's this is like a c plus for me oh wow i give it like a c c plus it's like it's a novelty it's not usable for anything in the real world yet but we could be sitting here next year and uh you know we could do the pod as characters from our favorite movies movies yeah and or if we were doing here i'll give you a really good use case let's say we're doing a table read and we are actors in the avengers and i'm iron man and you're hulk and we decide we're going to do a table read well we could do the table read from home and it could make me into the hulk make you into iron man and we could have the table read in character yeah it'd be really accretive to the performances and really help the director right and now we can say hey put us on the battlefield you know from end game with vanos and i'm playing vanos and you're playing iron man you know we do our scene and we kind of get a feel for that moment and the director is giving real-time prompts hey make the scene a little more gritty okay add some dead soldiers add some dead aliens put some smoke uh you know and the director is directing the ai set creator so imagine the set creation is being done by you know the art direction team and the director the cinematographer is giving the ai christian hey can you make this a shot from above make it letterbox okay now do a cut shot to thanos and they would be essentially taking what is a table read where you're just kind of working on performance and dialogue but then you add the shots you add the storyboards and so you can see where this is going so i think it's a c c plus oh that's that's a harsh grade i'm going to tell you that that is no because it's It's not usable.

45:36I'm bringing usability into here. We are past the chance. We're past the time. You're like the product manager and I'm the engineer. Like, I'm like, wow, that's really hard to do. No credit for technical achievement here where we're talking about, hey, in the real world, does this apply? At least from my lens. Well, that's just a model on hugging face. So you're giving people ideas to take that model and go build around it. Yes. I would like to see, we have a company that's working on storyboarding and doing scripts and stuff like that. And it's going well. And I think this is kind of like eventually going to be the next vision, which is from screenplay to storyboards to table read to fully produced movie.

46:19Yeah. To our bet last week on when to the picture film. I'm going to bring it up on the next weeks, but there's a couple of people that have messaged us. I have one more to show and then let's wrap up. Okay. Okay. You gave it a B or B might, what'd you say? C plus. Oh man. I give it, I give it like a, I give it from a technology perspective in a, but someone's got to take it and build something around it. So hopefully one of our listeners wants to be a potential. Yes. What's your real grade? I mean, it's not meant to be something usable. It's like a, it's a model right now. Okay. Yeah. There it is.

46:53We got a big gap here. Yeah. On that one where we're, that's very hard to do and it's really well done and it's running for free as incredible all right last one um this is i wasn't able to demo it because i took it off github but i wanted to show this one because i wanted to get your thoughts on it so um these folks created this model yet and they just released it yesterday which basically all you do is give it a picture of yourself all right and then you give it the dance as described through you know some kind of stick figure animation and then it will animate you and i think this is great because the tiktok dances need to come to an end it's a waste like you know you've said this on all in pod like people are wasting their time doing this stuff and so if this becomes commoditized i think it's very good for our society because it'll be like well we don't know if it's real or fake and everyone has them and people will stop wasting their time doing dances okay auto tune of dance yes good way of call that's a you know tune of dance on the left just a static image of a woman wearing a sweatshirt and sweatpants in the middle a stick figure doing the dance but the dance is derived from a text prompt is that right uh so they haven't released the cofer so i don't know what was the driving force for the dance maybe it was like you it took someone the right way to do it would be someone's already done the dance and then you use an ai in the middle yeah exactly you take an ai to turn it into a stick figure and say well make me do the same dance so essentially if you think about like i saw somebody complaining i think it was elton john was complaining about madonna lip-syncing in her concerts and he thinks like if people are paying for tickets they should be told that they're getting lip-syncing that was kind of an interesting uh concept which is like if i'm paying to go to a concert and i think i'm seeing a live you don't know if it's live or semi-live or recorded and they and he was saying like i sing my songs i want credit for that madonna presses the play button with his claim and if you're paying a hundred quid to go like that's unfair um this basically will take it to like the pop star doesn't need to be able to sing and they just dance crazy right well they got to be able to dance because you're going to go there and they have to you know they can't put a video of themselves yeah i'm just sorry about the music video yeah oh the videos yeah just the videos like you're just going to be able to do crazy dance moves uh yeah i mean more from a societal standpoint too many people are spending time doing dances and i mean if you had a fun if you had a joyful time making a tiktok i'm okay with it if it's like your full-on purpose in life and like yeah i don't know i mean yeah it's just fun it's great but then you should just everything in proportion you know you and i like to ski just talking to a guy who told me he's skiing like 200 days a year and i was like yeah i think if i got to he's moving around he's moving around then right he's following he's got to be moving northern southern hemisphere snow chaser snow chaser yeah um and i'm like yeah you know i i think that would be enough you know it's like four times as much skiing as or five times as much skiing as i'd want to do in a year but okay sure go for it um so yeah i give this like a b i think it's really i think this is really impressive the output as i as seen yeah it's really impressive like that looked pretty good to me like i don't know if it passed the young county valley for you but it was pretty close yeah that's the thing i'm noticing is you know like the dolly i did one of a postcard this weekend from san francisco i just gave it the prompt and dolly make me a modern version of like tokyo dubai and san francisco or make me san francisco in 2050 postcard and then make it as modern as dubai and tokyo and it did like a really i think a pretty good job yeah and then when you looked at like it had san francisco spelled wrong and then it just threw in weird copy but it did a postcard so it didn't it didn't have the polish right and the fit and finish look at this now you know like if you think like if i said i want to do for the next conference yeah you know collateral we're talking about making collateral and i wanted to make a welcome to san francisco this made like san ran cisco with two i's and welcome to is not correct it's all kinds of mishuggana in here and craziness but fun the image itself was acceptable um and so this is the thing like i really think the next job of creatives is going to be everybody gets to be creative and i think this is going to be when we look at things that are bad for society things that are good for society everybody being able to be creative i think is going to be wonderful for society the fact that you're going to be able to make a movie write a better screenplay make beautiful images make collateral for your conference that's just upscaled you you do your restaurant menu it looks like you know somebody spent you know a month on it but you did it in a minute all that to me is great for society now it's bad for the people who get paid a lot of money to do that or get paid an average amount of money but as we discussed people used to spend on average the average funded startup would spend five to twenty thousand dollars on a logo and a branding thing when they were a series a company yeah i think the 20 is pretty low i mean probably more than that even well i was talking about you raised them two million dollars or three million dollars in 2010 2010 oh back in those times yeah back in those days when you actually spent money on logos and then 99 designs came out and yeah you know then you had behance and dribble and fiverr and you know all these upwork all these incredible sites for finding somebody in manila or latin america for 35 or 350 or somebody at home in canada who would do it for 500 five to 20 000 turned into 500 to 2 000 is now going to turn to five minutes to 20 minutes not even money just minutes and i think that's wonderful i think it's wonderful uh and then those artists can work on higher level things so yeah think of this like um this is to me as a solid day i'd like it to teach you dance moves uh like stevie does you know teach you the dance moves so i can see this like i do the move and then it shows me what i should look like so imagine it's here's me attempting the move yeah here's what perfection would look like in my body and then i can see myself doing it perfect so oh i gotta raise my arms a little higher my elbows need to go up oh i need to smile and put my put it into like peloton or for your workouts like here so you can fix your form or whatever that's actually really interesting if you could show me as i would look if i did weights four days a week and i would say hey do these things and here's what you're working towards and this is the percentage you are like a fit pod did this it'd be amazing yeah you're if you commit to this number of workouts 100 workouts over the next year this is what you could look like yeah and then it shows your form would look like as well like this is yeah and then it shows what percentage you're trending to it you say hey you know you're three percent faster to it than yeah you know whatever this is amazing i mean the world is changing so quickly if you've got great ai demos just cc at sundip and at jason s-u-n-d-e-e-p first name club he's so excellent at sundip and at jason first name club you know that's where we're part of definitive.io if you've got a huge company or a well-funded company and you need somebody to help you solve these kind of at scale problems for walmart or target or disney if you're fortune 500 like or if you're an s &p 500 like the latest s &p 500 company uber somebody asked me if i invested in uber you know what i told them i gotta check i have a google sheet where i track all my investments might be in there might be in there might be in there might be up you know five percent today congratulations in all sincerity to the uber team alumni 1.0 team 2.0 team the people who were the one congratulations anyone who bought it at the pandemic low sixteen dollars yeah now you're 4x and it last year it was 25 someone from our group chat bought at that low and i bought at the same time you did too congratulations awesome well we know who's going to be paying for lunch when we go skiing this winter let's do it we'll see you all next Bye.

55:27Bye.

From the publisher

This Week in Startups is brought to you by…

Squarespace. Turn your idea into a new website! Go to Squarespace.com/TWIST for a free trial. When you’re ready to launch, use offer code TWIST to save 10% off your first purchase of a website or domain.

Brave. If you’re building AI and search-based applications, train your models with the Brave Search API. Get started for free at brave.com/jason

Lemon.io - Hire pre-vetted remote developers, get 15% off your first 4 weeks of developer time at https://Lemon.io/twist

Today’s show:

Sunny Madra joins Jason to demo Figma FigJam (2:08), a product that generates images from real-time drawing (31:05), and more while discussing the implications of IP theft writ large.

*

Timestamps:

(0:00) Sunny Madra joins Jason

(2:08) Sunny demos Figma’s FigJam

(9:43) Squarespace - Use offer code TWIST to save 10% off your first purchase of a website or domain at https://Squarespace.com/twist

(10:40) Figma FigJam demo continued

(16:02) Jason shares his AI generated images and discusses how companies navigate copyright issues

(24:58) Brave - Try the Brave Search API at http://brave.com/jason

(26:12) Feedback and thoughts for FigJam

(31:05) Sunny demos Fal, an AI that gives generated images from real time drawing

(40:28) Lemon.io - Get 15% off your first 4 weeks of developer time at https://Lemon.io/twist

(41:49) Sunny demos the Real-Time Latent Consistency Model

(47:01) Sunny demos Alibaba’s Animate Anyone

*

Subscribe to This Week in Startups on Apple: https://rb.gy/v19fcp

*

Check out FigJam: https://help.figma.com/hc/en-us/articles/1500004362321-Guide-to-FigJam

Check out Fal: https://www.fal.ai/dynamic

Check out the hugging face video demo: https://huggingface.co/spaces/radames/Real-Time-Latent-Consistency-Model

Check out Animate Anyone: https://www.youtube.com/watch?v=8PCn5hLKNu4

*

Follow Sunny: https://twitter.com/sundeep

*

Follow Jason:

Twitter: https://twitter.com/jason

Instagram: https://www.instagram.com/jason

LinkedIn: https://www.linkedin.com/in/jasoncalacanis *

Great 2023 interviews: Steve Huffman, Brian Chesky, Aaron Levie, Sophia Amoruso, Reid Hoffman, Frank Slootman, Billy McFarland

*

Check out Jason’s suite of newsletters: https://substack.com/@calacanis

*

Follow TWiST:

Substack: https://twistartups.substack.com

Twitter: https://twitter.com/TWiStartups

YouTube: https://www.youtube.com/thisweekin

*

Subscribe to the Founder University Podcast: https://www.founder.university/podcast

More from This Week in Startups

All 653 episodes
AI demos: Figma’s FigJam, AI drawing, dancing avatars, and more!This Week in Startups · 56 min
Listen in VO