In short
Denoised Podcast Episode Summary: Genie 3, ElevenLabs Music, Lightcraft Spark & More!
Episode Overview In this episode of *Denoised*, hosts Addy Ghani and Joey Daoud delve into the latest advancements in AI related to filmmaking, focusing on:
- Google's DeepMind's Genie 3
- ElevenLabs' music generator
- Houdini 21's VFX updates
- Lightcraft's new tools for indie filmmakers
- The ethical debate surrounding Grok Imagine's features
Key Highlights
- Google DeepMind's Genie 3
- Introduction: Genie 3 features persistent world generation, outperforming OpenAI's GPT-5.
- Functionality:
- Users can create navigable AI worlds through text prompts, images, or videos.
- Demonstrates physics and memory retention, allowing alterations (e.g., painting a wall) to remain after leaving the world.
- Implications:
- Potential applications in gaming, filmmaking, and robotics.
- Ties into the development of Artificial General Intelligence (AGI) and various industrial training scenarios.
- GPT-5 Release
- Overview: Following the anticipation, GPT-5's release was met with mixed reactions due to its lack of significant advancements.
- Key Updates:
- Consolidation of various models into a single GPT-5.
- Improved user experience with a filter that determines the type of model needed based on user queries.
- Critiques:
- Although some improvements were noted, the upgrade felt incremental rather than revolutionary.
- Discussion around the possibility of reaching true AGI being distant.
- ElevenLabs Music Generator
- Features:
- New music generation tool that offers enhanced control over music sections (intro, outro, etc.).
- Legally cleared music generation, addressing previous legal ambiguities surrounding music rights.
- Impact on Industry:
- Threatens stock music revenue streams as AI-generated music becomes more accessible and versatile for creators.
- Houdini 21 Updates
- Capabilities:
- Continues to lead in visual effects, particularly in simulations (fluids, destruction, etc.).
- New updates enhance simulation quality and algorithm efficiency.
- Industry Position:
- Remains the go-to software for high-level filmmaking due to its unmatched detail and accuracy.
- Lightcraft Innovations
- New Tools:
- Spark Shot: A browser-based tool for importing 3D scans and collaborating on pre-visualizations.
- Spark Live: A collaborative meeting platform for real-time project planning.
- Spark Atlas & Forge: Asset management and batch processing tools aimed at indie filmmakers.
- Significance: These developments offer accessible virtual production solutions, reducing the need for expensive reshoots.
- Grok Imagine Controversy
- Discussion:
- Grok Imagine's capability to generate NSFW content raises ethical concerns, especially regarding the unauthorized use of individuals' likenesses (e.g., deepfakes).
- Highlights the ongoing debate on the implications and regulations of AI-generated content.
- Additional Updates
- ComfyUI: Introduced subgraphs for workflow organization and simplification.
- Cloud Opus 4.1 & Google’s Code Writer Jules: Minor updates to enhance functionality and usability.
- MidJourney: Enhanced video outputs to HD quality, signaling a move towards higher standard resolutions in AI-generated media.
Conclusion The episode emphasizes how rapidly evolving AI technologies are transforming the media and entertainment landscape. With tools like Genie 3 and ElevenLabs' music generator, creators have unprecedented capabilities, while ethical discussions surrounding these advancements remain critical. The hosts encourage listeners to stay informed and consider both the potential and challenges presented by these innovations.
Key Takeaways
- Genie 3's persistent world-building could revolutionize content creation in gaming and film.
- GPT-5's updates are more about user experience than groundbreaking advancements.
- ElevenLabs could disrupt the stock music industry with its AI music generation capabilities.
- Houdini 21 continues to set industry standards for VFX.
- Ethical implications of AI, especially regarding content creation and likeness rights, require ongoing scrutiny.
---
For more insights and updates, follow the links shared in the episode and consider subscribing to the Denoised podcast for future discussions on AI in media and entertainment.
Written by AI. May contain mistakes. Listen to the episode to check what was said.
Transcript
Automatic transcript. May contain errors.0:00All right, welcome back to Denoised. it is going to be our Friday, maybe Saturday, weekly roundup of AI roundup, all the new AI tools and updates in the world of filmmaking. It was a busy week by Tuesday. There were a bunch of updates. And then we had the GPT-5 release yesterday. Yeah, we were stoked about that. I was stoked about the, well, everyone was kind of stoked about the announcement. And then, you know, the air left the excitement. So we'll get to the actually most exciting update, I think this week, which is not GPT-5, which was...
0:31genie 3 from google deep mind yeah so this is an update to their world model but the demos from this are absolutely wild google dropped another banger this one yeah this one is crazy this one is a either from a text prompt or i've seen demos where people can give it an input video or image and it creates a complete ai world that you can move around in yeah and the physics the reflection the behavior feels like you're in a real world i mean like this is like probably the biggest world model that's crazy release that we've seen so far are you able to then take that world into other things i don't think so yet and also this is still like in a research preview so we've just seen clips from it and they've or releases from people that have access either researchers or they said some creators and you could you could run it for it runs at 720p at 24 frames per second it will run for a few minutes because of the memory issue of how much the world could generate but like as it's generating the world the world is persistent so there's a wild demo of this paint roller this is all in genie 3 so the painting the wall but that wall doesn't exist no this exists it's all fake the entire thing is generated wow so then you see they're navigating with the keyboard and moving and then they turn back and the paint paint still there is still there oh my god oh my god so that's freaky that's why there's a couple minute limit but this is i I mean, in Genie 2, I think the runtime was like 20 seconds.
1:55And now we're like two, three minutes. Give me some VR goggles. Put me in there. So, I mean, yeah, world models are a thing that everyone, all the AI companies are trying to generate and have talked about, Runway's talked about, Loom has talked about. Persistent world models. Persistent world models. I mean, there's obviously the M &E implications, gaming implications, you know, generating a game on demand. but the real reason they want this is this is a big tie-in to agi because it's a way for the ai to like just understand how the physical world actually exists and behaves physics and everything yeah and then also autonomous vehicles robots robots uh the robots need to train themselves on a world yeah they need if they want to operate in this world they need to have their own understanding of how this world exists and functions right and that's what the world models do and it's it feels like west world because it does feel like west because it's like Like, oh, hey, it's all fun and games.
2:46We're doing this so you can make video games or movies. But the companies are really doing this. Videos are the way to train it. But the money and where they really want to go is robotics. The money is absolutely bottomless. Digital twins. You're also talking about military simulations and battlefields. And that is billions and billions of dollars a contract. I'm sure Google will not hesitate to take that paycheck. And then the robotics training we talked about. And then on the industrial training side. So let's say you're building an airplane or something. If you're Boeing or Airbus or somebody like that, the ability for you to generate a warehouse with all the parts, all the gizmos, all the assembly line stuff for that airplane and then train a robot into it or train human into that environment.
3:34Yeah. So then quickly ramp them up to then produce airplanes. Yeah, the digital twin thing. And NVIDIA always keeps talking about this in their keynotes and stuff. of like, yeah, before you build the$100 million factory, build it digitally and you can make sure it all works and functions properly. Absolutely. Yeah, huge implications. Implications are huge. And then we just talked about Han Yun's world model last time. Yeah, I mean, I think that's out of the water. Yeah, the Han Yun world model, I mean, you can maybe take a couple steps in the world. Yeah, it's like, not a wide lens, just like a real man.
4:03This one, you can move through this world. I'm not even walking. and I've seen drone versions where like people were doing aerial moves through. Yeah, the paint roller thing is mind boggling because you not only have like a flat surface, a 3D surface, if you will, but then it memorizes what you did to it. And then you can come back to it in the exact same place. Here, this one, they took a VO3 output of a drone shot and use that as the input. So the beginning part is VO3 and that was the input into Genie 3. and then now this is genie 3 and they're like flying and navigating through this world it kind of reminds me of the early days of gaussian splats where we were doing this with like a very crude low resolution version of this and we were blowing minds with that right you remember when somebody had taken a drone footage of the grand canyon and then in gaussian splat recreated it and then now you can walk through the grand canyon just based off a one minute video i did one of the entire grand canyon or just like a section of it it just yeah probably just a section of it but it was convincing enough and i think uh to a lot of m &e folks especially the virtual production folks it was like oh well now i can get parallax on the grand canyon if i put that gaussian splat out there right when they realized i could take this but this in in that application yeah i mean i think the first time i was exposed was like uh even just a simple scan of like um from the um the bad decision studio guys they did a scan of like a building and they did a scan of a totem pole with a drone and brought that in.
5:32I remember that. That was the first time I was like, oh, that's pretty sweet. And you were able to then bring it into Unreal Engine and then compound to it other things in Engine, like actual 3D assets on top of that, which is really cool. So that's why I originally asked, can this be exported? Because how many people want this in their package? Yeah, it talks about what we've talked about with building out a virtual space or virtual production, but an environment. a virtual environment that's consistent and you can have different angles and i would say at the very least a 3d file that is not 4d so just like a static photogrammetry of that environment with a basic texture map for starters yeah i mean it's like what's to say you like you can't just walk around the space and you know it's a space of a video of a 3d space that you could just do the same training of a mesh or model as if you were walking around with the camera or doing like a Oh, the other biggest case is autonomous vehicles.
6:26They need a world to train in. Yeah, exactly. Yeah. Yeah. Holy crap. So, yeah, I think this was probably the biggest, most exciting update this week. Very cool. Pretty wild. Okay, but then we had GPT-5 update, which the keynote was yesterday. Yeah, and Sam Altman was on Cleo Abrams, like, right after. I mean, they pre-recorded it. Oh, why is he about it? Okay, I didn't see that. I didn't see that interview. And Cleo was like, why don't we talk about the near future and long-term future of where you think AI will head? and obviously Sam Altman's view of the world is way the heck out there. Yeah, I bet.
6:57So look, I mean, the big updates, I think, probably the biggest most user experience update is previously, and we've made fun of, and everyone's made fun of, the like 20 different models that they had, the 4.0, the 4.0 Mini, the 4, 4.5, and some of them are reasoning models, some of them are more general use models, and you kind of had to pick and choose which one you wanted to do based on your task, and that wasn't always clear. Now GPT-5 is replacing everything. With just GPT-5. Everything is deprecated. just gpt5 and a couple versions with like a gpt5 mini and nano and plus but it's all gpt5 and the idea is that you give it your query and it has a filter or router that will look at your query and automatically determine does this need a reasoning model and something more advanced or does this just need a regular normal uh transformer process sure sure sure pros and cons i mean pros and cons to that because you know it's probably in their best interest to route you to the least uh compute intensive process and so maybe it's annoying that this was just like a giant cutting thing for them possibly i mean the api model calling the api is also really cheap like on par with gemini okay pro 2.5 and way less than anthropic i don't know about you but i was expecting gpt5 announcement to be like we have reached human intelligence hyped as a bit or people thought it might be but yeah i mean yeah i didn't i was trying to refresh yesterday because they said it rolled out to everyone and i didn't get the update yet but i have it now i haven't really messed around with it but in the demos a lot of it was just like yeah it seems better there wasn't anything that seemed like oh you could do something you couldn't do before two things i think is going on here and uh again i'm speculating and just for the entertainment of our viewers go along with me here so the one thing uh and i kind of texted you about it i was like could meta's poaching have actually worked and decimated the talent pool at open ai i mean i think feel like this was probably weighing the works before the poaching started sure so but you remember they had to like shut down the company for a while because the poaching was getting so intense was it from the poaching with it they shut down from the poaching and not from like the whole board drama fiasco like what was that last year some of that as well in the other thing i'll say and i think i'm hitting a vein here could agi and asi be like nuclear fusion like this it's always two years away this dream but like never quite achieve it yet right and could that actually then cause the ai bubble to burst yeah right it's like well is it because we we need more compute we need we need more yeah it's like scale we need to keep scaling i mean i'm clearly gpt5 has had the scale and the money right and it's still marginally better like maybe it hasn't hit human intelligence yet it's probably better his comparison was like uh what gpt3 was like a smart high school kid gpt4 smart college person, GPT-5, is like an expert in everything.
9:42But he didn't call it AGI because he says, like, I guess one of his benchmarks is that the model keeps learning itself. And this doesn't. Yeah. And the Silicon Valley folks are always looking at it through how their processes can be improved. And so they're looking at it through software development, right? Because that's what that industry up there is. And yeah, I think in terms of building code, and we just talked a little bit about vibe coding. Yeah, sure. Maybe GPT-3 is the high school kid and GPT-5 is the expert. And one of the big features they pushed on GPT-5 or demoed was like, oh, look, it has a whole coding thing.
10:17But is it like, I feel like it's that more just they're catching up the clod. Yeah. Not like, oh, this is light years ahead of anything they're seeing. They're literally forgetting that, you know, we live our life outside of code development. Like everybody else outside of Silicon Valley. Like, for example, I love cooking. I love recipes. I look at Michelin star folks and go to nice restaurants. Like, that's my thing. That's my jam. I'm a foodie. When I ask Chad GPT for a basic churro recipe, can't do it. Like, it gets the ratios wrong. It misses. There's no eggs in the recipe. I'd be curious.
10:49Yeah, we try it with five. Because, I mean, they're like, you know, in their own benchmarks. It's like, less hallucination, less this. Yeah. It'll never say, like, this might not make you the best churros, but go for it. It'll be like, for the best churros ever. but nothing that was like even you know a big functional use like uh it's not out on google yet but they demoed it at the google io where it was like oh you can take your phone and kind of in real time showcase like hey what's that thing and it was like having a conversation and looking through the camera so like nothing like that no update to the image model which like i think you know chat tpt image is great but nothing featured there so like nothing changed with that yeah you know i'm sure it'll just be like a better experience if you're a free user a better experience because they're rolling this out to free users on the same day.
11:31I mean, honestly, probably the biggest thing that got the most buzz was the absolutely insane graph that they displayed. Oh my God. What did that even mean? That might've been a vibe graph, but basically showing the benchmarks. But if you actually look at the numbers, the number on OpenAI 03 is higher than GPT-5 without thinking. So yeah, an insane graph. I didn't understand either of the axes or the color or where the color i mean the color and the shape are designed to be like look it's greater but um there's absolutely zero scale to this because 69.1 and 30.8 are yeah literally the same and then 69.1 is also obviously way higher than 52.8 i think that graph was generated by chad gbc that's why it's it's lacking a little bit yeah vibe when people say oh uh you know a producer on a movie will be replaced by ai i really now come back to like where are we at who said that my neighbor the guy at there someone on twitter said rest of peace hollywood so we must all be gone yeah it's like or you know okay let's like lawyers a lot of people say entry-level lawyers will be replaced by account financial analysts and no they won't not anytime soon not at this rate no yeah there was a joke after it was like oh like lawyers and accountants like breathing a sigh of relief after seeing the gpt5 and absolutely yeah i don't yeah nothing sorry sam outman but if you want to be on the show give us a shout we can talk about it yeah the other thing they did ask though uh earlier in the week is uh released an open source model gpt i love that oss yeah um i'm all for open source models is The first open source model they've released since GPT-2.
13:16This is back, what, five, six years ago? A while ago. Pre-AI. And also, you know, it's in their name. So they're going back to like their ethos of their name. Yeah. Elon called them closed AI. I do remember that. So yeah, they released two versions of a model. I mean, they're less powerful than their top line models. Yeah. But the big update here is that it's really performant, even more so than DeepSeek. So you have the lightweightness and the performance combined into an open source model. I think that can be really interesting for putting an LLM on device. So it's doing local inference. So for example, if you have a car and you want to talk to the car, right?
13:57Like Mercedes has their MBUX system, like a lot of virtual assistants in car. This could be a model that goes in there instead of whatever they have. Right, right. Or if you want to run something locally or run it on local data and make sure it doesn't go to the cloud, that would be the other big use case of why you want an open model. If you're a big military contractor, you can't have any internet access to anything. Or if it's like a tank in the battlefield. Yeah, if your Starlink isn't working, you need to have local reliability. Yeah, so updates from there. I'm more excited about the open source model than GPT-5 in this case.
14:35yeah i'm curious to see how that plays out yeah what people do with an open source open ai open ai model yeah and the other thing with the open ai versus like chinese model like deep seek is that it'll companies will be more tuned to adopt that because it's legally in a more clear situation yeah it's like an american company that you know you can go after if you have an issue exactly all right other update in uh the world of media 11 labs very powerful popular um voice over generator text voice generator now launched uh 11 music awesome music generator i love music models i love music models suno is great suno is a lot of fun yeah this one is on par or even better than suno i messed with it a bit uh the other the things that it really excels at um is it has a really excellent interface and it'll generate the music but it'll also generate it in sections and you can drag or modify each section of the music or kind of adjust the timing so that the beat changes at a different spot intro outro chorus exactly so for generating yeah just kind of the background beat music and having a little bit more control over when things pick up or come down uh excellent interface so far and how they built it yeah end of the day how you interface with ai is what ultimately what breaks or makes a model right yeah it's like how can you harness 99 of that power of that model if you have a clean enough interface you're doing it but if it's like a text prompt or something you're not you know yeah also other thing is they did work with some of the music labels and so they're saying that the stuff it generates is legally cleared uh commercially cleared so that's a big change too from what we've yeah where that it's been a bit of a gray area with some of the other music this really puts into danger a lot of the artists that make their living from stock music yeah the background beat kind of stuff and the licensing that goes into it they're getting passive revenue from like anybody that downloads it i mean if you've ever made a youtube video you're probably going to some stock footage website grabbing some music tracks putting it on a youtube video yeah yeah we have a bunch of stock music subscriptions and stuff but i mean i've also spent hours looking through stock music sites and it's just like not what i'm looking for not what i'm looking for i love artlist.io that's one of the better ones is that okay i've used art grid for this their footage stuff soundstripe is one i use a lot okay they have good stuff yeah envato is okay envato's hitter miss it's hard to find stuff because you have so much stuff from some good stuff some not so good stuff yeah i've seen there are some other companies that launched that had deals with record labels where they had you know like quote real songs but uh that you could license at like a more affordable rate for like a youtube video oh so it's like a cold play track or something yeah because that was always an issue before because it was like they weren't really you know in tune with youtube creators and it's like oh you want to license it yeah it'll be 50 grand you know because it's like that standard rate for like commercials or tv and it's like well i just want to put it on youtube yeah not get demonetized right and it's like now they have more they wisened up and made more affordable licenses yeah and youtube is so good at uh sniffing out license oh they're content detectors yeah um annoyingly excellent yes yes the downside of that is um they don't really have a good way to filter out if you legitimately used uh stuff under fair use right um so they're sometimes their content detector can be a bit too aggressive yeah so i mean shout out to 11 labs for dropping something that the market generally needs i mean a lot of the ai stuff that we look at on social media you know tiktok instagram linkedin whatever is missing the sound component yeah in general yeah yeah it's like uh If you have you ever done actual content production, that's like half the battle.
18:18And that's yeah, like bad sound will ruin anything. A video. Yeah. Like mediocre video you can get away with more than really crappy sound. Yeah. If you combine this with that Adobe tool where you can like the sound effect. Yeah. I mean, there's some other models too, where it's like you can give it the video and it will analyze it and try to create the sound that matches the video, like the Foley and stuff. And then you're more aware of this world than I am, but just taking like vocals recorded on like a crappy source, like a phone, and then turning it into like master audio from a microphone.
18:51For, I mean, Adobe podcast, their audio fixer is really good. Yeah. But that's more for, you know, this kind of stuff where we're talking. We used that when we had that bizarre issue at the AI on the lot. We don't have issues with our podcast. Yes. Not in here, but yeah, I have a lot when the mics are picking up some random Chinese radio stations. Yes, yes. And Adobe Podcast was able to clean that out and make the voices sound good and get the background audio. But it's not for singing. I'm sure there are other models or tools that I'm less familiar with because I don't deal with like music as much.
19:25Yeah, right. That can take a singing voice and make it sound like off of a crappy microphone and make it sound better. Well, it seems like Eleven Music is able to generate vocals. which generates vocals and um and yeah that's hard and then it takes well wow it could do lyrics yeah i mean the one thing i liked about suno as soon as i had a checkbox option would be like instrumental or lyrics and usually i mean the stuff i'm doing i'm like i don't just want background instrumental music 11 labs i think i i only mess with a little bit but i would type out a prompt and be like i just want a background you know electric beat and it would add lyrics into it so i think in the prompt you have to specify like no lyrics or yeah uh you have to put it in the prompt there wasn't a checkbox to be like just make it instrumental yeah uh whereas you know had a little bit better uh interface for that i'm sure they'll get the feedback and get it right on the second yeah really yeah all right next one houdini houdini dropped houdini 21 and for those of you in visual effects filmmaking you guys all know that houdini is the king of sims i mean there is no other package that is doing that is recreating reality quite frankly so like fluids like we're like yeah fire smoke uh water destruction like you know the collapse of a building or a car colliding with something um even down to joey like muscle sims and yeah i'm seeing like a muscle of a dog yeah so demoing right now about five to ten years ago this stuff was so computationally expensive the gpus just couldn't handle it right and of course everything you're looking at in this demo here that we're going to show you this is not real time we know this but that's okay because this is the highest level of quality you can achieve today and control and control including ai solutions including unreal including maya like there is no other package more capable than houdini and the fact that they've upped themselves this high only assures like we gotta stay grounded in reality like we talk about ai tool sets all the time capabilities all the time grinding up cookies into dust that's and the whipped cream on top yeah like when that comes in it's the consistency of whipped cream and has the like the material feedback yeah it's so accurate so look if you're making a film at the highest level you're using houdini you're probably not even going to touch your eye because it's not even close and you're not going to touch unreal because you make a lot of sacrifices when you go to real time right so The simulations are just not as accurate and things like that.
21:56So it's really good to see that, you know, we talk about a lot of AI tools, but end of the day, the highest level of accuracy and detailed reality is still achieved by something like Houdini. So what are some of the new updates in the version 21? This was like a version 21 sneak peek video that they teased. I think they're going to announce it or do a keynote SIGGRAPH next week. Yeah, I'm not. I was never a Houdini artist. I knew some of them, and they're all a little quirky. because the Houdini is like the perfect, you have to have the perfect 50-50 split in your brain, half technical, half creative.
22:29Whereas with like a software package like Maya, you could be fairly technical and get away with using it. Package like Unreal, you can be quite creative and because it's so easy, you can get away with it. But Houdini is quite challenging because it has a note-based thing and I also need to script in it. You have to recall. So I don't run into too many Houdini artists, especially at like a tier one level. I remember working with somebody at my last job who was a world renowned Houdini artist. He was so valued, in fact, that Houdini just hired him. So like there's not that many of them in the world.
23:05So that's I think that's their only caveat is like as capable as it is, it's really difficult to. Yeah. Very specialized. Yeah. Yeah. So, you know, do you know what specifics in here? Yeah, so I think it looks like the muscle sim stuff. Everything seems iterative. There's nothing new that they've never had before. Like the sims look better and has probably a better algorithm that they're running on. Right, I'm guessing maybe you could like process or run stuff. Yeah. On more local machines or to run it faster. Everything is going to be local. So typically how Houdini artists work is they'll set something up and then they'll submit the sim.
23:41And then the sim will take a few hours to render and then they'll come back and look at the results. Okay. Yeah. And it only helps that the AI race is making us get better GPUs out of NVIDIA and AMD. That is true. So that's all going into you being able to do stuff like this. Yes. Yeah. It's all net positive. All right. Awesome. Very cool. All right. Next update is from Lightcraft. So Lightcraft makes Jet Set, which we've covered before. We've covered before and I've done a bunch of videos with them. Basically like a very accessible virtual production. You could use your phone as a tracker, put it on top of a cinema camera and then kind of shoot, record all the camera data and then later on go uh link it up to an unreal scene or a blender scene yeah and it makes very accessible virtual production yeah lightcraft is also operating in a space with practically no competitors like they're a unique offering in the sea of stuff they are because there's either they're either like dedicated apps where it's like you have to shoot everything on the phone right and it'll track but it's like you're shooting on your phone yeah or you know or just do everything in unreal but then unreal doesn't have like physical tangibility into actual like you know hard goods if you will whereas lightcraft integrates back to unreal or unity and then you have the ability to then use a phone to do a lot of that task exactly yeah and so now they're sort of expanding their tool ecosystem to sort of be more of a one-stop shop for uh indie filmmakers and other productions um so they're launching a couple of web platform tools next year so one is spark shot which is it's a browser base tool yeah you bring in 3d scans you can kind to bring in your models and like collaborate with your team and sort of previs your film on a web browser, a collaborative web browser.
25:17This is really powerful because as you know, typically USD files for filmmaking is very heavy. You're talking gigabytes, you know, and then to load it into a browser and have it accurately sort of spool it up and play it back is quite powerful. So my guess is they're spinning up a virtual machine on AWS somewhere and then tying it into your browser session. like a stream that um yeah pixel stream streaming thing perhaps it's that or perhaps it's uh based off of html6 maybe oh okay yeah so there are some technologies but the fact that it's browser-based means you can't run it on anything an ipad yeah yeah and a lot of it because i think it's like cool too that they're expanding it because the demos have been like oh if you want to do kind of like low budget virtual production shoot but you know a lot of other use cases too it's like okay maybe you're not doing virtual production but maybe you're doing you know just previs for like shoot on a camera but it's like you have a scan of your location and you want to kind of bring in a virtual camera and like map out in yeah pre-plan in your location that you're going to shoot at for sure you can do it in a virtual space and you know make sure everything fits make sure your measurements happen and do it in a nice collaborative web web browser yeah i mean just a savings alone from not reshooting and not having like you know a second round of shooting is going to pay for like yeah especially when you're on a lower budget yeah and uh you don't have you don't have there is no reshoots you only have one shot to do this like literally exactly um other tools spark live which seems like more of a kind of collaborative yeah zoom-ish thing so you could all kind of hop on the same collaborative web meeting and uh i'm guessing like shot plan or do work in the 3d space and then spark atlas which is challenges the artistic centric database built on the open source super based sequel system yeah so that's like a for the indie filmmaker like a shot grid for your production to track your assets and stuff like that that'd be great because also yeah a nice more affordable accessible shot grid it would be it would be real nice welcome for the smaller community i mean if you're working in lightcraft then you as any filmmaker you're already got thousands of assets that you have to manage so then you need an asset management system the ai space and i mean they did kind of market this as like blending you know filmmaking and ai and it's sort of like a one-stop shop but you know the projects we're working on i've been messy and with the shop buddy that we talked about yes a while ago but just any tools to like track ai the images that go to the shots and then the versions of the shots and then you're reprocessing the shots it's still you know there's so much overlap in the vfx pipeline it's already established yeah uh i rebuild the wheel twice yeah but being able to have a tool to track and manage this stuff especially on bigger projects like gets really really uh important and then spark forge which uh it seems like it has some overlap but streamlines the processes by combining asset storage, metadata management, and batch processing into what Lifecraft calls a high-speed shot factory.
28:03Yeah, so that's their batch processing tool. That's interesting. Maybe it ties into some sort of cloud renderer using... Possibly, yeah. But I think it also ties into, because they have a, I can't think of the name of their app, but basically, if you are shooting virtual production with Jet Set, you can load in your Unreal or your Blender scene on your phone, and you get a rough previs, but then you still have to take the data from the phone, take your recordings that you on the camera and process it to marry it later on a computer yeah and so this might also automate or streamline that process so it's like oh just hey take all our takes take all our takes and then just deposit them all together yeah right yeah if you have the right naming convention which i'm sure they help with yeah yeah and it should just all line up how hey joey how about this combining the light craft spark with the gemini world build dude oh man you like oh instead of yeah like instead of like a Maya scene you're now just generating on the fly yeah I mean I feel like that's got to be the next don't you know that light craft CEO from your interview yeah Elliot yeah yeah you should shout him shout him out oh yeah no that's great yeah we got video we got we got like we have a series of with Elliot like yeah like a four episode series yeah Elliot's great Elliot's also so much fun to talk to because he's like so passionate about this he gets it and he's so excited about this and so excited about making more accessible like virtual production tools and ai tools and marrying the two together yes and they also work with uh bbl where you could like relight your shots afterwards which also works really well if you are shooting on a green screen stage in a virtual space but you don't have the money to like have interactive lighting yeah you can post process it later yeah i gotta say like uh bbl's relighting tool is probably the best relighting with aif scenes yet yeah yeah with no training no training yeah right you don't have to train on models give it an hdr map yeah netflix did a version of that but their version it trains like you need to train the actors you have to give it oh you have to shoot the actors and give it that training data yeah and then it'll relight but yeah people you don't have to train on anything just give it a shot and it'll relight it and give you your uh yeah and then the last update from bbl we we verified that they take now hdr maps and yeah i think they can generate them too now right i think koon just said that one so then that ties directly into vfx pipeline And they do spit out, I want to say 16-bit EXR.
30:18Jeez. I want to say that was what they can export. Because I remember that was a comment on one of the videos. Yeah, those two words in AI typically don't go together. 16-bit EXR, AI world is 1080p JPEG. I know. I might have some of the specifics wrong, but at a meetup, I just saw someone ask the export option and he did say EXR, which was, yeah, I think an early comment of like, well, it's not going to be in the real VFX pipeline until it does EXR. and uh bfxr as well it does the xr now i believe i'm 99 sure that was what he said yeah that's cool yeah all right other ai update another image model from alibaba quen quen quen 20 billion parameters yeah 20b is no joke yeah geez it says that it excels in text yeah accurate text also both in english and chinese and it's open source it's from alibaba yeah typically alibaba tencent models are just grab them use them yeah i think one is tencent if i'm not mistaken or alibaba one of those two we can i think it's tencent yeah yeah and then you have uh quen and then you have cdream from by dance yes yeah yeah like these are really good powerful open source models now is it ethical and is it yeah like is it ready for holly use probably not well yeah based on which country but you can't ignore what they're doing here right like if they get text right that's one of the hardest things to get right so if they can do it with 20 billion parameter training and some of the other stuff they're running under the hood ethical models should be looking at that and trying to replicate that yeah we'll see all right and then uh grok imagine oh grok is back in the news rock is back so did it do something bad well i mean okay first off they released grok imagine which was a new image and video generator which would also let you make uh not suitable for work content so topless models and elon's all about yeah not holding back between this and the uh sexy chat bot that you can uh oh the anime one yeah the anime yeah i think i saw it in japan when i was there so yeah i mean uh look i mean quality wise or whatever i've seen mixed things apparently generates really fast it seems kind of more like novelty than something that would go in professional use also there are issues like there was an article that someone was able to generate uh topless taylor swift new deep fakes using croc oh no imagine so obviously like problematic stuff taylor's uh legal team is all over this one i'm sure yeah you see that thing that um lebron james's legal team sued the creator that was making pregnant lebron james videos and they uh sued uh they filed a cease and desist to stop publishing those yeah okay i can see that coming yeah after that i would say that probably falls more to parody but uh obviously like new deepfakes of of anyone of any real person without their permission is um problematic yeah that's like the early days of napster when the record labels were suing napster and then we ended up with spotify and apple music and youtube music like so you're saying we're gonna have like a celebrity deep only fan authorized only fans we'll get over the novelty but the fact that we can modify anybody's likeness is not going away yeah i mean i they'll yeah whatever we'll need some well i mean most models have safe or like you know do more thorough yeah testing to make sure stuff like this doesn't happen yeah yeah as we grok and xai is a bit more everybody should have a say in how their image is being created and altered i you know as i think that's likeness and someone's making your likeness without your permission and that should not be there's defamation and if uh your likeness is being used to generate money and make you look bad you should have a say in that but what i'm saying is like five years from now we would have seen so many pregnant LeBron James that we were just like so what okay what are you doing with that technology that was so 2025 dude like what are we doing in 2030 with that technology how are we changing the world how are we making money and how are we improving society it's gonna be a like real life hacked LeBron James and your eye implant and you like think you're actually talking to I don't know real LeBron James.
34:45I don't know what the answer is. Or maybe it's LeBron James's likeness will never go away, right? Like it'll be a persistent thing, especially if he signs a Nike deal. The same way we have Jordan clothing and Jordan shoes and all that stuff. Like it'll be a permanent fixture to pop culture, like the whole LeBron. I mean that or I mean, aren't there already some laws in the process of like, you know, deep fake banning laws or like crackdown on deep fake stuff. So, I mean, or it becomes like a law and then you have enforcement and then it's up to the companies where they face, you know, legal fines that they have to, you know, ensure that it doesn't like that the tools can't make something that looks like a real person.
35:24Yeah, sure. Yeah. But yeah, I mean, you can't enforce it in China. Yeah. Or if you build an open source or you take a model and modify it. I mean, the person could be liable. I mean, I'll be curious to see what happens with the LeBron James model. Yeah. Yeah. I don't know. I mean, obviously, I mean, look, a parody thing, a pregnant LeBron James is like, okay, we all know it's kind of parody. But like a celebrity, nude, deep fake, you know, more problematic. And then even on a, you know, on a like local level, on a high school, you know, making like. Making someone, yeah, some high school kid feel bad and then that leads to.
35:59Yeah, making fake images of like someone, you know, for like cyber bullying. Yeah, no, that's not there. Right. But my question is, what is Grok and Elon doing? You know, with this kind of, like, shouldn't they be trying to make money? I don't feel like there's no money in this stuff. Maybe this is the other Westworld where it's like they make the crazy AI model so that somehow the Tesla cars can drive better. Somehow. I don't know. Yeah. Don't know how this one completely ties into it, but I don't know. Yeah. Well, it's out there. If you want to use Grok Imagine, tell us how it is in the comments.
36:30Yeah. Let us know if you've used it over any other model. Yep. All right, quick one from ComfyUI. They released subgraphs. So this is basically an easy way where if you have a really complicated ComfyUI workflow, you can take a piece of the workflow, put it into its own graph, and then on your other workflow, you can call up this little subgraph, run the process, and then come back to your big workflow. So a very long requested feature, but a way to clean up. Yeah, it's a way to collapse a portion or all of your workflow into one little thing and then tying into another workflow. So now you have super workflows.
37:00Also good, too, because I'm guessing you could probably reuse this subgraph. So if you have a process you're recurring, you could just take this one and plug it into other workflows. Yeah, I would say Mr. Comfy Anonymous. One thing you could probably do is build a UI builder on top of Comfy. So then if somebody wants to create a very simple UI with Comfy UI under the hood. So you don't expose any of the nodes and the graphs to the user. but the developer has full access to it right like a right i see what you're saying yeah so right now you can do it with other things like uh python pyui stuff like that you need something to host to process it so i think there's probably third-party companies because i know there's companies uh like playbook uh sort of pivoted to this where they'll host they'll run hosting for comfy and i feel like it would probably be more of like up to them to build that easier interface if you as a creator wanted to have a more front-end facing user interface because you would need some cloud compute anytime someone went to it to run it to process that.
38:08Yeah, I would say it doesn't have to be Figma. Figma is like the jam right now in UX and UI development. Nothing is better than Figma. Take 1 % of what Figma is doing and apply it to Comfy. And you've got a winning formula where you're not only doing custom workflows that are hyper powerful, but then you're wrapping it up in a nice little box and giving it to a user. Next update, more of a quick roundup. Cloud Opus 4.1 was released. So an improvement over four. I don't know what exactly improves. I haven't tested it out yet. I see a fancy graph. Let's go through the fancy graph. Their graph actually is accurate.
38:48It looks accurate to scale. I mean, the one here focused on software engineering, but yeah, Cloud's still one of my favorite models to use for writing and for a lot of other tasks. For sure. Google Labs, they had their own code writer called Jules, and it is now rolled out of beta. And if you're on the Google AI plan, I believe you could tap into it. And I've heard good things about it. I can't remember all these names, man. I know. I didn't even know Jules existed. Noble, L.M., Jules. Yeah, I'm curious if this is more for actual coders or if it's kind of a vibe coding tool. My guess is they needed it internally anyway, so they just built it and now they rolled it out to everybody sure good point yeah and the last week update is uh mid journey which had video and does pretty good video outputs they now upped the video outputs to uh hd yeah resolution and see the demos i mean some of these are just crazy detailed and uh look really good yeah the video generation world it seems like are now more or less by default 1080p right you have that's becoming more and more standard yeah moon valley it's like yeah they only do 1080 right and i think uh is the runway aleph at 1080 i think it is yeah vo is i think so vo3 yeah vo3 is yeah c dance is not uh i think luma 720 still right but yeah but they're coming more and more picking up and making 1080 yeah standard yeah um i would imagine in a year or two now you're looking at 4k hopefully actually i did see a tweet because i think someone asked uh crystal ball okay like when can we get 2k 4k outputs yeah and he's like soon yeah so i'll say to crystal ball's defense like he delivers he's the anti opposite of elon where elon's like self-driving coming in three months it's been three years yeah crystal ball brings yeah he also tweeted out another tease of interactive like world model from runway to talk and create like that thing we saw like i think he said end of year okay we'll see if that comes but the one where you can just kind of talk i don't know if it was that one but something that was i think because you know he's sort of responding to when genie 3 videos were out of like something in that realm yeah coming soon from runway yeah they're they're really all the ai companies are really quick to dismiss and one up the other one i think isn't it it's such a yeah i was like we're don't worry we're talking we're working on this too we got this coming out you You think that's a big deal?
41:13Wait till you see this. Don't worry about it. It's just nothing. We should do this with other podcasters, shouldn't we? What? You thought that episode was great. All right. And that was pretty much the roundup today. Let us know if we missed anything. And yeah, links for everything we talked about, as usual, at denoistpodcast.com. Thank you for the YouTube comments. Somebody just commented just to feed the algorithm. Yeah, thank you for feeding the algorithm. Yeah, thank you for that. We could use a couple of five-star reviews on Apple Podcasts and Spotify. If you haven't done so, you know, we're still in a double digit number.
41:44Like it makes a big difference. So please help us out. All right. Thanks, everyone. We'll catch you next week.
From the publisher
Google DeepMind's Genie 3 stole the show this week with its persistent world generation, outshining OpenAI's underwhelming GPT-5 release. Join Joey and Addy as they break down how Genie 3 creates navigable AI worlds with accurate physics and memory—allowing users to paint a wall, walk away, and return to find their changes intact. Plus: ElevenLabs' music generator, Houdini 21's VFX updates, Lightcraft's new tools for indie filmmakers, and the ongoing ethics debate around Grok Imagine's controversial NSFW capabilities.
---
The views and opinions expressed in this podcast are the personal views of the hosts and do not necessarily reflect the views or positions of their respective employers or organizations. This show is independently produced by VP Land without the use of any outside company resources, confidential information, or affiliations.




