How AI Handles Film Grain and Blur

0:00Today on the podcast, I want to talk about using AI to remaster old films, images, videos, classics. what's going on with the industry there because I think that there is a huge boom that's about to basically be unlocked you know we've all seen an old VHS tape and I I feel like recently I've seen somewhere on an old tv and I'm just like blown away by how like it sounds terrible but like how low quality it feels um compared to what we're so used to now but of course you get that retro feel so that's kind of cool and you don't really want to miss out on what it looked like back in the day But the way of the future is basically using AI models right now to remaster a whole bunch of these older films for higher quality.

0:43And what's really blown me away is there's a huge project underway right now to do this for the classic Wizard of Oz movie. And they're not just trying to, you know, increase the quality of the movie. They're actually building an entire experience over at the Las Vegas sphere. So there's a ton that's going into that. They're using AI. It's absolutely fascinating. I'm going to dive in and I'm also going to show you some clips if you're watching on Spotify or YouTube of what it's actually looking like, which blew me away, the special effects, but also what it means for the overall community for film in general.

1:13Is this going to be something that happens to every movie in the past? Are we going to try to keep some sort of historical accuracy in the quality? Like basically, what does that look like in the future for the whole industry? I'll be diving into all of that. But before we do, I'd love to mention that this episode is sponsored by AI Box, which is my very own AI startup. And I'd love for you to try it out if you haven't already. Basically, if you go to AIbox.ai, you can get access to the top 40 different AI models. It's$20 a month, so you don't have to have subscriptions to all of the top AI models.

1:42But you can compare results from an AI, from a prompt, side by side. So recently, I was asking it to generate an image. And I generated it with Ideogram, Flux, GPT, Image 1, which is basically what's built into ChatGPT. And it was really cool to see the same prompt generated with a whole bunch of different platforms. So you can do this with images is cool, but you also can do it with text. If you're ranking a document or an email, you can do it with audio to see what 11 labs versus opening eyes, audio tools sound like compared side by side. So you can do all of that and chat with all of the different AI models all in one thread, which is incredibly useful.

2:18And, uh, just not, you know, you're obviously not able to do that with chat or anything else. So if you're interested in trying this out, the link is AI box.ai. It's currently in beta. We have a ton of new exciting features coming soon. So I'd love for you to go check it out. there's a link in the description all right let's get into what is going on with the wizard of oz so basically they're blowing up the wizard of oz which by the way if you didn't know the wizard of oz is actually according to the library of congress the most watched film of all time is the wizard of oz now i'm not 100 sure how they calculate that like perhaps maybe it's true maybe it's true it is it is an old film and so people watch the old films but um i don't know anyways I guess I'm not questioning the Library of Congress.

3:01I just like, I actually, to not, if I'm being honest, I don't think I've seen the whole thing through. I've seen a lot of clips of it. So maybe that's just me. But in any case, it is the most watched film of all time, apparently. And they're putting it into the Las Vegas sphere, which if you don't know, giant ball inside of Las Vegas where the whole thing inside and outside is LCD screens. And it's 360, you look around, it's amazing, right? So what's interesting though, is you can't just like, they're not just taking the film and projecting it on like a 360. So you have to like crane your neck and look in a circle to see everything that's going on, they are creating a whole new experience.

3:31So they're using AI to generate the edges to increase like the size and, and doing a whole bunch of things to make it more immersive to feel like you're inside of the movie, which is really interesting. They had, um, they had like some clips where they were sharing kind of what it looked like. They said, apparently there's 2000 people working on it, but, uh, I was, I'm sharing a clip where basically you're inside of the tornado and the sphere all around you is showing you like you're, it's a tornado funnel and then it's sucking you up and it like looks really really impressive but the thing that was pretty tricky with this whole movie was basically you can't just use a regular film for this experience and also i would say like the sphere is an interesting thing and you might be like who cares about the sphere like it's a tourist attraction but i think it's interesting because this exact same concept and strategy that they're applying here is also going to be needed for vr for apples and sets for meta's headset or for anything else like that if you want to watch these 360 movies it's going to be the same concept so i think it's not just going to be like it's not like oh man no one else like no other movie company needs to do this because it's just the spirit it's like well if you want to have these 360 immersive videos i think a lot of people in the future would be interested in that and so this is probably something that will happen more and more in addition to maybe like increasing quality or other things like that which some people argue because they just love the artistic uh authentic old quality of something So, I mean, that's a great viewpoint as well.

4:55In any case, this is going to be starting on August 28th that this movie is going to be premiered. Like I mentioned, there is a 2 ,000-person team that is currently working on this. And, of course, the sphere is massive. A 160 ,000 square feet. This is kind of a 360 experience. And, of course, like ceiling, too, which is so interesting, right? Because you got to, like, watch the movie straight ahead of you. But then, like, above you is going to be, like, whatever's in the sky of the movie. So they got to fill that in, too, which is really interesting. So the CEO of the sphere, James Dolan, basically says that they are using AI to both increase the resolution of the existing film, right?

5:31They're going from like an old film to massive. And then they're also using it to expand the footage beyond the frame that was actually shot. So an example that they used is that this is from Ben Makuski said that throughout the entire through the entire use of AI, you know, he said, quote, a grainy close up of Dorothy becomes richly detailed. And then through a process called outpainting, though, it seems like magic. We see the rest of the scarecrow, the yellow brick road and the mountains of Oz. right so basically like in you know the original shot when the scarecrow is kind of like dancing his elbow goes off the screen and gets cut off but if so but like if you're in like a huge sphere and you have to make it like 360 you need to fill in that elbow so that there's nothing beside it and also you need a lot more space to the right and left of of the shot so they're they're like they're basically what they said that they're trying to do is they said um this is dolan he said quote our standard on this was not to modify the film at all but to try and bring you into the film as if you were in the studio when it was shot.

6:32So I think what's interesting is like there's the outpainting for sure, but they also said that in some cases, expanding the frame means that they actually have to create some new performances from the existing characters that weren't there originally. And so I guess that's like historically what people complain about the most. But I think overall, they're trying to stay true to the film, they're trying to basically make it the same film, and they just have to expand it a little bit. I think the concept is fascinating. I was recently editing a video over on Adobe Premiere. And they have a very interesting similar tool.

7:00Basically, I had a clip that needed to be synced up to something in particular. And the video was shorter than the audio I was syncing it to. And the video at the beginning of this particular clip was it was like pointing at like a rock and then it panned over to something. And so basically, I just use AI clicked and dragged it and it just it just added some extra motion, some extra, I don't know, rock texture before. So the whole clip synced up with the audio. I thought it was absolutely amazing. It saved me so much time and pain in that particular situation. And no one that ever watches the film is ever getting like, it's not even like, oh, your video is AI generated.

7:35It's like you're just using AI to help fill out a little pieces the same way you use Photoshop to help tweak an image or or basically all the tools we have from Photoshop that we now have for images or for video as well. So I'm honestly really excited. I think this is absolutely fascinating. It's going to unlock a lot inside of film. I think we'll see a lot of other studio companies do this. like I mentioned, not just for the sphere, but for 360 VR experiences as well. So I'll be really curious to see how the Wizard of Oz plays out in the future and what other experiences we'll see next, you know, thanks to AI and what we're basically able to do with this.

8:09Thank you so much for tuning into the podcast today. If you learned anything new about the future of AI and video, make sure to leave a rating and review on the podcast. It honestly helps the algorithm out a ton. So pretty much when you leave a rating and review, it tells Apple, Spotify, YouTube to recommend the show to other people like you and other amazing people. So it helps me out a lot and I'd really appreciate it. Thanks so much for tuning in. Make sure to go check out AIbox.ai if you want to check out all the latest AI models in one place. And I hope you have a fantastic rest of your day.