From VHS to 4K: AI Makes It Happen

0:00Today on the podcast, I want to talk about using AI to remaster old films, images, videos, classics. what's going on with the industry there because I think that there is a huge boom that's about to basically be unlocked you know we've all seen an old VHS tape and I I feel like recently I've seen somewhere on an old tv and I'm just like blown away by how like it sounds terrible but like how low quality it feels um compared to what we're so used to now but of course you get that retro feel so that's kind of cool and you don't really want to miss out on what it looked like back in the day But the way of the future is basically using AI models right now to remaster a whole bunch of these older films for higher quality.

0:43And what's really blown me away is there's a huge project underway right now to do this for the classic Wizard of Oz movie. And they're not just trying to, you know, increase the quality of the movie. They're actually building an entire experience over at the Las Vegas sphere. So there's a ton that's going into that. They're using AI. It's absolutely fascinating. I'm going to dive in and I'm also going to show you some clips if you're watching on Spotify or YouTube of what it's actually looking like, which blew me away, the special effects, but also what it means for the overall community for film in general.

1:14Is this going to be something that happens to every movie in the past? Are we going to try to keep some sort of historical accuracy in the quality? Like basically, what does that look like in the future for the whole industry? I'll be diving into all of that. But before we do, I'd love to mention that this episode is sponsored by AI Box, which is my very own AI startup. And I'd love for you to try it out if you haven't already. Basically, if you go to AIbox.ai, you can get access to the top 40 different AI models. It's$20 a month. So you don't have to have subscriptions to all of the top AI models.

1:42But you can compare results from an AI from a prompt side by side. So recently, I was asking it to generate an image. And I generated it with Ideogram, Flux, GPT, Image 1, which is basically what's built into ChatGPT. And it was really cool to see the same prompt generated with a whole bunch of different platforms. So you can do this with images is cool, but you also can do it with text. If you're ranking a document or an email, you can do it with audio to see what 11 labs versus opening eyes, audio tools sound like compared side by side. So you can do all of that and chat with all of the different AI models all in one thread, which is incredibly useful.

2:18And, uh, just not, you know, you're obviously not able to do that with chat or anything else. So if you're interested in trying this out, the link is AI box.ai. It's currently in beta. We have a ton of new exciting features coming soon. So I'd love for you to go check it out. there's a link in the description all right let's get into what is going on with the wizard of oz so basically they're blowing up the wizard of oz which by the way if you didn't know the wizard of oz is actually according to the library of congress the most watched film of all time uh is the wizard of oz now i'm not 100 sure how they calculate that like perhaps maybe it's true maybe it's true it is it is an old film and so people watch the old films but um i don't know anyways I guess I'm not questioning the Library of Congress.

3:01I just like, I actually, to not, if I'm being honest, I don't think I've seen the whole thing through. I've seen a lot of clips of it. So maybe that's just me. But in any case, it is the most watched film of all time, apparently. And they're putting it into the Las Vegas sphere, which if you don't know, giant ball inside of Las Vegas where the whole thing inside and outside is LCD screens. And it's 360. You look around, it's amazing, right? So what's interesting though, is you can't just like, they're not just taking the film and projecting it on like a 360. So you have to like crane your neck and look in a circle to see everything that's going on, they are creating a whole new experience.

3:31So they're using AI to generate the edges to increase like the size and doing a whole bunch of things to make it more immersive, to feel like you're inside of the movie, which is really interesting. They had like some clips where they were sharing kind of what it looked like. They said apparently there's 2000 people working on it, but I'm sharing a clip where basically you're inside of the tornado and the sphere all around you is showing you like it's a tornado funnel and then it's sucking you up and it like looks really really impressive but the thing that was pretty tricky with this whole movie was basically you can't just use a regular film for this experience and also i would say like the sphere is an interesting thing and you might be like who cares about the sphere like it's a tourist attraction but i think it's interesting because this exact same concept and strategy that they're applying here is also going to be needed for vr for apples and sets for meta's headset or for anything else like that if you want to watch these 360 movies it's going to be the same concept so i think it's not just going to be like it's not like oh man no one else like no other movie company needs to do this because it's just the spirit it's like well if you want to have these 360 immersive videos i think a lot of people in the future would be interested in that and so there's probably something that will happen more and more in addition to maybe like increasing quality or other things like that which some people argue because they just love the artistic uh authentic old quality of something so i mean that's a great viewpoint as well in any case this is going to be starting on august 28th that this movie is going to be premiered like i mentioned there is a 2 000 person team that is currently working on this and of course the sphere is massive a 160 000 square feet this is kind of 360 experience um and of course like healing too which is so interesting right because you got to like watch the movie straight ahead of you but then like above you is going to be like whatever's in the sky of the movie so they got to fill that in too which is really interesting so um The CEO of the Sphere, James Dolan, basically says that they are using AI to both increase the resolution of the existing film, right?

5:31They're going from like an old film to massive. And then they're also using it to expand the footage beyond the frame that was actually shot. So an example that they used is that this is from Ben Makuski said that throughout the entire through the entire use of AI, you know, he said, quote, a grainy close-up of Dorothy becomes richly detailed and then through a process called outpainting though it seems like magic we see the rest of the scarecrow the yellow brick road and the mountains of Oz right so basically like in you know the original shot when the scarecrow is kind of like dancing his elbow goes off the screen and gets cut off but if so but like if you're in like a huge sphere and you have to make it like 360 you need to fill in that elbow so that there's nothing beside it and also you need a lot more space to the right and left of the shot so they're they're like they're basically what they said that they're trying to do is they said um this is dolan he said quote our standard on this was not to modify the film at all but to try and bring you into the film as if you were in the studio when it was shot so i think what's interesting is like there's the outpainting for sure but they also said that in some cases expanding the frame means that they actually have to create some new performances from the existing characters that weren't there originally and so i guess that's like historically what people complain about the most but i think overall they're trying to stay true to the film they're trying to basically make get the same film and they just have to expand it a little bit.

6:52I think the concept is fascinating. I was recently editing a video over on Adobe Premiere and they have a very interesting similar tool. Basically, I had a clip that needed to be synced up to something in particular. And the video was shorter than the audio I was syncing it to. And the video at the beginning of this particular clip was it was like pointing at like a rock and then it panned over to something. And so basically, I just use AI clicked and dragged it and it just it just added some extra motion, some extra, I don't know, rock texture before. So the whole clip synced up with the audio.

7:24I thought it was absolutely amazing. It saved me so much time and pain in that particular situation. And no one that ever watches the film is ever getting like, it's not even like, oh, your video is AI generated. It's like, you're just using AI to help fill out a little pieces, the same way you use Photoshop to help tweak an image or, or basically all the tools we have from Photoshop, we now have for images or for video as well. So I'm honestly really excited. I think this is absolutely fascinating. It's going to unlock a lot inside of film. I think we'll see a lot of other studio companies do this, like I mentioned, not just for the sphere, but for 360 VR experiences as well.

7:58So I'll be really curious to see how the Wizard of Oz plays out in the future and what other experiences we'll see next, you know, thanks to AI and what we're basically able to do with this. Thank you so much for tuning into the podcast today. If you learned anything new about the future of AI and video, make sure to leave a rating and review on the podcast. It honestly helps the algorithm out a ton. So pretty much when you leave a rating and review, it tells Apple, Spotify, YouTube to recommend the show to other people like you and other amazing people. So it helps me out a lot and I'd really appreciate it.

8:29Thanks so much for tuning in. Make sure to go check out AIbox.ai if you want to check out all the latest AI models in one place. And I hope you have a fantastic rest of your day.