NAB Preview: PYXIS 12K, Strada Agents, Gaussian Splats and More

5 Apr 2025 · 46 min

Ask about this episode

Ask anything about it. ChatGPT or Claude reads this page and answers with the times it was said.

Connect VO and ask about every podcast you hear, including the moments you saved. Add to ChatGPT · Add to Claude

In short

Denoised Podcast Episode Summary: NAB Preview: PYXIS 12K, Strada Agents, Gaussian Splats and More

Episode Overview In this episode of the Denoised podcast, hosts Addy Ghani and Joey Daoud discuss key predictions and announcements as the National Association of Broadcasters (NAB) trade show approaches. They analyze the leaked news about Blackmagic's new 12K PYXIS camera, Strada's peer-to-peer media sharing tool, Adobe's latest AI features, advancements in Gaussian splats technology, and OpenAI's strategic shift towards open-source models.

Key Themes and Discussions

NAB Predictions and Announcements

  • Blackmagic's PYXIS 12K Camera
  • A leak reveals a new 12K version of the PYXIS camera, featuring an RGBW sensor.
  • Exciting capabilities include automatic sensor remapping for various resolutions, offering wider field of view without crop issues.
  • Speculation on pricing estimates; potential moves to drop current prices to compete in the market.
  • Strada's Peer-to-Peer Media Sharing Tool
  • Launching Strada Agents, which allows users to make hard drives remotely accessible without cloud intermediaries.
  • Direct peer-to-peer access to media files, which could solve many existing workflow issues tied to cloud storage.

Adobe's AI Features

  • New Updates in Premiere Pro
  • Introduction of smart context search to enhance footage organization.
  • Generative Extend feature enables editors to generate additional frames from existing footage, streamlining editing processes.
  • Importance of ensuring safety around users' data while using AI features.

Gaussian Splats Technology

  • Increasing momentum in the use of Gaussian splats for 3D scanning and virtual production.
  • Discussion about how it can aid in tech scouting, creating photorealistic environments without extensive manual processes.
  • Implications for museums and virtual experiences beyond film and TV.

OpenAI's Move to Open Weights

  • OpenAI announces a shift to open-source AI models, allowing users to download and modify weight data.
  • Discussion on the potential impact on enterprise AI adoption, especially for large companies that require secure, private data handling.
  • Speculation on the future business model, possibly mirroring approaches of companies like Red Hat for support and licensing.

Key Takeaways

  • Trends in Film Technology: The podcast emphasizes the rapid evolution of camera technology and AI in the film industry, with specific attention to how these innovations can enhance creative workflows and reduce costs.
  • Peer-to-Peer Solutions: Strada's new tool represents a shift towards efficiency and security, allowing professionals to access media files directly without cloud dependence.
  • AI in Editing: Adobe's advancements in AI indicate a trend towards integrating smart tools that enhance user productivity, while still addressing user concerns over data privacy.
  • Open Source AI: OpenAI's transition to open weights could redefine enterprise AI solutions, allowing for more localized, secure implementations of advanced AI tools.

Conclusion The hosts conclude by highlighting the excitement surrounding NAB and the potential for significant technological advancements in the media and entertainment industry. They invite listeners to stay tuned for more updates following the trade show.

---

For more information and updates, visit [Denoised Podcast](http://denoisepodcast.com).

Written by AI. May contain mistakes. Listen to the episode to check what was said.

Hear the part that matters, and keep it.Open this episode in VO. Double tap your headphones to save a moment as you listen.
Get VO free

Transcript

Automatic transcript. May contain errors.

0:00In this episode of the Denoise podcast, we're going to talk about NAB predictions and what we already know. and open AIs move into open weight. Let's get into it.

0:12All right, welcome back to the podcast. Hey, Joey, you going to NAB? I'm going to NAB, getting ready to go tomorrow. We just had a team meeting with all our editors and stuff, so getting ready for the circus of a bunch of video coverage. Yeah, no, it sounds like it's going to be a really exciting year. Lots of new announcements. I'm sorry, I'll miss it. I know. But I'm sure we're going to catch up. Yes, we'll have a debrief after the fact. But Yeah. Bummed that he won't be there. We can't tag team around the show. So yeah, but there have already been a good handful of announcements and interesting products coming out.

0:40So I want to break down and talk about what we already know and what's kind of circulating around the internet. We're recording this Thursday. Yeah. I know Blackmagic is doing their big press live stream or usually the pre-recorded, but their big press announcement of all their new updates tomorrow morning, Friday morning. So by the time this comes out, that will probably have already played. So then if you're like, why don't you talk about all the new stuff that came out? That is why we're talking about this Thursday, but there was a leak today of a new update to the Pixis camera. They're releasing a 12K version.

1:06And I was wondering this, it looks like it is with their RGBW sensor. Oh, wow. Because I was wondering, I'm like, are they going to start putting that sensor into more of their smaller cameras? And it looks like that's very exciting. And as we talked about in the episode, breaking that down, the really cool thing about that is if you shoot different resolutions, it automatically can remap on the sensor and you don't have to deal with the crop issue. Yes, it doesn't do like the typical downsampling, right, where it punches into a section of the sensor. This, if you don't want to shoot 12k, which a lot of cases probably don't.

1:34So even if you're shooting 4k, it's not like you're forced to crop in a lot more, right, you can still get the wider field of view, which means you're still getting like a full frame lens response. And you're getting all of the photosensitivity of that entire sensor, yet, it's lightweight, because you're probably shooting 4k or something. Yeah. So yeah, that's exciting. I am curious. So this was sort of a leak from there because Blackmagic usually does a lot of outdoor signage around the convention center and around the hotel across the way. The downside of that is you have to put it up early and people will take photos of it.

2:04And this was how it was posted on Reddit. And they're putting the signage out. So it's just a picture of it. I am curious if it's going to be the same exact body or if it's going to address a few of the slightly annoying things on the Pixis, like it only has one mini XLR input, doesn't have any internal ND. So I wonder if they're going to bump anything up with the Pixis itself, or it's just a higher resolution version, same exact body. And then there's the URSA Cine 12K. I was just going to say, like, this is the sort of issue a lot of manufacturers have with product lines at different tiers. Like you don't want the tier at the bottom to start nabbing sales of the tier up top, which really makes more money.

2:42so i think they'll keep a really clean line between the pixas and the ursas like you want it you need more input like you need x y and z go get the ursa or if you're good with this get the yeah i'm wondering that what do you think pricing the pixas as it is now is 3 000 yeah we saw what was the ursa 12k they dropped the body only to like 6 000 7 000 i thought 7 000 yeah and i'm guessing this maybe four or forty five hundred i wouldn't be surprised if they offer this uh 3 ,000 and blow the red Komodo out of the water and drop the existing Pixis price down to like 2 ,000 or something. Correct. Yeah.

3:15It's like everybody at the 3 ,000, it's incredible. The world we live in$3 ,000 gets you a solid cinema camera. I mean, yeah, with the bread dropping their price. I mean, I've not seen anything like affordable cinema cameras, high quality like this. Yeah. I mean, do you remember like about a decade ago when we would have to shoot something? The hardest part was getting a camera with enough dynamic range with the correct lens mount and all those things and now those are all or that had video features you know we're talking about the 5d mark ii and it's like well it looks great oh but you can only record like a couple minutes at a time before you have to cut and it has like zero video features and you're sort of like hacking your way through it yeah i mean get something that looks cool we didn't transition to like the mirrorless world of dslrs and now we're in the world of like proper sensors made for cinema which is what the Pyxis and the Ursa sensors are.

4:07Yeah. I am wondering about the price and I feel like it's going to be crazy that I'm going to probably have to ask companies this and bring in economic policy into NAB. But there are a bunch of tariffs that just went to effect in the US. And I'm wondering, is this going to affect pricing for these companies, especially something like someone like Blackmagic, they usually are pretty outspoken about their price and make it a big part of like their marketing campaign. Is that going to change like based on... Where are these things made? Probably not in America. I highly doubt that. I mean, they're also an Australian company.

4:37So it's probably Southeast Asia, like Thailand, Vietnam, I guess. I'm wondering for their sales in the US, is that whatever price they announce, is that going to stay the same? Is that going to change? And I'm kind of wondering that across the board for all the hardware companies with their pricing. I mean, that's a bigger question for the economy. Are the manufacturers that are going to get hit with the tariffs, are they going to absorb the cost, cut back in other ways, like sales and marketing, whatever department? or are they going to just pass that cost to the consumers and look 25 more expensive right or a combination of all of the above yeah yeah so didn't think i'm gonna have to become an economist going to nab but i feel like that's gonna like surprisingly play into the conversation i mean just to kind of play the devil's advocate who is american cinema manufacturing like as far as camera sensors go is as red making their sensors here probably not does anyone make their sensor here i don't know enough exactly manufacturer so i don't think i don't think so and that's the same issue with any kind of silicon right whether it's a cp or gpu like the wafers aren't made in america anymore and camera sensors are wafers so i think there is not a single camera manufacturer that is not going to be hit with tariffs in my opinion yeah where their cost of sales in the u.s are going to be affected yeah one last thing about the fix is i am excited that the way this news leaked feels like I've talked about how the excitement of like NAB pre-pandemic feels like it hasn't bounced back yet.

5:59But this was the kind of stuff that would happen from NAB or online around like pre-pandemic where like someone, some booth would be setting up their signage and someone would like sneak a photo and like post it online. And it'd be like, oh, look, Atomos is launching this new thing. And I feel like we haven't had that, you know, buzz and excitement around some like leaked photo. And so I'm excited to see that just anything is like leaked. And there's some like mystery and excitement before it's officially announced. It's really nice, right? Because it takes you back to when you were excited about new technology and there was leaps and bounds in each generation.

6:32I mean, to go from the old Pixis to a 12K with RGBW sensor and still offer it at whatever price, I'm sure it'll be super competitive. That's a big deal. So very excited about that. All right. Other product announcement, workflow-wise, and they've been talking about this for a couple of weeks. Strata is releasing a new app. They're calling it Strata Agents. And it's basically a piece of software you can load on your computer and it will make any hard drive you have plugged into your computer remotely accessible. And you can access the media files, stream the media files, download the media files without having to put them on a clouding intermediary.

7:07It's directly peer to peer. You can just play it, stream it. That's insane. Yeah. How safe or secure is it? That's like my first question. I mean, with their account access, I will ask him more details about the security. But I believe it's streaming with WebRTC. And it is, yeah, I don't know. I don't think there's any encryption that's happening when you're playing it. But it has the account authorization. But the actual connection, how it opens up. It's through your Shroud account, which has credentials. And then anyone, I mean, currently it's still like an alpha mode. They did send me a preview to download.

7:39I messed with it yesterday. And it worked. I mean, it's wild. It's like accessing a computer somewhere else. and I can just kind of browse. Like it only works with video files. Yeah. But I mean, I'm able to browse it and click and hit play. And it's just like playing back online on the computer remotely. They said they've tested it with a computer in Australia and playback was pretty seamless. When this comes out and if it works the way it's supposed to, and I mean, in my test, it worked. It will solve a lot of the issues that I had when I was getting a NAS and I was trying to like get the team onto it.

8:08And then I realized like, oh, once you go into the media asset manager route, nothing directly works with the server. you have to like upload a proxy to a cloud intermediary. Or if they want to download a file, the file has to go to a cloud service and then goes to the person. Like the Blackmagic Cloud thing. I think you had a video or a live stream. Yeah. How do you compare that solution, which I think is like really well polished and elegant versus something like this? Blackmagic Cloud is definitely more polished, camera to cloud. They definitely want the Apple route. So like if you are using Blackmagic Cameras and you're using Resolve and you're using Blackmagic Cloud, it is a very seamless experience.

8:41And I will find out more about that because our plan is to use that entire workflow for our NAB coverage. I'll see how it works. So you're really going to put it to the test. I'm going to put it to the test because we have tried Frame.io and Camera to Cloud solutions in the past. And usually the issue is, I've been using a variety of different manufacturers. The main issue we hit was like the internet at the convention center sucks and everyone knows this. And if we paid up for like the Teradek with the 5G, we just didn't have the budget for that. This year, I'm going to have like a phone I'm using as a hotspot to try to solve that issue.

9:11We'll see how it goes. So your original question, comparing it to Blackmagic Cloud, it's different because Blackmagic Cloud, you still have to put the media on the cloud storage and then it downloads a local copy to whatever editor has access to that footage. This, you plug it, you stream it. You get access to the actual file. Yeah, you're basically turning your hard drive into a cloud accessible. Cloud drive. Cloud drive. Yeah. Like your own personal cloud without having to actually use a cloud service. And it's not just like. And then there's subscriptions and none of, you know, all of that advantages that come with having your storage.

9:41How would they make money from this? I mean, they have a subscription service right now. I don't know what they're pricing or how they're going to price this in. It's still early. I mean, I think they're previewing it. I think the official rollout that they have planned is in June. Okay. Yeah. I mean, it worked when I tested it. The playback was really smooth. So I'm excited to see how this goes. And it's pretty innovative with what they're doing at Estrada. It is. I've never heard of anything like it. And of course, production is so decentralized now. We cover tax incentives of where everything's going.

10:08this is like hand in hand with all of that yeah if you could just plug in the drive on a main computer and then like you know how your team can access it from your stage in ireland to the team in la yeah i mean i think that next stage would be like when you can start doing stuff with this media like running your like basically like running transcription running ai analysis doing string out edits in the cloud using this media on the hard drive right and then being able to whatever workflow, like download an XML file or download just the media clips that you need to your computer. So a lot of possibilities here and just cool that they're going the route of where you don't have to have a cloud involved because that starts getting pricey.

10:46Like an overarching cloud service. A cloud service where you have to like, you have your files locally, but then you got to copy them or upload them to a cloud service. And then you have duplicates of files. How do you manage all that? And yeah, it gets messy and expensive. Yes. Agreed. All right. Adobe announced a bunch of updates and features yesterday. I saw that. One that was most interesting in Premiere is smart search. Okay. Context search. I thought generative extend was also really interesting. Okay, well, maybe I'm like being picky on that one because they talked about that last year and it's been out in the beta.

11:17So I'm like, that's not new. It's official. It's officially in their official product release. Yeah, but the fact that they've rolled it out on the public release, two millions of Premiere users, that's a big deal. Yes. This is generative AI at scale in the hands of consumers. And something that is like a very practical application of it. Absolutely. Generative extent, if you're not familiar with it, it is basically like a common issue you run into as an editor is like, I want to add a transition or I need to, you know, extend this clip and they cut too soon. There are a couple of tricks you can do as an editor to try to fix that.

11:51But their solution is you just drag the handle out and it uses their Firefly model to generate. Yeah. Look at the video that you have before and then generate the extra frames that you need. I mean, the first question everybody's going to ask is how good is it? I don't know. I've never, I've not tested it. I've seen. Yeah. I'm trying to think if I've seen people test it. I've seen some videos online. I think in some cases it's absolutely usable, but I wouldn't go as far as to say that this is something that I see a lot of editors using day one. I mean, it's a case where you're like, I need a couple extra frames to like hold for this dissolve that I'm trying to do.

12:23And there weren't enough frames for it. That's like probably the most common case. And if it's going to dissolve anyway, you're not going to see final quality and all that. Yeah. I mean, my solution for that has always been like, well, just slow the clip down, which is, you know, buy a couple extra frames. And yeah, that's your solution. So that is cool. The one they announced that is new is basically, I don't know what model they are using, if it's their own model, but it can analyze your footage and you can start searching based on context. You can search your footage, you know, oh, the plate or like, you know, the medium shot of a person.

12:49So that's smarter contextual search of your media inside Premiere. That's video based, not audio based. Video based. That's, you mentioned that that is really important. That's really important. Yeah. And that's something that not a lot have been tackling. 12 Labs is a company we've interviewed a few times and they have a dedicated model to understanding video. Yeah. But I think this is the challenge and this is the benefit where it's like as a user, as an editor, you want these tools like to be in the one app that you use all the time. So it gets really complicated when it's like, well, I have to get out of Premiere.

13:18Yeah. Or even if I think they do have an extension or something where it's like you can bring it in, but they never work as well as like it's built into the app and it just works. Yeah, and that gives Adobe users so much more reason to continue their Creative Cloud subscription or whatever they're paying for. They're like, this tool just keeps getting better and better. A very, another very practical use of AI. I feel like maybe Adobe went a little too hard on generative and that kind of scared a lot of the user base. Yeah. And this is a much more like day-to-day practical, like you need, you have a lot of footage, you need to sort through it or you need to find the shots.

13:48Although I will say Adobe, I haven't looked into it too much. there was a little bit of heat around their end user agreement around. Yeah. In the promo videos, they did specifically say, we don't train on your videos. Right. Yeah. I think they wanted to clarify that because there wasn't like vaguely worded language in the end user agreement that someone noticed. And then that kind of caused a stir. Yeah. I think initially when they rolled out some of the first AI features from Adobe rolled out in Photoshop. And when that got rolled out in the agreement, it was something to the effect of paraphrasing.

14:21Like, hey, we may use your artwork to generate more stuff. Right. And this is like... Maybe it was just vaguely language. Because in the promo video, it said, we only use your video for generative extent to understand what we have to generate, but that we're not training a model. I would also be surprised if they even did that because their whole foundation of Firefly has been like, they're one of the only models where it's like, we have trained on licensed data. We know everything it's trained on. We have permission to train on it. It's commercially usable. I think they back it by like a million dollar guarantee.

14:51or something. So they have been like hardcore have been like, yes, it is a commercially safe model. Like we know what went into it. And their business depends on it. Yeah. And then Frame.io launched an update with transcription. Oh, let me show Frame.io. Yeah. I even saw this announcement. I was in Frame and then this little thing popped up and it's like, would you like to transcribe your video? And I was like, what? That is another useful because it's like keeping everything in the same tool. That has been another round trip process for us of like, we need a transcript to this. So we go take it to another tool.

15:18And then there's even there's no way they never had transcript support even to search. So yeah, it's nice to just see that they're extending that out. What I would love to see in Frame.io though, that they still have not launched in version 4, and it's been a year now, API. There is still no API access in version 4. So I hope that comes like soon. The flip side is it's so strong on a browser. Like there is no other tool I can think of, you know, even like SyncSketch or ShotGrid that is as good as Frame.io, as clean, as easy to use on a browser, on a phone. It just works. It's just a seamless experience.

15:50I mean, Adobe's move to acquire frame IO was so brilliant, you know? And did you hear Joey that they are in talks with Figma right now? Weren't they trying to, and then it fell through? Yeah. So I think there was like a monopoly thing. Yeah. And that just got cleared. So I think they're good to go. I said they are going to move forward. Yeah. Okay. So Figma. Figma was eating their lunch with like. Oh, Canva was eating their lunch with. Canva is the competitor to Adobe Express. Figma is the industry standard tool for any kind of UI design. like graphic design like app app web-based yeah like mobile apps and stuff yeah uh you can very quickly put animations together in figma it's all web-based and stuff yeah very cool tool and so that is moving forward because i remember that was wasn't like a 20 billion dollar deal something like that yeah yeah i feel like shifting more web-based tools too is another kind of future brand like i feel for like for that to work especially with something with premiere is that you can have the same project the same experience and not have this is the web version of Premiere and you can cut here, but then it has absolutely nothing to do with your desktop app.

16:55Yeah. It's like, I would want something where it's like, they mimic each other where it's like, okay, I could have the producer or someone if they need to do some like descript like experience of like, make an assembly cut, but that it sinks and is represented back in the desktop version where the professional editor is going to be doing the finishing version control. Yeah, something where it's not like, is it even like Photoshop Express or Photoshop, Adobe Express. Adobe Express, yeah, where it's like the web version and it sort of has some cloud syncing with Photoshop, but not a lot. Adobe Express is, in my opinion, just like an attempt at Canva, where Canva clearly shines on how sophisticated it is as a browser-based tool.

17:35But Adobe Express is nothing compared to the power you have on Photoshop. So you're absolutely right. I think that bridge needs to be just more sort of intertwined. Yeah. The other thing I think they can do more of too is connecting Adobe and Frame more because comparing it to the Blackmagic experience where now we're working in a Blackmagic cloud project and it integrates directly with Blackmagic storage and Resolve and the media just syncs. Adobe sort of has the Teams, which is like a cloud-based collaborative project, but it just handles the project files. It doesn't do anything with the media.

18:09So they're like, well, then, you know, use a third party solution like LucidLink and put your proxies there. Yeah. But we tried it and it was just not a very seamless experience. And I'm sure they're working on it. And they own a cloud. Right. I mean, they have frame. It's like they have their own cloud service. It's like you could do this. You can put the two together. Yeah. Yeah. The other one was an update from Celtics. So are you familiar with Celtics? No. I would have never known how to pronounce this, by the way. They were one of the first sort of web-based screenwriting programs. Okay. I remember they've been around for a while and they sort of were web-based, kind of trying to compete with like Final Draft and the other screenwriting programs.

18:44They were bought a while ago by Backlight, which is the company that owns Iconic and a couple other media tools. And I'm excited to see updates because I haven't really seen much updates with them, but I'm excited to see those progress there. One thing that they're launching that looks cool is a screenplay plugin for Premiere that will... Tell me more about that. It seems like it is a similar feature to Avid's Script Sync, where Avid has this built-in feature where you can import the script and it'll sort of match it with your shots and kind of help you pick takes and build out your first assembly cut.

19:15Okay. It seems like it is a similar feature to that, but with Celtics and with Premiere. And so you can connect your Celtic script inside Premiere and help find your shots and do your initial rough cut. Yeah. I mean, I've never done feature film editing. I'm sure it's very daunting. I'm sure you have. Not a feature. But like really long, big projects. Yeah. Yeah. I mean, the longest editing projects I've done is probably 15 minutes. Right. So imagine editing like a 90 minute thing. You would need tools like this. It helps speed it up. Yeah. Especially if you're doing something episodic, you have a script, you're doing a vertical soap opera.

19:49Yes. By the way, one of our podcast listeners from Philippines messaged me and said that they're doing some vertical dramas over there and I asked him to send me some. So he will. All right. I want to see. I want to check that out. Yeah. So yeah, that was another update. I thought that was cool and worth mentioning because it, yeah, Celtics has been interesting and I'm glad to see that there's still a new product. Very cool. Moving into virtual production. Yeah. What's Moses up to? Moses. So one of their updates is they have a smaller version of their star tracker coming out. That's their camera tracker.

20:18Yeah. I saw a picture of it. It looks like small, much smaller. Like the star tracker is small. Yeah. So smaller than the star tracker. This one smaller i don't know if they're targeting more of the creator space with just having something to maybe not necessarily do in camera visual effects or real-time tracking but something to put on your camera to just track the 3d space accurately to use it later in post if you're running with like a sony fx3 or a7r you just pop it on top it's as small as those cameras yeah and then you can get your camera data and you can use it later something similar to a use case you might use lightcraft 4 uh as your phone i mean it might do real time as well yeah just be smaller also they're probably competing more down market so where htc vibe mars is yeah like uh you know that's a pretty solid camera tracking system for i think a couple grand yeah yeah the whole kit's five grand yeah yeah so i think yeah an emosa system is probably double that like a star tracker yeah so i'm wondering yeah is this gonna be in the 10k range is are they gonna loosen up on the subscription fees, which, yeah, these higher end trackers charge continual fees for.

21:25I'm excited. I mean, any kind of technical advancement, miniaturization, streamlining of technology in the virtual production space benefits everybody. Yeah. I mean, I don't think seeing two new trackers was on my card this time in between this and the Ocellus from Sony. Yes. You know, two new trackers in the market. Yeah. The other thing that they announced, and I feel like this is going to be, I'm trying to think of like, you know, what trends or what other things are we going to see at NAB? And AI has always been a hot topic, but I still don't think we're going to see anything that's like revolutionary.

21:53I think that's not at NAB. It's all on Twitter. The new the AI updates. Well, that's what I was telling you. I think last episode you're like, is runway dropping this in front of NAB? I was like, runway has no idea what NAB is. Those are two different things. I think the big theme here to me feels like refinement. Refinement, workflow integration. Yeah. I see a lot of AI updates, but it's like on the enterprise level of smart dynamic ads or upscaling your broadcast stream or your older broadcast streams like so that they're, you know, from HD to 4K using AI uprezzing. The manufacturers are smart.

22:29They're following the money. The money is no longer in like a classic film and TV shoot per se, because the market has just been weak for the last couple of years. So where is the money? Broadcast, VP outside of film and TV. So corporate. house of worship. And that's why I'm wondering if like having it as a smaller and just like a camera tracker and not necessarily like, oh, you want to build it into a soundstage, right? Real time, LED wall, ICV effects, but you just want highly accurate like camera tracking. If that's the route they're going. Yeah. You look at a consumer oriented company like DJI, right?

Read the full transcript

23:03They're selling to millions and millions of people. I think Moses wants a piece of that little market. Yeah. There's like a market there too. Education. But trend that I do think is sort of sneaking up Gaution Splats. I've seen like three or four different company updates around integrating or something with Gaution Splats. So one of them is another update from Mosis. We got this email this morning calling their scan to shoot VP workflow. And it is basically, it seems like it's a combo of using LiDAR and Gaution Splats to scan a scene to do previs and tech scouts where you can scan an environment and then bring it in.

23:38I believe Moses is coming into play using their software and create a photorealistic looking, highly accurate 3D representation of whatever location you're trying to scout. And then everyone else can come in and like virtually scout. That's super forward thinking on Moses' part because they already have the ecosystem. So why not just bring a Gaussian splat technology into it? And I think the announcement that I saw was they scanned something in London, sent it to Studio X in Thailand. shout out to linda and uh they shot as if they were in london in thailand this wasn't just for previous this was also like to put it on the wall i believe so yeah i guess that makes sense with scan to shoot yeah it would make sense in the title location across the world yeah okay yeah when i was reading the press release it seemed more like a tech scout kind of thing but yeah okay to getting final so how high of the resolution would you need display on a on a led wall pretty high and i get yeah because gaussian splats are not there yet as far as resolution goes not because the scans aren't good enough it's just a real-time performance limitation because they're computing those ellipsoids those gaussian little bubbles on the fly millions of them at the time they need to be in the billions uh-huh and i i don't think like the current algorithms and the compute power is just there yet i mean it always comes down to like what kind of shots do you need and is it going to be blurry in the background so yeah i'm curious more and i'm talking about this i'll see what this workflow looked like.

25:03I think it's definitely promising because the whole, you know, upside to Gaussian Splats is you get the parallax, you get all the benefits of photogrammetry without any of the work involved with building a photogrammetry asset. You just did a whole thing with Global Objects and Leica and there was a lot of post-production. Yeah, mostly Leica Geosystems. We got the part two with Global Objects that is not released yet, but Global Objects takes the Leica high-res LiDAR scanners and then combines it with their method of doing high resolution photography. Yes. And then merges it to get these photorealistic, highly accurate digital twins that are good enough to display on an LED wall.

25:42The global object outputs will probably be really high resolution and good to go on an LED volume because they're done the traditional way, probably using something like reality capture, like a very industry standard software. What if you can do, you know, half of that quality level at like 5 % of the work? Right. that's the promise of Gaussian splats. And they're believers too. Like the Gaussian splats will be the future. It's just, it's not there yet. It's not there yet. But that is where it's going to go. But we're seeing a lot of updates with that as now. So, I mean, the other one, like Craft Jet Set, which we've talked about repeatedly, but yes, where they have the app on the phone, you can strap it to your camera.

26:16But they have been doing a lot with loading Gaussian splats directly onto your phone, much lighter weight. You can have a bigger world. You don't have to deal with the whole Unreal Engine. That's asking for a lot on the phone. We'll also see how that works and get a demo of the workflow with that. But yeah, that was another big push they were doing. And also one of their other updates was that when you're recording on your phone, it will also record the LiDAR data. From the depth sensor, yeah. Yeah, from your phone as another data track that you can use in post-production. And I think the LiDAR data just comes in as a grayscale image.

26:45So it's pretty easy to work with in like Nuke or something. Where you just kind of like a video depth map based on the data, yeah. And then this other update from Valinga, which is another - Gaussian splat. Gaussian splat, yeah. Yeah, digitizing the world. Shout out to Fernando Rivas. Yeah, Volinga announced that they have an Asus color-managed Gaussian splat. Wow, that's... How does that even work? Yeah, so I know Volinga a little bit, and they have been finding out ways to take their 3D Gaussian splat engine and make it production-ready. So some of the things that are missing in Gaussian splats right now is bit depth, like the stuff that it's mostly 8-bit.

27:23Color space is a big issue. I mean, you're shooting something on an iPhone, going through the Gaussian splat solve, and then when it comes out onto a wall, what color space is it at? Well, it depends on the color space you shot it, but is there any transform happening during the solve? So I think this is an attempt at fixing all those things. If you can have an Asus ready Gaussian splat, then you can color manage it with any sort of standard media server, like a disguise system. And then that will ensure that, you know, your oranges are exactly the shade of orange that you intended and so on. So this is a really big deal.

27:59It doesn't seem like much, but it is if without this step, Gaussian splats won't be taken seriously in the production world. Right. This puts it more in the actual production pipeline to be more viable. Yeah. And just to pair this with Stability AI joining the Academy Software Forum. so they are also i'm speculating here they're just probably working on making their generations aces compliant yeah right so it's all like it doesn't matter what you can build with it that stuff soon has to go into a movie pipeline that right and that's been yeah big issue with the ai outputs it's like yeah you can get it but it's like a weird low-res format that's barely usable for like anything outside of the web yeah it's typically srgb 8-bit just like any jpeg image on the internet, but that's not what movies are made with.

28:46Yeah. So if you are, I mean, do you know, if you were shooting a Gaussian splat for this pipeline, do you have to shoot it on a camera that can handle this color system or in a format that can go into the Valinga pipeline and maintain the color space? Yeah. I would imagine that take some really high dynamic range camera, you know, just like a Pixis, right. And shoot it raw and then color graded in your computer. So conform it to like a rec 2020 push that into valinga it'll output a gaussian splat that is now built with rec 2020 files and then valinga will be aware that it's in 2020 space and so when you plug it into a system that can recognize color spaces like aces you can check that 2020 box so my guess is it's something like that yeah that'd be cool very very cool yeah yeah so yeah i feel like yeah gaussian splats is a little bit sneakier as more of a thing i've been seeing trending more than just AI.

29:40It is just more of a practical use case of AI technology. I mean, the Gaussian Splat system is solving using machine learning. It's just not generating stuff. It's recreating the world. And I think that has far more implications, not just in film and TV. You're talking about museums and virtual experiences and domes and anywhere you're trying to recreate something else from the physical world. 3DGS is very cool. And last one that we had flag that was interesting. Another update from Sony, they have an update to their Venice extension system. It's the Venice extension system mini. I have been a little bit fuzzy on how different this is than the Rialto and why it's not just called the Rialto mini.

30:17I think the Rialto was very niche, boutique and experimental. I know they used it for Avatar 2 and they used it for Top Gun. And just to set the stage, like, so the Rialto was a, you have the Sony Venice camera body. Yeah. The Rialto is you take the sensor and put your lens on it and have a eight foot-ish cable so you could kind of mount the camera in different spots that was it's physically too small to mount or handheld yeah that so you can separate the body from the sensor so you put the body on your backpack or somewhere else yeah like just to give a frame of reference to our listeners the venice 2 is about the size of your head and let's say you want to shoot top gun uh tom cruise is in a cockpit in front of him is the HUD of the plane.

31:01There is probably like a six inch by six inch space to put a camera. So you can't put a Venice 2 there. So this cable extends just the sensor to that little spot, which is that size. And then all of the processing and the memory card and all the writing is happening up to, I think, 18 feet away. 18 feet, okay. Yeah. That's right. So you can put the body by his feet or somewhere else where you have more space where you can mount it out of the shot. I think it's like a fiber optic cable that's super, you know, ruggedized. so the rialto this was a couple years ago two three years ago when that made a big splash it still felt like a very boutique thing that not a lot of cinematographers are using it's very expensive it's something that sony is probably supporting one-to-one this feels more like a product like that's just ready to buy and go out into the world and it is smaller than i believe the rialto was like a physical like size of the it's the same sensor but yeah it's like i think It's pretty much the sensor in a little box.

31:56Yeah. It's like a little bit bigger than a GoPro. Uh-huh. Yeah. It's very small. Yeah. For a full frame. I mean, I think the Venice 2s are even bigger than full frame. That's a giant sensor in that little package. Yeah. Yeah. That's another update from them there. I heard rumors. Interesting. Joey, it was just a rumor, but you know, we're undenosed here that Sony's looking at extension system for other cameras like the FX3. So like more of a consumer based extension system. That's already so small. But imagine if it could be like. it for one inch by one i could see it for like the what's their more body fx6 fx6 up is more of a traditional body yeah i could see it probably like that yeah we have a kind of a bigger body and so you can put the body somewhere else yeah fx3 is like a7r dslr yeah fx3 is like yeah so like it's small already yeah we'll see how it goes but you know they shot the creator on the fx3 did you go dog you heard it here first you heard it here after 20 000 other people kept talking about that yeah uh yeah that'd be yeah that'd be interesting yeah i'm i'm i know there was a version of it for dji came out with a version of it for the the 40 for the 40 yeah yeah which i love that camera and uh the corridor crew folks youtubers yeah they love that camera they use it all the time i've never used it it looks fascinating yeah for very interesting shots they use it for civil war yeah they did i saw i think i told you this too i'm like i saw it on uh I saw them using it on F1.

33:18In reality, like when they were doing, because when they're shooting the F1 film, they were like bringing the actors into like actual F1 events. And so that's right. You said, I saw on the podium when they had like Brad Pitt on the podium and they had everyone act like, you know, he really won. There was a person with the 4D like filming him. Because yeah, you don't want a giant. No, you can get, I mean, they talked about that in Civil War. It was like, well, you can get, you can tweak the stabilization balance where you can have it, you know, kind of have a little bit of handheld, but stabilize it.

33:43So you had like a lot more control over, you know, if you have like a lock solid, gyro stabilized or something in between handheld and yeah stabilized my i think it has like a weird lens mount that's like my only note is how do i mount like it's like dji's lens yeah the zen moose system or whatever that is yeah yeah so like you can't just throw any lens on it but i heard the sensor's pretty solid yeah i remember when uh in the drone when the drones are such a hot thing and they were coming out in ab and do you remember 3d robotics no yeah they were short-lived um i have one i bought one there they were like oh they didn't make the actual cameras they were a gopro mount but they had some of the earliest ones they were one of the first companies that kind of where you could program smart moves into the drone but then it would hold a gopro camera and my thought was like well i would rather go with gopro who makes the sensors then go with like dji where it's like what they make drones and sensors right that was wrong choice clearly they figured out that whole game yeah so yeah so yeah that's our kind of nab roundup of what we know now, but obviously there'll probably be more updates and stuff.

34:46And so we'll be doing a bunch of video coverage. So all of our videos are going to be on YouTube. So check us out on YouTube. And we will do another debrief next week after we check out everything and see what we didn't cover here and all the new updates and stuff. Absolutely. Yeah. And I'm sure there'll be a few surprises. So definitely tune in next week for our full NAB coverage. All right. And last story here, another kind of interesting update in the AI space. What do we got, Addy? Yeah. So OpenAI, one of the companies that we're all following closely as they're really setting the trend for what is happening in the AI world, right?

35:17They're generally first to market. ChatGPT 4.0 image generator blew a lot of image generators out of the water. They were the first to sort of introduce an LLM to the public with ChatGPT, first to kind of come to market with a video generation model Sora. So this is a company that's clearly, you know, steering the ship. And so now they announced what they're calling an open-weight, open-source model. So let me back up here. Yeah, what is that? Basically, when you have an AI model that's fully trained, it's quote-unquote closed, which means the actual secret sauce and how it is reasoning is all built into neural network weights.

36:00And there's billions and billions of these weights which connect one matrix multiplier to another. and there's a weight and imagine like a very complex circuit with a lot of wires and each wire is either very thick or very thin and that's the weight of the wire and this is more or less the ai models uh personal that that is the snowflake right that is what makes the ai model unique from the next one so for them to just come out and release quote-unquote their secret sauce of a model that's huge uh this is exactly what deep seek did and that's why anybody can run deep seek on their computer because you can just download the weights take it or modify it and make it your own version yes yeah i believe stable diffusion is open weight as well so that's why stable diffusion is so popular llama 2 metas llama or they llama 3 is open weight as well i meant two as two as well yeah but t-o-o yeah but you remember when uh you know this was like a year ago when elon musk had a problem with sam altman and elon musk was one of the primary founders of open ai back in the day.

37:06So, well, you might as well call your company closed AI because there's nothing open about it. So, FastFooter today, they're coming in on their promise to be - Making it open. Yeah, they're making it open. I don't think they're doing it because they're altruistic. I think they're doing it for very hard to find business reasons. To me, it feels like that is enterprise and where all of the money is to be made. You cannot make that money with the closed model. So, if it's open, you can just download the model and then modify yourself, correct? Like do companies charge for the models if it's an open weight or is it pretty much standard where it's like it's freely available?

37:42If it's an open weight model, the model's already been trained. You can modify the output to some extent by attaching LORAs and some front end tools. But the biggest benefit is if it's like, you know, we're thinking in the M &E world, you have a Disney or an Amazon or a Netflix. These guys are very protective over where their data lives. You know, they have release slates that cannot be made public, secretive movies they're working on, they're not going to use a black box on the cloud for any kind of work. It just doesn't make any security sense. So having an open-weight model will enable them to bring in this open AI model within a controlled environment, within the four walls of the data center at wherever, run it locally, do the inference locally, and have full control over it.

38:30Let's say you're a small company and you want to, like a DeepSeq. deep seek people download that they don't have to pay deep seek is free for the model so like is open ai going to do the same thing or are you like are they gonna have to i don't know you have to pay to license it yeah so i'm just following what stability ai is doing with stable diffusion there is two sets of licenses and this is the same with like unreal engine you have a consumer license for the average amateur user that's free practically free and then if you're going to use it to make a commercially viable, you know, output like a movie or a TV show, then you're going to have to pay the company.

39:05So my guess is OpenAI will roll out. They'll still have a free version of this open weight model. That's probably some amount limited or the last generation of it. And then if you want the latest and greatest, you're going to have to pay some kind of license fee to get the open weights and maintain them at your own site. Right. And do you think this is going to be the money play in the future of like, maybe it's not by charging the API access to the black box of the models that they host, but building out custom solutions or building or like support or like something similar to like how Linux is a free operating system, but they still make a lot of money by, you know, offering the support and packages and custom solutions.

39:44Yeah, Joey, I got to say, I'm not sure how AI revenue will sort of grow and evolve over the next couple of years. It's not as linear as we all thought it was, which is that you spend$10 billion on making this model. You host the model. People log into the model. They get what they need and they pay you, which is kind of what ChatGPT is, but it's clearly not where the money is. The money is not selling$20,$200 a month subscriptions. The money is selling a$1 million a year subscription to a big B2B company. And those guys, they don't want to run a black box on the cloud, right? So yeah, I agree.

40:22I think something like Red Hat, where Linux is free, Red Hat Linux is free, you can download it. But then good luck building your own application on it without Red Hat support. Something breaks. Who do you call? Who do you call all the training that you need to build a Linux application? And that's where Red Hat makes their money. I think technically they're a nonprofit company, if I'm not mistaken. I would imagine OpenAI goes that route where, first of all, it's an arms race. Like the LLM model that's amazing today is completely outshadowed in six months. So you can't just spend$10 billion and sit on it.

40:57You have to get ready to spend the next$15 billion to get the next bigger model done. And while you're doing that, you have to figure out how you recoup the cost for the$10 billion you just spent. So it's an extremely aggressive business with lots of costs, lots of expenditure and unclear revenue. That is the part that worries me a little bit. I think the AI bubble will burst a little bit. Having said that, what AI promises and how it's transformational is absolutely true. I'm just not sure that we thought, you know, as linear as a business model could be, it is going to be that in the future.

41:31I mean, I'm thinking too, like, is it also more, you know, is it the million dollar a year subscriptions? Is it the someone building an actual solution that makes it more user friendly to like the wider user base? Like there's a lot of kind of criticism where it's like, well, your product's just a chat GPT wrapper. It's a chat GPT wrapper. It's like, well, that could be very useful. Yeah. Because a lot of people are not going to want to have to figure out how to like prompt hack or, you know, like even going back to our editing examples of like going back and forth between multiple tools. Right.

41:59Want their one tool to work and use it. And like on a consumer level, it's ignoring the, you know, enterprise needs where it's like they want private data and private training and serving. Yeah. I think the sort of uncharted territory and where a lot of money is to be made and still hasn't been made is applications. I think there are no killer applications with LLMs yet. You know, of course you have a chat GPT app, but it's really a direct access to the cloud based black box. And that's why everything Adobe is doing with Premiere, to me, it's so promising because this is an application that's widely used.

42:33If you drop a couple of new features into it, it immediately gets utilization and you get feedback and data on it. You can improve those features over time. You need more application layer stuff in this AI ecosystem. One of the examples early on, you know, remember when MidJourney was on Discord? Yeah, yeah, yeah. And you wanted to generate an image. This is like early days, just a couple of days. Yeah, early. Middle last year. Back in the day. And instead of that, Leonardo, which is a competitor to MidJourney, had an iOS app. So you can do everything MidJourney could do. But from your phone, it had all the controls.

43:09So which one would you use? Leonardo, right? I used MidJourney. Well, for me, it's all about convenience. I figured out how to use Discord so I could use MidJourney. Yeah. And then you're waiting for your picture to come back. But you had to do it on public channels. So as you're waiting for your image, every other image is just like popping up, popping up, popping up. Okay. But again, I think the application layer hasn't been cracked. And so these models like, you know, ChatGPT or Runway Gen 4, the models themselves are not the moneymaker. It's everything around it that'll make money. Yeah. And how to make it more useful.

43:45I mean, I think also the other thing to crack is like the killer app or the useful app is when it could get into, you know, the data that we use every day. And I think the two companies that are most poised for that, but have not really been doing the best at it is Google with Gemini, which has sort of been integrated in Google Docs. But then I ask it, I'm like, you know, do this thing with this doc. It's like, I can't access that info. And it's like, what are you doing in my Google Docs if you can't like do all this stuff yet? And then Apple, which, you know, I mean, it's on our phone and it could easily, you know, handle calendar and contacts and all of our, you know, a personal assistant, like a true personal assistant.

44:17And, you know, they've been delaying their AI launch and stuff. And I'm sure for like, there are billions of users. So it's like when they launch something that's got to work, I understand that partly. Yeah, Marques Brownlee has an Apple AI video out now that kind of paints them in a negative light. And kind of rightfully so, you know, it's like big tech company reaches full maturity, is at the cusp of big technical breakthrough, can no longer keep up. That's happened to Kodak. That's happened to IBM. That's happened to practically everybody. So the question is, is Apple there right now? I still have a lot of faith in Apple.

44:53But yeah, I mean, I think the biggest fumble was announcing this. It was a big push for this last year. And then coming out this year and being like, sorry, not ready. We're going to wait another year. Yeah. No, I think Apple intelligence is half rolled out on iPhones now. I have it turned on. I mean, it's not useful. I'm not getting anything like mind blowing out of it. It does summarize emails and stuff. You're not using Apple Memoji, AI Memojis. Yeah, it does a weird like text summary and email summary, which nobody asked for. Yeah, they're not useful. Yeah. Yeah, okay. All right, let's wrap it up there.

45:25All right, sounds good. Links and everything we talked about, genoisepodcast.com. If you're at NAB next week, give a shout out to Joey or just leave us a comment. And if you want to connect in real life, let us know. Yep. All right, catch the next episode.

From the publisher

Blackmagic leaks a 12K PYXIS camera just before NAB as the industry prepares for a major trade show. In this episode, hosts Addy Ghani and Joey Daoud dive into pre-NAB announcements, examining Strada's peer-to-peer media sharing tool, Adobe's new AI features, and how Gaussian splats are quietly becoming the next significant technology evolution. Plus, they unpack OpenAI's strategic move into open weights and what it means for enterprise AI adoption.

#############

The views and opinions expressed in this podcast are the personal views of the hosts and do not necessarily reflect the views or positions of their respective employers or organizations. This show is independently produced by VP Land without the use of any outside company resources, confidential information, or affiliations.

More from Denoised

All 101 episodes
NAB Preview: PYXIS 12K, Strada Agents, Gaussian Splats and MoreDenoised · 46 min
Listen in VO