Apple’s WWDC: Liquid Glass But Where’s the AI?

0:00In this episode of The Noise, the quick recap of WWDC. 4D Gaussian splats are finally here. And a couple interesting AI papers, including storing AI memory in MP4 files. Let's get into it.

0:15What's up, Addy? Good to see you. Good to see you, man. How was your vacation? Good. Yeah, I went to Palm Springs. It was very hot, but it was nice. Nice place. We stayed up and just able to chill. I love summers here in LA. Deep-impressed. Yeah, it was getting spicy. It's going to get even spicier there. but it's also crazy because you drive like two hours and a temperature change of like 25 degrees microclimates in LA it's a thing yeah but no that was a lot of fun and bomb string is great just cool the mid-century modern classic cars it's like it's like a town that's just a time capsule yeah it's got that fun 50s vibe still all right so the WWDC keynote was this morning yeah I checked it out all right interesting nothing crazy nothing because uh last year a year ago was when they teased or announced the Blackmagic Ursa Cine Immersive.

1:03It was like, oh, we're gonna have a dedicated camera for shooting immersive videos. Nothing in the film world that crazy. Nothing overall that was really that crazy. The biggest thing was their new UI update across the board. They're redoing the entire look with, and they're calling it liquid glass. And so it is a very much more transparent, glassy looking effect that's going across the board. I feel a bit about it you're way nicer to apple than i am gonna be for the next few minutes all right what oh boy did they miss the mark on ai i would just love well ai separate i'm talking about this new we can go on the ai later i'm talking about specifically liquid glass and their new look design i mean i'm like i'm like bring back skeuomorphism bring back yeah the physical notepad it's it's it's pretty dope i like it and from all like ios needs a facelift and as newer devices can support better GPU, better rendering, better graphics.

2:00Yeah. This is something that could fill up that space. But Apple just dropped a liquid glass video on YouTube right after the conference. The first thought that went through my mind was, why don't you use extra GPU to run an AI process in the background instead of doing fancy graphics? That really doesn't move the needle. Yeah. When they played a promo for their upcoming Apple TV shows, it had this new liquid glass typeface. Yeah. It's hard to see. It was hard to see the text. And I remember there's some comments online too, of just like, oh, you know, rest in peace accessibility, which to Apple's credit, they're usually really, really good with accessibility.

2:36So I'm sure there's a lot of options to turn this off or make it more legible. But for the general branding, marketing, it was like a little squinting to read the titles of the shows they were advertising with this translucent glass looking font. I gotta say like from a creative design perspective, it's pretty novel i think it's pretty neat that the like this is all coming together timing couldn't be worse right like just look at it optically comparing it to like google io yeah exactly or microsoft bill mountains of of new updates and innovative uh releases and yeah apple the big i mean right we're talking about the first biggest thing was they're making it glassy uh they did talk about apple intelligence and what did he say he said something uh to the effect of it.

3:19Apple Intelligence with Siri coming later in the year, it took more work than we thought it would to reach our high quality bar. I mean, sure, I could see that. You know, Apple strategy is maybe this, and I'm just speculating with you here. It's like, look, the iPhone as a platform in everybody's pocket, billions of them around the world, that's not going anywhere anytime soon. So even if we don't innovate on AI, other people are going to put their stuff out on ios on ipads on iphones on watches anyway yeah and they are opening up more control to features and stuff on the iphone i'm so i mean they'd have an ai update um so it's the foundation models framework so i think it is their version their model it could run locally on the phone right and they're opening it up where apps can developers can access it yeah it doesn't really do much i mean it's stuff that we've sort of seen already of like uh some writing suggestions the Genmoji stuff.

4:12It doesn't do a ton. You can open up Apple Intelligence and give it access to ChatGPT and they have a partnership with OpenAI. So you have to go into the settings and turn it on. It's not like on by default. You can give it access to ChatGPT and then that gives you access to all of the better benefits of ChatGPT. Fair enough. I think the issue here is if you are one step behind today, you're 10 steps behind tomorrow, right? So an example is, okay, fine, You don't innovate on AI. You've got this incredible hardware platform. Everybody uses iPhones. Nobody can even think of you doing anything other than, you know, a lot of people that are not upgrading their phone this year.

4:48They're going to upgrade next year. They're going to keep buying Apple products, you and me included. So what happens when a disruptive new piece of hardware that relies heavily on AI comes out, whether it's an updated AR glass from meta or the Johnny I've open AI collab, whatever they're working on. Or it could be some startup out of nowhere then that gets acquired by google and now google's making this killer hardware right so like you're opening yourself up to major disruption if you're not innovating yeah a bit i mean but we've talked about this before like apple has also never really been first they you know see what's coming out and then they just usually do it better in this case yeah that did not that was not the case yeah yeah i mean i still think i mean look they won the higher end smartphone.

5:33And it's the aspirational product. I like people in less developed countries who have Androids want an iPhone, right? That's the one to move up to. To your point where, you know, they could get disrupted and where this other battle is, is in other wearable devices, like categories that aren't really developed or that they don't own yet. Like glasses is probably the next big one. And also they have significant investment in silicon now, right? Like the M3, M4 chips are so good. It's so above and beyond what you need for day-to-day use for your laptop. Yeah. Like even if a new AI application lands on this Apple Silicon, they're still good for a while.

6:09So they don't have to custom invent AI hardware anytime soon. You're not looking at like Apple deploying NVIDIA like departments within Apple to just build AI specific libraries and hardware. I don't think that's happening anytime soon. Yeah, you're right. I mean, they are building their own model and that can run on the device, but yeah, nothing like to the extent of NVIDIA. Yeah, I will say like building your own model is very vague in that sense. Like students, PhD students at universities are building their own models. So it's not really saying much. Right. I mean, I'm curious what more, I mean, also this is the keynote.

6:40It's, you know, more for general audience, I'm sure. Cause they have hundreds of talks this week because it's the developer conference. There's probably more details about what that foundation models framework is. So I'm curious, we'll try to dig in more in the future of like, if they have talks that come out online. Because I remember too, when they announced the Apple Vision Pro and the spatial video, it was sort of glossed, you know, it was like a special video, but then they had more dedicated talks of like the MV HEVC file codec and stuff that they came out later in the week. And it was like, okay, we're able to get more details about things when, you know, we want to tech out and learn more about what does that actually mean?

7:10Yeah, I think Apple maybe should, first of all, just a major disappointment in my personal opinion, that one of the most valuable companies on the planet, if not the most valuable, has nothing to really show in the most exciting technology in our lifetime. Yeah. I mean, they did dig themselves in hot water, you know, because that's like last year, they had all these big, you know, announcements and it was like, oh, this is what you expected, where it's like, you can talk, Siri will be smarter. You can talk to Siri, you know, it can communicate and do things on your phone and like a much more natural language, built an event and all of that.

7:43And then they hyped it up with the Apple intelligence, Apple intelligence built into the iPhone 16 and then with the ad and then it didn't deliver. That's why I bought the iPhone 16. Yeah. Are you part of the class action lawsuit or whatever? There is a class action lawsuit because it's like, you know, oh, you sold all these things and like nothing really delivered. The Apple fanboy in me doesn't want to sue Apple. And as much as I hate to criticize them, like I just want them to do better. Yeah. I mean, there was a Bloomberg article from like a month ago that was dug into like why they had so many issues.

8:13And it was basically like, well, the part of Siri that like does the logical things, you know, it's very like calculator, you know, set a timer, if then kind of stuff. And the chat GPT kind of part, I'm losing my words, but of the like the natural language, natural response. But that's still a large language model, you know, which is still predictive at its core. The two would not. It was way more complicated to connect and sync the two. That totally makes sense. Then they anticipated. Siri's like, hey, make me a calendar for 12 p.m. tomorrow. that stuff was done like 10 15 years ago yeah and that's like a very definitive like yeah you know there's no like oh well probability of 12 30 or 12 50 it's like yeah you got to set the clock for this accurate time or this event and getting that to communicate with merging it with an llm and making it perform the way you expect it to was where they got stuck i'd imagine that's not that hard but again i'm not i mean the only thing i'll give them is they're deploying this at the biggest scale right at billing on billions of phones yeah you roll this out it goes out to billions of people yeah okay well if roblox can do it at that scale and fortnite can do it at that scale then surely apple can too so uh that unless you general updates if you like you know try to give you the highlights if you didn't watch it they're changing all their version numbers unifying everything because there's like an ios phone version and an ipad version now it's just going to go by the year number so the next ios is ios 26 uh for the mac it's going to be mac os tahoe picking, you know, another California location they have not used yet.

9:39There was a big AI update. Oh, yeah. New Genmoji updates. You can now merge two emojis into a brand new single Genmoji. All right. So should we make an Addy and Joey emoji for the podcast? They're updating the camera app. Honestly, I think it's going to make it more confusing. They're like streamlining because right now if you go to the camera app, you have the little slider thing for the different modes and they're streamlining it into just like camera uh photos and video and but if you swipe you can still access the other options it's a lot more swiping a lot more hidden features i think it's going to confuse people and it doesn't really add like there wasn't any new like you know like we know we have quick time and raw like there wasn't there wasn't anything new to that um i guess usually they do roll that out when they announce hardware updates instead of the software but nothing yeah in the actual performance they i gotta say this This is the iPhone 16 that I got thinking and had Apple intelligence.

10:32They put two new buttons on it. So they have this button here that supposedly will take them. And then they have an action button, which is from the 14 or 15. Yeah. Yeah. I have the action button. You really don't need that. I use the action button for, to pull up, um, black magic camera app. Okay. Yeah. And actually I just recently, actually I recently redid it to load up perplexity because perplexity is voice mode can also control things on the iPhone. So that's what you're doing. See, you're invoking other AI solutions on iPhone. Oh, yeah, because it's way better. Yeah, it's way better than Siri.

11:03So Apple is counting on that. As long as you keep doing that, they're going to move new phones. Right, and that's probably why they're like, oh, well, we'll just let the apps have more access to core features. Exactly. Which, you know, they didn't. Does that also mean that at some point they're going to have to bring down the privacy wall for these apps? I think, or with your permission. I mean, similar with ChatGPT, where you have to opt into that and know what you're getting into a little bit. But if you use their foundation models, they keep pushing, hyping up that, you know, that's private.

11:31It can stay on device. It can run locally. It can run, you know, without a connection. So they are on the models they're training. It seems like pushing, you know, for the privacy stuff that they've capitalized on of owning that word privacy. Yeah. You know, in our industry and our friend circle, we have quite a few like hardcore Apple fanboys. And I don't know. Still an Apple fanboy. Yeah. I mean, I am too, but I don't know how they're going to really compare as apples to apples with Google and Microsoft and open AI. I mean, this is this is nuts, Joey. Like they are so they are not seeing the forest from the tree.

12:07I don't know. I kind of disagree ish because it's like they never really were that kind of company. Like they're not a enterprise cloud company. They're not a like Apple is not selling APIs. They're not selling models and cloud services. so that's that's not really their thing like yeah google's you know developed a lot more ai products but that's also more you know google cloud and and everything around they have more enterprise use cases yeah and that's more of their market like there's no cloud apple cloud service for i'll just caveat it with this is like the killer use cases haven't even been thought of yet at a consumer level so it's up to a company like apple to give it to us right they innovate they say this is the way to do FaceTime.

12:52This is the way to text message now. And we as a consumer either love it or hate it. Right. So none of that experimentation is even going on. So we're not even at like the level one of rolling out, do these tools work yet or not? I will say also like Apple still even, I feel late to just cloud workflows in general. Like they have a lot of good products. I don't use a lot of them because they're locally based. They're hard to collaborate it on especially if the person doesn't have a mac like i like their freeform app which is like sort of their whiteboard brainstorming app but it saves local files it could i could share an image of it but i can't really like add collaborators to it you know pages is cool but and they sort of have a web version of pages but it's a lot of there's just you know a lot of it's just still very um notes is really powerful notes is very syncable yeah some other let me see quality of life things that i'm excited about as a like phone screener uh habitual phone screener person is a call screening so if it's a no number it'll like it's sort of like what google voice does what'll be like what are you calling about and then it'll like kind of oh it picks up for you it'll pick up and sort of be like you know how can i help you and then like it'll pop up with a notification of like what they say so you can kind of you know i love that proof yeah just something that's i've always wondered it's like if i don't have your number saved like can you just send this number to voicemail automatically yeah because they're using a bot against you use a bot on their bot yeah and also speaking of bots they have hold assist now or two which is uh if you're on hold you can i guess put your hold assist on and so the call will stay active but your phone will hang up and then when the person comes back on it'll bring you back love that which is also great so it's like yeah okay now it's gonna be each side is a fighting with a callback agent or maybe apple thinks i'm going on a tinfoil hat conspiracy theory here forgive me people maybe apple thinks that this ai thing will just blow over well actually did you see the uh did you see that apple did release and a paper an ai paper no they released a paper um that was sort of criticizing all of the other reasoning models saying that they're not actually reasoning if you give them like a challenge that's too hard then they just give up yeah and so that was apple's latest innovation was a paper from them saying the other models kind of suck and uh they're like wait till we drop our llm guys check this out okay some actual interesting ish stuff so and integration.

15:13So macOS Tahoe, the new two of the things that stood out that I thought were interesting. I'm a big keyboard shortcut kind of person. I switched out Spotlight. I use Alfred, which is sort of like an app launcher. And you can also do some other kind of shortcut things with it. They are revamping Spotlight to be able to access files, be able to access your clipboard history, which also uses another tool for basically make it a lot more functional to like pull up and do shortcuts. And you can connect it to shortcuts, which is a separate app that you can build out shortcuts i don't use it it always ios it's pretty handy ios it's handy and then they have one for the mac as well okay and you'll be able to call up shortcuts and you can load ai features in the shortcuts like this document i'm on it can like look at the document and then suggest rewrites or summaries so it's some integration with ai shortcuts that you can run on your app i feel like also the way i described it it is probably way too complicated to set this up for like normal people.

16:09I don't use shortcuts because sometimes I never found like a killer use case for them. And it always still seemed a little bit kind of a pain to set up and deal with. I don't know if that'll be kind of the cool thing. But yeah, it goes to your point of that they are opening up the ecosystem where things can communicate more and access things more than before. Yeah, it's basically like, hey, open AI, take over my computer or something, you know, along those lines, because it's like either the run local, their version, which is not that good, or so you can pull it up with ChatGPT. But also ChatGPT has a pretty good desktop app already that they built that has its own pop-up command bar thing.

16:44And you can like, you know, have a look at your screen and do stuff. Yeah, you know, Sam Altman was on an interview and he said something really interesting. He said, the way millennials versus Gen Z use our products is completely different. So you and I, millennials, the way we use it is it's essentially a replacement in most cases for Google search. Yeah. Right? Sometimes, you know, I'm like, okay, I don't think Google search can handle this question. Give me the coffee shop with the most gourmet coffee with local, you know, it's like a very specific thing. You go to ChatGPT for that, and maybe that natural language will just do a better job.

17:22The way Gen Z uses ChatGPT, supposedly, according to Sam Altman, is it's a life advisor. So it's like when you're making major life decisions, like, should I date this guy? or should I go to this college? You know, it's like that level of life advising. So if you think about it, that generation and the generation after is going to grow up with that level of interactivity and commitment to AI. And they're going to want their device to have that level of commitment as well. Yeah, I can see that. I mean, the AI chatbots or the personas, like the character-driven chatbots. Yeah, and AI has to be more responsive.

18:01So like local inference, plus maybe it's a hybrid cloud, local inference that has to happen on device. And then it has to be multimodal, taking video, audio, depth data, be aware of surroundings, be aware of your location geographically, and take all those things into account and just be better with advising on life. yeah and the multimodal that did remind me there was another feature too where you can like screenshot or tap on things on your phone or you're seeing on the web or on your phone and run searches with it across different apps yeah not as sort of like built in google image search which we've had for years did they mention tim sweeney yeah i was you know i was wondering because they were talking about games and arcade and stuff and i was like like it'd be really fun are they gonna put up his face on that wall behind them yeah like if fortnight's a demo app that'd be like um really crazy no for now it was not a demo app yeah it would have been funny too if they were like we're offering you now the option to bring in uh your own payment system oh they did say that no oh okay no they're like well they were forced they're bleeding billions of dollars yeah all right and then vision os there were a handful of updates there and it's cool and the tech is really impressive but you need a big giant headset to take advantage of it oh yeah Yeah, Vision OS, that's the Apple Vision operating system.

19:16And so they have widgets rolling out. And the widgets are cool because you can kind of put them in your physical space. And then they just stay there. So like when you put your headset back on or after you reboot it, it'll like if you put... Oh, it registers something on your bookshelf. Yeah, you're like, oh, I want to put a calendar here. I want to put like the photo app here widget. Oh, that's cool. And then, you know, it just stays there. Yeah. And so you put the headset on or you take it off, you move around. But when you come back to the room, because it knows the room you're in based on how it mapped it out, it just locks it there.

19:43I love that. Yeah, it's wild. Yeah. It's cool. But yeah, it only works with a headset. I mean, that is spatial computing, right? New concepts on how we organize data. I think it's very forward thinking. And I think it's definitely the way that things will go once the physicality of the device, whichever company comes first, can figure out how to have that type of precise locking on the location and mapping with the augmented reality. And to be able to store light art. With something that looks like glasses. Yeah. Yeah. Something that's much easier to wear. And then more, there were a couple updates for Apple immersive videos.

20:16Adobe's coming out with its own app or version of Premiere that can deal with immersive video. And then they also have partnerships with GoPro Insta360 and Canon to do native video playback of 180 or 360 video. Yeah. Those things have been cooking for a while. Yeah. And then the other thing was the personas, which was the way that it would scan you to create your photorealistic looking avatar. so like if you were doing a facetime call and you're wearing the vision pro but i'm on my phone it was the little like virtual version of you that would show up it was very uncanny valley like weird ish looking they did a new they have meta did that a while ago remember oh with like a year or two ago with the like cartoon looking uh no no no it was it was photoreal yeah yeah oh that yeah so there's looks they did an improvement to it and like in the comparison they showed in the demo the quality was like way way way way better like very lifelike looking which i'm very i'm curious how they're pulling that off and how much it reacts to like facial movement there's probably an artist in india somewhere that's painting the face just like they're just looking at your entire photo library and like reconstructing their face they're using chat gpt you're like what does joey look like create a 360 panoramic based on this image and then ipad is just more and more continuing to be like a laptop.

21:35So they're adding windowing. So you can stack, you can resize windows, you can stack windows, basically how you can do on a laptop. But now you can do it on an iPad. A couple of interesting things that actually tie into sort of the podcasting space and kind of go straight at what apps like Riverside do for more audio and video input controls on the iPad. So if you plug in a microphone, you can have more control of being like, yes, use this input microphone for recording. But also, I think I don't know if it was a separate app or if you're doing a FaceTime call, but now they have local capture.

22:06So if you're FaceTime recording, interviewing with someone, it will record a local copy of your video and your screen on the iPad and put in your files app, which is exactly what Riverside does and why I would use that all the time for remote recording because it saves the local files for everyone. Yeah. And that's like the big selling point where it's like you're not dependent not good news for yeah i mean ish but i just said it was ipad which i'm so probably like well why wouldn't it also be like on a on a macbook yeah and then again you know this only works if you're on an apple device yeah apple has the same problem that porsche does when it comes to uh product segmentation so porsche has the 911 which is the flagship car and then they have the 918 which is called the boxster or the cayman in some cases that that car is could be as expensive and as fast as the 911 it gets really close so apple has the macbook and then if you go down to like the macbook air and then the ipad pro i mean you're looking at same price points and things that are more or less the same yeah just running different os and what porsche did was they just canceled the 918 they're like we're just gonna sell the more expensive thing from now on yeah i don't see them killing the ipad pro yeah yeah i mean because if you if you deck out an ipad pro with their keyboard case that's what like 1200 bucks yeah possibly more if you get the white if you get the cellular version with like and you max out the internal storage and a macbook air is like a thousand bucks you could get for a thousand yeah so you're you're i mean that's yeah yeah but probably if you are someone who has an ipad pro you probably also have a macbook pro yeah i think you're in the i think it's more like probably the what ecosystem are you in are you in the pro high budget ecosystem are you in the consumer se's and the and the basic lines and yeah the air and the i and the ipad air sure like if you want to spend more money go for it yeah we have all the stuff yeah i mean like i've looked at the ipad pro but i'm like well you know this does i have an ipad air like the base model because it's like well you know that's cool for reading and pulling up some stuff like on the airplane but i don't you know i'm like oh do i need to dish out for the ipad yeah the ipad pro is perfect for not you and me yeah i think it's for like a graphic designer or like a ux ui developer yeah if i was a big stylus user yeah i could see the advantages i feel like the debate would be more like you get an ipad pro do you get like a a tablet yeah yeah so yeah that's mostly the roundup nice we spent a long time oh we did yeah i mean uh yeah i kind of wanted to give a recap of if you didn't watch it but nothing mind-blowing there you have it folks gradual updates and all that stuff rolls out later in this year nothing is out right now that's what they said about apple intelligence all this stuff is supposed to roll out later this year there you go i am sure that nothing is rolled out now i'm positive about that yeah but it should roll out later this year the the liquid glass thing is pretty neat i'll give them that okay we'll see how that goes i'm curious i'm curious just about like how legible it becomes you're gonna see liquid glass rip off everywhere across automotive across hospitals liquid glass yeah i don't even talk about apple carplay but But they're like, liquid glasses come in Apple CarPlay too.

25:05Like you're going to see like Tesla UI mimic that. And you know, like it just, Apple has such a ripple effect when it comes to design. Yeah, that is very, that is very true. Yeah, now everything's going to be translucent glass. Translucent. For the next 10 years of your life. Yeah, because yeah, they're like the last redesign was 10 years ago with like iOS 7 or whatever it was or 9. Okay, next story. Yeah, so look, Gaussian Splats have been around for a couple of years. It's basically AI powered photogrammetry. It's somewhere in the middle between machine vision, traditional photogrammetry and AI inference.

25:40Like if you combine all these three things together, what Gaussian splats are like is it's literally a splat of paint, a splat of color as a point cloud. And then that point cloud, if you have enough color splats, starts to represent a 3D object. Like the splat holds data. The splat holes, it's a point in space with color information and it has a Gaussian fall off. So it's like not like a splotch of color, but just like a nice smooth gradient of color. And that's key because it supports obviously alpha channel and then you can start to mix and match point clouds very close together. The neat thing is Gaussian splats were really good at being 3D without 3D, if that makes sense.

26:25So you don't need a traditional 3D renderer or game engine or anything like that. You can just on the fly do what's called novel view synthesis. So anywhere you place the camera, if it has enough data, it'll figure out what it should look like from that point of view. And usually the gauze and slats we've been seeing are capturing an environment. A static environment. A static environment from like a photo instead of a photo, a 3D space. Computationally very expensive, just like photogrammetry. so it was limited to static stuff and we knew that sooner or later 4d four dimension the last dimension being time is going to come out and here we are today there's a bunch of announcements to cover on the 4dgs front yes so the big uh announcement came from a chinese university who dropped a paper called free time gs free gaussian primitives at any time anywhere for dynamic scene reconstruction we'll link the paper on the video here look basically it takes into account that you have the past and present frames or point clouds in a given capture and so it goes back and forth in time to more finesse the point cloud solve okay which is kind of the same technique that a lot of video compression uses like if it's not real time when you're compressing mp4 it'll go backwards it'll go forwards and then it'll come back to the middle frame and figure out what the best frame at that moment is that saves the most amount of data so i you know i'm just sort of layman terming it here because i don't understand the mathematics behind it i'm not a gaussian splat expert but again in the paper it says that it can go basically uh back forth anytime anywhere which means it can reference gaussian splats from the past in another space because as you're moving right basically like building out a video timeline that we're used to point cloud video timeline yeah and then optimizing the heck out of it to make it as efficient as possible and as high quality as possible yeah i mean yeah obviously cool applications of this one would be you know if you have the video and you want to reframe and move your camera around in a 3d space and reframe your shot yeah with the video happening yeah a cool use case other case uh loading this on and they have demos of loading it on an apple vision pro or a headset so like you can physically move the video is playing you're in the scene as it's happening and you can move around and see what's happening yeah i mean the big promise for gauzy and splats and uh you know from my virtual production days even in vfx is like you don't have to build complex real world things if you can just go capture it well enough right so you know let's say you're setting your movie in downtown LA and you have 10, 15 different cameras capturing once at one street and the cars are going by, people are walking, the weather is changing and the daylight is changing.

29:20You capture all that in time. Now you don't have to build that exact digital twin of that city with metahumans and, or digital humans or whatever. Like that's just way too complex. You can just use 40 GS and composite on top of that, put that in the background layer in Nuke or whatever, and then just do your thing and save tons of money, tons of time. Yeah. Yeah, for sure. Once the quality gets there. But yeah, this is a good step in the right direction. Yeah. One thing to clear up though, because I think I did see this going around a lot or I saw the clip of the demos going around a lot and it seemed like some of the misinterpretation of it was that you could do this from like a 2D video and extract the 3D information right that that that is not accurate yeah that is so yeah it's very much a traditional volumetric setup yes and so there was a one of the videos was a guy talking to camera a nice interview set up and yeah it turned uh he's a tech youtuber a chinese tech youtuber and so this video is from like a month ago and then you could see the behind the scenes shots in the video and it's a array of 20 or so cameras and in the paper it says you need about 20 cameras in order to capture this to have enough data the technology's in its infancy i think what they're really after is what happens after you capture the data.

30:32Yes, how you can process this. How you solve it, process it. Yeah, so as that gets better, I think there will be a less need for more cameras and in specific locations. Also right now too, from what you saw on the paper, you still would have to process this in order to play it back like this. You can't, even if you had the 20 cameras, you can't in a sporting event have a real time move around the space. You have to capture it, process it, and then you get this 4D Gaussian splat that you can move around. Yeah, I gotta say the live broadcast of volumetric data has been done at small scale. So companies like Intel and Verizon have worked on it five, 10 years ago.

31:11The problem was you're dealing with terabytes of data. From all the broadcast cameras. Yeah, there's so much content. So you need a data center to process all that stuff and then you need a big fat pipe in the network to ship it. Right. And that's something where it's like, you need this to happen in 30 seconds, a minute for your instant replay. Because once it keeps going, the game keeps going. It's like, well, whatever. Who cares? Exactly. You can maybe build that out for every NFL stadium or whatever, but it's not going to go down to like a consumer level. Right. Like our phones can't run real time volumetric stuff just yet.

31:46So that's why this is so key is Gaussian Splat technology is not traditional volumetric solve. solve. It's something entirely different and something that is efficient enough, I think, to come down to a level where consumer devices are able to run it at some point in the near future. Right. Run it, not create it. Receive it. Yeah. Right. Yeah. And even like in a headset, that makes a lot of sense. Yeah. I think a lot of this still, because it's AI, still depends on NVIDIA architecture, like CUDA and RTX cards and stuff like that. So we're going to see it on desktops before it gets down to our phone.

32:23Yeah. Or yeah, I'm curious how they would run it on a headset or if it's running through like some cloud-based version or option to... Yeah. And then just pixel streams down to our headset. Yeah. I'm going to check out Augmented World Expo tomorrow. Nice. So I'll see if there's anything in the 4D video space that happened in there. I went last year. It wasn't as much as I thought. Where is it at? Long Beach. Okay. Yeah. Long Beach Convention Center? Yeah. It's a nice location. Oh yeah. Go to Aquarium of the Pacific across the street. Oh yeah. That's cool. I've never... I've wanted to go there.

32:51Yeah. And then last kind of couple interesting papers. One was Memvid, video-based AI memory. This is so brilliant. This is such outside the box thinking. And I think this is the type of stuff that Apple should be getting into instead of liquid glass. Look, you have video, which is really an efficient form of storing images, right? Like if you think about the number of frames that you squeeze into an mp4 file 24 frames a second times you know 60 seconds times you know 60 minutes you're talking about thousands and thousands of frames what if in one of those frames you could throw text on there and that text could be readable by a machine so instead of storing text with ascii with binary data you just pack as much text as you want with video and it's It's a far lightweight, far more efficient way to store text.

33:45Yeah, that's weird. Isn't that wild? Yeah. So, yeah, I mean, the idea of this is from their website. Unlike traditional vector databases that consume massive amounts of RAM and storage, Memvid compresses your knowledge base into compact video files while maintaining instant access to any piece of information. Right. What are your thoughts on this? I mean, I'm trying to understand, you know, how the benefit of storing it as an MP4 file, like what the file structure looks like, where you're able to fit more text and make it more accessible in an mp4 file versus a database like not i don't know enough about like how the file structure is built where that how this makes sense i don't know enough about it either but i will i know enough to be dangerous i like the uh innovation around this yeah uh thinking differently novelty is pretty cool like my mind immediately went to secret military stuff where they have to transmit important text without text so they throw everything into a video file you know it's like north korea gives iran a video file or something why doesn't this file play or it's like an um enemy of the state yeah when he he stores the video on the video game cartridge file and then the kid takes in the kid's like the game's broken it doesn't work and he's like give me that uh it's the opposite of that it's like wait this video's not playing and it's like that's because it's the entire wikipedia yeah the video file my guess is this has to do entirely with how ai leverages vram and uh short-term memory on a system where if you have tokens let's say billions of tokens which could be text right uh you're taking up a ton of ram versus if you're doing this uh supposed video you're not really even loading it and it's just going through the video as needed so it's like creating a pseudo ram with the video if you will that's my guess on why this is far more efficient of course time will tell we're the first ones to break it to you and so you've heard memvid here first yeah if this does make it into training of a model i think that'll be pretty cool yeah or how you could also if you could use this as the memory for how a model could access like if it could access more memory because that's like an issue too of the knowledge window.