In short
Waveform: The MKBHD Podcast - Episode Summary
Episode Title
Move Fast and Break Terms of Service
Episode Description
In this episode, Marques, Andrew, and David discuss the recent leaks regarding the Google Pixel Fold, delve into the ethical implications of using YouTube videos to train AI models, and share their thoughts on newly released Canon cameras. The episode concludes with trivia that invites listener participation.
---
Key Discussions
- Google Pixel Fold Leaks
- Overview: The Pixel Fold leaks reveal details about Google's upcoming device.
- Major Points:
- Confirmation of multiple models: Pixel 9, 9 XL, and the foldable variant.
- Design criticisms: Some hosts believe that the new design lacks cohesion and aesthetic appeal, particularly the camera bump which is described as "ugly" and "messy".
- The discussion humorously revolves around the design's 'bean' aesthetic, referencing a common term used by the panel.
- AI Training Using YouTube Content
- Context: Recent revelations indicate that AI models, including those developed by Apple, may utilize data scraped from YouTube, potentially violating terms of service.
- Key Points:
- The ethics of scraping content and whether it constitutes fair use or theft.
- Apple’s clarification that the model trained using YouTube data isn’t intended for consumer-facing applications.
- The panel discusses the implications of copyright and the responsibilities of companies in acquiring data for AI training.
- New Canon Camera Releases
- Overview: The hosts discuss Canon’s latest offerings, the EOS R5 Mark II and the EOS R1.
- Features of R5 Mark II:
- 8K60 video recording capabilities and improved battery life with a new grip.
- Debate over the necessity and effectiveness of certain features, and whether they might compromise the camera's usability.
- R1 Highlights: A flagship model aimed at sports photography, boasting impressive performance metrics.
- Trivia Segment
- Engagement: Listeners are encouraged to participate in a trivia poll regarding the correct historical context of consumer hardware devices released by Google.
- Questions:
- The first consumer hardware device launched by Google in 2013, which leads to a debate about the accuracy of Google’s own claims in their blog.
---
Key Takeaways
- Design Evolution: The Pixel Fold's design is a significant talking point, indicating a mix of excitement and critique from tech enthusiasts.
- Ethical AI: The discussion emphasizes the importance of ethics in AI development, particularly concerning data privacy and ownership.
- Cameras and Technology: Canon's advancements highlight both the technological progress in camera systems and the ongoing compromise between features and usability.
- Community Engagement: Trivia not only adds a fun element but also fosters community involvement, connecting listeners directly to the content discussed.
---
Links and Resources
- [Vote for trivia answer](https://www.youtube.com/@Waveform/community)
- [Pixel Fold Leaks Article](https://bit.ly/3WdggQs)
- [AI Image Generation Discussion](https://bit.ly/3WvGJtX)
- [Canon R5 Mark II Overview](https://bit.ly/3Sdmajp)
Social Media
- Waveform Podcast: [Twitter](https://twitter.com/WVFRM) | [Threads](https://www.threads.net/@waveformpodcast)
- Marques Brownlee: [Threads](https://www.threads.net/@mkbhd)
- Andrew Manganelli: [Threads](https://www.threads.net/@andrew_manganelli)
- David Imel: [Threads](https://www.threads.net/@davidimel)
---
This summary encapsulates the main themes and discussions from the latest episode of the Waveform Podcast, offering listeners and readers a structured glimpse into the episode's content.
Written by AI. May contain mistakes. Listen to the episode to check what was said.
Transcript
Automatic transcript. May contain errors.0:00Support for this show comes from Strawberry.me. Be honest. Are you happy with your job? Or are you stuck in one you've outgrown? Or never wanted in the first place? Sure, you can probably list the reasons for staying, but are they actually just excuses for not leaving? Let a career coach from strawberry.me help you get unstuck. Discover the benefits of having a dedicated career coach in your corner. Go to strawberry.me slash unstuck to claim a special offer. From Pushkin Industries, I'm Jonathan Goldstein, and Heavyweight is back. The new season is bigger than ever. Bigger hopes. I keep waiting for this moment when he says, Mom, I get it.
0:47I'm sorry. Bigger dreams. Tom Hanks wants to meet with you. This is a real chance. And bigger heartbreaks. I thought it would be my movie moment. And maybe he would even whisper in my ear, I've always been in love with you. Check out new episodes of Heavyweight on Apple Podcasts.
1:12Oh, so did you see they updated No Man's Sky? You should talk about it. The planets are more real. It's called World Planets 1. Eight years after it got released, this is the planets one.
1:28My favorite, like I said, MySpace game just never got released, period. You can play No Man's Sky now.
1:40What is up, people of the internet? Welcome back to another episode of the Waveform Podcast. We're your hosts. I'm Marquez. I'm Andrew. And I'm David. And this week, a bunch, it's a mix of stuff. It is. I would say a mix of stuff. Every week. There is no theme. It's just a mix. But it's all new. We've got AI stuff. We've got new leaks of devices. We've got new cameras. But we also have one headlining major. piece of news. Kind of the elephant in the room. I feel like we like to put the really big thing in the middle of the podcast normally, but this was just too big not to talk about. This might take up most of the show, so we need to start with it immediately.
2:20I mean, I don't want to get too bogged down with it, but it is one of those pieces of news that you kind of can't get to without, I mean, if you don't talk about it, people are like, why aren't you talking about it? So we'll address it. HomePod Mini was updated. And it's midnight now instead of black. oh yeah this is a that's the whole that's the whole thing yeah it's so have you seen the side by sides actually i am not i'm not convinced that it's it's like the the office meme it's the same photo it's like are we sure that they they didn't actually change the color and just change the name i think it's a test all i know is that the materials are now 100 recycled instead of 90 90 percent yeah it was 90 now it's 100 but did the color actually change it didn't look like it to me but i did not look that hard at it apparently this is the most i've spent even thinking about this color right now many only had like black gray space gray and white to start and they started adding colors randomly there's just cool uh and now there's an orange and a blue i'm still a home pod mini stan just so you know the midnight could actually be a different color because we had a conversation about this yeah yeah it might be kind of different because the midnight color itself is one of those ones where it does look super different in different lights and maybe just those photos but like if there's space gray and midnight they're probably almost the exact same thing yeah cool okay yeah we got we got through that that's that's that's huge for us um yeah there's a whole bunch of pixel leaks though we should we should jump in again again there's what year is every year every year the pixel is the most leaked phone of all time i've gotta have some kind of record for this and now we're getting i guess seemingly more confirmation that there are a bunch of pixels and they're pixel nines so there's pixel 9 pixel 9 xl and then like a pixel 9 pro pro and then a fold two pro folds two pro fold pro fold two even though the first fold doesn't have the word pro in the name so there's a pixel fold now there's a pixel fold pixel pro fold two well it's not called two it's just pixel 9 pro fold oh yeah sorry pixel because Because now it's part of the Pixel 9 portfolio.
4:38It's doing the thing I've been asking them to do with the A series for years. Also, I think we need one of those whiteboards that says podcasts since last Pixel leak, and that we just erase every week and put zero again. It just says zero every time. Yeah. What do you think of them? Are you interested in any of the Pixels? well the fold is the big leak that we got this week the like kind of official photos of it we talked i think it was last week we talked a little bit about the different sizes of the nine nine pro nine pro xl but this week is the nine pro fold and it looks terrible i what ellis don't hate it you don't hold you guys are crazy okay don't hate it hold on i have that i have a question then okay last time we talked about this you said you didn't like the visor on the nine leaks you thought it looked bad but you think this looks good no i don't think it looks good okay okay so the the reason that i dislike the visor on the nine leaks is because it feels less of a commitment to the visor the visor before was like all the way to the sides and it would blend in with the side rails.
5:54And so that made it feel very committed and decisive and obviously a pixel. And when you separate it from the rails, it just feels like an island now, and it feels like the precedent is set that this visor thing is not that important to the pixel. And so now this is the least visor-like of all. Yes. I think the other one still has the same vibe of it. It's still very obviously a pixel, and it's just the modernized modernized version of it, which is funny because it's only divisors like two or three years old. It feels cyberized in a way. It's updated. It's like in this new squared off design all around including the camera.
6:31Are you? Yeah. I'm sorry. Oh, sorry. No, now this. Now let's go to the fold. Okay. Someone please explain this camera bump. It's just a it's just an island. I want to hear Alice explain. He's getting ready to yap over there. This is coming for someone who's owned an iPhone since they were 15 years old. So, you know. Take it with a grain of salt. But to me, the Pixel's gone through many iterations, right? We had the original Pixels with no definitive bump. Then we were in the Geordi LaForge Robocop era of Visor Pixels. Then we achieved bump Pixel after that, you know, not going to the edges. Well, Visors have only been since the 6.
7:14I know. I'm fast forwarding through the history here. Give me a sec. Okay. To me, since the visor, they took it off the edges, it became more of a discernible bump. We've gone back and forth. To me, the definitive pixel characteristic as a non-pixel user is the bean. What? The bean? Like inside of the bump? Whatever. If it's a bump, it's a visor. No matter what, that camera is in a bean. and the fact that the nine-fold render leak whatever two beans are you talking about are you talking about the sub bean inside of the mega bean no no no there is no mega bean there is just the bean the bean can exist in a visor, in a bump, in whatever well there was but like what he's saying is the pixel 8 and the pixel 8 pro the bean was longer yeah it did it's always some sort of a cut out in the visor and the visor went from one look to another.
8:15The Pixel 6 did not, though. The Pixel 6 was just glass and glass. Guys, I know this is controversial. Yeah, the Pixel 6 didn't. But I think as fans and appreciators of the Pixel, it's time to recognize the bean. Yeah, but Pixel 6 didn't have a bean. Well, Pixel 6, oh, and that was a good Pixel, too. That was like the start of the visor, and then they added the bean. Yeah, because it went from glass to metal. 8 was the best so far, for sure. I like 6 the best. Eight feels the most refined. Seven definitively is beamed up. Okay, let's all just be in agreement there. So the Pixel 6 was a special edition out there.
8:51So in the fold, they were like, recognize the bean, lean into the bean, this is the bean phone. If for some reason there's an audio listener who doesn't understand what he's saying, inside of the visor from the seven to now, the cutout of the metal of the visor for the glass of the cameras is an oval. Some may describe it as a pill shape. that's what i would say i mean a bean usually has a like a beans come in all shapes and sizes who's to say this isn't a digital bean including pill shaped beans i think most people say pill but i'm down for the bean it's more fun where are we i don't know uh andrew someone you asked so let's talk about this let's talk about well the camera bump for the pixel fold the Pixel 9 Fold the Pixel 9 Pro Fold is a curved rectangle with two ovals slash beans inside of it left aligned with a a rurkle because it's a rectangle though it's not a square well squares are rectangles yeah but a rectangle is not a square you're right let's continue so it has like two lenses in each it looks like although we'll get that back to exactly what it is and then it just has this like right aligned flash and microphone that is just in no man's land yeah there's so much extra space over there for this one my hot take they would have just put the same camera array as the pixel 9 pro and pixel 9 pro xl except the fold is probably slightly more narrow and currently the design of the Pixel 9 Pro and Pixel 9 Pro XL shows the camera bump visor taking up pretty much the entire back of the phone.
10:35And I would bet you that it's like two millimeters more narrow and they're like, oh, we can't fit it. So we just have to vertically stack them. At first, I thought they might have done it for like the, what is spatial video capture? But they're using the telephoto and the wide. And I don't really on top of each other yeah because the whole thing like the whole reason the iphone switched back to having the cameras on top of each other now like directly on top of each other so when you turn it sideways to capture spatial video they're horizontally aligned on the same axes so they can do parallax this you theoretically i guess still could do but usually you do that with a wide camera and the main camera not the telephoto camera and the main camera because now they're horizontally separated.
11:23Yeah. Anyway, it looks bad, I think, is my take. Ellis is trying to hit the buzz button for no, but he can't steal my thunder. Can we go back, Marquez? You said you didn't hate it. Yeah, I don't think it's that bad. I think it's not bad. I think the easy... Look, we get leaks all the time, and I think our strongest reaction to leaks is always on the design because it's not on. We don't know any specs. we don't know any features we just see the design and that's all we can react to and so whatever's different about it versus the old thing we will react strongly negatively because we always do and then two months in we'll be like yeah it looks like every other camera bump remember when the we first got the like triple cameras on the iphone everyone went it looks like a stovetop that's a what are they doing that's the ugliest camera bump ever and then two weeks later we were all like yep that's how it is i think that was at least like and actually i had that reaction to the last iphone where in the triple camera array of what you're talking about was at least like semi-symmetrical.
12:22This one now with the microphone and whatever that extra sensor is, it felt a little more all over the place. This feels just like so not even remotely symmetrical. It's all lined up. It's two rows. But the microphone has, like the microphone dot has just like the same amount of space as the large sensor in it. And there's also just a bunch of, there's a huge metallic it's all the dead space on the right that i don't like yeah it's weird every every camera bump sucks i don't know what to tell you i mean i don't disagree with that it's also gonna rock on a table yes many of them yeah i i just i know that when we first when the pixel fold first got announced it was like but now i think it looks really good the original pixel fold besides the interior well they also changed the dimensions of this new one which i'm interested to hear what you think about because it seems very anti what you liked about the pixel fold yes yes so what indra is talking about is that the it's more of a oneplus open format now it almost looks exactly like that kind of style uh whereas the previous pixel fold was a lot more like the oppo find n which was like a passport style um and i really really liked the short aspect ratio of the original pixel fold yeah um and it seems like that's gone forever because people don't like small phones apparently i'm curious to try yeah i definitely like the the the pics the first pixel fold which i think i said in the video it is the easiest it's the best foldable phone to use open yeah uh sorry it's the best foldable phone to use closed because that aspect ratio of the screen was great and open it suffered a little bit because it was so good clothes that it was like more squat and i had a smaller inside screen so maybe this is them going sacrifice a little bit of the outside usability make the inside usability better which i think makes sense if you're making a folding phone you should make sure the reason you're folding it is still good yeah um just gonna show you that i think that looks better i think i knew that i knew you're gonna bring that up but i think that looks better there are bad camera bumps out there and at least at least that takes up like the whole back of the phone you know only because they put a screen.
14:36A screen. I'd rather a screen than just this. You can have your phone upside down and you can know what time it is. I also. Guys, what is that? The Xiaomi Mi 11 Ultra. Thank you. Yes. One of the largest camera bumps on the back. And there's also like a Pocophone that did that as well. There's text on the back of the camera. We forget the Nokia 9 PureView that had the spider arachnid array. The nine cameras. I also want to say I recognize that what we are complaining about is extremely minuscule. I know. It's stupid to complain about. But that's what we do here. Yeah. That's what the leaks are.
15:10The leaks are basically, here's what the new design's probably going to look like. There are some leaks pointing to a large camera overhaul in general, which I'm curious about, because that could mean new sensors, it could mean new software, it could mean new capabilities. But again, we don't know if that's true. We're all hoping that Tensor gets better. We're all hoping that there's more RAM and a brighter screen and faster refresh rates and all that fun stuff. and that's possibly also in the pipeline but we don't get that from these leaks we just get to see the look of it was it true that the pixel the original pixel fold was one tensor behind the right i think it was it was tensor two pixel eight yeah yeah it was like tensor one or was it tensor two or it was yeah it was tensor two and the pixel a got tensor three yeah so it's nice that if they all come out at the same time hopefully they'll all be on tensor four that would Even though apparently it's not switching to TSMC until Tensor 5.
16:08So it's very possible that these also suck. One cool thing, though, we do see from this is on the inside, we now have just a top right-hand corner hole punch cutout for the camera versus that, like, would you even call that a notch? It was like a corner hole cutout for the camera that took up a lot of real estate. So this is more screen real estate on the inside. I like corner cameras. I'm fine with them. yeah i don't use the inside camera in most foldables most of the time which i think was why people would argue that samsung's underscreen one is not a terrible idea because it's a horrible camera but it's like you almost never use that one unless you're maybe like propping it up trying to do a zoom call or something like that and you don't care about your and you don't quality as much then yeah yeah so i i think most selfies will come from the outside screens a hole punch camera but yeah yeah but this is a proper cutout which means that it's not like an under display camera it's going to be super fuzzy under the controls so yeah yeah with that it is also funny that samsung has never improved that that that's been around for like three to four years and they have literally never tried to make it better yeah i gotta talk about that in the review yeah it's the same yeah it also seems like it's getting sorry it's still on the nine fold pro profold losing profold losing battery size despite being a larger phone am i right in that it says google take 45 oh my god there's so much light in this room it looks like i am in a haze yeah it's a classic google decision i don't know if you remember um the pixel 4 had like really really terrible battery life because they reduced the battery life like fairly significantly from the pixel 3 and then uh obviously most of the reviews were like the battery on this like does not last at all and then i think it was um gosh who was in charge of pixel at that time it wasn't hiroshi it was dave burr not dave burr i don't know whoever was in charge basically came out and was like it's insane that you guys like made this camera or the battery this bad like he went to the team and basically yelled at his team and he was like why would you reduce the battery life and it was like bro this is your product like you should have been in charge of this yeah that might have been a rick osterlo moment it was rick osterlo that's what it was it was it was like they reduced the battery capacity by like 500 600 million of hours and then they were like and they added the sully radar which just nuked the battery completely one of the worst features anyway yeah that phone was amazing except for the battery and the sully but it was good well long story short check out some pixel leaks let us know what you think maybe you think they're ugly maybe you think they're not so bad but we'll learn a lot more about this phone i guarantee yes stay tuned for next episode where we also talk about pixel yeah probably more i agree with you though that i'm sure that after a couple of months we will be just used to it and we won't think it's that ugly anymore yep there are a lot of camera bumps that i have always thought i mean initially that were super ugly and now i'm like whatever it's a bit of a tradition around here to complain about camera bumps on phones that we weren't going to buy and then they come out and then that's it and that's the end of the story that's the whole tradition now i'll make sure to make fun of any of you who have i'm definitely in this office speaking of folding phones got them uh there's a feature on uh some of these new samsung phones where you can draw on an image and then it can turn that sketch that you drew onto the image into something real that's like a part of the image now and yeah that looks real an eye generated asset to go on top of your image yes exactly and it's fine the thing is what is a photo again right like we don't we don't really these are just things that are cool ideas that they've come up with that they're just throwing in and people are trying them out it turns out they work and uh there are a lot of things that you can draw and like make in your photos that kind of are passable at a first glance that you'd never look twice at and this like that's it this one feels past the what is a photo because it feels so obviously not a photo but i mean some of them are decently realistic there are some that are pretty that one with the cat that they posted on the verge looks really good for a second until you realize the cat is the size of a small car looks like a really real cat though it does this does look like a photo of a cat just taking the crawfish evolution of 3xing its size yes so i took a picture of you guys earlier and i drew a butterfly on your hand which is where i think we would expect a butterfly to be and honestly the first glance at what it created is like kind of passable it's huge honestly the fact that it put the butterfly's legs like in the middle of my hand and added some shadow stuff right the compositing on these is really realistic.
20:59It's mostly that the image itself looks like a little bit cartoony and doesn't have the same like processing as like a camera processing. And that's how you can tell that it's not part of the image. There's also a tiny AI generated content watermark at the bottom left corner that if you aren't looking for, you might not see. Don't see. It's because it's white and like there's a white table emoji and it just says AI generated content. It's white text on a pretty busy background. So it's kind of hard to see, but yeah. It is a thing that you can play with and is kind of fun. It's probably not a useful feature to most people.
21:34I can't wait to get this feature. Allison Johnson posted a bunch of these on The Verge, and a lot of them are very funny. How do I do it? She drew a cat in the middle of a street, and the cat is massive but looks very, very realistic. She drew a really rough rendition of a bumblebee on top of a flower, and it made like a really realistic looking bee right and they made it out of focus like that part of the image was out of focus and that looks really real yeah so i think it's the good enough at first glance test that it passes like if i was scrolling on twitter or instagram and i saw that and i wasn't thinking about ai i wouldn't think twice i wouldn't check and i would just believe it and move on with my day yeah and that's that's a pretty impressive threshold for these like images you draw with your finger on your phone to pass but yeah once you actually check you can kind of immediately see the flaws yeah that's where that's where it lives right now right i think that this is going to be a very weird uh period of time because these platforms are very bad at detecting what's actually ai versus just like slightly ai modified and they'll just tag everything as ai even if it's not so at this point in time you kind of have to look for images just like you have to look for AI generated text.
22:54If it feels like it was written by a high schooler, then it's probably AI generated. If it feels like it's like summarizing something and you're in your English three class, probably AI generated. Same thing with this. If anything looks at off at all, just pixel people a little bit and you'll probably start to see some weird stuff. Zoom in on the fingers. You know what I cannot wait to use this for? What? So you know that one image where someone's like in an apartment complex and there's four buildings all around them and they're looking straight up and they take a picture of like a plane taken off.
23:26There's like a viral picture that happens all the time with travel influencers and everything like that. I'm just going to go there and take that picture without waiting for a plane and then just draw in the plane. Draw the plane. Yeah. That's going to be awesome. Or like in Brooklyn where the bridge is, you know that one street where they have the Brooklyn Bridge. Yeah. Just draw whatever you want there. Yeah, or like there's an in and out in LA that's like right underneath where the planes land at LAX and people like have to wait for the big plane to be extra low anymore baby now you just draw it in there and you're good and you didn't have to blow your eardrums out don't you care about realism don't you care about reality i just sent you guys a photo that i saw a little bit ago that's like a fairly innocuous sort of meme-y photo but the more you pixel peep the more you realize like things aren't right and i can't tell if it's ai or just like really bad computational photography i think that's a real photo this looks like a real photo zoom in on look at the sign look at the text and look at the sign and then look at the underside of the truck and the explain what it is yeah sure it's it's a it's it's a post and also look at the grill of the truck it's a it's a picture with a caption truck lifted too high to see the porsche in front of him and it's like a big lifted truck that's sort of like backing or pulling over the back of a porsche seemingly some sort of turbo s perhaps a gt3 with the intakes um it's a 718 it's a 7 but um but yeah it's like if you look at it it's like oh this is a real photo and then the more you pixel peep it's things don't look it's like why is that why is there all that red in underneath the truck yeah that's that's non-existent i'm wondering if it's like the bumper that just kind of got pulled down but what i'm more interested in is the stoplight is like half missing and look at the font in the yeah the thing that says limited is like weird not it's the weird thing about computational photography these days is that it always tries to do sharpening and so like really bad regular phone photos that are zoomed in a lot yeah the sharpening almost looks similar to ai text i know and that's why i'm like it's really hard to tell the difference a lot of the time and it's just it's like it doesn't really at the end of the day doesn't matter whether this stupid meme is AI, but we now live in a time where you can't tell.
25:40Yeah, where it's like is this? Yeah, normally I'd be like, well, it says CR30A so maybe this is like Russia or something but these are all American cars. No, this is, I think that's supposed to say CA 30A, like California Highway 30A. Oh. Which maybe it is, and again, it's just like a super zoomed in shot that's trying to sharpen it. It looks terrible. It's very possible. Yeah, I don't know. Smartphones have gotten, smartphones are not good at making text look normal when they're trying to uh upscale things this is a really weird image to me it's really weird look at the red light the red light is the light is that looks like a weird that's a weird light to me all of this image looks real except for the street sign and the red light yeah no but what look at the suspension of the truck yeah the suspension looks weird too like that all looks but it's i think that looks fine that looks like a fine like it's It's a modified lifted truck with weird looking red suspension parts and a red grill.
26:39And that also just got into an accident where the bumper's like half torn off. Yeah. This is weird. Interesting. Huh. I think it's trivia time. Okay. We told you it was going to be a grab back this week. Trivia. So not to spoil anything, but in our next few sections, we're going to be talking about some web scraping and crawling and all sorts of stuff. So I wanted to make this question about the classical version of that stuff, web crawlers. Specifically, there's lots of different names out there that computer scientists use to describe web crawlers. Which one did I make up? Oh, no. A. Spider.
27:25B. Automatic indexer. C. A web scutter. or D, these are all real, baby. This is going to be a trick question. Have you ever done a all of the above before? I haven't. I'm scared. Hmm. So your answer would be if you pick one, it's made up. But if you pick D, it's that they're all real. Yeah, you are acknowledging that I didn't make up anything for this question. This is either a trick question or a trick question trick question where you think it's a trick question, but that's the trick. But here's the thing. Here's the thing. You're right. But I feel like that's more fair. I would never give you a trick question without you guys all knowing there's the possibility of it being a trick question.
28:10You know, what's the fun and be... What's the point? Exactly, you know? That feels like enough warning for it to be a trick question. Yeah. Or maybe that's the trick, like David said. Trick question, trick question. I'm confused. Alright. We're gonna rack our brains for a while, probably, on this, but the answers will be at the end, as usual. We'll think about them, and we'll be right back.
28:43Support for this show comes from Shopify. When you're starting a new business, there's so much to do. Sometimes it can feel like you're playing in a Super Bowl, but you're the only one on your team. Shopify says they can help. Shopify is the commerce platform behind millions of businesses around the world, offering tools to help your one-man band play like a champion. Shopify says they can help your business grow with sales, design, marketing, and more. Can't design a website? No problem. Shopify offers beautiful, ready-to-use templates that fit your brand's style. Need extra support? Their AI-powered commerce tools can assist with everyday tasks like enhancing product photos, writing product descriptions, or generating discount codes.
29:18And if you get stuck, Shopify is always around to share advice with their award-winning 24-7 customer support. If you're ready to sell, you're ready for Shopify. You can turn your big business idea into with Shopify on your side. You can sign up for your$1 per month trial and start selling today at shopify.com slash waveform. So just go to shopify.com slash waveform, shopify.com slash waveform. Eczema isn't always obvious, but it's real. And so is the relief from EBCLIS. After an initial dosing phase, about 4 in 10 people taking EBCLIS achieved itch relief and clear or almost clear skin at 16 weeks.
29:58And most of those people maintain skin that's still more clear at one year with monthly dosing. EBCLIS, LibriKizumab, LBKZ, a 250 milligram per two milliliter injection, is a prescription medicine used to treat adults and children 12 years of age and older who weigh at least 88 pounds or 40 kilograms with moderate to severe eczema. Also called atopic dermatitis that is not well controlled with prescription therapies used on the skin or topicals or who cannot use topical therapies. EPCLIS can be used with or without topical corticosteroids. Don't use if you're allergic to EPCLIS. Allergic reactions can occur that can be severe.
30:27Eye problems can occur. Tell your doctor if you have new or worsening eye problems. You should not receive a live vaccine when treated with EPCLIS. Before starting EPCLIS, tell your doctor if you have a parasitic infection. Searching for real relief? Ask your doctor about EPCLIS and visit ePCLIS.lily.com or call 1-800-LILY-RX or 1-800-545-5979. I'm Christian McCaffrey, pro running back, and Abercrombie is an official fashion partner of the NFL. I'm not kidding when I say NFL by Abercrombie broke the internet last year, and I think this season's lineup is even cooler. And so does my wife, who keeps stealing all my hoodies.
31:00Stay fit for the season and Abercrombie's newest arrivals. Shop NFL by Abercrombie in the app, online, and in store.
31:13All right, welcome back. I don't know if you're watching the video version or listening, but we are actually wearing different things. I'm not.
31:25Well, the reason some of us are wearing different things is because we're recording this the next day because we have since gotten extra news that actually affects what we're about to jump into because we're about to talk about, you know, Apple and training AI models on YouTube videos. But the news is we actually finally did get a statement from Apple after we recorded that. So I just want to, we're jumping in now to share that statement just for clarification so you can hear it. Basically, the gist is Apple is clarifying that the data they used to train this model goes into this model, but this model is not being used in any of Apple's consumer-facing products like Apple Intelligence or Siri or any of that.
32:07It is used for only research purposes. Research purposes only is what they're saying. Whatever that means. You know, a lot of these things have been research projects. Like, Chagipity was a research project and then turned into a full-fledged product. However, it is true that Apple is not currently using OpenELM in any of their consumer-facing products. And that the physical data set that we are about to talk about for an extremely long amount of time. Too long. Is not planned on going into any consumer-facing models. models so the open elm language model that we're hearing about does have data from this company but this language model isn't going into apple intelligence that's the clarification also though there are some other companies that use this pile data set that does include our transcripts that have either denied comments or not made comments we kind of talk about it a little bit going further um and yeah i still think a lot of the things we say are valid even if we just talk straight about Apple in those senses because like this is happening not just with YouTube videos but with art but with music but with all sorts of other different things that we've talked about in the past and I still think it's a big thing we need to talk about going yeah further there's no comments from any of those other companies no when these companies are yeah there might be by the time this episode comes out yeah when these companies are literally running out of internet to scrape and so they're training their models on model output you know that they're going to start looking for any corner of the internet that they can take.
33:39So, yeah. So, I feel like that's enough context to at least know the news that's happened since we recorded. So now we can jump into what we did record. Take it away, past self. Alright, our next piece of news involves us a little bit. There was a headline that was going around yesterday, and I think they smartly included YouTubers' names because they knew they would talk about it, but here we are anyway, and it's fine. And it basically went along the lines of Apple and other major tech companies are stealing from mkbhd and other youtube channels and so people saw whoa apple stealing from mkbhd what's going on here and the the general zoom all the way out version of the story is you remember apple intelligence and all these ai features that apple's announcing that's a train that on something they have to acquire a bunch of training data and part of the acquisition process is working with a bunch of companies that scrape data and like come up with a whole bunch of training data for you to use if you're Apple.
34:42And one of the companies took a bunch of data including transcripts from YouTube videos which is I believe a violation of YouTube terms of service. Yeah. We'll get there. Yeah. Like you've gotten like 20 paragraphs into this outline already. But a lot of those videos are from YouTubers that you may know, like MrBeast or PewDiePie or ourself. We had a bunch of we had a couple of videos in this data set and there's a tool available for you to check which videos are included in the data set. So the long story short is they've made this headline that Apple has stolen YouTube content and put it in their training data for their AI.
35:26and that's kind of true but yeah there's a whole bunch of moving pieces a whole bunch of facets to this story that are all equally kind of interesting um i guess let's start at the beginning yeah you did long story short let's do short story yeah now short story yeah so okay do we but there's a lot more like short story long now to unpack some of those pieces so first part is apple intelligence is a bunch of models that run either in the cloud or on the iphone Apple makes the models but Apple has to train the models on something same thing with chat GPT same thing with Gemini they have a data set that they are trained on yeah so if you're Apple you have to get all this data this corpus of human knowledge that you want to train it on and that ends up being what's fed into the model so yeah they they have to work with companies they have to license information they have to just acquire a whole bunch of this data to train their models on and so that's part one is they had to work with some of these companies who have existing data sets that apple could buy yeah and like every ai company needs to train data right like there and a lot of them are using other things we talked a couple months ago about open ai being asked like from joanna stern are you scraping youtube videos and their cto yeah she's Yeah, she was just kind of like, not sure about that, which is like the least reassuring.
36:54Yeah, there was an interview with Kara Swisher recently that she did and she asked her point Blake, too. And she said, I don't know, which I think is the truth. I think that's the truth. I think she should know, though. Yes, she should know. But it is basically like they're trying to include the entire like corpus of human knowledge. and so they have they've gone to all these bazillion places for as much data as possible and they definitely can't guarantee that none of it is youtube they could they should with the amount of money that they have yeah they can and they can it's kind of like uh if you're building a smartphone and someone goes can you guarantee that all of the materials came from uh sustainable places and you can say that you've you've done the work for all your suppliers because you're not the one going and mining all the things you're going to suppliers but you trust to tell you the truth but your supplier could be lying to you your supplier could change things your suppliers could go out of business and you need a new supplier all this stuff but also let's be real like all of these ai companies like they don't have the ethics to care about this kind of thing because none of them have gotten in trouble for yeah there's no repercussion there have been no repercussion it's like there's a gold mine sitting right there and you have access to it and there's a sign in the front that says not your property but then you just you could go and take it anyway you're gonna to do that yeah i would argue most of these companies have the abilities to do any of these things but those abilities cost so much more money right and that they're still putting profits first so most of them almost none of them are but all of them have the opportunity to sure they're moving fast so yes and in ai especially we're at like 10x speed here move fast and break terms of service that's exactly that's pretty much yeah everything we're about to talk about in one sentence yeah So can we go to Eleuther off of that?
38:45Eleuther AI, which is the company we're going to be mostly focusing on? Yeah. So that is one of the companies that Apple got its training data from. Correct. And there was a Wired article on Tuesday that references a proof news investigation of this company that is a non-profit called Eleuther AI created this data set that they're calling The Pile, which is a non-profit open source data set that is online if you you can go find it right now and download it it's like 800 gigs or something like that um but it scraped the subtitles of over 170 000 youtube videos from 48 000 different channels and trains and put it in their data state for the use of training ai and that includes people like us we are in there because proof news made a website and we'll link it in the show notes where you can search videos that are in this data set.
39:39Weirdly enough, all of ours are all YouTube originals. It's like the whole first season of Retro Tech. It has Mr. Beast videos, PewDiePie. It even has Crash Course from the Green Brothers had 1 ,800 videos inside that. I know. And even stuff that are like super copyrighted late night shows like Stephen Colbert and Jimmy Kimmel and John Oliver was included in that data set as well. Because LutherAI on their site says, empowering open sourced AI research and just like open crawl which is a huge data set that open AI originally used to train chat GPT if you just go to a thing that's like we gathered all this information not to make money but just to do research and then you take an open source thing then you can say oh we didn't do anything illegal we just took this open publicly available data set which open ai like references all the time they're like i don't know if we took anything illegal but we took publicly available information and it's like there is such a delineation between publicly available and like free to use those are not the same thing and i know that you know it i know that you know it yeah like don't act dumb here yeah it's crazy yeah this is this is a gigantic data set with a ton of apparent so subtitles specifically i'm i feel like i'm glad it's not other parts of the videos too oh like your voice and stuff like that voice and face and all these other things about youtube videos but it is all of the words spoken in all the videos what you made an interesting point on twitter of is like we as a channel specifically pay extra money to make sure that is not only super accurate but then it helps us do in other languages correct yes so i pay for a human transcription of every video per the minute and it's to make sure that i mean obviously we've had jokes about this in the past but youtube auto transcriptions are like pretty bad so if you're hearing impaired you don't want to deal with those so we pay for these for every video and so if they're scraping the subtitles they're going to end up scraping from youtube api what i uploaded because i replaced the uploaded captions and so they're stealing paid you paid money and then they're taking the thing that you paid money for yeah and training whatever i do find it very funny if they just scraped so many videos where they didn't pay for this transcriptions because a lot of the transcriptions are bad really so you have like pretty rough data mixed in there yeah yeah as always but and the reason we can connect this to some big companies like apple and video is inside of their own papers talking about their ai models they've referenced this data set called the pile apple i think in a paper talking about open elm which is the model released at dub dub correct that like for some of their ai stuff reference the pile so like we know that they are using this data set that has been caught scraping all these things and there's just something like i don't i guess it's maybe not as weird because you're saying you're glad it doesn't have your voice and everything but Something about scraping straight subtitles and like we get paid obviously by people watching our content by a view.
Read the full transcript
42:51We didn't even get the one singular view from the AI scraping our video as they literally just straight up took everything with nothing back to it and just scraped all the data, which later we're going to talk about is against the terms of service for YouTube. Scraping subtitle data is in there. You know, you can scrape the entire internet and there's all of this stuff about like you're scraping websites and people's writing and like the ethical implications of that and how that's messed up. But people don't write the same way that they talk. So if you're trying to make a chatbot that is the most human like possible, YouTube is actually probably the most valuable data set on the entire internet because people on there actually speak more like they normally speak and not how they write.
43:38um and i just wanted to bring up very very briefly i used to contract for samsung i did work for samsung and in college um and i helped them train a bixby model uh based on i'm so sorry yeah well i'm sorry so it's your fault david's ruined bixby because what they did was they were like we need bixby to like have more natural output so we need you and a bunch of your friends to like basically use this client to message each other a bunch of messages as if you're having a natural conversation like 10 000 times so they wanted me to message my friend like hey how's it going you want to go to the gym later but they wanted they were like make it as natural as possible but we need 10 000 of them by next week so they wanted you to make a data set yeah we did make it but the problem was it was based on like repetition and the amount that we did and not uh it was not based on like here use this chat app for the next month and we'll just take everything that you say it was like we just need this on this deadline so we were just pumping out fake conversations that are definitely not the way that humans actually really interact yeah uh so yeah i'm probably partially to blame for bixby but i'm just saying we'll continue to blame this is a much better data set but there's like so many so many red flags i'll never forgive you david so here's the devil's advocate point that keeps coming up that i think at least has some grounding in reality okay what's the difference between a human taking inspiration from a song they heard and then making new music and a robot taking inspiration from millions of songs that it's heard to make some new music can you within a couple hours scrape 180 000 songs word for word with picture perfect memorization of every single word and everything in there no but what's the difference in output so we don't know what the exact output of this is but if it's saying just word for word things then i would argue there's absolutely no it's just the exact same thing.
45:50I guess if the question is like my output that I'm asking for is I want a creative new blues song for whatever. Give me a three minute creative new blues song in the style that would go viral in 2024. And you ask a human to do that and he'll use what inspiration he or she will use whatever they know and whatever they've heard recently. And some of it's memorized and some of it's I kind of remember some stuff that went well. And if you ask the robot to do it both of them will take whatever they were inspired by whether it's 180 000 youtube transcripts or just the stuff that the human listened to recently and they will both output something genuinely new because they're told not to copy they're told to make something new and what's the difference between inspiration and scraping in a way that these models are turning that data into new stuff i mean do you want the physical thing right now that is like YouTube doesn't allow you to scrape off of its platform?
46:45It's like literally against the term service or are you talking more broadly? I think more broadly because yes, you're right. We can get into that part later. A human is allowed to watch YouTube videos and be inspired by them. Sure. And a robot is theoretically not allowed to do that. There's an aspect even in that where if inspiration comes too close to copyright law, it can still get in trouble. Yeah, remember when, who was it that sued because the vibes were the same? I thought Paramore and Olivia Rodrigo got a little too close in a song. There was a... Yeah, there's been a bunch of lawsuits.
47:16This has 100 % happened before and appropriate things have happened in copyright. Also, sorry... But that's judged on the output, not the input. I don't know if you can make an ethics claim based purely on the material of the output, but I don't think we should forget the scale and then the idea of like who actually gets to benefit from the work and you know what i mean like like at the end of the day like none of us have a billion dollars you know we we don't have access to data centers it we would all feel terrible about using an entire city's worth of energy in an afternoon you know like like nothing about this is like is like good you know And it's just a way for people who already have a lot of resources to steal not just resources, but the means of generating more resources from people.
48:16And then also, I don't think we're quite there yet, but I think we should all start preparing our brains in the next like five years to just conclusively say that like human beings matter more than computers. Right. Like that and that, in my opinion, and hopefully the robots don't kill me when they become sentient and like rise up or whatever. But it's like, I think at a certain point we should all be prepared to be like, this is better because it puts a human being in a place of power instead of a instead of a computer, which at the end of the day, it's a it's a silicon wafer that I could crush with.
48:54Oh, you know, I strongly agree with both those points, because if we were to, you know, if you have a multi-billion dollar company, nearly a trillion dollar, multi-trillion dollar company, and you have like all the singer songwriters that are just like trying to make a living, and then you just go, I'm just going to take everything you did and not learn how to play the guitar and write good songs, and then replace all of you with AI generated songs. You can only do that because you're a multi-trillion dollar company. And I know that there's like not like a necessarily legal precedent that makes this like legally wrong.
49:29But like, do we collectively as a human species want to allow that kind of thing to happen? Like in the reverse engineer situation where like a human being spends that tens of thousands of hours watching YouTube videos, learning how to use a camera, like learning to edit. At the end of the day, what they have accomplished is giving themselves a skill and they can now be a part of the conversation that is YouTube. You know what I mean? But when a company like insert company name here does it and then they can begin, you know, in theory, launching thousands of YouTube videos. All the slop that you're noticing through every social media platform.
50:07It's a very different paradigm. Yeah. Yeah. I guess I'm trying to find the because it's kind of a gray area between those two things. This entire conversation is a gray area. By the way, this I just want to like put that out that I don't think anyone here has the answer to this. Yeah. But we certainly have feelings on it. Yeah. Because existentially, like the human believes the human is very is valuable, obviously. So the human wants to hear the human music and the human wants to watch the human perform the skills, obviously. And so we don't think that we would respond well to like a robot creation.
50:39It wouldn't have the same attributes. But even if that's what I was going to say before to answer your question is how the human receives the art. I think that is the key point, because if you show two outputs that are the same, but you tell someone the human made this one the human is going to inherently value that one yeah right yeah that someone should do that blind test someone should do uh control the scientific method like give watch someone listen to a song when they are told that a human made it and then watch a bunch of people listen to the same exact song when they are told that an ai made it and then afterwards ask what do you think and if you get told the human made it you'll go oh that was really soulful i could hear the inspiration and if you get told the robot made it you'll go that sounded really bland and generic and uninspired.
51:22Yeah. I wonder if it's just because we believe that the human made it. Probably. But also, I feel like we just have to care more about the human generated stuff. We got to. Yeah. Because at the end of the day, even if you even if there was quite literally no difference, if if the blind test proved that nobody could actually tell the difference. Do we want to live in a world where nobody makes anything? well and like there is a world like it's the grayest there there already to me is an example of someone who scraped a bunch of data made a piece of art with ai that some people knew as ai some people didn't know as ai but everyone loved and it ultimately didn't affect anything because it was one human creator just contributing to the conversation that is art and what i'm talking about is the song of the summer, BBL Drizzy.
52:15Is that an AI song? Yes. That is someone who trained an AI on tons of different Motown and soul. Wait, that's not a Kendrick song? No, no, no, no. The beat where the singer's going, BBL Drizzy. That's an AI-generated voice. That's AI-generated backing tracks. Metro Boomin sampled that with his human skill into a hip hop beat. But yeah, so I would argue there is room for human beings to use AI, train their own data sets, scrape and steal and and not disrupt. I'm going to keep using this word conversation because I really like it to describe the exchange of ideas and concepts. I think a computer could exchange, could contribute.
52:56No, a computer can. A trillion dollar company that can drastically alter the entire environment in which we create. Can really, and I'm going to curse Ellis, bleep this out later, can really f*** your s*** up. You know, f*** everybody's s*** up. Yeah. Anyway, we got way off track. Yeah, well, sorry. That's okay. We can go to maybe a couple of things here that are in the still gray, but less gray area. which are middle gray middle gray just like yeah um let's talk about first of all scraping straight using the youtube api subtitles yes we have to look into this yeah i spent a david and i spent a long time yesterday going into this um and i found a couple different things or we found sorry what'd you find mostly you sundar and neilai talked on decoder about this was back when open ai was potentially scraping youtube data and allegedly allegedly sorry we're gonna have to say a lot of allegedly um he responded that the youtube team is following up and that there are some terms and conditions and that they expect people to abide by those terms and conditions so that was like a very vague way of potentially saying like we're looking into it and it seems to go against their terms of conditions but i found a much more precise quote from neil mohan um talking to bloomberg the ceo of youtube saying that if soar was using uh youtube content it would be a clear violation.
54:20He said, from a creator's perspective, when a creator uploads their hard work to our platform, they have certain expectations. One of those expectations is that the terms of service is going to be a buy-to-buy. It does not allow for things like transcripts or video bits to be downloaded, and that is a clear violation of our terms of service. Those are the rules of the road in terms of content on our platform. So that is a very specific, funny enough, this was before all this came out, but he even mentions transcripts right there, scraping transcripts and downloading them from YouTube. is against the terms of service sounds pretty specific so youtube has a case here of something um what i found interesting also though is we can all assume google has their own ai and google has this gold mine of content on their own platform yeah are they scraping um not even scraping just using or just using the stuff that they have already yeah mohan mentioned something in that interview that i'm still not totally sure so i will let us maybe figure it out because i couldn't get a precise answer and everyone else can think of it but he said that google which owns youtube does use some youtube videos to train its own ai platform gemini but only if the individual creators on the platform agreed to that in their contracts what i cannot figure out what that exact contract means whether that is just the like the terms of service you have to agree to to upload literally anything on their website yeah whether it's the youtube partnership program i looked at my contract contract which was my terms of service yeah i didn't see anything specific to it but we were talking yesterday it would just like it wouldn't make any sense for google to not do this like reddit for example sells its user data to ai companies as training data when you upload anything to reddit it is now the property of reddit when you upload any images to instagram those are now the property of Instagram Adobe to anything you do on the Adobe platform trains its AIs I think you can well there's a whole thing around that that allegedly they've said that they don't but it's a I don't know it's a whole thing regardless it's just it's one of those things that's like Neil very used very vague phrasing there and there's so many times when you check the checkbox that says I agree to the terms of service and in the terms of service is a thing that will give the company access to your information and your rights it's very I'm not going to say this is for sure but it's very likely that somewhere in the terms of service gives YouTube the ability to co-license as we saw in their terms of service the content on YouTube to other companies which you would assume they would do to Google because Google is YouTube and YouTube is Google I would assume that I'm going to assume that that's the case.
57:06We would love clarification on that for sure. Anyone that works at YouTube, Neil, if you want to tweet at us or email us, we'd love to know about that, but it's the, it's the same goldmine analogy. It's like Google has the best possible opportunity to train the best possible model because they have the best possible source of information. And if they weren't doing that from a business perspective, that would just be like stupid from a business perspective, even though I don't think they should be doing it. You know, So Google would have more of an argument too of being like, we're creating this platform that helps creators flourish through different partnership programs where they can make money.
57:41So like, you know, we're gonna also make some even more money on it. It's still this weird, I don't love it, but it's a way better explanation than Apple taking or NVIDIA taking this like random free thing that definitely broke terms of service to get in the first place. Yeah. I recently asked Gemini to summarize the latest MKBHD video, and it did. And there's an element of, you know how in fair use, there's an element of, like, replaceability? So my work is considered derivative enough if it doesn't replace watching the original work. Like, if I make a commentary on someone's video, but I don't use the entire video, and I add my own thoughts and it's transformative, then it's not enough to replace watching the original video.
58:34Therefore, it is fair use. But Gemini summarizing my latest video feels like it can replace my video. And in order to summarize my video, it needs to know about my video and be trained on my video. So I would argue that it's taking from me and replacing me in some way. This is kind of the reason that there's been this huge conversation in the last year or so around the streamers that just play people's videos and don't react, don't even really react to them. And many of them will just leave the room while the video is being played. Because then they're getting the benefit. And it is replacing you and going and watching the video because the thousands of people that are watching the streamer are not going to go to YouTube and watch your video.
59:20They're just going to watch it on the stream. Yeah, I've seen people do that to my videos before. Yeah, all the time. Which is not cool. And it would be that would be a pretty good use of like that. That's the line. There is some sort of copyright law that's been debated, I think, from OpenAI and actual lawyers about if some of the scraping data is considered fair use. And I'm not exactly sure where it is, but even still. Pick your option. There's like a hundred different cases. I'm sure there's a billion different cases going on. And I just want to throw that out there that the fair use aspect of scraping AI data and using it for chatbots is being looked at right now.
59:56But even still in this specific thing with the Luther AI that we're talking about is they broke terms of service. And that's far different from from. Does the terms of service say that you can't scrape no matter what or only if you're making money on it? Because that's always kind of been the question because you can upload a YouTube video that has a Taylor Swift song on it if you don't monetize it. It's true. So. I'm not totally sure. That's kind of always the line. I would assume most of it is less of it's always not allowed, but we're much more willing to go after the people making money. It would be my guess.
1:00:32Also, can YouTube even do anything about this if Eleuther didn't agree to the terms of service? Like they're not... That's also a great question. Yeah, that's true. Did they even agree to the terms of service? Why would they have? Is it more of just a legal thing? and also once Apple has already, let's say Apple and NVIDIA and others have downloaded this data, but once Apple already trains their data and trains their models on all of this data, and then we find out, oh, actually some of this was not acquired legally or whatever, how do you reverse that? Is that reversible at all? You have to retrain a new data set, a new model, which costs a billion dollars.
1:01:13Yeah, it feels like that's a huge part of it too. It's, well, it's already in the data, so not much we can do here. This is the next thing I wanted to bring up, in all of this is yeah what are our next steps here if they trained it already we just said you don't you have to train a whole new data set which is none of these companies are going to do so much extra carbon in the atmosphere yeah um but then it's like there's also the argument of what if you like apple didn't take it luther stole the the data and now apple's taking it but i just like did apple pay for the data from luther i'm assuming no i've not seen anything about it but it's a free open source non-profit so i don't even know if they even paid an open source set which means they probably didn't pay for it this is the exact same argument that happened with open ai when they were training jet gpt and um dolly was that they used all of these open scraped model like open scraped data sets online and so then they weren't like we didn't scrape it we just took this open available information i guess they get to say publicly available yeah that sort of thing right some companies are partnering like we saw because we work with vox media for ads on this podcast and vox partnered with open ai and they're doing to train their data set it was easy enough because we knew that happened we could talk to vox it's just part of vox media not part of their podcast network we're not included in that but that still is some sort of actual connection that they've made so companies do that do actually connect with other media companies i think a lot of the companies are just realized there's a really good interview between uh neil and nick thompson who is the uh i believe ceo of the atlantic or the editor-in-chief of the atlantic he used to be the eic for wired um but he has he gives a huge explanation about why he's partnering with open ai to give them access to the atlantic for training data and they have sort of like this back and forth where they both give each other things.
1:03:09And I think the deal with OpenAI is like, it's better for OpenAI to just make a deal with all these media companies because they don't get sued like the New York Times sued them. And they can kind of just give them credits and do all this different kind of stuff. Acquire with permission. Yeah. Yeah. Wow. What a concept. Yeah, what a concept. Some of these companies are really struggling. That would probably cost a lot of extra money. So if you want to hear like a good sort of breakdown from these publications perspective of why they may give their data to these companies, you should listen to that interview.
1:03:39It's on Decoder. I think with taking the Eleuther stuff, all the companies taking from there need to pay the due diligence to realize where the information is coming from. And they are all more than capable of doing that. And if that broke YouTube terms of service, they're pretty much just that at fault for not. If you steal something, I just - We were talking about this yesterday. Like make the analogy of like selling stolen goods on Craigslist. I brought something up. this is in New York, so I'm sure laws change state to state, but to be convicted of possession of stolen property, actual knowledge of it being stolen is not required.
1:04:11All that is necessary is that you should have known. That means the prosecutor must only prove a reasonable person would have known the property was stolen. If you're getting tons of data for absolutely free, you should probably know that there's something. What do you mean? I found this Rolex on Canal Street. If you buy a bike on Craigslist for$40, that's a$500 bike, you should probably know that that s*** is probably stolen. And like a Luther did not do this fairly. And all the companies that pulled from this and threw it into their training data, training data probably should have known something sketchy was going on or at least put the effort into figuring it out.
1:04:47Right. You can just make this analogy like you steal a watch from someone on Canal Street and you now just say it's yours. Like that's what these companies are doing. And we already it's it's already a problem when you rip off people's writing. Right. You can like take a big thing on Wikipedia, change some words slightly, and it's still plagiarism. This has been a huge conversation on YouTube in general recently because there's all these video essay YouTube channels that are literally just like reading Wikipedia or reading books verbatim and then like putting graphics over it and pretending that they wrote the whole thing.
1:05:19And they'll just change some small sections and they'll be like, it's not plagiarism. I just took heavy inspiration. And it's like, no. And if you're making a language model and your whole model is based off of other people's work, even if you're changing the words, that's still heavy inspiration. And that's most of the New York Times lawsuit against OpenAI is kind of focused around this because they have many, many, many examples where they'll ask a question about a New York Times about something that happened. And it'll basically just almost verbatim say the New York Times article, but it changes some of the adjectives.
1:05:54I guess my last question, and maybe we can take a break after this, is, okay, so we know that these companies still want to make AI models and language models and things like that. What is the actual landscape of options for training data to make a good model? And I think that might be something that takes a whole lot more research that we don't know enough about. but it kind of feels like there are a relatively small number of absolutely gigantic models. And if you're Apple rushing into the scene where they probably shouldn't be, but not really being able to find huge models with gigantic amounts of information that contain zero improperly acquired information, that's a question I don't know the answer to.
1:06:43I think all of these companies have the resources, or I shouldn't say all of them, all the ones that we're talking about, Apple, NVIDIA, have the resources to like be able to ask proper permission and have more options than they could ever imagine. And or just pay people. And pay, just pay people. Like if you're YouTube, if you're Google and YouTube, you can say, hey, we would love to like train our models using our YouTube transcripts. We will pay you 5 % more ad revenue if you're willing to let us scrape your transcripts. What do you think? If you're Reddit, you could do the same thing. If you contribute a lot, we'll pay you based on how much you contribute to Reddit and keep conversations flowing, the quality of your conversations, stuff like that.
1:07:23These are all trillion dollar companies. It's not like they can't afford to pay people. They're the greatest and most intense nexuses of information in the history of humanity. Like they don't have the excuse to be like, I don't know. It's like, you know, you know, as much as any entity has ever known ever. Right. If you're Apple, there's a reason that they're going to these companies to buy slash license the data sets instead of going out and gathering it themselves. Admittedly, Apple's in a much worse position than all these other companies because their entire brand is privacy. Personally, but I still think they can go do their research on figuring out data sets that aren't.
1:08:03No, that's my question is what options are available? is are there only 20 reasonably big data sets that they could train like train stuff on or are there bajillions of options i have no idea but i don't know the specifics of it but i'm sure there are plenty of options that have like are we sure i don't know i just hope so i'm sure they can find i'm sure they could afford to pay someone to make a data set that was interesting there's a before we we gotta probably wrap this up so before we go to trivia but there's a very similar thing going on in the art like the physical art world on the topic of provenance where a lot of museums especially in New York, are getting in trouble because most of their art is stolen.
1:08:41And yes, the Met over the past few years has had to return over a thousand pieces to various countries. And the museum's excuses, how are we supposed to know it was stolen? We bought it from a reputable art dealer who said it wasn't stolen. How are we supposed to know? And on the surface, it very much feels like, oh, that's very reasonable. If an art dealer got it from another art dealer who got it from another art dealer who bought it from a thief. How are you supposed to track that down? But the actual reality of the situation is almost never like that. Like there's this awesome article from a year or two ago on ICIJI, which is an international journalist consortium, where they talk about there was an artifact that was stolen from Southeast Asia in the 80s that appeared in the museum in the 90s.
1:09:30Like it only took 10 years from stolen to in the museum and the museum was still like how were we supposed to it's like dude you are the one of the biggest art museums in the world like if you don't know like doing your due diligence basically yeah it's like it's like at a certain point like you have to own up to the amount of cred that you have and do things the right way right well that yeah it also gets into so many like ethical boundaries of like i mean they have a bunch of egyptian stuff direct from egypt in the met and so there's all those questions of like well the british stole everything yeah so when the british eventually sold that stuff technically all of it is stolen marquez i i genuinely see where you're coming from and i don't have the answer to your question which i think proves your point to a large extent however i fundamentally in my soul refuse to believe that this is not something that, again, the smartest, most valuable, farthest reaching entity in the history of humanity can't accomplish.
1:10:34I agree. I think you have a really strong case and I agree that it would make sense to believe that the strongest entity in humanity ever should have the ability to solve any problem that humanity comes up with. But I still don't know the answer to, I would love to see someone make an expose with whatever information is out there about what the world of these data sets is actually like. Because there are the data sets that are used by OpenAI. OpenAI is a several bazillion dollar company and they have to go get data sets. Like Google, what are they using? When you're buying all of the content on Reddit and using Reddit information, what does that look like?
1:11:12And if you're Apple and you have no data sets, how do you train a good AI? Where do you get that information? I don't know any of the answers and I would love someone to find all the answers. Yeah, I hope that would be a great expose. I hope nobody watching this thinks that are strong points on either side. Makes us think we do know the answer. This is just all a lot of arguing. We're making an ethical argument and that these companies don't care at all. They do not care because they're going to make more money even if they get sued and they get caught. I mean, they want to look like they care.
1:11:47The amount of money. Sure, yeah. What's the say? Move slowly and keep things intact? No, I feel like that's not it. Move fast and break terms of service. Like, nobody, you know? Immediately what we're talking about with is the more connection to us of scraping YouTube videos is what probably will happen is if YouTube does anything, Apple or Luther or whoever will pay Google a bunch of money and then all of the YouTube videos that got stolen will see absolutely nothing of that. Yeah, I do have to say it is crazy surprising that Google has not done anything about all of these companies that have obviously been scraping YouTube and breaking their terms of service.
1:12:21It is wild. Yeah, the transcript data is exposed in the API and I don't know that there's any, I don't know what their method of protecting that information would be. I guess, wait, sorry. Now to go all the way back to did they agree to the terms of service if you use the YouTube API? You'd have to. Do you have to agree to terms of service by using that? I believe so. So that might answer that question, but. Yeah, I don't know. I don't know anything about APIs. the API they might just have built a bot that can like scrape. I'm not 100 % sure but I thought a Luther said they use the API specifically.
1:12:51I use the API for some of our data collection and yes you do need to agree to certain terms of service. Apple's going to email you. What are you collecting? Oh oh. We should go to trivia. That's for our channel. Anyway, companies don't have your best interest in art and they like to make money. More at 11. I guess that's where we should take it to I'm so sorry guys. That was pretty intense. The rabbit hole just kept opening. It's always fun when you go down in an ethical... The pod was supposed to go live 10 minutes ago. It was cold when we started this and now my hands are closed. I told you not to turn off the AC.
1:13:29I know, you're right. Second question. In 2013, Google launched their first consumer hardware device. What was it? In what year? 2013. 2013, they launched their first Google hardware. Consumer hardware device. Consumer hardware. 2013? 2013. Oh, I have an answer. I gotta write this down before. So, was 2008 and the Nexus S not considered a consumer hardware device? That wasn't Google. Google didn't make it. Oh. We'll see. I don't know if it's right. We'll brainstorm it a little more. We got more to talk about, believe it or not. I have an idea. Yeah. We'll be right back.
1:14:26When did making plans get this complicated? It's time to streamline with WhatsApp, the secure messaging app that brings the whole group together. Use polls to settle dinner plans. Send event invites and pin messages so no one forgets mom's 60th. And never miss a meme or milestone. All protected with end-to-end encryption. It's time for WhatsApp. Message privately with everyone. Learn more at whatsapp.com. This episode is brought to you by State Farm. Checking off the boxes on your to-do list is a great feeling. And when it comes to checking off coverage, a State Farm agent can help you choose an option that's right for you.
1:15:05Whether you prefer talking in person, on the phone, or using the award-winning app, It's nice knowing you have help finding coverage that best fits your needs. Like a good neighbor, State Farm is there.
1:15:19Lowe's knows how to help make your home holiday ready for less. Get Select Style Selection's vinyl flooring for just$1.99 per square foot and have it installed before the festivities begin. Our team can help you every step of the way. See a Lowe's Red Vest Associate or visit lowes.com slash holiday install to get started. Lowe's. We help. You save. Basic install only. Date restrictions apply. Subject to availability. Install by independent contractors. See associate for details. Contiguous US only. Alright, welcome back. I have one last thing to talk about. It's kind of random off the wall, but every time Canon comes out with a new mirrorless camera, they absolutely nail it.
1:16:01With every single new spec, they finally added the thing that we are begging them to add. except and then they mess up one thing that makes it critically flawed and kind of an issue they make amazing cameras i just have to say like we still use a lot of canon cameras i'm looking right at a c100 c300 we shoot c70s for studio we have r5s everywhere 500 c500s too i love these things right they're really really good but r5 you might remember had the overheating issue like the really good cameras great autofocus a whole bunch of awesome stuff and then like ah but it overheats when you shoot 8K. Or they have like a really great vlog camera that's finally smaller and finally has great codecs.
1:16:42And oh, but the camera doesn't flip around or the monitor doesn't flip around. The R5C was everything we wanted, but the battery lasts 20 minutes. And doesn't have, yeah, yeah. I would argue almost this happens. Ibis. Ibis, yeah. Can I argue this happens with just like mirrorless cameras? Because this happens with Sony too. That's totally true. They like do all these cool things and then the like flip up screen only flips up. So if you have an external microphone or then they fix that and flipped it to the side, but that's where the microphone audio jack was. So it's just in front. It's almost like they need it to be imperfect so that they can release another camera that you'll buy.
1:17:13Well, this brings me to the newest announcement. Yeah. And I'm looking at it, and I personally don't see the Achilles heel. Someone's going to point it out in the comments and break my heart. But as of right now, Canon's released two new cameras, the R1, but also the R5 Mark II. This R5 Mark II, I think, for 4 ,300 bucks, is gonna be pretty sick. 8K60. C-Log 2 got added. Full-size HDMI port instead of that dinky mini HDMI on the R5. 4K120 with audio. It has a cooling battery grip. So obviously there was a firmware update a while ago to improve the cooling on the R5. But a cooling battery grip to have longer battery.
1:17:57There's more specific batteries for this, but it shouldn't overheat. it has electronic image stabilization that works with the stabilization built into rf lenses i mean i'm going down this list and i'm like it seems like a pretty sick camera records onto micro sd i'm like oh my good no it still has all the fundamentals it's like it's still a good size camera it still has it's 45 megapixels it takes fast stills like all the things that you'd normally expect that of a camera so i'm worried about what might go wrong when reviews come out but as of right now i think r5 mark ii is is that camera i'm trying to confirm this but i think i may have found something i can't see a picture is the sensor triangle what's going on no i i really liked that joke this morning like that would okay so one of the coolest things i think about the r5 mark one that we have is every time you take the lens off the shutter shuts and it protects the sensor and i think every single camera should have that there's just a photo here and it looks like the sensor is just open but maybe he did that on purpose but if they took that away from this one no it has it still it still has it yeah i saw in peter's video okay good yeah i think every single mirrorless camera needs or every single dslr it's a good feature because it's so reds are mirrorless and they get little dust particles on the sensor all the time if you're changing lenses all the time it just makes you feel so much better i'm just saying canon people let me know what i'm missing because i think i think i'm gonna end up spending four thousand dollars on one yeah on one 42.99 specifically 4300 it's not i don't want to go buying a bunch of stuff but like that's it also has eye tracked autofocus so you can look at the thing you want it to focus on and i'll on that wait what yes and i want to point out that a film camera from canon actually had this back in the day and it was so when you're saying eye tracking you don't mean it's tracking the eye of what i'm shooting no it's using my eye and which autofocus point i look at to focus on the subject yes what's what's wrong with this camera wait i don't know if i like that something is going to be horribly wrong with this camera yeah you yeah you you basically just look at what you want it to focus on and it changes the focus to it but there are some times where i'm like looking at something behind the subject just to like watch it go out of frame or something like that so it's just going to focus on that yeah oh wait hold on hold on yeah sorry i need to confirm here so if you're looking through the evf what you're looking at yes okay i thought you meant like if i were in frame yeah that's and i like put something up in front of me and looked at it it would rack focus to that no that's really cool and they had this in the canon eos 5 also known as the a2 and a2e we have one of those film cameras oh yeah film cameras um yeah and it was super cool and now i imagine it is way way way better than it was back in the day but they call it uh iaf2 and i imagine the first one was iaf1 i just remember seeing this on the that film camera and being like why has nobody done this again sick and if it's bad you can just turn it off exactly Wow.
1:21:08Yeah. It's pretty awesome. I'm scared. There will be something wrong. Don't worry. I'm scared. We'll find out when Marquez gets his... I'm reading comments on this to see... It also says they have C-Log2. And for those that don't know, for some reason, the R5 has C-Log1 and C-Log3. Log profiles shoot very flat so that you have a lot of room to grade. Famously, C-Log1 and C-Log2 are not good. I do not like them at all. C-Log2, we like. C-Log2, very good. We like. And they've always... They've always kept those for some reason for the cine cameras. And I know there's a reason for it. Obviously, they don't want to cannibalize their own market.
1:21:46They are so worried about that all the time. So bringing that on to this, I think it's going to be awesome. That's what scares me because you would think R5C Mark II would have this. But the fact that they bring this to R5, I keep thinking, what did they nuke? Yeah. What did they do? Something's missing. Is it still too light? It's like walking up to a dog like, what's in your mouth? What's in your mouth? What did you do? I'm going to try to verify. I don't know what it is, but it's going to be crazy. Okay, well, you know, we might have to get one. Did you mention full-size HDMI? Full-size, yeah.
1:22:13The real deal. We just plug right into a monitor. I feel like we lose those stupid adapters every single time we get one. Or they break. They're so finicky. They're not durable. They also announced the EOS R1, which is$6 ,300. Is it like the flagship? Yes. The sports photograph? It is basically the mirrorless version of the 1DX. 1DX. And it does 40 FPS raw. Yeah. Which is crazy. It's 24 megapixel, but it has some in-camera AI upscaling thing that can apparently upscale it to a much higher resolution. Okay. So very interesting. We've been wondering for like a lot of years when our camera is going to start catching up to smartphones in terms of like the computational photography and processing.
1:23:01And it seems like that's finally happening. but apparently it can generate a 96 megapixel image i'm not as worried about that sucking because like a smartphone sensor and optics are so small that like you kind of need some computational assistance to make a great big image i mean you're you're i'm looking at a film person like the bigger the sensor the bigger the optics the more room you have to make good images and i'm not surprised that a full frame sensor with a huge lens can be upscaled and still look good yeah or like a crappy 12 megapixel camera phone photo yes help there's no light intake at all so like a fast sports photo like okay give me a give me less megapixels on the raw capture right then you can upscale and have a good looking image yeah 24 megapixels on a full frame sensor you're getting a quite a bit of light on each pixel exactly so yeah that's exciting i found something on the r5 mark ii that let me know if this is a problem oh my god new battery type none of the old ones i saw that i saw that i am willing to accept that because it seems like it should still because there's new grips and stuff it should still it should have better battery life and i don't have a ton of r5 batteries anyway so i'm not mad about losing that and if you're a new purchaser and didn't have the previous ones that doesn't affect you at all so that does suck if you're upgrading yeah but it feels standalone enough to not be i have like 30 r5 batteries or something.
1:24:27All right, I'll keep looking for a deal breaker. The cooling grip is$750. Jesus Christ. Damn! I want to know really quickly that they did put that eye tracking in the EOS R3, which is the APS-C camera that they made the lens for for the Vision Pro. Right? That's the R7, sorry. They put it in the R3, which I don't really know a lot about the R3, but apparently they put that in there first, so this is the second camera to have it. You know, they go the opposite direction of Audi models as far as, like, names versus size this is such a stupid comment why am i even saying why is this coming out of my mouth rs rs3 rs5 rs7 gets bigger but like r1 is the biggest one r3 is smaller r5 canon's always done this though right like yeah 1d 1d 5d yeah it's a big boy yeah yeah i don't know why i even said that anyway what is coming out of my mouth why am i saying i should stop and think first what a what language model am I being run on right now?
1:25:24Anyway, we've talked for so long, we should do trivia. Let's do trivia. Let's do trivia. I feel like this might be the longest episode. It might be.
1:25:36We're off from last week's episode still by like 20 plus minutes. Really? And that's with goofing around for 15 minutes in the beginning. Goofing around. Question number one. Trivia. Let's kick up the energy. Trivia, dude. Web crawlers We know them as web crawlers. When I say web crawler, everybody knows what we're talking about. But Google.com. Some people use different words. I have three of them. One of them is possibly fake. Which one did I make up? Hit it. A. Spider. B. Automatic indexer. C web scutter or D these are all real and I didn't make anything up at all before I thought you were going to say I say web you say scutter scraper get out of the gutter what have we got boys oh wow we all said different things and you're all wrong It was D.
1:26:48But you should read your answers anyway. All right. I wrote C. I wrote Spider. I wrote the AI one. Unfortunately, no. Spider was used by Scott Spetka in his early paper, The Robot, colon, Beyond Browsing. I remember that one. Early computer research paper. Automatic Indexer was used by May Kobayashi. And I forget his first name, but the last name is Takeda. In a 2000 paper sponsored by IBM called Information Retrieval on the Web. and web scutter is present in the FOAF official documentation paradigm which I think some of was written by Tim Berners-Lee but I'm not gonna say that actually I can't I think it might have been but I'm not really sure and D the correct answer is these are all real I'm just about right I couldn't come up with anything funny this week guys I'm sorry it's all right it's all right it's so crazy how David knew all of that and he still got it wrong I know damn why now every time every time i'm just trying to i'm my headache i'm not ahead so i'm trying to like give you guys yeah that's fair quick update on the score are you ahead yeah marquez with 14 uh andrew with 13 david with 14 oh ellis carrying the one oh i thought i was one point over no you're one point over andrew but you and marquez are tied up really got him all right right where i want to be second question in 2013 google launched the first consumer hardware device that they ever launched.
1:28:16What was it? I think. Therefore I am. I think I still have it. Really? Wait, really? Hmm. Wait, 2013? 2013. Trying to get a reaction to see if I'm right. Oh, no. Oh, yeah. Is it what I think it is? No. I don't know if I'd consider that consumer hardware. Oh, yeah. I think my thing is from before 2013. Okay, what do you got? David, flip it. Chromecast. Oh, good job. Andrew, what did you say? I wrote Chromebook. Marques? I wrote the Chromebook CR48. Nope. Their first ever consumer hardware device was the Chromecast. Wait, wait, wait, wait. When was that? 2013. But the CR48 was 2010. Who made it?
1:29:13Google. But wasn't the question in 2013? Well, I just happened to come up with the actual first question.
1:29:22You know what I mean? I feel you. I feel like I'm right. I only agree with Marquez if me just saying Chromebook also counts in that. Where did you get the answer from, Adam? The keyword, which is Google's blog. What did Google say? They said the Chromecast. They said the Chromecast is the first consumer source. The first consumer hardware device. This Chromebook? versus Google. Wow. That's weird that they would forget about their own shop. It, uh, yeah, it's all matte black. No logos anywhere. What if we both get points? Forget points. Holy crap. I, in real time, Marquez has unearthed a product that is older than the Chromecast.
1:30:01You're not shocked that Google forgot about one of their own products? No, no, no. I'm not shocked that they forgot about their own product. Petition for us to all get a point. Because we're all... I think we should all get points because we're all technically right. the answer that Google somehow thought was the right answer. And so you should get a point for that. I came up with the actual answer, which is their actual first consumer hardware product. And I stumbled upon it. But, wait, wait, wait, wait, wait. But if we're letting the C48 in, then wouldn't just the G1 be the first Google consumer hardware product?
1:30:33Because that's as much Google made as yours. What I'm looking at is a 2013 Chromebook. That was an HTC. Yeah. It had an HTC logo on it. Yes, but yours doesn't have an Acer logo. No, it doesn't. It doesn't have a logo. It has no logo. But also, if we gave Andrew the point and didn't give it to either of you guys, you would all be tied at 14. And I think that makes the game really fun. No, what are you talking about? There's no world where David shouldn't get a point. I agree. But there's also no world that Andrew gets a point and I don't. Unfortunately, I think both of those worlds are the ones we currently inhabit.
1:31:10What are you talking about? This is insane. Is it that insane? Yes. It is insane. Okay. I have an idea. Also, low-key Chromebook Pixel was insane. I'm going to suspend the points from this week. What? And make a poll on threads and Twitter. Can you just do a YouTube community? Sure, YouTube community. YouTube community? Only YouTube community. Don't tell them who said which answer. I just want to say I did not expect this question to be so controversial. So contentious. Because I thought Google would have gotten this pretty straightforwardly right. But turns out their block is wrong. They must have used the AI-generated results to write this.
1:31:48Who wrote it? Actually, yeah. Can we confirm that this keyword post was not written by an AI? It was not, and I'm not putting them on blast. So go to YouTube community and vote on who gets the correct point, and I will update next week. What are you listing? All three and each of our names and everyone gets a point? Or just each of our names? just the answer. Chromebook? Chromebook. What was it? P48? CR48. CR48. Chromecast. Chromecast. Are you just letting people decide? Yes. Because I... Where does the Nexus Q fall into all of this? You can't just let people vote. Too late. You can't just do that.
1:32:26We live in a democracy, David. Anyway, final answer is the Chromecast. Vote in the poll. I hope it's like multiple choice so you can pick like two instead of just one. But anyway, we'll pause points till next week to figure that one out thanks for voting um yeah i guess that's it thanks stop the ballots thanks for watching thanks for listening we'll be back to regular length podcast next week i promise i swear we won't allegedly allegedly see you then wait for was produced by adam malina and ellis rovin we're partnered with vox media podcast network and our to try after music was vinso bingo make good choices make good choices and we didn't steal any of this i'm sticking
1:33:27We could make that into a paid service, you know. We come to your house, Fiber, TaskRabbit. We come to your house and just make Mario sounds.
From the publisher
This week, Marques, Andrew, and David talk about the new Pixel Fold leaks before jumping into the main topic which was all about using YouTube videos to train AI models. The discussion gets philosophical pretty quickly (obviously) and they they discus the new Canon cameras that were just released. Of course, we wrap it all up with trivia which needs your vote! So make sure to go vote on the community post over the YouTube channel. Enjoy!
Vote for trivia answer:
https://www.youtube.com/@Waveform/community
Links:
Android Authority Pixel Fold Leaks: https://bit.ly/3WdggQs
Verge Samsung AI Image generation: https://bit.ly/3WvGJtX
Proof News YouTube Piece: https://bit.ly/46sdmMx
Search Tool: https://bit.ly/4f3bzRT
Decoder Interview: https://bit.ly/3Lv79FJ
Peter McKinnon Video: https://bit.ly/3y1NnyC
Petapixel Mark 5 Mark II: https://bit.ly/3y1NnyC
Verge Canon R5 Mark II and R1: https://bit.ly/3Sdmajp
The Keyword Quiz: https://bit.ly/46a6SSe
Shop the merch:
https://shop.mkbhd.com
Shop products mentioned:
Canon EOS R5 Mark ii Camera: https://geni.us/psGErNA
Canon EOS R1 Camera: https://geni.us/cpGZ0
Socials:
Waveform: https://twitter.com/WVFRM
Waveform: https://www.threads.net/@waveformpodcast
Marques: https://www.threads.net/@mkbhd
Andrew: https://www.threads.net/@andrew_manganelli
David Imel: https://www.threads.net/@davidimel
Adam: https://www.threads.net/@parmesanpapi17
Ellis: https://twitter.com/EllisRovin
TikTok:
https://www.tiktok.com/@waveformpodcast
Join the Discord:
https://discord.gg/mkbhd
Music by 20syl:
https://bit.ly/2S53xlC
Waveform is part of the Vox Media Podcast Network.
Learn more about your ad choices. Visit podcastchoices.com/adchoices
