Best Of The Render Farm (Compilation)

6 Mar 2026 · 1 h 48 min · 42 chapters

Ask about this episode

Ask anything about it. ChatGPT or Claude reads this page and answers with the times it was said.

Connect VO and ask about every podcast you hear, including the moments you saved. Add to ChatGPT · Add to Claude

In short

The “Best Of The Render Farm” compilation is a discussion about building and powering a home render farm cheaply, plus related computer-hardware experiments (storage servers, water/immersion cooling ideas), and a string of failures/lessons learned. It also includes tangents about solar panels, power draw, and a “Glauber’s salt” phase-change cooling concept.

Guests

The episode is hosted by Bill Simmons and features recurring co-hosts/guests including Mark (Markiplier) and Wade. Another participant is mentioned as “Bob,” and a “Tugum4470” contributor is credited for server-hardware discount leads. No formal guest bios are provided in the transcript.

Guest backgrounds (from dialogue)

Mark is portrayed as a long-time DIY PC builder experimenting with storage, water cooling, and render workflows; Wade discusses server/storage setups (e.g., Synology, large storage); Bob is a jokester who proposes conspiracy/magical explanations; Tugum4470 is a source for discounted server parts (Shenzhen, China).

Key claims

Cheap render farms are possible because datacenter hardware is being dumped at large eBay discounts; businesses overcharge for workstation/server gear; immersion cooling uses dielectric fluid; Glauber’s salt can create a ~70°F phase-change cooling system; Dell support mishandled a suspected malware/boot-drive corruption incident.

Notable examples

Wade’s 400TB server; Mark’s 4090-based “garage render farm” plan; solar panels being “mopped”; five Dell refurbished PCs all failing with corrupted boot drives; custom water-cooling leak; a 4090 “one-slot” cooler that wasn’t actually one-slot; Glauber’s salt phase-change gel/pack idea.

Written by AI. May contain mistakes. Listen to the episode to check what was said.

Chapters

Tap a time to open that second in VO

Exploring New Hobbies

1:46 to 2:14

Discussion about the hosts' new expensive hobby related to building a render farm.

“So I have a new hobby, a new expensive hobby.”

Building a Server

2:14 to 2:40

Conversation about the infrastructure needed to build a render farm and storage solutions.

“That's not as exciting as you're trying to make it seem.”

Finding Deals on Hardware

2:40 to 4:06

Discussion on finding discounted server hardware and components for the render farm.

“Last night, I went to transfer some files.”

Setting Up a Render Farm

4:06 to 6:38

Insights on the best time to build a render farm and tips on acquiring hardware.

“I'm talking like 50 % plus discounts, right?”

The Challenges of Power Management

6:38 to 8:44

Discussing the power requirements and challenges of running multiple computers for the render farm.

“I had important business to take care of.”

Building Computers and Business Costs

8:44 to 14:00

Exploration of the cost differences between consumer and business-level hardware.

“You get me the best discounts on possibly good server hardware.”

Building a Computer and Price Discrepancies

14:00 to 15:22

Learn about the challenges and price differences in building computers versus buying prebuilt ones.

“but i got the wrong case size because you know it's been a while since i built a computer i used to always do it.”

Innovative Ideas for Gaming Spaces

15:22 to 16:22

Explore creative ideas for setting up gaming environments with advanced technology.

“And also all those computers are part of my render farm.”

The Fascinating World of Water Cooling

16:42 to 20:04

Understand the benefits and methods of water cooling in computer systems.

“No, no, maybe you'd actually appreciate it.”

Immersion Cooling Explained

20:04 to 22:08

Learn about immersion cooling technology and its applications in servers.

“No, you should wear like gloves and stuff.”
Show all 42 chapters

Creative Energy Generation Ideas

22:08 to 23:30

Discuss unconventional concepts for generating energy using water.

“on yourself because like your power washing on your roof and now you're getting liquid on your computer.”

Mystery of the Corrupted Boot Drives

24:27 to 28:00

Investigate the strange occurrence of multiple computers failing simultaneously.

“second half 2025 all rights reserved so i got a mystery this isn't the episode this is the this is just a random aside that i want to talk about so i i as you know i've bought some refurbished computers, right?”

Dell Customer Service Frustration

28:00 to 30:42

Hear a detailed account of a frustrating interaction with Dell's support team.

“something was wrong when I was being answered by the Dell social media team, which was a little strange, but I hoping that that's Dell customer service on the social media team.”

Theories on Computer Malfunctions

30:42 to 36:43

Exploring theories about potential security vulnerabilities affecting multiple systems.

“And look, it's like, I know what can they do?”

Innovative Cooling with Glauber's Salt

36:43 to 40:54

Discussion on using Glauber's salt for temperature regulation in computing systems.

“So I figured if I make enough of this shit and stuff my render farm full of it, it'll stay at 70 degrees because there's so much ice, but warm ice, Glauber's ice.”

Building a Custom Water-Cooled Computer

40:54 to 42:00

A narrative about the challenges faced while building a custom water-cooled system.

“It's a battery of coldness, but room temperature coldness.”

Building a Water-Cooled Computer

42:00 to 43:16

Learn about the challenges and surprises of setting up a custom water-cooled PC.

“I've never built a water cooled computer with a custom loop before, But I was like, hey, I went to engineering school.”

Lessons from Discount Parts

43:16 to 45:18

Discover the pitfalls of using cheap components and eBay purchases for PC builds.

“You know, now that I'm thinking about that, it should have been obvious, but I'd never built one before.”

Dual Processor Computers

45:18 to 47:58

Explore the excitement and challenges of building dual processor computers.

“The 4090 themselves are fairly expensive.”

Creating a Render Farm

47:58 to 53:02

Understand the process of setting up a render farm with GPUs and CPUs.

“one of which is right here, and I'm going to show you guys.”

Investing in Solar Panels for Power

53:02 to 56:01

Learn about the decision to purchase solar panels for powering the render farm.

“What are you going to render once it's all done?”

The Challenge of Refurbished Solar Panels

56:01 to 58:58

Learn about the challenges and humor in ordering and receiving large solar panels.

“I bought used dinner and it was terrible.”

Creative Small Talk and Render Farm Jokes

58:59 to 1:00:33

Discover humorous exchanges about small talk and the whimsical nature of rendering.

“You bought 10 kilograms of some unknown metal and I...”

The Intricacies of Building a Water-Cooled Render Farm

1:00:57 to 1:08:35

Explore the detailed process and challenges of setting up water cooling for a render farm.

“And I will continue to do so it doesn't make a goddamn bit of sense you open source bastards I hate it.”

Troubleshooting Server Performance Issues

1:08:36 to 1:10:00

Learn about the ongoing performance issues with a high-density server setup.

“So, you know, on the last episode, I was saying that my render farm is working.”

Performance Issues with Server Setup

1:10:00 to 1:11:40

Discussing ongoing performance problems with a specific server brand.

“into just setting up those parts of it with all the water cooling pieces in there, there's still a persistent performance problem.”

The Troubles of Server Maintenance

1:11:40 to 1:13:40

Exploring the challenges and frustrations of maintaining server hardware.

“Have you thought about talking to the server's manager?”

A Surprise with the Ford F-150 Lightning

1:13:40 to 1:15:10

Experiencing impressive power delivery and range with the new truck model.

“Whereas Gigabyte has a BIOS update that you can apply to the server as of earlier this year, which is after the processors actually launched.”

The Challenge of High Power Bills

1:15:10 to 1:17:00

Revealing the staggering costs associated with running a render farm.

“I want to see a Ford commercial with like a really nerdy dude driving his Ford lightning with the render farm.”

The Render Farm's Operational Realities

1:17:00 to 1:19:10

Sharing the struggles and humorous aspects of managing a render farm's power usage.

“just astronomically somehow it like comically goes off the paper you just look at it just like You're like, what the fuck?”

Server Setup and Performance Optimization

1:19:10 to 1:21:40

Discussing the technical details of optimizing server performance for a render farm.

“like the power efficiency of this cost over a period of time, the cost of this like computer going on eBay and finding random stuff.”

The Frustrations of IT Management

1:21:40 to 1:24:07

Conveying the challenges and frustrations encountered during IT setup and management.

“air conditioners that you've put in, it's able to breathe and circulate air better.”

Troubleshooting Server Issues

1:24:07 to 1:25:19

Learn about common frustrations with server setups and IT troubleshooting.

“I think it's probably because I didn't let go of the fixed IP on the previous device before I moved it over.”

Relatable IT Struggles

1:25:20 to 1:26:39

Explore relatable experiences with technology and home networking.

VLAN and Home Networks

1:26:40 to 1:27:44

Understand the complexities of VLANs and their implications on home networks.

“And like, but it's just me with like one light bulb being like, why won't you be blue?”

Creating a Render Farm

1:27:45 to 1:29:56

Discover the concept and benefits of a render farm in computing.

“Wade, I'm gonna make a 3D rendering of your basement, and I'm gonna show just poop water, just poof, and you just like, you know?”

Fiber Optic Networking

1:29:57 to 1:31:48

Learn about the installation and benefits of fiber optic networking.

“I am a man with ten garages of Render Farm.”

Render Farm Updates and Components

1:31:49 to 1:36:58

Get updates on render farm improvements and component choices.

“So I had another fiber line pulled and this one I was like I want 100 gigabit lines.”

Challenges with Professional Help

1:37:13 to 1:38:00

Discuss the difficulties of hiring professionals for server setups.

Building the Render Farm

1:38:00 to 1:41:44

Learn about the host's journey of building a render farm and the challenges faced.

Transitioning the Render Farm

1:41:44 to 1:43:11

Discover the reasons behind moving the render farm to a dedicated space and the implications.

“I feel like it's been, that's just a part of life.”

Balancing Work and Passion

1:43:11 to 1:44:15

Explore the intersection of hobbies and professional work in creative fields.

“And I'm selling some of it because with the current computer prices and RAM prices, don't give me that face weight.”
Hear the part that matters, and keep it.Open this episode in VO. Double tap your headphones to save a moment as you listen.
Get VO free

Transcript

Automatic transcript. May contain errors.

0:00Propel Fitness Water with Gatorade electrolytes, zero sugar, and vitamins. Propel hydrates better than water to help you get the most out of your workout and get back to your best self. What propels you? Propel with Gatorade Electrolytes.

0:34Coverage options are selected by the customer. Availability, amount of discounts and savings, and eligibility vary by state. This episode is brought to you by ChatGPT. Hey, it's Bill Simmons from the Bill Simmons Podcast. Have you guys heard about ChatGPT work? It's the new way to use ChatGPT for bigger multi-step projects. And when you need more than just answers, give ChatGPT work access to your apps and files, and it can create real work documents like spreadsheets, slides, and structured reports. Get started at chatgpt.com by selecting work mode available on Plus and Pro plans. This episode of Distractable is presented to you by T-Mobile 5G Home Internet.

1:16The folks over at T-Mobile have some big news for you. They now have the fastest 5G home internet according to the experts at UCLA Speed Test. So if you want the fastest 5G speeds with a five-year price guarantee, Visit t-mobile.com slash home internet to check availability. Price guarantee exclusions like taxes and fees apply. Fastest based on UCLA speed test. Intelligence data, second half 2025. All rights reserved. From eBay escapades to solar powered situations. It's time for best of the render farm. So I have a new hobby, a new expensive hobby. Yeah, we know about the lenses. No, no, no, no, no, no, no, no, no, no, no, no, no.

1:59You don't understand. All right. Who's our next guest going to be who like breaks a house trying to get you your thing? No, it's not like that at all. Is it mobile games? They can be expensive. They can be, but it's not mobile games. I want to build a render farm. That's not as exciting as you're trying to make it seem. Well, come on. I am personally. I do think that's interesting because I'm interested exactly at what the infrastructure for that is and how you set that. But like to normal people, that's an even tougher sell than lenses. I'm going to be honest. I'm going to be honest. Oh, come on.

2:30I'm going to let you cook here only because I filled up my Synology the other day. I've had it for, I don't know, 10 years. I've had it for a very long time. And it's got 30 terabytes of storage. Last night, I went to transfer some files. It's full up. Damn. So if you've got space for me, Mark, I'm in. Yeah. So I think, Wade, you'll like this because, you know, when I was doing that whole hard drive stint, which people forgot about when the lenses took over, but I was doing a hard drive thing there for a bit. Yeah. When you were thunderstruck, whatever it was called. Yes, exactly. Thunderbolt.

2:59So I built a server that has 400 terabytes of storage, right? Cause I was like, I'm going to future proof this. I had a whole hard drive kick. I got some refurbished hard drives. If there's one thing I love is that doing these hobbies and trying to find a good deal for them, even cause it's so expensive, a lot of these things. So I always try to find like the good deal for it. So I bought refurbished hard drives. And in every way, that's a big no, no, no, don't do that. But it just so happened in a specific situation that I did this, there was some cryptocurrency that was based on hard drives waste I talked about before, yada, yada, yada.

3:29But RenderFarm is different because it's extremely difficult to get server infrastructure at a cheap price, unless you just so happen to be in an era where everyone with a data center is replacing their hardware with this new fancy AI bullshit hardware and they're throwing everything out at incredible discounts and you can find the most amazing server hardware ever on eBay for steep discounts. Okay, how much is a steep discounted 400 terabyte? Oh, you're not gonna like this. I'm talking like 50 % plus discounts, right? How much is a 4090 right now right 49 couple grand isn't it 2200 bucks or something 40 90s right now is like two grand like around that it's still very expensive you can get some things with a 4090 in it an entire cpu rim like power supply motherboard case all this shit for 2400 so 400 more than the card and a 4090 in there 400 more than the card itself for the entire fucking computer with an nvm two terabyte NVMe.

4:43It's got 64. Look at that. Even my camera agrees. What the shit is, why is that happening? Why is there a thumbs up on your face? It's just so positive. You can get all that for$2 ,400. And that's, that's, that's still a lot of money, but you talk about getting the computer with a 4090 in it for that. Now here's the real kicker. That's just, keep talking. That's just domestic level computer hardware, right? At steep discounts. Cause now is a better time than ever in the history of forever to get a computer because there are so many companies that are trying to clear shit out to get this new shit in.

5:17What do I search for on eBay for this? Give me some keywords. What you want to look up on eBay is you want to find you want to find the specific server grade processor that you want, because what's happening is all these companies realize they need GPUs right now. So actually, GPU deals are hard to come by for work workstation level graphics, but you can still get good deals because people are still trading out computers. But you You can get like 64, 96, 128 core processors in their server chassis with like a terabyte of RAM. I don't even know what you would do with a terabyte of RAM for like 80 % off of the cost.

5:55And they are perfectly functional, very modern, like only a year or two old. But because every company in existence is trying to get rid of what they have and replace it with these bigger GPU based servers with like eight GPUs in them. You can get the craziest shit. You can get the craziest shit for so much less. There's processors out there that are like$12 ,000. You can get, you can get two of them. You can get two of them for like a 25 % of the price, which is a lot. I haven't bought these, but this is why I'm like, now is the greatest time in the history of forever to build a render farm. I want to see your half a million dollar server setup.

6:36You don't need to spend half a million dollars. What was I just telling you? I don't know. I had left. Oh, yeah. You weren't here. Where did you go? I had important business to take care of. I'm with you, Mark. I see what you're laying down. Yeah, you see what I'm laying down? You see? Well, so what? You're going to buy, well, you're going to lease space and just buy a bunch of secondhand servers and set up a render farm thing for cheap for people to use? No, just do it in my garage. If I have to lease space, that's going to cost more money. But if I do in my garage... Where's the car go? I don't.

7:04My car hasn't been in my garage for a year, man. Yeah. I mean, you know, he had movie set in there and stuff or whatever. Yeah. I have a whole set in there. But once that's gone, now that movie's done, I have space for everything. And I put air conditioning in there because filming in there in the summer was such a pain because it wasn't air conditioned. So I put an oversized air conditioner in my garage so I can have a server rack in my garage. I can't believe you filmed a whole movie in your garage. I didn't realize that. I picked up a lot of shots in my garage. I was basically talking about it for the past year, wasn't it?

7:33He did talk a lot about that. Yeah, I feel like. Oh, that's crazy. You know what, Mark? Points to someone. So I want to build a render farm. I want to get some sweet deals on some sweet computers and put them into my garage. And I'm sure that buying this shit off of eBay is definitely reliable. Well, so you're saying eBay, these companies aren't going out of business, but they still probably like offload these to just like wholesalers or something, right? Can you go to like in-person auctions where this stuff would be even cheaper? Probably for sure. I haven't scratched the surface of where these sales are.

8:08I've only really just started looking and finding like incredible deals. If anybody knows the secret ends of where to get this shit for the cheapest prices, put it on the subreddit. Let me know about it. I'm about to start a rendering revolution because online render services cost way too much. And if I can do it from home because I got solar panels, so I don't even need them. from the electricity, okay? Man, if we have a zombie apocalypse, you're gonna be able to film movies from your house. You're crazy. Mark's never gonna have to stop making content. Yeah, one can only hope. One can only hope.

8:42Anyway, that's my small talk. My latest hobby? Have I told you guys about it? Yes. Render farm? Oh, yeah, yeah, yeah. Render farm? Render farm? My main man, Tugum4470. You're the real. You're the real real. You get me the best discounts on possibly good server hardware. I'm sure they're all. I haven't even gotten it yet. I'm sure it's great. Where are they coming from? Shenzhen, China. Well, isn't that where all electronics come from? I feel like that's going into possibly prejudice territory, but keep going. Honestly, there's just like the manufacturing in Shenzhen is like every piece of technology.

9:16Where was the place where the glycine factory was? Medical grade glycine? Medical grade glycine. Did you hear about this? Of course not. It's me. on TikTok, there was a huge trend where there was this nonstop talk about medical grade glycine. And there was this one... What's glycine? I don't know. I don't know. And I don't know what it's for. Okay. I just know that medical grade glycine was very important. So there's certain things that you can do. And CG is like computer graphics. A lot of it comes down to rendering. But there's a whole world of art there that I know I'll never fully get. I won't be an expert at it.

9:52but at least the technology side is like, okay, for the sake of rendering, I can render and I can figure out how to do that. I can build a render farm, right? I know how to build a computer because I've done it before. I've done it for you. I look into it like a server can't be that different. And so this is where my brain goes. It goes from one to the other. I have a basis of knowledge. This is a problem that I'm facing. I think I can figure out, puzzle a way to a solution using my knowledge. You never have any like desire to do that? My knowledge is to socially outreach and find someone else who can solve my problem.

10:23I was going to go into the spiel of all the hardware that I've come back to and talking about that and talking about the latest thing that's going to make people so mad about me talking about it. I can't wait for people to be pissed off. Is it a render farm? I've heard that drink. You can't say that word in front of him. Render farm? Did render farms kill his family? Yeah, probably. I'm going to go with yes. You ever swallow and immediately know you did it wrong and you're fucked? Did you just do that unrelated to me saying the word render farm or was that? It was completely unrelated. I was just taking a sip and my body was like, I should breathe that.

10:59I've been building my render farm. I'm a render farm expert. I am an expert. You're still on about that. I've discovered the magic that is blown fuses again. So it turns out computers draw a lot of power. They, a lot of power. And so for those that aren't aware that even just running one computer all day long is an incredible draw of power. It's like running a microwave constantly. So one of the things that I'm looking into is getting power into my house, like figuring out the power system, trying to get like a better battery backup. But I was doing something yesterday that I was, okay, so I was up on my roof, right?

11:39And I realized how cosmically stupid what I was doing was. I climbed up on the roof and I called for Amy, Amy. And I was like, can you pass me the hose? So she throws me the hose. And there I am standing on my roof, watering my solar panels because they're dirty and encrusted with grime. But I just like, I just was like standing there and thinking about it as this like wonderful era that we live in with all this technology and able to just grab electricity out of the air with solar panels. And there I stand with a garden hose being like, so fix it. Got it. Well, if you want to grow your solar farm, you've got to water it.

12:16Yeah, that's true. That's true. It just felt so dumb. It was happening. But then I thought you were going to tell you were cleaning out your gutters or something. I was not expecting the twist of watering your solar panel. No, no, because I could understand like cleaning out the gutters. And what I should have done is I have a Ryobi power washer. And what's great about it is it has a hose attachment on it. But my hose isn't long enough. And I didn't have the battery charge. And I was just like, let me go see what they are. And they looked pretty crusty. Were you using the solar panel attachment for the hose?

12:44Shut up. You know, they actually make a Ryobi solar panel cleaner. It's basically the same as a power washer, but it's designed to work way better on solar panels. Yeah, because that stuff is crusty because I got done. I wash it off and I, you know, I felt like I was playing power wash simulator because I didn't have enough pressure because I had one of those little handles. But, you know, at the distance, the wind alone was beating me. So I got done. Everything was wet and I thought I washed it thoroughly. I saw some gunk run off. And by the time I got to the end, I went back to the beginning and the beginning was dry.

13:13It was just as dusty. It was like super, like just as crusted over. Couldn't see a single cell. I'm like, damn it. So I bought, Amy bought a big mop with a big handle. So today when I come in, I'm going to mop my solar panels. If people out there want to know what the celebrity lifestyle is like, it is mopping your solar panels on your roof. so yeah that's what i get to look forward to um and so i i'm i'm realizing that with all of this uh computer power that man i uh i um yeah things are going good things are going real good i have all the parts assembled there but i realized that i got the wrong uh case for it because i'm not building a server rack i'm basically just building a few computers for for my houdini render farm um but i got the wrong case size because you know it's been a while since i built a computer i used to always do it.

14:05And then I kind of fell into people doing the custom water cooling solutions because I was like, I don't really want to fiddle with all of that. So I'd rather get it from a company that's going to do it. But for these, for these things, like the prices are so stupid for like business level stuff. That's why businesses don't make any sense. I don't know how businesses ever make money when they pay like business prices for things. Cause you got like home internet, you pay home internet and it can be like up to a hundred dollars for good internet. And that's that's pricey. A business Internet line starts in the thousands.

14:34And I'm like, wait a minute, where does this jump occur? Why? Why is this? But that's just what businesses pay for. They just do that. And other people charge businesses like these exorbitant rates. And it's like it doesn't make any sense because the price of these these big workstation computers from a from a prebuilt manufacturer, like there's a markup for prebuilt computers for consumer level hardware. what should be like a$10 ,000 computer if you bought all the parts in a very good computer someone will mark up up to$50 ,000 for for the entire thing to be assembled if you look at some of the higher end workstations it doesn't make any sense so I'm building it myself again because I've done that before and it's not much different but I got the wrong case because it's an SS it's SSI-EEB motherboard not an EATX motherboard and even though the case says it's ETX and the The motherboard I bought was listed as ATX.

15:24Have you tried the EAT-ASS motherboard? But what if we had in our movie theater, we had a LAN area, we had little pods where people could do, like if they wanted to record YouTube videos or stream or something, we had little rooms segmented off where there was like one computer with a camera already set up and a light already set up. And also all those computers are part of my render farm. Yes. And we can farm Bitcoin while they play. No, no. No, that's not, you can't do it on normal hardware. That's not an efficient way to get Bitcoin. Not with that attitude. Oh, that's why you're the handsome one.

16:00Ah, so you want to get me Bitcoin. You just don't know it. Maybe, I don't know. I don't know what to believe anymore with you. But right, isn't that a great idea? It's the best idea. No, well, I mean, I do have little things that I've been working on, but you know, I don't want to bog anyone down with my really cool ideas and things. Is it lenses and or render farm? Propel Fitness Water with Gatorade electrolytes, zero sugar, and vitamins. Propel hydrates better than water to help you get the most out of your workout and get back to your best self. What propels you? Propel with Gatorade electrolytes.

16:37No.

16:42No, no, maybe you'd actually appreciate it. Maybe I'd actually appreciate it because it's only adjacent to it. I'm trying to get back into water cooling. so when you're building a computer and this this applies to people out there you have you can have the option of water cooling components and it's kind of like a it's a higher level way of building a computer but it can yield like a lot better results than just air cooling because if you have a bunch of fans in your computer the computer that i built for you was air cooled you know um it wasn't water cooled there was just like a big old air cooler on it i think unless i did put it know probably had an AIO didn't it I that one with the thread ripper was the last one that I built there oh maybe not no maybe not yeah I have no idea but either way I've been getting into water cooling again because there's a lot of really funky new developments in the world of water cooling and I've really wanted to try immersion cooling have you guys heard of this I have actually no so immersion cooling is literally what it sounds like you take your whole computer and you stick it in a liquid you go and that's okay for it that's okay for it's so good for it actually it has to be the right kind of liquid yeah yeah yeah it can't just be spit or piss or something like that yeah um so you you get a special fluid that's called dielectric fluid it's non-conductive so that when it's in there it's not gonna like zap because the thing is water pure water is actually not very conductive it's the impurities in water that cause it to become conductive and that can cause it to short out and then it'll go kabloom.

18:09So you need a pure whatever this fluid is. You can't have like dust getting in it or anything like that. It takes some cleaning required and there's some extra things. But the way you can do is you can take your whole computer really dense, like get the density way up and stick it in a vat of fluid and it'll circulate the fluid and it'll cool all the components in it, right? Do you run the computer while it's in there? Yeah. Okay, go on, expound. So it's dielectric, right? So the fluid is entirely non-conductive so all of your your plugs and stuff in the computer you power plug it's in there you know it's it's powered it's got all the peripherals in there this is usually for data centers and stuff like that but there are people that you know their home computer they basically get a fish tank right and they just put their whole they build their whole motherboard and stuff inside the fish tank and then they fill it up with this fluid and you'll see it it's pretty cool i can actually pull up like uh because i'm picturing like your tower you just shove it in a kiddie pool and then all the wires and stuff it's like does it just like bend up to come out of the tank or they're like how do you turn it on if it's in the tank how do you keep it from getting impure it's real tricky but this is it okay so like the tank is also the tower it's not the tower in a tank the tank is also the tower so this one's trickier i think this one is at a higher risk of problems because the top is open right so you see the cables going into the top the back of the motherboard is at the top of this fish tank that's in front of everyone and so the plugs go in the top now the problem with this is dust and impurities can get into the fluid this way.

19:34It's not sealed off. Ideally, you want something that's more sealed. And the other issue here is there's probably not as much circulation. I think this is, it's, uh, it's just more of a kind of a funny build that actually looks like a fish tank. But in industrial applications, you put your entire server rack inside this fluid. You can get the density up. You just need it to circulate things. And it's It's weird. It's super weird to look at. Your mind goes like, that's not right, but it works. It works and it works well. It cools things really efficiently. How pure are the rocks in the fruity pebble?

20:06Oh essential essential for that. Yeah You want your 90s ass color scheme glow-in-the-dark rocks at the bottom so that you can really get all the gaming juice out of your components Yeah, so I'm looking into this and I'm probably going to break some things. For a computer or for a server size stuff for server size stuff but the problem is you know everything server size takes a premium so i'm trying to like see if i if i just get a big enough you know horse drinking trough if i do that how annoying is this to change out like let's say a part fails you have to replace a part pull it out you shake it off a bit i mean it's about as annoying as like you can imagine it is it's it's literally dunked in a fluid that's probably slightly toxic but like Can you put your impure fingers in this liquid to replace the whole liquid?

20:56No, you should wear like gloves and stuff. Ideally, you know, you're doing this in a very professional way, but you know, I'm not the most professional person. I mean, they make like filtration systems. There must be a type of filtration that you could use to filter your dielectric juice. Is it expensive? Is dielectric liquid, water, whatever? Because it's a special thing, right? You don't really buy it in 50 gallon barrels. you buy it in you know smaller containers than that you know like paint where they have that special paint that's so dark it's like only 0.1 reflectivity sure that is very expensive but you can get black paint that is like two percent reflectivity still extremely dark for way cheaper than that right it's the same with these fluids some people have proprietary fluids that are crazy expensive that they have patents on and they sell because it's that much better at non-conductiveness or non-cooling or cooling capacity or stuff like that.

21:48And so these companies want to sell them at premiums, but you can get, there is dielectric fluid that you can get that will not be as expensive. That's so cool. So if everything blows up, a lot of my things seem to like have a risk, high risk of electrocution and explosions, but that's how you know you're really, really starting to get somewhere. You're also starting to push your drowned man saga on yourself because like your power washing on your roof and now you're getting liquid on your computer. You're starting to really toy with liquid. And as someone who deals with liquid, it's a dangerous game.

22:21I had a crazy idea to what if I pumped air through my pool? You know, because I thought Linus, you know, when he did his pool cooling for his whole server where he ran tubes, his problem was that he did liquid cooling underneath the pool. I'm like, what if you just pump air through the pool and then blow that air in and you got a cheap air conditioner, right? Yeah. Yeah. Yeah. Sure. Yeah. Yeah. Is there a, okay, perpetual energy idea. Not perpetual energy. What if, is there a way that you, you know how your water is pressurized, right? So you got water. What if, what if I have my water pipe, I build an illegal extension to go up really high, pour onto a giant water wheel that's going to generate electricity.

23:02But at the bottom of it, I just have it pump back into the pipe where it came out of. That way the water company never knows. They never know. Yeah. No, they have, they don't have anything for that. They have no idea. That's how it works, right? I just have the open pipe at the bottom. It just funnels right back in. It would work. I just put the negative pressure terminal. Yeah, I just put it in reverse. Yeah. Like, I have some questions about it, but I'm just going to not ask them and assume you're correct. This episode is brought to you by T-Mobile 5G Home Internet. You already know that T-Mobile 5G Home Internet is ridiculously easy to set up with a price that doesn't feel like you're getting scammed every month.

23:41But here's something new worth noting. T-Mobile now has the fastest 5G home internet, according to the experts at Ookla Speed Test. No, seriously. Their 5G home internet speeds are officially the fastest, which means that when you're downloading all your movies that aren't mine, every single one except for mine, you'll get them at the fastest speeds possible, along with all your video calls and uploading files and maybe even streaming something in the background, you know. And yeah, it is still a great value. backed by a five-year price guarantee so your bill doesn't slowly creep up when you're not paying attention so if you want the fastest 5g home internet with a simple setup and savings that actually stick head over to t-mobile.com home internet to check availability today price guarantee exclusions like taxes and fees apply fastest based on speed test intelligence data second half 2025 all rights reserved so i got a mystery this isn't the episode this is the this is just a random aside that i want to talk about so i i as you know i've bought some refurbished computers, right?

24:40From Dell. And I had them running. I was running, you know, a little render farm. And I've been doing small scale experiments with these computers as I try to build up what I'm going to do. So I had five computers running and for weeks now they've been running fine. They've been working perfectly. I've actually done some experimentation with underclocking, you know, or undervolting the graphics cards, yada, yada. It doesn't matter. Two nights ago or yesterday morning, rather, I woke up all five computers that I had running were offline, all five of them. And I'm like, well, that's strange. Not a one of them.

25:07I load up each one of them. I load up the first one and I discover, oh, the boot drive is corrupted. It cannot boot. Can't boot Windows. It does. It's self-diagnostic. All the hardware is fine. It can't boot Windows. Can't boot at all. It can't even find the boot drive. So I load up the next one. Two of five. Same thing. Boot drive corrupted. And here's the thing. I don't know if me even talking about this is painting a big target on my back. Oh, it definitely is. But I'm going to keep talking about it because it's just fascinating. All offline at this point. Third one, same deal. Same exact problem.

25:37Boot drive corrupted. Fourth one, boot drive corrupted. Fifth one, boot drive is corrupted. What time was this that you found this? I don't know what time they all went offline because I couldn't find any logs or anything like that. I didn't have anything robust to set them up. These were just render notes. They didn't have anything on them. They were just running two pieces of software, basically, is all they were running. So they were technically connected to the internet. I didn't even have monitors connected to them. So I had, you know, I was remoting into them just to even get there. but I had to like, I have a little like clamshell KVM so I can plug into them and see what's going on.

Read the full transcript

26:08And I'm like, that's super weird. What are the odds that five computers in different parts of my house, all running the same software, but also other computers in my house were running this software as well. All of the, only the Dell ones shut down and got corrupted. Can I pause a positive theory here? Yeah. What's up? Okay. Do you remember the story we just told the bird and the chipmunk wizard theory? Okay. What did we talk about yesterday on this podcast? We were recording, talked about adele and boots go on and now your adels won't boots oh okay i'm just saying put the tinfoil hats on because uh what day did that issue occur oh yeah during the adele boots day bob gave one hint all day you know that it was boots whoa whoa that imply that this is my fault somehow remember that song never mind i will find a render farm like you, Adele.

26:59All right. So this is very strange, right? So I contact Dell customer service and I've got a, I've got a customer service gripe to pick because all right, clearly this isn't normal, right? No, that's pretty weird. It's very strange. My only guess is that it was some type of malware that somehow got into the computers. And again, this is like maybe painting a big target on my back. I have no idea. But something got into the computers and corrupted the boot drive. It's very easy to cause these things to become unstable if you like delete system 32 or something like that. You can basically render a whole computer by doing that and it would just cause a bunch of problems.

27:43It wouldn't it would not be able to boot anymore. It wouldn't be able to repair itself. I'm not saying doing that would do that. But you know, a lot of things can be done. That just doesn't have a lot of value to the malicious party other than fucking your shit up, I guess. Yeah, I have no idea either. So I reach out to like Dell customer service and I knew something was wrong when I was being answered by the Dell social media team, which was a little strange, but I hoping that that's Dell customer service on the social media team. And I go through this all day. I'm like, this is weird, right?

28:12Can you help me find, figure out why this is happening? I was like, okay, let's troubleshoot it. So they run me around for hours and hours doing all these troubleshooting tasks that I keep saying like, yeah, I've done the basics. I've done your diagnostics. There's nothing wrong with the hardware. And then it goes on and on. They keep leading them on. Like, you're going to find out why this happened, right? Like, no, let's just do the next step. You're going to find out why this happens, right? Let's just do the next step. You're going to find out why that happens, right? All right. Create a thumb drive with a Windows installation on it.

28:35And I'm thinking in my head, I'm doing anything to not do this because if I format that drive, any evidence that of what happened on that computer is going to be erased or become much harder to find if I do a fresh install of Windows on it. And I keep asking them like this and they're like please just do the next step we are going through this this is the process we need to get i'm like okay and so i reinstall it do that and then i tell them like okay i'm in windows now what and they're like great let us know if there's any problem keep an eye on it have a good day and i'm like you motherfuckers you sons of bitches you had no intention of finding out what went wrong with it at all i was like just take this computer back and look at have have There's such a thing as computer forensics.

29:17You can look into the hard drive and find out some logs. You can dig in there and you can, but they had no desire to do any of that. They were never going to do it. And they strung me along the entire time. Did you do all five or did you say, do you have any that are still? No, I only did one. Okay. I only did one because I have all five with the same problem, but they would not admit. They would not admit that five going offline for the same reason, all independently of each other, wasn't weird. Right? And they kept thinking like, it's just like a random software corruption. I'm like, you gotta be kidding me.

29:49The odds of random software corruption occurring across five machines at the same time is statistically most likely improbable or not impossible. Nothing's impossible, but whatever. It seems much more likely that this is some kind of security vulnerability that was exploited or something like that. And it's only these. It's my other computers are fine. Only these. What's up with that? It was kind of brilliant. Now they've got you as a complicit party in covering up the evidence. If you do get a forensics specialist, they're going to see that you covered up one of the five. What crime is being?

30:26I don't know, man, but it's pretty bad if Dell's getting you involved in the cover up. You're right. And they got the social media team involved. So that way, the moment you try to say anything, they're like, they've already got the posts ready. Markiplier covers up corruption at Dell. You're right. Inside job. That's it. That's it. That's the one. That's it. And look, it's like, I know what can they do? All I wanted was them to just escalate it to the next level of being like, yeah, this is weird enough. Maybe you should look into this. It's probably nothing. It's probably something like as I was running them, like it was some port was not forwarded correctly in the computers.

30:59It allowed someone to get in or a virus to get in. I'm not saying this was like a specific attack. It just seems like this is malware riding across the software for the render farm thing that I was using that allowed like some piece of malware to get in, deleted a system thing. and boop, all the things go. It's more likely that that happened, but it's also worth exploring. I can't use these computers if that's possible. That was my point to them is like, I can't rely on these to do what I need them to do if there is something like that in them. I don't think it's the software I'm using because I'm using it across my other computers, but maybe again, it might be.

31:33I mean, it might be like a driver compatibility where it's the software and some specific thing in the Dell machines and they all have it because they're all the same machine or something. Yeah, exactly. No, it's weird to corrupt the boot disc like that is like not what would normally happen is they would just blue screen and then you could you could get it to post and maybe you would continue to have an issue. You have to do drivers or reinstall or whatever. But like, yeah, I'm not an expert. But as far as I know, that's a much weirder outcome. Yes. Yeah. That's not something where it's like whoopsie doodles.

32:01And then your whole boot drive is just corrupted. That's a different kind of issue. It's very strict. You guys are basing too much stuff on facts here. I think Bob's earlier theory about the wizard chipmunk. He's trying to get his revenge because you caught him like practicing his bird, which wasn't perfect. So he was like half chipmunk. And then he fully went chipmunk and he's like, fine, I just won't even be a bird. Fuck this guy. It is strange. And then he followed you home as a chipmunk and attacked your computers to get back at you. I did think I was almost positive that when I first saw that bird, it was a chipmunk first.

32:29That's what I saw in my mind. I might've seen a shape-shifting chipmunk. I think Bob was originally right. Just a glitch in the matrix. Here, let me give you, let me give you a Wade solution. here. Hang on. Okay, I'm ready. All right, Mark, I know how to solve this problem. It's not the Dell computers themselves. What you need is a Costco-sized jug of lighter fluid and then a lighter to light the lighter fluid. And then what you do is you take all of your computers and you set them in a smaller area, small enough where you could draw a circle on the ground around them in lighter fluid. And you want to use like the whole bottle, like as much as you can.

33:00You might need multiple bottles. I don't even know. But you basically want all of the wires, all of the networking stuff, all of the computers, all inside this circle. And before you turn them on to do anything, you light the lighter fluid. So you've got a wall of fire around all of your computers. Those are important to protect you. I know this about technology. The firewall will keep you safe, Mark. I've heard of this mythical firewall. I've got an alternate. Okay. Wizards are sometimes like the male equivalent of witches. And we know from even dating back to like the 1940s or even earlier, witches don't like water so if you pour water on each machine you'll melt the witch out of them oh oh okay i have a pool can i just throw them in the pool yeah in theory yeah okay all right cool no you know what mark you were telling us about how you wanted to do water computers in water right you were talking about that we talked about that what you do is because you said the water needed to be a special kind it needed to be thick or something get a bunch of the leftover thicket that you have from redacted get a get a bathtub filled with thick water and then just submerge all the computers in there that'll melt the witch out and keep it out plus then they'll be real cool because of what you were saying about water cooling yeah you you listened or get a snake big enough to eat a chipmunk or a small bird because clearly it's the only thing the wizard can turn into release a snake into each computer so that way if the wizard comes back it's ready to be gobbled up.

34:26That's good defense. That's great. If you could find a species of snake that can survive underwater, you could combine some of these solutions. That's true, too. If you can find a fire that can burn underwater... Are you jotting these down for later? Yeah, yeah. I'm really keeping track of everything that we're doing today. I appreciate that. Well, I really appreciate you guys helping me out, and I appreciate being able to write about something else. Someone out there is like, oh my god, Mark is under attack. I need to get him a message. It's totally happening. Yeah, yeah, definitely. Anyway, Glauber's Salt.

34:58G-L-A-U-B-E-R apostrophe S. Glauber's Salt, remember the name. It's going to change the world. How so? Well, that's what for us to discuss. Just chucking it out there. Glauber's Salt. I feel like generating heat is not as much of an issue in the world as dissipating heat and avoiding excess heat generation is. Yes, yes, go on, go on. Well, this doesn't seem to, well, is Glauber salt used in like heat exchangers or something? Like, what are we talking about? Like, is this? Almost, almost. So here's the thing. You boil water, you put your Glauber salt in it, and that mixture alone creates a concoction that would freeze at 90 degrees Fahrenheit.

35:39That's scientifically true, but that doesn't mean it's cold. Now, now, here's the thing. If you add regular table salt to your mixture, you will lower the freezing point of that mixture. Same way as if you put salt on ice, it'll start to melt because the freezing point is now lower than what it should be. If you put a certain ratio into it, I don't remember it off the top of my head, you can create a mixture that will freeze at 70 degrees Fahrenheit. Exactly what most people might consider room temperature. And if you put xanthan gum, it'll turn into a gel so that it's easier to, you know, handle than just like pure liquid.

36:17And then you have a gel, like a gel pack that'll freeze at 70 degrees. And what that takes advantage of is the fact that phase change, it's called a phase change material. It takes so much more energy to get it to change its phase than it does to get it moving a degree. So it'll stay at 70 degrees way longer. And all this circles back to the concept of my render farm. So I figured if I make enough of this shit and stuff my render farm full of it, it'll stay at 70 degrees because there's so much ice, but warm ice, Glauber's ice. So I don't know enough about thermodynamics to like really contribute to this, but what you're saying sounds right.

37:05So basically what you're saying is you would put all this stuff where the phase change point is right about 70 degrees. it would constantly be in and out of phase like it would be kind of part liquid part frozen because the the racks would generate heat so they would heat but then the phase change of all the glauber salt solution goop it would extract but they're but glauber salt is still still a poor thermoconductor right so would it really when mixed with water it becomes as good of a thermoconductor as water is So here's the thing, right? The weird thing about 70 degree phase change material is if you think of the world we live in, at night it usually gets below 70 degrees.

37:49In a lot of places. Even in the desert, it can get down because the sun is not shining and it's cold. It will freeze overnight if it's in an environment where it can for free. Anyway, Glauber's salt is cheap. So the thing is, if I get an industrial cook thing pot, an industrial boiler pot. I mean, an industrial boiler probably implies that it's a very large pot for boiling stuff. I don't know. Hey, Siri, what's a kitchen? So, Mark, if Glauber salt is such a magical, cheap material that is so simple to implement, why hasn't anyone else done this? Well, I don't know. That's fair. I don't know what it is about it.

38:30But ever since I heard about Glauber salt, I can't stop thinking about it. And it's not even that it's the Glauber salt, really. It's like, I don't know if there's a name for the mixture of what it is afterwards, but that's science. Like, you can do the science. I just need to figure out a way to make a 422 kilograms of it. I think the thing for me that I'm sticking on is the point is not, I'm with you, that it freezes at such a high temperature that basically freezes for free. But then it's a solid, right? Yeah. Or it's a goop anyway. the way water the way water cooling works is the heat is not dissipated just because water absorbs heat it's dissipated because water absorbs heat and then is cycled away from the electronics yeah but that's not what i'm doing if i put it in the room and then put a fan on it and blow the air but you're but but heat heat saturation is a thing the whole the whole thing will if you don't shut down server farms overnight do you part of the point is they sort of run 24 7 is there a downtime it'll be fun it'll be fine are these like you change out the glauber salt packs or something with no no that'd be too heavy no so mark what if you make your glauber salt solution your high high freezing point solution with mineral oil and then you submerge your stuff in a glauber salt mineral oil tank so that then you don't have to cycle it the phase change occurs and as the heat builds up, the phase changes out, but then it cut like it freezes.

39:54It's like an expanding, contracting water cooling rig. I love that. And I think that's incredible. However, I feel like it would mess up with the freezing point if it was mixed in mineral oil. Yeah, I have no idea what the freezing point of mineral oil actually is. I don't know how that's different. I know it's not water. So what I was going to do is I'm going to make an evaporative cooler. So I'm going to McMaster car and I'm going to buy a bunch of duct work and I'm going to get some ventilation fans and it's going to build a little evaporative cooler and the cool air from there is going to blow over the Glauber salt mixture and I'm going to have a heat exchanger inside there that's going to be like basically encapsulated by all of the Glauber salt mixture and then some working fluid running through that going to another heat exchanger inside the the render farm room and a fan on that blasting all of that delicious cold free air conditioning baby well not free it costs a lot to build it and all that stuff yeah so it's it's essentially a normal water cooling setup with extra stuff that's definitely gonna go wrong it's glauber salt it's glauber salt you gotta have faith in the glauber are you getting custom like heat sink blocks for all each of your little chip sets and cards and things or are you just sort of setting it near it no i'm not you know you keep thinking about a slather my electronics in glauber salt no it's air it's just air okay it's just air circulation you're just using the salt solution to cool the air to a crisp it's out it's a cold battery.

41:18It's a battery of coldness, but room temperature coldness. How is small for you guys? How's it been? You know how it be every day. Another failure. Every day I rise, grind, fall flat on my ass. This render farm is never happening. I swear to God, everything I've tried, I fuck you not. It is not going good. I thought I knew computers. I've assembled three different computers. Let me just say, don't buy cheap shit on eBay. Half of it doesn't fucking work. You don't have any support. You don't have any backup. You can't return it because it's coming from a city I can't even pronounce. And then the latest adventure was in my adventures with water cooling, right?

42:04I've never built a water cooled computer with a custom loop before, But I was like, hey, I went to engineering school. I can do this. And I set up everything. I made sure that I actually got parts that I could verify, like accounts still on eBay, still discounted. But there was like someone I could communicate with and I got parts. And then I sourced all of my water cooling stuff from a company that's actually here in LA who was very helpful. I asked for a lot of advice and they gave me guidance and I put it all together and I turned it on and I started filling the reservoir with liquid. and I go through two bottles and I'm like, wow, the guy only said I need one.

42:41This is a thirsty machine. And when I get through the second bottle, this pump just keeps chugging this liquid. I'm like, damn, it's going. And then I finally notice it's a clear liquid. So I know it's so dense with components that I didn't notice the entire bottom of the case is swimming in the fluid. And somewhere in the loop, there was a catastrophic leak and it was just gushing. So it would go through the pump. Did it ever occur to you that at no point did it start coming in the return to the reservoir? You know, now that I'm thinking about that, it should have been obvious, but I'd never built one before.

43:25So I was like, wow, this is crazy. So you doubled the amount it recommended. You were just, man, this is thirsty. That was your thought. I don't know. The server right now, I took all the electrical components out of it besides the power supply. I just so happened to grab the power supply that makes a clicking sound with the fan. Like, I don't know what kind of trailer all of my shit fell off of that I bought. Don't buy discount shit on eBay. It's not worth it. It's not going to be worth it. It won't. It's so many nightmares. I've wasted so much money. I should just trust this company because holy shit.

44:05I just gave you points for the drowned farm. Also for listeners out there, he pointed to a shirt that says Steiger Dynamics. Yeah, Steiger Dynamics. Oh, you like the listeners now. And what sucks also is like, I've been doing this. I run into all these little problems. So this is actually a 4090. He's holding a 4090. it's a 4090 graphics card that i have unmounted from its previous cooler and put this nice thin one slot cooler right it's one slot that's what it's it says there's only one it'll it's a little wide it's no it's one slot this son of a bitch is not one slot by two millimeters It was all, everyone said this was a one slot cooler.

44:54The company that made it then came out with another for this exact board, the reference board that this is a more expensive one that is actually one slot. And I contacted them and I said, Hey, is this available? And they said, yes, but you have to order a minimum of a hundred. Jesus Christ. A hundred? I said, I didn't respond. I haven't responded. How expensive are these? If I may ask. The 4090 themselves are fairly expensive. So this is... I mean, the one slot one. The one slot thing I got for this thing was 100 and I believe 60 plus tax and something like that. So 160 bucks for the cooling block itself.

45:35But if you know a 4090, it goes from a three slot card down to one. And I was like that. Which would be awesome. It would be awesome if it fucking did the thing that it said... Well, if you buy 100 of them, it will. You're right. I sure will. The solution is to buy more stuff, Mark. Then the new stuff you buy will work probably. And if it doesn't, then you could just go buy other new stuff and that'll be the stuff that works. And it's like all of this is an attempt to save money. Everything I've done is an attempt to save money. I have lost so much money. Well, I haven't lost it, right? Because I could sell this again and that's fine.

46:16It's just work to do that. The other computers that all crashed at once. Dell also extremely unhelpful. And then the episode that where I talked about came out, suddenly they wanted to help so badly. And I'm just like, hmm, interesting. Whatever, guys. Hey, you can't have eggs without breaking a few eggs. Yeah, so I can technically sell this. And this is still useful to people. It's still useful to me. Like, it's still like, OK, you can put this in a loop. This still works fine. Yeah, that's a normal 4090, right? That's not like a like a workstation one or something weird where it won't won't do video games or normal computer shit.

46:51Perfectly normal 4090. And actually, I could probably sell it for more than I paid for it because I've modified it in a way that's valuable. Yeah, with the water block, that's actually pretty sweet. But just so you know, anybody, if I sell it, it's not one slot. Only if your slots two millimeters too thin, like Mark slots. Right. Why don't you get girthier slots? Maybe you got the wrong slots, Mark. Why don't you just increase the gap a little bit? I'll just stretch my motherboard out a little. I don't really have a story to tell other than we're so back, baby. Buying random computer parts off of eBay is the successful way to do everything.

47:28You know how I said that it wasn't? It is. We're back in. Oh, shit. We're so back. We're so back because I have not had one success. Wait, that sounds bad. I have had not just one success. I have not had one success. Not a single goddamn success. Oh, I've not had a single. I've had a double. I have now two functioning dual processor computers that I built myself, one of which is right here, and I'm going to show you guys. I'm so excited for this. Jesus Christ. What the fuck? What the fuck? What happened? Oh, my God. God. This is one of them. Jesus Christ. That's enormous. They're so portable. Mark is lifting up a very large looking computer for the listeners.

48:21It looks like he stuffed a wig inside. Oh, wow. That's that's one of them. That's large. That slides into our server rack of some port. Yeah, so it's a server case. It doesn't seem to be plugged into anything. How do you know it works? I plugged it in before. I just don't have it on right now because in this room, if I have both it and this computer on it'll blow a circuit oh fun how many how many did you build total so far two uh this one is dual processors that i got off ebay are those like xenon processors or whatever like server ones yeah so these are they're actually these ones uh right here so these oh i got these for like less than 10 of the price of what they retail for i don't know how and i don't care well just wait two weeks when they stop working no no didn't you build like five of these and you had to send them to stigion i'm sorry what to look at them you were like help me are you trying to say steiger dynamics our favorite computer uh company god fucking damn it dude i hate words yeah that's it didn't they didn't they help yeah they're helping okay so is this a separate computer one of the ones they looked at this is a separate one yeah so we're working in tandem.

49:31I'm just trying to follow the timeline. Yeah. So what I, what else I did that the second one, I have an eight GPU server out in my, uh, storage. There was no way that I could fit eight 40 nineties unless I change the cooling block. Right. So what I've been doing is I've been putting these water cooling blocks on them. The ones that were like two millimeters too thick or whatever it was. Yeah. Those are too thick, but that's not, it's not too thick for that one. water cooling that whole thing would take a whole thing so what i realized is the actual 4090 i have if you take off the fan off the top of it the actual radiator is less than two slots there's no fans on it but it's less than two slots there are these stands on the sides of it that go up past two slots all i gotta do is cut those off i take some scissors and i'm like it must be plastic not plastic metal grab a dremel put the metal cutting head on it metal dust everywhere all in the electronic components.

50:26That's really good for electronics. Yeah. Airbrush blast it out. First one done. Not going to do that again for the seven others. Go to Home Depot, grab tin snips. Cause I'm like, I bet they're aluminum, not aluminum, steel. So you squeeze really hard with the tin snips and you bend it back and forth. It'll break eventually. Then you got these real jagged scrapey posts on the edge of your GPU. Oh, so sharp. So razor sharp. Like after it would break off, it wouldn't break off like it would limply fall over. It would go and they would go flying in a random direction. It was crazy. So seven of those went by and I fit eight GPUs into this server.

51:11And at this point, I decided to Google if I was doing this right. Nope. I tried to calculate the thermal capacity of these cards if they were just purely passively cooled, what the airflow would need. And then I couldn't find an answer. So I said, I bet it'll be good enough. And I turned the server on. And it worked. It fucking worked. I was watching the temperatures. So long as I kept the power of the cards individually, you can limit the power. They're normally 450 watt a card, which at eight cards is about 3 ,600 watts or 3.6 kilowatts. But if you limit the power to a reasonable level, like 33 % of what it should be, it works.

51:53Oh, that's fine. You don't need to use all the power. Why not just use three cards at full power? No, the only reason that I have a 33 right now is because it'll blow a fuse. But the reason with 4090, that math weighed, a lot of people on my member mixer pointed out, it doesn't math because the 4090 is already an overpowered card. So at 450 watts, it's actually not as efficient as it could be. If you lower it, and there's tech YouTubers that have done analysis of this, you can lower the power target to 60 % and only lose 10 to 15 % of performance. So you gain a huge power saving up to 33 % for about 10 to 15 % performance loss, which is great.

52:35It's actually phenomenal. And it's because the 4090 was overpowered. They put the power target so high. It's like it's already overclocked as the design comes in. But if you bring it down, you'll get barely a dip in performance. If you're gaming, it would be imperceptible. If you're doing rendering tasks, it's the matter of like a few seconds, like longer. And you can make it work. And I'm making it work. The render farm is happening. Yay. What are you going to render once it's all done? What are you making? my movie stuff like balls and water and stuff i'm gonna make the greatest most high fidelity 3d porn the world has ever seen yes yes i might still have the computer tower that has what was that game yiffalicious on it somewhere if you want it back don't say that publicly oh i mean what's porn is that jake gyllenhaal's new movie well congrats on your functional render farm how many how many more are you gonna make like how many how big will this get so they steiger dynamics is working on six computers uh that have are gonna be like the base render nodes i've actually been talking to the people at houdini uh so that they uh they can know how best to set this up steiger dynamics can know how best to set this up in terms of networking but i've also been working with them because I'm trying to get more CPU power.

54:01CPU power is like the thing for fluid simulations. The GPUs are great for rendering the actual final images, but the CPUs are necessary for any kind of physics simulation stuff. There might be a time in the future where that's not true, but right now you can get CPUs a lot cheaper than anything else because of the way that it's structured for simulations right now and because everyone's crazy for GPUs right now. So that's why the professional level GPUs that actually fit in those cases are way too expensive. So if I can fit a 4090, oh, the back of the server can't close because the 49s are too tall.

54:36It looks real jank, but it works. That just includes airflow, I'm pretty sure. It sure doesn't, especially when you got only passively cool cards. But I'm gonna like tape off the sides where like the triangle of it goes up like this. And I'm gonna tape off the side so it actually does kind of still go towards the back. Oh, is it? Oh, it's supposed to be drawing and that opens up a big leak in the IC. You know, all you need is just get some box fans and just aim those right in there. You're right, you're right. Or get a spray bottle when it gets too hot. Just... Yeah. Get the stuff you're allowed to put your electronics into.

55:12What's that? What are we... What was that called? Dielectric fluid. Just spritz it with a little dielectric juice. Cool it right off. So, you guys know how I'm trying to do this stupid server rim render farm thing, right? Sure. So in my genius, I was like, I'll buy some more solar panels. Because right now you can actually get them for fairly affordable rates. The prices have come down. Dude, everything is so cheap in Mark's world. Where do you live that every servers are cheap? Processors are cheap? He's Markiplier, so he has his own version of eBay he can log into where everything's just discounted for him.

55:44If you buy refurbished things, you can get them at cheaper prices. Way cheaper. And they're only partially used. Solar panels are good for 25 years. and they lose, they have a rating of how much power drop that they'll experience over a period of time. The quality is so much worse though. I bought used dinner and it was terrible. Yes, I'll have the refurbished ribeye and the potatoes off that lady's plate over there. The thing is like, if you get things, you get them refurbished and you do, you put some DIY spirit into there, you can get things at pretty good rates. Now, that being said, I am spending more because I'm investing in building something that's why I'm doing it.

56:24I bought solar panels, right? And so you can read online that this solar panel is like 65 inches by 44 inches is about the dimension of this panel. And I'm like, okay, that I got that size in my head. I ordered, you can order them by the pallet that you get bulk pricing. And I'm like, okay, I mathed out. I think that this area could cover about 28 to 30, maybe solar panels depending on how I arrange it. There's a pallet here that says 31. Refurbished, high quality, barely a few years old. I'll get it. That pallet weighs 1 ,680 pounds. And my hero of a FedEx freight person got it delivered down my driveway.

57:11So how? Ah, look, dude. One guy is like looking at his chart. is like oh no your driveway is treacherously steep i cannot imagine i was ready i told them i was ready yeah just put out the top i'll bring them down one at a time and even then if i if i had to deal with that i would be looking at a nightmare because uh 65 inches is five foot six that's taller than you no no it's shorter than me okay it's true it's half an inch shorter than you you're right it's close enough where i had to think about it but they're very large right If it was in this room, the pallet would take up like 70 % of the room.

57:52Oh, Jesus. That's enormous. Well, yeah. 31 things that are basically five and a half feet by what? Four feet ish. They're all as almost as tall as Mark and wider than I am, which is to say extremely wide. Yeah, they're huge. They're enormous. And I have to haul them up onto my roof. It's really nice of you to put all that power right back in the grid and not get any for yourself, though Yeah, you're not gonna hook those up to your house, right? You're just gonna keep, you're just gonna send that juice into the grid Yeah, that's what I just do in my public duty, you know Just really, really gotta do it for the people I imagine some poor guy working on a power line And then Mark just plugs this thing in like a Christmas tree And all of the power goes flying And this guy like, not hermit scream Well, Wilhelm The line bulges as the tsunami of power comes down the line at him.

58:44Like a cartoonist is like, Oh no, I gotta get down. Lightning bolts wearing sunglasses are coming out the sides. Some of them have guitars playing rock and roll songs. That was small talk. That was all small talk. That's what I did yesterday, Mark. What do you think we're talking about? You bought 10 kilograms of some unknown metal and I... I can't wait for the subreddit post. I can't believe Mark bought 10 kilograms coin of silver. What did I do? It's how you turn on the render farm. You have to put it in the slot. It's coin operated. It's very expensive. Oh, yeah. They got me. And you pull a big lever and then you render.

59:29That'd be great if I could set it up that way. I'd like to render a ball floating in water. Chunk. Cherry. Cherry. Oh, bar. Adobe crashed. Fuck. I'm doing good. My render farm is rendering. It's very powerful and it takes a lot of electricity. You're in the future now, so maybe it takes less. No more. But you got your solar all fixed probably, right? I didn't. I bought a 30 foot pole, but then I hesitated or I didn't hesitate. I didn't hesitate at all. That's the wrong word. Forget I said that word. I underestimated how unwieldy a 30-foot pole is because when you extend it all 30 feet, it's not only extremely heavy at that mechanical leverage disadvantage, but also the pole itself just goes, just droops all the way everywhere.

1:00:25And so it's really easy to whack it on things. And, you know, solar panels aren't exactly the most. They've got things to help with droopy poles. What? Viagra. Propel Fitness Water with Gatorade electrolytes, zero sugar and vitamins. Propel hydrates better than water to help you get the most out of your workout and get back to your best self. What propels you? Propel with Gatorade electrolytes. Not sponsored, I don't think. You don't think? I don't know. It's the future, man. Who knows? I've been also working on the render farm and I know I've disparaged Linux users before And I will continue to do so it doesn't make a goddamn bit of sense you open source bastards I hate it.

1:01:09I can't even log into my NAS from Ubuntu I tried to install Fedora and it blew up on installation Marinder Pretty much And then I installed Fedora's server client and I after the full installation process I'm greeted with a DOS command prompt. And I'm like, I left this behind in 1994, my commander. So yeah, I'm doing that because the alternative is Windows Server. And I don't know if you know how much Windows Server costs, but it can cost upwards of$7 ,000 per license. Do you need a license per machine that's on it? So you don't necessarily need that one. And I don't know if that includes multiple licenses for multiple computers, but it's like with servers, I have many small versions of it and I don't know what, I don't know any of it, but I know that Linux is free, so I don't have to deal with that.

1:02:06But also it's... It's Dracula? Oh, I love Count Dracula. Blah, blah. I auditioned for the movie. You think if we get in? Blah, blah, blah, blah. It's like a Christopher Nolan Dracula. We're going for dark and gritty. Dracula's been through a lot. and whenever you're ready i'm dracula jared lito as dracula uh so my small talk is the same as it's always ever been is just about the render farm i have solved water cooling wow don't talk about glob or salts again don't go there why not i don't need to right now right now i don't because it's winter so i don't need to worry about cooling too much water cooling is a lot like factorio i I was just playing that last night.

1:02:50Yeah, I know, right? So Factorio is about like optimizing your distribution and automating things so that it all flows in a good direction. And you know, you can get clogs in your Factorio factory because you can have things going and then it won't go out. You have an in to an out and an out to an in and the belts need to be perfect. And also you don't need extraneous belts because you'll run out of space and stuff like that, right? So water cooling has always been a very scary part of computer building to me. And I've never done it because I always worry about catastrophically exploding my computers with water.

1:03:21To be honest, I did that the first time. I think I told you guys the first time I did it, I had to put it outside and drain it. Well, that's just because I didn't know what kind of plug I was using. It was an inset plug versus outside plug. I've now successfully water cooled eight servers. Damn. I'm really proud of that. I've got custom blocks. Well, I didn't make them, but the blocks for the CPUs, I put them in there, I created my own routing with the loop inside a very elegant way of like the tight angles and stuff like that. Because if you go to a server manufacturer and you buy their proprietary water cooling solution, it's thousands of dollars, thousands of dollars.

1:03:57But the block I got is 60 bucks, right? So it's 60 bucks for that, 60 bucks for another one. And then the pieces, the connectors are like five bucks a piece. You need dozens of them. You need way more than you'd ever think. And if you get the quick disconnects, they get pricier. But I did it all and it works. And I set up the quick disconnects properly so that if I ever need to do maintenance, I pop them out. No water goes anywhere. Like dry breaks, you mean? Like specifically? Exactly. Yeah. So they just like couple and they uncouple really easily. So I pop all those out. The only thing that I didn't I don't understand is there's some liquid physics going on that don't make any sense to me because I know the general principle is like you need to put the fluid in when you're filling it and then air rises to the highest point in there.

1:04:41And it'll, you know, you want to vent that so you can always fill it. So you want where you're filling it to be the highest point and that goes down. But what they don't tell you, well, they probably do, but I didn't read it is the way the loops can sit and go up and down also create like many high and low points in the loop. It's like the false vacuum thing in the universe where they say we're resting at what we think is the base point, but actually we're going to all collapse into nothingness. And so what happens with that is pressure can start to build up explosively inside these tubes. I haven't had anything explode except where I was filling it in so many times.

1:05:19It's like old faithful. I watch as it goes in. I see an air pocket come back up and it sounds, it sounds like it's rumbling. And I have to put my finger over the thing or else it's going to push water up from behind it before the air gets there. So I push that and then once I look at the tube and I see the air is like filtered to the top, then I let it go. It goes, it's just like, it's a very strange, it doesn't feel like building computers at all. It feels like a, it feels like I'm a car mechanic Just like trying to cobble together the system. It's very fun. And water is going everywhere. I've ran through so many rolls of paper towels.

1:05:59I've lost more fluid than I've put into the thing, but not in the computers. You've probably spent thousands of dollars on this. On the parts? No, I was joking. Oh. I'm at like negative 10 points to start this episode. It's not a great start for me. No, come on. It was funny, man. I laughed. I thought it was very funny. I was just being respectful and being quiet. Thank you. We love this episode. We love this episode. I've not even done anything. I've never built custom water loop stuff, but I've watched lots of videos on it. That's that's very funny. Well, so you have dry breaks, so you could use like a like a pick or something to sort of like open the dry break and bleed the air from their little pockets that you have.

1:06:39I could. I just worry about breaking any kind of O-ring or seal inside there or jamming a mechanic or mechanism in there. And then suddenly I got like, oh, O-ring break. No. Do you have trauma about O-rings? Probably they make like a dry bleed connection, like a dry break bleeder where it's like you can connect it to the dry break and it's the right connection. But then it's just a bleeder that opens to the atmosphere or something. I bet they do. One of the problems with water cooling is that there's so many different manufacturers. There's so many different standards of parts. Most of the tubing that I do is 13 is 1013.

1:07:14It's 10 millimeters inner diameter, 13 millimeters outer diameter. Most of the actual threaded screw holes are quarter inch. Some things are very standardized, but all of them are tiny itty bitty parts that cost like five bucks a piece. And so you're like, oh, it's cheap. Oh, man, I need 96 of these. I wasn't wrong by adding up to thousands of dollars. It sounds like by the end of this. It does. But when you think of the server thing, it's like thousands of dollars per actual server on the rack. So that it adds up way quicker for there. And in the end, you would still have to hook it all up and get other stuff.

1:07:48So it works out to be cheaper, but it's there's something very fun to it's like it's the exact same difference of buying your own computer and building buying your own parts and building your computer or buying a pre-made computer. What if you buy your own parts and have someone else build your computer? That costs money. Unless I do it and then I do it for free. Unless you trick Mark into doing it. Hey, you guys want to come over? Yeah, I do. No, I felt very cool because I had a pressure tester. So whenever I would build the loop, I would have a pressure tester, plug up one end, put the pressure test, pump air in to test for leaks.

1:08:21It felt very, it felt very official. I felt very confident doing it. And it was actually really fun. I haven't, I don't work with my hands a lot. And I don't know, something about wrestling the pressure was very fun and super frustrating and sometimes, but very fun. Good work. I listened. I paid attention. Thanks, man. I have a disaster. Oh, go on. So, you know, on the last episode, I was saying that my render farm is working. I don't want to ruin the illusion for people, but you mean like 40 minutes ago? Yeah, well... You bragged about how your render farm was working. I said it in there because I knew that if I got into it, it would be a longer thing, so I didn't want that to be part of it.

1:09:07It has not been going as good as I may have suggested it was going.

1:09:15Oh no. Go on. This is an issue that me and there's an IT guy that's helping me out with setting some of it up. He's doing more of the software side, getting things to actually arranged in that capacity. And so one of the persistent problems is a server that I bought, which is a density, like a high density server. It's four nodes in like a two unit thing. They're long, but it's meant to cram as much process power into small pieces as possible. The issue with that is not in me putting it together. It's not in the water cooling that I set up because in the compact space, you need water cooling or else it's going to overheat.

1:09:51They're so crammed in there. And so you need an external water cooling solution. All that works. But after all that work that I've put in, and I probably put in like 100, 200 hours into just setting up those parts of it with all the water cooling pieces in there, there's still a persistent performance problem. The chips themselves are fine. they come back and they all the checks come together but what it's boiled down to is the specific server brand that it is has not put out an update to the chipset for those processors and that's just something that is i i don't know if there's a way to just go directly to the intel makes the processors and go like hey you got drivers give them to me or if it's something where you have to kind of like figure out a way to program it in yourself you got to get the chipset drivers from the manufacturer of the processor and then they integrate with the board and but there's a problem the longer you use them the more the performance just starts to go and then eventually it locks up so bad you can't use it how long is this like if you do it for a couple days or is this like 10 minutes 15 minutes is about the time it's not long enough that's not long enough to do i was like yeah you could just reset it every night so i thought this would have resolved i've done like bios updates i've done you know firmware updates i've done every update that I can that is provided by the manufacturer of the server.

1:11:10The end result, I think, and I'm in communication to like do a big return is to do a different server platform. There's another company and I'm not naming any of them because I don't know if one works or not. Okay. Asus servers, I'm going to say are the ones that are not working right now in this specific use case. They have worked in other things that I've done before, Asus or whatever it's called. And so Gigabyte makes an equivalent product that has also the hyper dense four unit thing, but I have to undo all the water cooling I literally have to unbuild Everything I've built to pull it out of the computers box those back up Return these giant hundred pound Gigantic boxes and then get new ones in a rebuild all the bullshit all over again, which took me out days weeks This sounds like the kind of server I wouldn't leave a tip and I always leave a tip.

1:12:04Give them a point. Just, I don't know. All right, all right, all right. Mark said so. Have you thought about talking to the server's manager? I am the manager. That sucks though. That really sucks. It's a big pain in the ass because as far as I know, it should work. They read fine. When they're working, the performance is exactly where it should be. All is lining up. It's not overheating. I even thought that it might have been one of the peripheral components in the server overheating. At one point, I had a graphics card in there, a very small compact one. I took that out because I thought it was overheating.

1:12:37Apparently, it was not the problem either. And no other peripheral in there because the fans are very loud. I do the water cooling also to try to quiet it down a bit. They're running at full bore and it's still just crashing. I think it's just because the chipset is not updated to run with those processors. There's some kind of paging file system, memory system error that's building up over time that's causing like consecutive errors that run into each other and then eventually it freezes. That one's a little, hey, sus. Nope, nope, no. I give myself one or whatever that's worth. But anyway, so that's the latest.

1:13:08It's not all sunshine and roses, but half of the other random farm is still working. It's just those hyper dense ones that are not working, which are the most recent addition. And it's something I can return. It's just like, that's ours I don't have. Not devastating, but it's unfortunate. Just means I got to undo a lot of work and redo it. But it'll probably be fine. Once you redo it, it'll probably work then. Yeah, it probably will, maybe. But I do know that the Gigabyte servers do have a more recent BIOS update than ASUS did. ASUS's last BIOS update is not only last year, but it's like mid last year.

1:13:42Whereas Gigabyte has a BIOS update that you can apply to the server as of earlier this year, which is after the processors actually launched. So I know that the old BIOS is not current as of the processor's release date. And these ones on the other server are. So ideally that should work because the processors are fine. Probably. I never thought I'd be a truck guy. I got a Ford F-150 Lightning because I looked at the specs of what it could do in terms of power delivery. The size of the battery is way bigger than the Teslas ever were. The range is not a lie. Those Teslas all lie about their range.

1:14:19It just blew my mind. I would watch it and I would go like, I've traveled 10 miles. Well, surely the, oh, it's dropped 30 miles. All right. Well, that's fine. It said I had like a 300 mile range on my Tesla. I got 180 at best, even when I was driving like this. It's just lies. But this one, I drive 10 miles and it's like the range estimate only dropped eight. And I'm like, oh, thank you. Oh, thank you. Now, hold on. The Tesla wasn't lying. Someone took the road signs and spread them out further. That wasn't the Tesla's fault. It's crazy because this truck has a 240 volt plug in the back of it.

1:14:56I could run my render farm off of this truck. This truck has more power than all of my backup batteries that I put in my render farm by three times. I want to see a Ford commercial with like a really nerdy dude driving his Ford lightning with the render farm. He's like off-roading in the mud through the woods while like video game Let's plays or like processing in the back. I could I'm good. I have an update on my many hobbies Which one is it 3d guns? Ammo farm where are we going look it's about the render farm It's been working delightfully finally after four floor air conditioners to wall air conditioners that sumbitch is actually staying at a steady time.

1:15:48But the harsh realities of operating a render farm... You built a freezer? It's not that cold, man, even with all those. I woefully underestimated how much cooling was necessary. But I have another problem entirely. I got my power bill. Oh, no!

1:16:10Did the seven air conditioners raise it slightly? It's been up and down because we've been testing it, but we haven't been running it So the past month has been the first time it's been like running every day chugging, you know, beautiful renders My power belt was three thousand dollars

1:16:33Is your solar working or Yeah, it is

1:16:43I bet you wish you were a man with five of us instead of a man with seven air conditioners now don't you I opened up that letter you know they show a bar graph of your like monthly usage yeah it was like oh and it's trending up as I'm testing and then this past month just astronomically somehow it like comically goes off the paper you just look at it just like You're like, what the fuck? I don't know what the power company thinks is going on at this place. You know, this place being a bathroom. You're going to get raided by SWAT for a render farm. Dude, yeah, no, DEA is going to show up and be like, the power company thinks there's a grow farm here or something.

1:17:25Something crazy is happening, so it must be drugs. Oh, there's a farm. You're going to find seven 3D printers, a server farm, seven AC units, and a bunch of 2D guns. It's like a big wooden crate with like the rack in it and then just a bunch of pieces of paper with hand-drawn AKs on it. This man's planning to raid the Looney Tunes. I got a gun safe and they're like, open this safe. I'm like, all right, I'll open it. And just an avalanche of papers, you know, mask style with all the dollars coming out. For some reason, they all have hand-drawn serial numbers, but then their hands scratched out.

1:18:00yeah so uh that's my update and it's only going to it's not gonna go down much in the next few months so they didn't say anything about that though because like i when we lived out there we had there was one summer where uh the really one of the really bad fire summers happened and like we had all of our shit closed and sealed and we were running the ac just to try and keep positive pressure on our house because it was like toxic outside and our bill jumped by like 250 and the power company sent the bill and then they called and we're like are you guys okay are you good and i was like yeah there's fires and shit like i don't know it's been awful but they no one they just saw your bill and we're like all right well if they did call i didn't answer but yeah i feel like they're probably more um more into that they're gonna think you're a render dealer and call you El Servo.

1:18:55I had this idea a long time ago before I started building it a long time ago. It feels like a long time ago, like a year ago, because with the Mac Studios, Apple Silicon, it's very power efficient. And I did some paper math that was like the power efficiency of this cost over a period of time, the cost of this like computer going on eBay and finding random stuff. And the math showed me a year ago that the power cost of the actual server grade stuff would be astronomical Lee high and I'm like I must be doing my math wrong that can't be right and now here I am my math was right congratulations oh 36 ,000 a year on power you're saving so much my yearly power bill is gonna be thirty six thousand dollars good math I can tell you it's okay you're getting that back because the server farm is very profitable, I assume.

1:19:51Oh, well, technically it's saving me money. Technically, I think I'm deep. I think I'm deep in the red. I have like, I don't want to go and do the math. I don't want to get, it would have been so much better if I just hired another company. Oh man. Oh man. You factor in maintenance cost. I'm sure you're going to be well into the green. Well, maintaining it. I'm not hoping to do that. I'm hoping that when it dies, it dies. and I will just, because there's no company I can send it back to. I've got it from eBay. So, and it's not like, I don't think I can sell it back again. So you spent a year working on this, getting it to work.

1:20:27You installed 70 air conditioning units. You're paying$3 ,000 a month. And your idea is, when it dies, it dies. I, even now I'm like buying a whole room full of Mac Studios might've been the better option. How much Glauber Salt do you need for it to die in a tragic Glauber Salt accident? Very little if I go by that one guy on Reddit thought of what I was going to do, which was shove Glabbersalt inside the computers and immerse them in it. So very little. Anyway. Sorry, I gotta weep a little bit here. I understand I would too if I had a $3 ,000 power bill. Yeah, I actually, in the past two days since we last talked, I did a full redo of my whole render farm.

1:21:13If I take a picture of it afterwards because I didn't take a picture of it during it. I'll send it to the editors if I remember. A lot of conditions. This is never going to happen. No one's ever going to see this. Editors, invent a render farm. Make it look awesome. It still has some wires across the floor just because of where the electricians put in plugs and the fact that it is a bathroom. But it's a lot cleaner now. It works a lot better. It turns out if you don't shove something up against your air conditioners that you've put in, it's able to breathe and circulate air better. so give those room to breathe everything's going i got the leaning tower of max studios it's great what does that mean when i picture your render farm don't take offense to this i picture c3po after he got ripped apart and is like in the backpack where all the pieces are there but there's wires and he's like heads on backwards that's how it was before have you did you did i not show you a picture of the before i'm pretty sure i did it's a dystopian it was a dystopian cyberpunk kind of nonsense thing if i type server into my phones like pictures it doesn't come up and i'm like why wouldn't that come up i was like oh yeah because it doesn't look anything like what they would think a server looks like what's the search term to find that picture post-apocalyptic nightmare rat's nest of wires and oh there it is let me look up apocalypse oh no results okay uh nest of wires rat king let me look up rat king nope yeah man i can't find this uh it's a mystery apple intelligence my booty well it's working great after the rebuild right no issues yeah so you rebuilt it and nothing has gone wrong and it worked perfectly the whole time kind of it's it's not my fault of course it's not no i can't find the picture oh no

1:23:06anyway it's it's good except one of the things that i i dislike is these small like arbitrary details about computers that you know you have to really read the manuals to know or read in depth about reviews and anything i'm sure a bunch of people know that if you need to populate all of the ram slots for server grade hardware to run at full performance it needs all the channels filled that's expecting that. So for a while, these have been running with almost all of them full, but not all of them for the ones that have RAM slots. You can't skip any slots and or it do. No, yeah, it's it's probably is common knowledge in the server world.

1:23:44But I didn't know this because I'm used to like running a PC for desktop reasons. And sometimes for PCs, if you have only half of them filled, it runs faster. So it's very opposite thinking. But whatever, doesn't matter. Not important. god damn it will be the death of me because for some reason those management ports just decided to die they they're plugged in just the same they were plugged in before from one switch put them into another switch reset everything reboot everything and then just never picks up an ip address just cannot do anything i don't get it i don't understand how this stuff is supposed to be smart, redundant, fail safe.

1:24:27It just, oh no, another plug. I can't do it on a different server. I think it's probably because I didn't let go of the fixed IP on the previous device before I moved it over. But I've done that before where devices just pick up. Anyway, it's a nightmare. I know that you know that you could pay someone to do that, but there's a part of my brain that would love to see you like find an IT consultant or something and be like, I just need you to come. I have the setup. And they walk into your bathroom and they're just like, oh, God, oh, no. Oh, and they pull out their laptop and plug in and they're looking through the software.

1:25:04They're just like, oh, God. I'm sure it's fine, but I'm sure a professional would. There's even people who build PC, like just towers. There's so much shit that if they looked at the way I did it, and I think I do it. I mean, it works. I've never had a PC that didn't work. Got all the specs I wanted out of it. they would still probably just vomit out their entire lungs at what i did i can only imagine for server shit what kind of things there are that you would have no idea about there actually is a guy uh with burning tractor which is the vfx company i work with um they have this guy rory there who is their it guy and so he he has worked miracles for never actually stepping foot inside the server him but every time i do something i swear to god he's i see on discord that rory is typing stop rory is typing stop rory is and i know it's like stop fucking it up you fucking delete how dare you delete i know that's what's going on i know he's doing that but you know what can you do well i think that's very relatable we've all been there with our server farms i think we've all been there with fucking up networking i mean i miss the days when it was just like you have your modem from the the the internet company and i still managed to fuck that up so what was i thinking having a whole farm yeah well it doesn't make me feel good that you're doing all this shit and it's this is pretty high tech stuff and it's a complicated system with lots of different and i i have felt exactly the way that you feel but it's been me on my home wi-fi with a modem and a router and like one smart device being like, oh no, I connected you to the, you were on the Wi-Fi and now you forgot.

1:26:47And like, but it's just me with like one light bulb being like, why won't you be blue? Fucking light bulb. But it doesn't make me feel good that I've been there, but with, you know, kind of a different scale of technology, kind of different, but it's all just like that, man. It's weirdly applicable because the things I've learned are actually like in the IT world, they're like common knowledge for, oh no, there he goes. He had it with our tech talk. Wade speaks for the subreddit. But it's common knowledge apparently in IT land. But, you know, if you want your home network to work better, virtual networks are the way you create a subnetwork just for your devices and Internet of Things.

1:27:28and then you create specific rules that those connect to each other and then to your other virtual network where you operate your normal internet connection so it's separated and you don't have any cross traffic from that one in your network what the fuck are you talking about yeah don't don't do it i tried to i tried to do a vlan i took down my whole network for two days i don't don't touch the vlan button it's not i'm not going to oh there's a part of me that's like oh that would be so sick though because then there wouldn't no it would not be sick it would be horrible it would be awful it would be like taking another full-time 40 hour a week job at a thing i don't know how to do and i don't need that in my life what i should do is i should uh render a 3d model of his basement and use my render farm to simulate poop water explode i would you've got really good at making the ocean go i know but using my computing power to make those infographics like you know news documentaries are like discovery tale shit they have a 3d rendering of what's happening.

1:28:28Wade, I'm gonna make a 3D rendering of your basement, and I'm gonna show just poop water, just poof, and you just like, you know? Thank you. What was the noise, Wade? Well, shit is on the move out there, but thankfully it's just Molly cleaning up after the cat. Okay. I would've phrased that differently. Shit is on the move out there, thankfully it's just Molly. But you know so many things. You've done so much cool stuff. I barely, apparently, I don't even know the beginnings of it because my, my, my render farm is very powerful, but it still isn't woefully under like, you know, at the NVIDIA CEO, what he's talking about, the more you buy, the more you save with his$10 ,000 graphics cards while he's, he's hawking a server rack.

1:29:15That's as big as the bigger than the shelf behind me that probably cumulatively in the whole rack costs like$10 million. And that's just to go really fast. You need a render cooperative or a render collective farm. What? What is that? A group of farms. Those are types of farms. You'd argue like a ground plowing kind of farm and a co-op kind of deal. What a name that would be though. The render collective. This is my render cooperative. I have 16 garages each stacked with... Every bathroom in every building I have access to, stuffed full of servers. I am a man with ten garages of Render Farm. I have some tech complaints, but you know, those are always hit or miss.

1:30:04I love when Mark moans about technology, and so does everyone on the subreddit universally. Alright, so I do have a few complaints. Okay, okay. I had another Fiberline pull to my Render Farm, right? Sure, sure. How basic do I need to break this down Line of fiber Are you asking me or Wade If anyone has an objective It's a line the internet comes in on And goes out on For a lot of people Actually not as many as there should be Most people have cable which is still copper cable Everyone's internet touches fiber optic At some point Usually there's a junction at some point Where it switches from your hard line to your fiber optic It's the internet It's the fast kind So you can get your own fiber going between yourself.

1:30:52You could set up your whole house networking with fiber if you really wanted to. You could do that, and it would be very fast, efficient networking. It's just that they're very fragile. And you hated having money in your bank account. Yeah, yeah. And if any rat even touches a wire, they'll crack it in half, or they'll nibble on it. Oh, an actual rat. I thought you meant like a really shitty person. Any of you fucking rats touching my wires. I see two paths for you.

1:31:20I'm gonna rule you with fear or I'm gonna rule you with love and you're not gonna like that Anyway, so anyway, I started shooting my ceiling Um, fiber I had it too, because I wanted a redundancy Because there's a single connection going to my render farm right now And if that breaks, then no one can use it Or I have to go in there, but there's no computer set up in there It's all remote access, right? So if that breaks, even I can't use it because I tell my computers are I access it remotely. So I had another fiber line pulled and this one I was like I want 100 gigabit lines. 100 gigabit because I was like I want this to be A.

1:31:59That was cheap to install. Well it's actually not that much more. Really? Most of the cost is in laying the conduit and pulling it through. I guess that's fair. The cable may cost like twice as much per foot or something like that but still most of the work is in the labor of getting it from A to B. so they did it I had them dig it really nice and the whole pipe and then you know it gets all said and done and I go to the server closet and I look at the cable and I'm like pick up the other cable that they put in this 10 gigabit one and I hold them up next to each other and I'm like fuck

1:32:39it's they pulled two cables through this fucking enormous thing and they're not 100 anyway so that's the only complaint I have about that and this is more of a complaint with a particular company than anything but it's like I'll say this thing I'll say these things and like the people that come to the house cause it's like a house and they're like and I'll say I want 100 gigabit and they're like you know what he needs 100 gigabit that's crazy I want a jillion gigabits this guy I want a billion dollars okay yeah alright and so they're like I'll just pull this fiber which is perfectly good at this point you have like three government satellites lights aimed at your house at all probably probably i have i have an unbelievable amount of random bullshit going on here and to confirm the bear yeah yeah the bear yeah the bear could anyway i was just like god i i just wish people would take me seriously sometimes because i'm saying what i mean i am i don't know everything about everything i'm doing but when i say i want 100 gigabit and they'll say like well you you need to get really expensive infrastructure to even handle 100 gig of it.

1:33:42And then I'd go, I know! Because I bought it! I have it! Plug it into the thing! Anyway. I have a render farm update. It's not going to be exciting. I'll take a nap immediately. So, in my experience, I have had many ups and downs with the render farm, especially in terms of, like, how to get the computers in there, what format, and I'm circling back to this crazy thing that's going to make a lot of people mad. Glow results! No, no, no. Don't even need it. I've very much become like no water cooling at all, unless it's like an all-in-one, and even then I would rather have an air cooler because it's just going to be consistent, at least I guess that the fan fails, but usually you can have two on them.

1:34:34I was so proud of my ability to go on eBay and find these crates. Wade? Nah, it's fine. I'm so proud of my ability to go on eBay, you know, much like the Cincinnati Bengals. Cincinnati. I was just going to write a sign that said, Wade loses a point for every minute he sleeps while Mark talks. So it's good that you woke up. Anyway, so I did not know this, but you know the Intel chip that everyone seemed to not review very well that I've been like, it's actually very good. They make a workstation-grade motherboard for that that takes error-correcting RAM, and it's the same fucking price as a normal, well, high-end, but a high-end normal desktop motherboard.

1:35:22And why this is huge is error-correcting RAM is very important on a server, especially if we're running a long time, is because when it's doing calculations that are very precise, it needs to not have wrong numbers in the memory. That leads to bad issues. and uh it's there's a lot of reasons why it would happen why it doesn't happen but error correcting ram corrects it and so it makes it really really uncommon for those to happen but it's also stupendously cheaper than the even the discounted server hardware i was getting online it is stupendous and it's more power efficient and it's like and i look at it i'm like what was i fucking thinking with this stupid render farm so yeah um i'm going to be overhauling it because now that iron lung is wrapping up i'm gonna i'm gonna get it out of my bathroom i'm gonna get it out of the bathroom and then i'm gonna move it uh so that it could be because it was always a stop gap it was always like this is urgent i gotta do this right here in this bathroom there's no other place to do it apparently and then um you know then one thing led to another but i'm gonna be moving it i'm gonna be selling stuff and then i'm gonna convert it to a much more optimized to streamline.

1:36:28And this is once again, where I'm like people like, again, you just don't be loyal to AMD or Intel by what is useful in the moment. And holy shit, I can like, they're so discounted because no one wants to get them because the two frames per second, it gets less than the other ones. Who cares? It is such a good productivity chip. It's so good. I'm doing overhaul to that. So I've got some computer parts coming in. That's fun. It's very fun. I've already sold a couple things back. So technically I'm up, except I paid for them before, so I'm there. Propel Fitness Water with Gatorade electrolytes, zero sugar, and vitamins.

1:37:04Propel hydrates better than water to help you get the most out of your workout and get back to your best self. What propels you? Propel with Gatorade electrolytes. But you got that money back. Full price, I'm sure. Oh yeah. Oh yeah. Man, people are tearing apart my render farm on on like the submitted home lab people are really not people and i shared the picture because i know it's bad guys i know oh wait that was real that was a real picture oh yeah you thought that was yeah no that's it it's just like look guys it was a i i learned as i went it's not pretty but fuck it works look guys it works it that shit fucking flies and people need to understand it's not just for like rendering video or encoding video that's not what it's for it's not even just for rendering the cg scenes which can do very well it's purpose built for distributed simulations simulations need a lot of compute power and to do it efficiently this is the best way that i've gotten so far to do it it's not the best way ever it's the best way i could manage myself and let me tell you all those people out there they were like why didn't you hire a professional to do this i tried they came in and i said yeah i want to put a server in my bathroom and then they go fuck you and they leave they don't do it they don't do it so yeah that's it so my my childhood thing actually that i do still to this day is something that i i i cultivated again because i was building the render farm and i know that sounds weird but my dad always had computers every ever since i was a kid and so for a very long time i was the type that was like he got computer magazines he got like the micro center mall like advertisement thing and so i would after he was done with that i'll go through and look like oh yes i'll take a thousand dollar hard drive 30 you know this five-year-old me just like oh yeah a 30 megabyte hard drive oh a 10 pack of floppies for only 29.99 well i'll take two you know uh so now that i'm i'm i'm back and building render from and i'm done with the movie now so i i now i'm just like what computer can i upgrade what means like i caught a whiff that there were new intel processors coming out and it's like oh yeah all right i probably need that i probably i probably could do with an upgrade to my main computer i can build another one you want to build another one so it's just like i i'm just desperate desperately looking around for anything that i can build and anything that i can tinker because it's just like it's just tinkering with legos but with expensive computer equipment you are a great candidate for a hobby i've been trying to teach myself about and i'm too stupid apparently to do very well have you looked into home lab stuff i was on the home lab subreddit they were making fun of my render farm oh they were burning your red of your friend Well, some of them were just like, no, wait, actually, this is what this subreddit is all about.

1:40:05really shitty setups this guy you can't make fun of him and meanwhile he's saying that i'm like oh you don't look i'm still getting hit here man seriously though the people on the on the home lab subreddit who are like scoffing at people who scrabble things together and have janky at what is a home lab if it's not supposed to be some janky shit where you're like i have these weird random components let me see what i can make with them it's great and the people who are chill about it are cool the people who are on reddit about it are not that janky shit held the number one movie for 71 and a half out of 72 hours that's true baby that's true what i will say is uh about that some people were looking at all the mac studios and was like oh clearly that's not a deal i'll tell you something about mac even if you don't like it that shit holds its resale value like crazy and you better believe i'ma sell those things now that i'm done with the movie so i only got them for this for this thing so i cannot fucking believe how expensive like an m1 mac mini still is like you'd think like oh that's really old but it's an apple silicon chip and but it's like oh that's like a five-year-old compact computer like 300 400 500 bucks depending on the specs it's like what the fuck you might as well just buy new stuff god damn that's the crazy thing is because i bought this i mean it was still the ai craze but then people discovered that hey these macs are actually really good for ai bullshit and I'm not using it for that.

1:41:33I'm using it for efficient rendering, but the resale value, I might make money on these. I'm going to make money on some Mac studios. It's crazy. So the render farm is no more. Whoa. Okay. It's a little underwhelming. It's gone. I mean, it is big. It is big news, but it's gone. I feel like it's been, that's just a part of life. Wow. Why are you acting like you're not listening? I know you hear what we're talking about. I am listening. I'm reacting. Oh, okay. So yes, the render farm has left the bathroom. I know it's a big deal. And you burned it in a bonfire in your backyard. I covered it in Glauber salt, which, as we know, very flammable, extremely flammable.

1:42:26One of the big problems that everyone was trying to warn me about when I stuffed it inside my servers. It's hard to get up when you're old. It's moving to an actual, not a bathroom, like, wait, you all right? Oh, yeah, this isn't about me. It's about you. Go on. Anyway, it's moving to a place that actually should have a render farm, a server room, a real, real deal server room. Purpose built specifically for that. Oh, fuck. What is happening under his desk? What kind of mole men are tunneling up from his basement floor? What the fuck is happening? I just squirted water all over. Well, geez, man, don't do that.

1:43:05I'm really trying to stick with the story of this one. Mark's render farm is going to a real room like a big boy. And I'm selling some of it because with the current computer prices and RAM prices, don't give me that face weight. Very high. Oh, man, you're not lying. There's some extra stuff that I think I'll try to sell. might even make some money off of what i got off ebay for that i don't understand what's happening with wade i gotta be honest i'm super distracted right now okay so my what i do right now is like okay let's say making movies or whatever it's like making entertainment that's a lot of different disciplines involved in it that's why i constantly come out like i bought a graphics card boohoo you know i i built a render farm boohoo you know glow results boohoo you know Lenses boo-hoo does that count of like having a job that requires a bunch of skills?

1:43:59I mean technically It's your job, so I can't argue it, but you can never stop. This is easy. I don't want to stop I want to slide into my grave. I don't think he's going to stop. Yeah slide into my grave Wishing I could do more the only time you're ever gonna get tunis honest is when mark finds out He has almost exactly one year to live and at the end of the year mark dies All right. That's the channel. That's not bad.

1:44:49access to your apps and files, and it can create real work documents like spreadsheets, slides, and structured reports. Get started at chatgpt.com by selecting work mode, available on Plus and Pro plans. In the U.S., there's a break-in every 26 seconds, but when intruders step near, SimpliSafe Home Security steps up. Stop. This is SimpliSafe. Police are on the way. Using AI alerts, U.S.-based live agents help deter break-ins. SimpliSafe, no long-term contracts. Save 50 % on your new system with professional monitoring at simplisafe.com slash Spotify or with promo code Spotify. Outdoor deterrence requires a SimpliSafe Active Guard outdoor protection plan starting at$49.99 a month.

1:45:29Visit simplisafe.com slash licenses for alarm license information. Tennessee 2012.

From the publisher

E-I-E-I-Oh boy! It's a bountiful harvest in the Distractible Vault tonight, with a collection of Mark's updates on ol' bessy herself: The Render Farm!

Learn more about your ad choices. Visit megaphone.fm/adchoices

More from Distractible

All 103 episodes
Best Of The Render Farm (Compilation)Distractible · 1 h 48 min
Listen in VO