In short
AI Today Podcast Episode Notes
Episode Title
Grok 3 is Here—And It’s Challenging the AI Giants
Episode Overview In this episode of the AI Today podcast, the host discusses the launch of Grok 3, the latest AI model from Elon Musk's company XAI. The episode emphasizes Grok 3's potential to rival industry leaders like OpenAI and Google, highlighting its performance metrics and unique features based on initial testing experiences.
---
Key Topics Discussed
- Launch of Grok 3
- Grok 3 is introduced as the flagship model of XAI, with the launch generating significant industry buzz.
- The live stream for the launch attracted massive viewership, indicating strong public interest.
- Performance Comparisons
- Grok 3 reportedly outperformed ChatGPT and other models in various metrics:
- Math Benchmark: Grok 3 scored 52, while competitors like Claude scored 39.
- Science Benchmark: Grok 3 scored 75, with the next closest at 65.
- Coding: Grok 3 achieved a score of 52, outperforming other models.
- Notable Features
- Reasoning Capabilities: Grok 3's enhanced reasoning capabilities are highlighted, allowing users to instruct it to "think longer" about a prompt, thereby leading to more thorough and accurate answers.
- User Experience: The host shares personal experiences testing Grok 3, including its ability to provide useful automotive information and product comparisons.
- Training Innovations
- XAI's approach to training Grok 3 is discussed:
- The company built a data center with an unprecedented 200,000 GPUs.
- Innovative strategies for power supply and cooling were employed, including purchasing a significant portion of the US’s liquid cooling capacity.
- Community Engagement
- The host invites listeners to join the AI Hustle School community, promising resources and insights on leveraging AI tools for business.
- Open Source Commitment
- A major takeaway is Elon Musk's announcement that Grok 2 will be open-sourced after Grok 3's rollout.
- The host emphasizes the importance of this decision, suggesting it could pressure OpenAI to adopt a similar stance.
---
Key Takeaways
- Grok 3's Competitive Edge: The model demonstrates superior performance in critical benchmarks, positioning it as a strong competitor in the AI field.
- Training and Infrastructure: Innovative training strategies enabled rapid deployment and performance enhancements.
- User Experience: Practical applications of Grok 3 showcase its capabilities, although there are mixed results in specific instances.
- Open Sourcing Previous Models: The commitment to open-source Grok 2 sets a precedent that could influence industry practices.
---
Conclusion The episode wraps up with the host expressing enthusiasm for ongoing developments in the AI landscape and the potential of Grok 3 to reshape competition among AI giants. The commitment to open-source principles is highlighted as a significant move toward democratizing AI technology.
---
For more insights on AI advancements, subscribe to AI Today and join the conversation on how AI is transforming various industries.
Written by AI. May contain mistakes. Listen to the episode to check what was said.
Transcript
Automatic transcript. May contain errors.0:01Welcome to the AI chat podcast. Today on the podcast we're going to talk about some breaking news out of Grok, aka XAI. and there's been a ton of beef going on between OpenAI and Elon Musk, Sam Altman and Grok and all that kind of stuff. And today, the new flagship model, Grok 3, has just launched. Actually, last night, I had to stay up, watch the live stream. It was actually pretty interesting, and they unveiled a bunch of new metrics that pretty much have Grok 3 beating ChatGPT and every other model, not by an insane leap, but by some significant numbers. I'll be breaking down all of that and also showing you a live demo because I have XAI premium or whatever that you need to have Grok3.
0:40So I'll be breaking down all of that. Before we get into the episode, I wanted to mention, if you've ever wanted to start an online business or use AI tools to grow and scale your current company, I have an exclusive school community called AI Hustle where every single week I record videos that I don't post anywhere else that essentially show you the AI tools that I'm using to grow and scale my companies and different side hustles that I'm doing. And my co-host Jamie has made over$25 ,000 last year doing a side hustle with Amazon. He's using AI this year to scale that up. We break that down along with dozens of other videos in a classroom section, over 300 members that all talk and kind of share their ideas.
1:18So I'd love to have you as a member of the community. It's$19 a month. In the past, we had it at$100. So it's at a discount right now. And if you lock that in, it won't be raised on you. But the link is in the description if you want to check that out. And I'd love to help you take your business to the next level using AI. All right, let's get into the episode. So what's happening with Grok? This is, of course, the latest flagship model. They did this whole live stream last night, which, okay, this is just a side tangent. But whenever they do these live streams, they always say they start at a specific time.
1:45I've just noticed with Elon Musk and all of his companies. And literally for like the Tesla live stream, I know they had like some sort of like issues. But I like waited on the live stream for like 50 minutes before it actually started. And for this one, I think I only had to wait like an extra 20 minutes beyond when they actually said it was going to start. but it always drives me crazy. I will say maybe it's a good marketing thing because like the number of viewers on the stream was like 100 ,000 and 200 ,000 and 400 ,000 and like 20 minutes in, there's like a million people watching this live stream that hasn't even started yet.
2:14So I guess maybe there's a marketing strategy involved in all of that. But anyways, that's my only criticism of the whole thing. So this thing is really impressive. A bunch of new capabilities. The big one that I think they pushed back a little bit for was to get reasoning and some of these like deep learning models. And of course, when DeepSeek came out and totally swamped the whole field like a month ago, then you had OpenAI and Google Gemini both really quickly within like two weeks, released their own kind of updates to the reasoning models and their deep research models. And so Grok obviously couldn't launch without that with all the other top players.
2:50So they've actually launched that as well, which has been pretty interesting. Now, if you go over to grok.com or on the mobile app, these are the two places where it's updated first, you will literally see a dropdown where you can switch to Grok 3. This is their latest model. And they have something called Think. They're going to be releasing their deep research, I believe, later. But I actually was testing out Grok 3 today, and I will admit I had mixed results with it. Now, I'll show you if I have my history here. I'll show you it does some pretty impressive things. So I was like, I got to test this out.
3:26I was going to Walmart this morning and getting some new stuff for my car because my wife got pulled over last night. So our brake lights, I guess, on our truck is out. And so, you know, traumatic experience for it's actually the first time she's been pulled over in her life, which is hilarious because she's driving my truck. So, you know, go figure. um so i was uh i was testing i was testing it out and i was asking it what kind of um you know what kind of like blades do i need for my for my windshield wipers on my truck and it told me and i was like i'm just gonna trust whatever it says and i'm gonna go i was like for it said for 2006 toyota tundra you'll need 19 inch windshield wiper blades all right i took it at faith and And guess what?
4:08It lied to me. I bought them. I came back to the car. They were way too short. I needed 26 inches. So this thing was definitely off on that. And the annoying thing was I was like when I was in the store. So I actually also asked it for like the bulb that I needed. I was like, what type of brake light bulb do I need? And it gave me one. And when I was in the store, I was kind of doubting it because there's just like this random bulb that says 7443 on it. And I'm like, I don't know. So I Googled it and it was right. And I'm like, OK, it was right about the bulb is probably right about the blades.
4:37Oh man, I picked the wrong one to verify on Google with. So it turns out I needed to go back and get different blades. Okay. The thing that I did think was quite impressive with this though. First of all, I'm like, okay, I have this truck. What kind of blades do I need? And then I just said, what type of brake lights do I need? It automatically jumped to the assumption. It's like, I'm assuming you're talking about, you know, the same truck that you just referred to. So this is what you need. It tells me the bulb type. It also tells me what wattage and voltage I needed to look for, which was pretty useful.
5:06Then also told me, look, you're going to probably want to get two of these because the passenger one also needs it. It also goes and tells me common brands, which was useful because I think I actually ended up buying a Sylvania. And I like knew because of what it was saying that it was probably the right one. So anyways, then it goes and gives me a bunch of other information on like, if you want to replace it, these are all the steps you want to replace it. This was cool because these weren't questions I was even asking. I was just like, what bulb do I need? It, you know, guess what kind of truck because of my last question.
5:33And then it's like, and if you're doing this, you're probably gonna wanna change it. Here's the steps to change it. So like, I guess I could have changed my prompt to be like, only tell me the name of the bulb, no other information. And I probably could have got a faster response. But like for me, as someone that was actually using it, this was very useful to get kind of all this additional details in it. And by the way, if you're just listening on Apple, I'm explaining everything. But if you're on Spotify or YouTube, I'm breaking down this and sharing my screen with a video to break it all down.
5:56So anyways, I wanted to give you the antidote of me actually testing this thing out. So you, you know, um, one other thing that I did with it, I tried their like image upload and help in Walmart. And there's these two different, uh, windshield wipers. And I never know if I'm getting scammed by these companies, anything in auto mechanics. I swear there's like a gimmick. So there's two kinds of windshield wipers from the same brand. One was like 15 bucks, almost seven bucks. One was optimum plus. And I'm like, is there any difference between these in reality? and Grok was a pretty good salesman and told me that apparently the op that one of them has equal pressure throughout the whole blade and it's less likely to get wrecked and blah, blah, blah, blah.
6:33So I end up buying the more expensive one because Grok told me it was good. But I mean, it's kind of useful and it's cool that I was able to just like snap a photo while in Walmart on my phone, have it upload. And then like it actually was really quick. And I don't think the internet was like super fast in Walmart. So anyways, this was my actual use case test of Grok. Let's go into what the updates were. And why I think this is an impressive thing. You guys are probably all sick of like, okay, that's enough of your like stupid trip to Walmart for your car. What is this thing actually capable of?
7:02So I'll break all of this down for you. So the first thing that was really impressive about this is how they actually trained this. They said they wanted to start with first principles, which is something that XAI has been really good at. And they essentially went to like, they're like, hey, we've got to build like a facility to have enough GPUs to train this AI model. So they go to all of these people that could build facilities. Like how long is it going to take you to like build us a data center, all these data center companies? And they're like, yeah, we can build you a data center. It's going to take us about 24 months.
7:30And they're like, okay, well, we'll be screwed because in 24 months, we definitely like that's two years. If that's how long it takes us to do the data center, then we got to train on top of that. Like, where is Chachi Bati going to be in two years? They'd be completely smoked. So they said, screw it. We're just going to buy a prebuilt factory. So this wasn't something built for a data center. They literally went and found, I think like an, uh, uh, uh, they said they had to find a factory that was like new enough that it was still good, but someone just went out of business and it's kind of hard.
7:58Anyways, they found some like electrical company that just went out of business or moved locations. They grabbed their factory. It wasn't big enough. So I think they actually had to add onto it, but they grabbed it and they were doing every hack in the book, like trying to essentially, um, hack and get this thing built faster. So they, uh, they, the first thing that they did was they wanted to put a hundred thousand GPUs. Everyone said this was impossible with some engineering feats. They did some crazy stuff. They were able to attach a hundred thousand GPUs and halfway through the training, they were able, I think that took them about 120 days, like three months, halfway through the training, they added another hundred thousand GPUs, um, which was like, uh, took them another 90 days.
8:35So really like three to six months said this entire thing up and running and people are like, how the heck did you get this like factory that was not built for data centers? Because data centers are notorious for a bunch of different reasons. Number one, absolute power hogs, like 200 ,000 GPUs. And when you think of a GPU, this isn't a little one in your computer. Like you're talking about a brick, like just this massive hunking thing. And 200 ,000 of those is a complete power hog. In addition, cooling that many GPUs is insanity. So what they said they ended up doing was they didn't have enough power from the grid.
9:08They were getting it hooked up. And in the meantime, they just bought thousands and thousands of generators and lined them up on an entire side of the factory, had all of these generators going. On the other side of the factory, they said they literally purchased 25 % of the entire United States cooling, remote cooling capacity. So pretty much like these trucks, all of these have to be liquid cooled. So they're like waters going through pipes and circulating through pretty much. And so people have like trucks to do like liquid cooling for like big events or concerts or like things, but there's like not that many of them.
9:39So they literally had to get 25 % of the capacity of the entire United States. I'm sure all that was probably great business to be in to cool this entire thing. They said they had so many problems with like one cable would be disconnected because what they did that was different was they actually connected all 200 ,000 GPUs together. And they had to make the redundant so that if one cable got pulled out of one or there's an issue with one, then all the rest of them keep working. There's a lot of like really impressive things that they were able to pull off for this. All of this to say grok 3 this current model they have was trained on 10 times more compute than grok 2 the earlier one and it might be like one of the most one of the biggest most compute used in any ai model so what was the output and i know like you heard at the beginning i'm like complaining that it it told me the long the wrong length of my windshield wipers or something like that which tragedy or any other model probably could also do that and i'll go and like research why that was But like overall, the other questions I've asked this and tested out, it's very thorough.
10:36It's very in-depth. It shows you its reasoning processes. It can do a lot of really impressive things. So what are the benchmarks? How did this actually perform? For the math benchmark, math aim 24, it scored 52. Grok mini, which is like their smaller version, was 40. This is like really impressive. The only model that got close was Claude at like 39. And that's like still worse than their mini model. It's still completely beating GPT-40 and which scored, I think, the worst. And Deep Seek. So Gemini, I guess, also did fairly good. So anyways, they completely beat everyone on the map one by like a long shot, 52.
11:19So then Science, they scored 75. The next runner up was 65. A bunch of models scored 65. So they're solid 10 ahead. And then when it comes to coding, they completely crushed again, scoring 52 on coding. And the next best model that wasn't from Grok was like 40. So they really, really crushed it on math, science, and coding. And it seems like ChatGPT, I've heard from a lot of people, is notoriously like sort of struggles in this area. Claude does really good. most of the developers I talked to use Claude, even though they haven't come with an update in like forever, because they just say it's better at coding.
11:55And so sometimes you find these use cases that these models had better training data or were trained better or fine-tuned better on. And it seems like Grok might be the winner now with code. So in the live stream I watched last night, they literally had it. They said like, build a game for us that's a cross between Bejeweled and Tetris. And it literally like wrote all the code. They ran it and it was an actual functioning game where you had like these Tetris blocks that each thing was a different color. And if you got three of them in a row, it would like bejeweled, it would like destroy the line or the blocks or whatever.
12:25So it was interesting and it was able to spit it out pretty quick. So this was pretty impressive. Reasoning, test time compute, it crushed it. And you essentially are able to tell it, think longer about this prompt. And if you just put that in your prompt, there's a button that you can also do. If you tell it to think longer, it bumps up its response from like 78 to 93 so if you tell it like use more compute think longer about this and we kind of saw the same thing with chat gpt they ran some of the similar experiments with similar results but if you tell it to think longer and use more compute it'll essentially try to solve the same problem like 10 or 15 or 100 times and then it's like what is the average of all 100 times so if i had said what windshield blade do i need for my truck think as long as you want about this it probably instead of just going and searching and grabbing like the first couple results from google it probably would have like looked at like 100 results and then try to solve it 100 times and then realize oh actually you need the 26 inch blade so i mean maybe as a user error on my fault i need to uh i need to ask i need to tell it to do that so the one thing that did not come with chat gpt because um subscribers to the premium tier which is like 50 bucks a month get grok three first um although i think i'm paying like 17 a month maybe i'm grandfathered in because I've been paying it for a couple of years, but like the$17 a month tier, I'm getting a grok three.
13:47But the one thing that did not release was, um, the voice. So Elon Musk said the voice is a little spotty should come out in about a week, but that's where you can talk to it. And apparently just like opening eyes voice thing, which is phenomenal where it's like really dynamic and you're like, talk really fast. Like talk like you're running on a treadmill. Talk like you're singing, like talk like you're yodeling. Like you can tell it to do all this crazy stuff. Um, the, the voice mode should be good, but that's not going to be coming for a little bit. In the next few weeks, Grok 3 model is also going to be available via their API, which I'm stoked about because I can then integrate it into AI Box, my software startup.
14:23So a lot of really cool things. The biggest thing, okay, this is the biggest W of the entire night. And that is Elon Musk said, once Grok 3 is fully rolled out and everyone can use it, everyone's like, what happens to grok too because they took like a q a on on twitter and people responding and he said the older version once the new one is fully rolled out the older version will get completely open sourced so anyone can use it this is amazing and i think open ai could solve all of their controversial problems of going from a non-profit to a for-profit and everyone hating them and stuff if they did this sam altman was like he did like a he did a sneaky poll in my opinion on twitter yesterday where he was like what do you guys want do you want like the best oath like the best o3 model open sourced because they're about to come up with a new model?
15:09Or do you guys want us to make the best phone model we possibly can? And like the way he phrased it, everyone, I even said like, oh, I want the best phone model because I was like, oh, this would be cool to have like an open source on my phone. But what I'm realizing is people can take the best model and make phone model versions for it. Like we could do that after. Really what we want is the best model possible that's open sourced, which they're not going to do their flagship model because that's how they make their money, but they could do their older model because like now that Grok3 is out as a consumer, I'm never going to go to my XAI app and just choose to use the older model.
15:38I'm always going to try to use Grok 3, but Grok 2 is still capable of doing a lot of things. And for developers, um, saves a ton of money if you can open source it and not have to pay their API fees and host it yourself or run it locally on your own computer. Super, super cool. So I think, um, the biggest win of this entire announcement, other than, okay, they made a model that beat everyone in the benchmarks. That is cool. But I think the biggest win is that they're saying they're going to set a precedent where the older model will always be open source. They're just giving that for free to everyone, to the public.
16:07So that is really cool. I would love to see OpenAI do that since that was the purpose of their company was to be an open source AI company. And now they're closed source. I would love to see them follow suit. And I think that this will put some pressure on them to potentially do that. You already see Sam Altman kind of like talking about it. And I think if this becomes precedent for Grok, they'll essentially be forced to, which I'd be thrilled about. Overall, super excited for everything happening. I'll keep you updated on all the latest news going on with XAI. Thanks so much for tuning into the podcast.
16:34And again, if you want to grow and scale your current business or side hustle using AI tools, make sure to check out the link in the description to the AI Hustle School community. Thanks so much for tuning in, and I'll catch you next time.
From the publisher
The debut of Grok 3 signals a new era in AI competition. Industry watchers are paying close attention. Is Grok 3 ready to take on the leaders in the space?
AI Chat YouTube Channel: https://www.youtube.com/@JaedenSchafer
My Podcast Course: https://podcaststudio.com/courses/
Try AI Box: https://AIBox.ai/
Join my AI Hustle Community: https://www.skool.com/aihustle/about

