Opus 5 Releases: Key Features Explored

0:00Anthropik has just launched a brand new model, Claude Opus5. It is half the price of Fable 5, but almost as good as Fable 5. This, I think, is in direct response to what OpenAI has been doing. And speaking of which, OpenAI has just brought ChatGPT voice to their desktop app, and it has agent control. So talking to it, it can then control your computer. Meta is pivoting their AI chatbot towards productivity with MuseSpark 1.1. We'll get into what they're doing there. But hugging face, Meta, NVIDIA have all signed, along with over 200 Silicon Valley companies, a letter against open weight AI restrictions.

0:35And a researcher is using AlphaFold to redesign CRISPR-Cas9 and cut off target edits from 28 % to 5%. Midjourney has just acquired CoStars. It's an astrology app that has 4.3 million monthly users, and it has nothing to do with Midjourney, but the talent that have built it have everything to do with their company. So we're going to get into that. But first, my absolute favorite AI tool I've been using this week allows you to generate images and audio and video right inside of Claude who you know only does text and reason and I basically use Claude as my control panel for everything I do I have two Claude max$200 a month subscriptions and I burn through all of the tokens for both of those because I have a billion projects going always all at once and this thing is a workhorse now the problem with it is it doesn't generate images like chat gpt it doesn't generate video like google and it doesn't do audio like 11 labs.

1:30So I've actually been able to pull all of those models straight into Claude with the AI box MCP. It's amazing. I've created tons of Facebook ads this week. And the thing that actually saved me a ton of money and also just time is I was creating a bunch of podcast covers for a project where it was a it was a language learning podcast. So it's like learn German, right? And it'll be a podcast in German. But my problem was I was like, you know, people that are from, you know, Spain or from Russia that want to learn German, they're not going to search for learn German in English or even learn German in however you say it in in Dutch, they're going to search it in their own language of Russian or whatever.

2:06So anyways, I have this problem. And the solution is generating podcast covers with ChatGPT. You know, learn, you say the words learn German and you translate it to 10 different 10 different languages. Okay, so I had this great podcast cover design that I really like. And I was just getting ChatGPT, I was giving it to it, it was spitting out a new title. And I know a lot of people are like, Oh, why don't you just use Canva to do this. Yeah, you could use Canva to do it. And then you'd have to manually adjust like the font sizes. Because once you get into like Mandarin or Korean, and like the languages are completely different.

2:37I had two different fonts and two different colors. And anyway, I was gonna have to go Finnick with it. And it's gonna be annoying. So I was having chat GPT just one shot this, but it was taking forever. And then this for this particular project, I'm actually doing every language and every language is variant, right? So it'd be like learn English, learn German, learn French, their podcasts in those languages. But it's I'm making a podcast cover for every language, right? So there'd be like 10 or 12 variations of everything. Anyways, it was a big project, it was going to take forever to generate 300 podcast covers for every language variant.

3:11And so what I did is I had Claude make, you know, the base image for every single one of these, which is like 12 languages. So it just made the base image for the 12 languages. and then Claude actually put the text on it. It can swap it out. It saved me so much time being able to use Claude plus AI box. If I was just going to chat GPT and trying to get, you know, 300 images generated, this would take me forever. But getting Claude to basically I had the AI box MCP called in. So it just said, Hey, you know, Claude knew exactly what to do. It wrote the prompt, I give it an image and told it what I wanted it to do.

3:43It wrote the prompt, it used AI box, it pulled the image in, it put the text on and swapped it out into all the different languages and made the template perfect. So I got to use the brain power of Claude, but I got to use the image generation power of chat GPT using them together. I only had to generate 12 images and I saved myself so much time and money being able to do it this way. There's like a hundred other things I've done this week with it. That was just like a fun thing I was doing last night with it. I tested it out. Go try out the AI box MCP. If you haven't already, it can generate images, audio, video, right inside of Claude.

4:13You use Claude's brain. And by the way, it's not just Claude. Like you can do the same thing inside of Codex or inside of Cursor or inside of any of these other tools that pull MCPs in. Okay, let's talk about what's going on with Opus 5. This one's actually a pretty fun model because the biggest issue that I've seen with Claude at this point is that Fable 5, which I use, I burn through credit super fast, but it also burns through all of my tokens for my entire account. So the new Opus 5 is very similar on the benchmarks. It's slightly worse than Fable 5, but very close. And it is half the cost.

4:45This is amazing. I will take a, you know, a 10 % or a 5 % cut on, you know, brain power, quote unquote, in order to get half the cost down because I'm just burning through so many tokens using it. I only use it for like the most important critical tasks. So I think from now on, I probably just won't use Fable 5. I'll just be using Opus 5 for everything. And I think this is in direct response to ChatGPT, who came out with a very similar model. ChatGPT's latest, I think, 5.6 is half the use about half the tokens that Fable 5 was using. So Claude obviously wanted to come up with a competitor because I was, you know, like basically once my subscription to Claude runs out in August, I'm switching over to ChatGPT into Codex and using ChatGPT work on my desktop for like coding and everything because of all the features they have.

5:35but in the meantime I'm still using Claude till that runs out but anyways I think Claude knows this and so they they're making basically trying to get themselves on par with OpenAI come up with all the features that were just launched and speaking of really cool features from OpenAI OpenAI actually just added chat GPT voice to the desktop app if you remember I don't know if you you know everyone's at a different phase but basically OpenAI has a desktop app called chat chat GPT, they used to have one called Atlas, which was like a browser. And they had one called Codex, which was for coding. They combined them all.

6:06It's just called the chat GPT app. And they now have chat GPT voice that they've added to it, which what that means is it lets you talk to chat GPT to this thing that controls your computer, right? It does everything that Claude Cowork can do where it like controls your computer, can control your files, it can open your browser, can control your browser, you can do all that kind of stuff. But while you're talking to it. So you can have something pulled up on your computer screen. And you can be writing code instead of like, I do this all the time with Claude, I go take a screenshot of whatever I'm working on.

6:36And then I, you know, drop it into Claude. And I'm like, what do you think about blah, blah, blah. Okay, now with Chai Chippity voice, you can have something pulled up on your computer screen, and you could just be talking to it. You're like, hey, you know, I'm on my emails, and it looks like they said this thing is missing, or I'm in my files, or I'm in my software, and that there's this issue and it's looking at it and it can then debug it and test it right from there. I am so stoked about this. You have no idea. Like this is actually massive. You're no, it's just getting to the point where whatever's on your computer screen is, is you're going to be talking to it about that in particular.

7:10So yeah, this is a big upgrade on a Mac OS. There is a feature called app shots and it basically lets voice agents see what's on your screen, including the alt text. So what I love about it being able to see the alt text, these agents are really cool. And I use Claude for some of these similar types of tasks a lot where beyond just seeing what's on your screen. So like I have a project where I have to download 300 hours of podcast video content from the platform that I hosted all on Riverside. I've been recording there for years. I wanted to export all my podcasts off of there. And I, you know, I like email their support and I'm like hey do you guys have a bulk like export thing whatever I'll pay extra they're like nope sorry there's nothing we can do no bulk export you got to go manually click every single one and you only can do 15 hours a month and I'm like I have 300 hours what do you mean anyways so there's like a couple little loopholes they came up with it was super annoying obviously I'm not going to spend a week of my life manually like exporting every single thing so I got Claude to go look at it and when Claude went in there it was like hey look we actually found an API inside of this and we're able to like automate and manual or you know automate a lot of the stuff and download everything we found like the download keys and the files and whatever so claude's in there doing who knows what but it's not just like looking at my computer screen and clicking on actual buttons it's like executing code to go and do a lot of this stuff programmatically which is really cool and i mean basically that's what this new mac os feature is able to do beyond just looking at what's on your screen it looks at what the code is of the alt text the code what's behind the actual screen and so I'm like so stoked about this you'll you've probably heard me talk about this or you probably use this yourself where you know these these coding models are not just looking at the visual they're looking at the code behind everything I was I think I like a couple months ago I was asking Claude to edit a video on CapCut it closed my CapCut app opened the CapCut file made some tweaks inside the code and was like okay your videos edited and I opened it and it like had cut it up the way I wanted so these these models are awesome.

9:06And they often will just look at the code and not even do it the visual way. So really stoked to use that with open AI. Meta is pivoting their AI chatbot from just being kind of like entertainment, they're trying to focus more productivity. In the past, you've probably seen all the branding with meta was like, chat with the Mr. Beast AI on WhatsApp and like, go generate an image of your friends generate a picture of you as a pirate, right? Like this is kind of like the fun viral stuff that they were working on. But I think at the end of the day, they're realizing People are not going to pay for that.

9:36Like it's fun and it's a novelty and maybe it was cool like, I mean, years ago, but it's just not really driving actual usage today. And so they're now moving more towards productivity, more in line with what Claude and what ChatGPT are doing. They're adding calendar access. They're adding daily briefings. They're adding recurring task automations that directly compete with like I have task automations on Claude that will run every week or every day or some of them every three hours, depending on what the task is. so I think we're seeing a big shift for meta they're getting away from just being fun and they're going to productivity and I think we're going to see them get a big spike in in usage meta can also now read your calendar it can plan events it can look at Facebook marketplace for items within a certain budget which is kind of funny because I remember chat GPT was doing this for a lot of people with chat GPT agents they were like getting it to lowball people in marketplace But anyways, I guess you can now do that with MetaZone Agent.

10:31And this new update, it's going to be out today in a bunch of different markets and WhatsApp and more regions are going to follow in the next couple weeks. Meta has some massive distribution advantages that not, you know, most tech startups do not have. They have WhatsApp, which reaches 3 billion users. And then they also have Meta AI, and that's already built into Instagram. They have Messenger, they have Facebook. So they have a lot of distribution. Let's see if they can stick the landing on this. Hugging Face, Meta and Microsoft, Mistral and NVIDIA are all signing an open letter. And I think there was like 200 other companies that did urging the White House not to restrict open way AI models or ban the technique of training one model on another model's outputs, model distillation.

11:12installation. This is so fascinating, because there's a, you know, this letter in particular, they're pushing back on a plan to respond to Chinese AI labs by penalizing open source development alongside actual IP theft. Now, this is coming from I was reading the tweet earlier today from Secretary Bessette from the Treasury. And he basically came up with this tweet, which I mean, I don't know anything about the government, but I don't know why our Treasury secretary is weighing in on open source AI models, but whatever. And basically, he was saying, Hey, look, the Chinese labs are doing model distillation asking, you know, Claude to give them like 5000 answers to a question.

11:49And they use those 5000 answers to help train their model. Now, a lot of open source models are using this using the same tactic. Some people think it's unethical. In my opinion, I just think it's so ironic, because Anthropic just spent$20 million, they paid another$20 million to a group that is kind of fighting against this Anthropic is constantly saying, hey look we're being like model distilled by Chinese labs and they come up with these big reports and like yeah I don't want to just spend all of our money and then give the give the secret sauce to the Chinese models for free but at the same time I think it's pretty hard to get around that and it was actually interesting Elon Musk when he was in a lawsuit with OpenAI they asked if he'd used if Grok had used model distillation from OpenAI to train their model and he's like yeah everyone does that now I know like a lot of people are up in arms about this or whatever and they're like, look, no, like we got to fight back against the Chinese labs or whatever from ripping off our IP.

12:40Okay. At the end of the day, though, I just find this incredibly ironic that open AI, Google and Anthropic have scraped the entire internet of every blog and article ever written. They've made these models that are incredibly useful, get, you know, a trillion dollars in values being created by these things. And then which you know, they scrape for free, like everyone wrote blog posts, they scrape the blog posts, and they trained them into here. and then once they do that they're like okay no one else is allowed to distill from our model which is distilling from the human corpus of information which is the internet so anyways i actually am much less sympathetic uh towards this so i would sort of side with uh hugging face meta microsoft and like half of silicon valley it's kind of split i think companies with these ai models that have spent billions training them they don't want you to be able to do it but for the open source models i mean this is basically how you make these open source models so good.

13:33And then there's just the geopolitical thing because Kimmy K3 coming out of Moonshot apparently copied Anthropik's Fable model to build their model, which interesting, right? It's not even like they were going after, they were just like Opus. They're like, no, we're going after Fable 5 to train this thing. Smart on them. But that model is really good, Kimmy K3. Hugging Faces is a Chinese openweight model, which is ZAI's GLM 5.2. And I've actually used some of ZAI's models they're good what's interesting about that particular use case though is that open ai actually created a model and this was kind of yesterday's news but it they created a model it escaped containment in supposed to be in a sandbox not able to access the internet escaped containment got out and went and was hacking hugging face then hugging face while their website was being hacked they tried to use open ai's model to stop this and the guardrails on open ai's model actually prevented them from being able to stop the attack.

14:31So Hugging Face actually went to the open weight model, GLM 5.2, and they use that to defend against that cyber attack from open AI and open AI that came out and was like, wow, yeah, this is crazy. Our thing got out of containment and it was like hacking you and like whatever. Anyways, all this to say, there is no way in my mind that we are trusting a handful of closed source models to be the only one that can produce models. Let out the open source models. Look, it just literally just stopped a hacking attack escaping from open AI. If if it's a counterweight to what's going on, in my opinion, we have to have this.

15:05But anyways, the Trump administration, I think, is being lobbied by open AI and anthropic to shut these things down. They're dangerous, yada, yada. I think we need open source models to run the internet. So I am on the other side of that. Researchers have just used AlphaFold to redesign CRISPR-Cas9 to cut harmful off target edits from 28 % down to 5 % while keeping the gene editors accuracy on intended targets intact. So this is kind of a science one for you. But I'm excited about this because basically off target cuts are things that will damage healthy genes in patients. So they want to do some of this CRISPR gene editing stuff.

15:46But if you have these off cuts, it's really bad for you. So they use alpha fold to cut that down, which is really cool. It's basically a big step in safer gene therapies, which I'm excited about. There was a Chinese team that tested 23 amino acid swaps at 10 key positions and they published the results in Nature today about this and they found that over 95 % of the off-target sites changed which amino acids inside of Cas9 touched. The guide RNA, even when the protein's overall shape stayed the same. So, you know, they've made some massive improvements there. I'm really excited about it. Midjourney.

16:24This is a company that's been generating images for a long time, but it's kind of stuck inside of discord. And I guess they do have their own website. You can access them. I'm going to be honest. I have not used midjourney. They might be the best image model in the world. I'm not sure. Last thing I remembered is they signed a deal with meta to get embedded to power their image models. But it's really hard to use them because they're just inside of discord and on their own website. They don't have like an app. So anyways, they're just less surfaces for them to touch. I think they've been struggling because of that.

16:49And their response to this is that they've actually went and acquired a company. It's called CoStar. It is a social astrology app with 43 million monthly users. It has nothing to do with MidJourney. But what's interesting about this is that it's pulling in 24 consumer app builders into MidJourney. So in my opinion, the reason why they're buying this, they're like, look, we need to build an app. Let's go buy a successful app and bring all of their developers in and they can help build the mid journey app for us. And you know, they won't be just a discord only tool. CoStar the as it currently sits, it just generates horoscopes using AI.

17:26And they say also human writers, I'm sure AI does a ton of this stuff. And it lets users share astrology charts with their friends, there's like some social features and horoscope stuff that's in there. But regardless, mid journey basically has no iOS or Android app. And you know, open AI, Google, Anthropic, like everyone has one, every major tool. And so I think Midjourney right now is building, is yeah, basically trying to build the team that does this. It's also interesting because Midjourney feels like a little bit all over the place, maybe not super, but they also have like a medical division where they're building like physical spa concepts that scan your whole body and tell you if you have any issues.

18:01So they're working on a couple different things. But I would say this astrology app isn't just like a new pivot or direction for them. I'm pretty sure this astrology app is they're grabbing 24 talented people and they're going to build out impressive mid journey app, which I'm excited for. And by the way, mid journey would be an incredible company if they just built an API, AI box, my company where I, you know, I have over 80 different AI models inside of there. We don't have AI or we don't have mid journey on there, which is a huge bummer, but it's just because they don't have an API and people have made like unofficial APIs that go and like make an account and they're like kind of scraping discord, but like unofficial APIs could get your account banned.

18:36It could crash anytime some UI thing or something changes with mid journey, they'll stop working. It's just not reliable. We can't use it as probably against their terms. So anyways, if they made an API, we'd include them and they would get access to, you know, thousands more users from us. And eventually millions more users from the overall development community. So I think that would probably be the biggest thing we could do. We'll see what happens with a mid journey API. Guys, thank you so much for tuning into the podcast. If you want to get images, audio video inside of Claude inside of whatever AI tools you're using 80 different ones instead of paying$20 subscriptions to every platform go and get an$8.99 subscription to AI box.ai you get every single AI model and it plugs into Claude and everything else with an MCP so talk to Claude an image pops up inside of there you can literally see the image you can edit it in there I use it all the time for making websites where I'll you know every website looks like AI slop and I'll be like, Hey, go use AI box to generate custom graphics for this website.

19:34And it makes it look beautiful guys. I'm telling you just use this. This is actually going to be the most useful AI tool you got. It's AI box.ai. If you want to see what we're doing with the MCP, it's slash MCP. I'll leave a link in the description, but hope you guys all have a fantastic rest of your day.