How 11 Labs API is Reshaping Music Innovation

0:0011 labs has just released an API for their music generator and this is something absolutely no one is talking about and I am super excited so today on the podcast I'm going to tell you why and also exactly what's a little bit of a little bit of a little bit of a little bit of a little bit of a little bit top 40 different AI models for 20 bucks a month, Claude, OpenAI, Google, and dozens more, 11 Labs for audio generation, a bunch of cool image generation models, 20 bucks a month, and you get access to all of it. So go check it out, AIbox.ai. There is a link in the description. Let's get into what 11 Labs has announced today.

0:49So a bunch of this is coming from their Twitter. They recently had like an X thread, and they said, introducing the 11 Labs music API. This is the first music API for developers trained on licensed data and cleared for broad commercial use. Okay, this is why I'm excited about it. Personally, I'm actually someone that has used a ton of different image generate or audio music generation models. The number one that model that I typically use is Suno AI. It's specifically for music does a bunch of cool stuff. And I have used this I've released full albums on Spotify, they get 1000s of daily streams with AI music.

1:23I know, I don't know, it's like controversial. Some music artists will come at me. I put my own special touch. There's all sorts of cool things you can do with Suno. For example, if you think of a song, you can hum a tune into it and then you can say basically the style. You want this to be a folk song and it will generate it. You can add lyrics or you can do instrumentals, which is what I typically do a lot. I'm not an amazing vocalist. And so yeah, you can do all sorts of cool things and make them really your own. So anyways, that's what I've typically used. Now, the problem is it is just a consumer tool.

1:52There is no API. You can't tie this into a platform or a software or tool. And so really it kind of limits the reach. Unless you're signing up on their actual website, you're not going to be able to basically get the capabilities everywhere else that has all sorts of interesting use cases, which I'll talk about. So 11 Labs has changed that. One of the number one audio platforms of all time is 11 Labs for creating vocal or for, you know, voices and reading and just basically audio. And now they've added music just recently. They added their music. And so they've added now the API, which is really cool.

2:22I was actually excited when I saw their music thing. It was the first time I was like, oh, I should probably look at something other than Suno because the quality on it looked really good. And then of course, now that it has an API, it like, honestly, it's possible they jumpstart Suno. It's kind of crazy to think about MidJourney was like the number one image generator for like a long time. And I almost never hear anyone talk about it anymore. The quality might be good, but like the use is gonna be super small because they basically locked themselves inside of Discord for a long time. And the number one thing that I think is a problem that they've never allowed an API.

2:54So something like me on AIbox.ai, my own platform, like I have OpenAI's newest image generation model because they release an API. And we get thousands of images generated from people that would want to try that out and use it there. And there's no way for me to add Discord without doing like a shady third-party API, which could get broken. And just basically no software companies are going to touch it without an API. And most of them can't. So anyways, this is really exciting. They said you can now integrate the highest quality AI music into your products and workflows. Since launch, creators have generated over 750 ,000 songs with 11 Labs music.

3:31This just came out like less than a month ago, I want to say. And yeah, this is impressive. Almost a million songs have been generated since it happened. I am not surprised. 11 Labs has a huge user base. And now that they basically have this API, I expect to see that number explode. So honestly, something I'm really excited about. This is what they specifically said. They said the 11 Labs Music API allows you to generate high quality tracks from a text prompt. And the reason I'm bringing this up is because like when an API comes out, it kind of makes sense for something like ChaiGPT API. You ask it questions, it responds.

4:05But when you do like music or video or even images, like there's a whole bunch of capabilities that sometimes the foundational, like the company that created it have. But they don't always move over to the API. So they outline basically what you're able to do with the API. Isuno, for example, lets you hum a tune and it will change it into a song. But if they had an API, I would assume like a feature like that wouldn't get ported over. Not necessarily, you know, for sure. But things like that don't typically or maybe they come later in any case. So this is kind of what Eleven Labs is outlining.

4:34So they basically let you put in a prompt, generates a track. You can create vocals or instrumental versions of any genre or in any genre, which is really cool. You can customize the length, structure and language. So they do have a whole bunch of really interesting settings there. and basically all these settings are what you can expect in a whole bunch of different software coming soon and they've announced specific partnerships they have already made basically who they use to test and create this api which i thought was cool so they said this is created in collaboration with labels publishers and artists songs were created with 11 labs music api are available for broad commercial use again amazing because of all of the lawsuits with suno and yudio and basically suno and yudio like if you have their paid plan they say you can use it for commercial use.

5:17They have like lawsuits based off of their training data with, I think, like different record labels and stuff. But I think that's kind of going to fall on them. They say it's good for commercial use. So I think basically you can use it. But 11 Labs is actually going quite a step further. When they did their training data, I noticed one of my distributors that I use is called Lander. And inside of Lander, there was this pop-up that came, I want to say six months ago, maybe even a year ago, which basically started saying like, hey, would you like to opt in to have your music included into AI training, we will compensate you for it basically.

5:48And some artists I said yes, some artists I said no on this. And it's interesting, because basically, when I saw this, I was like, okay, cool. I thought maybe it was Suno or UDO, they were trying to like, a lot of these AI companies are like train on data they weren't allowed to. And then they go back and try to like get licensing for data and do a retrain. And then when the lawsuits are all happening, like, Oh, look, whatever, we just we retrained. And now we're got the good data anyway. ways. So this is kind of isn't important. Let's move past it. I feel like that's kind of like open AI and the New York Times, like this kind of like a strategy.

6:21So I thought I was, I was assuming that was the, what was happening, but actually beyond Lander, just building another revenue stream for themselves. 11 labs, I'm assuming probably even contacted Lander and a lot of the distributors to try to work out these deals, make that pop-up show up because Lander's data they did confirm was embedded in this model and all those people are opting in. So it's like, you know for anyone that's like oh you know these ai models are training off of people's music and then um they're you know replacing artists and stuff well if you're using something from 11 labs all these artists have opted in and they're getting compensated so my mind like this is zero percent controversial and just a new revenue stream for artists okay they said it's designed for building apps across media and entertainment whether you're delivering personalized meditations producing music for video games or creating ai generated ads over the past weeks we worked closely with partners like Veed AMP and Hedra Labs to build the 11 music API.

7:17Okay, I want to talk about their partners. But first, I got to talk about a very funny element. And that is the fact that they said, based off of software, one of the one of like the startup use cases they mentioned here was personalized meditations, which is interesting, because a lot of distributors lender in particular, who has this partnership, giving them data, actually don't allow you to release like meditation music onto Spotify. Some people do, some people don't. Lander specifically doesn't, which is interesting because basically Lander's data was used. And then the use case that they're recommending, you can actually publish onto Spotify.

7:51But I guess if you're just doing software, like on inside of an application, then you can do it. So anyways, kind of an interesting thing. So they made a bunch of partners. The one that I'm the most excited about, they have AMP, they have Hedger Labs. Hedger basically does videos, which is really, really cool. They have a demo where basically it's like a woman singing an 80s song. And so Hedra makes the video of the woman singing, but now they actually have the song to go with it. And it's lip syncing up with the video. That is very, very cool for me, in my opinion, moving beyond just making videos.

8:22Now you're actually making a music video, which is crazy. Another one of their partnerships, which I think is pretty big, is with Veed. Veed is, you know, this huge video generation tool. It sponsored like a lot of podcasts. A couple of years ago, I think it sponsored the This Week in Startups podcast. And so like, I just know Veed has been shilled to me like over a hundred episodes that I've listened to. But it's actually a great video generation or video editing platform. I think it's basically a competitor to CapCut, kind of like Canva for video, I think. In any case, it has a ton of users.

8:55And so one of the big use cases that they're saying people are going to be using it for is AI background music, right? So if you're generating, if you're making a video, which is something that I personally have, you know, experienced a lot where I'm generating like some sort of video or editing a video for some, like a YouTube project is, you know, I used to have a YouTube channel where I'd put out weekly YouTube content before I had an editor and, you know, people that helped with the production on my podcast. And yeah, I remember this was a huge thing that would take me so much time. Basically, whenever I wanted like some B-roll and wanted to put music in the background, and I go to like YouTube has this like free music library place and like you could like search through and and like pick different songs and it would take like I'm ashamed to say I would sometimes spend an hour finding like the right music for my video because I'd just be listening to it and like you know if you had a good song you just kind of like use it over and over again you'll notice it's like Mr.

9:47Beast Mr. Beast or um Mark Roberg like Mark Roberg has the same song in all of his b-roll and he probably got that custom made so that he doesn't have to pay licensing for it. So like, that's probably one element of it. But also, then he doesn't have to sit there and think about what what the newest b roll song is going to be. So anyways, I think this basically solves that problem where you're generating, you're creating and editing a video, and now you can generate music in the background, you just describe the style that you want. You can do it. And basically, they say you can create a custom track, the AI analyzes your videos transcripts to generate a track that perfectly matches the subject and tone of your content.

10:25To me, that is very cool. You don't have to explain what you want. You just say, hey, generate like music here. It's going to look at the transcripts of your whole video. And it's like, okay, basically let's make a song like X, Y, Z. Now I wonder if I'm hoping you can switch. Actually, they did say in their API, you have the ability to switch between making it an instrumental or with vocals, but either way, very, very cool option. They said to showcase the power of 11 music in our API, our team also built Jingle Maker, a tool to create songs based on your X profile or website in just two clicks.

10:55This is actually really funny. They got the website jingle maker dot AI. And I think that more companies should 100 % do this. And basically, if you just if you go to jingle maker dot AI, which I did and test it out, because I thought this was hilarious, you can put a website or you can put your your profile in. Now, the one thing I'll say is that it's sort of like misleading on how it happened. The using your own profile, but basically, the way they explain it is like you you upload the link to your your Twitter account your x profile and it's gonna make like a song now my assumption was it's gonna be like a song about me based off my content i did that but it just made a song about like x in general so i don't think it like actually looked at the full url anyways whatever i'll forgive them for it was pretty funny it was a good song you can make a whole bunch of different styles of music and it's a very simple website you basically can make a radio ad uh midwest farmer of a rap uh drama trailer uh u.s politician style uh song whatever so like there's all these like funny things that you can basically um make now i think more companies should do this because basically they're displaying like they're showing look here's a new product and we've embedded the api in here and here's how it works and they make this kind of viral loop where if it actually okay it would be more viral if you could actually make a song about your personal profile and then you probably think it's really funny and post it unfortunately it doesn't look like that actually works.

12:14So I imagine the viral, the virality of that is not going to hit the way they hope, unless they fix that. I don't know. But in any case, I think this is genius. Make a viral loop with a product that's super funny. And it basically shows off what your product is capable of. I think more companies should do this. So I was excited. They said their API is available at 50 % off this month. So if you want to start try using it now, it's gonna be 50 % off. And yeah, I think this is amazing. Really, really cool tool. 11 Labs is, you know, the leader in voice. So it's cool to see them getting in more with actually making music, which is a growing industry.

12:51Anyways, thank you so much for tuning in to the AI chat podcast. If you enjoyed the episode today, make sure to leave a rating and review wherever you get your episodes. And also make sure to go check out AIbox.ai if you want to try all of the AI models I talk about on the show in one place for one subscription price. you don't have to have subscriptions to 10 different platforms you get them all on the ai box website thanks so much for tuning in and i will catch you in the next episode