Adobe's Firefly Gets Video Prompts

0:00Adobe Firefly now supports prompt based video editing. They're adding more third-party models into their platform. There's a ton of cool stuff that's going on with Adobe. And this is as the competition is really heating up from a lot of other players. OpenAI just dropped their latest image model, which is going to go into their video model. We have Sora that's out right now. And of course, everything from Google and Nano Banana and their VO video editor or video generator is really heating up the market right now. So we're going to dive into all of that on the podcast today, where the state of the market is, how Adobe competes with that, with their products.

0:34And before we get into that, I wanted to mention, if you want to try all the models that we're talking about on the show, make sure to go check out AIbox.ai. This is my own startup, and you get access to over 40 of the top AI models, everything from Gemini to OpenAI to Anthropic to Grok to 11 Labs for audio, a ton of cool image generators in there. It's 20 bucks a month and you get access to everything. So you don't have to have subscriptions to all of the top platforms. And you don't have to wonder where all of your content and data is and juggle between a million tabs. So I'll leave a link in the description for that AI box dot AI.

1:05Let's get back to Adobe. So Adobe right now they're updating their AI video generation app, which is Firefly. They're adding a new video editor. It's going to support prompt based edits, right? So you're, you have a video going, you can say, hey, change the color of this person's hair to purple. And all of a sudden in the video clip, the person's hair will change color. They're also adding a new third party model for some image and video generation. So they're going to include Black Forest Labs Flux 2, and they're also adding Topaz Astra. And I'm going to be honest, Black Forest Labs is a great model.

1:38We have it over on AIbox, and it kind of became famous for being the model that Grok on X and Elon Musk choose to power the image generation model on X. It's a It's a fantastic model when it came out. I think it's probably slipping behind some of the latest updates and announcements from Google and OpenAI, but I think they're scheduled for a new release on a newer model. So that should come out pretty soon. And in any case, the thing that's great about it is they have open source versions. Blackforce Labs, I believe, has some open source models and some other cool options there. So it is a great model overall.

2:18and I think you can also get an API directed from it. I think someone like Adobe is probably just grabbing the API similar to what I'm doing with AI Box. We have Black Forest Labs. We have a bunch of flux models inside and so that will help generate but it is a really good quality model. Up until now Firefly only supported prompt based generation so you would have to recreate an entire clip if any part of the video that you had if you didn't like it basically. So now they have this new editor and you can use a text prompt to edit different parts of the video. You can edit the colors. You can edit the camera angles.

2:53They also get a new timeline view that lets you adjust frames, sound, and other characteristics really easily. All of this came as Adobe did kind of an original announcement back in October. It was kind of this private beta. Now they're rolling it out to all of the users. And looking at it, it's pretty impressive. you can do a whole bunch of really cool edits inside of the platform. They said that using Runway's alpha model, users can now give Firefly-specific instructions like change the sky to overcast and lower the contrast, or you can zoom in slightly on the main subject. The thing that's cool here is it's not just, you know, when you say, like, zoom in, it's not just, you know, cropping in on the video and zooming in.

3:39It's literally regenerating it with a zoom So the quality is still at 100%. So I think this is fantastic. Runway does a great job. They also are making some great updates to their model. They've raised a ton of money. And so I think between Runway and Black Forest Labs for images, Adobe has chosen some great partners there. I will also say that Adobe has their own video model, their own Firefly video model. And so they'll also let you use that. I do appreciate that they allow you to use, you know, multiple models from you know something like runway for video as well as theirs i think people like having the ability to toggle between the two especially if one of them is better than the other if runway makes a big update and leapfrogs adobe um it feels like adobe isn't you know taking that too personally they'll just give you the options but with the new firefly video model you can also do some cool stuff you can upload a start frame and reference video of a camera motion and you can tell it to recreate that camera angle for a video that you're working on and it'll it's able to do that.

4:39To me, that's a really cool feature. They also said that you can use Topaz Labs Astra model to upscale videos to 1080p or 4k. So that's kind of cool, because a lot of these video models, you know, they can create a video, but it's sort of low quality. So then you're going and using this other model to upscale it to be, you know, 1080p 4k. Black Forest Labs Flux 2 image generation model is also going to be added to the app, like I mentioned, along with a collaborative boards feature, which is pretty cool. They said Flex 2 is going to be available on Firefly immediately, and then Adobe Express will be able to use Flex 2 starting in January.

5:17So these are, you know, phenomenal models. We're getting them. Just the ability to go from like 1080p to 4k, it kind of makes it so like on an image or a video, you could go from seeing like the actual detail in a piece of cloth versus just like seeing the outline of what's going on. I mean, I think we all know what an upscaler does, but like it truly regenerates the image as an upscaled higher quality image, which is interesting because it's a totally different piece of technology to upscale something versus to create it in the first place looking fantastic. So it's interesting that they have two different tools to help you with those two different steps of the process.

5:57I think there's definitely a lot of competitors releasing new models right now, images, video generation, Adobe wants to bring users in to use their apps more. They have a bunch of new updates to their Firefly app. They said that subscribers, if you have Firefly Pro or Premium, you get a ton of new credits. You get unlimited generations from all image models and the Adobe Firefly video model until January 15th. You get unlimited. So if anyone's interested, that is their offer. They also have a ton of changes inside of their Firefly model and apps that they made this year. in February they launched a subscription that let you access a bunch of different levels of image and video generation so they're trying to like figure out exactly how much to charge people they have different subscriptions and subscription tiers for how much you're generating and it's interesting because like on the one hand you have a subscription to use their products but on the other hand you you know you you want to be able to see how many like things you can actually generate or or how much of a power user you are it then launched their new Firefly web app they They have some mobile apps that they came out with this year, and they're adding support for some third-party models inside of Firefly apps.

7:04So it seems like this is something they're taking seriously. They're putting out a lot of new features and tools. I would not bet against Adobe. I think they're going to do quite well. They already have all the distribution of all of their kind of core legacy SaaS products, and now that they're adding AI into them, I think it's going to just streamline the process. They're competing against people like Canva in some areas, it feels like, but I think that they're going to do quite well with this. So it's definitely a company to keep watching out for. Thanks so much for tuning into the podcast today.

7:31If you enjoyed it, make sure to leave a rating review wherever you get your podcasts. And as always, make sure to go check out AIbox.ai if you want to get access to all of the top AI models in one place for$20 a month. I'll leave a link in the description to that. And I hope you have a fantastic rest of your day.