1. Podcasts
  2. The Neuron: AI Explained
  3. Pika Enact: Can You Direct AI Video While It Plays?
The Neuron: AI Explained

18 Nov 2026 · 45m · 17 chapters

Episode artwork

Pika Enact: Can You Direct AI Video While It Plays?

In short

Pika Enact explores “real-time directing” of AI video—moving and speaking to AI actors, changing backgrounds/camera while the scene plays—contrasting with prompt-to-generate tools that deliver a finished clip after a wait.

Guests (backgrounds)

  • Demi Guo, Pika CEO; previously focused on building AI video models and products.
  • Bataan Cohen-Grumy, creative leader/director background in traditional production; emphasizes visceral, set-like communication.
  • Lindsay Brilsen, creative leader; focuses on rehearsal/iteration and creative control.
  • Matan (mentioned as a director/creative-tech bridge; described as visualizing ideas via video demos that guide the company).

Key claims

  • Enact isolates an actor during playback and makes them respond physically in real time to dragging and spoken direction.
  • It uses a real-time streaming model with less delay than common chunked real-time video systems (described as avoiding ~5-second delays).
  • A “world model”/agent layer provides character memory/self-awareness so “Sarah” reacts to “Sarah,” not other characters.
  • Real-time models trade some quality for interactivity.

Notable examples

A live rehearsal/fight scene: line-by-line rehearsal, then “action,” with the background changed to a “kitchen at night,” actors moving and delivering revised dialogue immediately.

Written by AI. May contain mistakes.

Chapters

0:00

Introduction to AI Video Interaction

Learn how AI video tools are evolving from static to interactive experiences.

“When you're typing into a prompt box, it goes off into a black hole and there's no interaction.”
2:40

Pika's Evolution: From Generation to Interaction

Discover how Pika is shifting from generating video to real-time interaction.

“I guess to start, Demi, Pika began as a way to generate AI video from prompts, but now you're showing something that looks much more like interactive film set.”
3:31

The Director's Perspective on Pika Enact

Explore how directors perceive the changes brought by Pika Enact in scene direction.

“Generally speaking, we just feel like creative work, the hope is that in the future, people will be a much more accessible way for people to do the creative work.”
4:35

The Primal Nature of Real-Time Interaction

Understand the intuitive communication methods with AI in directing scenes.

“that made you think like, okay, this thing really changes how I direct a scene.”
6:02

Innovating Creative Production with AI

Learn how Pika Enact aims to make creative production more accessible and intuitive.

“And I just want to build on what Matan is saying.”
8:16

The Challenges of Bringing Ideas to Reality

Insights into the innovative processes and challenges faced in developing Pika Enact.

“Like we're thinking, okay, like I think the overarching question we're always asking is like, how do we make the creation process more accessible?”
10:40

Visualizing the Future of AI in Film

Discussion on the visualization of innovative ideas and the impact on the industry.

“one of the things I'm wondering is when when this idea came about that we're going to do this how how can we make this work?”
14:03

Innovative AI Model Development

Learn about the innovative AI model developed for real-time video interaction.

“I want to ask a few more questions about the live staging and kind of work through each of the pieces here.”
17:33

Directing AI Actors in Real-Time

Explore the process and challenges of directing AI actors during performances.

“And on top of that, we also have to build technology for specific for the condition that we want to achieve.”
24:29

The Multi-Model Approach in AI Execution

Understand the collaborative workings of different AI models in directing.

“The demo describes a rehearsal mode even, and how saying action then to turn that exchange into a clean take.”
Show all 17 chapters
28:00

Real-Time Direction in AI Video Production

Explore how AI can facilitate real-time direction of actors in video creation.

“So because the hope is that, okay, you're talking to actress, right, in the real-time middle.”
29:10

Mental Model Shift in Video Creation

Understand the evolving mental models in video creation with AI assistance.

“And she should recognize when I say Sarah, Sarah is moving closer, it's not Darren's moving closer, you know.”
30:50

World Model and Interactive Video

Learn about the concept of world models in AI and its applications in video.

“to think so you don't have to think about okay as a video artifact but think about like people and environment.”
33:10

Creative Ownership in AI Creations

Delve into the complexities of ownership and rights in AI-generated content.

“especially like focus on, I would say, that huge case.”
35:50

Future of Video Creation with AI

Discuss predictions for the future of video creation influenced by AI advancements.

“Is that your actor if you've created them?”
42:01

The Future of AI in Creative Work

Learn about the potential shifts in creative ownership and the role of AI tools for creators.

“And the animal handlers, which are always their own special breed.”
44:01

Exploring Pika and Enact

Discover where to find more information about Pika and its initiatives.

“and also having this set of personal tools it takes to go do that there's a lot of barriers there.”
A man walking through an airport, asking his phone a question

Ask about this episode

Get the gist, explore an idea or ask about something said.

Claude

On The Neuron: AI Explained, what are the key points of this episode?

Searching your listening

Transcript

Automatic transcript. May contain errors.

0:00When you're typing into a prompt box, it goes off into a black hole and there's no interaction. There's just a delivery. But with an act, even when you're moving a character around in a scene, they are acting and responding as though they are really being picked up and moved. Everything about the creation process with AI is about controlling exactly what you want. We've become, you know, programmers of like, you know, the creative process. And something about it brings it back to a very basic human level, interacting and trying to mold together what you want to achieve with an actor or a character.

0:35It's definitely a challenge because making it more efficient and more real-time obviously will have some trade-off in terms of quality. The real-time model is slightly worse quality than our real-time version. Welcome, humans, to the Neuron AI Explained. So most AI video tools have you describe a scene, hit generate, and wait to see what comes back. Pika has a much more ambitious idea. What if you could reach into the video, move an actor, talk to the cast, or change the camera while the scene is still playing? Today, I'm joined by Pika CEO Demi Guo and creative leaders Bataan Cohen-Grumy and Lindsay Brilsen to discuss Pika Enact, the technology behind it, and who really controls the creative process when AI starts taking direction.

1:25Before we get started, please take just a second to like this video and subscribe so you don't miss our other interviews and live streams moving forward. And on that note, everyone, welcome to the Neuron. So excited to have you here. Thank you. We're excited to be here. Yeah, thank you for having us. Excellent. Support for today's show comes from Alumni Ventures. Your financial advisor might be perfectly happy keeping you in public index funds and spending the afternoon out golfing, hoping you don't call. But public markets are not the whole market anymore. For more than a decade, Alumni Ventures has given individual accredited investors another option, access to blue-chip venture investing.

2:05Their team does the professional diligence while you get the opportunity to build your own portfolio and invest alongside leading VC firms. Time and CB Insights both rank Alumni Ventures, a top 20 U.S. venture firm. You can sign up for free, see the weekly deal flow, and decide for yourself. Or write one check into the Foundation Fund for a diversified portfolio of about 25 private venture deals. Go to av.vc slash neuron. That's av.vc slash N-E-U-R-O-N. Now back to our regular episode. I guess to start, Demi, Pika began as a way to generate AI video from prompts, but now you're showing something that looks much more like interactive film set.

2:54And you kind of walk us through what is Pika in Act, and what was the moment when you realized that just generating a finished clip wasn't going to be enough? Yeah, for sure. I guess our company, you know, since the beginning, we're always very excited about like building toward the future of like AI for creative work. We feel like AI will transform all the industry as we see as we transform engineering, legal and prior works and so on. And what we're very excited particularly is how will AI transform the creative industry. I think since the beginning, we founded a company a couple of years ago, and we've been always trying to build research and products towards this mission about defining and thinking about what's the future of creative work.

3:45Generally speaking, we just feel like creative work, the hope is that in the future, people will be a much more accessible way for people to do the creative work. and to really express their creative ideas. And this approach, I think something we're going to share today, is also one along the line that we're trying to innovate, how the future of creative world will look like. Yeah. I can talk more about it, but happy to share it later. I guess I want to ask a question of Matan real quick here, too, because I know that you've worked in traditional productions in the past. You are a director. And I'm wondering, what was the first thing here with an act that made you think like, okay, this thing really changes how I direct a scene.

4:41This is something. I think for me, conceptually, that sounded interesting, like the vision for it when Demi suggested it. But I think my mind was blown away just experiencing it for the first time because it was like the first time that you know it felt very close to home i would say but also even without thinking about like old experiences like for directing just the experience on its own just felt like so different we try to control the creation in ai in like many different ways but that felt like something else yeah what can a human director communicate by grabbing a character or giving a spoken note that the long text prompt just can't yet or may never i think there's something just very primal about it right like very intuitive and primal about this method of communication because again it feels very close to how you would do it on set so in a in one sense like when ai is advancing and We're trying to control it better with better prompting and agents and whatnot.

5:51This feels like going back to the basic in a very intuitive way. So, you know, just talk it out, right, like you would do on a set. Yeah. And I just want to build on what Matan is saying. Like, there's something very visceral and just sort of magical about the response that you get. When you're typing into a prompt box, it goes off into a black hole and there's no interaction. There's just a delivery. But with an act, even when you're moving a character around in a scene, they are acting and responding as though they are really being picked up and moved. I noticed they swing. Yeah. Yeah. I mean, I was blown away by that.

6:40Like, first of all, it's just like a feat of technology to be able to isolate that person while the scene is still playing. But on top of that, to have them reacting in real time physically in a way that really matches the action that is being enacted upon them is just incredible. um but yeah to have that kind of immediate feedback is is just truly a different feeling a different experience a different um degree of control i think that you feel um as a creator that makes you feel just much more connected to the output definitely yeah certainly you're part of the experience i think it's it's different than trying to control the experience yeah i'm also happy to maybe also talk a little more about premise of this so i think we started a company three years ago i think like i mentioned that was kind of our goal to like really explore innovate along the line of like defining how the future creative production or creative work will look like initially it was mostly the model side of things so building video models later on it might be templates having more like templates for people to more easily be able to create videos and nowadays we're about agents, right?

8:03Building agents to make the creation more accessible with AI and enact like the real-time directing experience is another step that we think potentially in the future we will again transform how people do to create production. Like we're thinking, okay, like I think the overarching question we're always asking is like, how do we make the creation process more accessible? It's not necessarily more accessible to non-creators. is also more accessible to create professionals. It's really about making the create idea more accessible into how do you turn it into production. And we feel like potentially, agent obviously really improved the accessibility.

8:46It's much easier than you have to, in the past, you have to write very long prompts. Agent may get much easier. You were just able to talk about your intentions. But we feel like potentially in the future, the best way for people to create videos or, you know, create films or create advertisements is actually mimic our same direction experience as how people are doing in real life today, but with the real-time AI technologies. So, and in that is, you know, design developed in that premise that we're thinking, okay, in that can, you know, it's just like how you would direct in real time. we feel like in real life we feel like that probably might be the most intuitive interface because that's how people are doing in real life like you're able to real time stage the environment and real time like talk to the characters to direct them on how they should act and also real time controlling the camera so all the pieces that you would do in real time like real life directing today you will be able to do it with real-time AI technology, which I think is really transformative because it's really different.

10:09We feel like it's a very innovative and a very different experience than the current creation today, which is still a little bit inaccessible for some people. That makes sense. Yeah. I this is I mean I we haven't even talked about this but this is this was an ambitious project like this was not a thing that is it had not even crossed my mind yet that this is a way we would want to interact and I mean obviously it is the second I saw it I was like oh of course and uh one of the things I'm wondering is when when this idea came about that we're going to do this how how can we make this work? Did it, uh, did it seem like we can do this or was, was there a lot of, is this even possible kind of mind?

10:58What was the mindset around it? Yeah. It's, we're always like, you know, for us, like innovation, it's like, I think our company is creative at heart and also really, um, always thrive to innovate. And also we're all like, whether you're engineer research or creative team, obviously are all like both technical and also creative um and and then we're always you know creative at a heart innovative at heart we're always willing to take challenges and to invent what's not impossible so it's not some it's like we always like that's kind of our philosophy um and um kind of obviously it's very like it seemed very like impossible um and um it has really develop through like a constant iteration between the creative and tech and researching so uh yeah it's really um maybe matang can talk a little bit more about process is yeah wow i think before i talk about the process is um i think one thing that excites us a lot of the time is seeing something for the first time that you've never seen before um i think in this process demi just kind of had this vision and outlined the idea and at first uh you know very visionary ideas even as simple as they you know may seem sometimes they are hard to grasp because you never saw them before so for me my process was like like confusion like what how and then usually what i do is i just try to quickly visualize that um before we even try to build because there's you know there's one way you can talk about an idea and it's i think it's old a whole different process to see that idea and i'm a very visual person so the first thing that i was trying to do was just like try to visualize like okay wait wait a second how does this look like um and i think once we saw it like we uh like was maybe oh this is very exciting and then then came the part of like actually making turn this into reality with research and you know making this a possibility and it starts looking like you can do it, I guess.

13:04Yeah. And I just, to share a little behind the scenes, you know, Matan is such an incredible bridge between creative and technology. He frequently does visualize these ideas by turning them into video demos that become kind of the North Star for everybody in the company to work towards. and I would say I remember seeing this video a few months ago and thinking like that is insane that is like years in the future and the demos that we're looking at today are very very very close to what he had put forth in that video so the best ideas always sound like crazy talk for a minute like I imagine the idea for the iPhone was uh uh it it had to just sound insane to people But what you all have brought together here is something really cool.

14:03And it seems very complex. I want to ask a few more questions about the live staging and kind of work through each of the pieces here.

14:31One of the things that's really interesting about this to me is as I'm watching, for starters, watching a character be moved is I feel like there must be a lot of things that the tool has to get right for that to work. Is this really complex? Yeah, obviously. So this, I guess this model is developed on top of first. So we actually recently launched our own model, developed open-weight models. So our own big models, developed open-weight models. It's actually ranked number one among all the open-weight models. And it is the most efficient in terms of speed and cost while maintaining really high quality with similar quality with the other open-weight models, but the most efficient.

15:26and this yeah this Enact is developed on our own model, that model it's called H3 Flex so it's developed on our PicaFlex and we, you know it's a very like because it's a very innovative task we had to do a lot of innovation around technology as well both including how do we build the data and how do we train design architecture and train models. So we, on a high level, we build our own data engine for this specific task using a combination of 3D approach and AI-generated videos and to construct the data for this task. And model architecture-wise, we also have to develop like new technology that help the model to condition on these like very diverse type of inputs.

16:32There are many real-time models out there, but most real-time models are actually has some delay. I'm not sure if that's how everyone understands. So all the current real-time video models out there, like the common one, like I think Felmac, I mean H3 Max or something, they all have like five second delay so it's really like chunk based so it's like you have to it's real-time streaming but it's not real-time interactive because there's like generating like all seconds by five seconds by chunk but our model because we require real-time interactive interact activity we actually had to train a much more efficient a real real-time model for this use case, which are really streaming, but almost like, so then it doesn't have this delay issue.

17:28So that's a very, I would say, innovative technology as well. And on top of that, we also have to build technology for specific for the condition that we want to achieve. You mentioned that in talking a little bit about the data for creating this, that you've had to do a lot of that yourself. And I understand you had simulated 3D stand-ins and working with mouse trajectories and all kinds of things, trying to keep backgrounds straight. That feels like that's not just data you go buy off a shelf or download off the Internet. Yeah. So for the data, we basically build our own engine for generating, it's actually more synthetic data.

18:17So it's more like we, it's a combination of like we render 3D first and using agent to render more 3D data. And then we render into photorealistic videos through a slower but higher quality video models. okay very cool very cool it seems like one of the hardest parts might be turning a model that renders a complete clip into a a continuous stream that's able to respond to you as you go and i'm wondering kind of how did you make that work to what extent you're able to share without the quality falling apart. Yeah, for sure. It's definitely a challenge because making it more efficient and more real-time obviously will have some trade-off in terms of quality.

19:11To be frank, obviously the real-time model is slightly worse quality than our no-time version. But yeah, indeed, it's a challenge. So it requires a lot of innovation. on like it requires like making sure that data is really high quality uh and making sure the architecture is the right architecture um but also a lot of like inference efficiency inference techniques um that are like lossless um or uh like and require some engineering and some experience as well um so which is uh for us we had the i would say uh have to um advantage or like luckily like we had a lot of experience on those like efficient inference techniques because our like other models such as a pickup flux is also really was able to achieve such efficiency is also because we were our team was able to apply a lot of efficient inference techniques on both model side on inference and on like more like infrastructure side nice i'd like to also talk a little bit about directing actors because this is something that is really really fascinating hi hi both how are you how are you doing hi we're both doing well thanks how are you doing yeah we're good how about you great um the scene we're gonna do is a dramatic fight between the two of I think first we can rehearse the lines.

20:48But before we do that, can we maybe change the background to kind of like a kitchen night scene? Yeah, a kitchen at night sounds good. I'm ready to rehearse the fight.

21:04Let's bring the lights up, please. It's a little bit too dark. Okay, great. Let's do this line by line. Alice, your first line is, You said seven. I thought something happened to you. You said seven. I thought something happened to you. Bob, then you replied to her, Nothing happened. I was just working. Nothing happened. I was just working. Alice, you say back to him, You could have called, but you choose not to. You could have called, but you chose not to.

21:50Bob, then you reply back to her, I'm doing all of this for us, for both of us. I'm doing all of this for us, for both of us.

22:03Alice, this is where you get a lot more emotional, and you say there is no us if I'm always alone. There is no us if I'm always alone.

22:17And okay, that's great. Let's now let's go into action. Let's do all of the lines. And I want you to first, before you start saying your lines, face each other. And when you're done with your lines, Alice, you should kind of grab Bob and then, you know, you should turn away and leave the frame. And Bob, you stay there very upset. And action. You said seven. I thought something happened to you. Nothing happened. I was just working. You could have called, but you chose not to. I'm doing all of this for us, for both of us. There is no us if I'm always alone.

23:02and cuts Lindsay with live direction you can tell an AI actor to to move closer to someone deliver a line differently or change the set and the actor responds the video keeps going how does that feel creatively? Does it feel more like editing or directing actors or kind of improvising with a cast? Or does it feel like I'm doing something weird sitting at a computer? Well, like I was saying with the real-time dragging and the way that there's just an immediate response that feels so human, it really truly does feel different than typing into a box, hoping for the best, getting something back two minutes later.

23:51Being able to see the actors sort of acknowledge, listen to you, take something in, rehearse a line, play it back to you immediately. And then also remember compounding comments and feedback and take that into the final performance. I sound like I'm like a super fangirling over our technology, and I kind of am because it is really kind of mind-blowing. It's just so different as a creator than it is to do it the old way. The old way. The old way of using a text prompt. The old way of Q1. Right, exactly. The demo describes a rehearsal mode even, and how saying action then to turn that exchange into a clean take.

24:50And I'm wondering, what can still change between a rehearsal and a final performance? I mean, I think just like any directing experience, and I'll also give this to Matan because he experienced it firsthand. You know, you can change your mind. You can have them try a number of different ways. You can land on one, tell them to stick with that, lose the others, and also see a bunch of different camera motions, see different motions, see different gestures. It's just wildly different. Yeah. Nice. Matan, what was your experience with that? Yeah, I think there's something in the process that something in the way that, you know, we work with Enact is kind of humanizing it back again, because in a lot of senses, we kind of lost that.

25:47We're like very like everything about the creation process with AI is about controlling exactly what you want. And, you know, we become, you know, programmers of like, you know, the creative process. and something about it just you know bring it back to a very basic human level of just you know interacting and trying to get you know mold together what you want to achieve with uh you know an actor or a character again it it felt um like i felt two things uh the first time i tried was like oh this is definitely a glimpse of the future but also oh this is also familiar you You know, so it was very interesting to see, I would say.

26:28And like, you know, it's very different. Very different from any other. It's very different from any method of creation within AI that I've experienced before. That's awesome. Well, I understand two systems work together here. A script model that converts your direction into short-time beats. and then a video model that's working with there that's helping perform them. There being like kind of multiple layers to this. Like I understand there's a script model, a video model, and a voice model because you're also speaking to it and communicating with it. And I feel like there's this group of different AI working together to build this thing.

27:14Is that correct how I'm seeing it? Yeah. So from a technology standpoint. point yeah so gotcha yeah so we yeah so that's more like an architect design thing so kind of the model we develop traditionally most models are just taking to text input and maybe now with reference to text video model i guess reference video model you're taking to like multiple references right like image reference text reference auto reference usually so for this you actually also take into interaction inputs um and then so it's like it was more like a multi model model um it's like in some sense if we use apply a buzz word best word that people are talking about it's more like a world model which because it really models like different aspect of modality and a different aspect of interactions so to answer your question yes so the model basically natively take into all those modalities interactions as important also outputs the The agenda layer right now is mostly about more when you're real-time directing.

28:18So because the hope is that, okay, you're talking to actress, right, in the real-time middle. Yeah. So you might talk to different characters or different actors. The hope is that you can like a very, what we're hoping to achieve is like, okay, talk to actor A, I don't know, Sarah and actor B, I don't know, like Darren or something. and then like, and then like, you're able to tell, oh, Sarah, can you like stand a little bit closer to me or you can guys stand a little bit closer or can you make sure you're more emotional when you're talking about a script? So the agent later really comes into like, regular for video models, there's no like memory and there's no like concept about self or concept about characters.

29:04So the agent later is really helpful for that. Our goal is like, okay, so Sarah, when she starts acting, she should remember, tell her to, you know, when she recites the line, she should be more emotional, for example. And she should recognize when I say Sarah, Sarah is moving closer, it's not Darren's moving closer, you know. So the age player really like give the characters or give objects and characters in a scene a meaning and self-awareness and memory. So that's how it's used. Yeah. And I guess you still have to give them pretty specific direction, just like probably to some extent, maybe like you would with a prompt as far as making sure this actor understands, like, I'm talking to you here and I'm talking to you here.

29:51But but I mean, I mean, I guess you've got to do that in person, too. I just I think I keep seeing this kind of kind of a middle ground that's probably going to continuously get a little more like working with people. exactly the goal the agent is really trying to it's really like what's fascinating about this is really a change of mental model of how you create videos so very initially it was mostly about prompting so the mental model is really like this you have to actually prompt okay 35 millimeter like i i'm not even creative it's probably lindsay mahano knows better like very precise oh this is a muted talk like they're very precise like description like of the objects and characters with agent becomes like better because we can describe the intention of the video on the crate um but then with this new interface in that real-time interface we're developing is it become even a higher abstraction of mental like way for you to think so you don't have to think about okay as a video artifact but think about like people and environment.

30:58Yeah, I think there's two parts of it, right? The first one is like writing your idea down and then there's like, you know, treatment and delivery. And that's what a director does in a sense, right? He takes a script and he works with the actor about the delivery of that concept or script. So again, coming from not from, because I'm not a script writer, coming from directing that felt, that piece that was missing in a sense. Yeah, and also it's a more like iterative and visualized process versus before. So yeah, it's a more, in our sense, more intuitive. It's like, you don't have to think about, oh, like, it's less about like, okay, what kind of video I want to create?

31:39But it's more about like, oh, like, should it be standing closer? Are you like visualizing it and see, oh, maybe some lighting here or maybe the camera should go around or maybe you should be more emotional about it. So it's more thinking real time, more iterative and also more intuitive, just like how you talk to actors. This keeps bringing me to the idea of like, when I think of live camera control and things like that, that are really ambitious and that you all have implemented in this, are you making like kind of a world model type thing that is able to, I mean, to be able to see off camera, some of that has to, I assume, exist and auto-generate.

32:21And I'm wondering, is it generating this as it goes or is it kind of building the world in advance and then you're able to just work the camera from there? Is that, I realize maybe that's a little more technical, but. Yeah, it is. It's basically, it is a world model. So, I mean, people have different definition world model. It is world model in the sense that it is real time. It is interactive. It is modeling the world. Yeah. and we take multi-modalities. And so, yeah. And then it's technically the model can do anything. Can also do gameplay or whatever. But because we're really focused on defining the future of creative work again, so it's really a model specifically for how people will be able to create videos in the future, especially like focus on, I would say, that huge case.

33:16Yeah, but a lot of technology are very fundamental in a sense that can be potentially applied to other use cases too. Okay. Okay. I would say one thing about the camera director part that is maybe a little bit different from the native experience of like directing on set, but it's also a huge unlock. Because when you're on set, you're trying to kind of control everything together and make it come together. so the camera and directing the actors that need to happen simultaneously and in this process you kind of uh separate the two parts to like two phases where you first you know you get your perfect performance first from the actors and then you can go in once you lock that perfect performance and you know start you know seeing different versions of just like the camera work and i think that's also very intuitive to camera work because um when you think not about a director but more of like a cinematographer is watching through the lens and, you know, he directs the camera in real time while he's watching this scene.

34:24So I think that feels like a huge unlock, I think. And you're not dealing with 20 takes of the same scene where you didn't have the camera where you really wish it was for this magical moment that's not going to happen again no matter how many times you try. Exactly. Exactly that. That's the exact unlock, I think. That's so cool. So as far as availability goes, I understand H3 Flex can be available via API, correct? Or is, I should say. It's been out. It's available via our Pika API Club. It's also open weights are available on Hug and Face. And it is newly available in our creation platform. Awesome.

35:11Yeah. Very, very cool. I also have a few questions I'm wondering about around the creative ownership end of things. And Lindsay, there's sort of a new kind of control here around this sort of stuff. And I wonder if just because AI enables me to bring in a photo of a person or generate a speaking performance or something, who should really own or govern, I guess, maybe is the question, that likeness, that voice permission. Because I assume even if you're creating a character in much the way that if that was the image of an actual person, is that your person? Is that your actor if you've created them?

36:00Whoa. Interesting question. Yeah, I mean, you could think of it as your own IP, right? If you've created something with AI, it's no different than if you've created it using clay, paint, illustration, your own personal performance around the bunny that you've decided you are. Yeah, so for sure, if you've made this your character and we provide commercial use licenses for that in Pika, it is yours. wow yeah it's an actor active creation right yeah yeah different I it crossed my mind as I was reading about this beforehand and I was like who owns the who owns the creative it felt like uh I mean I guess it's it's creative in the sense that that we think of you know if you made an ad for someone or shot a commercial or you designed a book cover right and I'm wondering as a creative director here, how do you decide where the line sits between like a shared idea or ordinary creative references maybe?

37:23Do you feel like that's kind of blurry right now or do you think there's any idea where this will go as a direction? Just with like AI in general, I know that there's just a lot of questions around ownership with training data, etc. But I think that the same standards of integrity and creative originality still hold for people who work in the industry, regardless of the tool that they're using. so if I illustrate something by hand that looks exactly like another a well-known artist it's the same as if I pull in a bunch of references into AI and like try to replicate it it's you really have to be the police you have to police your own actions um and you have to be aware of what is homage and what is stealing um and it really is in the hands of the creator to be aware of that um but all great creative work is born of inspiration you know it doesn't exist in a vacuum so i think that people who i mean i'm getting a little you know soapboxy here but i think that people who complain too much about references are sort of ignoring the vast history of our artistry and creation and how everything is informed by something else.

38:49I think Eric Clapton once said of music, there's only 12 notes, you know, there's only 12 notes and, uh, and we've all been playing them for the history of music. And, uh, I always thought that was, that was really interesting to remember. I have a question I'd like to ask all three of you before we go. So imagine we're having this conversation, let's say three years from now. What do you expect will be the biggest difference broadly around making video from the standard today? Yeah, I can start. I think kind of the enact is kind of our vision of what maybe will evolve in the future. because right now video creation i would say most people are still using like web like app-based video creation which is more like prompting maybe slightly easier prompting now uh and templates um apps mini apps um there's some people starting to use like agent in mcp uh or agents um and we feel like you know even with agent it's still not the best creative process it's still not the most accessible process and not the best process because it's still fairly technical it is not very intuitive like how people direct in person you don't feel like visualize or like you don't feel like as much control uh it's still a bit technical and also lose a little bit of fun of the creation process.

40:23Yeah. So we actually think that future maybe the create process will actually transform from the agent to the real-time directing process we're talking about, which people are, the technology will immerse people to have the same intuitive, controllable and visualized creation process like helping virtually in person today, except with like much less constrained on it will be much cheaper. you will be much less constrained like you right now you cannot actually direct a dinosaur but in the real-time directing process you actually can direct a dinosaur you can says all the time never even thought of that wow yeah but yeah so like you can direct the actors through really complicated actions that's not possible right and clothes that's not possible or direct very impossible characters, but in the same experience as how you would direct a real person.

41:23So you don't need the VFX stuff, but then that I feel like is very exciting. Maybe Ningse or Nielabri more, Matan. Who do you think? I think you were spot on. Who has some thoughts? Yeah, I think you were spot on. It's not just like, Like, how can we do it the same way we did? Like, just like, what more can it, you know, unlock using this? Yeah. It shouldn't constrain you in any way. It should do the exact opposite. You won't need to hire a bear on set around all of your people or things like that when you need animals. That's wild. Yes. Exactly. And the animal handlers, which are always their own special breed.

42:10A bird story. Yeah. I'm sure you have. From my perspective, I would answer the question slightly differently and say that I hope three years from now, the types of people who are creating are different, vastly different from what we see today. Right. You know, we were talking before the show started about adoption of AI creative, both from the creation perspective and the consumption perspective in the United States is not as high as it is in the rest of the world. And there's a lot of contention around it. And I think for creative professionals right now, the adoption has been slow and there have been a number of barriers to that.

42:52one is just the upskilling that you have to do you have to learn entirely doing the thing that you've always done well and now you're not maybe as good at it because you have to learn the art of prompting and there's this the quality issue where it's never quite what you want it to be and then i think that there's this element of control and authorship i think a lot of the outrage is that it feels too easy or you're not really the person who has produced the work because AI has done so much of that. And my hope is that things like Pika Enact and all of the initiatives that we're working on can return that feeling of creative ownership and craft to creators so that they feel closer to the work they don't have to learn all kinds of new things in order to make they can flip back into their old ways of creating and focus on making incredible things yeah because having a having a vision for something in your mind that you want to create and also having this set of personal tools it takes to go do that there's a lot of barriers there.

44:13And I think what you all are working on really knocks a lot of that down. Demi, Matan, Lindsay, thank you all so much for joining me. It's been fascinating. Thank you. Thank you. Before we wrap up, where should people go to learn more about Pika and Enact and H3 and all of the other great things you all are working on? I think our website, Pika.art. Pika.art. Will be a great place to start. Cool. Well, to everyone watching or listening, thanks so much. We appreciate you being here. If you enjoyed today's conversation please take just a moment to like and subscribe you can also stay on top of all the latest ai developments with our daily newsletter the neuron and join around 750 000 people who read it every morning we'd love for you to be one of them and that's all we have for today so farewell for now humans

45:13We'll see you in the next one.

From the publisher

What if making an AI video felt less like writing a prompt and more like directing a film set?


Pika is experimenting with a new approach called Enact: interactive AI-generated scenes where a creator can drag an actor into position, speak to the performers, or rethink a camera move while the scene is taking shape. Instead of asking for another finished clip, the director participates in the process.


Pika CEO and co-founder Demi Guo joins creative leaders Matan Cohen-Grumi and Lindsay Brillson to explain the idea behind Enact, why these tools feel different from conventional AI video generators, and what their team had to invent to make responsive generation work.


We also get into the limitations: video quality versus speed, what an AI actor needs to remember from a director, camera control, access to Pika's H3 Flex model, and who owns creative work made with AI. The bigger question is whether tools like this can help filmmakers feel more connected to the work rather than less.


Pika: https://pika.art/Pika H3 Flex and product information: https://pika.art/blog/pika-h3-flex


For more conversations about practical AI and where the technology is going, subscribe to The Neuron AI Explained and The Neuron daily newsletter at https://theneuron.ai/.


Sponsored by Alumni Ventures.

More from The Neuron: AI Explained

All episodes