

24 Oct 2026 · 1h · 19 chapters

Parallel’s thesis that AI agents will use the web 1,000–10,000x more than humans, requiring a “parallel web” layer for fast, efficient agent search, browsing, and monetization/incentive alignment. The ex-Twitter CEO argues agents will shift the internet from pull to push, and that ads/subscription models tied to human browsing won’t survive when agents do the browsing.
Prak (Parallel cofounder/ex-Twitter CTO/CEO; PhD; 11 years at Twitter; previously obsessed with agent/web scaling since ~3.5 years ago). Interviewer: Molly (Sorcery host). Mentioned partners/customers: Index (investor), BrowserBase (integration), Harvey, Notion, Muse, OpenAI, Instinct, Vercel, Stripe, USV.
“Thousand X was too low”; current agent traffic is estimated at 10–20% of human web usage; web search must hit ~150–200ms for voice agents; Parallel optimizes search for cost/latency and GPU efficiency; web monetization needs “agent ads” that pay content owners per read.
shipped BrowserBase integration; turning off web search in ChatGPT disappoints; voice agents make slow search “ridiculous”; GPU sourcing requires right model/location/latency.
Written by AI. May contain mistakes.
Explore how Parallel has evolved and the growing belief in AI agents' potential.
“but what have you gotten done this week?”
Discuss the high search activity of AI agents compared to humans and its implications.
“I was the lunatic walking around three years ago telling people agents will use the web thousand x more than humans ever have.”
Examine the current state and future growth potential of AI agents in web interactions.
“It might take us a few years, but thousand is a low number.”
Analyze the challenges faced by AI agents and innovations improving user retention.
“I think in the Bay Area and Silicon Valley, we're all living in a little bit of a bubble.”
Discuss the role of GPUs in AI model inference and web search efficiency.
“So how did you, you mentioned this at the start of the interview, but like you've been obsessed with this for a while.”
Learn about the increasing demand for GPUs in AI model inference and the challenges in sourcing them.
“Those were all bits of information and news to me along the way.”
Explore the evolving expectations for AI scale and performance based on historical insights.
“Our right goal is to grow faster than inference for agents for knowledge work or consumer agents grow.”
Discussion on how AI agents are transforming internet usage and business models.
“Now you go into the web piece of the infralayer.”
Exploring the challenges and solutions for content monetization in an AI-driven world.
“Other business models were like either affiliate business models or you drive a transaction of some sort.”
Examining the complexities of bot detection and the transition from bots to agents.
“version of we can call it Adsense which is easy auto differential pricing actually provides content owner value for high quality content.”
Addressing the cybersecurity risks posed by AI agents and the strategies to mitigate them.
“So earlier I spoke about the incentive alignment needed on the content side, which is like, why do I let you read my content?”
Discussion on the importance of distinguishing between beneficial and harmful bots.
“And so that creates a lot of vulnerabilities.”
Exploring the necessity of alignment and safety measures in AI deployment.
“While an agent is a more appropriate word, I think agents are perhaps the good parts, mostly.”
Explore how to effectively recruit talent as your team scales rapidly.
“I think we started the year close to 30.”
Understand how web search optimization impacts AI model efficiency.
“The third reason is when people have really scaled use cases and now start optimizing for measuring ROI, optimizing for end-to-end costs.”
Learn about the shift from pull to push in web interaction with AI.
“And so you'll see a bunch of on our website you'll see like put this prompt into your agent and then it'll exactly know how to use parallel to solve whatever problem you're trying to solve.”
Discover the significance of partnership in personal and professional growth.
“that changes on the entire web to know when your agent needs to act on something on your behalf.”
Learn strategies to maintain composure amidst significant pressure.
“So this is what now everyone's talking about, right?”
Explore the philosophy of handling pressure and internal expectations in a competitive environment.
“So it's like kind of a self-fulfilling prophecy of sorts.”

Get the gist, explore an idea or ask about something said.
On Sourcery, what are the key points of this episode?
Automatic transcript. May contain errors.
0:00Parallel web systems closing a$100 million Series B funding round last month, valuing that AI startup at$2 billion. You were at Twitter for 11 years. You were CTO, then you became CEO. I was also an engineer before that. We're building a collection of APIs that agents use to search and access the web. Parallel is an almost three-year-old company now. I was the lunatic walking around three years ago telling people agents will use the web a thousand X more than humans ever have. Most people didn't believe me at the time. I was wrong. Why? Thousand access to low. My deck literally contained a section which is like, are we too early?
0:36Turns out we were not too early. We're building a parallel web for agents. We can transform the web even if you don't publish your website to be agent friendly. We'll do that for you. In such a competitive career in every stage, how do you not break from the pressure? What pressure? You don't feel pressure? No.
1:03Prak, welcome to Sorcery. Thank you for having me. Well, we're in Index's office in San Francisco. It is gorgeous here. They're one of your investors. I'm not sure if you've ever gotten asked this question before, but what have you gotten done this week? I'll tell you what I got done today. We just shipped a really exciting integration with BrowserBase. We now power search in BrowserBase. And if you think about every AI agent that people use, what are they doing? They are looking at your internal information. They're looking at web information. They're searching a bunch, a bunch more than us. Then they're going into a browser, logging in and doing something, buying something, writing something.
1:47So that's what we got in today. Congratulations. We were talking a lot before this and we were having a really great discussion. Every interview I've had recently is some sort of explosive growth of agents. And it's going to be really fun to unpack all of that because from your point, you were talking about read versus write, what you're doing versus browser-based. So I guess to start, let's talk about that. Parallel, what is Parallel? How is it different? How has it evolved? And how are you learning as things are just changing so fast? Yeah, Parallel is a three, almost three-year-old company now.
2:24I was the lunatic walking around three years ago telling people agents will use the web thousand x more than humans ever have. And there were no agents. Agents didn't work. Most people didn't believe me at the time. Fortunately, some did, including Index. And at the time, it felt like the science fiction hypothesis that there will be a lot of agents at work and in our personal lives. And that they'll be doing like web searches for some reasons i believed it because i had obsessed with it for a lot long time but today if you look at like what's happened in the last three years like i was wrong but on the other side why thousand x is too low i think at the time i thought thousand x was like the crazy number to make up okay to talk about right and at the time i was like my deck literally contained a section which is like are we too early?
3:20Turns out we were not too early. Turns out today, if you force me thousand X's to lower number. If you just look at just some high level math, right? A person, an average person does like order of 10 or less Google searches a day. I was checking how many I do. Several thousand now. My agents, the ones I track. Wow. Several thousand per day. All the agents that I use today. So I am now sitting at roughly a thousand X, a little bit less than thousand personally. Most of the world is not. Most of the world will in due time. It might take us a few years, but thousand is a low number. But is that efficient?
4:07Do you think that'll crawl back at a certain point because they'll just get smarter and know where to go? Yes, but it is efficient because the other part of the story is that you gotta, you can't build old school search and do 1000x of this. You think about like okay all the infrastructure that a Google might have built to serve whatever, out of 10 billion searches a day. Like the best gift I have is 10 billion a day is what Google will do. They have a lot of infrastructure to pull that off. I don't think we get to build 1000x that infrastructure to do 1000x the searches, right? So part of what we do is build extremely efficient and optimized search, which again benefits from models getting better for us to be able to distill intelligence ranking into smaller and smaller models for us to be able to use GPUs as the underpinning of search indexes.
5:11Historically, search was done on CPUs, memory CPU bound. Now you get to architect and re-architect search for a price performance band that the world never needed until today. of one of the things we were talking about before, I recently interviewed G from Vercel. And this is, you know, maybe this is in parallel, but AI agents for coding have reached 60 % of traffic on their indices, what they see. You had a hot take. Generally on the web, the statistic being shared these days in the last few months is that agent traffic is exceeding human traffic on the web. That's roughly the characterization.
5:58Now there are two things to remember. An agent for roughly doing the same work that a human does will likely do a lot more searches because it can and a human is time constraint. An agent isn't really, it's more and right now they're not even that dollar constraint because people are willing to spend on frontier. A human read on the web or a human search on the web to create equal length value. It takes way more agent traffic. A lot of agent traffic is also people crawling for pre-training and people like when you look at like if you're a website owner and you're looking at automated activity versus human activity, automated activity is ripping.
6:45But my best estimation right now of where we are is agents are using the web 10 to 20 percent of humans, which is to say if my thousand X number is right, we have from here at least 5 ,000 X or 10 ,000 X growth left. Just another way of saying, we are very early with agents. I think in the Bay Area and Silicon Valley, we're all living in a little bit of a bubble. I think most people's agents aren't doing the number of searches my agents are doing, but they will. So Muse just came out with Jolly and I really like Jolly the character for Muse. We see dots coming out for open AI. We've been seeing a lot of these agents pop up for individuals, for consumers.
7:37That growth is faster than any growth ever seen. Like even Chachupiti, I think maybe, possibly, we'll see. But how do you expect that to grow? and I guess where does the retention stay two things one I have to make a note we should call out instinct too yes I almost forgot I am the reason is listen I'm on the rebel alliance here okay which is there are all these big people yeah and then there are us startup founders who are running at solving really hard problems and pushing the frontier of what's possible and innovating so we should talk about instinct yeah they are growing to amazing product so yes the category is amazing it's interesting I think it's growing really fast I don't have any insider information around retention I am as you can imagine it's a professional hazard that I use every one of these agents.
8:47And I try to deeply understand what they can and cannot do and what problems we can solve for them. We'll get into this category and how it changes our product strategy later. But I think my expectation is that these agents retention will be good. And it'll be good because for the first time the product onboarding feels natural. Like not someone designing like a bunch of UX click targets and flows to get you to understand the product. The product is natural. All of these products are somewhat natural and the question is can they deliver on the promise created by the UX. So the UX is you can text this thing and you can do anything.
9:43That's the UX. It's not complicated. Now, retention is entirely a function of can it actually deliver on this very simple high-level promise often enough to become a part of your life. Now, it's going to happen like a lot of other products struggle with the onboarding UX barrier to entry but this new generation of products just that just not a thing and so I am feeling that retention will get solved here. Is that where you think Open Claw maybe hit a wall like because that was really the first? No I think Open Claw was right in all of the ways yeah I think once someone got it's just not for the massive right it's just like most people don't have the ability to set it up and then to keep up the change I think the other factor we discount it's not just a one-time cost to set something up things are changing so fast that you have to adapt your instantiation of it alongside that change and you have to adapt your use of it alongside new capabilities.
11:00So part of it might have been that the setup time because of the flexibility and you controlling it was far too much. Part of it is also that it was perhaps a little too early, right? Because in the beginning, there was like one model which was really good, like the Opus model. And then as soon as you move to other models, it wasn't as great in the very beginning when people started using OpenClaw late last year. And so you had to adopt alongside it. But today, as evidenced by Instinct and Muse, you kind of don't have to know or think about it. And the product will change underneath. But as the customer of it, you don't need to know what changed in the last month.
11:51You're like oblivious to the capability improving underneath. I can't discount that this was really like just invented. So how did you, you mentioned this at the start of the interview, but like you've been obsessed with this for a while. So what does that mean and how? So I think I got obsessed with it almost three and a half years ago. I was the, I don't know if people remember, there was like this moment of this baby AGI and auto GPT. Speaking of, oftentimes developers in the open source world being ahead of everything else, people were building with like, I don't know, what is the model of the day?
12:30GPT-3-5 or whatever, like old models that weren't, like relative to today, they were like really bad models relative to today. And people were trying all these things and I was trying all of these things to try and make things work. And they didn't work. but if you believed you spent any time with the labs back then you internalized how models will scale and how models will improve like in some sense today it feels like everything changes every month in some sense i don't know if it's every month it might be every week but if you look at it a different way almost nothing that is happening is diverging from what you could have predicted in a straight line three years ago.
13:16Models will keep getting bigger and better. They will run for longer. Holding capability constant, models will get way, way, way smaller and cheaper. And people will be able to productize around them to disrupt every category of work that can be done on a computer. These were very simple things that we believed and said three years ago. And we have only seen evidence week on week and month on month supporting these very few simple things. And almost everything follows. So now you can say, yeah, I didn't predict that the big category would be coding agents first. I didn't predict the CLI form factor.
14:06Those were all bits of information and news to me along the way. But the macro thesis of agents are going to get more capable. You're going to do a bunch of inference. And for all the inference you do, you're going to have to do web search along it. I've now been on the record everywhere saying the one invariant I believe is we will use a lot of GPUs for model inference for agents, whether they be at work or consumer agents. and for every 10 GPUs the world spends on model inference, we'll spend one to two on web search. That's the business I'm in. So are you aggregating GPUs? You've raised 230 million reported and announced.
14:53I don't know. But are you aggregating GPUs? Yeah, we are not, I won't use the word aggregating. We are buying, we're renting GPUs. to build the scale of search traffic that we are seeing and expecting. And as I said, we grow alongside inference. So inference is growing. So we have to do a proportionate amount. I don't know if it's like already, I don't think it's a core competency of ours. We have been in multiple mad GPU scrambles in the last three months. To be like, oh shit, we need GPUs. We don't have GPUs. Can someone figure it out? And like you're making a bunch of calls. Who are you calling?
15:40Sorry? Who are you calling? Everyone. Everyone. Like every hyperscaler, every neocloud. What's like the typical response back? Because this comes up in pretty much every conversation now. It's like, how do you get, I guess, the allocation of GPUs? No, I think it's like, I think the, at least for us, I think it's true for many people. It's like, okay, which GPU is it? physically where is it sometimes we need gpus within five milliseconds of where a large web index is sitting okay other gpus were sometimes more flexible right with multiple gpu workloads it's not just like okay do you have gpus for me it's like do you have the right gpu in the right scale in the right physical location for me available at the right time and that is what makes the problem much harder i think so far we have managed to solve every problem we have encountered we've not had to turn away a customer because i didn't have a gpu right but we've had a bunch of GPU acquisition firetils.
16:55I mean, that's a really interesting line to go down. It's like, what is the sourcing process like for GPUs? Like, what are the main questions that you're asking? What do you need? Yeah, so I think you mostly, so I think different workloads are different. But for bulk of our workload, it's like, how many GPUs, which types are you open to? When do you need them? And where must they be? there's too much more to it I think for certain large training clusters there's a little bit more to it and then for us, are you willing to commit enough duration to that physical thing yeah but it's not complicated the reality is that I wouldn't say the market is entirely efficient right now a lot of it is on iMessage so but it works the market works Well, that's crazy.
17:51So you're doing deals on iMessage for GPUs? Not exactly. You're figuring out availability on iMessage. And then the finance person then calls the finance person and the paperwork gets done. Oh my god. This episode is brought to you by Brex, my favorite. You become what you spend on. And I refuse to spend my time on work that shouldn't exist. Expense reports, receipt chasing, and manual closes. The companies building what's next from Vercel, OpenAI, Anthropic, Granola, and Deepgram all made the same call. They all run on Brex. Brex is the intelligent finance platform that combines cards, expenses, and banking into a single stack with agentic finance built in.
18:35AI agents that handle expenses automatically, enforce policy before spend happens, and close your books in minutes. That's why Sorcery runs on Brex so I can spend time on building and not busy work. It's time to get Brex AF. Learn more at brex.com slash sorcery. That's B-R-E-X dot com slash S-O-U-R-C-E-R-Y. Bye. From handshake to signature faster, Harvey, the AI platform built for legal work, is trusted by 80 % of the AMLA 100 and over 20 % of the Fortune 500. Learn more today at harvey.ai. That's harvey.ai. AI needs more than chips. It needs power, land, and infrastructure. Zone develops next-generation data center campuses, partnering with AI companies, site developers, and technology leaders to bring compute online faster and at scale.
19:33Zone is building the foundation of the AI frontier, Visit zonefrontier.com to learn more. That's zonefrontier.com to learn more. I want to go back to the topic of scale because we were chatting about historical scale and what that used to look like and what you would expect. So you were at Twitter for 11 years. You were CTO, then you became CEO. I was also an engineer before that. You were also an engineer before that. You've done the whole thing. You also have a PhD. I've done all this research. but I want to talk about that so like can you set expectations now like what would scale meaningfully look like today if like back then it was a triple triple double double now it's like what do you have to achieve I don't know how somebody else could do it for our business turns out the answer is relatively easy as I've said like we just build alongside inference So if you think about inference growing year on year, to us that is the anchor.
20:37Our right goal is to grow faster than inference for agents for knowledge work or consumer agents grow. So if we grow alongside or faster, I'm feeling pretty good. And that's to us the benchmark. Now, what is the right inference benchmark? That's a question I don't know long term the answer to. But I think in the short term, it's clear that GPUs that are coming online this year or next year are going to do inference. And so then they're going to do search alongside it. So the short term there is very clear, but our benchmark is just growth of inference. So what are those numbers? I think the easiest approximation is 10x.
21:25You have to think about a 10x score as the very simple round number. If you think about today, if you'd asked me last year, I would have probably said a lower number. But the pattern here is even when I have thought I was being provocative and making up a high number, I have somehow managed to underestimate. so now I can I feel like I can go to 10x feel a little bit uneasy that it feels crazy to grow 10x for too many years you know how long can that happen maybe I'm wrong again I'm curious because you get to see so many different market insights from internally externally all around what are what are some surprises that you've come across and what are the signals you're looking for So I think it might be useful to tell people about the kinds of customers we end up working with.
22:20Okay. All of our insights, or at least my insights, come from working with people doing really, really interesting and unique things. We started working in the beginning with all of the people pushing the limits of building agents. So some of our customers, like Harvey Notion, they were one of the early people building agents for doing real work, where the quality bar for that work was quite high. And everyone in the adoption chain was like, oh, can we trust this agent to do our work? That was the question being asked. And we, by working with like really demanding customers or customers who had really demanding customers in turn, we ended up really pushing our systems capabilities on the quality dimension.
23:12Right. The next phase I would say is like voice agents are starting to work. And the interesting thing there is initially there was some acceptance for your voice agent pausing a little bit unnaturally or being like, let me look that up and come back to you. Like that was acceptable for like a three month period, I think. And then very quickly today, if that happens to you, at least the people who've interacted with multiple voice agents, you'd be like, that is ridiculous. Like that's a really bad product. And so now you're seeing all these voice agents, which are like super natural, but also super fast.
24:00So what does that mean for web search? Now you've got to be able to search the web in like 150 or 200 milliseconds. It's like human web search was like a sub second product, like 600, 700 millisecond product, roughly end to end. Because we don't notice it getting any faster, right? For a voice agent, that latency constraint on web search is unacceptable. So now you have to push yourself on the quality dimension, on the cost dimension, and the latency dimension. And you've got to crush all three. And that's been something like we get pushed by sort of the frontier customer who is like, listen, the product experience that we can build today is going to be unacceptable very, very quickly.
24:43So what does every underlying infra piece need to solve in order to create the market expectation, which changes so fast, right? Like, I think, I don't know, going back to web search, one of my, you should at some point try, even with the new model, turning off web search in chat GPT once. Okay. I think we all use chat GPT for the first, I want to say eight months, maybe nine. It did not have web search and we were just talking to a model. Try to do that today and see what happens. my bet is one 90 % of things you ask it will disappoint you number two you will feel like a caveman for a cave world in using that product so it's only three and a half four years ago now but our implicit expectations of a product that looks the same have changed so dramatically and that is what's sort of mind-boggling to me.
25:56And I think that is essentially what drives all technical progress is because it becomes table sticks. Right. And now they might be getting subconscious, you know, they might have some consciousness to them and start judging us and attacking us. I actually, I don't know, I'm more of an optimist on this. Okay. I think they will actually get proactive. So they will know us. They will know our explicit and implicit needs. And they will try to proactively do work. That's the phase, the next phase. I think you're starting to see glimmers of proactivity in instinct and muse and dot. Glimmers. I think they're still more reactive than proactive.
26:45They're always on, but they're not really proactive. I think the next era they will be hyper proactive, which I'm really excited about. I guess to peel back, because this is a brand new economy and layer of the internet and what could, I don't know, the internet might not exist anymore. Maybe we'll just use agents. This is what people are saying. What are those components of the underlying infrastructure? You're one of them. What makes up that base? There are two ways to talk about this. I think before going into the internet, let's first talk about the underlying infra components for building an agent.
27:27You need a model, which is inference. You need perhaps a sandbox. I think you need web search, like we provide. You need an action space which includes a browser and a few other API hooks. And you need access to a bunch of connectors to access your personal data or your company's data. You build these together and you can build an agent. And then the rest of it is all of the same stuff we've always had, which is observability, feedback loops, security. And then you have a cloud for agents. Now you go into the web piece of the infralayer. You now need to do web search, but also you need to figure out to your point around the internet shutting down.
28:18I do think the primary consumer of the internet is going to be an agent, which means the internet will get re-architected. The first thing that's happening is agents are reading the web, which is what we do. What we haven't figured out is, okay, what is the new business model? Like previously, if you put your content out there on the web, you were either building a subscription business, which is like you put some content out there, a bunch of users come, some fraction of them subscribe for a monthly subscription to a newspaper. Other internet businesses were monetized by saying, I'm going to put ads and I will get paid based on human visitors.
29:00seeing ads. Other business models were like either affiliate business models or you drive a transaction of some sort. All of these business models have fundamentally relied on us random walking the web as humans, opening pages and taking the next action after the next action on it, some of which are monetizable actions for these participants. If agents are doing this, the buying action still remains. Every other action breaks. So you can't monetize attention anymore. So ads business model, perceived subscription business models, these things are not durable. So what replaces it? That's part of what gets me super super excited about building parallel because like i think solving just technology problems i think is far less interesting than solving a technology and a business model problem so we have a highly opinionated point of view on how we keep the web open on how we incentive align content owners with the ai app or ai agent so that a content owner isn't sitting there saying I'm going to block all AI agents because I don't know how that becomes business for me.
30:27So we need to solve this problem for people, which is like, okay, give me an incentive to make my content available to AI agents. What is that? We built a system which runs a model, not surprising, to compute how much to pay each content owner every time an agent reads their content. and we've been now doing a bunch of partnership with content owners and the bet we're making is that we'll be able to keep the web open as a result of our version of we can call it Adsense which is easy auto differential pricing actually provides content owner value for high quality content. That's a really good point.
31:13I was interviewing USV Union Square Ventures not too long ago and fred wilson was talking about how google the traditional business there is being cannibalized by ai llm's agents it just is and so gemini is like the hail mary to pull it in and they're emphasizing that and they're taking advantage of that i'm curious to go deeper into this monetization standpoint um in another interview i did at browser base with john Collison of Stripe he posed the question do we need bot detection anymore there's obviously good bots there's bad bots but if everything all the traffic becomes essentially bots these agents like what is the point yeah no so I think today there's a lot of people doing a lot of bot detection the word bot detection I think is a few different things it is crawlers, it is actual agents working on behalf of a human or a business.
32:21It is malicious bots which are trying to do harm. So I think we have to use that word now a little bit more carefully than we have in the past because historically people have mostly had negative connotations with that word in that like it's not serving anyone yeah today there's a category which is actually highly useful for you or for me like i would like my agents to inherit privileges i have so i think we should be careful i do think there is like the bot detection market is doing well right now and doing well right now because we haven't figured out how to do incentive alignment And there's a separate kind of incentive alignment needed, let's call it on the action side.
33:12So earlier I spoke about the incentive alignment needed on the content side, which is like, why do I let you read my content? The other side is, what happens if I let your agent buy on my store? And you're starting to see divergent strategies there. I'm of the belief that we need to figure out how to solve problems so that all agents, not just the ones built by a large lab, can both access all content. and take all actions that their owner is allowed to. Right? But we're not there right now. One of the biggest topics behind growth is cybersecurity and active threats. How do you, I know you said you're an optimist, but realistically, like how do you see the biggest concerns around this?
34:02No, I think the cyber security risks are real. I think agents help both defenders and attackers. Problem always is that, so the people who rush ahead to adopt agents for defending themselves, I think will be fine because attackers like to find the weak-ifth link and there will always be a weak-ifth link. So broadly, that's what I think. Now, the security risk for something highly sensitive like the model weights of a frontier model are a whole different conversation. But by and large, my intuition is that we will use coding agents aggressively to secure. But along the way, there's going to be a cyber event every few weeks of consequence, which will drive action and urgency in getting ahead on defense.
35:18We're going to spend a bunch of inference on both attack and defense. Do you see any of this analogous to your time at Twitter? on consumer internet, obviously that's a huge, one of the largest social media platforms. And so that creates a lot of vulnerabilities. No, all of the, there are obvious parallels, right? Not to just keep calling out my company's name again and again. So Twitter, right? Like there was a real incentive to attack whether it were crypto spams. Yeah. Those were popular for a period, right? or whether it was some state-sponsored influence campaign, which we used to disclose a lot publicly.
36:04Those things always happened. It required real energy, focus to control. The thing most people don't understand is it is almost impossible to take it to zero. You have to contain it because it is a knife fight and the tactics change. Anytime you control some vectors, another new vector will emerge and then you'll control that. The other thing people don't understand is most of the bad stuff is stuff that doesn't show up on the surface. So if you saw an account and thought this is a bot, it's harmless because you could see that's a bot. So the real problem is going to be in the margins when we lose our ability to differentiate.
36:56Yeah. Either as people or as the technical people building these systems, when you can't differentiate a human from a bot or an agent. That's when you're like, okay, now I don't know what I'm up against. And I think that is very similar today that we used to deal with back then. Do you think bots should address themselves? I have two contradictory feelings about this. I do think good bots should declare themselves so that others can recognize them as good bots and treat them differently from bots that might be adversarial. And we keep using the word bots. I would like to use the word agent. Okay, well, every time we use bot, we're so cool.
37:48I really think bot has a more negative connotation While an agent is a more appropriate word, I think agents are perhaps the good parts, mostly. So yeah, I think they should declare themselves. I know there's like a bunch of protocols now being done around declaring identity or the world at large. The core challenge there, why the other side is like, this is a conceptual question. should your agent have the same access as you? Should it inherit your access or should it have only a part of your access? Now, I would really, it would be so much better if we could figure out a way to get rid of the bad bots, but live in a world where we could enable our agents to have the access we have and grant that privilege.
38:51Today, it's strange, right? Like, I can't get my instinct or muse to have the access I have on many websites because they got blocked there. And they will get even more blocked if they started declaring themselves. Yeah. And that is why I think we're in this moment of transition where these products have these rough edges, partly because we haven't done incentive alignment. but if we started just declaring them everywhere and they started declaring themselves everywhere like we don't participate in that space but we started doing that a bunch of people today because we haven't done the work to do business model alignment are going to start blocking them yeah and so these products then will look worse and be less useful and that sucks so to me the existential problem is how do we drive alignment between agents and everything on the web.
39:44Do you think everyone will need alignment and safety on their team? Is that the next hire class? Yeah, I think how do you not deal with the problem? Like we, if you think about us, we are the web layer. The web is the, is a dangerous place. Like anyone can post anything malicious anywhere, right? A lot of that content will flow into an agent's context. so you can do injection attacks. Now, to the credit of model builders, in the last two years, models have made very real strides on not being very vulnerable. But I think this whole world will rely on defense in many, many layers. So almost every layer has to obsess about this problem.
40:32And you can't say, oh, models will solve it. We have to really focus on it to solve it at our layer before we get into the models. Then models have to really focus on it. Then the app builders who are building with models and with us have to really focus on it at their layer. So we have to deal with adversaries at every layer. And that is actually what gives you true defense. And still the occasional thing will leak out. How good is AI at real professional work? Merkoy's AI Productivity Index or APEX tracks it with every major frontier model release. filled with partners like Harvey and Cognition, see where the frontier actually stands at mercore.com slash apex.
41:11Today's episode is sponsored by VCX by Fundrise, the public ticker for private tech, allowing investors of all sizes to invest in venture capital. Learn more at getvcx.com. Some of you may not have heard this yet, but our sponsor public just launched something called Generated Assets, and it brings AI into investing in a way I've honestly never seen before. Here's how it works. You type in an idea like AI-powered supply chain companies with positive free cash flow or defense tech companies growing revenue over 25 % year over year. Publix AI then dispatches a swarm of agents that scan every single US stock, evaluates them, and instantly builds a custom index around your thesis.
41:52What really stands out is how clearly it explains why each stock is included. And before you invest, you can even backtest your idea against the S &P 500. So you're making decisions with real context, not just guessing. And beyond generated assets, public lets you invest in stocks, bonds, options, crypto, all in one place. They'll even give you an uncapped 1 % match when you transfer your investments over from another platform. If you want to build a portfolio that actually reflects your thesis, visit public.com slash sorcery paid for by public investing. Full disclosures in the description. Founders scale faster on Deel.
42:26Set up payroll for any country in minutes. Hire anyone anywhere. Get visas handled fast. And get back to building. Visit deal.com slash sorcery. That's D-E-E-L dot com slash sorcery. How did you recruit for your team? Especially as this is moving so fast. So you have global offices now. Yes. How big is the team? And how have you recruited? What are the main roles? The team is about 120 people now. I think we started the year close to 30. So this has been a year of explosive growth. A lot of that growth has been because we had no GTM at the beginning of the year. We were a pure tech play. Now, the last three months, six months, we've built a pretty sizable GTM team.
43:20and that's been done because we're seeing all of these almost every business that buys inference needs to buy web search so we're finding really large like whatever the top 100 500 companies in the world starting to really spend on tokens and starting to really buy us alongside those tokens to make them more effective. So a lot of our growth is the sales team. Well, how do they know to buy you alongside the tokens? They run into problems. So one of the common things people run into is people start using a model. That model perhaps bundles itself with a web search. Okay. And they start building an application to that.
44:10Now, sometimes it's not good enough And the team realizes that it's the web search component which is causing it, despite the model being great, just causing it not to be capable enough to solve the problem they're solving. It's perhaps how we started first working with some of the AI legal, AI finance, AI science kind of customers. Right. The second point at which they really need us is they decide to use multiple models. So we're like, okay, we want to switch across multiple proprietary models on a dime, or we want to start adopting open-weight models. And at that point, having the highest quality web search, which works with every model actually enables model independence for you to have flexibility to build your application.
45:02So that's the second reason people buy us. The third reason is when people have really scaled use cases and now start optimizing for measuring ROI, optimizing for end-to-end costs. Because our search is so high signal and token efficient, the models do half the number of searches, use up far fewer tokens, end-to-end are cheaper, faster. That's the third reason people buy us, which is like, I'm spending too much on tokens. It works. It's useful. can you help us be more efficient so it's not just routing you also help with token optimization if a lot for a lot of categories of knowledge work where a lot of work happens on the web we help a lot in token efficiency wow so when we talked to gia versell we were talking about the shift of gtm it was seo then it was geo and now it's aeo so i think geo and au are the same a little bit but not really okay because the agents now are more than chat yeah you always like chat exactly so it's like versell has optimized itself for the agents coming to its website so the agents can read the website and know exactly what products they offer how they can use it and so because of that versell is like one of the top uh uses for building out your products and that kind of coding and all that environment no i think it's it's interesting you bring that up three years ago when we put up our first website up when we were still kind of it didn't say anything we were in stealth we had a machine version until this date if you go to our website you'll see like the human version and then there's a toggle to transition into the machine version really we've had it as far as i know we were the first website to take on this metaphor because we're building a parallel web agents yeah and so we have always carried this metaphor which now the world is coming around to it's like a cute thing to do because the truth is the presentation layer almost doesn't matter because we can we can transform the web even if you don't publish your website to be agent friendly we'll do that for you like we can we can understand what the human version is and how to help it become agent friendly oh wow um we don't do a or geo but i think your your website will become consumable by agents with us but i do think like we for example even think of our onboarding and our documentation and every part of the developer or customer journey with the primary assumption that it's a human with a coding agent or a developer with a coding agent rather than a developer.
47:54And so you'll see a bunch of on our website you'll see like put this prompt into your agent and then it'll exactly know how to use parallel to solve whatever problem you're trying to solve. Like one claim just like you just need the human needs just authorize slash add a credit card slash accept terms and the rest of it the agent can rip. So really rethinking how you design every experience to be agent first is I think pretty fundamental. Varsel, like I know, is very agent built. So people who live that world have an advantage. We have like probably like 10 or 15 minutes left, but I'm curious, I mean you're doing a lot of press, like you're out there, you're used to getting asked a bunch of questions, like what are the questions you want to get asked?
48:46I spend a fair amount of time thinking about today proactive agents and always-on agents, how that changes the compute world and how that changes the web. So the question I think there to me is and we've now built a bunch of system which some people are starting to use around this notion of a proactive web or I've been out there saying the web will go from pull to push. So far your primary, as humans, our primary way of searching the web was just us going and searching on Google. For the rare few you use Google alerts didn't really work. People tried to build like what Google now and a bunch of these things which send you notifications.
49:42Nothing really worked on the web in terms of being proactive. I think with agents and the cost of intelligence going down, it is going to work. And so now if you imagine an instant or a muse, implicitly understanding your world and your life and being able to set up essentially really, really high signal, high precision, high recall, alerts on everything that changes on the entire web to know when your agent needs to act on something on your behalf. So something changes in the world or something might be happening. What do you need to do as a result or does that change your plans or does that change your actions?
50:25How we allocate compute in that world is a problem I'm currently obsessed with. Because the web is really large, right? Like there's a trillion pages out there. A bunch of them are changing every day. Most of it is junk. No matter how cheap you make compute, we have not enough compute to compute everything. So now we need to be really smart at prioritizing our compute over everything that is changing on the web. So that more compute can be spent on things which are actually actionable rather than junk changes. The rate of change of the web is also going to dramatically increase, right? You're starting to see that, like people are publishing with agents, like you can like the AEO SEO businesses like churning out agent generated content on the web, which just means the rate of change on the web is increasing, which means the job of a search engine is to pull the signal from the noise as potentially more noise gets created.
51:34How do you think about data centers in space? I wish I knew more about it. I hope they work. Have you gone down any of these rabbit holes in this compute? I haven't. I haven't gone down the data centers in space rabbit hole. I do think we need compute. I've gone on a little bit of the how sovereign will participate in the data center. And that is fascinating to me about how that will play out. Well, one of our partners is Brex and they're all about performance and spending smarter moving faster. I take this topic in the personal way. So I do think performance is a matter of who you spend your time around some people say it's your closest five people some people think it's like your mentor people who inspire you for your career tremendous career very interesting I'm so curious who is that person or those people for you my wife is her name is Benita I was an engineer at Twitter when we got to know each other.
52:47So if you think of the part of my career where I've done well that people know about, it's mostly her. She is a superwoman, she's hyper ambitious and I was ambitious but I think she has driven my ambition even higher. Like I have always aspired to be the top X in the world at anything I do. That's like the only way. Like I was driven to do that for math, I was driven to do that for physics, I was driven to do that for computer science research and I think I got there for all of those. But I don't think I would have thought I was capable of this until she pushed me. And then I was like, yeah, I think if you care enough about something, I think you can go become top 10 in the world at anything.
53:47Now, the top one is a whole different field. But I think like for me, it's like the standard setter is my wife. She's a physician. She practices still. She's an investor at Andreessen Horowitz. She's done a startup. She does healthcare. She does biotech. She works really hard. And she's an amazing mom and wife. That's amazing. So you guys have a nice little competitive dynamic? Yes, yes, yes. I think I am privileged that when I go to a lot of things, like people use me to access her. Really? Oh, all the time. People will come to me to figure out how to get me to forward an email to her. Oh my gosh, that's amazing.
54:44Well, that's a really great call out. I wasn't expecting that. Why do you think partner selection or who you choose as a partner is so important? And I thought, probably the most important decision in life. And like you, as you said, right, like you, your peer group, like I was fortunate growing up to have like a really crazy, weird outlier of a peer group. Like all of my friends were essentially kids of nuclear scientists in India. And everyone was like, okay, I'm going to be the best at whatever we try to be. And so there was like this ambition slash competitive expectation all around. And so if you surround yourself and then I went to college and my college was the most competitive.
55:36And I went to grad school, that's the most competitive. So you surround yourself in that and you kind of surprise yourself by being around high expectations. So this is what now everyone's talking about, right? Like you build a team, if you have high talent density, it's a superpower. if you don't hire outliers you don't get outliers if you hire only outliers you get only outliers there's a lot of self-selection that happens i've been fortunate to go through that journey and been like i got started in life with that kind of a peer group and then you kind of won't ever let yourself not be in that peer group and that percolates into like your partner selection which then further drives things.
56:22So it's like kind of a self-fulfilling prophecy of sorts. In such a competitive career in every stage, how do you not break from the pressure? What pressure? You don't feel pressure? No. No? Why? Why would I? A lot of people do. Yeah, I think it's kind of a made-up thing, right? I really believe that like I think I through the Twitter acquisition I used to crack my sleep score really? and I was sleeping fine I think if you know what you must do you do it you can you don't have to feel pressure like the world can come at you but if you know what you're capable of and you have a slightly long-term view like everything is a week or a month so you don't have to feel pressure you have to perform every day which is a completely different thing so now the core question you have to ask is there are moments where you must feel pressure to perform so i really like feeling insecure is my word.
57:42Really? Which is I have always told people that I only want jobs which I wouldn't hire myself for. So I want somehow to feel that someone's thrown me into a challenge that on paper I'm not supposed to be able to accomplish. One, that drives you to be slightly humble. Two, it makes you a little bit paranoid. It makes you want to learn things and makes you curious and it makes you work really hard and it makes you seek help. If you feel secure in what you're doing, it doesn't drive any of the most important behaviors in my experience. So pressure is a different word because it suggests that you are trying to meet somebody else's expectations, instead of your own.
58:38And I think internal expectations are way, way, way better drivers of success than external ones. And at least for me, I would say other than my wife, my expectations have always be higher than the world's expectations off of me. Even from like true believers like who believed in me what a fascinating turn i did not expect that this is like we i will say thank you so much okay for such a fantastic conversation um it was really awesome to learn more about parallel and then your personal life too if only we started with this your philosophy and like how you think about things is really yeah that's fun yeah well thank you so much frog amazing cool Hey, it's Molly.
59:31If you enjoy our interviews, check out our newsletter, Sorcery.bc, where we deliver a once a week top deals and tech headlines email and also go deeper on our podcast interviews. Subscribe to Sorcery today. And don't forget to subscribe to the podcast on YouTube, Spotify, Apple or wherever you listen. Link in description to sign up.
Former Twitter CEO & CTO Parag Agrawal predicts AI agents could drive another 5,000–10,000x increase in web usage, fundamentally transforming how the internet operates and makes money.
Now Founder & CEO of $2 Billion Parallel Web Systems, Parag is building the search infrastructure for an internet where AI agents, not humans, become the primary users. With a reported $230M raised, customers including Harvey and Notion, and a team that has grown 4x this year, Parallel is positioning itself at the center of the AI infrastructure boom.
Recorded at Index Ventures in San Francisco, we discuss the massive GPU demand behind AI search, why traditional advertising and subscription models could break, and how Parallel is developing a new way to compensate content owners as agents replace human browsing. Parag also explains why the web will shift from reactive to proactive, how he's scaled Parallel from 30 to 120 employees this year, and lessons from his 11 years at Twitter as engineer, CTO, and CEO.
Parallel Web Systems was funded by Index Ventures.
Parag Agrawal: https://x.com/paraga
Molly O’Shea: https://x.com/MollySOShea
Sourcery: https://x.com/sourceryy
𝐒𝐏𝐎𝐍𝐒𝐎𝐑𝐒
• Brex—The modern finance platform, combining the world’s smartest corporate card with integrated expense management, banking, bill pay, & travel. https://brex.com/sourcery
• Harvey—The AI platform built for legal work, is helping the best firms and companies close deals faster. More than 200,000 lawyers, 80% of the Am Law 100, and over 20% of the Fortune 500 build with Harvey. Visit: http://harvey.ai/
• Zone—develops next-generation data center campuses, partnering with AI companies, site developers and technology leaders to bring compute online faster and at scale. Visit: https://zonefrontier.com
• Mercor—The human intelligence behind frontier AI. Frontier labs and leading enterprises use Mercor to turn the knowledge of 5M+ experts into the data, evals and benchmarks that make AI better at real work. Visit: http://mercor.com/sourcery
• VCX—VCX is the public ticker for private tech, allowing investors of all sizes to invest in venture capital. View The Portfolio at http://GetVCX.com
• Deel—Deel is the global people platform that helps startups hire, manage, pay, and equip anyone, anywhere. Trusted by more than 35,000 fast-growing companies, Deel is the people platform that just works, so teams can scale without the chaos. Visit: https://www.deel.com/sourcery
• Public–Investing platform Public just launched Generated Assets, which lets you turn any idea into an investable index with AI. With Generated Assets, you can build, backtest, refine, and invest in any thesis with AI. Gone are the days of one-size-fits-all ETFs. https://public.com/sourcery
Follow Sourcery for the latest updates!
Disclosure:
Paid Ad. Agents are an experimental AI tool. Its output may be inaccurate and is not investment advice. Public Holding’s, Inc. makes no guarantees about its accuracy or reliability—verify independently before use. Brokerage accounts and services provided by Open to the Public Investing, Inc. See additional disclosures at https://public.com/disclosures/agenticdisclosures.