Growth vs Efficiency: Can You Have Both?

21 Jul 2023 · 46 min

Ask about this episode

Ask anything about it. ChatGPT or Claude reads this page and answers with the times it was said.

Connect VO and ask about every podcast you hear, including the moments you saved. Add to ChatGPT · Add to Claude

In short

a16z Podcast: Growth vs Efficiency - Can You Have Both?

Episode Overview In this episode of the a16z Podcast, titled "Growth vs Efficiency: Can You Have Both?", the discussion revolves around the complexities of achieving sustainable growth in the current tech landscape. Industry experts Gina Gotthilf (VP of Growth at Duolingo), Kieran Flanagan (SVP of Marketing at HubSpot), and Bryan Kim (Consumer Partner at a16z) explore the challenges and opportunities businesses face in balancing growth, efficiency, and profitability in 2023.

Key Themes

  • Challenges of Growth in 2023: Despite the ease of product development, sustainable growth has become increasingly difficult. Traditional channels are less effective, requiring businesses to adapt and find new growth opportunities.
  • Importance of Fundamentals: Reinforcing the need for businesses to return to foundational principles, focusing on building products that evolve and respond to consumer needs.
  • Role of AI and Community: The integration of AI in product development and distribution is emphasized, as well as the importance of community trust and referral networks in acquiring customers.

Detailed Topics Covered 00:00 - Overview of Current Growth Opportunities

  • Exploration of new avenues for sustainable growth amidst evolving market conditions.

03:00 - What Growth Channels Still Work?

  • Discussion on the effectiveness of paid platforms, SEO, social media, and the shift in consumer behavior towards community-driven referrals.

05:02 - Fundamentals of Growth

  • Importance of understanding customer needs and iterating on products to foster sustained engagement and retention.

09:33 - Distribution Strategies

  • Analysis of the current state of distribution channels and how to leverage them effectively.

14:00 - Integrating AI for Growth

  • The potential of AI as a tool for enhancing product-led growth, particularly in personalization and customer interaction.

22:03 - Successful Company Examples

  • Case studies of companies that have effectively navigated market challenges with innovative growth strategies.

28:38 - Fostering a Growth Culture

  • Strategies for creating an organizational culture that embraces experimentation and quick iteration.

34:20 - AI in Distribution

  • Discussion on how companies are leveraging AI to improve distribution techniques and optimize customer experiences.

44:43 - Growth Challenge: Utilizing a $10K Budget

  • A creative challenge posed to the experts on how they would effectively use a limited budget to drive growth.

Key Takeaways

  • Balancing Growth and Efficiency: Companies need to find ways to grow while maintaining efficiency, as traditional growth metrics become increasingly unreliable.
  • The Shift Towards Community and Trust: Establishing a strong community and fostering trust can be more beneficial than relying solely on paid acquisition strategies.
  • Embracing Experimentation: A culture of experimentation and agility can help businesses adapt to changing market demands and leverage new technologies effectively.
  • AI as a Game Changer: The integration of AI presents both challenges and opportunities in product development and distribution, necessitating a thoughtful approach to its implementation.

Insights from Experts

  • Gina Gotthilf: Stresses the importance of understanding the product’s unique value proposition and creating a moat against competition through data-driven decisions.
  • Kieran Flanagan: Highlights the ongoing evolution of distribution channels and the necessity for marketers to adapt to new consumer behaviors.
  • Bryan Kim: Emphasizes the critical role of community in driving user acquisition and retention, particularly in a landscape dominated by established players.

Conclusion In an era defined by rapid change and uncertainty, businesses must recalibrate their approach to growth by focusing on product excellence, community engagement, and innovative use of technology. The insights shared in this episode offer valuable guidance for navigating the complex interplay between growth and efficiency in today's market.

Additional Resources

  • For further information, tools, and insights, visit [a16z.com](https://a16z.com).
  • Follow the participants and a16z on their respective social media platforms for ongoing updates and discussions.
  • Check out [Latitud](https://go.latitud.com/) and [Zapier](https://zapier.com/) for practical applications related to the podcast discussions.

Follow-Up Actions

  • Subscribe to the a16z Podcast for more insights into tech, culture, and industry trends.
  • Engage with the community by sharing thoughts and experiences related to growth strategies in your own ventures.

Written by AI. May contain mistakes. Listen to the episode to check what was said.

Hear the part that matters, and keep it.Open this episode in VO. Double tap your headphones to save a moment as you listen.
Get VO free

Transcript

Automatic transcript. May contain errors.

0:00We need to try to get back to like fundamentals and how do we actually iterate and ship fast. We have to build products that are constantly evolving and that are constantly learning and evolving from those learnings. The only way really to stay ahead of that curve on that consumer side is get the lightnings keep hitting. I mean that sounds hard. It's very real. That's incredibly hard. Second product hitting, so rare. Third product hitting, you're a generational company. It's like there's this big wave coming and it might hit your ship. Is there a way to avoid the way? I don't think so. I think it's kind of a tsunami.

0:32If you sit there, it's just gonna wash you away. People will want to talk to people. So like community becomes much more important, referral becomes much more important, where the myth becomes much more important. The new limiting factor is possibly creativity. That's a very, very fun place to be. Despite it being easier than ever to build a product, it may actually be harder than ever to grow one, especially sustainably, with many tried -and -true channels no longer working as they want to do. paid platforms were hit with app transparency tracking, SEO is not threatened by AI chat, social graphs have moved to interest graphs, product led growth is easier than ever to copy, and viarality is just as transient if not more transient than before.

1:15And those are just a few of the examples that founders are facing. So what growth green space still exists, especially in an era of austerity? How do you balance efficiency and profitability while still growing? and what channels matter and how you master them in 2023. These are just a few of the questions we addressed in this episode, together with three people that have successfully grown companies through similarly confusing waves of the past. First off, we have Gina Gotthelf, now leading latitude, but perhaps most well known for her impressive reign as a VP of growth at Duolingo, growing them from three to 300 million users with no paid budget.

1:54But we also have Curian Flanagan join the conversation, long time SVP of marketing at HubSpot, where he was a founding member of their international business, all the way up to HubSpot hitting over $1 billion in ARR. And finally, we have our very own brand -kin, partner at A16C, who also held several leadership roles at SNAP, from their hyper -growth days all the way through IPO. Alright, I won't keep you waiting any longer. Let's dive in. As a reminder, the content here is for informational purposes only. Should not be taken as legal, business, tax, or investment advice, or be used to evaluate any investment or security, and is not directed at any investors or potential investors in any A16z fund.

2:37Please note that A16z and its affiliates may also maintain investments in the company's discussed in this podcast. For more details including a link to our investments, please see A16z .com slash Disclosures.

2:58What are you seeing in terms of growth that still works in 2023? Are there white spaces that companies can tackle? What's happened in this kind of really interesting because there may be like AI is somewhat of a tailwind for like maybe 12 months or 18 months for the best people and then who knows after that maybe ahead, we're going to cross everything. So I think certainly in search, I really dug in there. And there are lots of examples of the click -through rate decreasing and the amount of traffic you get from Google search pages decreasing. But I still think there's a lot of value in that. Paydads, very similar, I still think there's a lot of value in that.

3:34What really happened with the popularity and growth of the internet is like marketing growth became much more measurable. And they could have a seat at the revenue table. They could say, hey, put a dollar in here and I get $3 out of here. And the growth that's starting to happen today or where things are starting to shift is a little bit back to this indirect causation. These channels, if you look at the platforms that grow in it's short from video, TikTok, YouTube, these kind of media channels. If you look at where I think things will go with the evolution of AI, people will want to talk to people.

4:03So, community becomes much more important, referral becomes much more important, where the math becomes much more important. All of these things are going to shift us back into the place where we have to be okay doing things where you can't measure everything directly all the time. And I actually don't think that's a bad thing because I think the over index of measurements forces everyone into the middle and everything becomes like mundane and lacks creativity. And so I think that there's like some pros and cons to actually this happening, but there's certainly a change in terms of how you are able to do your work and actually really have the value of that work to like the founder who the founder is for the most part still going to be stuck in the binary, give me three dollars for the dollar that I give you.

4:45We're almost like going back to the origins of advertising. There's that saying that says you need to hit someone seven times before they convert. And Facebook maybe changed that. Maybe it was like two times. And then it feels like we're sliding back in the other direction. I think it has always been the case that people need repetition to really notice something. And yes, more and more, there's more media, there's more for us to watch and listen to, and we're more distracted. So I think that that becomes even more of the case. But I may be simplistic, but I don't think that much is changing because to me thinking about growth is about the framework for Understanding what makes people tick what people care about how to reach one person or one media outlet or One channel whatever it is that will reach a lot more people in the most efficient way possible What are the moments in your product that people really really care about meaning like?

5:35number of people who actually encounter that moment and if you actually make some sort of like a bit tesser change, you'll actually see significance as a school results on the other end because people really care about that one moment. It could be a notification. It could be a screen. You know, we keep seeing these trends and things grow and EBSCO rules are constantly changing because we're at the whim of algorithms and so we're just constantly trying to adapt. Places become saturated. Like at one point it was really trendy and cool to do ads inside the subway in New York City. Someone discovered that in 2012, which is funny because it feels pretty obvious, and suddenly everyone was doing it.

6:10Everyone's testing the notifications and everyone's saying, there's too many and it doesn't matter. I think all of those channels are still very relevant. It's about finding how to actually impact how people feel and finding new ways of impacting people that are cheaper because less people are using it over and over. So I think that that will continue to be the case and it just depends on what's the trendy channel and what are people paying attention to. But if you think a priori like that like how do I reach one that then reach a lot or what are the things that I can modify that actually make a difference?

6:39Then I don't think that much has changed. I have like a slightly heretical take so this is gonna be fun But you know when we talk about gross especially I know ACKV where all we're the Silicon Valley and the stalwart what have you But when I think about gross this like gross tactic gross, you know channels and even the word gross hack became very popular in that You know, there's this prevalent theory and sort of care and touch on it where you can put it in a dollar and get back Why put a next dollar get why back and I think that certainly became true and there became so many channels and there became so many Wisdoms and tried and true tactics whether it's SEO or ambassador program or community building where everyone's trying to learn from each other I'm like, how do I hack this thing?

7:21Genus is something interesting is sort of how I think about it where like moments in the product when people go, uh -huh like this is great. At the end of the day, I think gross, we're sort of conflating two things. One is the actual product is a sticky, doesn't enable you to continue to come back because gross at the end of the day is like, how many people continue to use your product? It's like not a singular metric of like on day X, how many people showed up? Well, that's useful for today. But actually for a company that is ongoing concern, what you want to know is like, how many people consistently show up?

7:50And how does that grow, right? It's a cumulative concept, which means that, you know, the fact that people come back day in, day out is probably one of the most important factor in assessing the growth potential and growth of it, which to me goes back to a little bit of product where when people first come on, like we all notice, but, you know, the biggest drop off, typically day one or day zero, when, you know, people come on, they do onboarding and maybe they didn't get to the aha moment quickly. So why would they come back? If they don't come back, then your game as a gross is like, how do I get more acquisition, right?

8:21Because gross to me is also sort of a, you know, an numerically almost an equation. There's like, you know, people who showed up yesterday plus new people that you acquired minus the term people plus the resurrected people. That's sort of like an equation. And when you think about how to get the retention of, I think it all goes back to product. Why as founders and operators, why is there gross in your product? Like, why is it useful for more people? And is your product constructed in a way, as Gina said, like, you know, helps people understand what your product is about when they first use it.

8:52Can you deliver that product value again and again consistently? I think now we call it product like gross, but it's honestly like a core product value and how you actually define that is one. And a lot of things that we're also talking about here is like distribution. So they're like a product and the distribution side of it. If we think of like distribution, I think, you know, the panel is exactly right. There are areas where it's less good now and there are areas that are continuing to be good. You know, you talked about advertising, there's that saying that you never know where half of it goes.

9:21And maybe we're going back to that, but I think there are many other areas that continue to work well, whether it's subway ad or remnant TV ads or radio. It depends on your product is. And when your intended audience is, if you're marketing or appealing to young generation of gamers or communities or niche areas, then red and in discord are actually pretty good places. I also think ATT did kneecap a lot of the sort of paid advertising side of things. But the AI, like here I also talked about, can also be used for that purpose, right? Facebook or Meta is investing heavily on AI side of it so that sometimes all you need to do is just say, hey, I have this idea here is like the base creative.

10:05And now they're able to change how it looks, to add different copy, like change the thing to see what works automatically at scale with AI and deliver higher value. And that's also you know, very promising, I think, direction that we're seeing where the efficacy of the paid side may also be restored. Yeah, I mean, I like the breakdown between there is product and there is distribution, those latter up to growth, but maybe if we just attack this idea of building a good product, that's not a new idea, but it does feel like at least to me, maybe we are in a different era where it's easier to copy products.

10:43And so is it just about being a first mover in an era where things are easier than ever to build? And maybe Gina, you can speak to that because Duolingo kind of famously grew with no marketing budget. Is that correct or a very little marketing budget? And it was exactly product -like growth that resulted in that company becoming so big. Yes. So what I think has really changed with tech is that people could say, oh, my product is really good before, but like it wasn't as easy to know whether a product is good or not good as it is now because you can actually see that in metrics in terms of as Ryan was saying just in terms of retention and people coming back again.

11:18So now that defines what a good product is. But it's not just about building a product that's good, but also the fact that with tech, we have to build products that are constantly evolving and that are constantly learning and evolving from those learnings. But the main thing I think that like when you talk about Duolingo, what we're trying to do at latitude now, which is a new company. The importance of not just building a great product, but understanding really clearly what your moat is. And your moat needs to be something that makes it really hard to replicate your product. And it can be anything, right?

11:47Like so, for example, if Kim Kardashian launches a shoe that's exactly just like every other shoe that exists out there, the moat is Kim Kardashian because her brand and her audience and like the fact that she is an influencer, she's not telling people to buy this shoe, that's a moat. It means that like it's the thing that makes it really hard for you to go and just do that again. With is the most and that's the most incredible thing because of what I just said before about the iteration and the iterative practice. Anyone at any particular moment in time and many did try could actually go and copy exactly what Duolingo was doing.

12:19They in fact use the same fonts in many cases, they use the same design colors like the same format. You can do that but you don't have the data and the team behind it that knows how to use that data that is constantly learning from every single day of all of the usage that we're getting and understanding what's leading to every single decision and why we're modifying things in a particular way, that's impossible to catch up to. So at every moment in time, even if you mimic exactly what Duolingo is, there's no way you're going to get to the next day of Duolingo because you don't have all of that history or the knowledge of how to use that history.

12:53So you can just spend all your time trying to copy Duolingo every single day, but that doesn't actually get you to solve a problem for a consumer and understanding how what you're doing is actually solving a real problem, which is at the core of, as you were saying, a retensive product that people actually like, and that defines a good product. So it's not as easy as it sounds. It's definitely not as easy as it sounds. Kiran, I want you to tap in here. You now are the CMO at Zapier, which I feel like actually is a great parallel to what Gina just said. I mean, Zapier has so many, you could say clones or competitors, right?

13:27Like I've used many of them, many of them are cheaper. How do you think about that differentiation and building a product to Gina's point, like getting the right data and involving it in a way that you can stay ahead, you can have a mode? Yeah, I think first and remember, revenge is useful if you can build a healthier attention curve and that retention curve helps you make that product much better over time. And so you're just like making it much harder to compete with you. And that could be an all manner of things. Exha up your is mode for some time was just they had much more expansive coverage of apps and the amount of things that you can automate with.

13:57And then like, More recently, it's like, how do we integrate AI? How do we make automation much, much easier for companies? How do they actually do natural language within their apps? Like, one of the things that's super interesting about the AI part is going back like the distribution and then the product part and the product led growth. And like, AI is a phenomenal unlock for product led growth because product led growth will get naturally built into every single product because every single product will have a natural language interface. And so like, you will actually be able to onboard the products and use products without actually any human intervention.

14:25And I think that's an incredible augmentation of how apps work in general. But I think the most part is going to be much more complex. I'm talking through the lens of B2B, not through consumer apps. But certainly for B2B, it's going to be somewhat more complicated to figure out over time because AI does commoditize things and make things much easier to replicate. And we've seen AI may be one of the few platforms shifts that actually skews towards the monopolies and conglomerates versus these individual companies who just get sucked up in their features of these existing platforms. It kind of skews towards if you have distribution, you might wings.

15:00I think AI features might be more of a retention play than an actually new acquisition play, which is like, if you build the AI features into your platform, no one will go leave you to actually use all these different point solutions. So I think modes will exist in similar formats. There may be just companies with less of them. And I do think distribution is a mode retention, is a mode network effects, but there'll be a mode community is a mode. And so I think that all of those things in relation to Zapier, like how are we touching and all of those things as we continue the web company. One thing I want to respond to what Kirin said, a latitude, I would say the community is our mode, but the reason why the community is our mode in addition to the distribution aspect of it is the trust building.

15:35So trust can be a mode because that takes a while to build. So for B to be product, I think that's also super relevant because if someone can come into the market and just offer the same product, but you build a brand on the Zapier side that is super trustworthy, and so people will continue to trust new features or new solutions that you put out there instead of trying to maybe try new products. I think that that's another aspect worth considering. By the way, Karen, how many times a day do you get asked if it's tapier or Zapier? I don't even know if I said correctly, I said Zapier, but maybe Zapier.

16:08I should probably know. I heard one of the founders say it's Zapier, it rhymes with happier because it makes it happier. Oh, there you go. I know it's apps. That's how I do it. It's apps. Yeah, yeah. The main reason I joined is just I like to say in the word apps, it's just a cool world. I know we talked a little bit about B2B. Just talking about more of the consumer side, gross and thinking about distribution has changed. I think a long time ago already Mark Zuckerberg at Metta already said it's a battle for the home screen. And more and more, even recently, people are downloading less and less apps over time.

16:48Part one, part two is harder and harder to get discovered in the app store. App store ranking is hard to get discovery now. So now you have this issue of one, people are less willing to download brand new things. And two, even if they kind of heard about you, it's like harder to get discovered. So I think part one of the consumer side, the platforms have, or lack of better word, maybe I can call it ossified, where there are two distribution platforms, Google Play and Apple Store, great, and they just distribute apps. And people read download, ton of apps, they retry a lot of things with brand new things, not so much, or certainly less than before.

17:28So now you have this conundrum of like, okay, like it's just harder to break through the noises. And we talked a little bit about, especially Kieran talked about, you know, maybe AI is an accelerant for retention, maybe less of an acquisition. I think that's correct. And that's interesting where also we have a lot of these like incumbents, right? Like especially in the consumer side, incumbents come with incredible modes. They already have the network effect. They already are synced to everything. They already have login for everything. They already have all your data. They know what you bought.

17:59They know you. So So you talked about how do you stay ahead? It's very, very, very difficult actually. Even if you have a clever hack, all these companies come up with incredible new consumer products and they enter the zeitgeist and through entering the zeitgeist they're able to solve the first order question. How do I break through the noise and get distributed initially and have more people to try it on? That alone is a feat. That's incredible. If you have highly -retended product on top of that, legendary, that's amazing. Fantastic. And all these are the products that we talked about did have that.

18:36Now the question is, okay, copy. Gina, you talked about people copying down the fonts. I understand that so deeply of the Snapchat were four or five years. And you know, down to the font and everything, like UI level, yes, they copy everything. And how do you actually fight that as a new entrance? Especially when incumbents come bearing a lot of these already like weaponry, if you will, that have retention and data and everything. It's hard and I think actually, and this is like a sort of difficult answer, the only way really to stay ahead of that curve on that consumer side is get the lightnings keep hitting, which is so, so, so hard.

19:19I think getting the first hit is so hard. Second, product hitting, third product hitting, you're a generational company. So it's sort of that innovation curve that I think is like very interesting. So for the companies that are newly entering and building new product, and we're on the side of the builders, right? And companies may have like all the advantage, but we want to see new products. We want to see new, you know, hungry founder that are building for the next generation. And they're not happy with the current set of solutions. So the only way potentially is, you know, there's a series of things, but like step one boss game is like, how do you get through to distribution noise?

19:56Step two boss game is, you know, how do you get retented product? Great. Step three, and this is like the holy grail in my mind is like, how do you get that lightning to hit? Continue to enter zeitgeys. And for that, you know, I think it's thoughtfulness. I think it's a structure of the company. I think the culture of the founders and the team of wanting to continue to put out the best and brightest work that they have. have continuously versus potentially resting on laurels or optimizing for things that have worked in the past. And thinking that their first iteration product is what is going to bring them to the next, next, next level because they may not be because the distribution of the advantage of the incumbents as well as the difficulty of getting further discovery.

20:36What's an example of that? That sounds really hard. Is there an example of a company that you've seen execute on that hard mode really well today. I mean, you know, one of the last examples I've seen in one of our portfolio companies be real has done that too with certain features. But if you think about, I'll talk about snaps since that's the name I know well. And you know, it's been copied so many times. Don't have you. You know, the first hit one may think is a disappearing images. That was revolutionary that people thought of images as something to keep on your phone. It's like for recording and for keepsakes.

21:08You turned that into disappearing thing, which made the medium itself a message. Communication method. That's revolutionary, very interesting. Sexting was the first use case, but it catapulted the company in a new height. Great. So that was going really well. Now then, the kicker is they then started to add stories. Stories of these disappearing photos linked together that showed you a day in time in your life in a passive way, but also goes away revolutionary in that sense, then that to me is a second zeitgeist hit. Which by the way, what a great love something being copied to, right? So everybody has it.

21:49Like LinkedIn has stories like no dig on LinkedIn, but like everyone has stories now. So you know, it's a medium and like a thing that worked really, really well and potentially even burst like the short video type thing that's trend. So to think about the second innovation, That's like a huge innovation. Third also is you know, they didn't arrest area was like okay We are seeing more and more people Evanned in the front result of the front facing camera. What is the problem? Well, they don't like what they look like well Let's add dog ears on people's face. Let's like rainbow pukes on people's face and again That's another thing stuff where everyone copied like everyone has lens now like it's very very good I'm gonna talk here now and take talk You know, puking rainbows, blue eyes, what have you, but these augmented reality effects are now prevalent in consumer products.

22:36So this is one example where I think each subsequent hits have essentially catapulted the company the new heights. And that I know from inside was very difficult, very long term with several bets going at the same time and being very thoughtful of what to kill and what to put out there. So, it's that system of innovation is that hunger and continuous past that I think is very important. That speed and hunger of being able to like implement all that at a fairly large and established company, I think is a very difficult thing. So, I think there's a cultural aspect. I think there's a founders mentality of always wanting to be ahead of the curve, always implementing and sort of looping in the new products that the users are looking for.

23:22How do you foster that culture? I think especially in 2023 where maybe budgets aren't as big, maybe some of the talent you had before is not used to that austerity or that idea of having to ship really quickly, maybe spend less money and just figure it out. I've talked to a lot of companies this year that were CD public. I feel like a lot of founders are actually excited to get back to shipping. Like I think we went through this ballooning of companies during COVID and everyone was like wow Like I don't really know how this company even works anymore Yes, and we need to try to get back to like fundamentals and how do we actually iterate and ship fast?

Read the full transcript

24:03But I think what really as excited and tech is like getting back to the reason that people were excited to get into tech Like certainly I was as a fail software engineer is like to do work Like, not to like figure out how to like coordinate hundreds of people, but I actually like to get back and do work and ship things. And I think the faster you ship, the more you learn. So I think it comes from the founder. I guess it's a long -winded way to say like, I think you'll have some founders that embrace us. And actually at the heart, they actually thrive and they kind of chaos. They actually enjoy this period of time, especially like a lot of founders who are building with AI.

24:35I've met lots who are like, this is the best time to be a founder because we have no idea how this is going to go. And they love that. They love not knowing what the end result is rather than just tweaking the dials and trying to e -cat little bits of growth each and every day. And that trickles down from them, right? They set the tempo and it's up to the rest of us to up level to meet that bar. This comes from two places. One, as Karen said, from the founders, so from the top. And I think that what the founder can do is come up with artificial deadlines. For example, we have sludge in September because we're doing an event for 4 ,000 people and that's when we need to launch.

25:05And that's it. Or like a dual -lingo would be like, oh, you know, we We told Apple that we're actually going to make this sprint and now that's there. So we just have to do it. And so suddenly it's not like something that can be pushed because there's this external deadline. A lot of times it was artificial because you kind of created, but now it's set in stones. I think you can help from that perspective. And the other one I think is actually creating a culture from the very practical point of view of like a process, like for example, sprints, you know, so you have like two exprints and that's sort of the cadence at which things happen and maybe that's the cadence at which you're doing A, B testing.

25:35making sure that you are prioritizing as part of that sprint and that you're not just shipping to ship because then you can just like spray and pray. We need to like really be learning from everything that you're shipping and iterating. So that has to be part of the process whether it be retrospectives or whether it be having accountability like our product team at latitude has a show and tell every two weeks and where and sort of the whole company is there expecting to see what's evolved. At Duolingo we had a practice of making sure that every experiment had a proper right up in the beginning with all of the hypotheses and what we actually expected.

26:07And then two weeks later to be able to come back and then look at all of those because otherwise we'd be running around thinking about the next test and we'd forget to go analyze, think about what we learned and apply. So I think that all of those, you can sort of have little levers that create the culture from a practical standpoint so that you can set and forget and not have to, as a founder, keep watching and seeing if people are moving fast and iterating. So, funny you mentioned the artificial deadlines because I was thinking about this recently, about how, you know, when you go through college, you have exams, you have projects that have due dates, and then when you enter the workforce, especially over the last few years, you have those, but they feel very, very gray.

26:45And so, I think it's just a funny acknowledgement about how sometimes that works in the workforce. But, you know, you spoke to experimentation. How do you think about that in 2023? Should companies, especially when things are tighter, should they be leaning more into experimentation, because it's like, okay, we gotta figure this out. Like, here inside, we don't know where AI is going. Or should they be really drilling down on, you know, maybe the one or two channels that they know work? I always think of like your growth initiative as a portfolio of bets. And your portfolio is like very similar to like how you think about investing.

27:16You wanna have a spread across things that you have a high degree of confidence in. And the thing that you have high degree of confidence in is where you have a historical context to say we've done something similar before and it will likely work. And I can measure that against like, like what's the potential upside. But you definitely wanna take some things that are like more my speculative guests. Now all my speculative guests in terms of investing from 2020 to 2022 are all down by 80%. So they definitely do lose. I've lost a lot of money. But in terms of your growth portfolio, you wanna take those big swings.

27:44And I think one of the things that happened to your point staff, that's a nominal and I know of like, this is kind of a deadline, but it's not really a deadline. Like I've been in tech for a while. That definitely was not always the case and became the case when tech was ballooning. And I think it's good to get back to actually this stuff truly matters and hidden these dates truly matter. But I think the other thing that we've got away from is having people in the company who will take risks, who have deep convection about things, who will take risks, who will say, hey, we think this is the right thing to do.

28:11Give me a couple of people and I'll prove this at weekends or nights. And I'll figure out this is worth doing or not. And I don't have any historical context to say this is a good idea. But I've talked to customers and I think this is the thing that's going to work. And so I do think that we need to have experimentation across the entire spectrum. from like, how do we have confidence, high impact to like really game changer thing, not a lot of context to say this works, but like, is a real thing we're doing. And if you are at the point where you can have statistical significance because you have a lot of users, then I think, you know, you have to everything and it needs to be an experiment, even the things that you already know, like the channels that are already working, because if it's not an experiment, then you are not looking at it from a very scientific perspective and gaining data that will actually tell you whether you can replicate this when you launch it to a lot of users.

28:52But I agree 100 % with Kirin in the portfolio approach. It's not either or it has to be end. But I do believe in being as data driven as possible. Of course there are exceptions and there's an art to things but to be as data driven as possible. And that's where you find experimentation to be super important. And if you are an early stage startup you need to take big swings because if you get incremental improvements in things you're just not going to get anywhere. You can like improve things to percent over and over and no one and will notice you. And the way that I would approach it from a very tactical perspective is I would list all of the ideas of things that I would like to work on, whether it be like try and true channels that I wanna iterate on or big swings.

29:31And I would just try to rank them based on ROI. Like how hard is it gonna be to do this? What do I think is the return gonna be? And then just try, and that's the information I would use to make a decision about the portfolio of things would be working on as a team. Yeah, just to give one example on the big bets, because I think sometimes we think of these things as like the kinda AB test. For HubSpot, acquiring the hustle for us was a bet. We had deep convection about the future of B2B content needed to be much more engaged and needed to be part of the everyday presence of how people interact with content, one -on -two -a -gauge content, but we had never bought a media company before.

30:03You can't AB test that. Yeah, we had never had media talent that we had to figure out how to integrate to the company. And we used that talent to build a podcast network to do about the creator program for our staff. We built all of this stuff, really incredible presence on YouTube and we got incredible talent that I think is a real moat against most B2B companies because they do not have this talent within that company. That's like an example of like a sizable bet, not to something that we had deep conviction about. So I think those kind of things do matter. It's like a fun matrix of like important and urgent and important non -urgent like two by two type thing and you know some of the bets are you know both important and non -urgent important and urgent.

30:42But then you have these other you know ideas where you have this inkling, especially into consumer side. This is nearly impossible to predict how something would do, especially if it's like a fairly large bet. So there's a little bit of intuition where you sort of rank a couple of options and like look, I think this is a big product bet and that could be one of the experiments or sort of projects that you work on. Karen, you said something earlier, I really loved, which is at the end of the day, the founders and operators do what they do because they want to ship things. And you know, ship things that people use back to the fundamentals.

31:13I keep thinking it's one line or like the calm sea never made good sailors. And so, you know, we're not in a like a calm sea. And then what are good sailors made of? And they're probably made of like a lot of experience, but also knowing how to do the basics really well. Really, really, really well. And so going back to that fundamentals, to me is really interesting because there are two different ways to deal with this, which is like how do I get out of this? And what do I do? And here's all these tactics and hacks that you might be able to do. But there's another point of like, no, actually the way we become like an important generational enduring company is to get back to the foundation and fundamentals and build stuff that people want to use and genuinely is helpful to them.

31:53And I think that constitutes some of the ways as how people can think about making big bets. Totally. Maybe one topic we could just address directly is AI because on one hand, you're all kind of speaking to this idea of the fundamentals, right? Focusing on what really matters. But then you have this big wave like, you know, to use your sailor analogy, Brian, it's like there's this big wave coming and it might hit your ship and you got to figure out how to integrate it, avoid it, how are you seeing companies really kind of intelligently, creatively on more so the distribution side or thinking about how companies can grow.

32:30You know, look, this is very new and I'm very new to understanding AI, so I just put that there. But I think that from a distribution perspective, there's two ways to approach AI. One, what are the ways in which we can use AI to reduce the work that we're putting into things? So like when we're talking about ROI, that's the investment. It's just like reduce amount of time spent on things like for example, copywriting or image generation. I am a purist when it comes to copywriting. So like I think that everything needs to be like Pulitzer Prize winning copy. So I don't actually like copywritten by chat GPT, but it's actually like 75 to 80 % of the way there.

33:03And so I think that you can probably use that to benefit your company in many ways. either by helping organize ideas or coming up with a V1 of copy. I think you may be able to do that with image and potentially video as well. I would think about how to leverage AI to reduce work, to automate things and just make things cheaper from the time and spend perspective. Gina, by the way, you got to incorporate that into your prompt. You got to say, a YouTube title written by Pulitzer Prize winning writer. Yes, I'm sure. I think maybe we'll get there. But here's why I don't think it will get there because I think that human emotion and the ability the humans have to understand each other And how to make each other feel is gonna be really hard for AI to pick up on and so we are able to come up with just that one word Or just that one punctuation that really like drives the message and that's gonna be hard to replicate unless it becomes a little bit of Recipe at which point it stops impacting people because people become a little bit numb to that But then that drives me to the second point in which I think we can use AI interestingly which is people are very impressed by AI right now, which means they're more likely to pay attention, which means they're likely to think it's funny, which means they're likely to think it's moving or shocking.

34:13And those are all things that help your brand become remembered. And ultimately, that's what marketing and brand work is. And so I would leverage AI in as much as I can to accomplish that. When I think of AI for distribution, I kind of split it into two categories. And Gina covered one of them, which is there's a lot of people that are just using AI to replicate the things they do. And so that really is just like a cost saving. and marketing, I think might move from more of a channel domain expertise to more a generalist. We have generalists in early startups. I think that will actually be true of a stage companies because these generalists will be able to stitch together these micro apps to create customer experiences by just using data sets and using AI modeling.

34:50And that will suit operators and technologists. That's great news, by the way, because so many of us are generalists and I'm like, oh, great, I'll have a job. Yeah, I think people are like enjoy data, enjoy learning how to use apps and are able to think like product builders, to think marketers and growth people need to think like product builders. Like how can I use this to sit together some sort of build this in experience for someone? And I actually, how do I creatively do that with these apps and data? So I think there's like, to replicate what we already do. And you see a lot of this with like, I find sales, right?

35:18Like that's the number one use case you see right now. I can drag in all this content and use chat to be tea to create very, very cool like, I find sales. The stuff that I'm interested in is like, maybe that's 90%. The 10 % is like, what are things you can do with AI that is not possible today that helps in distribution? I'll give you one quick example. If you come into Zapier because it's 6 ,000 apps, and if you actually all the different triggers and things, like millions of different variations of what you could actually automate. So how would I ever know to figure out what I can unboard you to, or what you need to do when you actually sign up as user?

35:49The best way I could do that is build an automation guide just for you. Today, the way I would do that is I would get someone to reach out, talk to you about your tech stack, figure out what rule you are, and they contextualize workflows in a language you understand that are like contextual to your job, right? Hey, Steph, you're a marketer, you want to generate more leads, you want to send leads to the sales team, you want to enrich them, you want to make sure they can close in the customers more, like you understand that language and you understand why that's valuable. Again, today, human would need to reach out, write the automation guide for you, so not economical, not scalable.

36:18One thing I've been testing is like, we've been testing like ChatGbTV and able to do this like grab data from like something like ClearBet or something like that, TextStack, be able to feed in your role, be able to feed in contextual information about your text back company, and then have that right and automation guide for you. And then actually be able to surface that automation guide, whether through sales, whether through chat, whether through all these different mediums. And it's really good, like surprisingly good. The first time I did it was like, boy, like this is like, wow, like this is something we cannot do at scale today.

36:46That's the 10 % that I think if you do as a fast mover, you get this little window of time before everything gets commoditized and everyone just does the same stuff. that again, if you have good retention, you actually get meaningful growth there because you have that retention curve, you can get those users to stick up sell across sell and actually that's really really valuable. So there's the 90 % that I think most people are trying to replicate the things that we already do, but that 10 % like it's super interesting, which is what are the things we can do at scale today that we could not do previous to actually having this technology?

37:15I'm smiling because I heard this quote once, which is that the best growth hacks are never shared. So you gotta be careful, Kirin, sharing that 10 % I'm on the podcast. I need to keep the rest getting started. This is true. I'm smiling because this is such a fun conversation. And Gina and Karen, you both hit on the non -reflucability of human and I was thinking about this Nikon ad that just came out a few days ago, which is like, don't give a photo of the real world. And it has these unbelievable image of real places and a fake prompt that would generate such real image. And it was a very powerful message of, look, yes.

37:52A .I. can do a lot of things, but don't give up on the real world. And it was very powerful and it's creative. And, you know, can A .I. come up with that? I don't know. So it's very interesting. On the consumer side, a couple things going back to your question stuff, it was like, what can the companies do to use it to your advantage? One is the willingness to try, as Gina said, as it's quite high, meaning at least for the consumers for the first time in a while, they're willing to give it a shot. They're willing to actually download and use the product and try it out and go through the app download and all the things which They weren't before so for the first time actually you have this window of opportunity where people are willing to give it a shot So now acquisition side you have this sort of Potential window where you can appeal as like either first mover or great product to get a lot of sort of usage You know, Karen shared a zap of your example where you could also use it very strategically to deepen your core product value Like, why are people using the product that you have out there?

38:50And how do you actually use this new capability, new wave, if you will, to further strengthen and deepen the reason why people use your product? And sure, you can brand that AI and make it sexy, and like more people will be excited, what have you. But, you know, I learned one thing from Snap where the luxury, the sort of lens product was a state of the AR product, like augmented reality product. We did not call it augmented reality for four years. And we actually implicitly banned it inside a company to call it an augment reality because That's technology. That's not the point The point is for users to giggle and use and then have that emotion so As you think about like these new technology that are being enabled and and Karen talked about the 90 % and 10 % new things But there are these like ways deep in the core product value of why your product exists that I think you know You can call it AI.

39:41You don't have to call it AI. It could be abstracted away. It doesn't matter if If it makes the job that you do much easier in two ways, one, either take care of the raw things that you're doing in a mechanical turkey way, great. Or all of a sudden deliver value that wasn't possible before because they're a cost prohibitive or net new, I think that's incredible. So people you talked about, is there a way to avoid the way? But I don't think so. I think it's kind of a tsunami. If you sit there, it's just going to wash your way. So you do need to respond. And how you respond, I think, is important where rather than saying, oh, there's like a new shiny thing we're going to bolt it on.

40:17I actually think it's going back to the fundamentals to say, hey, like, why do our product exist? Then why do customers use our product every day, day in and day out? How do I use this new capability to actually augment that and make that even easier? So I get very, very excited about existing companies as well as net new companies because they both now have a new thing, right? Like for existing companies, their ways to actually deepen your mouth, actually, use this product, abstract it a way to make it so much more useful than before. New companies, all of a sudden, you have this moment in time where people are willing to give it a shot.

40:54And in the consumer side, what I also get really excited about is there are these net new behaviors. I know we talked about how we'll never sort of fully rely on computers for creativity. But you know, the cost of creation has nearly gone to zero now. The post production of this podcast, the actual creation, the ums and uhs and the i -movement and everything, you can actually pretty easily do that's rei, I potentially with a lot of new products out there and all of a sudden, you know, maybe you don't need a huge studio, maybe you don't need all these amazing client -seagadgets to do what we do and the bar is lower, the entry point is lower, meaning that, you know, all of a sudden the marginal cost of creation overall, whether it's image or video or prompt or pie, what have you, maybe quite low, which that means the new limiting factor is possibly creativity.

41:45And that's a very, very fun place to be. Speaking of creativity, I wanted to end this with a little bit of a challenge, a prompt for the three of you. You know, we talked about a lot of different things, we talked about product and distribution and how those come together. And you know, one product that I work is the A16C podcast. And if we think about austerity and trying to grow and turbulent times when you know maybe budgets aren't as high, if we had $10 ,000 to grow the A16C podcast, given all the channels that you could invest in, how would you think about that? And please don't just tell me build a better product because we're working on that.

42:23But on the distribution side, how would you use that money? Well, from someone who has tried to build two podcasts, my favorite word for podcast has growth is like grind, it is like grind, you know, because there's not a lot of meaningful things that work for podcast promo. So like, I'll just give you a wacky idea instead. Okay. May or may not be usable. So one of the things I would do, and this is kind of being done, I guess before, but it might be a more novel way to do it, is like get your audience, like pick 10 entrepreneurs from way back in the past that are no longer with us, like all the way back to Henry Ford and all these incredible entrepreneurs.

42:56Get your audience to vote. And like, what's the number one person you would like to hear interviewed in this pod? get them to vote. Whatever the top one is, use a 10k to give to someone to create an AI version of that, like person, you know, it's pretty easy to create a deep fake version, and then you should just interview them for half an hour and like put that out into the interweb. And that's probably a good way to like get interest in the podcast through something that will hopefully get a lot of social traction. I have an equally wacky idea. Being a consumer mindset, I think one of the distributed in channel that works these days as TikTok.

43:28So 10k, not a lot, but maybe the way to do it is find the intentionally quite controversial topic, we talk about it. Use AI to splice it up so that it's entertaining and very easy to point. And essentially the call out is finest. Stitching coming, fight us. And the hot take, fight us. And you know, actually use that remix culture of the internet to let that sort of do what it does. And the reason why the dollar would be interesting is sometimes it's interesting to seed these things. So have like one or two, you know, influence or whatever you're like overfounders who like we can, you know, invite over and like, here's a piece of content now, go debate that and actually be pretty brutal.

44:09Because like people love a good fight and put it out there and see how that does. I actually kind of love this idea. Even just the tag fight us is so strong. It's cool. I thought about it and I have a very boring idea, But this is what I would do. I think that your bet here would be to try to increase your audience by looking at places where your audience isn't, but you have a huge potential audience. And for me, that would be people in older demographics that are very business savvy and have been very active their whole lives and kind of get technology, but are a little bit out of the loop and don't know what A16Z is and have never heard of anything related to it.

44:46And I have had conversations with brilliant people and finance, or maybe like in their 60s, let's say, maybe even 50s, who have no idea what a 60s is, which in my world is crazy. And those people read the Wall Street Journal, and those people read the New York Times. So I would go and do something with one of those massive publications to reach those audiences. The thing about growth is that it's not just about growing, but you have to grow in terms of like the right people. So one way to game your question, which is something that growth seems to do all the time, is I'm just gonna go to a country where buying a user or buying a listener is super cheap and I'm gonna go and like you know do some sort of massive campaign because $10 ,000 goes so far in like Southeast Asia or like Latin American countries and then just get a bunch of people to listen to away sixteen.

45:31But it won't actually matter because they're not your core audience. But that would be a game of a response which I just want to leave here because I think it's really core to growth. In order for you to actually come up with a good growth strategy, You have to think about how can you game this problem and if you can easily game it then you're looking at the wrong thing Totally. Thank you all. This was so fun Thanks for listening to the A16z podcast if you like this episode don't forget to subscribe, leave a review or Telefront we also recently launched on YouTube at youtube .com slash a16z underscore video where you'll find exclusive video content We'll see you next time

From the publisher

Despite the ease of product building, sustainable growth has become increasingly challenging as many traditional channels no longer deliver the same results.

In these challenging times, we explore the remaining growth opportunities. How can we achieve a balance between efficiency, profitability, and growth? Which channels are still relevant and how can they be effectively mastered in 2023?

Join us as we discuss these questions with three seasoned experts who have successfully navigated similar confusing times in the past: Gina Gotthilf, leading Latitud and renowned for her impressive tenure as the VP of Growth at Duolingo; Kieran Flanagan, a long-time SVP of Marketing at HubSpot; and Bryan Kim, Consumer Partner at a16z, who held various leadership roles during Snap's hypergrowth phase up to its IPO.

 

Topics Covered:

00:00 – What growth opportunities exist in 2023?

03:00 – What still works in growth?

05:02 – The fundamentals and framework of growth

07:02 – Assessing growth potential and product lead growth

09:33 – Distribution

11:15 – Your moat and growth

14:00 – Integrating AI for product lead growth

16:23 –Trust as a moat

17:23 – B2C growth - discovery and breaking through

18:51 – Can you get ahead of the incumbents?

22:03 – Examples of companies and products

24:59 – How do you foster a growth culture?

28:38 – Experimentation  

34:20 – How companies using AI in distribution

44:43 – Growth challenge: What would you do with $10K?

 

Resources:

 

Stay Updated: 

Find a16z on Twitter: https://twitter.com/a16z

Find a16z on LinkedIn: https://www.linkedin.com/company/a16z

Subscribe on your favorite podcast app: https://a16z.simplecast.com/

Follow our host: https://twitter.com/stephsmithio

Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures.

Stay Updated:

Find a16z on X

Find a16z on LinkedIn

Listen to the a16z Podcast on Spotify

Listen to the a16z Podcast on Apple Podcasts

Follow our host: https://twitter.com/eriktorenberg

 

Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures.


Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.

More from The a16z Show

All 489 episodes
Growth vs Efficiency: Can You Have Both?The a16z Show · 46 min
Listen in VO