Is ConvertKit open metrics a good or a bad idea?, We analyzed 12,037 sessions of 1013 people searching on Google to better understand how people use, and How to lie with data - 91% all cause mortality

11 Apr 2024 · 20 min

Ask about this episode

Ask anything about it. ChatGPT or Claude reads this page and answers with the times it was said.

Connect VO and ask about every podcast you hear, including the moments you saved. Add to ChatGPT · Add to Claude

In short

Podcast Summary: Marketing School - Episode #2718

Episode Title

Is ConvertKit Open Metrics a Good or a Bad Idea? | We Analyzed 12,037 Sessions of 1,013 People Searching on Google to Better Understand How People Use | How to Lie with Data - 91% All Cause Mortality

Hosts

  • Neil Patel
  • Eric Siu

Episode Overview

In this episode, Neil and Eric discuss the implications of sharing metrics publicly, delve into their analysis of Google search behaviors, and scrutinize misleading data in health research. The episode emphasizes the importance of relatability in marketing and the effective use of video content.

---

Key Discussions

  1. ConvertKit Open Metrics
  2. Definition: Open metrics refer to the public sharing of company performance data.
  3. Arguments For Sharing:
  4. Transparency can build trust with customers.
  5. It can provide learning opportunities for other businesses.
  6. Arguments Against Sharing:
  7. Can create unrealistic expectations and increase vulnerability to criticism.
  8. As companies grow, their metrics may become less relatable to smaller businesses.
  9. Sharing metrics may not yield constructive feedback from a broad audience.

Key Takeaway: While sharing metrics can foster community and trust, it may also complicate perceptions of success and relatability.

---

  1. Analysis of Google Search Behavior
  2. Study Overview: Analyzed 12,037 sessions of 1,013 people to understand how users interact with Google search results.
  3. Findings:
  4. 11% of users scroll to the bottom of the first page.
  5. 58% click on organic listings, with only 8% on paid ads.
  6. The presence of videos in search results increases click rates significantly (61%).
  7. For local searches, map results capture 52% of the clicks.
  8. 90% of users utilize Google's suggested search queries.
  9. Users are more likely to click on Google Shopping results than organic Amazon links (14% vs. 3.3%).

Key Takeaway: The data emphasizes the importance of optimizing for video content and Google Shopping, as these formats drive higher engagement.

---

  1. How to Lie with Data: Intermittent Fasting Study
  2. Discussion: Critique of a study suggesting a 91% increase in cardiovascular mortality risk associated with time-restricted eating.
  3. Key Points:
  4. The study used unreliable data collection methods and had significant flaws in group comparisons.
  5. The misleading headlines can cause unnecessary panic about dietary methods that have been beneficial for many.

Conclusion: Marketers must be cautious about interpreting data. Sensationalist headlines can distort facts and lead to public misconceptions.

---

Final Thoughts

  • The hosts conclude by reinforcing the importance of relatable storytelling in marketing and the need for businesses to adapt their strategies based on audience engagement trends.
  • They encourage listeners to focus on building a community through shared journeys and measurable results.

---

Call to Action

  • Listeners are invited to subscribe and leave feedback, as well as to explore additional resources available through the Marketing School platform.

Connect with the Hosts

  • [Neil Patel on X](https://twitter.com/neilpatel)
  • [Eric Siu on X](https://twitter.com/ericosiu)
  • [Marketing School Website](https://www.marketingschool.io)

---

This episode provides valuable insights into digital marketing strategies, the importance of understanding consumer behavior in search engines, and a critical perspective on how data can be manipulated in health-related narratives.

Written by AI. May contain mistakes. Listen to the episode to check what was said.

Hear the part that matters, and keep it.Open this episode in VO. Double tap your headphones to save a moment as you listen.
Get VO free

Transcript

Automatic transcript. May contain errors.

0:01All right. So I wanted to talk about actually, there's a email service provider that you use called convert kit i you know had nathan berry at a founder's retreat a couple months ago so you do about 41 million dollars in arr or annual recurring revenue and they actually so funny enough yeah yeah here let me show you something okay okay don't challenge me let me show you this it's not even barometrics anymore this is you know what's funny? Let me give you the high level here. This thing is really cool, right? This dashboard, you know who made it? It's Ali Abdaal's brother. This is causal.app. They raised a bunch of money, I think.

0:41Okay, sorry, I lied. You're right. 38.8 million is their ARR. And then this is their goal to get to 41 this year. I think that's what it is. But I think, remember we've talked about, do we think it's helpful to share your numbers openly like this? Because it's actually really cool because when you look at their mrr churn in the very beginning right or um lifetime value you can see all these things net dollar retention uh from the from the early days you can see how it all went it got a lot better what's that i love how it says mr churn used to be high but is now is healthy i'm not i'm not trying to say convert kit is doing a bad job i'm just saying three percent a month is not healthy churn for sass as marketing software tends to turn higher so it's a lot that convert kit can't control yeah well i mean he also hits a lot of smbs too uh because when you look at arpu here you know it's it's kind of around 9k per year so it's not like enterprise contracts but you can see it all down here so the the reason i wanted to bring this up one causal dot app looks really cool and i like how it's summarized like this i would prefer not to share metrics publicly.

1:54I just wanted to go through it. I want to refresh our take on this. Is it helpful or not to share your metrics publicly like this? Well, first off, you interviewed Nathan. Did you ask him why he shares his metrics? I actually didn't touch upon that because my opinion is still the same. I don't think it's helpful to share metrics like this. I don't think it does anything for you. I think if you want people's input, you can share their metrics with those specific people and you don't have to share with the whole world. Yeah. And that's what it is. Some people still share their metrics. I know Pat Flynn used to share, like I had him on the podcast recently.

2:28He doesn't share his metrics publicly anymore because it also, as you grow more, if you're trying to be helpful to people, it becomes less relatable. And you also start to paint a bigger target on your back as well because this is just how people are, right? The more wealthier they think you are, the more richer they think you are, the more you become a target. And that's just how it is right that's human nature so i think it's congratulations to your success but i still wouldn't do it so anyway i just wanted to bring that up do you want to hear a funny story so we both know tim better be funny the stock trader whoo who tim sykes we both yeah yeah yeah yeah all right we both probably haven't seen him in a while but uh interesting guy good personality he's funny uh when you hang out with him in person when he used to talk about stock trading and he was showing how he took his barbnits of money.

3:16I don't know what that meant. It was like 30 grand or 16 grand turned into 100 grand and then millions of dollars. Dude, I need a barbnits of money. And then he kept doing more trading and showing like I was taking 1 million to 2 million or 4 million or whatever the number is. His signups actually weren't doing as well. The moment he said, all right, forget this. I'm going to start over and each year and take like 10 grand or 20 grand or something and grow that. he started doing better in signups in revenue and people following him because like you said it's more relatable i think sharing the journey assuming you're targeting smbs or people starting off from the low end to getting somewhere that can really change people's life like six figures or whatever that's amazing and you'll get a lot of followers from it and you'll generate a lot of traffic.

4:09I used to do that from aha to oh shit. And I took you did it. You did a challenge. Yeah, but I did aha to oh shit. And excuse my language. I took this from Groove HQ. But again, I said from aha to oh blank, I'm sharing my journey from zero to 100 ,000 monthly visitors. I'm learning a lot. And so will you put in your email address to learn more. did really well. And I'll blog about that every month. And those stats and data aren't too crazy because I'm not sharing like revenue numbers. But then when I went from the same thing, I'm sharing my journey from 100 ,000 to a million monthly visitors. It didn't do as well.

4:50And then when I crossed a million, I just stopped sharing because everyone's like, well, you're at a million. I can't relay. I don't even know how to get to 10 ,000. I was like, okay, this works better at lower numbers than higher. And I think if you want to share, it's not helpful in which you don't get tons of advice from people but you build up a community way faster on the smaller numbers and then just stop doing it once you got the community and you hit the number we now have a new segment in this podcast because the marketing school youtube channel is only at 2 000 subs right now so you guys will see us go from 2 000 to 10 000 then do 100 000 and then we're going to go for a million and you know the cool thing with the play button neil is you can buy multiple ones so once you get one you can buy it for other people on your team and all that so we're going to show you guys how to get a silver play button and then a goal a gold play button and then there's a diamond one too if you get to 10 million you know that i didn't i have the silver and you have the gold too from a million you have a gold i don't know where it is though i didn't know you can buy it from other people on your team no so okay here i have it right next to me over here let's check this out so here's here's my silver i've actually never seen this right now again in the microphone oh yeah so here's a silver play button right and then this document over here or sorry, this over here, this card.

6:06Thank you. Well, you can't see the card. Okay, the card says, congratulations on your subscriber milestone. We are honored to take part and recognize your achievement and I want your experience to be exceptional. If you want to buy more, basically, you can buy more for your team and you basically pay like 150 bucks per so your team can celebrate in it. But anyway, we'll share that journey. That's a good idea, Neil. And going back to Tim Sykes real quick before we move on, The fact that he's redoing it, he was redoing it every year, going back to zero, going back to zero. It shows that it's not a fluke and it's a repeatable process.

6:37And that's also more trustworthy, too. Yes. And what he found is he took that model, he started doing really well, and then he brought on other people because he already had a platform who were different types of stock traders. And they kept rinse and repeating the same model. And that's how his business grew from, you know, 10, 20 million, 30, 40, et cetera. Yeah. Yeah, that's actually a good take too, because he was the coach, right? And then he hired other people, he taught them, and they became the coaches, right? And then he went and started a new brand called Karmagala, right? I don't know that they're interrelated or not, but the charity, right?

7:14Nonprofit, okay. So that's not related, it's probably not worth talking about then. So what else do you have? No, but here's what's interesting, what he did with his marketing. he ended up making it Tim Sykes but he had tons of different coaches on there and the company was still called the same and it did well it just shows even if your brand is related to like Flynn or anything like that you can bring on tons of other people and scale it uh and it still works here this is what it is recognize your team so you see there's a there's a gold one over here there's a silver one and there's a diamond one so Neil send me your gold one so then I'll act like I have one as well.

7:48So just I can put it in the back. But anyway, I want to take a second to tell you about my podcast co-host agency. So NP Digital, so Neil Patel Digital, what they do is they do a whole host of marketing services and they are global. They're worldwide. They have SMB services as well. They have mid-market to enterprise services as well. They cover the entire gamut. So you could just go to mpdigital.com to learn more about it. And now back to the episode. But on a side note, we did something interesting the other day. Let's see if I can actually open up my tabs to go find the history. There you go.

8:30So we did something interesting the other day. It actually was going on for a while. We wanted to analyze Google search results and see what was happening, right? So we analyzed a little bit more than 12 ,000 sessions on Google from 1 ,013 people searching. So the exact amount of sessions were 12 ,037 sessions. And we wanted to better understand how people are searching Google, especially because of AI, what they're clicking on. And we learned quite a bit of interesting stuff. So I'm gonna end up going down. I'm sorry for reading, but I think you can share your screen, you know? Oh, all right.

9:08Let's just share the screen. I'm so sad for sneezing because someone said explicitly, I hate it when they sneeze. And I'm sorry for sneezing, but sometimes we can't control it. So number one, only 11 % of people scroll to the bottom of page one. And in most case, people clicked on a result towards the top of the search results page as they found what they're looking for. So it just shows that Google's algorithm is pretty good at just showing people what they're looking for and the top three results. The second thing was from all the sessions, 58 % of the people clicked on an organic listing. 8 % clicked on a paid result.

9:48And keep in mind, not all results actually include ads. And 34 % had no clicks. It's kind of crazy, you know? And keep in mind, this isn't like a crazy sample size. To give you an idea, there's 8.5 billion searches a day on Google. So 12 ,000 is a really small percentage. And we didn't do 12 ,000 over a day. it took us weeks to collect that, right? Because we needed the collaboration of the people actually searching. By the way, Neil and I have an agency owners group called the Agency Owners Association. All you have to do, just go to marketingschool.io slash agency. Once again, it's marketingschool.io slash agency to learn more.

10:29And now back to the show. Three, when a search result page contained a video above the fold, searchers clicked on it 61 % of the time. Wow, that's high. If you're creating content like we are here doing a podcast, create video formats and put that stuff on social media because Google is indexing it. And when they're showing videos, there's a really high click rate, especially when those videos are above the full. For local queries, map results got 52 % of the clicks. So if you're a local business, it's really important for you to be in the map results. And a lot of that has to do with Google My Business.

11:06make sure you're getting the reviews, the ratings. 7 % of searchers modified their search query. It pretty much means like, imagine searching for something, not finding what you're looking for. So you adjust your search query in hopes that you will find what you're looking for. But it just shows the majority of the people who are using Google on their first search result are typically finding what they're looking for. And 90 % of the time, people use one of the suggested search queries provided by Google Autocomplete. So also known as Google Suggest, you know, when you type something into Google, they show you a list of pre-filled words and phrases and 19 % of the people just click on one of those.

11:47So they're pretty decent at predicting what you're actually looking for once you start typing in a word or so. when people search for a product 14 of the time they clicked on google shopping result and they were 3.3 times more likely to click on a shopping result over amazon organic result right and this data is when there was an organic amazon result so it's pretty crazy people will click on a shopping result more than an amazon result which i would have never guessed i would have actually assumed that people would have more so clicked on the amazon result but that's not the case. Of the users that clicked on the organic result, 35 % of the time people click the back button, meaning they didn't find what they're looking for and they're going to another result.

12:32And the average search duration was 59 seconds. And of the users that clicked on the listing, 54 % of the time, they only clicked on one result and that was it. No back button, no nothing. They're pretty much one and done, good to go. They got what they want. You know, one of my takeaways from you reading that is at the end of the day, human beings will be human beings because if 61 % of people are clicking on a video, that I consider a rich snippet. If they're clicking on the local map path, that is a rich snippet to me. And that's always been the behaviors in the past too. Whatever they see, whatever the human sees and whatever stands out, they're going to click it.

13:07Which is why when you release a book, for example, if it's a different color than the other books out there, it's going to stand out more. And so food for thought, try to get the rich snippets If you can, it just, it depends on the surf that you're optimizing for. Yeah. And if I had to give two more takeaways, one would be produce way more video content because the click rates are through the roof. And if you're in e-commerce, you really have to focus on Google shopping, not just Amazon. It is an omni-channel approach. Yes, you need to do marketplaces, but you also should consider Google shopping.

13:37And we see a lot of businesses just take that. If you've ever built a website, you know how tough it can be to keep a strong design while ensuring site performance is fast. That's where Framer comes in, and it totally changes the game. Framer is the design-first, no-code website builder that lets anyone ship a production-ready site in minutes. I recently built a custom landing page in just a few hours. Animations, fast load times, responsive layouts, all without writing a single line of code. It was easy to use, and the end result was polished enough to look like a developer spent days on it. One of my favorite things is that Framer's AI handles translations with a single click, so your site can be up and running in multiple languages almost instantly.

14:14and with real-time collaboration, your whole team can jump in and work together. No issues with versions or miscommunication. Whether you're starting from scratch or using one of their templates, Framer lets you focus on design while handling the technical side for you. Animations, responsive layouts, search optimization, and all the things that matter. Ready to build a site that looks hand-coded without hiring a developer? Launch your site for free at framer.com and use code MS to get your first month of pro on the house. That's framer.com, promo code MS, Framer.com promo code MS. Rules and restrictions may apply.

14:46When I first started my business, the overwhelm was real. I didn't have the tools to help me scale. If only I had Shopify from the start to handle all the behind the scenes work. Shopify is the platform behind millions of businesses globally from huge names like Mattel and Gymshark to the smallest brands just getting started. The best part about it, it has everything you could need. Say you're ready to launch your own design studio. Shopify has hundreds of templates to create a beautiful store that matches your brand style. Or if you need help with content creation, Shopify has got AI tools that write your product descriptions, craft page headlines, and even enhance your product photos.

15:21Shopify lets you easily create email and social media campaigns to reach customers wherever they are, whether they're scrolling or strolling. If you're ready to sell, you're ready for Shopify. Turn your big business idea into a game with Shopify on your side. Sign up for your$1 per month trial and start selling today at shopify.com slash marketing school. Go to shopify.com slash marketing school. Shopify.com slash marketing school. You know, speaking of data here, here's, here's something funny. Did you, did you see that, that study recently that says time restricted eating? So basically intermittent fasting is associated with a 91 % increase in the risk of cardiovascular death.

16:01Did you see that? No, but I do. So I'm curious on this. Okay. So here, get this. Cause you like to read off a lot of data, right? So the cardiovascular death is death related to the heart. Correct. Correct. Correct. So this is Peter Atiyah. By the way, Peter. Heart attack. I don't know. I mean, stroke to me is like has to do with the I don't know as much. Maybe that's the brain more, but maybe it is. I'm not a medical person, nor are you. Right. So I don't know. But for sure, heart attack. So, OK, check this out. So Dr. Peter Atiyah, by the way, he's speaking at that. I don't know if you're going to the event in two weeks or so, but he's going to be there.

16:41So he said last Monday researchers. So basically, look, they concluded that time restricted eating was associated with a 91 percent increase in risk of cardiovascular death. These results are alarming if you take the headlines at face value. But on closer examination, the results from this study are virtually meaningless. So the researchers used data from the National Health and Nutrition Examination Survey collected between 2003 and 2018 from more than 20 ,000 people in the U.S. and followed mortality outcomes, grouping participants by average eating duration. Food frequency questionnaires are notoriously unreliable data that are frequently contaminated by recall biases of both total energy intake and timing.

17:20This analysis was done under the, sorry, parentheses, very weak assumption that the completion of two food recall surveys was sufficient data to represent the participants, quote unquote, normal eating patterns, both eating duration and total energy intake for the next eight years. There were no significant differences in all cause mortality, the most important metric. However, the TRE, so time-restricted eating group, of less than eight-hour eating duration had a relative 91 % increase in the risk of cardiovascular death compared to the reference group, 12-16-hour eating duration. Almost done with this.

17:56But importantly, the time-restricted eating group wasn't just different from the non-TRE group based on eating duration. There were significant difference in the group sizes, other lifestyle habits, and comorbidities, making it almost impossible to compare the two groups. It's unfortunate that results such as these are being used to scare people away from time-restricted eating, which is a proven way to reduce energy intake and lose weight. Previous research has already supported the notion that how many calories you eat matters more than when you eat them. This is yet another nutritional study that affirms my disappointment in the field, not because a topic is unworthy of research, but because of the willingness to draw sensational conclusions from flawed data, which us marketers like to do.

18:49So a recap for me here, Eric, right? So is he saying that time-restrictive eating or intermittent fasting, is he saying, which is similar, or same thing based on - Same thing. Is he saying it's bad for you or good for you? because he started off saying it caused more heart attacks. He's saying that's what the research paper said, and he's saying that research paper is intellectually dishonest. And also, I think who funded it, that research paper, was like food groups, right? Because they want you to eat more, right? So you got to look at who's funding it, but also the way the data was combined made it, like you can basically manipulate data to tell any story that you want, and that's what happened in this situation.

19:27And like, yes, it is a sensational headline. When I saw it, I was like, oh, crap, should I stop intermittent fasting? But intuitively, it didn't seem right to me. But like you don't know until someone like a doctor like this calls it out. So that's what it is. I didn't know you do intermittent fasting. Dude, I've been doing it since I was 27 years old before it was cool. I did the sleep tape at 30 years old before it was cool. So that's right. Anyway, guys, that's it for this episode. Please don't forget to rate, rate, and subscribe. It helps us grow. And go to marketingschool.io slash agency.

19:55If you want to grow your agency faster, that's the group that we have. And it's growing. So we'll see you later.

From the publisher
In episode #2718, we talked about sharing metrics publicly and the benefits and drawbacks of doing so. We also discussed the importance of relatability and the impact of sharing journey stories, as we share insights from a study on Google search results and discuss the significance of rich snippets, video content, and Google shopping.    Don’t forget to help us grow by subscribing and liking on YouTube!   Check out more of Eric’s content (Leveling UP YT) and Neil’s videos (Neil Patel YT)    TIME-STAMPED SHOW NOTES: (00:00) Today’s Topic: ConvertKit open metrics - good idea or bad idea?, How to lie with data - 91% all cause mortality, and We analyzed 12,037 sessions of 1013 people searching on Google to better understand how people use  (01:15) ConvertKit open metrics - good idea or bad idea? (09:51) We analyzed 12,037 sessions of 1013 people searching on Google to better understand how people use  (14:55) How to lie with data - 91% all cause mortality (18:55) That’s it for today! Don’t forget to rate, review, and subscribe!   Go to https://www.marketingschool.io to learn more!   Leave Some Feedback: What should we talk about next? Please let us know in the comments below Did you enjoy this episode? If so, please leave a short review.   Connect with Us:    Single Grain << Eric’s ad agency NP Digital << Neil’s ad agency X @neilpatel X @ericosiu See omnystudio.com/listener for privacy information.

More from Marketing School - Digital Marketing and Online Marketing Tips

All 936 episodes
Is ConvertKit open metrics a good or a bad idea?, We analyzed 12,037 sessions of 1013 people searching on Google to better understand how people use, and How to lie with data - 91% all cause mortalityMarketing School - Digital Marketing and Online Marketing Tips · 20 min
Listen in VO