1. Podcasts
  2. Voices of Search // A Search Engine Optimization (SEO) & Content Marketing Podcast
  3. How Bad Data Corrupts AI Bidding and CAC Performance
Voices of Search // A Search Engine Optimization (SEO) & Content Marketing Podcast

12 Aug 2026 · 43m · 23 chapters

Episode artwork

How Bad Data Corrupts AI Bidding and CAC Performance

In short

How bad/invalid traffic and “bad data” distort AI-driven bidding and CAC/ROAS performance, and why measurement and signal quality matter as channels diversify and agentic/AI discovery grows.

Guest backgrounds

Chester Scott, Chief Strategy Officer at Lunio (formerly PPC Protect). Former agency marketer across UK/Europe/Middle East/APAC; client-side roles at Central Retail (SEA) and The Hut Group (beauty). Early TikTok employee in MENA/Turkey/Africa/Pakistan, leading pure-play e-commerce and launching auction/live shopping solutions.

Key claims

Lunio’s meta study of 2.5B+ clicks/year estimates ~8.6–8.7% of paid traffic is invalid/fraudulent. Total “waste” is larger (~50%) when including low intent, non-incremental spend, poor creative, and saturation. Fraud isn’t only social/affiliate; small invalid percentages still matter at scale. Measurement remains flawed (last-click, multi-touch), and “dirty signals” fed to bidding agents cause them to optimize toward more rubbish.

Notable examples

TikTok/Performance Max/Advantage+ can have higher invalid traffic; Amazon “Alexa for Shopping” and Google “Ask Advisor” signal agentic traffic at scale, requiring intent-based quality (human vs bot vs fraudulent vs good bot) rather than “real human” only. Vanity metrics like clicks/ROAS can mislead; focus on marginal ROAS and incrementality.

Written by AI. May contain mistakes.

Chapters

0:43

Chester Scott's Background

Chester shares his extensive marketing experience and role at Lunio.

“Chester, welcome to the Voices of Search podcast.”
2:55

Understanding Click Fraud and Traffic Quality

Discussion on Lunio's role in combating click fraud and improving traffic quality.

“So if we come into Luneo specifically, Luneo was actually previously known as PPC Protect, seven, eight years old as an organization.”
4:19

The Importance of Third-Party Solutions

Chester emphasizes the need for advertisers to use third-party solutions for better control and performance.

“Like, you know, I guess SEOs, for better or worse, just take traffic at face value.”
6:04

Fraud Across Different Marketing Channels

Exploration of how fraud impacts various marketing channels and the common misconceptions.

“I don't think we can rely on other parties to do that for us.”
9:30

Challenges of Bad Data in Digital Marketing

Discussion on the complexities of bad data and measurement in the evolving digital marketing landscape.

“And we're in a very tricky moment in digital marketing as an era, which is, as we've seen AI now become much more prolific, We now have new channels of discovery.”
14:00

The Challenge of Causal Proof in Marketing

Exploring the difficulties in balancing long-term and short-term marketing metrics.

“The large challenge with that at the minute is that causal proof, and that could be in the form of market mix modeling as an example, is largely a long-term directional indicator.”
15:00

Understanding the Data Problem

Discussing the complexity and noise in marketing data and its implications.

“into decision-making processes with a level of confidence that we're making the decisions based on a measurement framework that has the robustness to do that in the right way.”
16:00

The Impact of Fraudulent Traffic

Analyzing the extent of fraudulent traffic in digital marketing and its consequences.

“And is that, in the order of all these challenges, a high priority, mid priority, low priority?”
16:50

The Bigger Waste Problem in Advertising

Examining the broader issues of waste in advertising beyond just click fraud.

“But the reality is, is that the waste problem beyond just click fraud and invalid traffic is much bigger.”
18:00

Rise of Bots and AI in Marketing

Investigating the growing influence of bots and AI agents in the marketing landscape.

“as it pertains to bot traffic, as it pertains to these AI agents that are now more and more becoming a prolific way of doing discovery and seeking out information.”
Show all 23 chapters
20:00

Understanding Agentic Traffic and Its Challenges

Discussing the implications of agentic traffic for marketers and the evolving landscape.

“happening, but equally not make any knee-jerk decisions and kind of changes, because it's maybe not 100 % necessary right now.”
21:43

Understanding Agentic Traffic and Its Challenges

Discussing the implications of agentic traffic for marketers and the evolving landscape.

“You could start replying to spam from agencies that claim they can get you to rank number one on Google.”
23:07

Evaluating Traffic Quality in Agentic Commerce

Discussing how to assess the quality of traffic in the context of agentic commerce.

“or thought that that raises is then, well, if agentic traffic becomes a real reality, then how do we begin to understand the quality of that traffic that's coming to site?”
28:00

Stages of AI Adoption in Marketing

Explore the gradual adoption of AI in marketing and the importance of building consumer trust.

“I think that we will see some adoption, but I think it will be on relatively menial tasks to begin with.”
28:50

Rethinking Marketing Metrics

Discuss the narrow focus on event-driven metrics and the need for a broader perspective in marketing.

“exactly what I need and I don't have any of those concerns.”
32:05

Opportunities and Challenges for Marketers

Examine the current landscape of digital marketing and the unfolding opportunities in uncharted territory.

“I think that the systems-based thinking is something that a lot of digital marketers have lost themselves on.”
33:56

Importance of Data Quality in Marketing

Understand how data quality affects AI bidding and overall marketing performance.

“And that requires us to think differently, quite critically, on how we actually solve for those problems.”
37:00

Measurement as a Priority

Highlight the critical role of measurement in digital marketing success and decision-making.

“if we don't get the signals and the data inputs right, then the waste problem, the invalid traffic problem, the fraud problem compounds.”
38:28

Introducing the Lightning Round

Transition to a rapid-fire Q&A segment with key marketing insights.

“favorite part of the show, which is what we call our lightning round.”
38:44

Overrated Marketing Metrics

Identify common marketing metrics that may not accurately reflect performance.

“What is the most overrated marketing metric today?”
39:56

Complacency in Measurement

Discuss the industry's reliance on flawed measurement techniques and the need for improvement.

“So next question for you, Chester, is what's one thing marketers are trusting too much?”
41:04

AI's Role in Marketing

Clarify misconceptions about AI in marketing, emphasizing the importance of human oversight.

“i think that couldn't be further away from the truth i think the reality is is we've spoken about throughout this podcast is ai is absolutely incredible at delivering on against the objective that you give it.”
42:02

Key Marketing Signals for Digital Effectiveness

Learn about the importance of marginal ROAS and input quality for marketing.

“I kind of answered this in my previous question.”
A man walking through an airport, asking his phone a question

Ask about this episode

Get the gist, explore an idea or ask about something said.

Claude

On Voices of Search // A Search Engine Optimization (SEO) & Content Marketing Podcast, what are the key points of this episode?

Searching your listening

Transcript

Automatic transcript. May contain errors.

0:00Chester Scott: The Voices of Search podcast is a proud member of the I Hear Everything podcast network. Looking to launch or scale your podcast? I Hear Everything delivers podcast production, growth, and monetization solutions that transform your words into profit. Ready to give your brand a voice? Then visit IHearEverything.com. Welcome to the Voices of Search podcast, a member of the I Hear Everything podcast network. Ready to expedite your company's organic growth efforts? Sit back, relax, and get ready for your daily dose of search engine optimization wisdom. Here's today's host of the Voices of Search podcast, Jordan Cooney.

0:42I'm Jordan Cooney, and joining me today is Chester Scott, Chief Strategy Officer at Luneo. Chester, welcome to the Voices of Search podcast. Hey, Jordan. Thanks for having me. Appreciate you taking the time. Yeah, thrilled to be diving into this conversation. You know, we don't get enough folks on the show that are here to talk about where data is going, how data is changing. I mean, we've been seeing so much change to attribution and traffic. But before we get into all of that, tell us a little bit more about Lunio. Tell us a little bit more about what you guys do and, you know, give us a little background on your role there.

1:21Yeah, sure. So maybe I'll start with myself and then I'll move into Lunio. So as you're aware, I'm Chester, currently the Chief Straplessy Officer at Luneo. But first and foremost, I'm a marketer. I spent the bulk of my early career agency side, both independent before moving into big network, worked on some of the biggest accounts across the UK, European, Middle East and APAC markets, managed a bunch of different channels inside of that arena. and I've also had the pleasure of working client side as well and so worked in two different retail e-commerce conglomerates one in Southeast Asia at Central Retail and then the other in the UK in a global role at the hook group looking after their beauty effort and in addition to that, I have also spent time platform side, an early employee of TikTok across the Middle East, Turkey, Africa, and Pakistan, leading their pure play e-commerce vertical.

2:29I was the person that took that auction solution into the market in that region. And I've launched a bunch of, you know, interesting commerce solutions. Live shopping was one of the first pieces that we launched, TikTok shops, so on and so forth. So, you know, I had the luxury of working, let's say, in all three areas, which sets me up for having a relatively unique vantage point, I would say, in my current role at Luneo. So if we come into Luneo specifically, Luneo was actually previously known as PPC Protect, seven, eight years old as an organization. We became Luneo as we grew up as an organization, we became multi-platform in 2022.

3:13And first and foremost, we started out as a click fraud and some might refer to as invalid traffic solution, ingesting clickstream data from search platform, predominantly social platforms as we became Luneo. We classify that traffic through proprietary detection algorithm to understand the difference between high quality traffic and traffic that is maybe of lower quality or at the very worst end, fraudulent and has no propensity to go on and purchase. But the reality is that that was our starting point. ClickFraud was our starting point. We have always had this ambition to eliminate paid media waste.

3:52And paid media waste is obviously a much bigger arena than ClickFraud itself. And so we're starting to make inroads on that strategy right now. And 2026 is a big year for us. And as we move into 2027 as well, we will venture into those additional waste vectors and sort of help add value to customers beyond just click fraud and invalid traffic. So I think this is a largely misunderstood topic by a lot of our listeners, right? Like, you know, I guess SEOs, for better or worse, just take traffic at face value. I think paid search marketers have become highly reliant on Google to help them make many of these decisions.

4:38Why is a technology like Lunio helping brands understand where fraud is happening, where quality actually sits in terms of the internet's traffic? yeah you know i think there is a necessity for advertisers both sort of brand direct and and agencies to leverage third-party solutions whether that be from kind of a traffic verification whether that be from a data perspective whether that be from a measurement standpoint because i think that by leveraging third-party solutions you ultimately are taking back control you're not passing back passing over the control ultimately to the platforms that are incentivized to drive high quality results for themselves.

5:29And so I think first and foremost, it's about making sure that as an advertiser, you are taking as much control as you possibly can, that you're validating everything that you possibly can. And ultimately that should drive improvements in performance and long-term marketing effects, as opposed to potentially driving short-term marketing effects or efficiencies, I probably should say, and forgetting about actually the overall effectiveness of what you're buying, how everything kind of integrates together. So I think it's more around verification, due diligence, and just taking as much control as you possibly can to make sure that you've got your own interests at heart.

6:06I don't think we can rely on other parties to do that for us. Yeah, no question. And you've got this vast experience across marketing channels, right? Like, I mean, you've done social, you've done some paid, you've got a lot of different like, um, experiences when you look at these, like, I think a lot of marketers think that there are certain verticals that are more susceptible to fraudulent traffic. You know, the two that really come to mind are social media and, uh, you know, affiliate type traffic sources, But that's not necessarily true. Fraud probably happens in all different verticals. Tell us more about that and how you all have, in your own experience as well, and at Lunial, you all have looked at this traffic challenge by vertical.

7:00yeah sure i mean like if you look at the kind of channel mix and the traffic quality that you get from each respective channel and you know there are varying levels of fraud for sure right you see higher levels in fraud potentially within social platforms within black box or ai native platforms such as the performance max advantage plus remains to be seen because it's still relatively new, Advantage Plus, so on and so forth, you tend to see higher levels. In more traditional solutions such as Google Search as in text ads, yes, we do tend to see lower volumes of invalid traffic, but it doesn't mean to say that it's completely squeaky clean.

7:39And I think that where we potentially come unstuck is looking at a relatively small percentage and not thinking that actually trying to improve that relatively small percentage can't have big impacts in absolute terms. And that's because of the volume of investment that's going through those channels. And I think there's also a reality that fraud within the former of what I just suggested, the social platform, search, shopping, sorry, PMAC, shopping, et cetera, is quite obvious as to why there might be fraud, where there might be. It's quite easy to understand. Whereas when you think about traditional search or you think about an LLM, where the incentives for fraud maybe feel a little bit more abstract.

8:28They're a little bit harder to get your head around as to why somebody might be doing something because there's not a real kind of immediate obvious incentive. But that's not necessarily the reality. And I think as marketers, sometimes we're guilty of trying to find the big thing. What's the big thing that's going to move the needle. When in reality, we're all probably just trying to find what are maybe the 510 things that can drive marginal improvement that add up to that big thing. And so I think that that's the really key thing, particularly within the most sophisticated of advertisers, is they're ultimately trying to find marginal improvements in absolutely everything that they do in order to drive big effects when compounded together.

9:13And there's tons of sporting analogies in this, each by each, mile by mile. And it's relatively similar from a paid media and a performance marketing perspective. Yeah, no doubt. I mean, one of the big things that I think is really interesting is we really don't fully grasp the bad data problem. And we're in a very tricky moment in digital marketing as an era, which is, as we've seen AI now become much more prolific, We now have new channels of discovery. ChatGPT now has an advertising platform. We all have seen what is the organic discovery track for ChatGPT and these AI models. The reality here is that we're dealing with a bit of a vacuum because we don't have great data.

10:07We don't have great insights. But when you think about the data problem and you think about the measurement problem, how much of this challenge is, you know, scrupulous bad actors versus bad data versus just like the evolution that we're seeing in the market? let me let me try and break this down into into three core areas i think one because i think all everything that you just said ben there i think that there's probably multiple challenges that that sit inside of that so let me let me try and break that down into into something that's a bit more digestible for me to be able to answer and firstly we've got a significant amount of diversification in channel mix we've gone from having a relatively straightforward kind of meta traditional search maybe bits of shopping and maybe a bit of snapchat and tiktok but what we're now seeing is is a significant diversification across that mix there are more channels than ever today that we need to think about how we plan buy optimize and i'm talking about traditional search social search shopping pmax ai max you've got the new entrance from chat dpt you've got tiktok in the mix you've got bing and all of their respective ads you've got social search and so that kind of ecosystem is bigger than it ever has been before and so we're no longer trying to understand the signals and then the downstream impact of of one channel and one campaign type we're actually trying to understand the signals and then the impact of all of this diversification from a channel perspective that's happening as well.

11:45And so I think that that is definitely a significant challenge. How do all of these channels, platforms, campaign types, how do they play nicely together? So that's the first challenge. The second challenge is ultimately about data volume. I think that once upon a time, it was all about how can we collect more data? How do we get as much data as we possibly can, because that's going to make us better at everything else that we do in terms of our planning, our decision-making, our optimization, our measurement. But I think maybe to some degree, we've gone so far the other way. The pendulum swung so far the other way.

12:22The real challenge that advertisers have now is how do we separate signal from noise? What data points and signals are actually important in order for us to be effective? And what actually is nice to have, but it's not business critical and it's it's quartering those those decision making processes so that's equally a significant problem and then you've got the measurement challenge right and you know i think you might have used some examples there in your question around ga4 and and other solutions you know it's now using model data i think that measurement on for the largest part is still relatively unsolved the industry from my perspective has maybe been a little bit complacent in accepting um you know a fundamentally flawed approach in last click attribution as an example in multi-touch multi-touch attribution and that might be because you know those big platforms that maybe don't have always our best interests at heart of you know they've largely been the big innovators in this space and so i think that that is is definitely be a big challenge.

13:30And so the great thing now, though, is that I think that advertisers are now starting to ask those questions because of what's happening in the macro. And now we really are starting to see some really strong innovation from a bunch of different vendors in the market, as well as from the big platforms, on how do we innovate from a measurement perspective? And I think, for me, the gold standard is trying to understand what is the causal proof. How can we develop a scalable system that leverages causal proof. The large challenge with that at the minute is that causal proof, and that could be in the form of market mix modeling as an example, is largely a long-term directional indicator.

14:10But we know that on a daily, when you're activating, you need something that can give you insight into how to optimize on a daily basis. And so So that's the real challenge now is how do we find a system that uses causal proof that's able to balance the long and the short term? And I think that's largely where the challenge comes. And so when it comes back to your kind of original question of, you know, where is the data problem? I think that it is massive increase in diversification of channel. How do they all play nicely together? It's the volume of data. How do we separate signal from noise?

14:46And how can we help each other to be able to do that? And the measurement component, the more innovative and more robust and more sophisticated our measurement capability is, the better signals we're going to be able to pass back because we can pass those signals back into AI-driven solutions, into decision-making processes with a level of confidence that we're making the decisions based on a measurement framework that has the robustness to do that in the right way. Does that answer your question? And actually, I think it does. And it not only does it answer the question, I think it exemplifies the challenge that digital marketers are facing, right, which is that this is a hyper complex.

15:29It is a it is a both business decision level of complexity in terms of how you're measuring as much as it is a tool platform tracking challenge, as well as a channel and marketing challenge. And I think this is where marketers are grappling with this, which is it is so difficult to isolate where the problem is. And so the main question I have for you off of this is how big of a problem is fraudulent traffic? And is that, in the order of all these challenges, a high priority, mid priority, low priority? And does it change based on who and what business we're talking about? So John, I think that's a really good question.

16:15And I quite often like to, at the start of any presentation that I do, I quite like to use a quote from a guy called John Wanamaker. You might be familiar with the guy. One of the original marketing pioneers from the late 1800s was famous for inventing the price tag, but he's also extremely famous for inventing or for making the quote, which is half the money I spend on advertising is wasted. the problem is I don't know which half. I think the real ironic thing about that quote is that that was made in the late 1800s, but that quote is as true today as what it was back then. And so when I think about the specific question that you had around fraud, if you look at Lulio's own data, which is based on a meta study of over two and a half billion clicks per year, and that's increasing each year, we're able to estimate that roughly 8.6, 8.7 % of traffic that is coming from pay channels is due to invalid and fraudulent traffic.

17:18But the reality is, is that the waste problem beyond just click fraud and invalid traffic is much bigger. And we're probably getting up towards kind of 50 % when you add in all of the additional waste vectors. And I'm talking about kind of low intent users. I'm talking about non-incremental investment. I'm talking about poor creative execution, audience saturation, so on and so forth. And so I think that that's the really key thing is that click fraud, invalid traffic is a big problem in itself, but actually there is a much bigger waste problem that we should all be paying attention to because that's no longer a marginal gain.

17:57You're getting the whole cake I want to transition to something that I know SEOs and organic marketers are going to love to hear about because it is fundamentally a challenge to communicate what is happening in the market today as it pertains to bot traffic, as it pertains to these AI agents that are now more and more becoming a prolific way of doing discovery and seeking out information. How are you thinking about that particular part of the ecosystem, which is in the last 24 months, we've seen a huge increase of bots. And the complexity of these bots is becoming even more challenging because it's not just that ChatGPT and Anthropic have one bot.

18:49They have a multitude of bots that are doing certain types of activities. how are we as marketers to think about the bot piece and the AI agent piece of the traffic that's hitting our sites these days? So I think there's a couple of realities, right? I think you're absolutely right. There's been a lot of talk in our industry about agentic traffic, agentic commerce. And I think that sometimes what we have to be really conscious of is that we're in a bit of an echo chamber. And that actually, we maybe talk about these things before they become a real consumer reality. And so I think that for me, what's been really interesting is that whilst there's been a lot of conversation about this type of thing happening and where the industry is moving to, and that has been real, I think over this past couple of months, we're really now starting to see that become a reality.

19:41And I'll unpack that a little bit in a second. But up until this point, we're still seeing a relatively small amount of agent-led traffic that comes to customer sites based on what we're able to identify. Do I think it's going to remain a small amount? Absolutely not. That's definitely going to grow exponentially. And so I think it's about how do we be aware of that evolution that's happening, but equally not make any knee-jerk decisions and kind of changes, because it's maybe not 100 % necessary right now. But what has happened over this past couple of months that has been really interesting from my perspective is that we've seen the announcement of Alexa for Shopping.

20:20Alexa for Shopping is the collapsing of Rufus, their on-site agentic capability into their Alexa offering. And for me, that announcement was probably the first time where I thought, wow, we're probably really now going to see agentic shopping and traffic at real scale. And the reason that I say that is because, you know, Amazon have done a great job for the past 25 years in building consumer trust and confidence in their shopping experiences. And I think that if there is a business that is able to get the consumer comfortable with leveraging agents on their behalf to make purchases, to research, and to make bookings, I think they're probably the closest to it.

21:10Now, what's then also happened in that timeframe, we've had Google Marketing Live and Google I.O. And as part of Google Marketing Live and Google I.O., they've announced Google Ask Advisor, which is equally an agentic capability for the consumer, which could also see real scale of agentic traffic, and it may be even agentic commerce, that becomes a reality. Time for a one-minute break to hear from our sponsor, Previsible. So you're looking for SEO help. And you got a couple of options. You could start replying to spam from agencies that claim they can get you to rank number one on Google. You can pay an hourly rate for a consultant who will inevitably nickel and dime you with hourly charges.

21:56Or you can work with a cookie cutter agency to quickly launch a strategy-less project with low success rate. None of those sound very good, now do they? Well, that's where Previsible's integrated consulting model comes in. Previsible draws from a collective 40 years of SEO and digital marketing experience to unlock your organic growth opportunities. They build custom solutions that combine strategy, technical expertise, content, and reporting to effectively operationalize SEO for your business. Prefizzable's four-stage approach ensures that your SEO programs thrive by starting off with a strategy-first approach.

22:32Then they support you in your efforts to create quality content, help you identify technical issues, and most importantly, they'll work with your cross-functional teams to integrate your SEO strategies to make sure that your SEO budget actually drives results, not just your agency's bottom line. So join brands like Yelp, eBay, Canva, Atlassian, Square, all who rely on the SEO consultants at Previsible. For more information, go to previsible.io. That's previsible, P-R-E-V-I-S-I-B-L-E.io.

23:06So then the second question or the next sort of challenge or thought that that raises is then, well, if agentic traffic becomes a real reality, then how do we begin to understand the quality of that traffic that's coming to site? And so if you think about the fraud industry, and that is the big incumbent players that have been in the market, the IESs, the Double Verifies, the Motes of old, other players in our space, well it's largely been built on the understanding that if you're able to identify what is a real human then you have a good understanding of whether that user is of value or not because if it's a real human it's a value and if it's not a real human then it is either of low value and low propensity as a chance of low propensity to purchase or it's fraudulent and so that quite binary definition as essentially being the backbone of kind of verification and fraud solutions within the ad tech space.

24:12Now, with the rise of agentic commerce and those now accepting that that's going to become a reality, you know, that completely changes the picture because we're no longer having to understand what's a real human and what's not. We now need to understand what's a real human, what is a bad bot, a fraudulent bot, or a a fraudulent user. And what is a good bot, a bot that's maybe there with real human intent? And that ultimately means that the old way of thinking collapses to some degree. Now, as I said, that doesn't mean we all need to panic, right? This is not changing immediately, but it does mean that we need to think differently.

24:51And so if I think about the early thoughts around this from a linear perspective and what we started to work on, it's all about intent, irrespective of the source of the entity of that traffic. What is the actual intent of each individual click, potentially of each individual user that comes to site? If we can understand the intent of each individual user, of each individual click, that ultimately means that we are then able to have an understanding of the value and the propensity that that user is then going to go and complete a desired action. And ultimately that means that you can then remove out the bad.

25:32And potentially it also means that you can then sort of change the position to some degree so that you actually focus on the good stuff. You double down on the good as opposed to maybe only focusing on the bad. I love this. And I think I have a major question for you because this is where the industry is going to go. I mean, you brought it up. Your Amazon example is spot on. It's exactly where consumers are going to be going, which is we're going to be leveraging agents to perform a lot of these activities. Shopping can be a very cumbersome, time-consuming process. And if I have an agent working on this in the background, it can help me move my decision making much quicker.

26:13My main question here for you on this, and I think the challenge that everyone is trying to understand is what happens if my agent is lazy? What happens if my agent is a bum and is just doing really crummy things on a website and isn't legitimately shopping on my behalf? How do I monitor? How do I track? And then even worse, how as a marketer do I validate or invalidate that as a real source? Another great question, Jordan. I think that you kind of hit the nail on the head with this question, right? I think that I mentioned right at the start that at times in our industry, we can be in a bit of an echo chamber.

26:53We're excited about all of this latest innovation and we want to take advantage of it. We want to be an early mover on it. But there is a reality that quite a lot of industry press, et cetera, miss. And that is that all of this innovation and agentic commerce capability, shopping capability, agents for consumers, all of that innovation is all well and good, but only if the consumer adopts. If the consumer doesn't adopt, then actually the innovation is irrelevant. And so I think that what's going to be really interesting over this next 12, 24 months is how much does the consumer adopt? And in order for the consumer to adopt, they have to trust.

27:37they have to have confidence in in that the agent is working aligned to them as as a human that they're doing as good a job as what they could do as a human and if it's maybe not doing as as good a job maybe in terms of identifying the right price or the you know from the right the right provider then it needs to be offering enough convenience and so i think that we're probably going to see this in stages. I think that we will see some adoption, but I think it will be on relatively menial tasks to begin with. So it might be research projects. Then it might transfer into finding me the best holiday deal, the best flight price.

28:23Then it might be booking a reservation. Then it might be making its first real transaction, but a low value transaction. then it might get into a bigger transaction so on and so forth and so i don't think this is a kind of an on off switch i think it's a it's a um a process that as a as an industry and as and from a consumer perspective we're going to go through and it's going to take time for the consumer to build trust to build confidence that the agent is acting and delivering in a way that is aligned to exactly what I need and I don't have any of those concerns. And so, yeah, I hope that answers your question.

29:02It does. I actually want to dive into this just a little bit further and talk about events, right? Because I think as marketers with this lack of data, this lack of trust and transparency in our measurement tools, this level of confusion with all these different channels, what we've done as digital marketers is we've gone down to like the root event as our primary metric and only metric. If a signup doesn't happen, if a click doesn't occur, if a purchase doesn't happen, if a request for more information isn't transpired on the website, it's just not real or useful. And that's a very, very narrow set of your visitors, users, audience, if you want to call it, prospects, if you want to call it, on your website.

29:51And so my main question about this for you is like, how does Lunio and how does like the, you know, demything or, you know, myth busting aspect of a Lunio product help marketers better understand what is quality when all of our minds are focused on events? It largely depends on optimizing for the right metric, right? If we are optimizing on metrics that could largely be considered to be vanity metrics, a click as an example, maybe a form download, a form submission, well, they're all things that a bot itself can achieve. And so we need to be able to understand what is the actual business goal and how do we set ourselves up to be able to deliver that business goal or business outcome and that might therefore include ensuring that we've got all of our upstream capability in terms of site quality uh sorry uh traffic quality uh in order and a good example of this right might be um you know you've got an organic search versus a paid search and you might be wanting to drive um as many sales as you possibly can and so you've got obviously got a paid search team that are bidding on every single user that comes to site irrespective of whether you're in the whether whether anybody else is in the auction or not it could be non-incremental and so you know do you really need to be in that auction probably not right and so it largely depends on what you're optimizing for and how everything sits together how the ecosystem works it's it's all about systems as opposed to siloed efforts and i think that that's i'm not sure that that analogy really helped it but ultimately what i'm trying to say is it's about it's about ensuring that we think about the way that we plan by optimize as a system, not as individual singular efforts.

32:06I fully agree. I think that the systems-based thinking is something that a lot of digital marketers have lost themselves on. And there was a whole era there where digital marketers were building their own paid search systems and their affiliate tools and all these other ways to better evaluate and determine what is a useful channel. And we've kind of just like, I don't know, for lack of better terminology, become lazy and relied on entire like ecosystems that are provided by the advertiser themselves, right? Google's GA4, Google's search console, right? And so there has to be this middle ground where we're using third party, our own capabilities, as well as the the advertisers actual technology to help us elevate how we perform in digital marketing.

32:53I want to transition kind of to our last kind of topic, which is talking about the marketers themselves. I mean, you're, you're a marketer yourself. You've worked in a variety of different environments and types of brands and businesses. And, you know, we've talked throughout the show today about the struggles. I want to talk a little bit about the opportunities. What are the opportunities that marketers have today, what makes it exciting to be a digital marketer right now in this era? I think for me, we're going through uncharted territory, right? And so to some degree, that's leveling the playing field for everybody.

33:33And what I mean by that, that's leveling the playing field to some degree for advertisers. It's leveling the playing field for agencies, it's leveling the playing field equally for vendors like Lunio, because all the rules are being rewritten. And so that creates huge opportunity and excitement, right? We're being challenged in a completely different way. And that requires us to think differently, quite critically, on how we actually solve for those problems. So that for me in itself is really exciting. If I then think about kind of, you know, media and marketing in general, for me, everything is trending towards a black box first approach.

34:17The buy side to me feels like it's collapsing to some degree. You know, we previously had a ton of different platforms that were all planned, bought, optimized in very different ways. But because everything is trending towards black box and kind of AI first, it feels as though that buy side is all starting to look quite similar. And so what that means is that the challenge, the problem that we're trying to solve within those platforms is changing. For me, it's all coming down to the data quality that we are ultimately able to build. It's therefore the signal quality that we're able to pass back into those smart bidding algorithms that is really going to give us the edge.

34:59and then it is a um to kind of close that off that's why measurement is so important because if we don't have the right measurement uh capability then ultimately the signals that we're passing back aren't verified on maybe as high quality as what we believe them to be therefore the signal signals that we're that we're passing back we're not able to deliver the outcomes that we'd like to and so i think that we have as many challenges as what we had yesterday. They're just changing. They're different. And so the advertisers that are going to get the edge, the vendors that are going to get the edge are the ones that embrace that.

35:38We accept that we're changing. We don't try and kind of cling onto the past and we accept that it's changing. We take advantage of it. And that's what I'm really excited about at Lunio is how do we take advantage of that? And I'm curious to get your perspective as marketers shift into this opportunity, right? And taking advantage of the future of where digital marketing is going. What are some of the risks that we should be aware of? Like, what are some of the pitfalls, maybe even some of the experiences you've had in your career that we should avoid? Yeah. So I think that, you know, if we don't get that data component right, and we are passing back, as we would refer to at Luneo, dirty data, non-cleaned signals into the bidding algorithms, then ultimately those agents are going to be incredibly good at finding more and more rubbish.

36:38And so that is a problem, right? We have to solve the data quality problem in order to be able to get the outputs that we want from agents. And I'm a firm believer that we need to embrace agentic capability. We need to embrace AI-first solutions. But we also have to recognize that if we don't get the signals and the data inputs right, then the waste problem, the invalid traffic problem, the fraud problem compounds. And that is a big challenge. And that is then equally linked to the measurement piece, right? If we don't have measurement sophistication, if we don't treat measurement as our first priority, then ultimately everything upstream of that is to some degree irrelevant because we're basing decisions then on flawed measurement solutions.

37:34And by the way, I just want to preface this, which is I'm not saying that there is a perfect measurement solution out there or there isn't a perfect measurement capability, but I think that we should be treating it as our first priority. Because if we treat it as our first priority, everything upstream of that can be better. Whereas the way that I think about measurement, by the way, is probably a bit of an insurance policy. Nobody wants it until they absolutely need it. But when you need it, it's critical. Absolutely. I think it's a great, great statement around how we should be thinking about our capabilities in digital marketing.

38:13If we don't actually have good quality data, if we don't actually have really good quality inputs, everything else downstream fails. And you need to build in the systems around that to ensure that we're reaching that capability. So it's a really valid point. But I want to transition to my favorite part of the show, which is what we call our lightning round. So Chester, I'm going to ask you five questions from the themes that we discussed today. And we have you give me a 30 to 60 second an answer on each. Sound good? That sounds good. Awesome. All right. First question. What is the most overrated marketing metric today?

38:51So I'm actually going to give you two. I'm going to give you a really obvious one, which would be clicks. Optimizing for click is one of those vanity metrics that I spoke about in a previous question. That is not a marker of what's good and what's bad. It's a leading indicator, but one that is fundamentally compromised. So that's definitely one. The second one is a little bit more controversial, and that is ROAS. And the reason that I say ROAS is because it is probably the North Star metric for most advertisers, but it disguises the truth. And I believe that as an industry, we should be focused on marginal ROAS.

39:38What is the diminishing returns when we invest in a certain channel, platform, campaign, audience, creative, in order for us to be able to drive overall effectiveness? So marginal ROAS would be the focus. ROAS for me is the enemy. Love it. Excellent. So next question for you, Chester, is what's one thing marketers are trusting too much? I would say their own measurement capability. And that's not every advertiser. But as I said in a couple of earlier sections, I think as an industry, we've been complacent around measurement. We've largely relied on last click attribution. It's fundamentally flawed.

40:24It overcredits certain channels. It undervalues others. And actually for me, in order for us to be able to drive overall effectiveness, for us to be able to drive real improvements, we first have to solve the measurement problem. If we solve the measurement problem, everything else upstream can be more effective. Absolutely. What's a major misconception with AI marketing, specifically paid or organic? I think that it's going to solve all of our problems. and i think the second part is is that you know that the human is no longer needed i think that couldn't be further away from the truth i think the reality is is we've spoken about throughout this podcast is ai is absolutely incredible at delivering on against the objective that you give it.

41:24But if you're optimizing towards a compromised outcome because your measurement is not right in the first place, or it's being fed information that is fundamentally flawed in the first instance, then it's useless. The data input, the prompt, whatever it might be, but the input is critical. And that's where the human comes in. That is the role of the human moving forward is How do we fine tune the input in order for AI to give us a better output? But human oversight and augmentation for me is still business critical. What is a major marketing signal that digital marketers should be paying more attention to?

42:09I kind of answered this in my previous question. I would say marginal ROAS and incrementality. I think that we need to try and do more as an industry to get closer to that answer in order to be able to drive overall effectiveness. And I think that overall effectiveness ultimately is what will drive growth and market share wins over time. And so I think, yeah, marginal ROAS and an incremental contribution. As we look ahead, maybe two, three, five years ahead, what is a measurement that marketers wish they would have been tracking sooner? i keep uh these questions are leading into into each one uh jordan but i i would absolutely say um obviously marginal roas because that that's that's kind of what i answered the previous question and it's directly tied to this one but but ultimately i think if you look further upstream of that i think it's about trying to validate verify the quality of the input and tracking the quality of the input.

43:17Not just accepting that all traffic is equal because it's absolutely not. Not accepting that all signals are equal because they're absolutely not. And doing more to understand the quality of each individual input, which allows you to deliver the better outcome. Absolutely. And that wraps up this episode of the Voices of Search podcast. A huge thank you to Chester Scott, Chief Strategy Officer at Lunio for joining us. If you'd like to contact Jester, you can find a link to his LinkedIn profile in our show notes or on thevoicesofsearch.com. You can also visit his company website, lunio.ai. If you haven't subscribed yet and want a daily stream of SEO and content marketing knowledge in your podcast feed, hit the subscribe button in your podcast app or on YouTube and we'll be in your feed every week.

44:03Okay, that's all for today. But until next time, remember, the answers are always in the data.

44:13Thank you.

From the publisher

Up to 60% of paid clicks provide zero conversion value. Chester Scott, Chief Strategy Officer at Lunio, explains why clicks and ROAS both distort performance measurement and how they corrupt AI bidding decisions. The conversation covers the shift from ROAS to marginal ROAS as a North Star metric, isolating diminishing returns across channels, platforms, and audiences, and protecting automated bidding models from compromised leading indicators that inflate CAC.

See Privacy Policy at https://art19.com/privacy and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info.

More from Voices of Search // A Search Engine Optimization (SEO) & Content Marketing Podcast

All episodes