WRONG!😱AI Stats are Wrong - Here is how to FIX IT! + Guy's Trip Recap! - Ask Us ANYTHING❓ | Ep. 385

0:01Welcome to Do This Not That, the podcast for marketers. Each episode is packed with quick tips. They're super short, and at the end, we have some fun. Let's jump into it, and thanks for being here. We are back for Ask Us Anything from the Do This, Not That podcast, presented by Marigold. This is our short episode where all week long we get in questions. We get in work questions. We get in super ridiculous questions. We try to tackle one of each, and if you want to submit a question, you'd be actually cool. you go to jayschwedelson.com there's a button that says podcast another one says ask us anything and that's it we need your questions so let's do the work question before the ridiculous question we got a question in from ben from seattle ben what do you got jay i got burned bad in a meeting i sourced a stat i got from chat gpt in a presentation and someone called me out and said that was not true.

1:01And guess what? They were right and I was wrong. Super embarrassing. Does that mean I cannot use stats from AI? So this is a great question because this is something I had to go and do a lot of investigation on because I'm sure all of us, we go on ChatGPT and we go on other AI tools, Claude, whatever you use, I don't care. And then we say, oh, we're working on this blog. We're working on a podcast. We're going to a webinar. We're going a presentation. What does it matter? And you ask it for stats and information and whatever. And then you get back the information and it sounds super legit. It will actually say, you know, if you do this, it says 37 % of people, blah, blah, blah.

1:43And it's a stat. Okay. And sometimes not only will they say the stat, the AI tool, and you ask it a question and it will say, according to, you know, HubSpot, according to Salesforce, according to whoever, right. And they're like, oh, it said a stat and it said, according to whoever, that means it's real. But then what I've realized, so, and I'll give you what I found and what you should do about it is that even when it gives you a stat, even when it says, and this is from whatever source, whatever, sometimes when I see the stat, I'm like, you know, that sounds ridiculous. Is that really true?

2:18And I'll ask ChatGPT again, is this stat that you just gave me actually true? And then a lot of times it'll say, actually, sorry, it's not true. And every time I want to take my computer and throw it against the wall, because I'm like, well, why'd you give it to me in the first place? So here's the wild part. And I asked ChatCPT, for example, and I said, I want to know the truth. What percentage of statistics that you give back when someone asks are actually not accurate? And by the way, I have a solve for this. What percentage of stats that you give back are actually not accurate. And what ChatGPT itself said, 40 to 50 % of stats shared by ChatGPT are not actually real stats, even if they say according to whomever.

3:07That is wild. So half the time when you're getting a stat from it, you need to actually further verify it. And so what you want to do is when you are asking for a stat, I don't care what it is. Okay. It doesn't matter what it is. You need to use this prompt specifically. Okay. I'm going to put in the show notes and you say this, give me stats for whatever, right? Give me stats for email marketing, open rates for HR laws that have been passed in the last year. I don't care. Okay. Give me stats for whatever, but clearly label them as either sourced and 100 % accurate or inferred and prioritize real stats with sources that you have verified when possible.

4:03Okay. And when you do that, and you could even say for any stat you ever give me moving forward, that you want your stats to be clearly labeled as sourced and fully verified versus inferred. Because about half of the stats they provide back are inferred. What ChatGPT and the other AI tools are doing is they're taking all sorts of data that's out there and they're mushing it into one stat and they're spitting it back to you and they're saying it's a real stat. But when you dig into it, it's not. But when you ask ChatGPT or any other AI tools to say, I want to know that this is sourced and verifiable and 100 % accurate, it then will only give you the information that is actually accurate.

4:46This is like really important because if not, just like Ben, you're going to get kind of screwed on what it is that you're sharing out there, what it is that you're putting out there. This is not like what they call hallucinations by AI. Hallucinations by AI is just completely made up stuff. That's not what this is. What this is, is them taking data from all over the planet, okay, and they're inferring a statistic, which is weird because a statistic, just because the nature of what it is should be accurate, but they're not. So you literally can't take a stat that just comes from AI unless you push back and say, I need to know this stat is 100 % accurate, it's verifiable, and what is this actual source?

5:29All right, I know that's pretty wild. So that was a really good question because this has messed me up so bad. All right, let's get to the ridiculous portion of the podcast. We got a question from Jamie. What up, Jamie? Where are you from? Oh, you're from Deerfield Beach. That's right near me. All right, Jamie, what's your question? Jay, you mentioned you went on your annual guys trip to Las Vegas. So how was it? Okay, this is true. So for any new listeners out there, I do. I go on an annual guys trip with my friends from college, my six friends from college. We go every year. I strongly recommend everybody doing this.

6:09And we just got back. And the way we do it is one person picks out of the hat and whoever gets picked out of the hat's in charge for that year planning the trip. And my buddy who, who loves gambling and all this nonsense, he picked Vegas. I could do without Vegas. No offense to Vegas. Vegas is a great city. I'm just, I'm not a gambler. I don't, I don't, I don't, I don't like it that much. I'm horrendous at it, whatever. So we went to Vegas. It was great. But speaking of gambling, actually, I'm about to go down a rabbit hole. So here's what happened with the gambling. So none of my friends are like, you know, gambling lots of money or anything like that.

6:42But so one of the first night, no, the second night we were there, everyone's like, let's play blackjack. And I don't know how to play blackjack. I mean, I know you try to get to 21. You don't want to go over 21. That's basically what I know. I've never played blackjack. I'm not a gambler, right? Which is fine if you are. Good for you. I don't know. I'm just not. And so like everybody else, all these six guys are like, no, no, we'll teach you whatever. So first we find the table with like the lowest dollar amount that you could play at a table. And I sit down next to some random dude because we couldn't get all the chairs.

7:15And I didn't know. I had no idea what I was doing. And so they would give you the card. And then I didn't know when to hit or not hit. So I would hit. And apparently I was hitting at the wrong time because you're only supposed to hit when certain cards are there. The guy next to me was getting annoyed. he's like dude you don't know what you're doing and so i got up i i was very uncomfortable so then we found a table where all six of us could sit down together and we played and they were telling me what to do and i perceive everybody at the table proceeded to lose money not a lot of money but but money not one person won money i said this game stinks because all you're doing is following some sort of pattern or whatever it was horrendous it wasn't fun it was not i don't my friends like no this is fun i'm like we just all lost money this stinks so then i said them listen listen, after dinner, because we were going to dinner, none of my friends knew how to play craps.

8:05I said, I'm going to teach you guys how to play craps. And again, I'm not a gambler. So why do I know how to play craps? Well, in college, I did many, many, many stupid things. I mean, really epically stupid things. One of the stupid things that I did in college was that me and a buddy of mine built a craps table. We had no idea what we were doing. We built a craps table. and in his apartment, we were the house and we would have people come over and play craps for money during college. I mean, talk about a stupid idea. We ended up doing really well with it, but what was I doing? Why was I not like studying?

8:38I don't know. So I never gambled a lot, but I liked figuring out how to make some money. So in college, we had a craps table, so I really knew how to play craps, but I don't think I've played maybe one time since then and maybe for like 50 bucks or something like that. So anyway, so after dinner, I go, let's go to the craps table. and nobody knew how to play craps like this is gonna be terrible this is gonna be boring it's gonna be bad so we go to the craps table and um we're all there and there's a lot of people there whatever and my buddy is the one to roll this is not normal how it goes down so my buddy proceeded to roll and the way craps works is if you roll for a long time without rolling a seven then everyone can make a lot of money.

9:18The dude rolled for like 25 minutes. It was out of like a movie. Everybody at the table was making a ton of money. It was why we weren't betting a lot, but you just couldn't not make money because it was going on and on forever. And everyone was like, this is the greatest game of all time. Everyone. It was wild. I've, it was so crazy. I've never seen this before. Not that I'm there so much, but it went on for so long. And my buddy made everybody so much money. I made that money because I taught him how to play that one of the dudes at the other end of the table threw my buddy a hundred dollar chip because he said, you made me so much money.

9:56I want to give you some money. And he gave him a hundred dollars. I was like, I've never seen that before. This is wild. So anyway, blackjack stinks. Craps was great. I really probably won't gamble again for years because it's not my jam. I don't like losing money. And that was fun. So Vegas was cool. Check the box. I need to get to the sphere. I still haven't gotten to the sphere. Everybody got to the sphere. So this is the update. This is what I got for you. And yeah, do me a favor. Register for Guru Conference, our free virtual email marketing event. We're going to have 25 ,000 people there.

10:30Nicole Kidman's keynoting. We just announced Lance Bass is going to be there from NSYNC. It's going to be wild. We're going to run out of virtual seats. So go We'll check you later. You did it. You made it to the end. Nice. But the party's not over. Subscribe to make sure you get the latest episode each week for more actionable tips and a little chaos from today's top marketers. And hook us up with a five-star review if this wasn't the worst podcast of all time. Lastly, if you want access to the best virtual marketing events that are also 100 % free, visit guru events.com so you can hear from the world's top marketers like Damon John Martha Stewart and me guru events.com check it out