602: A Glimpse of a Better World

29 Aug 2024 · 1 h 47 min

Ask about this episode

Ask anything about it. ChatGPT or Claude reads this page and answers with the times it was said.

Connect VO and ask about every podcast you hear, including the moments you saved. Add to ChatGPT · Add to Claude

In short

Accidental Tech Podcast - Episode 602: A Glimpse of a Better World

Episode Overview In this episode of the Accidental Tech Podcast, the hosts discuss a variety of topics, including Apple's packaging, fundraising for St. Jude Children's Research Hospital, upcoming Apple events, and advancements in technology, particularly around AI and image formats.

Pre-show

  • Apple's Packaging: The hosts express excitement over the quality of Apple's new packaging, particularly for the iMac, highlighting its sustainable materials and aesthetic appeal.

Fundraising for St. Jude Children's Research Hospital

  • September Campaign: September is Childhood Cancer Awareness Month, and the podcast is part of a fundraising effort to raise $500,000 for St. Jude.
  • Marco Offset: The hosts encourage listeners to contribute by linking their purchases of new Apple products to donations to St. Jude, suggesting a "Marco Offset" approach.

Follow-up Topics

  • Overcast Update: A new version of Overcast has been released, improving user ratings and user interface features.
  • Apple Intelligence Waitlist: John gets through the waitlist for Apple Intelligence but faces limitations due to using an external disk.
  • Image Generation and AI:
  • Discussions about prompt injection vulnerabilities in Apple Intelligence.
  • The hosts explore how grammar constraints can be added to language models (LLMs) to ensure valid outputs.

Upcoming Apple Events

  • Fall 2024 iPhone Event: Details about Apple's upcoming event where new iPhones and other products are expected to be announced.
  • iPhone Rumors: Discussion about expected RAM upgrades for upcoming iPhones and Macs, which is long overdue.

Ask ATP Segment

  • Restore from Backup vs. Fresh Start: A listener asks whether it’s better to restore an iPhone from backup or to start fresh. The hosts advise that starting fresh can lead to data loss and is generally unnecessary due to the controlled nature of iOS.

Key Discussions Apple’s Packaging

  • Sustainability: Apple has moved to paper-based packaging, which has been well-received by the hosts.
  • Unboxing Experience: The attention to detail in the iMac’s packaging reminds them of the nostalgia associated with older Apple products.

St. Jude Fundraising

  • Marco Offset Concept: The concept encourages users to donate an amount equal to the extra costs incurred when purchasing new devices.

Apple Intelligence

  • Limitations and Expectations: John discusses his experience with Apple Intelligence, including limitations and the challenges of training the AI.
  • Prompt Injection Concerns: There are discussions surrounding vulnerabilities related to prompt injection in AI systems.

iPhone and Mac Rumors

  • RAM Upgrades: Excitement over potential RAM upgrades for the iPhone 16 and upcoming Macs, as they have long been stagnant at 8GB.

Fresh Start vs. Restore

  • Pros and Cons: The hosts discuss the risks associated with starting fresh on a new device, including potential data loss and the unnecessary complexity of transferring data.

Conclusion The episode encapsulates a wide array of tech-related topics, from personal anecdotes regarding Apple products to serious discussions on charitable efforts and advancements in AI. It concludes with practical advice for listeners regarding tech purchases and device management.

Sponsors

  • Trade Coffee: A sponsor of the episode, offering freshly roasted coffee beans delivered to customers' homes.

Additional Notes

  • For those interested in supporting St. Jude, links are provided for donations.
  • Members can access exclusive content via ATP Overtime.

---

This Markdown file highlights the episode's key points, discussions, and concepts effectively, making it easily accessible for readers.

Written by AI. May contain mistakes. Listen to the episode to check what was said.

Hear the part that matters, and keep it.Open this episode in VO. Double tap your headphones to save a moment as you listen.
Get VO free

Transcript

Automatic transcript. May contain errors.

0:00So I had the pleasure today of unboxing one of the new iMacs. Have either of you done this? I don't think so. Yeah, I haven't. Why are you in possession of a new iMac? It's not for me. I was helping someone else set it up, but I was unboxing it. And I got to say, it was a pleasure. Like, it gave me such kind of old Apple fun vibes, even though, like, in certain ways, it's very modern, you know, because it has all of Apple's all, like, you know, paper-based packaging now. Like, you know, there's no plastic anywhere. Which I really do like, by the way. I think we've talked about that in the past.

0:30But generally speaking, Apple's packaging has gotten really, really, really good. And aren't they using like the bags from the Apple store? I think like even the handles, which feel like their rope are actually like recycled paper or something like that. Yeah, that was one of the first paper things that they did ages ago. Yeah, years and years ago. But yeah, so the iMac boxes, like it's in many ways, it has a lot of the similar elements as like the Mac Pro and XDR boxes with like those big like arrow panels that like kind of butterfly out when you open it up. um but of course obviously in the consumer line but it's still like it's pretty elaborate cardboard work to make like this pretty well cushioned thing with no plastic anywhere in sight it's it's pretty remarkable but what's nice about it is this was a green iMac and you know how like you know the typical iMac box you have like the outer cardboard like the brown cardboard shipping box and inside of it you have the nice white apple box then you have a little handle on top the handle it's green you open it up everything that can be tinted green is tinted green like because this is the color of the iMac so like first of all you open up the box and you see the the like screen overlay like the big sticky thing that covers up the screen for protection on the front of it it says hello written in the macintosh hello style you know so like the first thing you see you open it up that the cardboard butterflies out and you see it saying hello under like the translucent paper cover it's delightful and every single accent it's the it's the accent color of the computer like it was so well done it very much reminded me of like you know old apple be back when we were all buying desktops i mean john still is but no one else is like it was honestly it was delightful and so i just wanted to kind of shout that out like in a world where most of us aren't even buying desktops anymore it was really nice to see apple putting a ton of little detail work into making the desktop unboxing experience in 2024 pretty delightful i think the candy color imax predate both of your uh mac use but that was back when they were shipping with mac os 9 and they did the same thing where mac os 9 would ship and the accent color inside the interface like basically the scroll thumb color and like the text selection color everything would match the color of the computer you got yeah and the background to a desktop background like the default desktop background when matching color.

2:47It's an iMac tradition. Apple, as we often discuss on the show, they really could use more use of color in their product line, please. But when they do it, they do a nice job. I know as we're recording this, it's the 28th of August, and that means it's not quite September. But you might be listening to this in September. And you know what, darn it, we're close enough to September. And what is September, gentlemen? It is Childhood Cancer Awareness Month, which means it's time for the Marco Offset. What are we talking about? So, hey, if you live in a backwards country like we do, healthcare is a real problem.

3:25And if you live in any country, then childhood cancer is a real problem. And there is an establishment in St. Jude, in Memphis, Tennessee, excuse me, called St. Jude Children's Research Hospital. and they are a truly phenomenal organization that wants to end childhood cancer. They would like no child to die from childhood cancer ever. That's their goal. Their final form is to have them just go away because childhood cancer is cured. That is the goal. So why do you care? Why am I telling you about this? Because September, like I said, is Childhood Cancer Awareness Month, and our friends at RelayFM, which is also us, you know what we mean.

4:07They slash we are trying to raise as much money as possible for St. Jude Children's Research Hospital. Currently, as we record, the goal is$500 ,000. The campaign has been officially open for eight-ish hours, and we have already raised$30 ,000, which is truly incredible. That is so very cool, but we can do more. And I know that both the Relay and ATP listeners really, really do come out and support this wonderful organization. So if you're interested, you can go to stjude.org slash ATP to kind of fast track your way straight into the donation. Or if you'd like more information, you can go to stjude.org slash Relay.

4:48And hey, here's the thing. Relay's been trying to get to$3 million lifetime. We've already crossed it. Honestly, I think we should shoot for four. Let's shoot for four this year. You never know. Could happen. Could happen. It's an audacious goal, but it could happen. So how do we get to$4 million, which is my goal, not relays? Then you got to donate. So stjude.org.atp. Let me just kind of talk about a couple of things real quick, and then I'd like to explain the Marco or have Marco explain the Marco offset. So here's the thing, is that 400 ,000 kids worldwide get cancer each year. 400 ,000, that's a lot of kids.

5:24In many countries, four out of the five kids who develop cancer will not survive, mostly due to lack of access to quality care. So St. Jude and Relay and ATP, we all think that's no good. That is no good at all. So what are we trying to do? We're trying to raise money to help fix that problem. So St. Jude needs your help because St. Jude, they pay for everything. They pay for patient families to come and be with their sick child. They pay for everything. I actually went to Memphis in April for a big conference for fundraisers, and I cannot eloquently describe what it's like to be there. It is unreal seeing a mass of people so wholly dedicated to just saving lives.

6:08It's phenomenal. And the way they can afford to do this is from people like you and me and donating at stjude.org. In a couple of weeks, I will be going back to Memphis. I'll be going back to the St. Jude campus in order to participate for my very first time in a 12-hour telethon event, which we call the podcast-a-thon, with our friends Mike Hurley, Stephen Hackett, Kathy Campbell, and Jason Snell. The five of us will be there for 12 straight hours, and you can watch me melt into a puddle during that time. It'll be great. It'll be fun for everyone. So again, please, if at all possible, go to stjude.org.

6:44Here's the thing, and they've kind of asked me to read this, but I think it's accurate. So when we rally for a common cause, we become more than a community. We become beacons of hope for all. I mean, think about that. Think about if your kid was sick or your sibling was sick and suddenly somebody swoops in and in so many words says, don't worry, I got this, because that's what St. Jude is basically doing. So that's why we're asking all of you to join Relay and St. Jude and ATP this September for Childhood Cancer Awareness Month. Together, we can help cure childhood cancer. Now, okay, what if you don't care about childhood cancer, which you should?

7:15What if you just want to feel better about your rampant consumerism? Marco, how do we do that? So here's what's about to happen. We're about to have Apple announce a whole bunch of tech devices, mostly iPhones, probably Apple Watches, and maybe some new Macs later in the fall. So this is Apple device consumerism season. This is when all of the best and most popular devices come out, and many of us try to find justifications for why we absolutely need to buy these things, even though we have a phone that works fine, and we have a watch that works fine. But we could theoretically not buy these things.

7:49But you and I both know that's not going to happen. Of course, we're going to buy these things. So here's how you assuage your guilt as a rampant consumer who is wastefully throwing away your money on phones and watches and Macs and things that you don't necessarily need. I mean, look, you could use your old one for a little while longer, right? But you won't. So we know you're going to buy new stuff. Here's what you do. Donate a chunk of money to St. Jude when you do this. Think about whatever the, you know, what case is describing as the Marco offset? This is a term we've come up with over the last couple of years for describing, here's my strategy for how to figure out what a good minimum donation to St.

8:26Jude is. When you buy your new Apple product this fall or Apple products this fall, think about amounts of money that are kind of added on during the process that you kind of just accept or tack on without thinking too critically about them. Things like sales tax or cost of accessories, cost of storage upgrades, cost of AppleCare, These kind of additional costs that are above and beyond the base price of the most basic model of thing that you could get. So if the iPhone starts at$1 ,000 of the line that you want and you, say, spend another$100 to double the storage and then you spend another$60 on the case, you're at$160.

9:08Maybe you spend another$60 on tax, you're at$220, I think. Yeah. Mask getting complicated. All right. So you're at$220 with those kind of add-ons over the base. that is your minimum donation to St. Jude. So here's what you do. Whenever you buy these products in the next coming weeks and months, well, hopefully coming weeks because then it'll be during the drive. But when you place your order for your new iPhone on Apple Watch in a couple of weeks maybe, figure out that baseline minimum of the add-on price that is like, what are you getting that's a little bit extra? That's your minimum. So in my example, my minimum was$220, I think, if I remember correctly.

9:45I've already forgotten. I'm talking a lot. So,$220 is your minimum, then that's your minimum donation to St. Jude. So, if you've done that configuration there, consider a$220 donation to St. Jude. Now, if you are fortunate enough that you can give more, that's great. We encourage that. But that's kind of a good baseline of like, here's an amount of money that while making my frivolous technology purpose that I purchased that I probably could have gone another year or two without making. when I'm making this frivolous technology purchase, I'm throwing away another$200 in just add-ons and fees and taxes.

10:19If I can spend it that easily, I can give at least that much to this amazing charity doing amazing work for the world. So that's the Marco Offset. I encourage you to give generously. So several years ago now when ATP started really embracing this, I kind of jokingly, but also seriously, offered, hey, if you have the top donation and the donation list, if you reach out to me, forward me a copy of the receipt and give me a mailing address. As long as the United States Postal Service can mail something to your address, I will send you some not-for-sale ATP stickers. In the course of the last eight hours, I have two batches of ATP stickers to send out because one person, and I don't recall if they want to be anonymous or not, so forgive me for not naming them, but one person donated$8 ,000 and then the other person said, in so many words, hold my beer and donated$10 ,000.

11:07Oh, my God. That's$18 ,000 of the 30 ,000 raised between two ATP listeners, which is incredible. So you don't have to donate$8 ,000 or$10 ,000, but if you donate at least$10 ,000 and one cent, as I sit here right now, then you too can earn some hilariously overpriced ATP stickers. So reach out to me, forward me your receipt, and give me a mailing address, and I will dispatch them as soon as possible. I have the competition for the world's most expensive stickers. And I know we just talked about you're buying a new tech device. You're going to pay a minimum amount that you paid for the accessories.

11:40And these people competing to get the top donation so that keeps rising or whatever. That's great for the people who are hearing that and say, I think I could swing that. That's great. If you're listening to that and you're like, that's ridiculous. I barely have enough money to get by. A$5 donation is fine. Don't stop yourself by saying, oh, this pledge drive is just for people who can donate hundreds of dollars to buy new iPhones every year. give a single dollar like i swear like they will anything you do helps right like they they're not going to turn you away because you can only give them three dollars give the three dollars like that's what that's what these donations are made it's the relay listeners adding up all this money or whatever they're not all giving ten thousand dollars i swear to you people are giving five bucks ten bucks twenty bucks that's what makes this pledge drive so please uh stjude.org slash ATP.

12:30There you go. Alright, so let's do some follow-up. I hear that things may be different in Overcast land. What's going on there? So I re-added streaming as discussed last episode. That update is out. I've been in kind of a bad place mentally over the reaction to the update in part because as I described in a few episodes ago, I said basically that I described my star ratings being lower as a small fire on a big building that nevertheless I needed to put out. And so I'm happy to say that since the streaming update, there has been a sharp rise in the average score of new ratings. So I think that has made a substantial difference.

13:17So thank you, everybody who has updated your ratings since then or added new ones. Thank you for that. I'm also happy to announce now that what I've been working on for the last week or so is I'm bringing back a swiping UI to the now playing screen. Oh, hooray. That makes me very happy because I have mostly adjusted to the current one, but I still my natural reaction after so many years is to swipe laterally. So that makes me very happy. Yeah, and it was very hard to do because in SwiftUI, there was not a good way to detect pixel-perfect scroll positions of a scroll view until iOS 18, which added like a scroll geometry thing that you can finally actually read it.

14:03And I've been experimenting with this for a while, trying to get – because the reason I need scroll positions is when – in the current UI, when you switch over to – like from the artwork view to the info view, I animate down the height of the main playback controls to make more room for it, to give the info view as much room as it can get. and in order to do that I have to know well if you're dragging across and you don't drag it all the way how do I know where you are in that animation to know how far to bring that bar down so I tried all these different hacks including wrapping a UIKit, UI scroll view in SwiftUI and then of course inside that scroll view the content that I'm putting in it is itself SwiftUI again so it kind of like go back and forth through UIKit.

14:55And let me tell you, that creates so many shortcomings and problems. And I tried making that work for like two weeks and I couldn't get it to work well enough and have no massive show-stopping problems. So anyway, I finally figured out a way to do it where the animation works okay on iOS 17. It works a lot better on iOS 18. So I'm working on that now. That should be out fairly soon. at least into beta. And I'm looking forward to sharing that with everybody. Because honestly, it does make the app better. It does make it easier. You can swipe the whole screen again, just like the old version. It is a much better design.

15:37It was just very difficult to achieve in the constraints that I had using SwiftUI until fairly recently. So, I'm sorry, is the swipey stuff, is that requiring iOS 18 then? No. The way it's going to work, the way I have it right now, which is probably how it's going to ship, uh is you the swiping works no matter what but on ios 18 as you drag across and as the controls shrink downward to make to make as much room as possible for the info on ios 18 that will be pixel perfect on ios 17 it will stay at the top height until you are halfway through at the halfway point it will then animate itself down all the way and so it's there's kind of like this threshold where at the halfway point, it will cross that threshold and do the whole animation at once, as opposed to doing it pixel perfect as it tracks your finger.

16:30It looks okay at high speed. If you do it at slow speed, you'll catch the transition. But small price to pay for a much more usable interface. And the way my users are, by December, I'm going to probably have 70 % iOS 18 usage anyway, so it doesn't really matter. I know that's one of your pet obsessions, making all the animations beautiful and everything, But honestly, I think from a user's perspective, the thing that counts so much more than the pixel precision of the transition where it scrutinized is the responsiveness of when I put my thumb on it and I move, does the thing move immediately and in tracking with my thumb?

17:06And I think users will, I'm not going to say the forgiving of, they will not even notice almost anything else at normal swipe speeds as long as it is responsive. So I would sacrifice attractiveness of the transition, even on iOS 18, if it took away from the responsiveness at all. Right. And, you know, again, like users aren't running your animations at one one hundredth speed so they can scrutinize every pixel or whatever. They just want to put their thumb on the screen, move it to the side and see the info real quick. Believe me, some of my users are that picky. But yeah, overall, and it is very fluid and responsive on both OSs because, again, like it's all Swift UI.

17:42it's all very efficient you know with the way it's drawing the ui and updating things and everything like i gotta say i've gotten pretty good at swift ui like doing the whole app this way i have finally built up like decent swift ui skills um so like if something is possible to do in swift ui i can probably figure out how to do it uh it just takes a little bit of time and you know my usual pattern of doing it is like i will start trying to solve a problem i will build up this ridiculous amount of complexity as I try different things and figure out different what works, what doesn't, try different approaches.

18:13Then I'll like whittle it all back down to like the distilled essence of here's the one thing that really worked well. Like it's a whole process. But I'm very happy to be able to do this so quickly. Like this is part of the reason why the rewrite has been just so massively productive is that, now that it's done, is that I can do pretty substantial changes like this in now days and a week or two instead of like months that it would take before. It's so much faster to iterate. It's so much faster to change and design to restructure, redesign screens and controls and everything. It's so much easier.

18:55So I'm very thankful for that. That's awesome. I'm very, very glad to hear that things are looking up and looking better. They are literally looking up because that's the way the graph is moving. So that's very good news. we had some feedback with regard to the Mac screen sharing like badge and we were talking about oh could we do something visually or something like the Siri animation in iOS 18 what can we do to make it more obvious without having to nag the user is this okay is this okay is this okay so Josh Hattersley writes even the existing colorful icon indicating screen capture approach has its downsides some friends and I occasionally stream movies for group watch events in discord and while While I normally do so from a Windows machine, I tried recently from my Mac.

19:34I was extremely annoyed to find that the colorful badge Apple slaps on captured Windows also appears in the streamed video, even in an app like, however you pronounce I-I-N-A, we went through this years ago, I don't remember, which hides the title bar. Frustrating, and it feels like there should be a method to dismiss it. That's what I was saying last week that Apple really needs to do, although it may be tricky if an app like Ina is not using the right API. So basically like that, the purpose of that badge, that badge is for the person who is doing the stream. So they know that a streaming app is recording their screen.

20:05But the output of that streaming app, like when it says, OK, I'm projecting my screen to all my friends so they can see it. The friends don't need to see the screen recording badge. It's not for them. I think Apple should like this is what I was saying. If they ever did like a Siri type border, that part should be omitted from screen recording itself and from any output of that or whatever, because its purpose is to inform the person who initiated the screen recording or who's on the computer that is running the app that is recording the screen. That's just for them. It doesn't need to be in the output or the recording or the outgoing stream.

20:36And I hope that's something that either if Apple already does that, I hope apps that use those APIs learn how to get just the part they want and not the badge. And if Apple isn't already doing that suggestion, maybe I'll file it as a feedback. I mean, not really familiar with the APIs because I don't have any screen recording apps, but I just assume that's a logical thing to do. And it amazes me that like the badge just going out in the streams and stuff yeah that's something else oh yeah one more one more thing that i didn't put in there about screen recording someone i forgot who it was it didn't make any of the notes but someone showed a uh a picture probably or maybe it was a screenshot of apple tv projecting something apparently you can do screen recording in apple tv uh somehow either is it like a diagnostic thing to do screen recordings for like feedbacks or maybe their apps to do it but either way there was a giant solid red border around the entire television and that is the indicator apparently in apple tv to let you know that the screen is being recorded Not quite as elegant as the Apple Intelligence wavy thing or whatever, but gets the job done.

21:27That's special. John, you had some good news in your own world. You have finally gotten to the front of the line. Yeah, the Apple Intelligence wait list. Quinn Nelson suggested that I log out of my Apple ID and back in, but it turns out I didn't have to do that. I just updated whatever the latest beta of 15.1 is because I'm on the 15.1 train. And I went into Apple Intelligence and I was like, yay, you're in. It's Apple Intelligence and Siri, a personal intelligence system integrated deeply into your Mac apps and Siri. learn more dot dot dot right underneath that is a little box that says apple intelligence is not available when starting your mac from an external volume whoops cool so i am through the wait list and i have learned that i think i mentioned this on a past show but there it is right in my face i cannot use any apple intelligence features in the beta because i am indeed booting from an external disk i don't know what that limitation is about but it is what it is and i'm not putting 15.1 beta on the internal SSD of my wife's computer.

22:21I don't blame you. Alright, with regard to making photos memories using Apple Intelligence, Simon writes in to say, I cannot get Apple's AI to create a photos memory of the times my kids have gotten dirty. So Simon includes some screenshots and the prompt that he typed or said was, my kids are covered in dirt. To which Apple says, try another description. To create a memory, add details to your description or choose a new person, place, or event from your library. So Simon tried again. My kid's getting dirty while they play. To which Apple said, unable to use that description. And then my kid's getting dirty while they eat and play.

23:01Unable to use that description. Okay, fine. My kid's playing in sand. Try another description. Create a memory, add details, blah, blah, blah, blah, blah, blah. So apparently they are really trying not to do anything naughty or inappropriate which for the most part i applaud but they might have swung a little too far in one direction that was the prompt that we read on uh last week's episode like nothing filthy so my my suggestion was yeah what about your kids like getting dirty or like getting food on their face or whatever it's so hard to tell what these different responses kind of like when like home pod tells you different things or whatever which one of these responses is because apple intelligence is baited in it just couldn't figure out how to do these and which one of these is because of the, what do you call it?

23:42The prompt preamble or whatever you call it that said nothing filthy, right? You can't tell, am I being denied because of that nothing filthy thing? Or am I being denied because it just wouldn't work either way? I guess we'll all find out when we get this and start using it and start trying to make memories of ourself. If we get thwarted on things that we didn't hear mentioned in the little preamble, then we know it's just Apple intelligence being weird. But it's not an easy problem. Like the nuances of, you know, my kid getting dirty while they eat right and and the prompt saying nothing filthy i can see where there might be uh some confusion there but yeah i'm glad someone's out there uh trying it and speaking of trying it yeah so evan jow uh put up a youtube video where they figured out how to do prompt injection against apple intelligence it's uh pretty wild um it's only like a 10 minute video so it's worth watching but it is pretty cool what they ended up doing and it involves a lot of uh disassembly not in the like you know the computer code way necessarily but like how do i you know how do i get it what they're using where is that data stored how can i modify that and inject my own thing with it it like i said it's very very much worth your time if you have 10 minutes to spare yeah and this is just another another one of the weaknesses of a lot of lm based things are lots of computer interfaces and we used to say this about twitter as well difference between inline data and data that is provided in a different channel so the thing you're typing to an llm you want that to be processed right all the other stuff where you're saying this is not what the person is typing but this is what we're trying to tell you on the side llm like instructions to the llm you really want those things to be separate but the way most of these systems work is it's all just being one big wad that you throw in the top and probably most of that wad gets to the actual lm under the covers right so if you watch this prompt injection thing he's just looking through like the config files and figuring out what do i have to put inside the text that gets fed to the top of this big system such that it will interpret that as an instruction and then do like oh well you set it off with double curly braces or you put it in angle brackets or whatever that's an example of trying to put stuff in line it's in the same place as your message It's kind of like back in the day when you were on Twitter, where you would try to like quote tweet something, it would just be a bunch of text.

26:01And inside that text would be the URL of the tweet that you're trying to quote tweet. But later when Twitter officially supported that, I don't actually know the Twitter API, but I'm assuming what they did was said, OK, now when you quote tweet something, you get to say what you want to say in your tweet. And then you tell us the URL, the thing you're quote tweeting. But that's not part of your text. It's totally separate. like in the api request you say here's my text and here's a whole other field which is and by the way this is the thing i'm quote tweeting so you don't have to worry about reading the text and trying to find a url and once you find a url figure out if it's a twitter url and if it's a twitter url figure out if it's a tweet you don't have to do any weird parsing or whatever and if these systems use something like that they wouldn't be as vulnerable to just typing a double curly brace and putting a bunch of special instructions and typing two closing curly braces and then going back to what you were saying because you get to type that in a text box and you can watch it like he's just typing like text edit and he's selecting it and firing up the writing tools and saying go and they do totally different things like they don't do like whatever feature he suggested it's because the text that he selected oh we did a double curly brace inside the text and now we've escaped out of the text world and now we're into this world and parsing those things out and making it so people can't inject that in there is a much harder problem than you think it is uh but that's how these systems work and they don't have to they don't have to work this way like apple could have made it so that when you select a bunch of text and you right click it and do the writing tools thing with apple intelligence it could take that text put it into one separate bucket and then take another bucket and say here are the instructions to our system and send them as two separate blobs so so like it would never parse an instruction out of the text that was selected but that's not how it currently works at least in the beta he was using the instructions that are in the text get interpreted by the system and make it do all sorts of things and those those instructions are just plain text strings whether they're double curly braces or angle brackets or whatever you can find what they are in a bunch of config files and even if they can encrypt those config files or try to hide it or whatever like people can figure it out so that is a weakness of uh of trying to put metadata in line see also file name extensions you will never stop banging this drum i will never let it go to the day put it on my gravestone to the day i die maybe because i grew up with extensions it just does not bother me the way it does you.

28:16Because I like that in the file name it's clear what this file type is. You can have that without literally putting it in the file name. Do you see what I'm saying? So how did you have that in Mac OS? In classic Mac OS? How did you know what kind of file it was? There was type information. It was metadata separate from the file name. No, no, no. The system would never look at, the system would never try to parse anything out of the file name. Never. No, no. This is you and me having two different conversations which I think the two of us do a little too often. There was separate information. Just like there's separate information like where's the creation data in the file?

28:45Is that in the file name? No, it's somewhere else. No, no, no. You're missing my point, probably because I'm not presenting it well. What I'm saying is I'm looking at a Finder window or whatever the hell of the equivalent was in classic Mac OS. It was called Explorer back then. Yeah, it was called Windows Explorer. I have 10 different files in this folder or directory or whatever. And three of them are pieces of text, two of them are images, and the rest are a smattering of other styles of file. How do I know as a user what's text and what's an image? You asked this question as if that's not a thing that can happen today on your Mac.

29:14Do you have show all file names extension at all times turned on? No, I don't. So how, if you have a bunch of files in the finder and the file name extensions are not visible, how can you tell what kind of files there? I guess that's fair. All right. Touche. Touche. I mean, I think I do typically see the file names. Where is that? I know what the setting you're thinking of. Some people turn that on, which I guess I could understand you forgetting that that's not, it's not, that's not the default. No, I don't have it on. But like, it's not the default to turn it on. And if you don't turn it on, most of the time the system tries to hide them by simply literally hiding that part of the file name.

29:43It's still in the file name, but it's hiding it. And then your question is exactly the same. Casey, well, how do you tell? No, that's fair. You look at the icon. If you're in list view, you look at the kind column, right? That's how we did it. Fair enough. I mean, either way, I just really don't see why this is so offensive to you. But it's fair. I'm not saying you're wrong. I'm not saying you're wrong. It's the principle. I guess. I don't know. I bet if I grew up the way you did, I would probably also be deeply offended by it. I had a glimpse of a better world, and it was taken away from me. but i'm but i'm still glad to still i'd much rather still have max even with the sport at least we didn't get drive letters am i right that is actually drive letters are a true abomination i am right there with you on that one uh yeah yeah all right moving right along um how do you add grammar constraints to an llm john so like if i want to get a valid json out out the other side how do i do that so that was a question uh well again when we were looking at the the prompts that people pulled out of mac os or wherever they were the prompt said please produce only valid json and i discussed how just mind bending it is that you have to put that again in line with the with the text that's being fed in you have to put these instructions in plain english in line and then cross your fingers and hope to get it done because there's nothing particularly special about saying please provide valid json or only output valid json or please produce json that's valid or please please send your output in the format of json like you can say it a million different ways it's just text this is not offset by double curly braces this is not a special instruction to the engine it's literally just the plain text sent exactly the same as your text right uh and i like that's doesn't seem particularly reliable or great uh but steven tierney was the first to write in to give some examples of how lms are augmented to try to make this slightly less ridiculous so he writes you can constrain the format output format of an lm by specifying a formal grammar and he linked to an example from the llama open source uh lm i'll put a link in the show it's to the the readme and github it's basically just like a bnf type grammar where you say this is what json looks like and it's a grammar that defines the valid structure of json uh there i'll put another link to a recent paper on the topic called llm generation with grammar augmentation from one of the authors of the paper they write all of the compared approaches use constrained decoding to filter syntactically invalid tokens during generation they remove the set of bad tokens when the llm is choosing the next token so basically the llm goes through this process and for every token which is basically like a letter or a part of a word or whatever it has a list of possible candidates and like probability and then there's this other system where you pick one of them you don't always pick the highest probability but you pick one of the ones that's near the top right and what it does it says okay llm during this normal process produce all the possible tokens the candidates that we might pick uh but before we do the picking process if we decide which one we want again it's probably going to be one of the top ones although it's not always the toppiest top one that's part of what the temperature setting does right um before we pick that one uh delete any token that would make the output invalid json because it knows like it based on the grammar like okay we just did like the end of a double-coded string right the next colon the next token has to be like a colon or a curly brace like you know in the grammar what is even valid for the next token is any letter valid does it have to be like is any letter or a double quote or colon it knows and so it just goes through the candidate list and just deletes everything that wouldn't be valid and you hope there's something left right you hope that when you delete everything that would be valid hopefully something's left and it usually is because the candidate list is very very long right um and that's one way where you can constrain the grammar now there's possibility you might have to backtrack where you end up at a terminal condition where you didn't you can't produce any more tokens because you deleted all of them or whatever and there were some earlier versions of this that did slow down inference a lot but a lot of them use the similar approach we'll put a link in the show notes to a reddit discussion where someone tried to explain like the pipeline of like the text goes into a tokenizer that goes into the model they would get the list of candidates then a sampler takes it then you get the winner and then you keep doing that and then the grammar filter just goes in between the candidates and the sampler and open ai has a similar type of feature where you tell it what kind of output you want again this is different than asking for plain json but even given all of that like i said if you want to make sure that your candidate list contains something that will be valid json you should also still ask for it because that makes it much more likely that near the top of the candidate list or at least somewhere in the candidate list will be tokens that would make it valid json uh so you still you still have to say please and thank you like please produce valid But by the way, even if you, you know, when we pick your tokens, I'm going to delete all the choices that aren't valid JSON and only pick from the ones that are left.

34:17Cool. I mean, it makes sense. It's something, though. And we also had Nate write in and point out that the notification history that I think John was asking for is basically the one that exists in Android right now. It's better in Android. it could be better still but hey they have a notification history and it shows you your notifications to show here's all your notifications in the last 24 hours grouped by application and it gives you little summaries of it you could have even more information because again what i was looking for was like show me all the notifications that that have gone by when did they appear uh and what action did i take on them if any right and at what time did i take the action like stuff that the system surely knows at the time you do it but just like record it and keep a rolling 24-hour window it's not probably not that much data because it happens to me all the time a notification notification comes and go whether maybe i actually did something with it maybe i swiped it away and actually i want to see it again and i would just like to say you know i would like it to be just like a big linear list where i'm at certain point in the list but at any point i can say show me things that have gone by in the list already and i can scroll backwards or forwards that's just not how notifications work on ios or the mac for that matter and i wish they did we are brought to you this episode by trade coffee if you make coffee at home and i mean let's face it most of us do get ready to discover how much better your coffee can be with trade because the secret to coffee at home is to get freshly roasted beans what trade does is they bring the country's top local roasters together they curate their best coffees and then trade matches you with options you'll love recommending new roast based on what you like or what you might want to try and then every bag is roasted to order and delivered to your home fresh exactly whenever you need it and however much you need so this is a wonderful way to get great coffee at home because i'll tell you what the equipment the gear the brew method those are all fun i i love coffee making gear and methods and i have tried them all what makes the biggest difference by far is having freshly roasted beans done by a great roaster that is number one you can have the worst coffee maker or the worst pour over technique or whatever if you're using good beans it'll be good if you're using bad beans it won't be so go to trade this is actually even better because they also support small businesses because trade they don't roast the beans themselves they partner with over 50 independent roasters across the country they have they've made over 435 000 perfect coffee matches to date so they know what people like they send you what what they know you like and if you by any chance aren't satisfied they'll replace it for free super simple but it doesn't matter it trust me you're going to want what trade sends you it is so good i've never had the miss with like a recommendation for me.

Read the full transcript

36:52So see for yourself at drinktrade.com slash ATP. If you go there, you get your first bag for free. So you can try it, see how you like it. Of course, they have all sorts of different options. If you need like, you know, whole bean ground in different ways, whatever it might be. If you need to change your schedule or change your interval or skip a week, it's no problem. Super easy. Check it out. Drinktrade.com slash ATP to get your first bag of coffee free. This is the best way to get coffee at home. It's freshly roasted. Trust me, it makes a huge difference. So coffee at home made better with trade.

37:24Thank you so much to trade for sponsoring our show.

37:30We're not going to talk too much about it right now. We'll do more of that next week. But we wanted to note that Apple has announced their September event. It will be the 9th of September, which is a Monday. It'll be Monday, September 9th at one o 'clock, one true time zone. uh we will be watching along with everyone else and i'm excited for it i think it's going to be really fun and uh we're going to talk about what we expect later but any thoughts about that gentlemen talk about the the little invitation which i got a little odd this year uh so people haven't seen the artwork we'll describe it it's like an apple logo with what i guess is supposed to be kind of like the new siri kind of glowy effect around it but it doesn't really look it doesn't look like the old siri and it doesn't quite look like the effect that goes around your screen when you activate apple intelligence and the new uh ios and ios 18 but i think that's what they're going for and then the slogan in white text with a similar kind of multicolored glow behind it is it's glow time apple intelligence isn't even launching with these phones and now i know there's going to be features that are like whenever you activate siri it's going to glow so i guess yes it is glow time because now you're going to be activating siri and it's going to glow around your screen so technically it's glow time but do you really want to highlight the feature that everyone is going to associate with Apple intelligence, even though you know Apple intelligence isn't shipping with these phones, it's kind of weird.

38:53I think this is the invitation, so who cares? But we have a very strong tradition in this community of overanalyzing these, so I feel like I need to do my part. I feel like I ask this question every year, and I never recall what the answer is because, hey, it's me. Has there ever really been a strong correlation between this and like a actual new announcement you know this clearly is reminiscent of siri but siri's been around for a while have we ever seen like the dynamic island as an example like that wasn't teased in any way shape or form in an event poster was it like have we really ever gotten one of those in the last 10 years you have asked this multiple times although i think the question is shifting slightly over the years but uh you used to ask has any one of the invitations ever hinted at anything that it was actually in the presentation and the answer is yes it totally has now you're asking has it hinted at something that we didn't know about at all i think maybe the closest we can come there is one of the ones that was like the invitations basically let us know that there was going to be mac stuff and we at that point we were so disillusioned that nobody thought any mac stuff would be announced because the mac was really down in the dumps but when we saw the invitation like that's got to be mac stuff and it was it was mac stuff that's fair i forget what the particular invitation was or which one it was but yeah these things often do have hints about what they're going to show sometimes it's boring like this year they're like yeah the glowy effect we've all seen it in the betas and that's what they're going for but it's glow time it's so weird uh and i i don't i do think that a lot of times the invitation has a thing and a theme or whatever that is not they don't you won't see the presentation and say that was the glow time presentation because they're not going to say it's glow time in the presentation they're probably not even going to show this graphic or whatever but they will of course show their new os and their new phones and all the other stuff.

40:34So anyway, it's, you know, I, I don't think this is revealing anything. Like I can't even think of anything that hasn't been rumored that could possibly be hinted at by this invitation, but you know, it could happen. Hey, so hell might be freezing over. There are rumors. This was posted on Bloomberg that Apple is going to increase the ram in their base max or backbook pros like what what huh what we're not going to be stuck with oh i just got an error network changed uh we're not going to be stuck with eight gigs forever and forever is this the first time during the history of our show existing that this is going to maybe happen right i'm gonna say like what how long has eight gigs been around like and what we're talking about is the base model mac so whatever the cheapest mac is for years and years the cheapest mac laptop would come with four gigs of ram and then one glorious day apple said you know what the cheapest mac even the whatever the the lowest end mac we have now it's going to come with eight and i think that day may have been before the beginning of the show 11 years ago right we looked it up like they remember somebody looked it up and pointed out to us and it there was i believe like if you if you went to like you know if you said only like new models there was like i think the macbook air was the last one to have a little configuration of that at some point but like if you look to just whatever was for sale i think the md 101 that that old like the last one that had the cdu drive um that one which stuck around for a very long time in the sales channel i think that one started up at four also and that might have been the last one that was actually for sale yeah and and despite this let's say conservative approach apple has taken to ram RAM prices do fluctuate over time.

42:23You can look at the graph. It's not smooth. But in general, RAM becomes cheaper for the same amount of memory over time. And despite the fact that Apple has always done it this way, there's nothing particular about RAM that absolutely dictates that you must go from 4 to 8. You could go from 4 to 6 or 4 to 5. Now, probably it's going to want it to be powers of 2. And you can't get everything you want. it can't go from 4 to 4.75 because they probably don't sell things in those units or whatever, right? But you don't always have to double it. And as the amount of RAM gets larger and larger, doubling becomes much more significant.

43:01You're adding one gig of RAM, then you're adding four gigs of RAM, then you're adding eight gigs of RAM, because you go from one to two and two to four and four. You don't necessarily have to double it. Again, RAM is usually sold in powers of two and it usually makes sense to do the doubling or whatever but what it means if apple is going to really hold the line on ram for a long time is it's not a smooth ramp it's like just 8 8 8 8 8 for just years and years and years and you're like oh it's okay you know when it went from four to eight it's like wow everyone gets eight that's gonna be great and then you're like eight is okay and then you're like well you know you probably shouldn't buy one with eight and you're like oh really don't get the base model it has it you really need to get 16 like eight outstays its welcome.

43:41And it's like, you know, you could have gone to 12 at some point in there, but instead it's just going to be eight forever. And this rumor is we're going to go from eight to 16, which I'm all for. I'd rather go from eight to 16, right? But I'd rather not always have to wait for the doubling because it's going to become untenable. Like what about when you're going from 64 to 128? That's a missing 64 gigs of RAM that you have to live with until finally it becomes completely ridiculous that they're only shipping with 64 gigs of RAM. And then finally you get 128 right how about a 96 how about throw a 96 in there somewhere you know like it should be smooth and this is all the more frustrating because of that weird it's not even a rumor it was a teardown that i think basically confirmed this like they opened up an m4 ipad and look at the m4 soc and it had 12 gigs of ram on it because the the ram is on the soc it's like right next to the actual little chip it's like on the package with the soc right it had 12 gigs of ram and it only eight was exposed to the ipad but those the chips were a six and a six now people are like well maybe those are ram chips that only you know four of the six gigs work on those ram chips and other people said that's not how ram usually works are they just disabling that ram or whatever i was like hey that made me hopeful that the next low-end mac would start at 12 instead of eight because we had seen m4 socs that apple shipped that have 12 on them again i'm way happier with 16 but it shows that 12 was possible is possible apple did ship 12 on machines granted it didn't expose all or whatever uh and they could have done that on the m3 or on the m2 or whatever but they didn't so uh this may be the year for when the m4 max the plain old m4 max not the m4 pro not the m4 max those will have tons of ram you know whatever just a plain old m4 max that's probably going to ship in the macbook air obviously the imac um what am i missing the mac mini right plain old m4 starting at 16 gigs of ram long overdue and it will make the m4 line a great time to buy in you won't have to to scare people away from the basest of base models except for the fact that it'll probably have 256 ssd which is insane and they should double that too but anyway setting that aside you won't have to tell everybody oh you're going to get a macbook air are you getting an i back you just make sure you double the ram to 16 and you'll be fine and of course they charge you like$200 for that extra RAM, which is disconnected from all reality.

46:00And then suddenly the base price doesn't look that good. So it seems like when the M4 Macs come out, you can buy the base model and it won't be terrible. So we are getting real-time follow-up from the chat from David Schaub and the desktop Macs, if I'm reading this graph right, which I think I am, desktop Macs went to eight gigs of ram in 2012 when did we start the show it was 2013 right so that was before the show started laptops however went in 2017 what so in in you know early 2017 you could buy a laptop with four gigs of ram like the base model macbook air probably oh my god i mean that's what it's like towards the end right before a ram transition you like you look back and you're like really they were selling max with that little base ram because we just all get into this mindset we tech nerds of like of course you'd never get the base amount of ram that would be ridiculous right but that's just because apple holds the base amount of ram for so long that we just get trained like you don't this is a great machine you don't have to do anything to it except pay 200 extra bucks for more ram but everything else about it is great you're like wait why doesn't it like why can't i just get the the regular the cheapest one i'm like well that doesn't come with enough ram it's like well why would they sell it this is what happens if you talk with a non-tech person And they said, well, why would they sell it if it doesn't have RAM?

47:15I was like, well, it has enough, but if you want the machine to last longer and it will be a little bit better. And like you have to go through it used to be worse with spinning disks, obviously. SSD makes this better, but it's still not an excuse. Like it just it lets you get away with less RAM for longer. But there is a time limit. You can't hold it at eight gigs for 50 years. You have to increase the amount of RAM. And it looks like 2024 slash 2025, we're going to go from eight to 16 and we will enjoy a blessed two, three, four, maybe even five years. where we're all happy with the base RAM on Macs.

47:45I'm excited. I mean, we'll see what happens, but that would be excellent. So yeah, so with that in mind, there's also a rumor that the iPhone 17, not the one that we're going to hear about in just a few weeks, next year's iPhone, iPhone 17, will feature 12 gigs of RAM. This is reading from Mac rumors. Next year's iPhone 17 models will come with 12 gigs of RAM, up from the 8 gigs of RAM expected across Apple's upcoming iPhone 16 models, according to the Weibo user PhoneChipExpert. The iPhone 15 and 15 Plus features 6 gigs of RAM, while the iPhone 15 Pro and 15 Pro Max come with 8 gigs of RAM. The difference is said to be the reason why Apple Intelligence is only currently supported on the iPhone 15 Pro models.

48:23Since it's a requirement for Apple Intelligence, all four of Apple's upcoming iPhone 16 models are expected to feature 8 gigs of RAM, as is the rumored iPhone SE 4. So this is the Apple Intelligence RAM dividend. On the phones, obviously it's forcing all the phones up to 8 gigs, because we know, based on what Apple has shipped already, that the six gig ones can't do it now obviously max were already shipping with eight gigs but there's more stuff going on and contending for ram on the average mac than there is on the average phone given the different environments or there can be anyway because there are fewer constraints on what people can run simultaneously yada yada um why why is this the year that we go from eight to 16 i think the answer is apple intelligence i think that's that's why the all of a sudden the the phones are going all of a sudden the pro and non-pro phones are going to have the same amount of ram and it's going to be more than they had last year like it's still kind of weird to me that the 15 i mean it shows kind of how blindsided apple was by the whole lm stuff that the 15 line had this bifurcation where the pros can run the lm stuff but the non-pros can't because they they only had six and they're not making that mistake with the 16 line and apparently not with the 17 they're all gonna have it maybe maybe the 17 line uh they just this rumor just says the iphone 17 models will come with 12 gig does that mean all of them will i mean again i welcome it i think it's useful even if it wasn't for apple intelligence but if that's what it takes if it takes a new incredibly ram hungry feature that apple wants to promote to get them to finally start putting ram in their devices i'm all for it no argument here and then coming back to this upcoming i was going to say year but this upcoming month i guess this upcoming event iphone 16 camera improvements these rumors about the cameras for next month again reading from mac rumors the summary is that the ultra-wide camera will go from f2.4 to f2.2 aperture the 16 and 16 plus may support macro photography for the first time the iphone 16 pro the human-sized iphone 16 pro not the gigant gigantor one that i have will gain the 5x tetraprism telephoto camera which will make my decision making very complicated for this upcoming month the iphone 16 pro and 16 pro max will feature an upgraded ultra-wide camera with a 48-megapixel sensor with the same pixel-bidding feature as the main camera.

50:39It will have an f2.2 aperture up from f2.4 and support 48-megapixel Pro-Raw photography. This all sounds good. I'm happy that I will finally get the 5X lens in my size phone. I won't have to pull a casey and jump up. So I'm looking forward to it. Yeah, there were some other items in this article as well. I've just pulled out the most relevant and interesting ones but um one of the things i didn't put in because that's not an improvement is the rumor is that the main camera no change exactly the set for the pro models anyway the 16 pro and the 15 pro will have exactly the same 1x main camera which is i mean obviously there'll be processing changes and there's always something they tout and apple has done it a couple of times where they really haven't actually improved the camera hardware at all will they have find a way to make you think that it's better or whatever uh but the rumor is this is going to be one of those years but you know they make up for the other changes suddenly the ultra wide getting you know a 48 megapixel sensor with pixel binning and having a better aperture that'll really i hopefully make the ultra wide a lot better camera i forget if there was a i might have snipped out over here i forget if there was a rumor about the selfie camera improving but that's always welcome so we're not it's not always and especially these days it's not always about like how much better is the one x camera getting because it seems like they're really pressing up against the uh size and cost constraints that they want to at least that apple wants to dedicate to camera other phone makers are dedicating even more size and even more cost to their cameras but with apple's current design i'm not sure you know we can't expect the kind of changes we got uh during like the big uh camera you know blow up era someone should do a graph of this of how rapidly and dramatically the cameras improved when apple started making them way bigger because they used to be flush with the back of the phone and then all of a sudden they weren't and they became less and less flush over time and they took up more and more room and the camera improvements during those years when they went from a tiny little flush pinhole to these gigantic mountains huge improvements but the even though the camera bump has been getting still getting bigger it's getting bigger more slowly and the area dedicated the cameras is also slowing so yeah the one x camera is probably not going to be that big of a leap well they're running out of space to expand into on the back of the phone well you got to do like i said i've always said that you can't you know you got to do the full width right and maybe have fewer bigger cameras like look what the pixel nine does they've been the full width of the phone for a while now and their lower end phone just has two cameras side by side and the high-end one has three cameras side by side like you know we'll see what they do on the slim and if they actually change the design of the non-slim ones but But I don't think like you could make better cameras with bigger sensors, but they will take up more room and stick out more and cost more money.

53:19And every bit of space inside a phone that you take up with camera is space that you can't put battery in or any other parts in. So it is a balancing act. But we've definitely seen the rate of improvement of the 1X camera really slow down and lean heavily on processing features. But the other camera is getting better. Again, I think that's great. Yeah, honestly, what I look forward to more than camera optic changes, because again, as John's saying, the actual raw quality of the cameras changes pretty slowly these days. Again, because we are really hitting a lot of limits of physics and current sensor tech and optics.

53:54But the processing does change every year. And even when in the past, even when they have occasionally had a generation where the basics of the camera didn't change between one and the following phone, usually the processing is tweaked or is able to be more advanced, maybe be less heavy -handed in certain ways. and like as i've spent more of the last couple of years getting back into real cameras like big cameras one of the i mean obviously again like there's there's certain things that smartphones will just always be worse at because they're so optically you know very very small sensors very very small lenses that have to be very inexpensive relative um but also there's certain things that phones are way better at and generally always will be like stacking multiple exposures together to generate HDR and different effects and different processing steps.

54:44But it is still very, very clear to me when I look at a phone picture versus a big camera picture, you can spot the differences very quickly if you know what to look for because phone pictures are still so heavily processed by default. And there are, like, there's recent things, like I know, didn't Halide just release a cool, like, raw mode that's less or, like, that's basically unprocessed? Yeah, it's called zero processing or something. i actually tried it out where it's not no processing but it's almost no processing obviously there's some amount of processing just to get a reasonable picture off of the sensor but they do almost no processing and if you ever wondered what it would look like if you didn't apply most of the iphone's processing the answer is noisy yes because they're very tiny sensors and you're going to see rainbow noise all over everything unless it is extremely bright sunlight and you're like wow why would anyone ever use this zero processing mode it's like well in good lighting what you're saying is phone don't try to do the thing where you take 17 exposures and make everything like beautiful and have it all be exposed and like this weird you know artificial exposure bracketing hdr type thing let the sky blow out or let this thing be in shadow or whatever and if there is enough light you won't get that much noise and it is you know it's it's it's not a feature that most people want the default should still be all the processing on uh but it is fun to just see like what are these cameras capable honestly i'm pretty impressed with the zero processing mode and saying actually these cameras aren't that terrible like it's not too long ago that i owned like when my you know son was born in 2004 we had a digital camera that took pictures that were just about as noisy only there was no there was no option to add processing to make them better uh so technology marches on so if you want to try that uh download the i think it's in the latest version i think i might be on the beta but i think it's in the latest uh release version of halide uh that zero processing feature they have a big blog post about it it's it's fun to try yeah i was i was also very impressed honestly by like how how decent the sensor the raw sensor stuff is but yeah you do get a lot of the rainbow the chroma noise and and that's that is just the realities of such a tiny sensor that's you know having to crank up its sensitivity a lot in a lot of different lighting conditions um and so anyway wait.

56:56One of the biggest differences when you look at iPhone pictures versus bigger camera pictures is you can tell there's been a lot less processing done to the bigger camera pictures. Now, again, in certain conditions, this is not what you want, especially in terms of like, you know, if you need to combine multiple exposures to get larger dynamic range, for instance. That's something that the phones are just so much better at and probably always will be. But the big cameras, you can really like a big camera version. If you take it, if you like in the spot and you take the same picture with a big camera and then a phone barring, you know, exposure differences for things like HDR.

57:34are other than that like usually the big camera one will look a lot more natural because there would be like way less like over contrasting edge sharpening like all these like these kind of artifacts of the heavy-handed processing and so one thing i hope for every year that i don't usually get too much sometimes it gets worse but usually what i hope for with the new phones every year is that they've developed better processing so that it is a little bit less obvious like so it can be a little bit less heavy-handed by default or at all. This is something that, again, just due to the sensor size and the realities of those optics in phones, it's very hard to make it not require a lot of processing to look good.

58:16But over time, we do approach that. We do get better over time. Some phone generations are a step back. I'm not super happy with the 15 in this regard. I think it does apply very strong processing by default. but I think it actually is better than the 14 was in that same area. So hoping for more improvements there and that usually requires not only just slight improvements to the camera here and there but that also usually requires higher end processing, different techniques, more power in the signal processing pipeline and where AI comes in and helps sometimes too or ML or whatever we're calling it this few year period.

58:55All those things help too. but anything that can make the camera make this make the photos appear less heavily processed i very much welcome those changes when we can get them there's an interesting parallel with the ai thing like the one of the one of the knocks against the early and even some of the current like image generators so like a dolly or whatever where you just ask it to make you an image based on a text prompt is that they had real difficulty with text because they didn't know or care what letters were so if they had a sign with text on it it would look like like greek text where it's like oh this isn't a real language they aren't real letters it's just like you can tell it's supposed to be text but they're not there's no actual alphabet they're just these blurry smear of letters right because it you know it didn't consider that an important part of the image and whenever it sees signs in its training day it's like oh just a bunch of high contrast lines on a background you know anyway um the parallel to that in over processed phone pictures is they take a picture of real text on a real sign but then they apply their processing to it and their processing if you zoom in often looks like kind of an impressionist painting where it looks like blobs of paint instead of sharp individual pixels and they're doing that sort of denoise and lump everything together and it will make text unreadable so if you ever tried to use your phone to take a picture of some tiny text so then you could pinch and zoom on the text you may be surprised to find that when you pinch and zoom the text looks like a total mess it looks like that ai generated text and you can't even read it you're like wait is the text actually blurry on the you know this little temple not stem not stick of my eyeglasses because you're trying to look in there it's like no the text is perfectly clear on your eyeglasses but the processing of your phone totally mangled it and made it unreadable that is an example of where uh process zero which is the actual brand name that they're using for this hey lads process zero would come in handy because yes it would be noisy but it won't take the letter forms and melt them into nothing and sometimes when you talk about i can tell a phone picture from a real picture like oh well you're just pixel peeping which is what they mean by that is you're zooming in to the picture so you can see at an individual pixel lever that oh this is totally blobby and gross whereas if you zoom in on a real camera it looks nice as you zoom in and right up to the point where you actually see the individual pixels kind of right um but like pixel peeping is said derisively well first of all that is getting a closer look at the quality but second there's a thing called cropping which with real cameras you can do if you didn't frame the shot well or perfectly with a real camera it's usually better to although ai helps with this it's usually better to get more of the background that you want so that if you do need to reframe you can just crop in a little bit or if you take a big picture and the most interesting part is in the upper right corner or whatever you can crop in on that but you can only do that if when you crop in which is another way of zooming throw away everything except for this tiny square pinch and zoom until only this tiny square is visible on the screen they're both the same operation if you do that with a phone picture you're like oh this is unusable this person is a wax blob right they are an impressionist painting i can't make out a single thing at a regular size it looks okay because they're small but when i crop in all of a sudden pixel peeping becomes i just want to crop this i just want to crop and only have this person in the picture and with a real camera you can do that because the quality of the pixels doesn't immediately go into wax melted blob the second you go you view it at more than you know 1x zoom or even like less than 1x because sometimes the phone screen doesn't even show the entire picture.

1:02:09So, uh, yeah, I'm, I'm a little bit of a, uh, big camera bigot, despite the fact that I take tons of pictures on my phone and mostly enjoy how they look, but I know the weaknesses and I know better than to try to crop a tiny one third portion of a phone picture and expect it to look good, especially if it's a person, because they will look like a melted wax horror. Cool. Uh, yeah. All right. So, uh, our subtopic that I alluded to earlier. So allegedly Apple will support jpeg xl which will sit alongside heath jpeg heath max pro raw and pro raw max and the initial reports i read on about this seemed to hint that apple invented jpeg xl but having looked at the wikipedia entry that doesn't seem to be the case no i mean i don't understand these stories that put like a new format from apple called jpeg xl like just google the term before you write that story but um before we get to that though have any of you heard of heath max because no i was just thinking i don't recall what that is at all i mean i didn't google it either like i'm assuming it's just some variant of heath and heath has been around for a while what the heck is heath max i have no idea like we we had only two image formats for so long and then when they added heath which was now i mean a good number of years ago that was like such a big change and and kind of like what makes me a little bit nervous about this jpeg excel news is like we still don't really have amazing support for heath in the ecosystem around our computers and phones well i mean that's that i think is a a thing in favor of jpeg xl which we'll get to in a second when we get to the forum but i did just look up heath max that's just what they call what they call the 48 megapixel thing where you get all the actual 48 megapixels and you don't bend it they're calling that heath max but well so the way it was was that originally when the 48 megapixel came out the only way you got all 48 48 megapixels was if you uh did a raw shot if i recall correctly then they eventually added with 14 pro heath max which is yes i would like a 48 megapixel image but feel free to compress it right it's not raw right so the heath heic h-e-i-f h-e-i-c whatever that whole when apple introduced that format right their pitch was here's a new image format again it's not an apple invention it's some standardized thing that apple likes and probably had some part in uh and what their pitch was uh you get better quality images for the same size or you get smaller images you know like it was it's a better format right compressed images it's not a raw format it's a compressed thing the the format is very flexible we can do all the things we need to do we can uh implement all the features we want to implement i forget if this is the one that they implemented the little live picture thing in instead of having the sidecar thing they combined But anyway, the pitch was it's a better image format.

1:04:53Right. And we're judging that by the quality of the image at a given size. And even though it was weird, we're like, well, but it's not like it's Apple's proprietary format. This is a format that anybody can use. It's an open thing and it's better than JPEG. And that frustration that we have about like, oh, only Macs and stuff can read those things, mostly mitigated by the fact that when you share, we convert it to a JPEG. And if you didn't like it at all, you can go into settings and say, I don't want to ever use this hefeek stuff. just shoot everything in jpeg and it would still work but i left everything on the default switch was shoot everything in heath or whatever because they take up less room on my phone or they take their better quality at the same size or whatever like it's a better image format and i was figuring before i read the story that you know this heath heek thing will just you know tough it out for another you know five to ten years and eventually you'll see more widespread support for this format and it won't be that big of a deal honestly it hasn't been that big of a deal for me because again because of the sharing stuff or whatever but then this jpeg xl story comes out and it's like well if you were waiting around for he for heek to become so standard that it's as common as jpeg that seems like that is never going to happen for reasons that we will explain now right oh so jpeg xl supports lossy and lossless compression of ultra high resolution images up to one terapixel Up to 32 bits per component, up to 4 ,099 components, including alpha transparency, animated images, and embedded previews.

1:06:20It has features aimed at web delivery such as advanced progressive decoding and minimal header overhead, as well as features aimed at image editing and digital printing, such as support for multiple layers, CMYK, and spot colors. It is specifically designed to seamlessly handle wide color gamut color spaces with high dynamic range such as REC 2100 with the PQ or HLG transfer function. I understood about a third of what I just read. So there are some sweet features involved. There's independent tiles. So decoding of sections of a large image by allowing images to be stored in tiles. Progressive decoding, more specifically, excuse me, it's a mode specifically designed for responsive loading of large images depending on the viewing device's resolution.

1:07:02There's support for both photographic and synthetic imagery. The format features two complementary modes that can be used depending on the image contents. Efficient encoding and decoding without requiring specialized hardware. JPEG XL is about as fast to encode and decode as old JPEGs using libJPEG Turbo. and an order of magnitude faster to encode and decode compared to Heek with x265. It is also parallelizable. JPEG XL can losslessly transcode a widely supported subset of JPEG files, making about 20 % smaller file sizes possible due to JPEG XL's superior entropy coding. This process is reversible, and it allows for the original JPEG file to be reconstructed bit for bit.

1:07:40JPEG XL, and I think this is the kicker, is a royalty-free format with an open-source reference implementation available on GitHub under a three-clause BSD license. Poor Heek and Heef. They were better image formats, and they had their very brief time in the sun, but not enough to become industry standard, and here comes JPEG XL, which is basically better than them in every possible way, including the most important one, which is royalty-free. BSD implementation, royalty-free, open source, parallelizable, supports all the new modern things, huge image files, transparency. just think of all the image formats that we've lived with and all the weird stupid we've had we had gifs which are fun but they had you know only go up to 256 colors um we have jpegs but there was a kind of blurry so you'd use gifs for those if you could but if they had more than 256 colors then you needed to do png but png was the only one that supported transparency but then i didn't support transparency pngs and even today like even when i'm putting stuff on my website it's like i'm gonna put oh i want it to have transparency i guess i'll have to use a ping but of course pings are basically uncompressed even though you can squish them down a little bit farther so jpegs are much smaller than pings but then jpegs are blurry especially if you have text because they don't do a good job with that and like and there was progressive jpegs when we had modems so the jpeg would slowly fade in or whatever but and there's those old jpeg 2000 and then then there's webp and all the weird google formats and what is it avif and then there's all these wars about i hate it when i download a webp image because mac os doesn't like those and i always have to end converting them so i have a retro batch thing that converts all the webp images into pngs and and of course there's photoshop formats like this solves all of them supports everything that they all support is totally open has the name jpeg in it which is really important i mean it probably is from the joint photographic experts group but being called jpeg something is important now granted it didn't help jpeg 2000 but putting 2000 in the name wasn't a great move right and excel makes it sound like it's extra large but i think that's not what the stands for but this this has all the features and it's royalty free and it's open source and like it's made like it's made for modern hardware parallelizable the thing with the tile encoding or whatever that it's parallelizable because you can break up your image into chunks and decode them all in parallel and if you're just showing one quarter of an image it can just decode that corner of the image like it's it's so well thought out and well designed to not have any of the weaknesses of the existing formats and by the way it also makes smaller files at the same quality or better looking files at the same size right so i am ready to throw heek and heath in the dustbin of history i'm ready to go all in a jpeg excel provided everybody starts supporting it that means mac os chrome all the other like every platform needs to support this which almost sort of mostly happened with webp i think webp on the web works okay as this name suggests but when you download a webp onto your mac mac os is like you know and whatever the other format that google likes is an avif or whatever there's a bunch of other image formats that are better than most of the existing ones that are kind of competing with he can heath and all that but yeah the only thing jpeg xl does have going forward you know it does support animation you know why do we have quote-unquote animated gifs for so long because it was the only image format that supported animation and then there was like animated pings but that didn't get very wildly supported these days when we say i'm uploading a gif they just convert it to mp4 behind the scenes right and like twitter and uh mastodon or whatever they don't actually show you an actual gif because actual gifs are humongous because it's individual frames that are you know individual gifs or whatever and this is not a video format so it doesn't solve all the problems like h265 will live on and all that other good stuff but i am excited about jpeg xl and i hope unlike he can heath this does sweep across the entire industry and become boring and supported everywhere and i guess the only barriers to that not happening are companies that are really tied to their formats either because they own the patents on them or because they've already invested in this giant infrastructure that understands web p and process them or whatever and i hope we get over that again this being royalty free should help being royalty free also means people don't make money from it so some people are motivated not for for that format not to spread but my fingers are crossed on this i and this is just a rumor we don't even know if it's true right i haven't even seen the betas and even in the is jpeg xl going to be the default are they going to talk about it in the event and because they did talk about he can heep they said hey we've got a new image format and it makes better images right uh and don't worry it'll be compatible because when you share it it'll convert to jpeg i assume they would take the same approach to jpeg xl and where does that leave heath and heek are they still even going to be an option or are they just going to be removed from the menu and it's going to be plain old jpeg same as it ever was or jpeg xl which is the extra large version but not really yeah this i'm hoping this takes off because you know heath and heath slash heek i know one's the container and one's the format heath has just still it's been around for a while it has never gotten good enough support across the industry to the point where like if you are taking a photo from an iphone and sending it anywhere or using it anywhere else but besides another iphone you've probably been just having to convert it to jpeg and to the point where like apple's own frameworks will do that for you a lot of the time because that is usually what people need to do i would love for jpeg excel to get wide enough support everywhere that we don't have to do this dance anymore in a few years because JPEG has been a wonderful format for the entire tech industry for the 150 years that we've had it.

1:13:12We do have better techniques now. We do have better compression now. We do have like different needs now. It is time to hopefully retire JPEG and replace it. And the only reason we're still using JPEG is because it is like the kind of universally compatible version. Now, everything I just said is also true about mp3 and I and I say that with love because I love the mp3 file format um I think it's a lot easier to replace jpeg than to replace mp3 for a lot of reasons well I mean here's the difference though because you mentioned jpeg and how much you love it it's been around for a long time but jpeg has obvious problems which is the reason people used anything that wasn't jpeg first of all if you have something that's like line art or something like that a like black and white line art a gif is better for sharpness 256 grays in a gif for example is going to give you sharp crisp edges none of that weird compression artifact stuff or whatever it'll be a real small file or a png or something like that jpeg makes things blurry and gross until unless you crank up the quality and then it makes your file size bigger it is it is made for photos it relies on your perception of the human perception and it's great for photographs but black text on a white background line art uh tiny text that becomes a fizzy mess that is jpeg's weakness transparency not a thing in jpeg except probably jpeg 2000 animation i believe there is an animated jpeg you know there's motion jpeg formats or whatever but like lots of things that we eventually found to be useful in image formats plain old jpeg in most implementations simply doesn't support not true of mp3 mp3 has a lot of things going for it number one uh pretty much every thing you could think to do with an audio file mp3 supports right and number two mp3 is so close to the perceptual limits of human hearing and file sizes in the grand scheme of things are so low that we don't care that you can make a better sounding slightly smaller file with aac or whatever because the difference isn't that big you know what i mean maybe for hours and hours of video or something like that and maybe for multi-channel formats it's a whole other thing but like mp3 for its role doesn't really have any of those glaring weaknesses like like no transparency in an image format for the web it's so killer and there's no equivalent to that for like oh here's the problem with mp3 right and so you know it was bad when we were doing like mp3s at really low bit rates but you know a 320 kilobit mp3 that's fine for 99 of the planet for you know basic two-channel audio or mono audio and so yeah i think mp3 has still got more legs but jpeg like again the reason anybody uses formats other than jpeg is because they know jpeg's weaknesses and they know this has to be a ping this has to be a gif or you know this has to be something else entirely because jpegs can't do it all but jpeg excel like those old those things i said i don't know if this is the case but when i read support for both photographic and synthetic imagery with two complementary modes i think it's going to be one mode where it recognizes line art i don't know if that's true i'm putting my hopes and dreams in that one line there and then the other thing where it can transcode existing most existing jpegs and make them 20 smaller smaller essentially losslessly and you can reverse that that means that like if you have a library full of jpegs like if you shot jpegs for years and years on your phone and then when he came out let's say you you didn't pick that format but either way if you've got jpegs on your phone this format can make all your jpegs 20 smaller like losslessly not re-encoding them and making them look worse just take that jpeg and replace it with a file that is exactly the same but it's 20 smaller that's that's one of the the great things about having jpeg in the name and saying it will subsume your existing jpegs and make them smaller and 20 is not a small number so but i you know again we're just reading a feature list and this is from the wikipedia page and it makes everything sound like you know wonderful and roses and we'll see if this is really true or if the if all my hopes and dreams are accurately represented by these bullet points but this is looking great to me i mean just just recently i've been putting images up on my website and you know it's just like why is why are images such a mess still on the web and here's JPEG XL.

1:17:14Come to save us all. Probably people said the same thing about JPEG 2000 and again, that didn't quite work out but maybe this time we'll do it. I hope so because if you think about what it takes for a new image format to really gain a foothold and really get as widely supported as JPEG and Ping are today, we have such a massive world of technological tools and infrastructure and various devices, server side open source libraries, server side language support, CDN support, obviously browser support, different phones, whether cameras are going to shoot this format. There's so much out there that either processes or converts or resizes or displays images.

1:18:04and this is part of the reason why we haven't had more formats that really take a foothold because the world of of just tech and software and hardware that deals with images is so vast so for this to really take off obviously having you know royalty free and open source components is massively important here because any if there's any kind of royalty requirement on a format that means that in the entire ecosystem of open source tools and of server side you know language supports everything is probably not going to support it or at least it's going to support it in in a very loose or half-assed way and there's going to be format wars because they're like well you have your royalty one and i have my royalty one and i want mine because i get money from it and you want yours because you get money from it and even in this case it's there's an open source implementation but it's not like a copy left type of uh you know gnu public license or whatever it's bsd which is the one that says take it make money off it whatever like it's not even a restrictive open source license yeah so that that really is setting the stage for this to be widely adopted um so we'll see i mean the only other thing that generally tends to hold back new formats from being adopted besides you know the the tech besides the you know the technical requirements royalty requirements open source uh lack thereof the only other thing that tends to hold things back is if it's not a big enough improvement over the ubiquitous established format that was always the problem with jpeg 2000 and i think to some degree that was a problem with heath i think this might be enough overall improvements to finally make it worth people actually like putting in the work to to implement this so i i hope this goes that way because again like jpeg really has had its time it's been wonderful but this this is a lot of advancement over that and i hope we get the chance to actually use it and even if it isn't even if it turns out this is not a big enough jump for it to be adopted industry-wide i'll say the same thing that i said when apple went to heek slash heef even if this is only a format that only apple ever uses if it makes all the pictures on my phone a little bit smaller and they all just get converted to jpeg anytime they're exported which again has basically been my experience i never have to think about the fact that this phone is always taking pictures and he keep unless I like look at see that format in the photos menu on my Mac when I export I'm like oh yeah that's right that is a format right like I don't have to think about it but they take up less room in my iCloud photo library they take up less room on my phone I'm that's worth doing that's why I didn't change that option I want my pictures to be smaller I keep taking pictures I want them to be you know like I said I want them to be smaller or better quality at the same size and just keep making those formats better so probably like half my collection is jpegs before they introduce he and then half of them is the new format and then i'll start with jpeg xl i would prefer it if it went industry-wide and you know solve those problem but like to give another example because of apple i have i use the photo screensaver on all of our macs and i have like my favorites for my photo album being like the floating you know floating images going up and down your screens like pictures of my family and everything they're all the favorites from my photos library the screensaver has a feature that says hey um pick an album from your photos library in this little picker and we'll use that to feed this slideshow but i can tell you that once you push up around 200 000 pictures that ui gets very upset so what i do instead uh apple you could fix this but anyway what i do instead is i go to the favorite collections and photos and i export them all to a folder on my mac somewhere and i don't export them at 100 size because they're just going to be in a screensaver and they're usually pretty small in that floating screensaver so export them in like the quote-unquote large size instead of original size and i do that in heek and when i used to do that in jpeg the folder was way bigger and now the folder is smaller and i like that right and then you just point the screensaver at the folder and it can somehow handle that when it couldn't handle the thing in the photo picker library i try not to push my photo library too much i don't want to upset it but anyway just just for that thing taking up less space on my phone and taking up less space in the favorites folder that is on all the macs in my house for that alone please i welcome jpeg excel but yeah I really hope it does sweep across the whole industry because it, it seems like it just finally resolves all of the issues.

1:22:16It's the image format that does everything we want image formats to do and hopefully does it well. All right. You want to do some Ask ATP? Let's do it. All right. So Tom Thorpe writes, it's that new iPhone time of year again and time to ask the age old question whether to restore from backup or start fresh. I've been on the same backup for 10 years, but I'm starting to think it would be nice to start fresh partially because I want to clear out unused apps, but I also still can't help but imagine it would clear out the craft, provide better battery life, et cetera. What are the pros and cons of doing so today?

1:22:45What would I lose by starting fresh? And would I get any of my imagined benefits? I don't think I've ever started fresh. I think I'm still carrying the same iOS installation, if you will, from my 3GS way back when. So I don't think I can say from experience whether it would be a good idea or not. Generally speaking, I don't think it's a bad idea. The thing that scares me the most personally is losing my iMessage history, which, granted, is basically a black hole anyway because search is terrible in messages. But, I don't know, it gives me the heebie-jeebies to think of losing it. But I guess, man, go for it and report in and let us know if it was a mistake.

1:23:33Especially if you take a backup first. I mean, it's not going to hurt anything. You can always go back to your backup. So, all right, so Marco, correct me. I mean, the whole thing of like, well, you could always back up. Like, I feel like, yeah, you can, but after a couple of days of using the new one, it's like how when you undo in an undo stack, as soon as you make any change, you can't redo anymore because there's no way for you to like merge that change back into your stack. You know, it blows the redo stack. You can take a backup, but like as soon as you start doing anything on the new installation that is like creating new data, writing new things, you're not going to want to ever go back to that backup because it'll be too disruptive or you will lose something that you've done.

1:24:17So basically that's usually a pretty one-way transition. I would say if you actually want to like have a clean start, if that's like a really appealing thing to you for some reason, sure, go ahead, do it. I don't think though that it's necessary with modern OS installations in almost every case, especially on the phone. On the Mac, sometimes you can build up a whole bunch of weird stuff in various library directories. Even then, you can clean that out. So it's rarely necessary on the Mac. I would say on the phone, it's basically never necessary. I think, like you, Casey, I think I've either never done it or I've done it maybe once in total ever.

1:24:55But I don't think it's really necessary because iOS is already so controlled and limited. You're not throwing in texts. You're not throwing in weird preferences that live around forever in some directory. You don't need to run iPhone cleanup utilities to find lost and abandoned files. There's so much on the iPhone that because of the technical limitations imposed on apps and because of all the containerization of all the apps data and everything, you don't really need most of that stuff. Now, whether you want to go through your apps and clean out apps, that's a different story. but you can just delete the apps.

1:25:32You don't need to reinstall the whole thing from scratch instead of bringing it over to your restore. I think mostly what you'd be doing by doing a fresh installation without a restore and manually starting things from scratch, I think most of what you're doing there is causing a lot of time loss, possibly some data loss in apps that don't transition over at all or well or perfectly, all for a benefit that I'm not sure is real or at least I'm not sure it would be anything you would ever notice. So I would recommend if this is not something that you really think you need to specifically do because of a specific reason you're trying to get rid of I would say don't do this.

1:26:15Just bring your stuff over. It's not going to make a meaningful impact on stuff like battery life or things like that. That's mostly a myth on iOS, and there's other ways to control that, like deleting apps. So just go through. If you really want the same effect, go through and delete a bunch of apps that you don't use anymore. You can do that. Just do that. It's fine. Before I address Tom's question, I'll just say that all three of us are in agreement for just general people who don't have the specific question. Our advice is just transfer data from your old phone. It's what everybody does. It's the default.

1:26:44That's what we recommend. Flat out, not even close, right? Now, Tom's question is, like, I think I might have a problem. I think I might want to do this. What are the trade-offs here? What would I lose by starting fresh? Marco kind of already addressed this. It is possible to lose something because if you have an app, especially older apps, but who knows, could be modern ones too, that don't have any kind of cloud sync type thing and you start fresh and you reinstall that app, the data that was associated with that app that was on your old phone is still sitting on your old phone. And that's the only place it is because it doesn't have any kind of like it saves it up to iCloud or it puts it on a server or it does any kind of syncing thing.

1:27:19it's just locally on that inside that app if you did a backup and restore did a data transfer you would keep that data most of the time right but if you but if you have an app like that and you okay let me download that app from the app store and you launch it and you see nothing in the app you're like hey where's all my stuff it's back on your old phone so it totally is possible to lose data again good apps don't do that they have some kind of cloud syncing thing they use cloud kit or whatever that's how people expect ios apps to work but there's no way as an end user for you to really know what is this app doing is it just storing things inside its container locally on my old phone and and if i install the app fresh on a new phone and sign into it with my account it doesn't bring my data with it you won't know that until you do that so that is a pretty significant risk which is another reason to keep around your old phone when you're setting up your new phone just to make sure that's not the case as for would i get any of my imagined benefits there are scenarios where a fresh install will save you but they're pretty obscure right so because everything is so containerized or whatever the usual way that you're going to get any kind of benefit is there's some kind of problem situation usually having to do with corrupt data like there's some kind of file format or data or whatever associated with an app that is that for whatever reason a bug in the program or who knows something it's not it got mangled and so it's sitting on your ssd on your phone and it is improperly formatted and maybe you don't notice because it's some some obscure corner of some database that some file uses to keep track of its stuff right but the way this could potentially manifest is let's say that app runs in the background once an hour for 60 seconds if during that 60 seconds it goes into a tight loop because its decoding code gets tripped up over the bad formatting and just goes around and around does an infinite loop for 60 seconds before it gets before it gets killed you don't know that's happening behind the scenes but once per hour there's a little tight infinite loop for 60 seconds draining a little tiny bit of your battery because of some tiny corrupt database and something you have no visibility into this the app developer thinks there's nothing wrong with my app i don't know what the problem is he would have to diagnose and get your actual data file to determine that you your data file was corrupted maybe by a bug of three versions ago in his program and you've been slinging that corrupt database file around from phone to phone to phone burning tiny little bits of power on it and multiply that by three or four apps that have this problem if you do a fresh install of those apps and it syncs a new thing down from the cloud or whatever you wouldn't have that problem right if it's corrupt in the cloud and you do a fresh install and you install that app and it syncs to the cloud you got the same problem you didn't didn't you know what i'm saying like you and you don't know unless you're the developer of that app is this corrupt just locally or is it corrupt in the cloud am i just you know the only one thing is you could have problems on your phone do a fresh install reinstall all the apps that you use lose and restore all those problems because all the problems were like corrupt data in the cloud or something like that or any bug related to that right because you never know like is the problem that i have like people have this concept of like i think there's cobwebs inside their phone or whatever but it's you know there are specific things that applications could be doing that could be causing you a problem and i'm not even sure what the ratio is but a huge number of those are not solved by setting up a new phone at all because it's just going to faithfully reproduce every single one of those problems if you just delete that entire app then hey problem solved but if it's an app that you use every day and you had a problem over there you're also going to have a problem over here in a lot of circumstances and that's not satisfying right on the mac again it is much more likely that there's some leftover files to something you never use that you can just clear out and doing that manually is very difficult and i do not recommend people do it and it takes a lot of experience not to hose yourself so you know that's why the mac is what the mac is but on the phone your tools are fresh install or backup delete app or not delete app and it that's pretty much where it ends and that's good you don't want more tools than that but sometimes you have problems that you can't escape by doing a fresh install and that's just a break so i i would recommend not doing it again basically you didn't say you had any specific problem you just want your thing to be better getting a new phone and setting it up as a fresh phone by itself will empty out a lot of stuff like when you transfer data from your phone it's not transferring like every single thing that was on your phone to your new phone it's transferring the things that it thinks it needs to transfer and everything else on your new phone is fresh probably all like the caches directories the spotlight indexes are going to be recreated, whatever the heck Apple intelligence is doing, it'll sink your photos down from iCloud fresh.

1:31:36So if a bunch of photos are corrupt over there because of some heated up part of your SSD flipped a bunch of bits or something, you won't have that problem over here as long as they weren't corrupt in iCloud. Like just restore from backup. It will still be a fresh phone, even if you don't start from zero. And if you do start from zero and you have a lot of stuff, you will spend hours and hours and hours trying to get it back like your old phone. And as soon as you think you have a good and you sell your old phone or wipe it or whatever, then you're going to find the thing that you missed and it was only on your old phone and you deleted it.

1:32:02So don't do it. All right. Michael Quinn writes, so we all buy new iPhones in a few weeks, spend the next 12 months training them as our personal AI assistant with stuff securely stored on board. What happens after that? Does that transfer to iPhone next? Do we have to retrain every iPhone forever, a la waiting for photos and spotlight to rescan and index each year? Kind of sucky experience. If so, maybe another barrier for upgrading. If you know you're going to lose your personal AI. This is a really good point. And holy crap, I would assume since Apple is a company that knows what they're doing and cares that it would transfer, but then photos.

1:32:37So I don't know. I don't know what's going to happen. I mean, I think Michael's answer here, Michael's question here contains the likely answer. So what Michael says in the question is, do we have to retrain every phone forever, a la waiting for photos slash spotlight to rescan and index each year i think it's probably going to end up working much like spotlight indexing because that is kind of what it's built upon or at least that that is like the structure that they have built it with so chances are and again i don't think we know this yet but chances are the way apple intelligence you know indexing or assistant learning will work on the phone is very similar photos in that when you get a new phone or you do a restore it'll spend the first couple of nights that it's plugged in all night indexing your data and training itself on that data it's going to be or you know it'll as it's sitting on your desk during the transfer it'll heat itself up like crazy melt itself while it's doing all this so i would expect it will be similar to that apple does have a history of features like like for instance like some of the like you know people training uh metadata stuff in in the photos app apple has a history of having features that have local intelligence or categorization or other ml kind of data that is generated on device but then they have ways for other devices or restores on that same device later down the road to re-index and basically get that same data somehow on them so i think it will be very similar to that process where whatever you have like taught it that will probably, and by the way, we don't even know necessarily what that means yet.

1:34:18I don't know if any of the features that we've seen even have things that you can teach them besides indexing content from your apps. But whatever effort you put into training Apple intelligence will probably carry over just fine. And I think, again, most of the features that we're going to see in this first year, I think are going to be based upon either just kind of global knowledge-less models that you're not putting your special spin on or index content from apps that can just get re-indexed as when you have a new phone. So photos is a good example of this because I think one of the photos things he's probably referring to is face recognition.

1:34:55When that feature was first introduced, photos would scan all your photos and find people and find their faces and do all that stuff. And you get a new phone and it would have to re-scan them and re-find all the faces. And it was frustrating because the scanning for faces is not perfect. And sometimes you have to correct it. No, this isn't my mom. This is my grandmother. No, this isn't my first kid. It's my second kid. And you you would do those corrections because it would get it wrong and then you get a new phone you're like geez it's getting it wrong again i corrected the same photo that it thinks is my mom but it's actually my grandma it's literally the same photo i corrected on the other thing this is like michael's question if i do all this stuff on my phone do i get a new phone do i have to like essentially like i lose all that information uh and so apple added a feature i think a year or two after this the face recognition came out that said we will transfer your face recognition data from your old thing to your new thing.

1:35:41But they didn't mean get your faces set up all the way you want them on your old phone and when you get your new phone, it'll be just like that. That's not what they meant. The way they implemented it was anything you manually did on the old phone, when you corrected that and said, that's not my mom, it's my grandma or whatever, right? That action by the user, those actions were recorded and transferred to your new phone and synced to your new phone or whatever. Everything else was not. So what would happen is it would transfer over basically like the manually entered info, which is probably pretty small because you just manually do one or two things, but you got thousands of photos.

1:36:18Then it would rescan all of your photos and do phrase recognition augmented by your corrections. But the rescanning is probably like a new version of iOS and a new code base or whatever. And who knows, it's not going, first of all, you have to do the rescanning because that's, so that takes time and energy or whatever, at least usually not that long. and second it's probably not going to end up in the same state as your old phone because that was scanned you know some of those photos were scanned two versions of ios ago depending on you know how old your phone is or whatever and there's totally different code scanning and by the way it's scanning with the benefit of all your manual data whereas those are scanning with only the benefit of some of your manual data that exists at the time the scan took place and so you end up with your new phone not being like your old phone it's one of my frustrations with the photos photos on the mac because i meticulously arrange my you know select my faces and everything and i'm on the mac your iphotos library is essentially a folder on your mac i can never lose that folder because when i go to another mac and pull out the same photo library faces are all over the freaking place because it doesn't it doesn't benefit from all of my stuff like this is a carefully curated collection of things that have been scanned over the course of years plus my manual corrections or whatever.

1:37:24So that is what they did with photos. What might they do with AI? There's no technical reason for both photos or AI that they couldn't take your complete semantic index or whatever they're calling it and transfer it wholesale to your new phone. They could do it through the cloud because they have end-to-end encrypted things in the cloud where Apple would have no access to information, but it would go up to the cloud in a way that Apple has no access to it because it's end-to-end encrypted, not like your iCloud messages backup where they can read it all or whatever but like totally encrypted and pull it down to your phone it could be device device transfer where it never touches any Apple server but it goes directly from your phone to your other phone they could do that but I kind of understand why they don't want to well for multiple reasons one is that I think the amount of manual information in the vein of like oh I'm correcting the face in this picture for AI is going to be small people like this question envisions like oh i've got this ai on my phone and i've trained it up to really know me or whatever you haven't trained it up you're not retraining any models here right basically all you did was threw your data in it and let it chew it up if you allow it to chew up that same data on your new phone it should more or less come to the same result or maybe better because it's a new version of the model or whatever but it's not as if you are retraining the model so to speak and it's somehow the model is getting smarter and learning you or whatever you are just feeding it more data into that semantic index thing and that it's reading that or whatever that same process should be pretty much 100 repeatable on your new phone because again like the lms and all their weights and all their numbers or whatever you are not changing those by talking to the llm those never change unless apple releases a new model it's only the semantic index stuff that's there and how did that index get formed it got formed without your intervention it got formed when you were sleeping and your phone was plugged in and it was scanning all your data so as long as that data is over there the semantic index will be over there So I kind of understand why Apple wouldn't copy it.

1:39:17And also, like I said, if they make improvements to that, you want to do the scanning with the new improved system rather than taking the scan that was made with the one year old system and transferring it to your new phone. So that's how I guess this is going to work. Again, we don't know for sure. Apple intelligence hasn't even shipped, let alone had anyone transfer from one phone to another. But I don't, let's put it this way. I think it'll be better than photos because I think photos, there is actual work that you're doing and like a a presentation of all the faces that you don't get reproduced i think with apple intelligence whatever happens on your old phone when you set up a new phone it should all be reproduced because i think there's less manual stuff thanks to our sponsor this week trade coffee thanks also to our members who support us directly you can join us atp.fm slash join one of the perks of membership is atp overtime a bonus topic every week this week's Over time, we'll be talking about rumors of a folding all-screen MacBook, which is, I think, very interesting.

1:40:19So we'll be talking about that. So that's this week's ATP Overtime. If you want to hear us talk about a folding all-screen MacBook this weekend, new topics every week in Overtime, plus other membership bonuses, go to atp.fm slash join to join up and support us that way. Thank you so much to everybody, and we'll talk to you next week. Now the show is over They didn't even mean to begin Cause it was accidental Oh it was accidental John didn't do any research Marco and Casey wouldn't let him Cause it was accidental Oh it was accidental And you can find the show notes at atp.fm And if you're into Mastodon You can follow them At C-A-S-E-Y-L-I-S-S So that's Casey Liss

1:41:41I have a brief life update, I'm happy to share with everyone. Oh, you're doubling your RAM? Yeah, I'm doubling my RAM. Actually, I'm doubling my 5G because as of a few hours ago, I am even more vaccinated than I was before. What? He's got his new COVID vaccine. He's got his new COVID vaccine, is what he's saying. I need to get that, too. Yes. Oh. Yes. Yes, indeed. Did you get a flu shot at the same time? No. In my personal opinion, October is the right time for a flu shot based on no science, no medicine, just an opinion. I mean, there is science, but like there is science about the timing. It's of any of these shots because your immunity is strongest.

1:42:15the i think like the first you know right after you get the shot your immunity is the strongest and it does fade over time so there's a strategy that says wait until you're farther into like cold and flu season to get your flu shot same thing with covid but the thing is especially with covid you get covid tomorrow so yeah it's going to be worse in the winter but if you get it tomorrow waiting was the wrong move but if you don't get it tomorrow waiting was the right you know i mean so and flu i think is more has more of a seasonal bump to it so you can probably game that a little bit better but like i just know so many people have gotten covid lately like the summer has been a pretty big surge and it's out there and it's waiting for you to get it and so i'm gonna get the covet shot immediately i'm also gonna get the flu shot immediately because i don't even bother timing that and i just don't want to have to go back and forth you know what i mean uh to get multiple shots but uh yeah recommended when you're in there getting your covet shot get your flu shot and if you want to wait and take the risk feel free but if you get covered before the shot that sucks because you got coveted and also sucks because you can't get the shot until you've been over COVID for some amount of time too.

1:43:08So not great. Yeah. Yeah. I am. I am stunned that we didn't bring it home from Europe. And I feel like our time is ticking because it's, it appears from what the kids are telling us that like half of their elementary school is out for multiple days at a time. And then occasionally some of them will come back with masks on. And so you put two and two together and you know exactly what's going on. It's only a matter of time so uh here here's hoping that i dodge it at least long enough to get through uh the podcast and then if i come down with it after that so and covet was out there in europe with you a bunch of people who were there got it a bunch of people were there with it and got it while they were there or brought it back and you know it just you dodged it oh it's every like all summer it's been everywhere like we we got it in our in my family we got it in uh may and it's been like everyone has it around here all summer long i just talked to one of my friends here today just is just coming off of it like from the last nine days like every it's everywhere like you know we we like to think that we're like past the era of covid we're not only are we so not past it and not only are we probably never going to be past it um but the only things that are that are really different now is that it's for most people it is less severe to get it now than it used to be because we have some experience with it in our bodies now.

1:44:31But it's still very widespread and still causing problems for a lot of people. And so it's just everywhere. So yeah, definitely get your vaccines. Like, yeah, they're not perfect. They're also a lot better than nothing. So get your vaccines. It's not a big deal. Just please, for the love of God, do what you can to help. Yeah, you read a story. It's like, oh, the vaccine is for a strain that's not even circulating. That's true. but like what the vaccines you know are even if they don't stop you from getting it they make the symptoms more mild and that's what you want like you want every you want every bit of help you can get even if it helps just a little even if it makes you like a little bit less because there is still the possibility that you're going to have a bad experience or get long covid like that is still happening to people like we benefit from quote unquote benefit from the fact that a lot of the people that covid was going to kill it has killed like millions right so those people are dead And, you know, and the people who are still here are the people who didn't die or didn't catch it.

1:45:24And we all have lots of vaccines and that makes the symptoms less severe. But, yeah, it's just not not a thing that you want. Same thing with the flu shot. Do they guess right on the strain or whatever? It's just like every little bit helps. Right. And, you know, the studies say it does help. It does help if you've gotten vaccine vaccinated. It does help if you've gotten vaccinated recently. And it does help if you've gotten vaccinated recently with the strain that is somewhat close to the one that's currently circulating. So just do it. Yeah, that's highly recommended. And same thing with flu shot and any other vaccines that you might be overdue for when you visit your doctor.

1:45:59Yeah, I mean, honestly, like one of the I wouldn't necessarily it's hard to say like upsides, but, you know, a silver lining of all of this is that it seems like in recent years as part of the covid vaccines ramping up, it seems like getting almost any vaccine has gotten a lot easier because like the like, you know, major drugstore chains now have not only, you know, they they had flu before, but not in, I think, the numbers they have now. and most people weren't thinking to go and get it as much as they are now, especially younger people. Now you can go to any drugstore in the U.S. at almost any time you want and get a COVID shot.

1:46:38You can get a flu shot. You can get other commonly needed shots like HPV that a lot of people should be getting. It's so easy now to get access to so many vaccines that are just in drugstores, widely available for little to no money. It's actually, to have built up all that infrastructure now is quite an upside. And if you have a primary care doctor and you do annual visits, that's also a great time to do it. Time your annual visit for right before flu season. You will get a flu shot when you go into the office. They'll have it there. It'll, you know, just make sure it's out by the time you go and get all your vaccinations.

1:47:12It's very convenient.

From the publisher

Sponsored by:

  • Trade Coffee: Coffee at home, made better. Get your first bag free!

Become a member for ATP Overtime, ad-free episodes, member specials, and our early-release, unedited “bootleg” feed!

More from Accidental Tech Podcast

All 184 episodes
602: A Glimpse of a Better WorldAccidental Tech Podcast · 1 h 47 min
Listen in VO