#721: AWS News: Amazon Nova Premier takes on complex tasks and model distillation, and more

0:00This is episode 721 of the AWS podcast, released on May 19th, 2025. Hello everyone and welcome back to the Adibus Podcast. I'm Lish here with you. Great to have you back. And I'm joined by one of my two co-hosts, Jillian Ford, is the second availability zone today. Good day, Jillian. How are you going? Well, this second availability zone is super excited for today's update show. What about you, Simon? That is the way. I'm also fired up and ready. Less sick than in previous episodes, which is always good. So I don't have my radio voice anymore, but I can actually think clearly. So that's helpful.

0:35And speaking of thinking clearly, probably our highlight or top story today is the release of Amazon Nova Premiere, which is now generally available. This is our most capable multimodal model. Say that three times fast. It's useful for complex tasks and also as a teacher for model distillation as well. There's lots of cool things about it. But Gillian, what leapt out at you in terms of its capabilities that might be handy for our listeners? Yeah, I'd say it was a great call out on just the model distillation there where Nova Premier would be the teacher. And then you would use one of the other Nova models within the Nova family as the student model.

1:15And then you could be able to get a wonderful performance and intelligence, but also with a smaller model and a lower price point. So that's always really cool. But in addition to that, I think the improved agentic capabilities, that is a lot of people are thinking about agents. and Nova Premier can perform end-to-end actions on behalf of the user. This could be use cases like RAG, function calling, and agentic coding. What stands out for you? Yeah, for me, I think I like the context window, million token context window. I'm lazy. I'm a big fan of a big fat context window that I can just jam full of stuff and have the model do stuff.

1:57I know that's not the best way to do it, but it can be a useful way until you then have to, you know, chop stuff up. Because at the early stages of LLMs, I was doing a lot of chopping of files and stuff to make them fit the context window. And now I don't have to do that, which is good. I think everyone was agreeing with you on that. Like, yes, like, they're totally guilty. I just want like the largest LLM and just like to. Just let me cram as much as I can. Yeah. The other thing that left out of me is the price. it's typically half the cost of sort of comparable models. And you can argue comparison until the cows come home.

2:32We can talk about benchmarks and stuff like that. And this has some great benchmarks, but the price is right, which is less. Because it's interesting, as I'm seeing people adopting Gen.AI, obviously, it delivers value, but it also comes to the cost. And so managing that, I think, is important too. Totally, yeah. I'm definitely excited, especially as people are thinking about But overall in their entire architecture of cost optimizing, this is just one important area that you can look at as well. So model choice is a really great call out. True, true. Let's jump into it. Let's talk analytics. Amazon MSK managed streaming for Apache Kafka now gives you seamless certificate renewal for all MSK provision clusters, which means that your brokers in your clusters get the most up-to-date certificates for their encryption without going through a restart.

3:22This is a big deal because if you've ever done certificate rotation, it's painful. And if you get it wrong, everything stops working, literally stops working. The encryption certificates used by Amazon MSK require renewal every 13 months, which is good security practice to actually refresh and change your certificates. And now it does it seamlessly without disruption to client connectivity. So kudos to the team for that one. AI Search Flow Builder is now available on the Amazon Open Search service. so this is for anything 2.19 plus domains. So this lets you design and run your AI search flows through a low-code experience without custom middleware, and it means you can get up and running really, really quickly.

4:03And speaking of versions, as I mentioned, OpenSearch Service now supports OpenSearch version 2.19. This has lots of improvements in the area of vector search, observability, and also in terms of dashboards as well. AWS CleanRooms now supports multiple results receivers in a collaboration. So you don't need to have external audit mechanisms to control collaboration. It means that multiple members can receive and validate the analysis results from queries across collective data sets directly from the collaboration. So again, a lot of undifferentiated heavy lifting being taken away there. And Amazon Kinesis Data Streams now supports tagging and attribute-based access controls for consumers.

4:41So this allows you to decide who gets access to what. It also lets you apply tags for allocating costs and simplifying permission management for your enhanced fan out consumers as well. Now on to everyone's favorite topic, artificial intelligence. Amazon SageMaker Catalog introduces authorization policy for asset type usage. So this is a new governance capability that gives organizations fine grain control over who can create and manage custom assets using specific asset types. Amazon SageMaker HyperPod now integrates with Amazon EventBridge. And this enables you to receive near real-time notifications about changes in your cluster status.

5:27Which notifications, you're probably wondering? Well, there's actually two. So the first is cluster status change events. So when your HyperPod cluster transitions between states, such as in-service or failed. And the second is node health events that notify you when nodes change health status like they're healthy or unhealthy or are automatically replaced during recovery from failures. You can also write simple event bridge rules to trigger automated actions when these events occur. AOS announces significant enhancements to Amazon Q developer in Amazon SageMaker AI JupyterLab, introducing customization of code suggestions based on private code repositories and the ability to include entire workspace context for improved code assistance.

6:16These new features empower organizations to leverage their proprietary code and improve the relevance of code suggestions, ultimately enhancing developer productivity and code quality within JupyterLab environments. I don't know about you, Simon, but I'm going to admit, QDeveloper has turned into my favorite AWS service that has a forever free tier. What about you? Yeah, I have a lot of fun with it. I'm using the QChat, so that's the CLI version of it. That suits my workflow. I'm in it 24-7, basically. It's just working hard. And again, I love that team that develops that particular solution because they iterate really fast.

6:58Like almost every time I restart it, there's some new feature or interface you can use. Vim or Vi or whatever, Nano, whatever you want to, you know, create stuff inside it as well. So it's, yeah, it's, if you're not coding with, I'm not even going to say just with QDeveloper, of course, QDeveloper is my favorite, but if you're not coding with some assistance from Gen AI, you're just missing out. Oh, I heard about that. And I've heard it described as it's like, you know, speaking with a megaphone. You know, you still got to speak, but the megaphone makes it a lot easier. 100 % yeah. Amazon SageMaker now supports direct connectivity to Oracle, Amazon DocumentDB, and Microsoft SQL Server databases, expanding the available data integration capabilities in Amazon SageMaker like House.

7:47Amazon SageMaker now offers a unified scheduling experience for visual ETL flows and queries. Amazon SageMaker now offers 14 new built-in visual ETL transforms. There is a whole blog that talks about them. I'm not going to read every single one, but there's a lot that look really useful. Yeah, a lot of good stuff there to make it just easier, which is good. Easier, yes. And more things that are now easier. Bedrock Data Automation now supports extraction of custom Gen.AI-powered insights from audio by specifying the desired output configuration through Blueprints. Amazon and Bedrock Model distillation is now generally available.

8:30We already talked about this, but I'll give the primer for those who maybe aren't familiar with it. So this is the process of transferring knowledge from a more capable model, also referred to as the teacher model, to a less capable one, also referred to as the student model. The goal is to make the faster and cost-efficient student model as performant as the teacher for a specific use case. This is generally available, so now we're able to support the following models, the Nova models, Cloud 3.5 Sonnet version 2, Lama 3.370B, and Lama 3.2 1B slash 3B as the student. AWS Health Imaging announces two enhancements that make it easier to manage diverse medical imaging data in the cloud.

9:19So the first one is Health imaging now supports video data. These are encoded per the DICOM standard. And with this launch, video data can be stored in a health imaging data store alongside still image data. And the second is health imaging has added support for retrieving lossless images in the JPEG 2000 lossless format. The service supports retrieving both DICOM instances and image frames in the JPEG 2000 lossless format. AWS announces the preview of the Amazon Q Developer integration in GitHub. Amazon Q Developer in chat now supports AWS Systems Manager just-in-time node access approvals from Microsoft Teams and Slack.

10:04AWS customers can now monitor node access requests and approvals from chat channels to enhance security posture and meet compliance requirements. Amazon Q developer announces a new agentic coding experience within the IDE that transforms how you build software. The new experience redefines how you write, modify, and maintain code by leveraging natural language understanding to seamlessly execute workflows. One of my favorite use cases, and of course, I'm a solutions architect, so this is why it's my favorite, is when I talk to customers, I will send them instructions for how to install the draw.io extension for Visual Studio Code.

10:44And then I'll send them instructions on how they can use the free diversion of QDeveloper to be able to have Q automatically draw an architecture diagram. It's like so brilliant. Super cool. I like that too, in terms of, especially if you're picking up some code base that you're not familiar with and say, how does this work? Exactly. Just do it for us. It's really cool. Let's talk business applications. Amazon Simple Email Service has now launched support for SES Outbound sending endpoints over IPv6. So the IPv6 March continues. And Amazon SES Mail Manager now supports a published to Amazon SNS topic rule action.

11:27So this means you can now notify with the complete email content and it also has options for SNS topic and encoding. So this means you can track what's going on. AWS B2B Data Exchange also now supports IPv6 on B2B Data Interchange Service APIs. So again, you can migrate from IPv4. And an update for cloud financial management. The payments account summary provides an overview of AWS Financial Account Balances now. So this lets you view your account's financial status more efficiently. Critical account balance information is summarized in a single easy access location on your payments page. A quick update for compute.

12:06AWS Elastic Beanstalk adds controls for default security group management. So this gives you greater control over your network access and security configurations. And a bunch of updates in the world of contact center. And so let's move through them because there's lots here. They've really been busy for customers. Amazon Connect now supports audio optimization for Omnisia cloud desktops. So this is a Omnisia virtual desktop environment type capability. Amazon Connect external voice pricing changes have now altered. Basically, the new pricing models have independent pricing for external voice connectors and external voice minutes and are effective for all customers from May 1st.

12:47There's a link in the show notes about what these all mean. Amazon Connect for WhatsApp business messaging and SMS is now available more broadly in a number of different regions. I know a lot of folks use WhatsApp business as a communication mechanism. Amazon Connect Outback campaigns now supports Poland. So this increases, again, the reach of those particular campaigns. Amazon Connect now publishes post-contact completion events to contact event stream. This is via Amazon EventBridge. So it means you can get real-time insights into when a contact is fully concluded, including the completion of any after-contact work.

13:22So this means you get that full lifecycle visibility into customer and agent interactions. It means you can understand that a ticket is really closed because it's really, really been done. Amazon Connect has added enhanced contact information to the Describe Contact API, so you can take smarter and faster actions when you're doing things. So you can get new insights like disconnect reasons, recording status, after contact work time and custom contact attributes all in one call. They've also added five new metrics and dashboard drill downs for outbound campaigns so you can get more information as well.

14:00And also Amazon Connect Contact Lens has launched a new real-time adherence dashboard. So this means that supervisors can apply filters on adherence status, duration and percentage and do all the sorting and management, etc. So for example, a supervisor can highlight agents who will be falling behind schedule for more than five minutes, quickly identify breaches and notify the agents accordingly. So that means I can coach them and they can just simplify that process of making sure they're optimizing their call center. They've also launched administrator access for agent schedules so you can address key operational needs with minimum configurations.

14:35And it now supports bulk removal of agent schedules as well. So with this launch, you can remove schedules for up to 400 agents for a single day or up to 30 days for a single agent. So you can make big shifts real quick. I'm so impressed with the Connect team. Every single time, it feels like they've got so many updates. They're bringing it. They really are. One quick update in containers. Amazon ECS announced a new feature that allows you to easily roll back your ECS service to a previous safe state if a deployment fails. This sounds super useful. Look, not being someone that ever makes a mistake, but if I did make a mistake, this would be really handy.

15:16Yes.

15:19Now on to database. There's a new open-source Adibus Advanced Postgres ODBC driver, which is now available for Amazon Aurora and RDS. The database driver provides support for faster switchover and failover times, Aurora Limitless, and authentication with Adibus Secrets Manager, AWS Identity and Access Management, or Federated Identity. There's a very cool new thing. I'm very interested in this particular license. Oh, why's that? I think it's going to help improve the switchover speeds. Basically, it takes you from tens of seconds to single-digit seconds. And if there's one thing I've learned is that when a database is down, everyone's having a bad day.

16:07And if you've got a database that can switch over, people obsess with how quickly you can switch over. And I think the team realized they had to make something that would really optimize that. So it's there. and it's under the Library General Public License as well. So nice version there. Yeah, for sure. Those are great call-outs. I'm excited as well. RDS for Postgres now supports the latest minor versions 17.5, 16.9, 15.13, 14.18, and 13.21. Is this where I say the famous words, patch your stuff? Oh my gosh. I've been waiting for you to use one of those like... Finally, finally I brought it to the table.

16:54We'll see if it sticks out on our day.

16:59Amazon Aurora now supports Postgres Major version 17. Amazon Aurora Postgres Limitless database now supports Postgres 16.8. Amazon RDS for Oracle now supports Oracle Application Express version 24.2 Amazon Neptune now supports Graviton 3 R7G and Graviton 4 R8G instances and one quick update I was just gonna say a quick reminder always look into whether you can use Graviton because typically it's a win. It really is. Yeah. Especially as people are looking at how can they holistically cost optimize their architecture short-term and long-term, like Graviton is just like a no-brainer for sure. Particularly with the hosted services where it's just like literally you're clicking, hey, I want to use Graviton.

17:57Great. Done. Yep. And there's one quick update in developer tools. AWS CodePipeline now enables you to use AWS Secret Manager credentials in your command actions by specifying the secrets as environment variables in the action declaration. Let's talk management and governance. AWS Systems Manager has added customization options for onboarding configurations. So this is a new systems manager experience, which allows customers to choose to enable or disable default EC2 instance permissions, set the frequency of their metadata connection, and define how often the SSM agent automatically updates, along with a bunch of other cool customizations.

18:39Amazon CloudWatch RUM adds support for interaction to NextPaint or INP WebVital. This is a crucial metric that helps customers measure the latency of a page's response to user interactions, offering insights into the end user experience of their web application. So IMP is a metric that assesses a page's overall responsiveness to user interactions, and it observes the latency of all click, tap, and keyboard interactions that occur through the lifespan of a user's visit to a page. and basically the final value is the longest interaction observed ignoring outliers and this helps you optimize your customer experience.

19:22Amazon CloudWatch Network Monitoring has added a multi-account support for flow monitors. So flow monitors give you near real-time visibility of network performance for workloads between instances like EC2 and EKS and S3 and RDS and DynamoDB. By integrating with AWS organizations the flow monitors now are to monitor network performance of your workloads that span multiple accounts. Amazon CloudWatch has launched tiered pricing and additional destinations for AWS Lambda logs. The new tier pricing is effective immediately, requiring no code or configuration changes. As an example, the US East North Virginia Lambda logs to CloudWatch pricing starts at 0.50 per gig, tiering down to 0.05 per gig.

20:09and CloudWatch now supports Amazon S3 and Amazon Data Firehose as Lambda Log delivery destinations as well. And the AWS Launch Wizard now automates multi-node SAP NetWeaver deployments on SAP ASC databases as well. So if that's a world that you live in, this gives you a guided way of sizing, configuring and deploying your SAP application. All right, I'm going to admit that networking is my least favorite topic, but there are two updates to networking that I'm actually excited about. So the first is Amazon VPC Reachability Analyzer now supports resource exclusion. So this allows you the ability to exclude network resources when analyzing reachability between a source and a destination.

20:59And this is gonna provide you with greater flexibility if you need to run reachability analysis. So now what you can be able to do is identify an alternative path in your network. So when would you want to do this? Like, let's say you want to identify any path from your internal gateway to an elastic network interface that is not passing through the network firewall for inspection. You can specify network firewall under resource exclusion and run the reachability analysis. And then if the analysis returns a reachable path, you know there's an alternative path in your network and you can take required actions.

21:37This seems like it would save someone a lot of time. A lot of time, yes. Someone's going, yes! And one more on that vein is Amazon VPC IPAM now allows cost distribution to AWS organization member accounts. So this is going to allow you to easily allocate costs to your internal teams for their IPAM usage. So VPC IPAM, this makes it easier for you to plan, track, and monitor IP addresses for your AWS workloads. So when you enable IPAM for your AWS organization, IPAM aggregates the organization-wide IP address range and charges the AWS account in which IPAM is created. So now with this launch, you can allocate the charges directly to AWS organization's member accounts for their individual usage.

22:31And I really like this because as a lot of people have more and more accounts, and especially if you're going from that one-to-many journey, the networking part gets really confusing. And so this is just something that I think that can help people as they're navigating one-to-many, which can become maybe one is a few, and then it could be hundreds. It becomes a lot. Yeah, exactly. And there's one quick update in the Marketplace category. AWS Marketplace now supports SaaS products that are deployed on AWS or other cloud infrastructures and on-premises. This will allow independent software vendors to list more SaaS products in the AWS marketplace, which offers customers a broader selection of products.

23:19Yeah, it's a pretty cool improvement because it means, I know for a lot of customers, buying from the marketplace makes it super easy. Yeah, it does. Software they need. And now they can deploy to multiple locations, so not necessarily on AWS. But just so you know, there is a new tag or a badge that's called deployed on AWS. And basically anything that's 100 % deployed on AWS infrastructure, be it through SaaS or on AC2 or EKS, et cetera, it'll show you that. So you can understand that you've got that particular quality to that deployment. Yeah, I think so, especially as a lot of organizations want to make sure that the software that they deploy in their environment is going to have a strong security posture and operational excellence.

24:04This badge is just like that stamp of approval. Yeah, you've got to look for the badge. Let's talk about the topic of security, identity, and compliance. AWS Resource Explorer supports 41 new resource types, including AWS CloudTrail, Amazon Connect, Amazon SageMaker, and lots more. And Amazon Verified Permissions now supports policy store tagging. So as you know, I'm a big fan of tagging stuff. And so this launch enables Verified Permissions customers to use tag-based controls to manage access to their policy stores. So for example, you can now tag a policy store for a tenant and you can use IAM permissions to restrict that to that policy store accordingly.

24:45So lots of opportunities there. You can also use the cost allocation tags too. AWS WAF is expanding the availability of its enhanced rate-based rules feature across multiple regions. So this is continually expanding. Basically, you could already use WAF-based rules to automatically block requests from IP addresses that make large numbers of requests from a short period of time. until that rate falls below a customer-defined threshold. Now WAF customers can aggregate requests by combining IP addresses with other request parameters, so keys, and supported keys include cookies and other request headers, queries, strings, or arguments, cookies, label namespaces, HTTP methods.

25:25Basically, you can see if someone is doing something trying to sort of hide amongst lots of stuff, you can aggregate it together, which is nice. Amazon Cognito now allows you to include additional contextual information in the OAuth 2 client credentials flow for end-to-end access token requests. So this is machine-to-machine based interactions. End-to-end authorizations commonly used for automated processes like data sync, event-driven workflows, and microservice communications. This capability lets customers provide context-specific details. So things like the IP address of a machine or a location or environment or a business context like an application name or a tenant ID when requesting access tokens for machine-based interactions.

26:10So this helps you, again, improve the security posture of what you're doing. Now let's move into storage. One quick update for storage, but an important one. Amazon EBS announces provisioned rate for volume initialization. So this is pretty cool. This feature helps you create fully performant EBS volumes from Amazon EBS snapshots with predictability, helping speed up your EC2 instance launches at scale. Particularly this is used for data disaster recovery and volume copy workflows. So with provisioned rate for volume initialization, you can launch hundreds of instances from EBS-backed AMIs at the same time and know that the attached volumes will be fully performed within a predictable amount of time.

26:54So this minimizes the amount of time before those workloads could fully utilize the underlying storage. So you use this feature by specifying a volume initialization rate when creating new volumes from snapshots, launching new instances from your EBS-backed AMIs, replacing root volumes of instances, and just provisioning volumes using the EBS container storage interface driver. You can also specify the rate of volume initialization in launch templates, applying the same rate to all launched instances in that template. This is a big deal because the amount of engineering that it takes to make sure all these things work at a particular rate is immense but more importantly i know for a lot of customers they want to get the full performance out of the ebs volumes very very quickly and as you know it can be lazily loaded over time this is one of the things we used to talk about a lot back in the day when ebs was new that it can take time as those things are provisioned this overcomes that and gives you the full full rate straight away, which is pretty impressive, I would say.