SED News: The NVIDIA-Hugging Face Deal, China’s Proxy Economy, the Open Weight Surge

8 Sep 2026 · 52 min · 19 chapters

Ask about this episode

Ask anything about it. ChatGPT or Claude reads this page and answers with the times it was said.

Connect VO and ask about every podcast you hear, including the moments you saved. Add to ChatGPT · Add to Claude

In short

Tech and AI M&A/raises plus an in-depth look at China’s “proxy economy” enabling cheap access to frontier models, and how that fuels the open-weight model surge (distillation from proxy logs). Also covers NVIDIA–Hugging Face, Dynatrace–Arize, Temporal’s rumored funding, OpenAI hiring InstantDB, Jeff Dean’s departure, and AI security/agent infrastructure funding.

Guests

Gregor (host, Software Engineering Daily) and Sean Falconer (co-host; travels for work, kids back in school; attending Superbase conference in Oct; previously covered Temporal).

Key claims

NVIDIA’s $12.9B Hugging Face buy is about owning distribution/community to accelerate model usage. Dynatrace’s $915M Arize deal consolidates AI observability into enterprise observability. China proxies (“one fish, three meals”) bulk-register accounts, “model swap” to cheaper models, and monetize request/response logs for distillation and training. Open-weight quality rises because proxies provide teacher outputs and human traces.

Notable examples

20M developers/3M models on Hugging Face; Arize agent hallucination scoring/monitoring; Temporal durable execution for AI agents; InstantDB team joining OpenAI; Jeff Dean leaving Google to start Discovery Loop; Hidden Layer AI security ARR “tens of millions”; Instinct.ai $250M Series B; Owner.com $240M Series D.

Written by AI. May contain mistakes. Listen to the episode to check what was said.

Chapters

Tap a time to open that second in VO

Catch-Up and Conference Preparations

0:45 to 2:36

Hosts discuss their recent activities and the upcoming conference schedule.

“But yeah, so yeah, Sean, what have you been up to?”

End of Summer and M&A Activity

2:36 to 3:41

Discussion on the end-of-summer vibe and the increasing M&A activity in tech.

“But yeah, it's been sort of announced for about 12.9 billion.”

NVIDIA-Hugging Face Acquisition Insights

3:41 to 5:00

Analysis of NVIDIA's acquisition of Hugging Face and its implications.

“I did just actually jump straight to the Hacker News comments on this one to begin with.”

Arise Acquisition by Dynatrace

5:00 to 7:27

Discussion on Dynatrace's acquisition of Arise and its market impact.

“And then they also are sort of owning the community layer.”

Temporal's Growth and Future Prospects

7:27 to 10:10

Exploration of Temporal's planned fundraising and its significance in the AI landscape.

“although I see their billboards around the San Francisco Bay Area, they are in the AI observability and evaluation platform space.”

InstantDB's Role in OpenAI's Strategy

10:10 to 14:00

Examination of InstantDB's acquisition by OpenAI and its strategic importance.

“It probably would have been hard for them to kind of end up in some crazy multiple in the billions.”

OpenAI's Acquisition of InstantDB

14:00 to 15:00

Learn about OpenAI's acquisition of InstantDB and its implications for developers.

Jeff Dean's Departure from Google

15:00 to 18:00

Discover the significance of Jeff Dean leaving Google after 27 years and his new venture.

“But we shall see if there's a better version of this.”

The Impact of Jeff Dean on Google

18:00 to 18:30

Reflect on Jeff Dean's monumental contributions to Google and the tech industry.

“And maybe there's a certain marketing angle to that to kind of save face and all this when you have such a high profile person leaving.”

Jeff Dean's Departure from Google

19:23 to 19:50

Discover the significance of Jeff Dean leaving Google after 27 years and his new venture.

“No separate tool to switch to, no dashboard to babysit, security that fits how you actually build.”
Show all 19 chapters

Hidden Layer's Successful Funding

21:31 to 24:08

Examine Hidden Layer's recent funding and their focus on AI model security.

“So back to just, I guess we called it M &A and it's more just A &R, acquisitions and raises.”

Instinct.ai's Rapid Valuation Increase

24:08 to 28:00

Analyze the high valuation of Instinct.ai amidst the competitive AI personal assistant market.

“On Hugging Face, I must say, I'm not fully, I don't go into Hugging Face a whole ton these days, but I remember when using it, it was still kind of confusing at least back, I don't know, a year and a half ago, two years.”

The Rise of Backend AI Solutions

28:00 to 30:45

Exploring how unsexy backend companies are thriving with AI.

“So kind of almost the anti to instinct in this case.”

Emerging AI Models and Safeguards

30:45 to 32:46

Discussion on new AI models and the importance of safeguards.

“And then now, woken up this morning, what do we have this morning, Sean?”

China's Transfer Economy and Open Weight Models

32:46 to 39:18

Analyzing China's proxy economy and its impact on AI model development.

“Something that then popped up in my, actually from a friend sending me an article about what's called the transfer forestation markets in China.”

Implications of Proxy Access for AI Development

39:18 to 42:00

Exploring the implications of proxy access on AI model training.

“Yeah, it makes the idea of models are banned.”

Exploring China's AI Landscape and Meta's Role

42:00 to 45:50

Discussion on the implications of China's AI strategies and Meta's positioning in the open weight model market.

“the way the Chinese government thinks like, oh, we don't want users to have access to this, but clearly they are very powerful and very helpful.”

Insights from Hacker News

45:50 to 50:06

Highlights from Hacker News articles discussing intelligence versus cost in AI and the concept of invisible companies.

“And one of the things they point out is that the chart uses a log scale, which visually ends up flattening the actual massive price gaps.”

Future Predictions for AI and M&A Trends

50:06 to 51:48

Predictions on future trends in AI, company consolidations, and funding in the tech landscape.

“And then some collection of them have probably done really well and they're going to raise money and so forth.”
Hear the part that matters, and keep it.Open this episode in VO. Double tap your headphones to save a moment as you listen.
Get VO free

Transcript

Automatic transcript. May contain errors.

0:11Gregor Vand:Hello and welcome to SED News. This is the monthly format of Software Engineering Daily where myself, Gregor, and we also have Sean Falconer. Hey, Gregor. Yeah, we have the two of us taking you through a spin of the main tech headlines. We then dive into a deeper topic in the middle. And then we finish up with Hacker News highlights, where we pick some of our favorites from the last couple of weeks as well. But yeah, both Sean and I have been super busy. So that's why this release is going out, I think, about a week later than it should. So apologies to anyone that was hoping to see one last week.

0:47Gregor Vand:But yeah, so yeah, Sean, what have you been up to? Other than the usual road warrior travel schedule, school started again for my kids. So my kids are back in that routine. So we're kind of back in the thick of it. And I'm a little bit nervous because my summer has been, there's been so much travel involved and we haven't even hit like conference season yet. I'm like, oh my gosh, I don't know what's going to happen at that point. But it has been a great time this summer. And I'm glad that we always figure out a way to make these sessions work, which I really enjoy. So despite us living on opposite sides of the world and sometimes having busy work schedules where you're able to find time to do this.

1:23Gregor Vand:Yeah, absolutely. For anyone interested, yeah, it's Sean's 4 p.m. right now, my 7 a.m. over in Singapore. Yeah, so yeah, but this seems to be the slot that works. Yeah, exactly. Yeah, no, on my side, yeah, talking of conferences, yes, we've got the Superbase conference coming up at the, I think, 2nd of October. So yeah, this is just crunch month, especially for that. Anyone that's maybe familiar inside a tech company that has their own conference, it becomes a pretty huge deal. Sort of all eyes on that. Unfortunately, though, there are always other things. Other things that come up. It's not like your day job stops.

1:58Gregor Vand:No, exactly. It's like conference crunch plus all the other things. Yeah, ours is coming up in two months too. So people are heads down on that right now as well. And they have been for months probably. Yeah, exactly. Exactly, yeah. So yeah, I did actually go to Stripe, do their, like a kind of, as a few companies do, they kind of have their headline conference at usually in the bay area or the us at least which striped it in may and then they do like a sort of world tour where they hit some of the bigger cities around the world like london for example but singapore does get them which is great like we sort of singapore tends to be the hub for asia for these kind of world tour conferences so went to stripes conference here and caught up with the folks there which was yeah pretty super interesting and some of our other team were like on the stage talking about things so yeah exciting times but yeah let's roll into the headlines we're doing a slightly different one this month which is sort of an end of summer special yeah i also feel like it's definitely end of summer just the sort of feeling of end of summer even though it's very still very hot in a lot of parts of the world and etc but end of summer special of sort of mna that's been going on so mergers and acquisitions there has been a lot there's been a lot of activity we didn't cover a ton of mna through the summer actually no that wasn't happening just we just didn't focus on it too much so yeah this is kind of fun yeah i think talked about any scale and scale oh yeah yeah and uh any scale and scale scale scale ai scale but no i don't think we're gonna touch on them today we've got far more things that we can touch on which is great yeah i think the as i was going to bed last night yeah the news was dropping that nvidia were definitely definite as it can be but definitely buying hugging face this this had been rumored, I think, last week.

3:41Gregor Vand:But yeah, it's been sort of announced for about 12.9 billion. So yeah, this is kind of interesting. I did just actually jump straight to the Hacker News comments on this one to begin with. And of course, a lot of, we'll get into in a second, what is hugging face? I mean, for anyone that doesn't know, etc. But I think a lot of the community comments were, oh, they're just gonna, they're doing this so that they can piss off the big frontier model people, basically. But I think that was a bit of a hot take from some of the hacker news yeah yeah i don't understand why in video would want to do that because they make a lot of money from those people in my mind like it's really i mean i guess if you don't know what hugging face is it's it's become really like the default hosting and distribution layer for sort of not open ai but open sort of ai models and they have a lot of developers there's almost like 20 million developers there and there's over 3 million models and there's data sets and all kinds of stuff on there and actually funny enough i had my first ever blog post published on hugging face this week so in some ways i give myself credit for you know this acquisition going through but you got out of the line that's basically what you're saying yeah i gotta i'm waiting to see my share of the 12.9 billion but but yeah i mean i think that potentially this is a way that they can own essentially distribution of the hardware that all these models are going to run on and And then they also are sort of owning the community layer.

5:03And I would think, you know, if you think of a company like Google, especially in the early days, you know, a lot of the moves that they made where sometimes they would give away particular pieces of software or they gave away like Android operating system. It's because it was in their best interest for more people to be on the Internet. Because the more people are going to be on the Internet, then being like the front door of the Internet at that time, it's more search, more ads, more revenue than it's like flywheel spin. So they could afford to give away stuff because in a lot of ways, it's like a customer acquisition channel for them.

5:33And I think you could kind of, you might be able to make a similar argument here where the more people who are building models, using models, running models is ultimately great for NVIDIA's business. Because the more that happens, essentially, the more money they make. So why not?

5:49Gregor Vand:Yeah, absolutely. And yeah, I mean, when I said sort of pissing off the big frontier models, I mean, that is a very hot take. it's more sort of a hedge really it's like which could be construed as pissing off but busy saying hey we don't that's what i think people are also looking at if they get too much completely interlocked with the circular financing and so on but there is a whole world out there that has nothing to do with the frontier model creators and that basically all most of it lives lives on hugging base so then it does make a lot of sense for nvidia to to be very much there and make sure it doesn't get i don't know bought by somebody else or because clearly they were open to acquisition so who else could have bought this probably quite a lot of people so yeah i mean it's probably a great landing for hugging face because i don't know i think the acquisition was really about buying essentially a community of users and it was you know buying a net new revenue stream or something like that right yeah yeah that also makes sense yeah let's see we did actually have hugging face on the podcast on an episode i think it was last year sometime so go check that out as well but yeah very very interesting huge huge move and slightly unexpected i think i think when it was rumored last week it definitely came as a surprise to people but yeah hopefully nvidia is a good home for them as opposed to any other company that could have come along and done this so yeah okay so moving on to another acquisition arise is that how you say it yeah that's right nice okay so yeah arise that's i think you've been covering this one sean yeah so dynatrace obviously signed an agreement and acquire a rise for a little bit under a billion dollars, so$915 million.

7:26And if you're unfamiliar with a rise, and which probably a lot of people are, although I see their billboards around the San Francisco Bay Area, they are in the AI observability and evaluation platform space. So if there's other companies in the space like Fiddler and Galileo, there's a whole host of them. But really, like some of the core capabilities around like tracing LM apps and agents, what they're actually doing at runtime, detecting hallucinations, scoring that output, monitoring model agent behavior and production. Like this is a huge space. Like it's very hard, especially when you're running agents or multi agent systems at scale and enterprise, like just having like visibility into what they're doing.

8:02And then if you're in a regulatory or regulated industry, you also need to know what they're doing to apply with certain regulations and so forth. So essentially they're in that space, but the acquisition makes a lot of sense. Like, I don't think there's a world where agent observability is like a separate category of product over traditional application observability. Like eventually these things are just going to merge because like a business, an enterprise doesn't want to have two different observability platforms that have to run for the software anyway. Like they much rather deal with one vendor.

8:32So Dynatrace is one of the well-known players in observability for applications and infrastructure services. So adding this to their that makes a lot of sense. And I think one of the things that will be interesting is part of Arise's differentiation was being kind of vendor neutral and being able to plug into any model or framework. And I think one of the concerns I've seen people raise is, will they continue to be neutral now that they're part of this larger entity of Dynatrace? And will that mean that they'll bring some of that stuff, be less essentially neutral in terms of the way that they work?

9:07I have no idea, but that's kind of like one of the concerns that was brought up. But I think we're going to see a lot more of this consolidation. Obviously, there's a huge amount of M &A activity going on right now. But I think there's a lot of sort of moment in time AI companies right now or genres of AI companies where they're solving an important problem, but it's hard to create like a really truly large business on a specific problem. So either they have to grow into something bigger, like more of like a bigger platform or they'll get absorbed essentially by existing platforms and from adjacent areas.

9:40Gregor Vand:How old did you say Arise was? They're pretty young. I think their last fundraise was in 2025. They did a Series C for like 70 million or something like that. So they haven't raised that much money. So pretty great. I'm sure they were, everybody that works there is probably pretty happy because they, I don't know exactly when they started, but I would imagine they're too old. I could probably look it up, but they probably haven't sunk that much time into something and they haven't raised that much money to get almost a billion dollar exit. Yeah. So they were officially founded in 2020. So yeah, especially in this space.

10:10Gregor Vand:Yeah. It probably would have been hard for them to kind of end up in some crazy multiple in the billions. So yeah, this does feel like a nice landing for them. Yeah. And I'm sure they were probably at a place where, I mean, I don't know. I'm just kind of guessing, but like the, given that their fundraise was over a year ago, they were probably at a place where do we go for another funding round, which would probably need to be a fairly large round. And then you're kind of cutting off an exit like this at that point. And you're signing up for potentially another like six years on this journey to get to like something really big.

10:44So you're cutting off a lot of the potential exits and landings. And then on top of that, you're signing up for another half decade commitment to the company. And sometimes that just maybe doesn't make sense. Like it might be overall like a better outcome for everybody. and I'm sure they'll still be able to continue to work on like the vision of what they're doing in the company just within a larger organization that can better support it yeah so yeah next one

11:07Gregor Vand:is Temporal so again that was you're covering that one Sean yeah so Temporal they've also been on SED I interviewed their CTO a couple years ago they might have been on multiple times even at this point but so this is not them being acquired but right now the rumor is that they are looking to raise$500 million at at least a$12 billion valuation. So nothing's closed yet. It could all, of course, change, but that's the rumor that's out there. And that's more than double the$5 billion valuation they had just six months ago where they raised$300 million Series C. So if you don't know Temporal, they are an open source, durable execution platform.

11:46They also have a cloud managed offering for this. But it lets essentially developers write long running multi-step workflows that automatically can survive crashes and retries and timeouts and failures without you having to do state management and retry logic all yourself. If you look at a lot of companies, they'll have some either hand-rolled or some version of durable execution. Sometimes it's temporal, something else. But they're originally really popular for things like payment processing or fulfillment pipelines where you don't want that thing to fail. But AI has been this huge tailwind in this space because AI agents are essentially inherently long-running multi-step processes that are also very failure prone.

12:29And you don't want to, every time it fails, have to start it all over again and then repay for those tokens. So having something like a temporal to be able to pick up basically where you left off and retry and handle all that logic for you without you having to do it yourself is really makes a lot of sense. I think this concept of durable agents has been a real tailwind for Temporal. And in a lot of ways, they've been at it for quite a long time. It's one of those companies where it's like overnight success, but 10 years in the making. They basically created, I think, this category of durable execution.

13:01They put in a lot of hard work to kind of grind. They did a really good job of getting into some of the big Bay Area digital native companies. And I think that they were successful there and essentially developers would leave and they would bring that technology to the next company and they got eventually they got enough word of mouth network effects where they just now actually kind of almost like getting this like viral growth from it because they have so many network effects of people being really happy

13:27Gregor Vand:with the product and taking it with them yeah they seem to have also this year i mean obviously i've been through this with super base now this year but they're sort of going from like c to d to e in one year basically so like they did series d temporal did series d in february of this year i think and so this would be not really even six months later they're looking at their next round at double i believe that's double the valuation so five billion on the last round and then or more than double and 12 billion on this round so yeah and i think that context is really interesting of yeah how temporal has been around a long time basically replacing state machines and this kind of thing step functions and yeah just like retry logic effectively that used to be just hand rolled I think by every company and then yeah and then now it's only this huge tailwind with AI for all the reasons you just mentioned so yeah I think super interesting yeah next one that crossed the radar was InstantDB so they are it's definitely more of an acri hire than acquisition at least that's how it's being yeah reported but yeah the team of InstantDB joining OpenAI so yeah InstantDB is yeah open source basically back end you got a database auth storage layer but the key thing here is like this is a very useful thing for agents basically being able to spin up that layer of infrastructure and yeah clearly open ai don't seem to be doing a lot of the building of that themselves at least not that we can see in public acquisitions seem to be or i could hires again in this case again seem to be how they're doing it this is interesting and and definitely one where there's a cloud offering they had a cloud offering which is i believe going to be mixed by open ai i think you know this is when developers get a little bit angsty when you know there's a product that they use and okay the team is going the team is going to go in-house with open ai but ultimately this product that they i believe they said they were handling like 400 000 apps i think this is a bit of a loss i guess for the ecosystem at the moment perhaps if by getting just sort of subsumed inside OpenAI.

15:33Gregor Vand:But we shall see if there's a better version of this. Yeah, I mean, it seems like with OpenAI, it might be some of these moves. Who knows what their actual intention is, but it seems like they're kind of trying to build their own agent infrastructure stack with some of these pieces that they're kind of assembling. And they've been making all kinds of different moves in agents for two years now. And I think part of that is like, how do you capture more of the AI value chain outside of the model itself and even outside of you know what they were originally really well known for which was like the consumer interface of chat dbt around their models yeah one of their investors was jeff dean so pretty big name and yeah we've got also some just sort of i think general general news on jeff dean is that right yeah so i mean the big news over the last month was that a little less than a month ago at the beginning of August, Jeff Dean announced he was leaving Google after 27 years.

16:29He's like employee number 30. He was most recently chief scientist. He's probably one of the most famous and world-renowned engineers in the world. You could probably make a fair argument that Google might not exist, at least in the form that it is today, if Jeff Dean hadn't been there with all the contributions he made to MapReduce, BigTable, Spanner, TensorFlow, Google Brain. He's just this godlike figure. The fun Jeff Dean facts that are these Chet Norris memes and stuff like that. I remember it was like, only Jeff Dean knows the final number of pi and crazy things like that. Jeff Dean doesn't get compiler errors.

17:09He tells the compiler that it's wrong and fixes it and just stuff like that. So it is quite the thing. I never thought that he would leave. I figured he would just eventually retire. But it looks like he's going off to start his own company. And he took three really heavyweight people with him as well. And they're now starting this company called Discovery Loop, which is, there's not, I don't think there's a ton of information out there, but they say it's a public benefit corporation aimed at using AI to automate and massively scale scientific experimentation. Definitely something interesting to pay attention to, see where they go.

17:42I would imagine them raising money is a very easy conversation. They probably just, here's my resume and slide across the blank check and have people just fill it out. But it'll be interesting to see what happens at Google coming out of this. Clearly, that's a pretty big loss. And Google did invest in Jeff Dean's company. And maybe there's a certain marketing angle to that to kind of save face and all this when you have such a high profile person leaving. But what do you think, Gregor?

18:08Gregor Vand:Yeah, no, I was sort of thinking, okay, what is the, you know, I love tipping points, right? What was the tipping point for Jeff Dean to leave Google? and I guess it's just like this is there has been no better time for someone of his stature and mind I guess where you are going to get the back if like if you actually want it you can probably have an amicable conversation and be backed still by Google and even bring people with you and not become some kind of rupture we've seen this a few times and yeah I think that's it really like there is there has been no better time that he could now step away from like the mothership and to do his own thing but i'm sure it will be very closely intertwined with things that google do anyway so yeah i think that's definitely life goals right there if you can give such a contribution through one company but then get like all the backing to then go and do your own thing from that company as well and be able to take some of the you know amazing talent that google still has like yeah amazing yeah yeah just one more fun jeff dean back before we we go off this is uh jeff dean proved that p equals np when he solved all np problems in polynomial time yeah there we go you're shipping faster than ever with ai coding agents but those agents don't vet the packages they pull in and they don't have security contacts built in ori by endor labs fixes that It plugs directly into your editor via MCP, catching vulnerabilities, blocking malicious packages, and flagging exposed secrets in real time.

19:40No separate tool to switch to, no dashboard to babysit, security that fits how you actually build. Teams using Ori see 10 times fewer security tickets and 6 times faster fixes. Free for developers. Get started at www.endorlabs.com. If you're running Postgres in production, you've probably felt the moment analytical queries start fighting your transactional workload. Most teams end up adding a second database and all the pipeline complexity that comes with it. Tiger Data, creators of TimescaleDB, takes a different approach. We extend Postgres with hybrid, row, and columnar storage, so one table handles both writes and analytical scans.

20:16Native compression cuts storage costs up to 95%. Continuous aggregates keep dashboards live without bash jobs. And it scales to petabytes without you re-architecting. Companies like Cloudflare, Octave Energy, Schneider, Axpo, and Floco run production workloads on Tiger Data today. No stale data. No second system to operate. Just Postgres. Managed for you, ready for the workload you're building toward. Try it free at TigerData.com. Your customer lives in the real world, and it's messy. Intermittent connections, mid-onboarding drop-offs, edge cases on devices you've never tested. Mobile apps reflect reality in a way no other surface does.

20:52Yet, from an engineering perspective, they're the hardest to understand. It's common for mobile engineers to see green backend dashboards, normal error rates, no crashes, but inevitably somewhere there's a frustrated user watching your app spin. After a few seconds, they'll lose patience, close the app, and turn their attention somewhere else. They may never come back. The worst part? Most observability tools never see any of it. BitRift, on the other hand, captures 100 % of mobile data, unsampled and in real time, so it's immediately queryable by engineers and AI agents. It's mobile observability built for the real world.

21:26Try BitRift today. bitrift.io slash signup.

21:31Gregor Vand:So back to just, I guess we called it M &A and it's more just A &R, acquisitions and raises. So back to A &R. Yeah, this one is a little bit, maybe for some off the radar exactly, but that's why I wanted to bring it in is a company, Hidden Layer, who are a security startup and they make tools to protect AI models, agents and workflows. And obviously we have covered so many of these attacks that have happened involving some form of agent or whether it was intended or not. So it's very interesting that, yeah, they've managed to raise 100 million, which actually now for a security startup, that's pretty impressive.

22:07Gregor Vand:There was definitely seemed to be some, I would say, decline in the security company raising space. I haven't seen a lot of big raises from security companies, strangely, even though we keep hitting all these security problems. It just seems that unless the company is basically something AI and then they maybe weave security into it, but this is very much no, like they've been doing security the whole time. They're just, they've managed to, I think, pivot that story and the products well into the AI space. And they claim that they haven't given exact AR numbers, but they say that they're now in the AR is now the tens of millions.

22:44Gregor Vand:And like 90 % of that was driven by new customers signing in the past year. So again, that's tens of millions in ARR for a security company of their age. Impressive as well. It is still pretty challenging to get companies to pay for a quote, new security company. Well, I say nobody got fired for buying CrowdStrike. Maybe somebody did it at some point. But honestly, I still think nobody gets fired for buying CrowdStrike. That's just a classic case of, yeah, they had a bad month a couple of years ago, but then nobody seems to remember that anymore. so i think it's steep in security it's like a steep hill to climb because unless you're doing some sort of like you know maybe consumer related security but you know most of this is going to be like b2b and how do you get like a truly large enterprise to trust some smaller player in the market that's relatively new with something like security but i do think that given that trust and governance and security around models is like so top of mind for businesses right now i do think there's gonna be a lot of companies that kind of emerge out of this new companies that have raises and are addressing like real problems in the space because that's a big part i think of what needs to be there to unlock e2b enterprise ai which is you significantly wagging behind other areas of right now yeah and like i think it's interesting they want to be known as like an edr solution which is endpoint detection response but specifically for ai they do things like they scan models that you are using they actually scan the files to like make sure that you are using the model that you think you're using so again like having spoken about hugging face and we're gonna actually our main topic is a lot about the open weight slash quote open source ecosystem and so provenance which is do you know where this thing came from this very much weaves into that which is like do you know the model is the model the one that you really think that you're using you You know, is that we've seen, obviously we've seen all sorts of like package manager based attacks, you know, where someone can take over a name or something.

24:47Gregor Vand:On Hugging Face, I must say, I'm not fully, I don't go into Hugging Face a whole ton these days, but I remember when using it, it was still kind of confusing at least back, I don't know, a year and a half ago, two years. It was still maybe confusing, like, is this a model made by anyone reputable with data that I can trust or not? So enterprise has to be super careful now when they're pushing their developers to use AI and especially open the small amount of actually open source models like yeah great but do you know what's what's in them so anyway I think that's why we've seen this from hidden layer they've managed 100 million at series b which is yeah super impressive for a security based startup yeah just moving us along this one is super buzzy startup got coverage in wall street journal but instinct.ai i think buzzy i want to keep touching on that because this was a 250 million series b at 2.5 billion valuation honestly i'm sure if there's anyone listening out there knows this product that's great i'm still a bit confused what the why here or why why this feels more like the team you know you've got like noah shin is i believe the at least one of the co-founders so he was at sierra and yeah it's like youngish team like and it's sort of like an open claw but polished it's kind of my read on it yeah i'm curious like why the crazy valuation on such a young company but but yeah i don't know if this crossed your radar as a company sean or not but no i hadn't seen the news around this yeah but it's basically what i could tell kind of going after the personal assistant ai personal assistant market yeah and unless of like an open source completely vibe coded thing by a single individual and more more of a company approach I mean, I don't know.

26:32I'm assuming that they were able to get that valuation in part because of maybe who the founders were. And then also in combination with whatever growth they might be seeing. But I also would think that the total addressable market is massive. Maybe that helps justify some of it. But that does seem quite a large or a very high valuation. And also for$250 million Series B.

26:53Gregor Vand:Yeah. So I realized in our notes, I put the wrong URL. So there's instinct.ai, which is not them. what's fun though if you go to instinct.co which is them it is just a website that looks like it's from 1992 and it's yes it does it's a white background it's times new roman it just says instinct and then it says contact and then you've got san francisco and you've got you know the comms it's all written there's no there's no science comms at instinct.co yeah i'll just do a quick read it then just has one basically one about paragraph and it just says instinct is the personal assistant that understands what you're working on and what's important to you.

27:31Gregor Vand:It connects to your applications and devices, email, messaging, screen, audio location, and more. The interface is simple. There are no new interfaces. It's trained to use a phone and a computer. I'll pause there. There's more, but yeah, very sort of open clot-ish. But I mean, this is the ultimate, I'll just say it. This is the ultimate flex right here. You know, hey, we have a website that is just a white Times New Roman and we just raised 250 million, 2.5. So yeah, signing the times perhaps but it's they're going for agent readability on the website right yes that's definitely what they're doing you know agent doesn't need to know anything more than than this basically but yeah you know what i'm gonna if i can in singapore sometimes things are not available here yet so i'll try it out i was never an open claw person but maybe this can i definitely need some form of personal assistant executive assistant so i will try this out all right and then just a final one i just popped this in it was kind of interesting this is it's called owner.com and they basically just do kind of like back-end software for businesses like it sounds super boring unsexy effectively it's an eight-year-old company but i think it's kind of cool they've raised 240 million series d at 2.3 billion so actually kind of similar numbers just different round to instinct but yeah i think this is cool it's good to see like how companies if they really do keep moving themselves forward and taking advantage of like what ai can do then And you can still be raising on these like unsexy business models.

28:58Gregor Vand:So kind of almost the anti to instinct in this case. Yeah. That's a hard market to like selling into the long tail of restaurants. Like OpenTable was able to do it through a lot of just sheer will of beating the street with, you know, sales reps and stuff like that. And back then when OpenTable did it, they were actually putting like physical computers into the restaurants and things like that. But I think the thing is, is like if you can do it because it's hard, it's very sticky. And then you have this like mass amount of customers that probably part of it's like, okay, well, I've captured the interest of this customer.

29:31Like how can I, what are the other things I could sell into that same customer that helped them that also helped me by generating more revenue? Yeah.

29:38Gregor Vand:As you say, it's like, it's very restaurant back office or like, I say back office. Yeah. It's like they cover everything like point of sale, a branded restaurant app, marketing campaigns, online menu, when you say online menu, like literally a restaurant menu, a reviews engine, all this stuff. So they're kind of trying to cover every single base that a restaurant or any kind of food service, I guess, would be needing. So yeah, super verticalized in that sense. But nice to see just something that doesn't, of course, AI comes into it, but it's not just an AI company claiming to sort of solve all the world's problems.

30:09Gregor Vand:It's very specific for something I think we can all relate to restaurants. Yeah, it's encouraging for all those founders out there that might be listening that don't have a pure AI company. Like, yes, you can actually still build a business and raise money, despite what maybe all the headlines tell you. Yeah. If you want to raise money, not all do. But if you do want to raise money for something that seemed boring, definitely, definitely still possible. So, yeah, nice. Yeah. I mean, I guess just sort of we're going to get into our main topic in a couple of minutes. In terms of other news, I think it's just that we've seen an absolute deluge of new models coming in.

Read the full transcript

30:42Gregor Vand:My night last night was top of Hacker News was Metamuse Spark 1.3 and Gemini 3.8 Flash. And then now, woken up this morning, what do we have this morning, Sean? GPT-6, Astra. Yeah. Hot off the presses. Yeah, very exciting. So we have admittedly not had time to really dig into all the things that Astra claims to be able to do. but certainly from the pretty, I would say like they've gone up a level from the launch website perspective for Astra. Again, IPO looming perhaps. But yeah, they're really going all out, pitching it against Fable 5 and 5.1 and showing lots of nice charts that it's all the benchmarks are far above.

31:27Gregor Vand:So yeah, we'll probably get into that one in more detail next month. But yeah, any hot takes? I mean, I think it's just limited release right now. But I mean, some of the things that I was able to dig into with the press was they talked about how they had to spend kind of extra time shipping safeguards and adding, enhancing the safeguards around it so that the model couldn't find and weaponize zero day on its own. And I think part of this is, you know, trying to really address some of the criticism that we've seen over the last couple of months when it comes to the frontier models. there was of course what happened and we covered previously with the mythos fable of it all where you know it was around for a week and it was pulled i guess who knows we're only less than a day into astro so maybe they'll get pulled off the market later this week but i think they're trying to address some of the concerns there yeah so we have spent quite a bit of time on sort of when we normally this is like the headline section and we've obviously gone through a lot of tech a &r as we now call it the main topic this week it's actually kind of running on a little bit from last month's where we dived into, we call it the Kimmy moment last month.

32:33Gregor Vand:Kimmy, this open weight model that literally all the weights you could find on Hugging Face and was really starting to show that an open weight model can rival the closed source frontier models. Something that then popped up in my, actually from a friend sending me an article about what's called the transfer forestation markets in China. And that's kind of framing what we're talking about today. It's sort of like the last couple of weeks is really like models. There's been a couple of weeks where the model map, if you like, has been a bit, has been rewritten in some ways. But I think just diving into how we got here is interesting.

33:12Gregor Vand:We didn't really touch on that so much last month. So kicking off, yeah, we've just seen, even since we talked about Kimi last month, we've seen like a bit of a proliferation and open rate releases. Some of these names might be new to people. So Zed.ai released GLM 5.3 Flash. We've had Quen dropping a whole bunch of new models and all sorts of new models coming out from all these Chinese foundries or however they like to be called. But what we perhaps didn't appreciate was that for a while there's been this transfer station economy, which is basically where, although you cannot access frontier models from OpenAI and Anthropoc in China, there has been a huge economy where basically you are able to access them for very low cost.

34:04Gregor Vand:So I'll kind of go through the three ways they've been able to do it. And then we'll just have a little pause there. So basically the first way, apparently I love all these kind of naming conventions and come come out of like Chinese proverbs and stuff. But apparently it's called the one fish, three meals. And this is from this article. So I should definitely give a shout out. So the blog is called China Talk. It's unattributed because for obvious reasons, I think there's far too much being talked about here that if someone is named on this, that could be problematic for them. So totally understand that.

34:35Gregor Vand:So the one fish, three meals, what is that? So basically they talk about either. Meal number one from the fish is you can bulk register accounts to farm free credits, reselling unused quota, corporate discount arbitrage, and API maxing. So one$200 max plan gets basically carved up to multiple users. Meal two is what's called model swapping. So users select Claude Opus, but the proxy would silently root to Sonnet, Haiku, or in a sort of quote, worst case glm or quen and fraudulently relivels the output so like researchers audited 17 api proxies and found that widespread model swapping basically so proxy access to quote gen i 2.5 achieved only 30 on a medical benchmark which is way off the actual official 83 what are they doing with the model swapping like are they essentially capturing the value of quad somewhere else so essentially someone thinks that they're using cloud opus they're paying that amount they get some cheaper basically version of that in response and then the labs are using the delta between that to do something for themselves yeah i think i think that's exactly it so yeah user thinks they're using let's just say opus what yeah which was the example given here they think they're using opus and basically yeah lab goes off and uses charges them you know because they say hey i'm a proxy so it's not i'm trying to think of a good example i don't want to put muddy the waters with names but like i think an example here that at least gets people thinking is imagine cursor it's not cursor just to be super clear it's not cursor but like imagine imagine cursor was to tell you hey would you like to use opus or sonnet and you pick opus and then i get a response back and i think that opus created that and i pay for opus amounts i instead get a sonnet response back and i go off and keep doing my work however lab keeps the money that i paid them for opus and then goes and actually uses opus to yeah and we'll get to sort of why are they doing this at all but yeah that's that was a good good sort of question yeah yeah so they're basically using the excess sort of capacity that's there because they're not actually responding with the high value model to use it for their own purposes exactly yeah yeah meal number three is the logs are the products effectively so So every request passing through a proxy, like a prompt or response or tool calls or iterations, that all does sit on this proxy server.

37:05Gregor Vand:And if it wasn't clear yet, these users in China, they're using these. They pay a proxy to get access to these models. The proxy tends to go through Singapore. So currently Singapore data centers are like some of the most heavily used in the, or VPNs heavily used in the world. So yeah, so the logs sit on the proxy server. So then for AI coding agents, they contain all the reasoning chains, engineering decisions, like repository context. human verified correct outputs as well you know they're basically capturing what a proxy literally is you know it sits in the middle it captures basically all the ins and the outs as if you were anthropic or open ai yeah but without the concerns of user privacy or gdpr or anything like this farm this user data however we find necessary essentially exactly yeah so So, and apparently that, yeah, certainly that last one, like logs, that seems to be, I guess, quote, the margin of these proxy products.

38:01Gregor Vand:I think they see that as the highest value, basically. You capture users through. It's real human behavior. And then it also, those form essentially like memory paths. It's like, I'm trying to accomplish this task. And the traces give you a graph for how to accomplish that. And it's probably not always going to be that efficient. So then if you mine them, you can take that into training and synthesize essentially sort of better neural pathways for similar types of memories. Yeah, exactly. So I think this is like just, I got to say, I had kind of, I had missed this certainly. And so when I was hanging out with a friend the other day, who's a programmer, CTO, and he spends a lot of time in China.

38:47Gregor Vand:He's German originally, but a lot of time in China. And so he's always the guy who just knows what's going on and why and so on. So yeah, he was talking to me about this and I was like, what are you talking about? And he's like, okay, I'll send you this article. So yeah. And why does that even kind of play into, especially what we're talking about last month with Kimmy and just this open weight surge, if you like, well, it doesn't mean this is not the entire reason this has been possible. Like that would be undermining, but distillation, this idea that you can capture the inputs and likely responses from these models you basically are able to then take that and then train models open weight models or create open weight models that sounds a bit like oh but how on earth would you do this because it's actually that's super slow or i think the volume here is what's always hard to like fathom the chinese population and just i think the sheer scale of what has been going on here is like absolutely unreal so yeah i mean when people talked about distillation i don't think it was fully understood how do you even do distillation well this is a sort of a very quick and interesting look into how that even works and then yeah that is sort of a huge reason i think that we have seen just a massive proliferation of open weight models and like of the quality that we're seeing again lots of very very smart people in in china creating these models but it is these proxies do exist this stuff is happening and it's a bit hard to see why that would be happening without yeah one seems to have led to the other at least in some form yeah i mean in order for you to the part of the process of distillation is essentially using a larger model or like a teacher model to generate the final outputs the answers or confidence scores so and then you use that to essentially teach the other model so you want to make a really good open weight model and you have access to the best frontier model and you're not even paying for it because you're like you're using the margin that you're saving from deviating routing to cheaper models and then on top of that you also have human trace behavior for how they're interacting with agents then that's all data that you can use for essentially distillation of reinforcement learning and fine tuning to make these open weight models really really good without needing access to, like this is a way essentially you can get access to the models and all the data that you need to do this process.

41:15Gregor Vand:Yeah, it makes the idea of models are banned. It's very interesting, like if a model is banned, but then by say the Chinese government, but then equally these proxies sound like pretty prolific. And you wonder actually, are these actually supported by the country as opposed to like, is it a blind eye or is it actively supported? And it makes the story of why are models banned even more interesting. Yeah. You wouldn't really be able to do this on the proxy level, or like the proxies wouldn't have any teeth for a user to go and use them if you didn't need to go do this. So I think it's absolutely genius, if I'm just being super honest.

41:54Gregor Vand:I think it is super smart because you always got to think 10 steps ahead of like, well, we don't want, at least that's probably, I guess, the way the Chinese government thinks like, oh, we don't want users to have access to this, but clearly they are very powerful and very helpful. like but what's the way we could sort of harness the output of this uh it's super interesting so yeah hopefully that gives a little bit of backstory to where we are at the moment with the open weight side of things yeah it does make you think like if they're able to do this you know these types of things that it'd be hard to get away with this in the u.s i would say yeah yeah you know what does that you'd hope it'd be hard to get away with it yeah yeah yeah what's that mean for how does like an open weight model stay competitive with essentially this market that is kind of doing you're stopping it nothing to be able to make better and better models if you're willing to like essentially circumvent people's privacy circumvent certain laws to train these models and you're and then you're a legit company not doing that like it makes it pretty hard to have an equal footing in terms of competition yeah well i think that's a good segue way into then i was also just for this week generally sort of wanting to maybe look at within the main topic what is meta doing because you know that's a topic we haven't really we haven't touched on meta in a big way in a while and thinking about it last week i realized i don't actually even know what meta are up to which says a lot because it just means they're not terribly interested from a pure personal coding level but it is very interesting just to look at them from the landscape point of view like i hadn't even appreciated that they did actually shelf the llama a family of models like back in april everything's moved to muse so there was actually it was a closed model muse code so that was starting to show a bit of a reset and that was under you know alexander wang who had come over from scale.ai and then but now they're moving back to sort of open weight models so there's muse glimmer which was under apache 2.0 so then to your point yeah sean i think they can compete in the sense that open weight models now have a lot more reputation in the sense of quality of output open weight doesn't mean less quality for certain tasks perhaps like coding like you can actually get very very far on these quote cheaper models and meta is not an ai company like it's still a social platform company it's very difficult i think for them to shift that image of themselves i don't really know like what's their go-to-market around their models like it's just not the natural i think it's compute basically yeah which has come out here so it's like okay we can still release an open weight model but it's on meta compute and so we're just going to go down the traditional well yeah i mean that's how they monetize it so it makes sense to basically give the model away because yeah or give the weights away essentially because it's almost like a customer acquisition channel but it's how you market it but that is probably not the natural location that people they're thinking about but even if i think more and more companies are going to have essentially a hybrid model strategy where they have some closed frontier models from the top labs, but then they also have open weight models.

45:01And probably a lot of them are not going to necessarily run those open weight models themselves. They'll go through an inference provider like a Fireworks or Base 10 or whoever it might be to do that. But then they're going to want to do that. So they have kind of a model agnostic strategy and they can direct certain workloads to different models, depending on like what the use case of the workload is. But is meta a consideration in there? I wouldn't think it would be the natural location that a lot of these companies are going to go. I guess maybe meta's approach is like, hey, well, if we can continue to prove that our model is the best in the open weight market, then naturally people will want to use our model because it's the best.

45:41But that's gonna be tough to do like we said given that all the moves that the chinese companies are doing

45:46Gregor Vand:yeah absolutely so we are gonna have to leave it there i think hopefully that's been like a little insight i know we like to try and sort of do a deep dive i hope that's been deep enough this week we had so much to cover in the first segment but yeah go check out if you're interested yeah it's the article it's on this yeah blog called china talk it's called how to buy cheap cloud tokens in china very very very straightforward yeah that was published in may there is sorry there is a name against it but yeah i say the kind of the who overalls behind this blog yeah is a little bit less but this person they are a research associate at oxford china policy lab and they hold a master's degree from university of oxford so i do feel like a lot of the research here is pretty well backed up so go check that out yeah we're probably going to have time for maybe one each on the hacker news highlights but yeah favorite part of the show let's get into it sean what was your highlight from hacker news yeah so i grabbed one it's kind of still on theme of some of the stuff that we're covering around lms and inference and cost but there was a recent there's a blog post it's on openteams.com intelligence versus cost and it was posted by the anonymous one on hacker news but essentially it's a someone's like personal deep dive into first they're critiquing some of the existing charts that you see that people use to sort of compare intelligence versus the cost for LMs.

47:12And one of the things they point out is that the chart uses a log scale, which visually ends up flattening the actual massive price gaps. So their argument is that's kind of misleading, and it doesn't really show the true story. And then what they do in the article is they redraw that on a linear scale and show what the real world pricing and the gap is between the open weight model and like a fable 5.1. And essentially their argument is that fables seven and a half times more expensive, but you're only going to get a small sort of intelligence bump that most people wouldn't even notice. So does it really make sense if you could take an open weight model, run it even on a last generation GPU for, you know, 1400 bucks a month or something like that unlimited and you're getting kind of 90 % of what actually people need is kind of the argument.

48:05Now, I will say that this is someone's personal journey and it's not necessarily scientifically based and things like that, but just interesting kind of food for thought.

48:13Gregor Vand:Yeah, no, that's super interesting. Yeah. On my end. So I'm trying to think which one to pick. I'll go with it is, I mean, it's on Hacker News and I think that's what's cool, but it's not super tech related, but AI does kind of come into it as well. But there's a great article called invisible companies and this was posted by eton non-ro so what is an invisible company well it's basically the argument that people can actually make good money from finding companies that just are very good in their sector but are just kind of like completely not the buzzy company to buy and so if you're a vc and you want like a slightly alternative strategy then you can go and find companies that very much are outliers in like their segment for how much money they're able to produce.

49:01Gregor Vand:But the reason that it's called invisible companies is you actually also don't want them to become visible. You don't want them to kind of get into become a segment that it becomes hot and people now want to buy companies in that segment. Otherwise, because the whole point is the aim isn't to sell these companies on necessarily, it's to hold them and to make money from them. AI comes into it in the sense that like, well, you can definitely do a lot more research much faster to find these companies, but does that make them more or less visible? That's part of what the article discusses. So yeah, I don't know.

49:34Gregor Vand:I'm sure we've got a lot of listeners out there who are just generally like entrepreneurs themselves. So I definitely found this one very interesting as well. And just completely, completely off tech topic. Sometimes it's nice just to read something that's not related to models or AI models or that kind of thing so absolutely awesome yeah and no doom this week unfortunately no new doom running on something but i i hope i'm sure we'll find something for next month but yeah i guess just any any quick thoughts on on what we might see in the few weeks ahead sean i mean given this it's not a real hot take but given all the movement that we you know all the mna would you describe it a and r a and r yeah yeah i think that's really just the beginning i think we're going to see a lot going on through the end of the year of consolidation of companies and also large fundraisers from variety of different companies.

50:24Because even, I would suspect, like a lot of the companies that raised fairly large rounds in 2022 that when the market was really hot and were sort of overvalued and to a point where it was hard to look at the value, like some collection of those companies are probably in a place where they're running out of money and maybe don't have the growth to raise. And then some collection of them have probably done really well and they're going to raise money and so forth. So we'll probably see a lot of that.

50:50Gregor Vand:Yeah. I was just double checking. I don't see my prediction last month was that we're going to already see Kimi 3.5. Sadly, no, but we definitely, you know, as we've covered a lot of stuff in the last, a lot of open weight in the last months, I think my prediction for the next few weeks is I really think we're going to start to see some cost inflection point. I think there's going to be some kind of like, not backlash exactly, but I do think there's going to be some moment where like some big company somewhere perhaps is like we are we're not going to use a topic anymore it's too expensive we're using kimmy or we're using something i'd kind of like to see it because i think i would like to see the cost being driven down to some kind of equilibrium but yeah i would suspect too one other thing is that i think we'll see a big model announcement from google sooner rather than later too because they've been way too quiet other than like the jeff dean news yeah cool well yeah thanks everyone for tuning in and we shall catch you next month thanks everyone cheers

From the publisher

SED News is a monthly podcast from Software Engineering Daily where hosts Gregor Vand and Sean Falconer break down the biggest stories shaping software engineering, Silicon Valley, and the broader tech industry.

In this end-of-summer episode, Gregor and Sean turn to a busy season of mergers and acquisitions, including NVIDIA‘s reported $12.9 billion acquisition of Hugging Face, Dynatrace‘s near-billion-dollar deal for AI observability platform Arize, and Temporal‘s rumored raise at a $12 billion valuation. They also cover a run of large funding rounds, from AI security startup HiddenLayer to AI personal assistant Instinct and restaurant software platform Owner.com, all against the backdrop of a deluge of new model releases.

The main topic digs into China’s “transfer station” economy, the sprawling proxy market that gives developers cheap access to frontier models officially banned in the country. Drawing on a China Talk report, they walk through the tactics at play, from “one fish, three meals” credit farming to silent model swapping, and unpack how this pipeline of captured outputs and human traces may be fueling the recent surge in high-quality open weight models. Gregor and Sean also examine where Meta now sits in the landscape after shelving Llama and pivoting toward its Muse family.

As always, the episode wraps up with a few standout Hacker News threads, including a critique of how log-scale charts obscure the real cost gap between open weight and frontier models, and a look at “invisible companies” as an under-the-radar investment strategy.

Sponsorship inquiries:
sponsor@softwareengineeringdaily.com

The post SED News: The NVIDIA-Hugging Face Deal, China’s Proxy Economy, the Open Weight Surge appeared first on Software Engineering Daily.

More from Software Engineering Daily

All 195 episodes
SED News: The NVIDIA-Hugging Face Deal, China’s Proxy Economy, the Open Weight SurgeSoftware Engineering Daily · 52 min
Listen in VO