1. Podcasts
  2. Technology
  3. Best AI papers explained
Best AI papers explained cover art

530 episodes

Best AI papers explained, page 20

by Enoch H. Kang · English

Cut through the noise. We curate and break down the most important AI papers so you don’t have to.

All episodes, page 20

Interpreting Chain of Thought: A Walkthrough and Discussion

How to interpret LLM chain-of-thought using “Thought Anchors” (a circular, color-coded graph of sentence-level reasoning) plus counterfactual importance and resampling sentence-to-sentence importance…

4 Aug 2025 · 15m · 6 chapters

The wall confronting large language models

The episode argues that large language models (LLMs) face a “wall” of diminishing returns: scaling up parameters/data yields rapidly worsening reliability and uncertainty, making them unsuitable for…

4 Aug 2025 · 18m · 9 chapters

COLLABLLM: LLMs From Passive to Collaborative

The episode argues current LLMs feel “passive” because training rewards next-turn answers, not long-term task success, leading to inefficient back-and-forth when user intent is unclear.

31 Jul 2025 · 18m · 12 chapters

A decade's battle on dataset bias: are we there yet?

The episode discusses a modern re-test of the “Name That Dataset” experiment, showing that deep neural networks can reliably identify which dataset an image came from, even when humans struggle.

29 Jul 2025 · 16m · 9 chapters

GEPA: Generative Feedback for AI System Optimization

GEPA (Genetic Pareto) is a prompt optimizer for LLM system optimization that targets sample inefficiency in reinforcement-learning-style prompt tuning (e.g., GRPO/GRPO-like RLVR), which can require…

29 Jul 2025 · 15m · 7 chapters

From AI-Curious to AI-First: Engineering Production AI Systems

Engineering realities of building production-grade AI systems; why “AI-first” is an engineering discipline, not research or demos.

28 Jul 2025 · 36m · 20 chapters

Context Engineering: Beyond Simple Prompting to LLM Architecture

Reframes “prompt engineering” as insufficient for production LLM apps, arguing for “context engineering”: architecting the entire context window (information payload + orchestration) to enable…

28 Jul 2025 · 30m · 18 chapters

Agentic Misalignment: LLMs as Insider Threats

Agentic misalignment—how autonomous LLM “agents” can become insider threats in simulated corporate settings when pressured by self-preservation threats or conflicts between company goals and the…

28 Jul 2025 · 18m · 10 chapters

Small Language Models: Future of Agentic AI

The episode argues that “agentic AI” will increasingly rely on small language models (SLMs) rather than large LLMs, driven by capability-per-parameter, better operational fit for agents, and major…

28 Jul 2025 · 21m · 11 chapters

Learning without training: The implicit dynamics of in-context learning

In-context learning (ICL) in LLMs—how models adapt to new input patterns at inference time without weight updates, and a Google Research paper’s theory that explains ICL as implicit weight changes…

28 Jul 2025 · 11m · 7 chapters

Inverse Scaling in Test-Time Compute

Inverse scaling in test-time compute—when increasing inference “thinking” (more reasoning tokens) can reduce accuracy and worsen safety behavior.

28 Jul 2025 · 16m · 7 chapters

LLM Economist: Large Population Models and Mechanism Design in Multi-Agent Generative Simulacra

Princeton’s “LLM Economist” framework uses multi-agent LLM “economic simulacra” to test mechanism-design policies (especially optimal tax schedules) via a Stackelberg game: a planner proposes taxes;…

28 Jul 2025 · 16m · 12 chapters

Microsoft's Blueprint: AI, Quantum, and the Agentic Future

The episode explains Microsoft CEO Satya Nadella’s “refounding” strategy for the next computing era, built on three pillars: (1) pragmatic AI that drives measurable economic value (Nadella claims AI…

26 Jul 2025 · 27m · 21 chapters

Zuckerberg's AI Vision Analyzed

Analysis of Mark Zuckerberg’s strategy for Meta’s AI future—open-source model leverage (Llama), agentic AI coding, a slow takeoff/fast internal sprint, and long-term ambitions for AI companions via…

26 Jul 2025 · 26m · 16 chapters

Inside Claude: Scaling, Agency, and Interpretability

How Anthropic’s Claude models are trained and how researchers try to reverse-engineer internal “minds,” focusing on RL with verifiable rewards (RLVR), emerging agency/deception risks, and mechanistic…

26 Jul 2025 · 34m · 16 chapters

Personalized language modeling from personalized human feedback

The episode explains Personalized RLHF (PRLHF), a framework for training large language models to match individual user preferences instead of “majority voting” preferences from standard RLHF.

26 Jul 2025 · 17m · 10 chapters

Position: Empowering Time Series Reasoning with Multimodal LLMs

The episode discusses a paper arguing that multimodal large language models (MLLMs) can enable “time series reasoning” by combining numerical time-series data with external context (text, images,…

25 Jul 2025 · 16m · 11 chapters

An empirical risk minimization approach for offline inverse RL and Dynamic Discrete Choice models

Gladius, an empirical risk minimization method for offline inverse reinforcement learning (IRL) and dynamic discrete choice (DDC), infers hidden reward/utility functions from historical action data…

22 Jul 2025 · 15m · 8 chapters

Inverse Reinforcement Learning Meets Large Language Model Post-Training: Basics, Advances, and Opportunities

Explains how inverse reinforcement learning (IRL) and learned “neural reward models” enable LLM post-training/alignment beyond prompting or supervised fine-tuning, covering MDPs, reward modeling from…

22 Jul 2025 · 26m · 10 chapters

The Invisible Leash: Why RLVR May Not Escape Its Origin

The episode explains a research paper (“The Invisible Leash: Why RLVR May Not Escape Its Origin”) arguing that reinforcement learning with reward models (RLVR) mainly sharpens a model’s existing…

20 Jul 2025 · 16m · 6 chapters

Language Model Personalization via Reward Factorization

Language model personalization using reward factorization (PREF), aiming to tailor LLM responses to individual user preferences rather than one-size-fits-all RLHF.

20 Jul 2025 · 10m · 6 chapters

Train for the Worst, Plan for the Best: Understanding Token Ordering in Masked Diffusions

Compares mass diffusion models (MDMs) vs autoregressive models (ARMs) for generating discrete sequences (text, proteins) and explains why “train for the worst, plan for the best” works via adaptive…

18 Jul 2025 · 14m · 6 chapters

Do We Need to Verify Step by Step? Rethinking Process Supervision from a Theoretical Perspective

Compares process supervision (step-by-step feedback) vs outcome supervision (only final success/failure) for training reasoning-capable AI, focusing on a March 2025 paper arguing outcome-only…

17 Jul 2025 · 13m · 6 chapters

Soft Best-of-n Sampling for Model Alignment

The episode explains the alignment problem for LLMs (next-token predictors that may be “technically correct” but not match user intent) and a lightweight method called Soft Best-of-N sampling (“Soft…

16 Jul 2025 · 14m · 8 chapters