Talks & slides
Talks
Slides from my talks. Present them here in the browser, or download the PowerPoint.
-
Making AI Reasoning and Actions More Reliable with SMT and Lean
[Online] AI Horizons · NUS Artificial Intelligence Institute
Hosted by Dr Dianbo Liu, National University of Singapore
Language models give convincing answers, but how do we check that their reasoning is correct? The talk follows one question from natural language to a solver-checked result: translating claims into logical constraints that SMT solvers such as Z3 can check, using solver feedback to revise answers, and detecting when the translation itself is wrong. It closes with Lean-verified policy checkers that evaluate an agent’s tool calls before they execute.
-
Reinforcement Learning with Verifiable Rewards
Case Western Reserve University
A first-principles tour of reinforcement learning with verifiable rewards (RLVR): how a task checker turns sampled attempts into a training signal, and how SFT, DPO, PPO and GRPO differ in what drives each update. It then covers later refinements (RLOO, Dr. GRPO, DAPO, GSPO), process rewards and richer feedback, and what improvement these methods actually measure.