DR

TLDRs

These are (hopefully) more accessible writeups of my research, primarily aimed at readers comfortable with math and ML but not theory (or who don't want to read the entire paper). I started writing these mostly to get better at explaining things without defaulting to heavy math. To that end, the writeups here are intended as high-level overviews. Comments and suggestions are more than welcome :).

A full list of work is at research.

Majority-of-Three is Optimal [arXiv]

A proof of the simplest optimal learner

A Theory of Saddle Escape in Deep Nonlinear Networks [arXiv]

Analyzing training dynamics in small-initialization deep nonlinear neural networks

Rao-Blackwellized Score Matching on Manifolds [arXiv]

Figuring out what denoising score matching actually learns when high-dimensional data has structure