Project pages
Longer write-ups, figures and demos for some of my papers.
Learn from Your Mistakes: Self-Correcting Masked Diffusion Models
Masked diffusion models keep tokens fixed once they are unmasked, so errors accumulate. ProSeCo trains one model to both unmask and correct, interleaving corrective refinement steps with unmasking during generation.
Simple Guidance Mechanisms for Discrete Diffusion Models
Simple, effective classifier-based and classifier-free guidance for discrete diffusion, plus UDLM, a class of uniform-noise diffusion language models that is particularly amenable to guidance.
Bi-Directional Equivariant Long-Range DNA Sequence Modeling
A family of bi-directional, long-range DNA language models built on Mamba, and the first to respect the reverse-complement symmetry of double-stranded DNA.