I work on alignment science, with a focus on reinforcement learning. My research asks what models actually learn when we optimize them against imperfect rewards. I build model organisms of reward hacking, measure how hacking learned in training transfers to new settings, and develop evaluations that catch these behaviors before deployment.

I am currently at Koç University and will soon join Harvard University as a Research Fellow.

Publications

For a full list of publications, see my Google Scholar profile.

Blog Posts

The Bestiary of Unintended Solutions: Specification Gaming in AI
Can You Share Your Network Configurations?