Your Name

Anat Kleiman

PhD Candidate in Computer Science

I am a 4th year PhD candidate in Computer Science at Harvard University in Machine Learning Foundations. I am advised by Sham Kakade and Jonathan Frankle. My research focuses on the science of deep learning, with a particular emphasis on large language models (LLMs). I am especially interested in identifying and addressing empirical challenges in LLM applications, including issues like catastrophic forgetting and inefficient reasoning. In addition, my work explores the use of LLMs in tasks involving reasoning, unlearning, and continual learning. I am also supported by the Kempner Graduate Student Fellowship


In the summer of 2024, I interned as a Machine Learning Research Intern at Apple where I worked on unlearning. Before that, in the summer of 2022, I worked as a Machine Learning intern at Netflix focusing on video automation. Finally, during the summers of 2019-2020, I worked as a software engineering intern at Uber ATG on self-driving vehicles. I also completed my MSE degree in Computer Science at Princeton University where I worked with Ryan Adams.

Education

PhD in Computer Science
Harvard University, 2022 - Present
MSE in Computer Science
Princeton University, 2020-2022

Papers

Preprints

Soup to go: mitigating forgetting during continual learning with model averaging
Anat Kleiman, Gintare Karolina Dziugaite, Jonathan Frankle, Sham M. Kakade, Mansheej Paul

Published

Transcendence: Generative models can outperform the experts that train them
Edwin Zhang, Vincent Zhu, Naomi Saphra, Anat Kleiman, Benjamin Edelman, Milind Tambe, Sham Kakade, Eran Malach
38th Conference on Neural Information Processing Systems (NeurIPS 2024)
REVISE: A tool for measuring and mitigating bias in visual datasets
Angelina Wang, Alexander Liu, Ryan Zhang, Anat Kleiman, Leslie Kim, Dora Zhao, Iroha Shirai, Arvind Narayanan, Olga Russakovsky
International Journal of Computer Vision (IJCV 2022)

Workshops

Predicting task forgetting in large language models
Anat Kleiman, Jonathan Frankle, Sham M Kakade, Mansheej Paul
Workshop on Challenges in Deployable Generative AI at International Conference on Machine Learning (ICML 2023)
Soft prompting might be a bug, not a feature
Luke Bailey*, Gustaf Ahdritz*, Anat Kleiman*, Siddharth Swaroop, Finale Doshi-Velez, Weiwei Pan
Workshop on Challenges in Deployable Generative AI at International Conference on Machine Learning (ICML 2023)
Buffer pool aware query scheduling via deep reinforcement learning
Chi Zhang, Ryan Marcus, Anat Kleiman, Olga Papaemmanouil
2nd International Workshop on Applied AI for Database Systems and Applications(VLDB 2020)