Anas Barakat
Postdoctoral Research Fellow
Singapore University of Technology and Design
Optimization for Reinforcement Learning and Multi-Agent Learning
Foundations and algorithms for policy optimization beyond expected additive rewards, multi-agent learning in structured games, and online learning under limited feedback
My research develops theoretical foundations and algorithms using optimization for learning problems that go beyond the classical paradigm of maximizing expected additive rewards in fixed learning environments. In modern AI systems, objectives may be nonlinear, distributional, multi-sample, or nonconvex with exploitable hidden structure; learning feedback may be limited and revealed online; and environments may contain other agents adapting strategically. These challenges arise in modern AI training and LLM post-training, where models are optimized through imperfect objectives, learned rewards, verifiers, and interactions with users or other agents.
My research is organized around two complementary directions:
-
Policy Optimization Beyond Expected Additive Rewards: Foundations and optimization algorithms for reinforcement learning and post-training objectives beyond standard expected additive rewards, including general utilities, reward-free RL, risk-sensitive criteria, and LLM post-training.
-
Multi-Agent Learning in Structured Dynamical Games: Optimization for game dynamics and equilibrium learning in strategic and stateful multi-agent environments including Markov games (stochastic games and beyond, with general utilities) and continuous dynamical games.
Selected Publications
For a complete list of my publications, see my Research page below (organized by theme) or Google Scholar (for a list in reverse chronological order).
News
- 05/2026: New preprint: Online Learning on Hidden-Convex Losses via Algorithmic Equivalence: Optimal Regret, Geometric Barrier, and Bandit Feedback, arxiv link.
- 05/2026: Humbled to be recognized as a Gold Reviewer at ICML 2026.
- 02/2026: New preprint: Why Pass@k Optimization Can Degrade Pass@1: Prompt Interference in LLM Post-training, arxiv link.
- 02/2026: Optimistic Online Learning in Symmetric Cone Games accepted to Transactions on Machine Learning Research, link.
- 01/2026: Convex Markov Games and Beyond accepted to AISTATS 2026, arxiv link.
- 10/2025: Designing and teaching a new course with John Lazarsfeld and Iosif Sakos. Check out our website: Online Learning and Learning in Games.
- 09/2025: On the Global Optimality of Policy Gradient Methods in General Utility Reinforcement Learning accepted to NeurIPS 2025.
Experience and Background
- October 2024–present: Postdoctoral Research Fellow, Singapore University of Technology and Design. Working with Antonios Varvitsiotis.
-
February 2022–August 2024: Postdoctoral Fellow, ETH Zurich, Department of Computer Science. Worked with Niao He.
-
Ph.D. in Applied Mathematics and Computer Science, Institut Polytechnique de Paris (Télécom Paris), 2021.
Advised by Pascal Bianchi and Walid Hachem. -
Engineering Master’s degree in Applied Mathematics and Computer Science, Télécom Paris, 2018.
-
M.Sc. in Data Science, Université Paris Saclay, 2018.
Here is my CV for more information.