Renos Zabounidis

PhD Student @ Carnegie Mellon University • NSF Graduate Research Fellow • Goldwater Scholar

renos_img.png

1604C Newell-Simon Hall

4804 Forbes Ave

Pittsburgh PA, 15213

I’m a PhD student in the School of Computer Science at Carnegie Mellon University, advised by Katia Sycara in the Advanced Agent Robotics Technology Lab. My research focuses on integrating foundation models, reinforcement learning, and neurosymbolic approaches to build more capable and interpretable autonomous agents.

I’m particularly interested in how LLMs can be combined with RL to enable agents that can plan, reason, and learn efficiently in complex, long-horizon tasks. My recent work, SCALAR, received an Honorable Mention for Best Paper at NeurIPS 2025 (1 of 2 out of 112 accepted papers).

Before CMU, I graduated Summa Cum Laude from UMass Amherst with a B.S. in Computer Science and Mathematics, where I received the Graduating Senior Award (top 8 of 426 graduates) and was a Commonwealth Honors College Scholar with Greatest Distinction.

Research Interests: Reinforcement Learning (Hierarchical, Multi-Agent, LLM Reasoning), Interpretable AI (Concept Bottleneck Models), and Foundation Models for Embodied Agents.

news

Dec 09, 2025 Our paper SCALAR received Honorable Mention for Best Paper at the NeurIPS 2025 Workshop on Bridging Language, Agent, and World Models (1 of 2 out of 112 accepted papers)!
Nov 03, 2025 Our paper Re-FORC: Adaptive Reward Prediction for Efficient Chain-of-Thought Reasoning is now on arXiv!
May 01, 2025 Starting summer internship at AWS Agentic AI Research Team working on efficient chain-of-thought reasoning with Michael Kleinman, Aditya Golatkar, and Stefano Soatto.
Jul 01, 2024 Won the AWS Trainium Hackathon among 30 participants by implementing the fastest Mamba 2 kernel using the Neuron Kernel Interface (NKI).
May 01, 2024 Starting summer internship at AWS AI Fundamentals Research Team working on privacy-preserving synthetic data generation with diffusion models.

selected publications

  1. NeurIPS WS
    SCALAR: Self-Supervised Composition and Learning of Skills with LLM Planning and RL
    Renos Zabounidis, Yue Wu, Simon Stepputtis, and 3 more authors
    In NeurIPS 2025 Workshop on Bridging Language, Agent, and World Models for Reasoning and Planning, 2025
  2. NeurIPS WS
    Re-FORC: Adaptive Reward Prediction for Efficient Chain-of-Thought Reasoning
    Renos Zabounidis, Aditya Golatkar, Michael Kleinman, and 3 more authors
    In NeurIPS 2025 Workshop on Efficient Reasoning, 2025
  3. Preprint
    Benchmarking and Enhancing Disentanglement in Concept-Residual Models
    Renos Zabounidis, Ini Ogontola, Joseph Campbell, and 2 more authors
    Preprint, 2024
  4. CoRL
    Concept Policy Models for Interpretability in Multi Agent Reinforcement Learning
    Renos Zabounidis, Joseph Campbell, Dana Hughes, and 1 more author
    In 6th Conference on Robot Learning (CoRL), 2022