Publications

Multi-Agent Control

• Tug of Peace: Distributed Learning for Quality of Service Guarantees
  S. Chandak, I. Bistritz and N. Bambos
  To be presented at IEEE Conference on Decision and Control (CDC), 2023
  [full version]

• Equilibrium Bandits: Learning Optimal Equilibria of Unknown Dynamics
  S. Chandak, I. Bistritz and N. Bambos
  International Conference on Autonomous Agents and Multiagent Systems (AAMAS), 2023
  [paper] [arXiv] [slides] [poster]

Reinforcement Learning and Stochastic Approximation

• Reinforcement Learning in Non-Markovian Environments
  S. Chandak, P. Shah, V. S. Borkar and P. Dodhia
  Systems and Control Letters, March 2024
  [paper] [arXiv]

• A Concentration Bound for LSPE($\lambda$)
  S. Chandak, V. S. Borkar and H. Dolhare
  Systems and Control Letters, January 2023
  [paper] [arXiv]

• Concentration of Contractive Stochastic Approximation and Reinforcement Learning
  S. Chandak, V. S. Borkar and P. Dodhia
  Stochastic Systems, December 2022
  [paper] [slides]

• Prospect-theoretic Q-learning
  V. S. Borkar and S. Chandak
  Systems and Control Letters, October 2021
  [paper] [arXiv] [slides]

Older Publications

• Learning to Speak on Behalf of a Group: Medium Access Control for Sending a Shared Message
  S. U. Haque, S. Chandak, F. Chiariotti, D. Günduz and P. Popovski
  IEEE Communications Letters, August 2022
  [paper]

• Hidden Markov Model-Based Encoding for Time-Correlated IoT Sources
  S. Chandak, F. Chiariotti and P. Popovski
  IEEE Communications Letter, May 2021
  [paper]