Publications

Multi-Agent Control

• Learning to Control Unknown Strongly Monotone Games
  S. Chandak, I. Bistritz and N. Bambos
  Submitted to IEEE Transactions on Automatic Control
  [arXiv]

• Tug of Peace: Distributed Learning for Quality of Service Guarantees
  S. Chandak, I. Bistritz and N. Bambos
  IEEE Conference on Decision and Control (CDC), 2023
  [paper] [full version] [slides]

• Equilibrium Bandits: Learning Optimal Equilibria of Unknown Dynamics
  S. Chandak, I. Bistritz and N. Bambos
  International Conference on Autonomous Agents and Multiagent Systems (AAMAS), 2023
  [paper] [arXiv] [slides] [poster]

• Learning to Speak on Behalf of a Group: Medium Access Control for Sending a Shared Message
  S. U. Haque, S. Chandak, F. Chiariotti, D. Günduz and P. Popovski
  IEEE Communications Letters, August 2022
  [paper]

Reinforcement Learning and Stochastic Approximation

• A Concentration Bound for TD(0) with Function Approximation
  S. Chandak and V. S. Borkar
  Submitted to Stochastic Systems
  [arXiv]

• Reinforcement Learning in Non-Markovian Environments
  S. Chandak, P. Shah, V. S. Borkar and P. Dodhia
  Systems and Control Letters, March 2024
  [paper] [arXiv]

• A Concentration Bound for LSPE($\lambda$)
  S. Chandak, V. S. Borkar and H. Dolhare
  Systems and Control Letters, January 2023
  [paper] [arXiv]

• Concentration of Contractive Stochastic Approximation and Reinforcement Learning
  S. Chandak, V. S. Borkar and P. Dodhia
  Stochastic Systems, December 2022
  [paper] [slides]

• Prospect-theoretic Q-learning
  V. S. Borkar and S. Chandak
  Systems and Control Letters, October 2021
  [paper] [arXiv] [slides]

Applications of Dynamic Programming

• Tiered Service Architecture for Remote Patient Monitoring
  S. Chandak, I. Thapa, N. Bambos and D. Scheinker
  To be presented at IEEE Healthcom, 2024
  [arXiv]

• Hidden Markov Model-Based Encoding for Time-Correlated IoT Sources
  S. Chandak, F. Chiariotti and P. Popovski
  IEEE Communications Letter, May 2021
  [paper]