Centre for Networked Intelligence

Dear All, Networks Seminar, supported by the Centre for Networked Intelligence, is a technical discussion forum in topics including but not limited to computer networks, machine learning, signal processing, and information theory. The seminar series has a webpage hosted at https://cni.iisc.ac.in/seminars/. You are invited to the following seminar held as part of this series. Title: Reinforcement Learning in Non-Stationary Environments Speaker: Prof. Pranay Sharma, Assistant Professor, Centre for Machine Intelligence and Data Science (CMInDS), IIT Bombay Time: 4:00 PM - 5:00 PM (IST) Date: 09 February 2026 Venue: Online on Zoom Zoom link: https://us06web.zoom.us/j/83388976389?pwd=XcpO3GhLxsR14a7SVbPx33HQQa1jbt.1 Zoom Meeting ID: 833 8897 6389, Pass Code: NSSIISc YouTube Livestream: https://www.youtube.com/watch?v=wOSXnNi7Big Webpage Link: https://cni.iisc.ac.in/seminars/2026-02-09/ Abstract: We consider the problem of non-stationary reinforcement learning (RL) in the infinite-horizon average-reward setting. We model it by a Markov Decision Process with time-varying rewards and transition probabilities. Existing non-stationary RL algorithms focus on model-based and model-free value-based methods. Policy-based methods, despite their flexibility in practice are not theoretically well understood in non-stationary RL. We propose and analyze the first model-free policy-based algorithm, Non-Stationary Natural Actor-Critic (NS-NAC), a policy gradient method with a restart-based exploration for change and a novel interpretation of learning rates as adapting factors. Further, we present a bandit-over-RL-based parameter-free algorithm, BORL-NS-NAC, that does not require prior knowledge of the variation budget. Bio: Pranay is an Assistant Professor at IIT Bombay in the Centre for Machine Intelligence and Data Science (C-MInDS). Till January 2025, he was a Research Scientist in the Department of Electrical and Computer Engineering at Carnegie Mellon University. He finished his PhD in Electrical Engineering and Computer Science at Syracuse University. Before that, he finished his B.Tech-M.Tech dual-degree in Electrical Engineering from IIT Kanpur. His research interests include federated and collaborative learning, stochastic optimization, reinforcement learning, and differential privacy. More details: https://sites.google.com/view/pranay-sharma/home ALL ARE WELCOME. Thank you, CNI Seminar Series Organizing Committee.