Abstract
This work is motivated by a visual search experiment in which a human subject is shown a number of drifting-dots images. The direction of drift in one of these images (the odd image) is different from the common direction of drift in rest of the images. The goal of the human subject is to identify the location of the odd drifting-dots image in the shortest possible time while keeping his probability of decision error small. Our interest is in understanding the relation between (a) the amount of time taken by the human subject to identify the odd image, and (b) the “closeness” of the odd and the non-odd images used in the experiment. It is often the case that the human subjects participating in such visual search experiments tend to sample image locations uniformly at random in an attempt to complete the given task as soon as possible. In this work, we model the above visual search experiment as a problem of odd arm identification in a multi-armed bandit in which (a) each arm yields Markov observations, and (b) the arms are restless. Further, we model the tendency of human subjects to sample image locations randomly as a “trembling hand” for the human subject, and come up with a metric that captures the notion of “closeness” between the odd and the non-odd images. Our results generalize all the previously known results for odd arm identification in multi-armed bandits. Rooji Jinan
Rooji is a PhD student at Robert Bosch Centre for Cyber Physical Systems, IISc, working under the guidance of Dr. Parimal Parag, Department of Electrical Communication Engineering, IISc. Rooji received her B.Tech. degree in Electronics and Communication and her M.Tech. in Communication Engineering and Signal Processing from Calicut University, Kerala. Prior to joining IISc, she worked as an Assistant Professor at Christ College of Engineering (affiliated to Kalam Technological University), Kerala during 2016-17. Her broad research interests are in applied probability and her current project focuses on design and analysis of efficient distributed storage and computation systems with the goal of achieving low latency.