Speaker: Francis de Véricourt, ESMT Berlin
Date & Time: February 11, 2022, Friday 13:30
Zoom Link:
https://zoom.us/j/6547746234?pwd=ZENZNWtCbUlQRjVMMVFneWtxZGlzZz09
Title: Is your machine better than you? You may never know.
Abstract: AI systems are increasingly demonstrating their capacity to make better predictions than human experts. Yet, recent empirical studies suggest that professionals sometimes doubt the quality of these systems, and as a result overrule machine-based prescriptions. This paper explores the extent to which a decision maker (DM) can properly assess whether a machine produces better recommendations. To that end, we analyze an elementary dynamic Bayesian framework, in which a machine performs repeated decision tasks under a DM's supervision. The task consists in deciding whether to take an action or not. Crucially, the DM observes the accuracy of the machine's prediction on the task only if she ultimately takes the action. As she observes the machine's accuracy, the DM updates her belief about whether the machine's predictions outperform her own. Depending on this belief, however, the DM sometimes overrides the machine, which affect her ability to assess it. In this set-up, we characterize the evolution of the DM's belief and overruling decisions over time. We identify situations under which the DM's belief oscillates forever, i.e., the DM always hesitates whether the machine is better. In this case, the DM never fully ignores the machine but regularly overrules it. We further find that the DM's belief sometimes converges to a Bernoulli random variable, i.e., the DM ends up wrongly believing that the machine is better (or worse) with positive probability. We fully characterize the conditions under which these failures to learn occur. These results highlight some fundamental limitations in our ability to determine whether machines make better decision than experts. They further provide a novel explanation for why humans may collaborate with machines – even when one may actually outperform the other. (Joint work with Huseyin Gurkan, ESMT).
Bio: Francis de Véricourt is Chaired Professor of Management Science and the director of the Center for Decisions, Models and Data (DMD-Center) at ESMT Berlin. He lived and worked in France, USA, Germany and Singapore. Francis was the first Associate Dean of Research at ESMT and held faculty positions at Duke University and INSEAD. He was a post-doctoral researcher at Massachusetts Institute of Technology (MIT) and received a MS degree in applied mathematics and computer science at the Grenoble Institute of Technology as well as a PhD degree from Université Paris VI, France. His general research interest is in the area of decision science, analytics and operations. He is the author of numerous academic articles in prominent management, analytics and economics journals such as Management Science, Operations Research, American Economics Review and others. He also co-authored the book
Framers: Human Advantage in an Age of Technology and Turmoil, Penguin Random House, which was on the Financial Time's 2021 best books. He received several outstanding research awards, including the ENRE and MSOM best publication awards of the Institute for Operations Research and the Management Sciences. Francis is currently Department Editor at Operations Research and MSOM Journal.
