The Econometric SocietyEdited by: Guido W. Imbens • Print ISSN: 0012-9682 • Online ISSN: 1468-0262
Econometrica: Nov, 2002, Volume 70, Issue 6
https://doi.org/10.1111/j.1468-0262.2002.00436.x
p. 2141-2166
Ed Hopkins
Reinforcement learning and stochastic fictitious play are apparent rivals as models of human learning. They embody quite different assumptions about the processing of information and optimization. This paper compares their properties and finds that they are far more similar than were thought. In particular, the expected motion of stochastic fictitious play and reinforcement learning with experimentation can both be written as a perturbed form of the evolutionary replicator dynamics. Therefore they will in many cases have the same asymptotic behavior. In particular, local stability of mixed equilibria under stochastic fictitious play implies local stability under perturbed reinforcement learning. The main identifiable difference between the two models is speed: stochastic fictitious play gives rise to faster learning.
March 5, 2024
The terms of the Editors of the Econometric Society's three journals end June 30, 2025. We are pleased to announce the incoming Editors and to thank the outgoing Editors for their excellent and continuing service.
Econometrica: Since 2019, Guido Imbens has served as the 14th Editor of Econometrica. On July 1, 2025, Marina Halac will become the Editor.
Quantitative Economics: Stéphane Bonhomme has been the Editor of Quantitative Economics since 2021. His successor will be Bernard Salanié.
Theoretical Economics: The Editor of Theoretical Economics since 2021 has been Simon Board. Taking over for him in July 2025 will be Federico Echenique.
Guido, Stéphane, and Simon have been outstanding Editors. We are grateful to them for the work they have done and will continue to do, and we look forward to further congratulating them next year. We believe Marina, Bernard, and Federico will be outstanding successors and we thank them in advance for their service.
Finally, we are grateful to Larry Samuelson for chairing all three search committees, and we thank the search committee members for their hard and fruitful work:
Econometrica: Christian Dustmann, Lars Hansen, Alessandro Lizzeri, George Mailath, Ariel Pakes, Helene Rey, and Elie Tamer.
QE: Kate Ho, Michael Keane, Felix Kubler, Whitney Newey, and Frank Schorfheide.
TE: Jeff Ely, Johannes Horner, Gilat Levy, Meg Meyer, and Ran Spiegler.
