The Econometric SocietyEdited by: Guido W. Imbens • Print ISSN: 0012-9682 • Online ISSN: 1468-0262
Econometrica: Mar, 2022, Volume 90, Issue 2
https://doi.org/10.3982/ECTA18583
p. 887-906
Graham Elliott, Nikolay Kudrin, Kaspar Wüthrich
We theoretically analyze the problem of testing for p‐hacking based on distributions of p‐values across multiple studies. We provide general results for when such distributions have testable restrictions (are non‐increasing) under the null of no p‐hacking. We find novel additional testable restrictions for p‐values based on t‐tests. Specifically, the shape of the power functions results in both complete monotonicity as well as bounds on the distribution of p‐values. These testable restrictions result in more powerful tests for the null hypothesis of no p‐hacking. When there is also publication bias, our tests are joint tests for p‐hacking and publication bias. A reanalysis of two prominent data sets shows the usefulness of our new tests.
Graham Elliott, Nikolay Kudrin, and Kaspar Wüthrich
This zip file contains the replication files for the manuscript.
March 5, 2024
The terms of the Editors of the Econometric Society's three journals end June 30, 2025. We are pleased to announce the incoming Editors and to thank the outgoing Editors for their excellent and continuing service.
Econometrica: Since 2019, Guido Imbens has served as the 14th Editor of Econometrica. On July 1, 2025, Marina Halac will become the Editor.
Quantitative Economics: Stéphane Bonhomme has been the Editor of Quantitative Economics since 2021. His successor will be Bernard Salanié.
Theoretical Economics: The Editor of Theoretical Economics since 2021 has been Simon Board. Taking over for him in July 2025 will be Federico Echenique.
Guido, Stéphane, and Simon have been outstanding Editors. We are grateful to them for the work they have done and will continue to do, and we look forward to further congratulating them next year. We believe Marina, Bernard, and Federico will be outstanding successors and we thank them in advance for their service.
Finally, we are grateful to Larry Samuelson for chairing all three search committees, and we thank the search committee members for their hard and fruitful work:
Econometrica: Christian Dustmann, Lars Hansen, Alessandro Lizzeri, George Mailath, Ariel Pakes, Helene Rey, and Elie Tamer.
QE: Kate Ho, Michael Keane, Felix Kubler, Whitney Newey, and Frank Schorfheide.
TE: Jeff Ely, Johannes Horner, Gilat Levy, Meg Meyer, and Ran Spiegler.
