Econometrica

Journal Of The Econometric Society

An International Society for the Advancement of Economic
Theory in its Relation to Statistics and Mathematics

Edited by: Guido W. Imbens • Print ISSN: 0012-9682 • Online ISSN: 1468-0262

Econometrica: Sep, 2020, Volume 88, Issue 5

Analysis of Testing-Based Forward Model Selection

https://doi.org/10.3982/ECTA16273
p. 2147-2173

Damian Kozbur

This paper analyzes a procedure called Testing‐Based Forward Model Selection (TBFMS) in linear regression problems. This procedure inductively selects covariates that add predictive power into a working statistical model before estimating a final regression. The criterion for deciding which covariate to include next and when to stop including covariates is derived from a profile of traditional statistical hypothesis tests. This paper proves probabilistic bounds, which depend on the quality of the tests, for prediction error and the number of selected covariates. As an example, the bounds are then specialized to a case with heteroscedastic data, with tests constructed with the help of Huber–Eicker–White standard errors. Under the assumed regularity conditions, these tests lead to estimation convergence rates matching other common high‐dimensional estimators including Lasso.


Log In To View Full Content

Supplemental Material

Supplement to "Analysis of Testing-Based Forward Model Selection"

This zip file contains the replication files for the manuscript.

Supplement to "Analysis of Testing-Based Forward Model Selection"

This appendix contains material not found within the manuscript.