Researchers increasingly use machine-learning predictions as covariates, including controls for confounding. Prediction error can then change the estimated effect of interest. Regression calibration offers an established baseline: use a labeled sample to predict the true covariate from its machine-generated surrogate and the other regression variables. We explain when this procedure identifies a linear model and what can go wrong when calibration must itself be learned. A population projection can suffice without a correct conditional-mean model, but estimated calibration must preserve the residual relationships that identify the downstream coefficients. We connect departures from those relationships to coefficient error, distinguish many calibration predictors from many mismeasured covariates, and separate estimation error from failures of support and transport. Exact examples show how omitting treatment or imposing shrinkage changes confounding adjustment; simulations illustrate these mechanisms. The resulting framework makes regression calibration a transparent benchmark for evaluating methods that use machine-learned covariates.
Cite: Gaurav Sood. "Regression Calibration as a Baseline for Machine-Learned Covariates." https://gsood.com/research/two-regressions-and-a-bootstrap-regression-calibration-for-ml-generated-covariates-and-the-nonlinear-boundary/
BibTeX:
@misc{soodtwo,
author = {Gaurav Sood},
title = {{Regression Calibration as a Baseline for Machine-Learned Covariates}},
note = {Working paper},
url = {https://gsood.com/research/two-regressions-and-a-bootstrap-regression-calibration-for-ml-generated-covariates-and-the-nonlinear-boundary/}
}