← Statistics and Research Methods › Causal Inference

Correcting errors in machine-learned covariates can change a treatment-effect estimate in ways that separate corrections do not predict. Each correction changes the regression's adjustment for other variables, so its effect can depend on which errors have already been corrected. Existing methods use verified measurements to correct inference and guide validation. We study the joint effects of finite corrections on a fitted coefficient. Our diagnostic replaces sets of proxy covariates with verified values and compares the resulting refits with the sum of isolated correction effects. Exact least-squares identities locate the source of nonadditivity in changes to the regression's cross-product matrix. Correction paths describe how the coefficient moves as more measurements are corrected, and their dispersion describes how much the choice of correction set matters. Established Shapley methods attribute the endpoint change. Simulations illustrate these distinctions. Applications to housing and text-coded incivility compare refits with three additive approximations: isolated corrections track small random correction sets closely but misstate the full correction. The resulting diagnostic measures both the consequences of individual errors and the additional changes produced by correcting them together.

Cite: Gaurav Sood. "Which Prediction Errors Matter? Finite Covariate-Correction Paths for Downstream Regression." https://gsood.com/research/partial-credit-diagnosing-proxy-covariates-with-validation-swaps/

BibTeX:
@misc{soodpartial,
  author = {Gaurav Sood},
  title = {{Which Prediction Errors Matter? Finite Covariate-Correction Paths for Downstream Regression}},
  note = {Working paper},
  url = {https://gsood.com/research/partial-credit-diagnosing-proxy-covariates-with-validation-swaps/}
}