Propensity Score Matching is a popular approach to evaluate treatment effects in observational studies. Regrettably, practitioners often overlook the issue of model uncertainty and its consequences when building the propensity score model. We tackle this problem by Bayesian Model Averaging (BMA) with an application to the 2014 Italian tax credit reform (the so-called “Renzi bonus”). Model uncertainty has a dramatic impact on the estimated treatment effects: using standard model selection procedures may lead to choosing equally defensible models that, however, produce substantially heterogeneous results. By using BMA-based estimates, we find a much more coherent picture: significant effect of the rebate on food consumption only for liquidity constrained households, in line with most recent literature.
No such thing as the perfect match: Bayesian Model Averaging for treatment evaluation / Lucchetti, Riccardo; Pedini, Luca; Pigini, Claudia. - In: ECONOMIC MODELLING. - ISSN 0264-9993. - ELETTRONICO. - 107:(2022). [10.1016/j.econmod.2021.105729]
No such thing as the perfect match: Bayesian Model Averaging for treatment evaluation
Lucchetti, Riccardo;Pedini, Luca;Pigini, Claudia
2022-01-01
Abstract
Propensity Score Matching is a popular approach to evaluate treatment effects in observational studies. Regrettably, practitioners often overlook the issue of model uncertainty and its consequences when building the propensity score model. We tackle this problem by Bayesian Model Averaging (BMA) with an application to the 2014 Italian tax credit reform (the so-called “Renzi bonus”). Model uncertainty has a dramatic impact on the estimated treatment effects: using standard model selection procedures may lead to choosing equally defensible models that, however, produce substantially heterogeneous results. By using BMA-based estimates, we find a much more coherent picture: significant effect of the rebate on food consumption only for liquidity constrained households, in line with most recent literature.I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.