I will present a thorough treatment of the theoretical uncertainties in the fits of the Higgs couplings. These uncertainties should be increasingly relevant for the new physics search as the LHC accumulates data. The analysis will be put in a broad statistical context, including conceptual discussions and the development of new methods related to systematic uncertainties.