In this work, we introduce a modified Holzapfel-Ogden hyperelastic constitutive model for ventricular myocardium that accounts for residual stresses, and we investigate the effects of residual stresses in diastole using a magnetic resonance imaging-derived model of the human left ventricle (LV). We adopt an invariant-based constitutive modelling approach and treat the left ventricular myocardium as a non-homogeneous, fibre-reinforced, incompressible material. Because in vivo images provide the configuration of the LV in a loaded state even in diastole, an inverse analysis is used to determine the corresponding unloaded reference configuration. The residual stress in this unloaded state is estimated by two different methods. One is based on three-dimensional strain measurements in a local region of the canine LV, and the other uses the opening angle method for a cylindrical tube. We find that including residual stress in the model changes the stress distributions across the myocardium and that whereas both methods yield qualitatively similar changes, there are quantitative differences between the two approaches. Although the effects of residual stresses are relatively small in diastole, the model can be extended to explore the full impact of residual stress on LV mechanical behaviour for the whole cardiac cycle as more experimental data become available. In addition, although not considered here, residual stresses may also play a larger role in models that account for tissue growth and remodelling.