Are Protein Force Fields Getting Better? A Systematic Benchmark on 524 Diverse NMR Measurements

Recent hardware and software advances have enabled simulation studies of protein systems on biophysically relevant time scales, often revealing the need for improved force fields. Although early force field development was limited by the lack of direct comparisons between simulation and experiment, recent work from several laboratories has demonstrated direct calculation of NMR observables from protein simulations. Here, we quantitatively evaluate 11 recent molecular dynamics force fields in combination with 5 solvent models against a suite of 524 chemical shift and J coupling (3JHNHα, 3JHNC?, 3JHαC?, 3JHNC?, and 3JHαN) measurements on dipeptides, tripeptides, tetra-alanine, and ubiquitin. Of the force fields examined (ff96, ff99, ff03, ff03*, ff03w, ff99sb*, ff99sb-ildn, ff99sb-ildn-phi, ff99sb-ildn-NMR, CHARMM27, and OPLS-AA), two force fields (ff99sb-ildn-phi, ff99sb-ildn-NMR) combining recent side chain and backbone torsion modifications achieved high accuracy in our benchmark. For the two optimal force fields, the calculation error is comparable to the uncertainty in the experimental comparison. This observation suggests that extracting additional force field improvements from NMR data may require increased accuracy in J coupling and chemical shift prediction. To further investigate the limitations of current force fields, we also consider conformational populations of dipeptides, which were recently estimated using vibrational spectroscopy.