Global distance test
The global distance test (GDT), also written as GDT_TS to represent "total score", is a measure of similarity between two protein structures with known amino acid correspondences (e.g. identical amino acid sequences) but different tertiary structures. It is most commonly used to compare the results of protein structure prediction to the experimentally determined structure as measured by X-ray crystallography, protein NMR, or, increasingly, cryoelectron microscopy.
The GDT metric was developed by Adam Zemla at Lawrence Livermore National Laboratory and originally implemented in the Local-Global Alignment (LGA) program.[1][2] It is intended as a more accurate measurement than the common root-mean-square deviation (RMSD) metric - which is sensitive to outlier regions created, for example, by poor modeling of individual loop regions in a structure that is otherwise reasonably accurate.[1] The conventional GDT_TS score is computed over the alpha carbon atoms and is reported as a percentage, ranging from 0 to 100. In general, the higher the GDT_TS score, the more closely a model approximates a given reference structure.
GDT_TS measurements are used as major assessment criteria in the production of results from the Critical Assessment of Structure Prediction (CASP), a large-scale experiment in the structure prediction community dedicated to assessing current modeling techniques.[1][3][4] The metric was first introduced as an evaluation standard in the third iteration of the biannual experiment (CASP3) in 1998.[3] Various extensions to the original method have been developed; variations that accounts for the positions of the side chains are known as global distance calculations (GDC).[5]
Calculation
[edit]The GDT score is calculated as the largest set of amino acid residues' alpha carbon atoms in the model structure falling within a defined distance cutoff of their position in the experimental structure, after iteratively superimposing the two structures. By the original design the GDT algorithm calculates 20 GDT scores, i.e. for each of 20 consecutive distance cutoffs (0.5 Å, 1.0 Å, 1.5 Å, ... 10.0 Å).[2] For structure similarity assessment it is intended to use the GDT scores from several cutoff distances, and scores generally increase with increasing cutoff. A plateau in this increase may indicate an extreme divergence between the experimental and predicted structures, such that no additional atoms are included in any cutoff of a reasonable distance. The conventional GDT_TS total score in CASP is the average result of cutoffs at 1, 2, 4, and 8 Å.[1][6][7]
Variations and extensions
[edit]The original GDT_TS is calculated based on the superimpositions and GDT scores produced by the Local-Global Alignment (LGA) program.[1] A "high accuracy" version called GDT_HA is computed by selection of smaller cutoff distances (half the size of GDT_TS) and thus more heavily penalizes larger deviations from the reference structure. It was used in the high accuracy category of CASP7.[8] CASP8 defined a new "TR score", which is GDT_TS minus a penalty for residues clustered too close, meant to penalize steric clashes in the predicted structure, sometimes to game the cutoff measure of GDT.[9][10]
The primary GDT assessment uses only the alpha carbon atoms. To apply superposition‐based scoring to the amino acid residue side chains, a GDT‐like score called "global distance calculation for sidechains" (GDC_sc) was designed and implemented within the LGA program in 2008.[1][5] Instead of comparing residue positions on the basis of alpha carbons, GDC_sc uses a predefined "characteristic atom" near the end of each residue for the evaluation of inter-residue distance deviations. An "all atoms" variant of the GDC score (GDC_all) is calculated using full-model information, and is one of the standard measures used by CASP's organizers and assessors to evaluate accuracy of predicted structural models.[5][7][11]
GDT scores are generally computed with respect to a single reference structure. In some cases, structural models with lower GDT scores to a reference structure determined by protein NMR are nevertheless better fits to the underlying experimental data.[12] Methods have been developed to estimate the uncertainty of GDT scores due to protein flexibility and uncertainty in the reference structure.[13]
See also
[edit]- Root mean square deviation (bioinformatics) — A different structure comparison measure.
- TM-score — A different structure comparison measure.
References
[edit]- ^ a b c d e f Zemla A (2003). "LGA: A method for finding 3D similarities in protein structures". Nucleic Acids Research. 31 (13): 3370–3374. doi:10.1093/nar/gkg571. PMC 168977. PMID 12824330.
- ^ a b US patent 8024127 B2, Adam Zemla, "Local-Global Alignment for Finding 3D Similarities in Protein Structures", issued 20 September 2011, assigned to Lawrence Livermore National Security, LLC
- ^ a b Zemla A, Venclovas C, Moult J, Fidelis K (1999). "Processing and analysis of CASP3 protein structure predictions". Proteins. S3 (S3): 22–29. doi:10.1002/(SICI)1097-0134(1999)37:3+<22::AID-PROT5>3.0.CO;2-W. PMID 10526349. S2CID 29803757.
- ^ Zemla A, Venclovas C, Moult J, Fidelis K (2001). "Processing and evaluation of predictions in CASP4". Proteins. 45 (S5): 13–21. doi:10.1002/prot.10052. PMID 11835478. S2CID 28166260.
- ^ a b c Keedy, D.A.; Williams, CJ; Headd, JJ; Arendall, WB; Chen, VB; Kapral, GJ; Gillespie, RA; Block, JN; Zemla, A; Richardson, DC; Richardson, JS (2009). "The other 90% of the protein: Assessment beyond the α-carbon for CASP8 template-based and high-accuracy models". Proteins. 77 (Suppl 9): 29–49. doi:10.1002/prot.22551. PMC 2877634. PMID 19731372.
- ^ Kryshtafovych, A; Prlic, A; Dmytriv, Z; Daniluk, P; Milostan, M; Eyrich, V; Hubbard, T; Fidelis, K (2007). "New tools and expanded data analysis capabilities at the Protein Structure Prediction Center". Proteins. 69 Suppl 8 (S8): 19–26. doi:10.1002/prot.21653. PMC 2656758. PMID 17705273.
- ^ a b "Results Table Help". 14th Community Wide Experiment on the Critical Assessment of Techniques for Protein Structure Prediction. Retrieved 27 December 2020.
- ^ Read, Randy J.; Chavali, Gayatri (2007). "Assessment of CASP7 predictions in the high accuracy template-based modeling category". Proteins. 69 (S8): 27–37. doi:10.1002/prot.21662. PMID 17894351. S2CID 33172629.
- ^ Shi, S; Pei, J; Sadreyev, RI; Kinch, LN; Majumdar, I; Tong, J; Cheng, H; Kim, BH; Grishin, NV (2009). "Analysis of CASP8 targets, predictions and assessment methods". Database: The Journal of Biological Databases and Curation. 2009: bap003. doi:10.1093/database/bap003. PMC 2794793. PMID 20157476.. Related page
- ^ Sadreyev, RI; Shi, S; Baker, D; Grishin, NV (15 May 2009). "Structure similarity measure with penalty for close non-equivalent residues". Bioinformatics. 25 (10): 1259–63. doi:10.1093/bioinformatics/btp148. PMC 2677741. PMID 19321733.
- ^ Modi V, Xu QF, Adhikari S, Dunbrack RL (2016). "Assessment of template-based modeling of protein structure in CASP11". Proteins. 84 (Suppl 1): 200–220. doi:10.1002/prot.25049. PMC 5030193. PMID 27081927.
- ^ MacCallum, Justin L.; Hua, Lan; Schnieders, Michael J.; Pande, Vijay S.; Jacobson, Matthew P.; Dill, Ken A. (2009). "Assessment of the protein-structure refinement category in CASP8". Proteins: Structure, Function, and Bioinformatics. 77 (S9): 66–80. doi:10.1002/prot.22538. PMC 2801025. PMID 19714776.
- ^ Li, Wenlin; Schaeffer, R. Dustin; Otwinowski, Zbyszek; Grishin, Nick V. (5 May 2016). "Estimation of Uncertainties in the Global Distance Test (GDT_TS) for CASP Models". PLOS ONE. 11 (5): e0154786. Bibcode:2016PLoSO..1154786L. doi:10.1371/journal.pone.0154786. PMC 4858170. PMID 27149620.
External links
[edit]- CASP14 results - summary tables of the latest CASP experiment run in 2020, including example plots of GDT score as a function of cutoff distance
- GDT, GDC, LCS and LGA description services and documentation on structure comparison and similarity measures.