How to do an evaluation: pitfalls and traps
Open Access
- 23 January 2008
- journal article
- research article
- Published by Springer Nature in Journal of Computer-Aided Molecular Design
- Vol. 22 (3-4) , 179-190
- https://doi.org/10.1007/s10822-007-9166-3
Abstract
The recent literature is replete with papers evaluating computational tools (often those operating on 3D structures) for their performance in a certain set of tasks. Most commonly these papers compare a number of docking tools for their performance in cognate re-docking (pose prediction) and/or virtual screening. Related papers have been published on ligand-based tools: pose prediction by conformer generators and virtual screening using a variety of ligand-based approaches. The reliability of these comparisons is critically affected by a number of factors usually ignored by the authors, including bias in the datasets used in virtual screening, the metrics used to assess performance in virtual screening and pose prediction and errors in crystal structures used.Keywords
This publication has 43 references indexed in Scilit:
- Frog: a FRee Online druG 3D conformation generatorNucleic Acids Research, 2007
- Benchmarking Sets for Molecular DockingJournal of Medicinal Chemistry, 2006
- A Distance Function for Retrieval of Active Molecules from Complex Chemical Space RepresentationsJournal of Chemical Information and Modeling, 2006
- Ph4Dock: Pharmacophore-Based Protein−Ligand DockingJournal of Medicinal Chemistry, 2004
- Virtual Screening Using Protein−Ligand Docking: Avoiding Artificial EnrichmentJournal of Chemical Information and Computer Sciences, 2004
- A new test set for validating predictions of protein–ligand interactionProteins-Structure Function and Bioinformatics, 2002
- The Protein Data BankNucleic Acids Research, 2000
- Contact area difference (CAD): a robust measure to evaluate accuracy of protein modelsJournal of Molecular Biology, 1997
- Development and validation of a genetic algorithm for flexible docking 1 1Edited by F. E. CohenJournal of Molecular Biology, 1997
- Merck molecular force field. I. Basis, form, scope, parameterization, and performance of MMFF94Journal of Computational Chemistry, 1996