King's College London

Research portal

Multi-factorial analysis of class prediction error: estimating optimal number of biomarkers for various classification rules

Research output: Contribution to journalArticle

Mizanur Khondoker, Till T Bachmann, Muriel Mewissen, Paul Dickinson, Bartosz Dobrzelecki, Colin J Campbell, Andrew R Mount, Anthony J Walton, Jason Crain, Holger Schulze, Gerard Giraud, Alan J Ross, Ilenia Ciani, Stuart W J Ember, Chaker Tlili, Jonathan G Terry, Eilidh Grant, Nicola McDonnell, Peter Ghazal

Original languageEnglish
Pages (from-to)945-965
Number of pages21
JournalJournal of Bioinformatics and Computational Biology
Issue number6
Publication statusPublished - Dec 2010

King's Authors


Machine learning and statistical model based classifiers have increasingly been used with more complex and high dimensional biological data obtained from high-throughput technologies. Understanding the impact of various factors associated with large and complex microarray datasets on the predictive performance of classifiers is computationally intensive, under investigated, yet vital in determining the optimal number of biomarkers for various classification purposes aimed towards improved detection, diagnosis, and therapeutic monitoring of diseases. We investigate the impact of microarray based data characteristics on the predictive performance for various classification rules using simulation studies. Our investigation using Random Forest, Support Vector Machines, Linear Discriminant Analysis and k-Nearest Neighbour shows that the predictive performance of classifiers is strongly influenced by training set size, biological and technical variability, replication, fold change and correlation between biomarkers. Optimal number of biomarkers for a classification problem should therefore be estimated taking account of the impact of all these factors. A database of average generalization errors is built for various combinations of these factors. The database of generalization errors can be used for estimating the optimal number of biomarkers for given levels of predictive accuracy as a function of these factors. Examples show that curves from actual biological data resemble that of simulated data with corresponding levels of data characteristics. An R package optBiomarker implementing the method is freely available for academic use from the Comprehensive R Archive Network (

View graph of relations

© 2018 King's College London | Strand | London WC2R 2LS | England | United Kingdom | Tel +44 (0)20 7836 5454