Statistical criterion for comparison of binary classifier accuracy

Abstract

© Published under licence by IOP Publishing Ltd. An ABC-method (Accuracy Binary Classifier) for a more accurate assessment of the binary classifier's quality compared to the ROC-method (Receiver Operating Characteristic) is proposed. The ABC-method is suitable for quantitative and qualitative measures in independent and dependent small samples and it is not limited by the laws of distribution of objects in a sample. The ABC-method is effective for classification issues in different scientific and applied fields: IT, physical, technical, medical.