Binary classification: counterbalancing class imbalance by applying regression models in combination with one-sided label shifts
Preprint
Authors
Bellmann, Peter
Hihn, Heinke
Braun, Daniel A.
Schwenker, Friedhelm
Faculties
Fakultät für Ingenieurwissenschaften, Informatik und PsychologieInstitutions
Institut für NeuroinformatikLink to original publication
Abstract
In many real-world pattern recognition scenarios, such as in medical applications, the corresponding classification tasks can be of an imbalanced nature. In the current study, we focus on binary, imbalanced classification tasks, i.e.~binary classification tasks in which one of the two classes is under-represented (minority class) in comparison to the other class (majority class). In the literature, many different approaches have been proposed, such as under- or oversampling, to counter class imbalance. In the current work, we introduce a novel method, which addresses the issues of class imbalance. To this end, we first transfer the binary classification task to an equivalent regression task. Subsequently, we generate a set of negative and positive target labels, such that the corresponding regression task becomes balanced, with respect to the redefined target label set. We evaluate our approach on a number of publicly available data sets in combination with Support Vector Machines. Moreover, we compare our proposed method to one of the most popular oversampling techniques (SMOTE). Based on the detailed discussion of the presented outcomes of our experimental evaluation, we provide promising ideas for future research directions.
Funding information
Multimodale Affekterkennung im Verlaufe eines tutoriellen Lernexperiments / DFG [394413900, SCHW623/7-1]
EU Project
BRISC / Bounded Rationality in Sensorimotor Coordination / EC / H2020 / 678082
Subject Headings
Support-Vektor-Maschine [GND]Support vector machines [LCSH]
Regression analysis [LCSH]
Keywords
Regression; Imbalanced classification tasks; Binary classificationDewey Decimal Group
DDC 000 / Computer science, information & general worksMetadata
Show full item recordCitation example
Bellmann, Peter et al. (2021): Binary classification: counterbalancing class imbalance by applying regression models in combination with one-sided label shifts. Open Access Repositorium der Universität Ulm. http://dx.doi.org/10.18725/OPARU-34233