GO Loss: A Gaussian Distribution-Based Orthogonal Decomposition Loss for Classification
Joint Authors
Tao, Wenyuan
Liu, Mengxin
Zhang, Xiao
Chen, Yi
Li, Jie
Own, Chung-Ming
Source
Issue
Vol. 2019, Issue 2019 (31 Dec. 2019), pp.1-10, 10 p.
Publisher
Hindawi Publishing Corporation
Publication Date
2019-12-12
Country of Publication
Egypt
No. of Pages
10
Main Subjects
Abstract EN
We present a novel loss function, namely, GO loss, for classification.
Most of the existing methods, such as center loss and contrastive loss, dynamically determine the convergence direction of the sample features during the training process.
By contrast, GO loss decomposes the convergence direction into two mutually orthogonal components, namely, tangential and radial directions, and conducts optimization on them separately.
The two components theoretically affect the interclass separation and the intraclass compactness of the distribution of the sample features, respectively.
Thus, separately minimizing losses on them can avoid the effects of their optimization.
Accordingly, a stable convergence center can be obtained for each of them.
Moreover, we assume that the two components follow Gaussian distribution, which is proved as an effective way to accurately model training features for improving the classification effects.
Experiments on multiple classification benchmarks, such as MNIST, CIFAR, and ImageNet, demonstrate the effectiveness of GO loss.
American Psychological Association (APA)
Liu, Mengxin& Tao, Wenyuan& Zhang, Xiao& Chen, Yi& Li, Jie& Own, Chung-Ming. 2019. GO Loss: A Gaussian Distribution-Based Orthogonal Decomposition Loss for Classification. Complexity،Vol. 2019, no. 2019, pp.1-10.
https://search.emarefa.net/detail/BIM-1133163
Modern Language Association (MLA)
Liu, Mengxin…[et al.]. GO Loss: A Gaussian Distribution-Based Orthogonal Decomposition Loss for Classification. Complexity No. 2019 (2019), pp.1-10.
https://search.emarefa.net/detail/BIM-1133163
American Medical Association (AMA)
Liu, Mengxin& Tao, Wenyuan& Zhang, Xiao& Chen, Yi& Li, Jie& Own, Chung-Ming. GO Loss: A Gaussian Distribution-Based Orthogonal Decomposition Loss for Classification. Complexity. 2019. Vol. 2019, no. 2019, pp.1-10.
https://search.emarefa.net/detail/BIM-1133163
Data Type
Journal Articles
Language
English
Notes
Includes bibliographical references
Record ID
BIM-1133163