Tongue Image Database Construction Based on the Expert Opinions: Assessment for Individual Agreement and Methods for Expert Selection
Joint Authors
Xu, Jia-Tuo
Tu, Li Ping
Qi, Zhen
Hu, Xiao-juan
Zhang, Zhi-feng
Wang, Weijian
Luo, Zhi-yu
Jiao, Wen
Zeng, Ling-zhi
Jing, Cong-cong
Ma, Xu-xiang
Source
Evidence-Based Complementary and Alternative Medicine
Issue
Vol. 2018, Issue 2018 (31 Dec. 2018), pp.1-9, 9 p.
Publisher
Hindawi Publishing Corporation
Publication Date
2018-10-02
Country of Publication
Egypt
No. of Pages
9
Main Subjects
Abstract EN
This study aims at introducing a method for individual agreement evaluation to identify the discordant raters from the experts’ group.
We exclude those experts and decide the best experts selection method, so as to improve the reliability of the constructed tongue image database based on experts’ opinions.
Fifty experienced experts from the TCM diagnostic field all over China were invited to give ratings for 300 randomly selected tongue images.
Gwet’s AC1 (first-order agreement coefficient) was used to calculate the interrater and intrarater agreement.
The optimization of the interrater agreement and the disagreement score were put forward to evaluate the external consistency for individual expert.
The proposed method could successfully optimize the interrater agreement.
By comparing three experts’ selection methods, the interrater agreement was, respectively, increased from 0.53 [0.32-0.75] for original one to 0.64 [0.39-0.80] using method A (inclusion of experts whose intrarater agreement>0.6), 0.69 [0.63-0.81] using method B (inclusion of experts whose disagreement score=“0”), and 0.76 [0.67-0.83] using method C (inclusion of experts whose intrarater agreement>0.6& disagreement score=“0”).
In this study, we provide an estimate of external consistency for individual expert, and the comprehensive consideration of both the internal consistency and the external consistency for each expert would be superior to either one in the tongue image construction based on expert opinions.
American Psychological Association (APA)
Qi, Zhen& Tu, Li Ping& Luo, Zhi-yu& Hu, Xiao-juan& Zeng, Ling-zhi& Jiao, Wen…[et al.]. 2018. Tongue Image Database Construction Based on the Expert Opinions: Assessment for Individual Agreement and Methods for Expert Selection. Evidence-Based Complementary and Alternative Medicine،Vol. 2018, no. 2018, pp.1-9.
https://search.emarefa.net/detail/BIM-1156583
Modern Language Association (MLA)
Qi, Zhen…[et al.]. Tongue Image Database Construction Based on the Expert Opinions: Assessment for Individual Agreement and Methods for Expert Selection. Evidence-Based Complementary and Alternative Medicine No. 2018 (2018), pp.1-9.
https://search.emarefa.net/detail/BIM-1156583
American Medical Association (AMA)
Qi, Zhen& Tu, Li Ping& Luo, Zhi-yu& Hu, Xiao-juan& Zeng, Ling-zhi& Jiao, Wen…[et al.]. Tongue Image Database Construction Based on the Expert Opinions: Assessment for Individual Agreement and Methods for Expert Selection. Evidence-Based Complementary and Alternative Medicine. 2018. Vol. 2018, no. 2018, pp.1-9.
https://search.emarefa.net/detail/BIM-1156583
Data Type
Journal Articles
Language
English
Notes
Includes bibliographical references
Record ID
BIM-1156583