Web-Based Evaluation System to Measure Learning Effectiveness in Kampo Medicine

Abstract EN

Measuring the learning effectiveness of Kampo Medicine (KM) education is challenging.

The aim of this study was to develop a web-based test to measure the learning effectiveness of KM education among medical students (MSs).

We used an open-source Moodle platform to test 30 multiple-choice questions classified into 8-type fields (eight basic concepts of KM) including “qi-blood-fluid” and “five-element” theories, on 117 fourth-year MSs.

The mean (±standard deviation [SD]) score on the web-based test was 30.2 ± 11.9 (/100).

The correct answer rate ranged from 17% to 36%.

A pattern-based portfolio enabled these rates to be individualized in terms of KM proficiency.

MSs with scores higher ( n = 19 ) or lower ( n = 14 ) than mean ± 1SD were defined as high or low achievers, respectively.

Cluster analysis using the correct answer rates for the 8-type field questions revealed clear divisions between high and low achievers.

Interestingly, each high achiever had a different proficiency pattern.

In contrast, three major clusters were evident among low achievers, all of whom responded with a low percentage of or no correct answers.

In addition, a combination of three questions accurately classified high and low achievers.

These findings suggest that our web-based test allows individual quantitative assessment of the learning effectiveness of KM education among MSs.