top of page
Co-Creative Robot: Gallery

Comparing the Tangible Tutorial System and the Human Teacher in Intangible Cultural Heritage Education

Jiahao Guo, Yuyu Lin, Hongyu Yang, Junwu Wang, Shuo Li, Enmao Liu, Cheng Yao, Fangtian Ying

Publication: In Proceedings of the 2020 ACM Designing Interactive Systems Conference (DIS 2020)

Skill: Hardware Prototyping, Service Design, Gesture Recognition, Similarity Matching

Abstract. Computer-supported digital-physical tutorial systems have been widely used in the field of Intangible Cultural Heritage (ICH) education for their advances in conveying multimodal contents. However, there is limited work to compare the strengths and weaknesses of the teaching effects of the human teachers and the non-human tutorial systems in ICH education. In this paper, we designed an introductory course and presented BatikGuide, a tangible tutorial system that provides visual and vocal instructions, and real-time evaluations. Followed by we conducted a comparative experiment and analyzed the data collected from the quantitative scales, observation, and semi-structured interviews. The results revealed that there is no obvious disparity between BatikGuide and the human teacher. Although the human teacher could have better performance in professional instructions, BatikGuide remains the potential in stimulating learning motivation, large-scale replication, and public dissemination. According to these findings, we discussed the prospects of computer-based systems in ICH education and preservation.

Keyword: Intangible cultural heritage; Intangible cultural heritage education; Batik; Tangible tutorial system; Tangible tabletop.

Co-Creative Robot: Text

Service Design

We designed the teaching process of an introductory Batik course. a) have a basic understanding of the course and batik art, b) explain the characteristics of three different waxes, c) tell the story related to the origin of batik, d) explain the structure and the development history of brass knife, e) explain differences between different size of brass knives, f) teach how to use the brass knife, g) tell the legend of the origin of the Miao nationality with the folklore of Mother Butterfly, and explain the significance of batik to the Miao people, h) draw batik pattern under the instruction of the teacher as a final practice.


Learners could get real-time feedback from our acoustic-optic interactive system.


Real-time Multitask Evaluation System


We designed the evaluation framework flow including color detector, hand gesture recognition and similarity matching. When the color detector detects “blue”, Gesture recognizer start the task for 30 seconds, and repeat one time if the success rate less than 50%; when the Color detector detects “green”, clip the figure and save it; when the Color detector detects “purple”, clip the user drawing figure and compare it with the saved figure.

bottom of page