It Is Your Turn: Collaborative Ideation with a Co-Creative Robot through Sketch
Yuyu Lin, Jiahao Guo, Yang Chen, Cheng Yao, Fangtian Ying
Compared with virtual agents, sketching on paper with embodied robots could be more engaging for designers’ early-stage ideation and collaborative practices. We envision the possibility of Cobbie, a mobile robot that ideates iteratively with designers by generating creative and diverse sketches. We conducted a comparative experiment and analyzed the data collected from quantitative scales, observation, and semi-structured interviews. Finally, we discussed the prospects of co-creative robots for human-AI collaborative systems.
Comparing the Tangible Tutorial System and the Human Teacher in Intangible Cultural Heritage Education
Jiahao Guo, Yuyu Lin, Hongyu Yang, Junwu Wang, Shuo Li, Enmao Liu, Cheng Yao, Fangtian Ying
We designed an introductory course and presented BatikGuide, a tangible tutorial system that provides visual and vocal instructions and real-time evaluations. Our comparative experiment showed that BatikGuide has the potential in Intangible Cultural Heritage education, especially stimulating learning motivation, large-scale replication, and public dissemination.
AquaBot: An Interactive System for Digital Water Play
Lijuan Liu, Cheng Yao, Yuyu Lin, Yang Chen, Ziyu Liu, Fangtian Ying
Water is a ubiquitous game medium in everyday life. In this paper, we take an interest in digital games with physical water and propose AquaBot an interactive water game system. It includes an underwater robot and a wearable wristband. The robot can change existing states such as light, color, and movement, based on its interaction with the player and environment. The wearable device is used to control and interact with the robot. After test, we discuss design factors of interaction with underwater robot from water environment, human and device.
IPANDA: A playful hybrid product for facilitating children’s wildlife conservation education
Yang Chen, Yuyu Lin, Junwu Wang, Lijuan Liu, Cheng Yao, Fangtian Ying
We introduced the concept of a hybrid product that combines a digital game with physical experiences. We made a preliminary prototype IPANDA, which includes sensing modules and software applications to gather real-time environmental data and connected to one virtual wildlife experiencing environmental challenges. Children who play the product can learn about the environment around them and foster wildlife protection awareness.
Shadower: Applying Shadows to Children’s Outdoor Interaction
Yang Chen, Yuyu Lin, Lijuan Liu, Cheng Yao, Fangtian Ying
Shadows are ubiquitous in our life. We focus on a novel way which can change people’s perspectives of observing surroundings and create a natural outdoor interaction for children in their daily life. In this paper, we present a mobile AR game that uses shadows as clues with a treasure hunting game mechanism to make a connection with children and outdoor surroundings.
OlfacEnhancer: A Vision-Based Scented Necklace for Cross-Modal Interactions
Yuyu Lin, Kai Zheng, Jiahao Guo, Cheng Yao, Fangtian Ying
Visual and olfactory collaborations affect our living experiences. In this paper, we propose OlfacEnhancer, a pendant to augment real-world olfactory perception synchronizing visual information. We present the compact hardware design that can release seven different scents and the implementation of a computer-vision-based self-sufficient system, which includes automatic image capture and real-time object recognition.
iDraw: Wall Painting Robot for Multiple Wall Textures and Angles of Inclination
Yuyu Lin, Ye He, Zhuangtian Zhu, Ying Yang
Manual wall painting has limitations in its low efficiency, high error rate and potential danger. Existing mature facade robots on the market can only work on the glass or metal plane, which cannot meet the requirements of the adaptability of wall painting. Therefore, we develop a façade drawing robot, iDraw, which can move stably on surfaces with different textures and inclination.