MyKeepon Project

Help people improve their emotional regulation skills by interacting with Keepon robot

Time: May – December 2015

Team: Yu, advised by Dr. Malte Jung

Role: User Researcher, Arduino Developer, Project Manager

Methodology: Literature review, User Testing, User Interviews, Behavior Mapping, Design Thinking, Prototyping, Wizard of Oz, Arduino Programming, 3-D Printing

Tools: Pen & Paper, Arduino

Product: A fully functional Keepon robot that we have been used to running study and collecting data. A complete exploratory human-robot interaction study


Overview

This project was to design human-robot interactions using socially assistive robot - Keepon. The purpose of this exploratory study was to see how a robot’s “empathy behaviors” can help college students regulate their emotions.


My Roles and Process

This was an individual research project with Dr. Malte Jung, and I had many roles throughout the project. My roles:

  1. User Researcher: At the beginning, I studied how people express empathy behaviors to each other, and my goal was to map human behaviors to Keepon’s movement. I interviewed 4 colleagues. For each interview, I asked my interviewee to listen to a sad story of my own without any verbal expressions. In other words, my interviewees could only use their body language to express empathy to my sad story. Later, each interviewee received an in-depth interview.
    I learned different behaviors people used for expressing empathy. One example is that people might use small nods to indicate they were listening but big nods when they heard an important part of the story. Other examples included how people idly look around and how people move their bodies.

  2. Arduino Developer: I was the main developer throughout the study. I worked with the open source code and modified it for our purpose. Although I am not trained as a developer, I love solving challenging problems, and it is very rewarding to see my robot moving according to my code. With well documented online Arduino tutorials and my knowledge in C++, I was able to write reliable Arduino programs. Here is the GitHub repository for this project: github.com/yuqicornell/KeeponRobot.

  3. Project Manager: Later in this project, I had an undergraduate team working with me. At different stages, I defined and communicated project objectives with my team. I also coordinated the project schedule and progress between my team and advising professor. Furthermore, I oversaw the execution of each experiment session, collected information, and led regular team discussions.

Keepon Robot

For this study, we used an open-source robot - Keepon. One reason is because it has great degrees of freedom in regards to movement. We can easily simulate human behaviors with Keepon, such as nodding, shaking head, idly looking, and breathing. Through those behaviors, Keepon is also capable of conveying human emotions, like happy, sad, excitement, etc.

Keepon movement DOF
Fig 1. Illustration of four degrees of freedom in Keepon movement

3D Printing

The process of building a Keepon robot was lots of fun! I 3D printed all the parts that are needed. Then, I modified the Keepon from a toy version to a robot that I can program.

3d printing
Fig 2. 3D Printer and 3D Printed Parts
Finished Keepon
Fig 3. Finished Keepon robot

Keepon’s interaction with kids in Sciencenter, Ithaca NY

I presented our robot to children around 10 years old in Sciencenter, Ithaca. It was an educational activity of teaching children robotics, but the enthusiasm children showed towards the Keepon robot gave us great confidence moving forward.

children interaction with Keepon
Fig 3. Chidren interact with Keepon in Sciencenter, Ithaca
children keyboard interface
Fig 4. Simple interface designed for children

Lab User Study

We also designed user studies in laboratory setting. Experimenters controlled Keepon from another room using the Wizard of Oz method. By observing users’ behavior, the experimenter issues corresponding movement commands to Keepon. We used different psychological and behavioral measurements to evaluate the emotional responses of our participants.

* The study has not been published, and I have omitted confidential study information in this project description.