HappyFeet: Challenges in Building an Automated Dance Recognition and Assessment Tool
Loading...
Links to Files
Permanent Link
Author/Creator
Author/Creator ORCID
Date
2018-09
Type of Work
Department
Program
Citation of Original Publication
Abu Zaher Md Faridee ,Sreenivasan Ramasamy Ramamurthy, Nirmalya Roy, HappyFeet: Challenges in Building an Automated Dance Recognition and Assessment Tool, GetMobile: Mobile Computing and Communications archive Volume 22 Issue 3, September 2018 Pages 10-16 , DOI: 10.1145/3308755.3308759
Rights
This item is likely protected under Title 17 of the U.S. Copyright Law. Unless on a Creative Commons license, for uses protected by Copyright Law, contact the copyright holder or the author.
Abstract
In this paper, we discuss our experience in building an automated dance assessment tool with IMU and IoT devices and highlight the major challenges of such an endeavor. In a typical dance classroom scenario, where the students frequently outnumber their instructors, such a system can add an immense value to both parties by providing systematic breakdown of the dance moves, comparing the dance moves between the students and the instructors, and pinpointing the places for improvement in an autonomous way. Along that direction, our prototypical work, HappyFeet [1], showcases our initial attempts of developing such an intelligent Dance Activity Recognition (DAR) system. Our CNN based Body Sensor Network proves more effective (by ≈7% margin at 94.20%) at accurately recognizing the micro-steps of the dance activities than traditional feature engineering approaches. These metrics are derived by purposely evaluating the setup on a dance form known for its gentle, smooth and subtle limb movements. In this paper, we articulate how our proposed DAR framework will be generalizable for diverse dance styles involving very pronounced movements, human body kinematics and energy profiles.