HappyFeet: Challenges in Building an Automated Dance Recognition and Assessment Tool
Links to Fileshttps://dl.acm.org/citation.cfm?id=3308759
MetadataShow full item record
Type of Work7 pages
journal articles postprints
Citation of Original PublicationAbu Zaher Md Faridee ,Sreenivasan Ramasamy Ramamurthy, Nirmalya Roy, HappyFeet: Challenges in Building an Automated Dance Recognition and Assessment Tool, GetMobile: Mobile Computing and Communications archive Volume 22 Issue 3, September 2018 Pages 10-16 , DOI: 10.1145/3308755.3308759
RightsThis item is likely protected under Title 17 of the U.S. Copyright Law. Unless on a Creative Commons license, for uses protected by Copyright Law, contact the copyright holder or the author.
In this paper, we discuss our experience in building an automated dance assessment tool with IMU and IoT devices and highlight the major challenges of such an endeavor. In a typical dance classroom scenario, where the students frequently outnumber their instructors, such a system can add an immense value to both parties by providing systematic breakdown of the dance moves, comparing the dance moves between the students and the instructors, and pinpointing the places for improvement in an autonomous way. Along that direction, our prototypical work, HappyFeet , showcases our initial attempts of developing such an intelligent Dance Activity Recognition (DAR) system. Our CNN based Body Sensor Network proves more effective (by ≈7% margin at 94.20%) at accurately recognizing the micro-steps of the dance activities than traditional feature engineering approaches. These metrics are derived by purposely evaluating the setup on a dance form known for its gentle, smooth and subtle limb movements. In this paper, we articulate how our proposed DAR framework will be generalizable for diverse dance styles involving very pronounced movements, human body kinematics and energy profiles.