Learning to Understand Non-Categorical Physical Language for Human Robot Interactions
dc.contributor.author | Richards, Luke E. | |
dc.contributor.author | Matuszek, Cynthia | |
dc.date.accessioned | 2021-04-09T17:21:39Z | |
dc.date.available | 2021-04-09T17:21:39Z | |
dc.description | Proceedings of the RSS 2019 workshop on AI and Its Alternatives in Assistive and Collaborative Robotics (RSS: AI+ACR) | en_US |
dc.description.abstract | Learning the meaning of language with respect to the physical world in which a robot operates is a necessary step for shared autonomy systems in which natural language is part of a user-specific, customizable interface. We propose a learning system in which language is grounded in visual percepts without pre-defined category constraints by combining CNNbased visual identification with natural language labels, moving towards making it possible for people to use language as a highlevel control system for low-level world interactions, allowing a system to operate on shared visual/linguistic embeddings. We evaluate the efficacy of this learning by evaluating against a wellknown object dataset, and report preliminary results that outline the feasibility of pursuing a visual feature approach to domainfree language understanding. | en_US |
dc.description.sponsorship | This material is based upon work supported by the National Science Foundation under Grant No. 1637614 and No.1657469. | en_US |
dc.description.uri | http://iral.cs.umbc.edu/Pubs/RichardsMatuszekRSSws2019.pdf | en_US |
dc.format.extent | 5 pages | en_US |
dc.genre | conference papers and proceedings | en_US |
dc.identifier | doi:10.13016/m2lbuq-ulee | |
dc.identifier.citation | Luke E. Richards and Cynthia Matuszek. “Learning to Understand Non-Categorical Physical Language for Human Robot Interactions.” In Proceedings of the RSS 2019 workshop on AI and Its Alternatives in Assistive and Collaborative Robotics (RSS: AI+ACR), http://iral.cs.umbc.edu/Pubs/RichardsMatuszekRSSws2019.pdf | en_US |
dc.identifier.uri | http://hdl.handle.net/11603/21316 | |
dc.language.iso | en_US | en_US |
dc.relation.isAvailableAt | The University of Maryland, Baltimore County (UMBC) | |
dc.relation.ispartof | UMBC Computer Science and Electrical Engineering Department Collection | |
dc.relation.ispartof | UMBC Faculty Collection | |
dc.relation.ispartof | UMBC Student Collection | |
dc.rights | This item is likely protected under Title 17 of the U.S. Copyright Law. Unless on a Creative Commons license, for uses protected by Copyright Law, contact the copyright holder or the author. | |
dc.title | Learning to Understand Non-Categorical Physical Language for Human Robot Interactions | en_US |
dc.type | Text | en_US |