Learning to Understand Non-Categorical Physical Language for Human Robot Interactions

dc.contributor.authorRichards, Luke E.
dc.contributor.authorMatuszek, Cynthia
dc.date.accessioned2021-04-09T17:21:39Z
dc.date.available2021-04-09T17:21:39Z
dc.descriptionProceedings of the RSS 2019 workshop on AI and Its Alternatives in Assistive and Collaborative Robotics (RSS: AI+ACR)en_US
dc.description.abstractLearning the meaning of language with respect to the physical world in which a robot operates is a necessary step for shared autonomy systems in which natural language is part of a user-specific, customizable interface. We propose a learning system in which language is grounded in visual percepts without pre-defined category constraints by combining CNNbased visual identification with natural language labels, moving towards making it possible for people to use language as a highlevel control system for low-level world interactions, allowing a system to operate on shared visual/linguistic embeddings. We evaluate the efficacy of this learning by evaluating against a wellknown object dataset, and report preliminary results that outline the feasibility of pursuing a visual feature approach to domainfree language understanding.en_US
dc.description.sponsorshipThis material is based upon work supported by the National Science Foundation under Grant No. 1637614 and No.1657469.en_US
dc.description.urihttp://iral.cs.umbc.edu/Pubs/RichardsMatuszekRSSws2019.pdfen_US
dc.format.extent5 pagesen_US
dc.genreconference papers and proceedingsen_US
dc.identifierdoi:10.13016/m2lbuq-ulee
dc.identifier.citationLuke E. Richards and Cynthia Matuszek. “Learning to Understand Non-Categorical Physical Language for Human Robot Interactions.” In Proceedings of the RSS 2019 workshop on AI and Its Alternatives in Assistive and Collaborative Robotics (RSS: AI+ACR), http://iral.cs.umbc.edu/Pubs/RichardsMatuszekRSSws2019.pdfen_US
dc.identifier.urihttp://hdl.handle.net/11603/21316
dc.language.isoen_USen_US
dc.relation.isAvailableAtThe University of Maryland, Baltimore County (UMBC)
dc.relation.ispartofUMBC Computer Science and Electrical Engineering Department Collection
dc.relation.ispartofUMBC Faculty Collection
dc.relation.ispartofUMBC Student Collection
dc.rightsThis item is likely protected under Title 17 of the U.S. Copyright Law. Unless on a Creative Commons license, for uses protected by Copyright Law, contact the copyright holder or the author.
dc.titleLearning to Understand Non-Categorical Physical Language for Human Robot Interactionsen_US
dc.typeTexten_US

Files

Original bundle
Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
RichardsMatuszekRSSws2019.pdf
Size:
892.14 KB
Format:
Adobe Portable Document Format
Description:
License bundle
Now showing 1 - 1 of 1
No Thumbnail Available
Name:
license.txt
Size:
2.56 KB
Format:
Item-specific license agreed upon to submission
Description: