Towards Making Virtual Human-Robot Interaction a Reality

Thumbnail Image

Files

1092.pdf (734.87 KB)

Links to Files

https://ebiquity.umbc.edu/paper/html/id/985/Towards-Making-Virtual-Human-Robot-Interaction-a-Reality

Permanent Link

http://hdl.handle.net/11603/22340

Collections

UMBC Computer Science and Electrical Engineering Department
UMBC Faculty Collection
UMBC Office for the Vice President of Research & Creative Achievement (ORCA)
UMBC Student Collection

Author/Creator

Author/Creator ORCID

https://orcid.org/0000-0003-2838-0140

Date

2021

Type of Work

conference papers and proceedings
preprints
Text

Department

Program

Citation of Original Publication

Higgins, Padraig et al.; Towards Making Virtual Human-Robot Interaction a Reality; VAM-HRI, 2021

Rights

This item is likely protected under Title 17 of the U.S. Copyright Law. Unless on a Creative Commons license, for uses protected by Copyright Law, contact the copyright holder or the author.

Subjects

UMBC Ebiquity Research Group
human-robot interaction
virtual reality
grounded language acquisition
Sim2Real

Abstract

For robots deployed in human-centric spaces, natural language promises an intuitive, natural interface. However, obtaining appropriate training data for grounded language in a variety of settings is a significant barrier. In this work, we describe using human-robot interactions in virtual reality to train a robot, combining fully simulated sensing and actuation with human interaction. We present the architecture of our simulator and our grounded language learning approach, then describe our intended initial experiments.