A Simulator for Human-Robot Interaction in Virtual Reality

Thumbnail Image

Files

A Simulator for Human-Robot Interaction in Virtual Reality.pdf (1.67 MB)

Links to Files

https://ieeexplore.ieee.org/document/9419217

Permanent Link

https://doi.org/10.1109/VRW52623.2021.00117
 http://hdl.handle.net/11603/25074

Collections

UMBC Computer Science and Electrical Engineering Department
UMBC Faculty Collection
UMBC Student Collection

Author/Creator

Author/Creator ORCID

https://orcid.org/0000-0003-2838-0140

Date

2021-05-06

Type of Work

conference papers and proceedings
postprints
Text

Department

Program

Citation of Original Publication

M. Murnane, P. Higgins, M. Saraf, F. Ferraro, C. Matuszek and D. Engel, "A Simulator for Human-Robot Interaction in Virtual Reality," 2021 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), 2021, pp. 470-471, doi: 10.1109/VRW52623.2021.00117.

Rights

© 2021 IEEE.  Personal use of this material is permitted.  Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.

Subjects

UMBC Ebiquity Research Group

Abstract

We present a suite of tools to model a robot, its sensors, and the surrounding environment in VR, with the goal of collecting training data for real-world robots. The virtual robot observes a rigged avatar created in our photogrammetry facility and embodying a VR user. We are particularly interested in verbal human/robot interactions, which can be combined with the robot's sensor data for grounded language learning. Because virtual scenes, tasks, and robots are easily reconfigured compared to their physical analogs, our approach proves extremely versatile in preparing a wide range of robot scenarios for an array of use cases.