A Hardware Accelerator for Language Guided Reinforcement Learning

dc.contributor.authorShiri, Aidin
dc.contributor.authorMazumder, Arnab Neelim
dc.contributor.authorPrakash, Bharat
dc.contributor.authorHomayoun, Houman
dc.contributor.authorWaytowich, Nicholas R.
dc.contributor.authorMohsenin, Tinoosh
dc.date.accessioned2021-03-26T16:31:32Z
dc.date.available2021-03-26T16:31:32Z
dc.date.issued2021-03-02
dc.description.abstractReinforcement learning (RL) has shown great performance in solving sequential decision-making problems. This paper proposes a framework to train RL agents conditioned on constraints that are in the form of structured language to improve training efficiency. We implemented an energy-efficient hardware accelerator to receive both images and text inputs that allows RL agents understand human language and act in real-world environments. A scalable and parallel hardware with different number of processing elements is implemented on both FPGA and ASIC that provides a balance between power consumption and performance. The post-layout ASIC design consumes 9.2 mW while providing 361 fps throughput.en_US
dc.description.sponsorshipThis project was sponsored by the U.S. Army Research Laboratory under Cooperative Agreement Number W911NF10-2-0022. The views and conclusions contained in this document are those of the authors and should not be interpreted as representing the official policies, either expressed or implied, of the U.S. Government. The U.S. Government is authorized to reproduce and distribute reprints for Government purposes notwithstanding any copyright notation hereinen_US
dc.description.urihttps://ieeexplore.ieee.org/document/9367213/en_US
dc.format.extent6 pagesen_US
dc.genrejournal articlesen_US
dc.identifierdoi:10.13016/m23do0-qgag
dc.identifier.citationA. Shiri, A. N. Mazumder, B. Prakash, H. Homayoun, N. R. Waytowich and T. Mohsenin, "A Hardware Accelerator for Language Guided Reinforcement Learning," in IEEE Design & Test, doi: 10.1109/MDAT.2021.3063363.en_US
dc.identifier.urihttps://doi.org/10.1109/MDAT.2021.3063363
dc.identifier.urihttp://hdl.handle.net/11603/21225
dc.language.isoen_USen_US
dc.publisherIEEEen_US
dc.relation.isAvailableAtThe University of Maryland, Baltimore County (UMBC)
dc.relation.ispartofUMBC Computer Science and Electrical Engineering Department Collection
dc.relation.ispartofUMBC Faculty Collection
dc.relation.ispartofUMBC Student Collection
dc.rightsThis item is likely protected under Title 17 of the U.S. Copyright Law. Unless on a Creative Commons license, for uses protected by Copyright Law, contact the copyright holder or the author.
dc.rightsPublic Domain Mark 1.0*
dc.rightsThis work was written as part of one of the author's official duties as an Employee of the United States Government and is therefore a work of the United States Government. In accordance with 17 U.S.C. 105, no copyright protection is available for such works under U.S. Law
dc.rights.urihttp://creativecommons.org/publicdomain/mark/1.0/*
dc.titleA Hardware Accelerator for Language Guided Reinforcement Learningen_US
dc.typeTexten_US

Files

Original bundle

Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
09367213.pdf
Size:
11.91 MB
Format:
Adobe Portable Document Format
Description:

License bundle

Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
license.txt
Size:
2.56 KB
Format:
Item-specific license agreed upon to submission
Description: