Planning with Abstract Learned Models While Learning Transferable Subtasks

dc.contributor.authorWinder, John
dc.contributor.authorMilani, Stephanie
dc.contributor.authorLanden, Matthew
dc.contributor.authorOh, Erebus
dc.contributor.authorParr, Shane
dc.contributor.authorSquire, Shawn
dc.contributor.authordesJardins, Marie
dc.contributor.authorMatuszek, Cynthia
dc.date.accessioned2021-04-09T16:53:58Z
dc.date.available2021-04-09T16:53:58Z
dc.date.issued2020-03-04
dc.descriptionProceedings of the AAAI Conference on Artificial Intelligence, Vol. 34 No. 06: AAAI-20 Technical Tracks 6, AAAI Technical Track: Planning, Routing, and Schedulingen_US
dc.description.abstractWe introduce an algorithm for model-based hierarchical reinforcement learning to acquire self-contained transition and reward models suitable for probabilistic planning at multiple levels of abstraction. We call this framework Planning with Abstract Learned Models (PALM). By representing subtasks symbolically using a new formal structure, the lifted abstract Markov decision process (L-AMDP), PALM learns models that are independent and modular. Through our experiments, we show how PALM integrates planning and execution, facilitating a rapid and efficient learning of abstract, hierarchical models. We also demonstrate the increased potential for learned models to be transferred to new and related tasks.en_US
dc.description.sponsorshipThe material presented here is based in part upon work supported by the National Science Foundation under Grant No. IIS-1813223 and Grant No. IIS-1426452, and by DARPA under grants W911NF-15-1-0503 and D15AP00102.en_US
dc.description.urihttps://ojs.aaai.org//index.php/AAAI/article/view/6555en_US
dc.format.extent9 pagesen_US
dc.genreconference papers and proceedings preprintsen_US
dc.identifierdoi:10.13016/m2zhmk-s5t7
dc.identifier.citationWinder, J., Milani, S., Landen, M., Oh, E., Parr, S., Squire, S., desJardins, M., & Matuszek, C. (2020). Planning with Abstract Learned Models While Learning Transferable Subtasks. Proceedings of the AAAI Conference on Artificial Intelligence, 34(06), 9992-10000. https://doi.org/10.1609/aaai.v34i06.6555en_US
dc.identifier.urihttps://doi.org/10.1609/aaai.v34i06.6555
dc.identifier.urihttp://hdl.handle.net/11603/21314
dc.language.isoen_USen_US
dc.publisherAAAIen_US
dc.relation.isAvailableAtThe University of Maryland, Baltimore County (UMBC)
dc.relation.ispartofUMBC Computer Science and Electrical Engineering Department Collection
dc.relation.ispartofUMBC Faculty Collection
dc.relation.ispartofUMBC Student Collection
dc.rightsThis item is likely protected under Title 17 of the U.S. Copyright Law. Unless on a Creative Commons license, for uses protected by Copyright Law, contact the copyright holder or the author.
dc.titlePlanning with Abstract Learned Models While Learning Transferable Subtasksen_US
dc.typeTexten_US

Files

Original bundle

Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
1912.07544.pdf
Size:
457.67 KB
Format:
Adobe Portable Document Format
Description:

License bundle

Now showing 1 - 1 of 1
No Thumbnail Available
Name:
license.txt
Size:
2.56 KB
Format:
Item-specific license agreed upon to submission
Description: