Planning with Abstract Learned Models While Learning Transferable Subtasks

dc.contributor.authorWinder, John
dc.contributor.authorMilani, Stephanie
dc.contributor.authorLanden, Matthew
dc.contributor.authorOh, Erebus
dc.contributor.authorParr, Shane
dc.contributor.authorSquire, Shawn
dc.contributor.authordesJardins, Marie
dc.contributor.authorMatuszek, Cynthia
dc.date.accessioned2021-04-09T16:53:58Z
dc.date.available2021-04-09T16:53:58Z
dc.date.issued2020-03-04
dc.descriptionProceedings of the AAAI Conference on Artificial Intelligence, Vol. 34 No. 06: AAAI-20 Technical Tracks 6, AAAI Technical Track: Planning, Routing, and Schedulingen
dc.description.abstractWe introduce an algorithm for model-based hierarchical reinforcement learning to acquire self-contained transition and reward models suitable for probabilistic planning at multiple levels of abstraction. We call this framework Planning with Abstract Learned Models (PALM). By representing subtasks symbolically using a new formal structure, the lifted abstract Markov decision process (L-AMDP), PALM learns models that are independent and modular. Through our experiments, we show how PALM integrates planning and execution, facilitating a rapid and efficient learning of abstract, hierarchical models. We also demonstrate the increased potential for learned models to be transferred to new and related tasks.en
dc.description.sponsorshipThe material presented here is based in part upon work supported by the National Science Foundation under Grant No. IIS-1813223 and Grant No. IIS-1426452, and by DARPA under grants W911NF-15-1-0503 and D15AP00102.en
dc.description.urihttps://ojs.aaai.org//index.php/AAAI/article/view/6555en
dc.format.extent9 pagesen
dc.genreconference papers and proceedings preprintsen
dc.identifierdoi:10.13016/m2zhmk-s5t7
dc.identifier.citationWinder, J., Milani, S., Landen, M., Oh, E., Parr, S., Squire, S., desJardins, M., & Matuszek, C. (2020). Planning with Abstract Learned Models While Learning Transferable Subtasks. Proceedings of the AAAI Conference on Artificial Intelligence, 34(06), 9992-10000. https://doi.org/10.1609/aaai.v34i06.6555en
dc.identifier.urihttps://doi.org/10.1609/aaai.v34i06.6555
dc.identifier.urihttp://hdl.handle.net/11603/21314
dc.language.isoenen
dc.publisherAAAIen
dc.relation.isAvailableAtThe University of Maryland, Baltimore County (UMBC)
dc.relation.ispartofUMBC Computer Science and Electrical Engineering Department Collection
dc.relation.ispartofUMBC Faculty Collection
dc.relation.ispartofUMBC Student Collection
dc.rightsThis item is likely protected under Title 17 of the U.S. Copyright Law. Unless on a Creative Commons license, for uses protected by Copyright Law, contact the copyright holder or the author.
dc.titlePlanning with Abstract Learned Models While Learning Transferable Subtasksen
dc.typeTexten

Files

Original bundle

Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
1912.07544.pdf
Size:
457.67 KB
Format:
Adobe Portable Document Format
Description:

License bundle

Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
license.txt
Size:
2.56 KB
Format:
Item-specific license agreed upon to submission
Description: