Ghosh, IndrajeetJayarajah, KasthuriWaytowich, NicholasRoy, Nirmalya2025-06-172025-06-172025-04-28https://doi.org/10.48550/arXiv.2504.19772http://hdl.handle.net/11603/39076 ACM UMAP June 16-19 2025, New York, USAWorking memory involves the temporary retention of information over short periods. It is a critical cognitive function that enables humans to perform various online processing tasks, such as dialing a phone number, recalling misplaced items' locations, or navigating through a store. However, inherent limitations in an individual's capacity to retain information often result in forgetting important details during such tasks. Although previous research has successfully utilized wearable and assistive technologies to enhance long-term memory functions (e.g., episodic memory), their application to supporting short-term recall in daily activities remains underexplored. To address this gap, we present Memento, a framework that uses multimodal wearable sensor data to detect significant changes in cognitive state and provide intelligent in situ cues to enhance recall. Through two user studies involving 15 and 25 participants in visual search navigation tasks, we demonstrate that participants receiving visual cues from Memento achieved significantly better route recall, improving approximately 20-23% compared to free recall. Furthermore, Memento reduced cognitive load and review time by 46% while also substantially reducing computation time (3.86 seconds vs. 15.35 seconds), offering an average of 75% effectiveness compared to computer vision-based cue selection approaches.11 pagesen-USThis work was written as part of one of the author's official duties as an Employee of the United States Government and is therefore a work of the United States Government. In accordance with 17 U.S.C. 105, no copyright protection is available for such works under U.S. Law.Public Domainhttps://creativecommons.org/publicdomain/mark/1.0/Computer ScienceUMBC Mobile, Pervasive and Sensor Computing Lab (MPSC Lab)Human-Computer Interaction Computer ScienceMultimediaMemento: Augmenting Personalized Memory via Practical Multimodal Wearable Sensing in Visual Search and Wayfinding NavigationText