Exploring connections between auditory hallucinations and language model structures and functions

dc.contributor.authorAllen, Janerra D.
dc.contributor.authorXia, Luke
dc.contributor.authorHong, L. Elliot
dc.contributor.authorChoa, Fow-Sen
dc.date.accessioned2024-07-26T16:35:26Z
dc.date.available2024-07-26T16:35:26Z
dc.date.issued2024-06-06
dc.descriptionProceedings Volume 13059, Smart Biomedical and Physiological Sensor Technology XXI; 130590A (2024)
dc.description.abstractAuditory hallucinations are a hallmark symptom of mental disorders such as schizophrenia, psychosis, and bipolar disorder. The biological basis for auditory perceptions and hallucinations, however, is not well understood. Understanding hallucinations may broadly reflect how our brains work — namely, by making predictions about stimuli and the environments that we navigate. In this work, we would like to use a recently developed language model to help the understanding of auditory hallucinations. Bio-inspired Large Language Models (LLMs) such as Bidirectional Encoder Representations from Transformers (BERT) and Generative Pre-trained Transformer (GPT) can generate next words based on previously generated words from the embedded space and their pre-trained library with or without inputs. The generative nature of neural networks in GPT (like self-attention) can be analogously associated with the neurophysiological sources of hallucinations. Functional imaging studies have revealed that the hyperactivity of the auditory cortex and the disruption between auditory and verbal network activity may underlie auditory hallucinations’ etiology. Key areas involved in auditory processing suggest that regions involved in verbal working memory and language processing are also associated with hallucinations. Auditory hallucinations reflect decreased activity in verbal working memory and language processing regions, including the superior temporal and inferior parietal regions. Parallels between auditory processing and LLM transformer architecture may help to decode brain functions on meaning assignment, contextual embedding, and hallucination mechanisms. Furthermore, an improved understanding of neurophysiological functions and brain architecture would bring us one step closer to creating human-like intelligence.
dc.description.sponsorshipThis work was supported by the NSF grant ECCS-1631820, NIH grants MH112180, MH108148, MH103222, and Brain and Behavior Research Foundation grant
dc.description.urihttps://www.spiedigitallibrary.org/conference-proceedings-of-spie/13059/130590A/Exploring-connections-between-auditory-hallucinations-and-language-model-structures-and/10.1117/12.3013964.full
dc.format.extent11 pages
dc.genreconference papers and proceedings
dc.genrepresentations (communicative events)
dc.genrejournal articles
dc.identifierdoi:10.13016/m2xxff-9377
dc.identifier.citationAllen, Janerra D., Luke Xia, L. Elliot Hong, and Fow-Sen Choa. “Exploring Connections between Auditory Hallucinations and Language Model Structures and Functions.” In Smart Biomedical and Physiological Sensor Technology XXI, 13059:58–68. SPIE, 2024. https://doi.org/10.1117/12.3013964.
dc.identifier.urihttps://doi.org/10.1117/12.3013964
dc.identifier.urihttp://hdl.handle.net/11603/35100
dc.language.isoen_US
dc.publisherSPIE
dc.relation.isAvailableAtThe University of Maryland, Baltimore County (UMBC)
dc.relation.ispartofUMBC Student Collection
dc.relation.ispartofUMBC Faculty Collection
dc.relation.ispartofUMBC Computer Science and Electrical Engineering Department
dc.relation.ispartofUMBC Chemical, Biochemical & Environmental Engineering Department
dc.relation.ispartofUMBC Psychology Department
dc.relation.ispartofUMBC Biological Sciences Department
dc.rights©2024 Society of Photo-Optical Instrumentation Engineers (SPIE). One print or electronic copy may be made for personal use only. Systematic reproduction and distribution, duplication of any material in this paper for a fee or for commercial purposes, or modification of the content of the paper are prohibited.
dc.titleExploring connections between auditory hallucinations and language model structures and functions
dc.typeText
dcterms.creatorhttps://orcid.org/0000-0001-9613-6110

Files

Original bundle

Now showing 1 - 2 of 2
Loading...
Thumbnail Image
Name:
130590A (2).pdf
Size:
478.95 KB
Format:
Adobe Portable Document Format
Loading...
Thumbnail Image
Name:
13Transcript.pdf
Size:
50.41 KB
Format:
Adobe Portable Document Format