Measuring Perceptual and Linguistic Complexity in Multilingual Grounded Language Data
No Thumbnail Available
Links to Files
Author/Creator
Author/Creator ORCID
Date
2021-04-18
Type of Work
Department
Program
Citation of Original Publication
Pillai, Nisha; Matuszek, Cynthia; Ferraro, Francis; Measuring Perceptual and Linguistic Complexity in Multilingual Grounded Language Data; The International FLAIRS Conference Proceedings, 34, 18 April, 2021; https://doi.org/10.32473/flairs.v34i1.128450
Rights
This item is likely protected under Title 17 of the U.S. Copyright Law. Unless on a Creative Commons license, for uses protected by Copyright Law, contact the copyright holder or the author.
Abstract
The success of grounded language acquisition using perceptual data (e.g., in robotics) is affected by the complexity of both the perceptual concepts being learned and the language describing those concepts. We present methods for analyzing this complexity, using both visual features and entropy-based evaluation of sentences. Our work illuminates core, quantifiable statistical differences in how language is used to describe different traits of objects, and the visual representation of those objects. The methods we use provide an additional analytical tool for research in perceptual language learning.