Improving Word Similarity by Augmenting PMI with Estimates of Word Polysemy
Links to Fileshttps://ieeexplore.ieee.org/document/6152109
MetadataShow full item record
Type of Work26 pages
conference papers and proceedings pre-print
Citation of Original PublicationLushan Han, Tim Finin, Paul McNamee, Anupam Joshi, and Yelena Yesha, Improving Word Similarity by Augmenting PMI with Estimates of Word Polysemy, IEEE Transactions on Knowledge and Data Engineering ( Volume: 25 , Issue: 6 , June 2013 ) , DOI: 10.1109/TKDE.2012.30
RightsThis item is likely protected under Title 17 of the U.S. Copyright Law. Unless on a Creative Commons license, for uses protected by Copyright Law, contact the copyright holder or the author.
pointwise mutual information
natural language processing
UMBC Ebiquity Research Group
Pointwise mutual information (PMI) is a widely used word similarity measure, but it lacks a clear explanation of how it works. We explore how PMI differs from distributional similarity, and we introduce a novel metric, PMImax, that augments PMI with information about a word's number of senses. The coefficients of PMImax are determined empirically by maximizing a utility function based on the performance of automatic thesaurus generation. We show that it outperforms traditional PMI in the application of automatic thesaurus generation and in two word similarity benchmark tasks: human similarity ratings and TOEFL synonym questions. PMImax achieves a correlation coefficient comparable to the best knowledge-based approaches on the Miller-Charles similarity rating dataset.