Improving Word Similarity by Augmenting PMI with Estimates of Word Polysemy
Loading...
Links to Files
Author/Creator
Author/Creator ORCID
Date
2013-06-01
Type of Work
Department
Program
Citation of Original Publication
Han, Lushan, Tim Finin, Paul McNamee, Anupam Joshi, and Yelena Yesha. “Improving Word Similarity by Augmenting PMI with Estimates of Word Polysemy.” IEEE Transactions on Knowledge and Data Engineering 25, no. 6 (June 2013): 1307–22. https://doi.org/10.1109/TKDE.2012.30.
Rights
© 2013 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or
reuse of any copyrighted component of this work in other works.
Abstract
Pointwise mutual information (PMI) is a widely used word similarity measure, but it lacks a clear explanation of how it works. We explore how PMI differs from distributional similarity, and we introduce a novel metric, PMImax, that augments PMI with information about a word's number of senses. The coefficients of PMImax are determined empirically by maximizing a utility function based on the performance of automatic thesaurus generation. We show that it outperforms traditional PMI in the application of automatic thesaurus generation and in two word similarity benchmark tasks: human similarity ratings and TOEFL synonym questions. PMImax achieves a correlation coefficient comparable to the best knowledge-based approaches on the Miller-Charles similarity rating dataset.