Causal Feature Selection with Dimension Reduction for Interpretable Text Classification
Loading...
Links to Files
Permanent Link
Author/Creator
Author/Creator ORCID
Date
2020-10-09
Type of Work
Department
Program
Citation of Original Publication
Guohou Shan, James Foulds and Shimei Pan, Causal Feature Selection with Dimension Reduction for Interpretable Text Classification, https://arxiv.org/abs/2010.04609
Rights
This item is likely protected under Title 17 of the U.S. Copyright Law. Unless on a Creative Commons license, for uses protected by Copyright Law, contact the copyright holder or the author.
Access to this item will begin on 4/30/21
Access to this item will begin on 4/30/21
Subjects
Abstract
Text features that are correlated with class labels, but do not directly cause them, are sometimesuseful for prediction, but they may not be insightful. As an alternative to traditional correlation-basedfeature selection, causal inference could reveal more principled, meaningful relationships betweentext features and labels. To help researchers gain insight into text data, e.g. for social scienceapplications, in this paper we investigate a class of matching-based causal inference methods fortext feature selection. Features used in document classification are often high dimensional, howeverexisting causal feature selection methods use Propensity Score Matching (PSM) which is known to beless effective in high-dimensional spaces. We propose a new causal feature selection framework thatcombines dimension reduction with causal inference to improve text feature selection. Experiments onboth synthetic and real-world data demonstrate the promise of our methods in improving classificationand enhancing interpretability.