Analyzing COVID-19 Tweets with Transformer-based Language Models

Thumbnail Image

Files

2104.10259.pdf (234.32 KB)

Links to Files

https://arxiv.org/abs/2104.10259

Permanent Link

http://hdl.handle.net/11603/21607

Collections

UMBC Psychology Department
UMBC Faculty Collection
UMBC Staff Collection

Author/Creator

Author/Creator ORCID

Date

2021-05-06

Type of Work

journal articles preprints
Text

Department

Program

Citation of Original Publication

Rights

This item is likely protected under Title 17 of the U.S. Copyright Law. Unless on a Creative Commons license, for uses protected by Copyright Law, contact the copyright holder or the author.

Subjects

Abstract

This paper describes a method for using Transformer-based Language Models (TLMs) to understand public opinion from social media posts. In this approach, we train a set of GPT models on several COVID-19 tweet corpora that reflect populations of users with distinctive views. We then use prompt-based queries to probe these models to reveal insights into the biases and opinions of the users. We demonstrate how this approach can be used to produce results which resemble polling the public on diverse social, political and public health issues. The results on the COVID-19 tweet data show that transformer language models are promising tools that can help us understand public opinions on social media at scale.