Research Papers

Revised and Resubmitted

All visuals are not equal? Credibility perceptions, vaccine misinformation correction, and the moderating role of political interest

with Porismita Borah (lead), Yezi Hu, Liwei Shen, Yibing Sun, Luhang Sun, XiaoHui Cao, Dhavan Shah, Michael W. Wagner, and Sijia Yang

Prevalent vaccine-related health misinformation circulating on social media such as Twitter/X can result in vaccine hesitancy, posing threats to public health. Past efforts to correct misinformation suggest that visuals provide a promising strategy to encourage peer correction and counter vaccine hesitancy. Our research explored the effectiveness of visuals in increasing users’ COVID-19 vaccine-related misinformation correction intentions and engagement, while considering the roles of perceived credibility, vaccination history, and political interest. An online experiment (N = 1303) with a 4 ́ 2 between-subjects factorial design was conducted in 2022. Results showed that for the non-vaccinated individuals who are not interested in politics, the testimonial image generated higher perceived credibility, which led to a higher willingness to correct misinformation. However, the vaccinated group perceived the testimonial image as less credible, and this process was not influenced by political interest. Theoretical contributions and practical implications are discussed.

Russian Nuclear Threats in a Multi-Platform World: Shaping Communication Flows About Ukraine Across English, French, and German

with Jisoo Kim (lead), Junda Li, Yehzee Ryoo, Elohim Monard, Andreas Nanz, Célia Nouri, Erik P. Bucy, Jon C. W. Pevehouse, and Dhavan Shah

Ever since the commencement of the 2022 Russo-Ukrainian War, the battle over narratives, aimed at justifying the war and swaying public reactions either in support or opposition to other countries’ involvement, has emerged as a fundamental aspect of the conflict. Responding to the intense counter-offensives of Ukraine, Putin deployed atomic diplomacy – blackmailing the Western allies with the potential use of nuclear weapons – to dismantle NATO resolve and bargain over the Ukrainian sovereignty for “peace.” Considering the threats and other concerns of nuclear crises prior, this paper provides a comprehensive analysis of the thematic structure of discourse related to nuclear issues during wartime on social media, exploring its evolution over time and the interplay of various narratives, events, and platforms. Using structural topic modeling and time series analyses, we examine the social media discourse on Twitter (now X), YouTube, and Facebook in English, French, and German from November 2021 to November 2022. Our findings highlight that despite the strong lead of pro-Russian narratives at the beginning of the invasion, Putin’s explicit nuclear threat rather steered public attention toward domestic politics and the partisan assessment of Western policies. While there were variations in thematic emphases across linguistic contexts and platforms over time, our analysis reveals a close coordination of anti-Russian voices on platforms like Twitter and YouTube. This analysis contributes to understanding the intricate dynamics of social media information flows and public responses to geopolitical crises.

What Makes a Strong Argument in Health Promotional Messages? Identifying Latent Persuasive Message Features through An Agnostic Causal Machine Learning Approach

with Sijia Yang (lead), Luhang Sun, Ran Tao, Yoo Ji Suh, Yibing Sun, Yidi Wang, and Jiaying Liu

Argument strength has been widely studied in health message research. That said, researchers have not yet taken advantage of machine learning to speed up uncovering the “recipe” for message-level argument strength. We applied an agnostic causal machine learning approach that integrates the supervised Indian Buffet Process (sIBP) algorithm with crowdsourcing in two online experiments, testing a) textual tobacco control messages (K = 377) among Chinese male smokers (N = 1,206) and b) COVID-19 vaccine promotional messages (K = 1,759) among a national sample of US adults (N = 819). The sIBP algorithm automatically discovered that messages emphasizing negative health consequences increased argument strength in both studies. In contrast, politicizing cues reduced the argument strength of social media posts promoting COVID-19 vaccines, suggesting that vaccine messaging may want to avoid politicizing cues in the US context. We discussed the strengths and limitations of this computational approach for future message effects research.


Peer-reviewed Journal Articles

Constructing Vec-tionaries to Extract Message Features from Texts: A Case Study of Moral Content

with Anqi Shao, Yicheng Hu, Heysung Lee, Xining Liao, Yoo Ji Suh, Jisoo Kim, Kai-Cheng Yang, Kaiping Chen, and Sijia Yang. Political Analysis. (forthcoming)

While researchers often study message features like moral content in text, such as party manifestos and social media, their quantification remains a challenge. Conventional human coding struggles with scalability and intercoder reliability. While dictionary-based methods are cost-effective and computationally efficient, they often lack contextual sensitivity and are limited by the vocabularies developed for the original applications. In this paper, we present an approach to construct vec-tionary measurement tools that boost validated dictionaries with word embeddings through nonlinear optimization. By harnessing semantic relationships encoded by embeddings, vec-tionaries improve the measurement of message features from text, especially those in short format, by expanding the applicability of original vocabularies to other contexts. Importantly, a vec-tionary can produce additional metrics to capture the valence and ambivalence of a message feature beyond its strength in texts. Using moral content in tweets as a case study, we illustrate the steps to construct the moral foundations vec-tionary, showcasing its ability to process texts missed by conventional dictionaries and word embedding methods and to produce measurements better aligned with crowdsourced human assessments. Furthermore, additional metrics from the vec-tionary unveiled unique insights that facilitated predicting outcomes such as message retransmission.

Uncovering gender stereotypes in controversial science discourse: Evidence from computational text and visual analyses across digital platforms

with Kaiping Chen and Sang Jung Kim. Journal of Computer-Mediated Communication.Volume 29, Issue 1, January 2024

This study examines how gender stereotypes are reflected in discourses around controversial science issues across two platforms, YouTube and TikTok. Utilizing the Social Identity Model of Deindividuation Effects, we developed hypotheses and research questions about how content creators might use gender-related stereotypes to engage audiences. Our analyses of climate change and vaccination videos, considering various modalities such as captions and thumbnails, revealed that themes related to children and health often appeared in videos mentioning women, while science misinformation was more common in videos mentioning men. We observed cross-platform differences in portraying gender stereotypes. YouTube’s video descriptions often highlighted women-associated moral language, whereas TikTok emphasized men-associated moral language. YouTube’s thumbnails frequently featured climate activists or women with nature, while TikTok’s thumbnails showed women in Vlog-style selfies and with feminine gestures. These findings advance understanding about gender and science through a cross-platform, multi-modal approach and offer potential intervention strategies.

Development and validation of internet literacy scale for high school students

with Siyuan Ma, Yin Wang, Zeng Shu, and Lin Sun. Educ Inf Technol. Volume 29, 1427-1454, April, 2023

The paper aims to develop and validate an internet literacy scale for high school students. The study emphasizes the importance of internet literacy, especially for adolescents who need sufficient internet literacy to gain self-development and live their whole lives in this information age. The study has recruited 744 high school students and provided a validated scale consisting of thirty items in eight dimensions: (1) self-management, (2) self-image construction, (3) damage control, (4) information processing, (5) critical thinking, (6) cooperation, (7) consciousness of morality, and (8) consciousness of security. The current developed scale can reflect the latest, abundant meaning of internet literacy. This study fulfills the need to build up a validated, comprehensive internet literacy scale for adolescents such as high school students. The study also suggests potential applications of the scale in the pedagogical context.

Algorithmic Agents in the Hybrid Media System: Social Bots, Selective Amplification, and Partisan News about COVID-19

with Jianing Li, Josephine Lukito, Kai-Cheng Yang, Fan Chen, Dhavan V Shah, and Sijia Yang. Human Communication Research. Volume 48, Issue 3, July 2022, Pages 516–542

Social bots, or algorithmic agents that amplify certain viewpoints and interact with selected actors on social media, may influence online discussion, news attention, or even public opinion through coordinated action. Previous research has documented the presence of bot activities and developed detection algorithms. Yet, how social bots influence attention dynamics of the hybrid media system remains understudied. Leveraging a large collection of both tweets (N = 1,657,551) and news stories (N = 50,356) about the early COVID-19 pandemic, we employed bot detection techniques, structural topic modeling, and time series analysis to characterize the temporal associations between the topics Twitter bots tend to amplify and subsequent news coverage across the partisan spectrum. We found that bots represented 8.98% of total accounts, selectively promoted certain topics and predicted coverage aligned with partisan narratives. Our macro-level longitudinal description highlights the role of bots as algorithmic communicators and invites future research to explain micro-level causal

How Climate Movement Actors and News Media Frame Climate Change and Strike: Evidence from Analyzing Twitter and News Media Discourse from 2018 to 2021

with Kaiping Chen, Amanda L. Molder, Shelley Boulianne, Christopher Eckart, Prince Mallari, and Diyi Yang. The International Journal of Press/Politics. Volume 28, Issue 2, June, 2022

Twitter enables an online public sphere for social movement actors, news organizations, and others to frame climate change and the climate movement. In this paper, we analyze five million English tweets posted from 2018 to 2021 demonstrating how peaks in Twitter activity relate to key events and how the framing of the climate strike discourse has evolved over the past three years. We also collected over 30,000 news articles from major news sources in English-speaking countries (Australia, Canada, United States, United Kingdom) to demonstrate how climate movement actors and media differ in their framing of this issue, attention to policy solutions, attribution of blame, and efforts to mobilize citizens to act on this issue. News outlets tend to report on global politicians’ (in)action toward climate policy, the consequences of climate change, and industry’s response to the climate crisis. Differently, climate movement actors on Twitter advocate for political actions and policy changes as well as addressing the social justice issues surrounding climate change. We also revealed that conversations around the climate movement on Twitter are highly politicized, with a substantial number of tweets targeting politicians, partisans, and country actors. These findings contribute to our understanding of how people use social media to frame political issues and collective action, in comparison to the traditional mainstream news outlets.

Twitter as research data: Tools, costs, skillsets and lessons learnt

with Kaiping Chen, Sijia Yang. Politics and the Life Sciences. Volume 41, Issue 1, 114-130, August, 2021

Scholars increasingly use Twitter data to study the life sciences and politics. However, Twitter data collection tools often pose challenges for scholars who are unfamiliar with their operation. Equally important, although many tools indicate that they offer representative samples of the full Twitter archive, little is known about whether the samples are indeed representative of the targeted population of tweets. This article evaluates such tools in terms of costs, training, and data quality as a means to introduce Twitter data as a research tool. Further, using an analysis of COVID-19 and moral foundations theory as an example, we compared the distributions of moral discussions from two commonly used tools for accessing Twitter data (Twitter’s standard APIs and third-party access) to the ground truth, the Twitter full archive. Our results highlight the importance of assessing the comparability of data sources to improve confidence in findings based on Twitter data. We also review the major new features of Twitter’s API version 2.

Copyright © Zening Duan 2025. All Rights Reserved.