โก Quick Summary
This study investigates the impact of X’s (formerly Twitter) policy shift on misinformation, specifically regarding anti-vaccine discourse, revealing a 60% increase in anti-vaccine tweets following the policy change. The findings highlight the significant role of content moderation in shaping public discourse around vaccines. ๐
๐ Key Details
- ๐ Dataset: Tweets from November 16-30, 2022
- ๐งฉ Analysis Tool: GPT-4o for stance classification and thematic categorization
- โ๏ธ Methodology: Regression analyses excluding the announcement date
- ๐ Key Metric: Odds Ratio (OR) of 1.60 (95% CI: 1.50-1.72) for increased anti-vaccine tweets
๐ Key Takeaways
- ๐ Significant increase in anti-vaccine tweets post-policy change.
- ๐ Retweets were a major factor in content amplification.
- ๐ฌ New anti-vaccine content creation also rose after the policy shift.
- ๐ฉบ Health concerns over vaccination became more prominent in discussions.
- ๐ Conspiracy-related narratives saw a decline in relative prevalence.
- ๐ Stance consistency in quote tweets increased, indicating stronger ideological alignment.
- ๐ Content moderation policies play a crucial role in controlling anti-vaccine discourse.

๐ Background
The rise of social media has transformed how information, including health-related content, is disseminated. The termination of misinformation policies on platforms like X has raised concerns about the potential for increased dissemination of anti-vaccine sentiments. Understanding the dynamics of this discourse is essential for public health strategies aimed at combating misinformation.
๐๏ธ Study
This empirical study was conducted to assess the effects of X’s policy shift on anti-vaccine discourse by analyzing tweets from a seven-day period before and after the policy termination. Utilizing advanced language models like GPT-4o, researchers classified stances and themes in the tweets, providing a comprehensive view of the changes in discourse patterns.
๐ Results
The analysis revealed a striking 60% increase in anti-vaccine tweets following the policy change, with an Odds Ratio of 1.60. Notably, the increase was particularly pronounced in retweets, indicating a significant amplification of anti-vaccine content. Furthermore, the thematic analysis showed a shift towards greater emphasis on health concerns, while conspiracy theories and anti-mandate narratives became less prevalent.
๐ Impact and Implications
The findings of this study underscore the critical role that content moderation policies play in shaping public discourse on vaccines. The rapid increase in anti-vaccine sentiments following the policy shift suggests that removing such restrictions can lead to a surge in misinformation. This has profound implications for public health communication strategies, emphasizing the need for effective moderation to mitigate the spread of harmful narratives. ๐
๐ฎ Conclusion
This study highlights the significant impact of social media policies on public health discourse, particularly regarding vaccines. The findings suggest that content moderation is essential in controlling the volume and amplification of anti-vaccine content. As we navigate the complexities of misinformation in the digital age, it is crucial to consider the implications of policy changes on public health outcomes. We encourage ongoing research in this area to better understand and address the challenges posed by misinformation. ๐
๐ฌ Your comments
What are your thoughts on the impact of social media policies on vaccine discourse? Let’s engage in a discussion! ๐ฌ Share your insights in the comments below or connect with us on social media:
Auditing the impact of social media’s policy shift on anti-vaccine discourse: A large language model-driven empirical study.
Abstract
The sudden termination of X’s (formerly Twitter) misinformation policy on November 23, 2022, provides an opportunity to assess the effects of lifting content moderation restrictions on vaccine-related discourse. This study examines changes in the prevalence, thematic composition, and engagement of anti-vaccine discourse following X’s policy shift, analyzing tweets from a seven-day period before and after the policy termination (November 16-30, 2022), excluding the announcement date itself from regression analyses. Using GPT-4o for stance classification, thematic categorization, and stance consistency assessment, with validation through external benchmarks and cross-annotator agreement, we find that anti-vaccine tweets increased significantly post-policy (OR = 1.60, 95% CI: 1.50-1.72), particularly via retweets, suggesting content amplification. Sensitivity analyses excluding highly retweeted content revealed that the policy change was also associated with increased creation of new anti-vaccine content. Thematically, health concerns over vaccination became more prominent, while conspiracy-related and anti-mandate narratives declined in relative prevalence. Stance consistency in quote tweets increased, indicating reinforced ideological alignment in anti-vaccine discourse. These results suggest that content moderation policies may constrain both the volume and amplification of anti-vaccine content, with policy removal associated with rapid shifts in discourse patterns.
Author: [‘Li Y’, ‘Chen T’, ‘Zhao Y’, ‘Ke W’, ‘Pang P’, ‘McKay D’, ‘Chang S’, ‘Baxter N’]
Journal: PLoS One
Citation: Li Y, et al. Auditing the impact of social media’s policy shift on anti-vaccine discourse: A large language model-driven empirical study. Auditing the impact of social media’s policy shift on anti-vaccine discourse: A large language model-driven empirical study. 2026; 21:e0346568. doi: 10.1371/journal.pone.0346568