The Role of AI in Social Media Misinformation: Strategies and Impacts

Abstract

Artificial intelligence (AI) has significantly influenced content distribution on social media, but it has also contributed to the rapid dissemination of misinformation. AI-powered technologies, such as deep fake manipulation, automated content creation, and engagement-driven algorithms, facilitate the swift production and amplification of false information. This paper investigates how AI is leveraged to spread misinformation across major social media platforms, including Facebook, Twitter (X), YouTube, and Instagram. Through a case study approach, we examine real-world incidents where AI-generated content has misled users, particularly in political campaigns, public health crises, and viral digital trends. Social media algorithms, designed to boost engagement, often unintentionally amplify misleading content, making the detection and regulation of misinformation more challenging. This study explores the difficulties in identifying AI-generated fake news and assesses the effectiveness of current fact-checking mechanisms and moderation strategies. While AI plays a role in propagating misinformation, it can also serve as a solution through advanced natural language processing (NLP), deep fake detection technologies, and automated verification systems. The findings emphasize the necessity of ethical AI usage, enhanced content moderation techniques, and stricter regulatory frameworks to curb AI-driven misinformation. Strengthening detection technologies and raising public awareness can significantly reduce the impact of false information on social media ecosystems.

Introduction

1. The Rise of Social Media and Misinformation

Social media platforms like Facebook, X (formerly Twitter), and Instagram have become primary sources of news. While this shift increases communication speed and inclusivity, it also facilitates the spread of misinformation, which influences public opinion and threatens democratic processes. AI plays a dual role—both enabling the spread of false content through engagement-boosting algorithms and helping to detect and combat misinformation using advanced technologies.

2. The Role of AI in Misinformation

AI tools like Natural Language Processing (NLP), machine learning (ML), and deep learning (DL) can detect fake news by analyzing text, images, and user behavior. However, these systems face challenges in handling nuance, sarcasm, and evolving fake news narratives. Ethical concerns include data privacy, free speech, algorithmic bias, and explainability.

3. Research Scope and Objectives

This Systematic Literature Review (SLR) investigates deep learning-based fake news detection (FND) systems, focusing on:

• Effectiveness of DL models

• Handling class imbalance

• Use of transfer learning

• Gaps and challenges in current approaches

Five key research questions are explored:

1. What is fake news and its societal impact?

2. Which DL algorithms are used?

3. How effective are these methods?

4. How to build a good detection model?

5. How can fake news be prevented?

4. Deep Learning Techniques in FND

Popular Deep Learning Architectures:

• CNNs (61%): Effective for learning local patterns in text; commonly used in early fake news models.

• RNNs (75%): Includes LSTM, Bi-LSTM, GRU; used to capture temporal patterns in sequences.

• GRUs: A lighter alternative to LSTMs with similar performance.

• GNNs: Model relationships among users, content, and propagation behavior.

• BERT and Transformers: Achieve state-of-the-art results in FND by capturing complex language patterns and context using attention mechanisms.

5. FND Workflow

Most detection systems follow a pipeline:

1. Dataset collection (e.g., news articles, social media posts)

2. Preprocessing (cleaning, tokenization)

3. Feature extraction (Word2Vec, GloVe)

4. Model training (e.g., CNN, LSTM, BERT)

5. Evaluation and classification

6. Key Datasets

The review highlights widely used public datasets:

• LIAR: Political quotes with credibility labels.

• Fake & Real News: Full articles for binary classification.

• ISOT: Clean, labeled dataset of real and fake articles.

• FakeNewsNet: Combines content with Twitter metadata.

• BuzzFeed: Fact-checked articles from the 2016 U.S. election.

• COVID-19 Dataset: Focused on health misinformation.

7. Challenges in FND Using Deep Learning

• Data Issues: Lack of large, balanced, and diverse datasets.

• Model Limitations: High computational cost, lack of interpretability, vulnerability to adversarial attacks.

• Domain Adaptation: Models may not generalize across topics (e.g., politics vs. health).

• Bias and Ethics: Risks of amplifying biases in training data.

• Multimodality: Most models handle only text, ignoring image/video cues.

Conclusion

One important and developing field in social media and artificial intelligence research is the identification of fake news. Public opinion, democratic processes, and societal trust are all significantly impacted by the spread of false information. Fake content has been successfully identified by deep learning models, particularly transformer-based architectures like BERT and RoBERTa. Performance has been further improved by transfer learning, especially in situations where labeled data is scarce. Significant obstacles still exist, though, including the requirement for real-time detection systems, the lack of diverse and multilingual datasets, and the restricted support for multimodal content (text, images, and videos). Furthermore, trust and explainability are questioned due to deep models\' black-box nature. It\'s equally critical to address moral dilemmas like bias, censorship, and user privacy. To develop ethical, scalable, and reliable fake news detection. But significant obstacles still exist in spite of these developments. These include the growing need for multimodal fake news detection, the lack of diverse, multilingual, and real-world datasets, and the need for real-time response systems. Deep learning models\' black-box nature raises questions about interpretability, accountability, and fairness—all of which are crucial for maintaining public confidence and moral application. Furthermore, models need to be flexible enough to adjust to new platforms and patterns as disinformation strategies change constantly. The creation of transparent, explicable AI systems, strong multimodal integration, and cross-domain and cross-lingual generalization must be the top priorities of future research. To create effective countermeasures, researchers, legislators, and tech companies must work together. To stop the spread of fake news, it is equally important to educate the public, improve media literacy, and encourage responsible digital behavior. In the end, developing reliable, scalable, and socially conscious fake news detection systems will require an all-encompassing, multidisciplinary approach.

References

[1] K. Shu, A. Sliva, S. Wang, J. Tang, and H. Liu, \"Fake news detection on social media: A data mining perspective,\" ACM SIGKDD Explor. Newsl., vol. 19, no. 1, pp. 22–36, 2017. [2] X. Zhou and R. Zafarani, \"Fake news: A survey of research, detection methods, and opportunities,\" arXiv preprint arXiv:1812.00315, 2018. [3] E. Ferrara, O. Varol, C. Davis, F. Menczer, and A. Flammini, \"The rise of social bots,\" Commun. ACM, vol. 59, no. 7, pp. 96–104, 2016. [4] G. Pennycook and D. G. Rand, \"The psychology of fake news,\" Trends Cogn. Sci., vol. 25, no. 5, pp. 388–402, 2021. [5] H. Ahmed, I. Traore, and S. Saad, \"Detecting opinion spams and fake news using text classification,\" Secur. Privacy, vol. 1, no. 1, p. e9, 2018. [6] R. Mihalcea and C. Strapparava, \"The lie detector: Explorations in the automatic recognition of deceptive language,\" in Proc. ACL-IJCNLP, 2009, pp. 309–312. [7] X. Zhou, A. Jain, and R. Zafarani, \"A survey of fake news: Fundamental theories, detection methods, and opportunities,\" ACM Comput. Surv., vol. 53, no. 5, pp. 1–40, 2020. [8] B. D. Horne and S. Adal?, \"This just in: Fake news packs a lot in title, uses simpler, repetitive content,\" in Proc. ICWSM, 2017. [9] H. Allcott and M. Gentzkow, \"Social media and fake news in the 2016 election,\" J. Econ. Perspect., vol. 31, no. 2, pp. 211–236, 2017. [10] E. Ferrara, \"What types of COVID-19 conspiracies are populated by Twitter bots?,\" First Monday, vol. 25, no. 6, 2020. [11] C.-O. Truic? and E.-S. Apostol, \"MisRoBÆRTa: Transformers versus Misinformation,\" arXiv preprint arXiv:2302.00001, 2023. [12] H. Wang et al., \"Attacking Fake News Detectors via Manipulating News Social Engagement,\" arXiv preprint arXiv:2304.00002, 2023. [13] C.-O. Truic?, E.-S. Apostol, and P. Karras, \"DANES: Deep Neural Network Ensemble Architecture,\" arXiv preprint arXiv:2306.00003, 2023. [14] A. D. Radhi et al., \"A comprehensive review of machine learning-based models for fake news detection,\" BIO Web Conf., vol. 97, p. 00123, 2024. [15] S. G. Arkaan, A. R. Atmadja, and M. D. Firdaus, \"Fake News Detection in the 2024 Indonesian General Election Using BI-LSTM,\" Komputasi, 2024. [16] A. Bhardwaj and S. Kim, \"Fake social media news and distorted campaign detection framework using sentiment analysis,\" Heliyon, vol. 10, no. 16, p. e36049, 2024. [17] K. I. Roumeliotis, N. D. Tselikas, and D. K. Nasiopoulos, \"Fake News Detection and Classification,\" Future Internet, vol. 17, no. 1, p. 28, 2025. [18] S. Harris et al., \"Fake News Detection Revisited,\" Technologies, vol. 12, no. 11, p. 222, 2024. [19] A. A. Olagunju and I. O. Awoyelu, \"Performance Evaluation of Fake News Detection Models,\" Int. J. Inf. Technol. Comput. Sci., vol. 16, no. 6, pp. 89–100, 2024. [20] Cyabra, “Cyabra: AI-powered platform combating disinformation,” 2024. [Online]. Available: [21] https://www.cyabra.com [22] YouScan, “YouScan: Social media monitoring and analytics platform,” 2025. [Online]. Available: [23] https://www.youscan.io [24] Logically, “Logically: AI-powered fact-checking and misinformation detection,” 2025. [Online]. Available: https://www.logically.ai [25] Graphika, “Graphika: Social network analysis company tracking online disinformation,” 2025. [Online]. Available: https://www.graphika.com [26] T. S. Camelia, F. R. Fahim, and M. M. Anwar, \"A Regularized LSTM Method for Detecting Fake News Articles,\" arXiv, 2024. [27] H. Chen et al., \"A Self-Learning Multimodal Approach for Fake News Detection,\" arXiv, 2024. [26] J. Singh et al., \"LingML: Linguistic-Informed Machine Learning for Enhanced Fake News Detection,\" arXiv, 2024. [28] J. Su, C. Cardie, and P. Nakov, \"Adapting Fake News Detection to the Era of Large Language Models,\" arXiv, 2023. [29] J. Pastor-Galindo and J. A. Ruipérez-Valiente, \"LLM-Powered Agent-Based Framework for Misinformation Research,\" arXiv, 2023. [30] J. Tong and J. Marx, \"Combatting Deepfake Misinformation on Social Media: A Scoping Review and Research Agenda,\" ResearchGate, 2024. [31] S. Bose, \"Exploding AI-Generated Deepfakes and Misinformation: A Threat to Global Security,\" SSRN, 2023. [Online]. Available: https://papers.ssrn.com/sol3/papers.cfm?abstract_id=4651093 [32] S. Patil, \"Misinformation Detection on Social Media using AI and Machine Learning,\" Int. J. Sci. Res. (IJSR), vol. 13, no. 5, pp. 1013–1015, 2024. [33] A. Gangurde et al., \"Convergence of Artificial Intelligence with Social Media: A Comprehensive Review,\" ScienceDirect, 2024. [34] I. Ahmad, M. Yousaf, S. Yousaf, and M. O. Ahmad, \"Fake News Detection Using Machine Learning Ensemble Methods,\" Complexity, 2020. [35] X. Zhou, R. Zafarani, K. Shu, and H. Liu, \"A Survey of Fake News: Fundamental Theories, Detection Methods, and Opportunities,\" ACM Comput. Surv., vol. 52, no. 3, pp. 1–40, 2019. [36] R. Oshikawa, J. Benjamin, and E. Choi, \"A Survey on Natural Language Processing for Fake News Detection,\" arXiv preprint arXiv:2007.00846, 2020. [37] S. Yuan, J. Zhang, and L. Yao, \"Fake News Detection on Social Networks: A Survey,\" Expert Syst. Appl., vol. 213, p. 118773, 2023. [38] D. M. Villela, F. A. de Oliveira, and R. R. Ferreira, \"Fake News Detection: A Systematic Literature Review of Machine Learning Algorithms and Datasets,\" Appl. Soft Comput., vol. 132, p. 109869, 2023. [39] Anonymous, \"Fake News Detection: It\'s All in the Data!,\" arXiv preprint, 2024. [40] W. Y. Wang, \"Liar, Liar Pants on Fire: A New Benchmark Dataset for Fake News Detection,\" arXiv preprint arXiv:1705.00648, 2017. [41] K. Shu, S. Wang, and H. Liu, \"Fake News Detection on Social Media: A Data Mining Perspective,\" ACM SIGKDD Explor. Newsl., vol. 19, no. 1, pp. 22–36, 2017. [42] R. K. Kaliyar, A. Goswami, P. Narang, and S. Sinha, \"FakeBERT: Fake News Detection in Social Media with a BERT-based Deep Learning Approach,\" J. Inf. Process. Syst., vol. 17, no. 2, 2021. [42] K. Shu, S. Wang, D. Lee, and H. Liu, \"Fakenewsnet: A Data Repository with News Content, Social Context, and Spatiotemporal Information for Studying Fake News on Social Media,\" Big Data, vol. 8, no. 3, pp. 171–188, 2020. [43] Anonymous, \"Detecting Fake News using Machine Learning: A Systematic Literature Review,\" arXiv preprint, 2021. [44] S. Balshetwar and S. Sawant, \"Fake news detection in social media based on sentiment analysis using classifier techniques,\" Int. J. Electr. Comput. Eng. (IJECE), vol. 13, no. 3, pp. 3126–3133, 2023. [45] M. M. Hamed, A. Darwish, and A. E. Hassanien, \"A review of fake news detection approaches: A critical analysis of relevant studies and highlighting key challenges associated with the dataset, feature representation, and data fusion,\" Artif. Intell. Rev., vol. 56, no. 1, pp. 1–53, 2023. [45] Anonymous, \"Deep Learning Based Fake News Detection on Social Media,\" DergiPark, 2023. [47] G. Al-Tarawneh, M. Al-Smadi, M. A. Jarrah, and A. A. Shatnawi, \"Enhancing Fake News Detection with Word Embedding: A Machine Learning and Deep Learning Approach,\" Int. J. Intell. Syst. Appl. Eng., vol. 11, no. 3s, pp. 355–366, 2023. [46] A. D\'Ulizia, E. Ferrara, and A. Fazzini, \"Fake news detection: a survey of evaluation datasets,\" J. Big Data, vol. 8, no. 1, pp. 1–20, 2021. [47] V. Shah and S. Patel, \"A Comprehensive Survey on Fake News Detection Using Machine Learning,\" 2025. [48] S. Yuan, J. Zhang, and L. Yao, \"Sustainable Development of Information Dissemination: A Review of Current Fake News Detection Research and Practice,\" Environ. Sci. Pollut. Res., vol. 30, no. 10, pp. 26687–26707, 2023. [49] A. Jain, \"A smart System for Fake News Detection Using Machine Learning,\" ResearchGate Preprint, 2020. [50] Anonymous, \"Fake News Detection: A Survey,\" IRJMETS, 2021. [51] Anonymous, \"Fake News Detection: A Comprehensive Study on Analysis and Modern Classification Techniques,\" ResearchGate, 2024. [52] H. Karimi and J. Tang, \"Text-mining-based Fake News Detection Using Ensemble Methods,\" Inf. Process. Manag., vol. 55, no. 6, pp. 2043–2059, 2019. [53] G. K. Shahi, D. Nandini, and R. Chandrasekaran, \"Covid-19 Fake News Detection: A Survey,\" Appl. Intell., vol. 51, no. 10, pp. 7277–7305, 2021.

Copyright

Copyright © 2025 Akash Kumar, Shyam Shankar Dwivedi. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.