Artificial Intelligence Technologies for the Analysis of Content Restrictions on the Internet

Main Article Content

Мурад Джериби
Hu Hao
Andrei Mikhailovich Sukhov

Abstract

This paper proposes a new approach to determining the level of internet censorship. Our definition of censorship is based on the principle of accessibility of alternative viewpoints in search engine results and large language models. The calculation method involves compiling a list of 11 questions, the answers to which suggest opposite opinions depending on the country. These answers are evaluated in comparison with the government's point of view. For search engine results, calculate the number of answers to these questions from a pro-government point of view and the proportion of answers that detail an alternative point of view. The difference between these indicators is proposed to be considered an index of internet censorship. Since Internet searches are increasingly performed through chatbots of the most well-known large language models (LLMs), the level of censorship is also assessed for these models. The comparison showed that the responses of the national search engine Baidu in China are closest to the government's point of view, while the level of censorship in the United States is higher than in Russia. The effectiveness of censorship in the United States is explained by a different mechanism, whereby materials expressing alternative opinions restrict access to popular information platforms. Censorship in chatbots is much stronger than in internet search engine results are calculated.

Article Details

How to Cite
Джериби, М., H. Hao, and A. M. Sukhov. “Artificial Intelligence Technologies for the Analysis of Content Restrictions on the Internet”. Russian Digital Libraries Journal, vol. 29, no. 5, Sept. 2026, pp. 1924-58, doi:10.26907/1562-5419-2026-29-5-1924-1958.

References

1. Warf B. Geographies of global Internet censorship // GeoJournal. 2011. Vol. 76. P. 1–23. https://doi.org/10.1007/s10708-010-9393-3
2. Lake E. American Nomenklatura: What the Twitter Files show // Commentary. 2023. Vol. 155, No. 2. P. 33–40.
3. Filastò A. Measuring Internet Censorship with OONI // RIPE 87, 27 November–1 December 2023, Rome, Italy.
4. Raman R.S., Wiley B.G., Iyer K., Kwa T.H., Paris A.M.D., McCoy D. Advancing the art of censorship data analysis // Free and Open Communications on the Internet (FOCI). 2023.
5. Topornin N., Pyatkina D., Bokov Y. Government regulation of the Internet as instrument of digital protectionism in case of developing countries // Journal of Information Science. 2023. Vol. 49, No. 3. P. 595–608. https://doi.org/10.1177/01655515211014142
6. Burnett S., Feamster N. Making sense of internet censorship: a new frontier for internet measurement // ACM SIGCOMM Computer Communication Review. 2013. Vol. 43, No. 3. P. 84–89. https://doi.org/10.1145/2500098.2500111
7. Gokul A. LLMs and AI: Understanding Its Reach and Impact. 2023.
8. Shi X., Wang C., Li Y., Sun L., Lin B. Blind matching algorithm based proxy distribution against internet censorship // IET Communications. 2023. Vol. 17, No. 7. P. 863–877. https://doi.org/10.1049/cmu2.12589
9. Prawira I., Ekaputri R.A. Exploring Branding of Indonesian Journalists on Instagram // In: Mutsvairo B., Bebawi S., Borges-Rey E. (Eds.) The Routledge Companion to Journalism in the Global South. London: Routledge, 2023.
10. Issledovatel’skiy arkhiv avtora. https://disk.ssau.ru/s/xZkESxdt7CMAY2w. (date of last access: 10 June 2026).
11. Nalbant K.G., Aydın S. Development and transformation in digital marketing and branding with artificial intelligence and digital technologies dynamics in the Metaverse universe // Journal of Metaverse. 2023. Vol. 3? No. 1. P. 9–18. https://doi.org/10.57019/jmv.1148015
12. Hickner A. How do search systems impact systematic searching? A qualitative study // Journal of the Medical Library Association: JMLA. 2023. Vol. 111, No. 4. P. 774. https://doi.org/10.5195/jmla.2023.1647
13. Loginova N.A., Djeribie M., Sukhov A.M. Limitations on the use of Large Language Models imposed by information age // Artificial Intelligence and Decision Making. 2025. No. 2. P. 90–96. https://doi.org/10.14357/20718594250208
14. Lewandowski D. Ranking Search Results // In: Lewandowski D. (Ed.) Understanding Search Engines. Cham: Springer International Publishing, 2023. P. 83–118.
15. Yeremizina S. Search engine optimization and its significance for the visibility and branding of businesses. An analysis of Google's search ranking algorithm and the effects of selected search engine optimization techniques. Doctoral dissertation. 2023.
16. Lin G. Using cross‐encoders to measure the similarity of short texts in political science //American Journal of Political Science. 2025. Т. 69, No. 4. P. 1600–1616. https://doi.org/10.1111/ajps.12956
17. Li Y., Bandar Z.A., McLean D. An approach for measuring semantic similarity between words using multiple information sources // IEEE Transactions on knowledge and data engineering. 2003. Vol. 15, No. 4. P. 871–882. https://doi.org/10.1109/TKDE.2003.1209005
18. Li D. et al. From generation to judgment: Opportunities and challenges of llm-as-a-judge // Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing. 2025. P. 2757–2791. https://doi.org/10.18653/v1/2025.emnlp-main.138
19. Ramesh R., Vyas A., Ensafi R. “All of them claim to be the best”: Multi-perspective study of VPN users and VPN providers // 32nd USENIX Security Symposium (USENIX Security 23). USENIX Association, 2023.
20. Chayka A., Sukhov A. Comparing chatbots trained in different languages // Communications of the ACM. 2023. Vol. 66, No. 12. P. 6–7. https://doi.org/10.1145/3626835
21. Abushbak A.M., Majeed T., Sinha A. Instagram, censorship and civilian activism: The digital presence of the Israel–Palestine conflict narratives // NIU International Journal of Human Rights. 2023. Vol. 10, No. 1. P. 162–171.
22. Urman A., Makhortykh M. The Silence of the LLMs: Cross-Lingual Analysis of Political Bias and False Information Prevalence in ChatGPT, Google Bard, and Bing Chat // arXiv preprint arXiv:2309.14544. 2023. https://doi.org/10.48550/arXiv.2309.14544
23. Buyl M., Rogiers A., Noels S. et al. Large language models reflect the ideology of their creators // npj Artificial Intelligence. 2026. Vol. 2. P. 7. https://doi.org/10.1038/s44387-025-00048-0
24. Zarouali B., Poels T., Broeck K.V.D., Walrave M. Comparing Chatbots and Online Surveys for (Longitudinal) Data Collection: An Investigation of Response Characteristics, Data Quality, and User Evaluation // Communication Methods and Measures. 2023. P. 1–20. https://doi.org/10.1080/19312458.2023.2252043
25. Zmitrovich D., Sheplyakov A., Shavrina T., Smurov I., Fenogenova A., Mikhailov V., Chertok A. A family of pretrained transformer language models for Russian // Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024). 2024. P. 507–524. https://doi.org/10.48550/arXiv.2309.10931
26. Williams A. Human-centric functional modeling and the metaverse // Journal of Metaverse. 2022. Vol. 2, No. 1. P. 23–28.
27. Krutenko E.V., Shteynberg B.Ya. Oshibki iskusstvennogo intellekta pri reshenii kombinatornykh zadach // Russian Digital Libraries Journal. 2026. Vol. 29, No. 2. P. 428–441. https://doi.org/10.26907/1562-5419-2026-29-2-428-441
28. Diskin E.I. Primenenie tekhnologiy iskusstvennogo intellekta pri osushchestvlenii tsenzury so storony internet-platform // Vestnik Rossiyskogo universiteta druzhby narodov. Seriya: Yuridicheskie nauki. 2024. Vol. 28, No. 3. P. 584–603. https://doi.org/10.22363/2313-2337-2024-28-3-584-603