Abstract:

The relevance of the issues of the analysis of scientific publications is due to the fact that with the of Internet technologies, it became possible to collect data on the publication citation network. Meanwhile, the current approach to the analysis of scientific publications is based on bibliometric indicators that take into account only the number of citations. However, network analysis, which is mainly used in the study of social networks, is becoming increasingly widely used. The author has developed a methodology that allows for an effective analysis of scientific publications based on network analysis methods alternative to bibliometric methods. As criteria for evaluating scientific publications based on network analysis, relevant measures of the centrality of the citation network nodes are established: centrality by degree of connectivity; centrality by proximity to other nodes; centrality by mediation; centrality by authority; centrality by concentration. The author presented the experiment result that allows validating the developed methodology of network analysis of the scientific publications significance. Scientometric databases were used as primary sources of data on publications, which make it possible to track the citation of publications and identify relevant citation networks. The application of the proposed network analysis methodology contributes to the identification of important publications in the development of the scientific direction.

Abstract:

Starting from spring 2022 a national system for evaluating the effectiveness of scientific research and development is being created using the database of leading Russian journals Russian Science Citation Index (RSCI). The article represents some results of the analysis of the RSCI normalized rating published in December 2022. Using the journal citation graph constructed from the data Math-Net.Ru on the example of thematic group OECD 101.Mathematics we show that in the case of a large number of self-citations of the journals, a relationship between the normalized rating and the number of references is found, and the relationship with self-citation is somewhat stronger than without self-citation. Analysis of the distribution of the journals by thematic groups shows that using a single attribute, such as the OECD, as a criterion does not allow forming a group as a community of journals with a single strongly connected component in the citation graph. We conclude that the research methods of journal citation graphs are a good basis for a comparative analysis of the characteristics of journals and their ranking, which means they can be used as tools for further development and improvement of journal ratings.

Abstract:

Translated plagiarism has widely spread in a scientific world and posed a serious problem due to the challenges in its automatic detection. However, in the last five years some progress has been observed in this area. The authors of this paper, as well as foreign research team from several universities independently of each other proposed an approach to detect plagiarism based on citation analysis with search of initial source for analyzed suspected paper with the same or similar references. Developed methods of detection of illegal use of borrowed text successfully passed several tests. The report shows the results that we have obtained in the last four years.

Abstract:

According to the portal Math-Net.Ru a graph of journal citation is constructed. To increase the reliability of the model, the citation time interval was chosen from 2010 to 2021, when the distribution of citation articles stabilized at the level of 3500-4500 citations per year. The structure of link aging is studied and it is shown that their half-life is equal to 8 years. Therefore, the publication date of the cited articles was limited to 2002. For the constructed citation graph, the main properties, such as a small diameter and a high density, are obtained, indicating a high level of scientific communication in the Math-Net.Ru. The absence of the “Matthew effect” as a pronounced advantage in quoting established journals in relation to less well-known ones is shown. Adequacy of the journal citation graph Math-Net.Ru as a model of scientific communication confirmed by comparing the ranking of journals in the citation graph with their SCIENCE INDEX rating in eLIBRARY.RU. A direct moderate relationship between the two rankings is shown. A number of meaningful conclusions are drawn from the analysis of the citation graph.

Abstract:

The article examines current challenges in scientometrics arising from the surge in publication activity and the widespread adoption of generative artificial intelligence. The existing scientometric toolkit for analyzing research activity is reviewed, categorized into quantitative metrics and science mapping methods (citation network analysis, academic genealogy, semantic analysis, etc.). An attempt is made to overcome the limitations of traditional citation analysis, such as “semantic blindness” and vulnerability to manipulation. As a potential solution, a conceptual model is proposed where the unit of analysis shifts from the publication as a whole to an individual “key statement”. This approach involves recording not only the statement’s content but also its type, area of relevance, and its logical relationship with other claims (confirmation, refutation, clarification, generalization, etc.). Within this framework, principles for calculating modified scientometric metrics are introduced.

The proposed model was tested on a corpus of 728 articles from the Russian  journal Informatics and Education (2016–2025). An analysis conducted using large language models revealed that retrospective extraction of statements faces significant hurdles due to established cultures of scientific communication. Consequently, the study highlights the advantages of having authors formulate key statements themselves as a distinct type of metadata. In conclusion, the paper outlines development paths for the concept of an “embedding space of knowledge,” which could eventually complement existing approaches to analyzing the evolution of scientific ideas and theories.

Abstract:

Modern scientometric systems and citation systems use various mechanisms of thematic search and thematic filtering of information. In most cases, a full-text approach is used for thematic analysis of articles and journals, which has a number of limitations. The use of algorithms based on graph analysis, both independently and in conjunction with full-text algorithms, eliminates these limitations and improves the completeness and accuracy of subject search. The algorithm developed by the authors and presented in this work uses the co-authorship graph to analyze the thematic proximity of journals. The algorithm is insensitive to the language of the journal and selects similar journals in different languages, which is difficult to implement for algorithms based on the analysis of full-text information. The algorithm was tested in the scientometric system IAS ISTINA. In the interface developed for these purposes, the user can select one journal that is close to him on the subject, and the system will automatically generate a selection of journals that may be of interest to the user both in terms of studying the materials available in them and in terms of publishing his own articles. In the future, the developed algorithm can be adapted to search for similar conferences, collections of publications and scientific projects. The presence of such a tool will increase the publication activity of young employees, increase the citation rate of articles and the citation rate between journals. The results of the algorithm for determining thematic proximity between journals, collections, conferences and scientific projects can also be used to build rules in models of differentiating access to data based on domain ontologies.

Abstract:

With the advent of network science, it has become possible to explore complex network systems, including social and information networks, by presenting them as graph models. The exponential growth of the total volume of scientific publications determines the relevance of the tasks of analyzing their interrelations. In network science, models and methods related to the field of so-called citation networks are being developed to solve these problems. However, network metrics are not used when analyzing publications in citation databases. The paper considers the issues of creating a decision support system for the selection of information sources based on data on the citation of scientific publications. A software package has been developed for making decisions on determining an important publication in a certain thematic area. The software package is based on a method of ranking publications by importance based on the analysis of citation networks, which allows you to identify publications that do not clearly stand out when ranking based on known bibliometric indicators or known measures of centrality of nodes in their pure form. A study and comparative analysis of software for visualization and research of all types of graphs and social networks has been conducted. Studies have been carried out confirming the effectiveness of the proposed decision support system in the selection of information sources.

Abstract:

The tool for building ratings of scientific journals is one of the popular services of bibliographic databases. The task of building a rating is usually divided into two main subtasks: determining the reference group of journals and calculating the rating indicator for journals of this reference group. Practice shows that for the correct comparison of journals, a necessary condition is to limit the reference group to exclusively journals of a certain subject. In the case of methodological errors made at the stage of selecting a reference group, the values of the journal index in the rating may differ greatly from the expected ones.

For example, in the ranking of journals in the Russian Science Citation Index (RSCI) according to the two-year impact factor in the thematic area “Mathematics”, classical fundamental mathematical journals, contrary to expectations, do not reach the first positions of the rating. The first positions were taken by journals for which mathematics is not the dominant profile discipline. Analysis of statistical data on the subject of published articles and citations in journals that occupy leading positions in the RSCI rating shows that the multidisciplinary nature of these journals significantly influenced the rating indicators.

The noted misunderstanding leads to the idea that in this case, not all the articles of the journal should have been involved in the calculation of the rating, but only those related to this thematic area. At the same time, the existing scheme of thematic classification of directions also raises questions. The "bottom-up" classification, which is gaining popularity and works on a representative array of articles, seems to be more promising. Here thematic clusters are isolated on the basis of the concept of proximity of articles, interpreted as the proximity of their bibliographic links. And further, the thematic affiliation of the article is not assigned by the volitional decision of the author or the editorial board, but is strictly formally calculated on the basis of its bibliographic list.

Abstract: Methods of the semantic documents parsing in digital control system of scientific collections, including electronic journals, offered. The methods of processing documents containing mathematical formulas and methods for the conversion of documents from the OpenXML-format in ТеХ-format considered. The search algorithm for the mathematical formulas in the collections of documents stored in OpenXML-format designed. The algorithm is implemented as online-service on platform science.tatarstan.

Abstract:

We investigated the current models of the publication and dissemination of scientific knowledge. We describe the modern information management system of scientific publications and services that determine their functionality.

We discuss the concept of the digital infrastructure of the electronic scientific journal. Under this infrastructure, we understand the complex that combines management software platform of electronic journal and a number of specialized information systems. The software platform realizes the basic operating log management processes. Information systems provide the operation of additional services, taking into account the specifics of the journal subject area.

We present an approach to the organization of the digital infrastructure of the scientific journal based on an open platform Open Journal Systems (OJS). We provide software services that extend the functionality of this platform and considering specificity of the subject area of scientific journals. We have created software modules for automating of electronic scientific journal workflow. These modules are an extension of OJS.

We present a system of services for the automated processing of collections of scientific documents. These services provide verification of document compliance to the accepted rules of formation of collections and their conversion to the established formats; structural analysis of documents and extraction of metadata, as well as their integration into the scientific information space. The system allows to automatically performing a set of operations that cannot be realized for acceptable time with the traditional manual processing of electronic content. It is designed for the large collections of scientific documents.

Algorithms style validation of texts at the article registration stage in the information system of electronic scientific journal, the selection of reviewers, alert and control the timing of reviewing were automated. Information gathering algorithm with dedicated news lines of scientific journals, further analysis and distribution of news by categories and degrees of importance were developed. The algorithm automatically extract bibliographic data from a homogeneous array of publications (in particular, the issues of the scientific journal) and the formation of metadata blocks for export to international information and analytical system were created. Methods integration of OJS platform and international databases of science citation were developed.

We present methods of processing documents containing mathematical formulas: in the collections of documents that contain mathematical formulas, algorithm for the search formulas is developed; basic ideas, approaches and results already obtained by the mathematical knowledge management based on ontology are presented; a method of constructing recommender systems based on mathematical knowledge ontologies described. The method of primary processing automated of scientific article using TеX-notation developed.

The new direction of researches of scientific communications in the environment of Web 2.0 – altmetrics – is considered. We have analyzed the content of the notion «altmetrics», we conducted a comparison of traditional (bibliometric and scientometric) and alternative indicators. We describe the use of world experience informetric services on scientific journals sites. We discussed options for implementing these approaches to create an electronic scientific journal management platform. 

Abstract:

The materials presented at the Conference describe the results of recent years in the following areas: Open access to scientific data and knowledge in Earth Sciences; Data peculiarities in Earth Sciences: new concepts and methods, tools for their collection, integration and processing in different information systems, including systems with intensive use of data; Data mining and mathematical simulation of natural processes in Earth Sciences. Evolution of classical GIS-applications in Earth Sciences; Application to Critical Raw Materials (CRM); social aspects of mining (e.g., the Social Licence to Operate [SLO]); predictive mapping and applications to exploration, landuse and search for extensions of known deposits; Intelligent data analysis, elicitation of facts and knowledge from scientific publications. Thesauruses, ontologies and conceptual modeling. Semantic WEB, linked data. Services. Content semantic structuring. Applications for geosciences, e.g., Ontology-based Dynamic Decision Graphs for Expert systems and decision-aid tools; Application of methods and technologies of the remote sensing in Earth Sciences: from satellites to unmanned aerial vehicles; Information technologies for demonstration and popularization of scientific achievements in Earth Sciences; Applications: environmental risks including mining wastes, natural hazards, water resource management, etc.

Abstract:

The use of modern methods of thematic analysis for the analytical processing of information is currently used in almost all areas of human activity, including scientometrics. Many scientometric and citation systems, including the world famous WoS, Scopus, Google Shcolar, develop thematic categories for searching and processing information. Most important tasks that can be solved using thematic classification methods are: assessment of the dynamics of the development of thematic areas in the organization, country and in world science; search for articles on a given topic; search and assessment of the authority of experts; search for journal for publication and other relevant tasks. The Lomonosov Moscow State University is currently developing and using the system ISTINA. In this project, algorithms have been created that solve some of the problems listed. Scientific research is underway to create new effective mathematical models and algorithms in this area.

Abstract: The number of scientific journals published in the world is very large. In this regard, it is necessary to create software tools that will allow analyzing thematic links of journals. The algorithm presented in this paper uses graphs of co-authorship for analyzing the thematic proximity of journals. It is insensitive to the language of the journal and can find similar journals in different languages. This task is difficult for algorithms based on the analysis of full-text information. Approbation of the algorithm was carried out in the scientometric system IAS ISTINA. Using a special interface, a user can select one interesting journal. Then the system will automatically generate a selection of journals that may be of interest to the user. In the future, the developed algorithm can be adapted to search for similar conferences, collections of publications and research projects. The use of such tools will increase the publication activity of young employees, increase the citation of articles and quoting between journals. In addition, the results of the algorithm for determining thematic proximity between journals, collections, conferences and research projects can be used to build rules in the ontology models for access control systems.