Information-analytical system for evaluating the scientific performance of structural units of universities and research institutes based on the approach of constructing complex integral evaluation

Abstract

The article discusses the creation of an information-analytical system for evaluating the scientific performance of structural units of universities and research institutes based on the approach of constructing complex integral evaluation. A model of information technology for evaluating the results of scientific activity is proposed, consisting of four modules: an information collection module, an information storage module, an analytical module, and a module for user interaction and data visualization. The modular structure of the technology will allow expanding and modifying the capabilities of each of the modules independently of the others, as well as increasing the stability and flexibility of the technology. The implementation of this system is performed using microservices technology. A conceptual model of the information system and a structural model of the functioning of the information collection module, as well as a structural model of the information system database, are proposed. It is shown that most of the well-known indices for evaluating the performance of subjects of scientific activity, for example, h-index, g-index, e-index, I-10 index, etc., do not fully take into account information about citation. Therefore, the method for calculating the evaluation of scientific research activities of scientists was proposed, which does not lose information about any citation of the author and publication. This method determines the scalar evaluation of the results of scientific activity, and it is based on determining a few coefficients. The coefficients define one scientist’s citation in the publications of other scientists. As a result, assessment is obtained by solving a system of linear algebraic equations that are constructed based on calculated coefficients. Most of the known evaluation approaches have their own calculation features and disadvantages, which are associated with the loss of some information. Therefore, it is not recommended to give preference to one of them. For the purposes of a comprehensive assessment of the productivity of research activities of scientists, the authors proposed a method of vector evaluation of the results and the construction of the integral assessment. This method is based on the construction of vectors and scalar estimates for each scientist in a multidimensional metric space. The dimensionality of the space is determined by the number of calculated scalar estimates. The method is also based on the construction of an ideal point, which consists of scalar estimates that are the best in terms of achieving maximum performance. The assessment of each subject of scientific activity is calculated as the metric distance from the ideal point to the vector of scalar estimates of this subject of scientific activity