Computer Science

CLC number: G623.58

A Novel Scholar's Evaluation from the Perspective of Academic Equilibrium Value: A Case Study of Computer Science

学术均衡价值视角下的新型学者评价：以计算机科学为例

¹ School of Information Management, Nanjing University, Nanjing 210023, Jiangsu, China
² Nanyang Business School, Nanyang Technological University, Singapore 639798, Singapore

Received: 6 May 2025

Abstract

Objective and fair scholar evaluation promotes academic engagement and ensures proper allocation of research resources. However, current evaluation methods face challenges such as insufficient consideration of disciplinary differences, over-reliance on publication output, neglect of low-cited papers, and limited discriminative power. This paper proposes an improved evaluation metric—the Academic Equilibrium Value index (AEV-index)—based on academic equilibrium value. By incorporating weights for publication and citation tiers and integrating average publication and citation levels within disciplines, the AEV-index aims to offer a more comprehensive and equitable assessment of scholarly performance. Using Scopus data from computer science conference papers (2012-2021) across the subfields of "Network and Information Security", "Computer Graphics and Multimedia", and "Artificial Intelligence", we weighted publications and citations to evaluate researchers' academic levels. The research findings indicate that: (i) The AEV-index enhances existing scholar evaluation metrics from multiple perspectives, providing a relatively reasonable and broadly applicable comprehensive evaluation index. (ii) The AEV-index is significantly correlated with traditional scholar evaluation indicators such as total publications, total citations, and the h-index, while also moderating disciplinary differences, thereby facilitating cross-disciplinary comparisons of academic influence. (iii) Additionally, the AEV-index mitigates the negative impact of low publication output, recognizes the value of low-cited but high-quality papers, and offers improved discriminative power, thereby addressing several limitations of existing evaluation metrics.

摘要

客观公正的学者评价能够提升学术参与度并保障研究资源的合理配置。然而，当前评价方法面临诸多挑战，包括对学科差异的考量不足、过度依赖论文产出、忽视低被引论文价值以及区分能力有限等问题。本文基于学术均衡价值提出一种改进的评价指标—学术均衡值指数(AEV-index)。AEV指数通过引入出版物和引用层级的权重，并整合学科内的平均出版物和引用水平，旨在提供更全面、更公平的学术绩效评估。本文选取了2012-2021年间Scopus数据库中“网络与信息安全”、“计算机图形与多媒体”和“人工智能”子领域的计算机科学会议论文数据，通过对发文量与被引频次进行加权处理，实现对研究人员学术水平的综合评估。研究发现：(1)AEV指数从多个维度对现有学者评价指标进行了优化，形成了兼具合理性与广泛适用性的综合评价指标；(2)该指数与总发文量、总被引频次及h指数等传统学者评价指标具有显著相关性，同时能够调和学科差异，为跨学科的学术影响力比较提供支撑；(3)此外，AEV指数可缓解发文量不足带来的负面效应，认可低被引优质论文的价值，并提升了评价体系的区分能力，有效弥补了现有评价指标的多项局限。