海报设计┃陆澜

直播观看方式：

直接扫描海报上二维码

方法的夏天（第五季）：AI 时代下的社会科学研究方法

第1讲 Can ChatGPT or Other AI Support Research Assessment?

主讲人：Mike Thelwall（谢菲尔德大学信息学院 教授）

对谈人：李江（南京大学信息管理学院 教授）

2024/08/19（周一）19：30-21：00

【内容简介】

Research assessment is a labour-intensive part of the job of most academics, including for peer reviewing journal submissions or evaluating the quality of research produced by job applicants. As a result of the enormous amount of expert time consumed by this activity, there have been calls to automate as much of it as possible using artificial intelligence (AI). This talk reports a large scale experiment to assess whether traditional machine learning techniques could assess the quality of published journal articles with an acceptable degree of accuracy at the article and departmental levels. It also reports a short investigation into whether ChatGPT can write plausible and accurate reviewer reports on academic papers.

【相关论文及成果】

Thelwall M. (2024). Can ChatGPT evaluate research quality? Journal of Data and Information Science, 9(2), 1-21.

Thelwall M. (2024). Quantitative Methods in Research Evaluation: Citation Indicators, Altmetrics, and Artificial Intelligence. https://arxiv.org/abs/2407.00135 (book preprint)

Torres Salinas D, Thelwall M & Arroyo Machado W. (2024). ChatGPT for Bibliometrics: Potential applications and limitations. Working paper.

【主讲人简介】

Mike Thelwall is a Professor of Data Science in the Information School at the University of Sheffield in the UK. He primarily investigates quantitative methods to support research evaluation, including artificial intelligence, citation analysis and altmetrics. Mike has also developed a wide range of software and methods for gathering and analyzing social web data. His books include Quantitative Methods in Research Evaluation: Citation Indicators, Altmetrics, and Artificial Intelligence. He is an associate editor of the Journal of the Association for Information Science and Technology and sits on five other editorial boards.

https://www.sheffield.ac.uk/is/people/academic/mike-thelwall

【对谈人简介】

李江 南京大学信息管理学院教授，从事科学计量、网络计量与政策计量研究。在Journal of the Association for Information Science and Technology (JASIST)、Journal of Informetrics、Scientometrics等SSCI/SCI期刊上发表论文30余篇。担任Journal of Informetrics副主

编和Scientometrics编委。