The Future of Peer Review in Scientific Manuscripts: Embracing Artificial Intelligence

By Staff Writer

May 28, 2024

Introduction

The future of peer review in scientific publishing should include artificial intelligence (AI). Large-language models, incorporating in-context learning, could assist editors in triaging manuscripts. Numerous questions have emerged over decades concerning peer review. Is it effective in detecting fabrication, falsification, image manipulation, or adherence to reporting guidelines? Can AI be fair, or subject to bias? Is it efficient, or increasingly labour-intensive without compensation? Given these challenges, AI should and will be increasingly used to assist in peer review.

Effectiveness of AI in Peer Review

Peer review is crucial for maintaining the quality of scientific publications. However, human reviewers often struggle to detect issues like data fabrication, falsification, and image manipulation. AI could be more effective at identifying these problems. For instance, large-language models could be trained to spot inconsistencies in data and adherence to reporting guidelines. A study by Liang et al. assessed the agreement between human reviewers and GPT-4 on 3096 manuscripts submitted to 15 Nature journals. They found a 30.1% overlap in comments, which is comparable to the 28.6% overlap between two human reviewers. This suggests that AI can provide valuable insights, potentially even more so than human reviewers.

Fairness in Peer Review

Bias in peer review is a well-documented problem. Various forms of peer review, such as open, single-blind, and double-blind, aim to mitigate bias. However, these methods are not foolproof. For example, a study found that manuscripts from authors with Nobel prizes were less likely to be rejected compared to those from unknown authors. AI could help reduce bias in peer review. Algorithms can be designed to evaluate manuscripts based solely on their content, without considering the authors’ identities or affiliations. This could lead to a fairer assessment process and reduce the influence of factors like language proficiency and institutional reputation.

Efficiency in Peer Review

The number of scientific publications has increased by 47% between 2016 and 2022, reaching 2.82 million manuscripts per year. This surge has overwhelmed editors and peer reviewers, leading to a higher rejection rate without external review. AI can help alleviate this burden by initially screening manuscripts and providing a summary of their quality. AI can also speed up the review process. For example, a recent study found that 57.4% of investigators in AI and computational biology found GPT-4’s feedback helpful, and 82.4% found it more helpful than some human reviewers. This indicates that AI can provide timely and valuable feedback, enhancing the efficiency of the review process.

The Future of AI in Peer Review

While AI shows promise, it is not yet ready to replace human reviewers entirely. Current systems need more data to improve their accuracy and reliability. However, AI can complement human reviewers by providing initial assessments and identifying potential issues. One concern is the confidentiality of manuscripts. Large-language models extract data from numerous published works, which could compromise the confidentiality of the reviewed manuscripts. A possible solution is to limit AI’s training data to the journal’s database or open-access articles.

In the future, AI could be used to scan all submissions and provide a quality summary for editors. This will help editors decide whether to proceed with external peer review. Embracing AI in peer review is inevitable, and the focus should be on evaluating its effectiveness and reassuring authors about the fairness of the process.

Conclusion

AI has the potential to address many challenges in the peer review process, including effectiveness, fairness, and efficiency. While it is not yet ready to replace human reviewers, it can significantly enhance the review process. As AI technology matures, it will likely play an increasingly important role in scientific publishing.

Reference url

Recent Posts

diabetes care South Africa
     

A Shared-Value Model for Enhancing Diabetes Care in South Africa

🌍 How can innovative models transform diabetes care in South Africa?

Discover how Discovery Health’s shared-value program is not only improving patient outcomes through enhanced glycemic control, but also reducing healthcare costs. This strategic approach is making significant strides in diabetes management, setting a precedent for future healthcare innovations.

Curious to learn more? Dive into the full article for an in-depth look at the program’s impact!

#SyenzaNews #HealthcareInnovation #HealthEconomics #DigitalTransformation

oral cancer East Africa
   

Oral Cancer in East Africa: The Need for Early Detection

💡 Did you know that Toombak use is a leading risk factor for oral cancer in East Africa?

A recent scoping review sheds light on the shocking prevalence of oral cancer in the region, emphasising the urgent need for public health interventions and improved early detection strategies. Enhancing awareness around risk factors like Toombak, tobacco, and alcohol for tackling this growing health crisis.

Curious about the key insights and their implications for health economics? Look into the full article to find out more!

#SyenzaNews #HealthEconomics #Oncology #GlobalHealth

Novartis patent cliff layoffs
     

Engineering Resilience: Mastering Pharma Patent Expiration Strategy

🚨 Are you still reacting to pharmaceutical patent expirations with layoffs and litigation, or are you ready to engineer a strategy that turns the patent cliff into your next competitive edge?

Patent expirations don’t have to derail your pharma portfolio. Learn how to outmaneuver generics and transform challenges into advantages. Dive into our latest insights and take control today.

#SyenzaNews #pharmaceuticals #innovation #PharmaStrategy #patentcliffs

When you partner with Syenza, it’s like a Nuclear Fusion.

Our expertise are combined with yours, and we contribute clinical expertise and advanced degrees in health policy, health economics, systems analysis, public finance, business, and project management. You’ll also feel our high-impact global and local perspectives with cultural intelligence.

SPEAK WITH US

CORRESPONDENCE ADDRESS

1950 W. Corporate Way, Suite 95478
Anaheim, CA 92801, USA

© 2025 Syenza™. All rights reserved.