The Future of Peer Review in Scientific Manuscripts: Embracing Artificial Intelligence

By Staff Writer

May 28, 2024

Introduction

The future of peer review in scientific publishing should include artificial intelligence (AI). Large-language models, incorporating in-context learning, could assist editors in triaging manuscripts. Numerous questions have emerged over decades concerning peer review. Is it effective in detecting fabrication, falsification, image manipulation, or adherence to reporting guidelines? Can AI be fair, or subject to bias? Is it efficient, or increasingly labour-intensive without compensation? Given these challenges, AI should and will be increasingly used to assist in peer review.

Effectiveness of AI in Peer Review

Peer review is crucial for maintaining the quality of scientific publications. However, human reviewers often struggle to detect issues like data fabrication, falsification, and image manipulation. AI could be more effective at identifying these problems. For instance, large-language models could be trained to spot inconsistencies in data and adherence to reporting guidelines. A study by Liang et al. assessed the agreement between human reviewers and GPT-4 on 3096 manuscripts submitted to 15 Nature journals. They found a 30.1% overlap in comments, which is comparable to the 28.6% overlap between two human reviewers. This suggests that AI can provide valuable insights, potentially even more so than human reviewers.

Fairness in Peer Review

Bias in peer review is a well-documented problem. Various forms of peer review, such as open, single-blind, and double-blind, aim to mitigate bias. However, these methods are not foolproof. For example, a study found that manuscripts from authors with Nobel prizes were less likely to be rejected compared to those from unknown authors. AI could help reduce bias in peer review. Algorithms can be designed to evaluate manuscripts based solely on their content, without considering the authors’ identities or affiliations. This could lead to a fairer assessment process and reduce the influence of factors like language proficiency and institutional reputation.

Efficiency in Peer Review

The number of scientific publications has increased by 47% between 2016 and 2022, reaching 2.82 million manuscripts per year. This surge has overwhelmed editors and peer reviewers, leading to a higher rejection rate without external review. AI can help alleviate this burden by initially screening manuscripts and providing a summary of their quality. AI can also speed up the review process. For example, a recent study found that 57.4% of investigators in AI and computational biology found GPT-4’s feedback helpful, and 82.4% found it more helpful than some human reviewers. This indicates that AI can provide timely and valuable feedback, enhancing the efficiency of the review process.

The Future of AI in Peer Review

While AI shows promise, it is not yet ready to replace human reviewers entirely. Current systems need more data to improve their accuracy and reliability. However, AI can complement human reviewers by providing initial assessments and identifying potential issues. One concern is the confidentiality of manuscripts. Large-language models extract data from numerous published works, which could compromise the confidentiality of the reviewed manuscripts. A possible solution is to limit AI’s training data to the journal’s database or open-access articles.

In the future, AI could be used to scan all submissions and provide a quality summary for editors. This will help editors decide whether to proceed with external peer review. Embracing AI in peer review is inevitable, and the focus should be on evaluating its effectiveness and reassuring authors about the fairness of the process.

Conclusion

AI has the potential to address many challenges in the peer review process, including effectiveness, fairness, and efficiency. While it is not yet ready to replace human reviewers, it can significantly enhance the review process. As AI technology matures, it will likely play an increasingly important role in scientific publishing.

Reference url

Recent Posts

pediatric heart devices
           

Urgent Need for Pediatric Heart Devices

🚨 Are we doing enough for our youngest heart patients?

Experts at the International Society for Heart and Lung Transplantation are urgently calling for improved pediatric heart devices to ensure that children with life-threatening heart conditions receive the specialized care they need. With many current devices designed for adults, the risk to young patients is alarming.

Dive into the key insights on the critical gaps in pediatric cardiac care and the innovative solutions that could bridge these divides.

Read more to understand how collaboration, investment, and policy changes can transform pediatric heart treatment!

#SyenzaNews #MedicalDevices #HealthcareInnovation

suzetrigine pain management
      

Journavx for Pain Management: Toward Affordability and Access

💊 The jury is out on the pricing for Journavx®

Delve into our review of the recent ICER 2025 report on suzetrigine (Journavx®) to learn about the anticipated value relative to its clinical efficacy, safety profile and potential cost savings in tackling acute pain while addressing the opioid crisis.

Explore how suzetrigine paves the way for a safer, more effective approach to pain management and its implications on healthcare economics.

#SyenzaNews #HealthEconomics #HealthcareInnovation #Journavx

defunding scientific research
      

Defunding Scientific Research: Implications and Misconceptions in Gawande’s Analysis of Harvard Funding Cuts

🚨 What happens when scientific research funding is threatened?

In his thought-provoking article, Atul Gawande highlights the dire implications of proposed federal funding cuts to elite institutions like Harvard. He argues that such actions could devastate not just innovation, but also patient care and public health across the nation.

Explore the complexities of research funding and the potential ripple effects on America’s scientific landscape. Don’t miss out on these critical insights!

#SyenzaNews #HealthcareInnovation #HealthEconomics #MarketAccess

When you partner with Syenza, it’s like a Nuclear Fusion.

Our expertise are combined with yours, and we contribute clinical expertise and advanced degrees in health policy, health economics, systems analysis, public finance, business, and project management. You’ll also feel our high-impact global and local perspectives with cultural intelligence.

SPEAK WITH US

CORRESPONDENCE ADDRESS

1950 W. Corporate Way, Suite 95478
Anaheim, CA 92801, USA

© 2025 Syenza™. All rights reserved.