Skip to main content

Refine your search

Abstract image of a globe.

Fake references are not only a medical problem: new audit finds them across physics, engineering, and computer science journals

Months after an audit published in the Lancet reported thousands of fabricated citations emerged in medical papers, the same research team has found the same problem in the physical sciences, engineering and computing.

About 1 in 435 science and engineering papers from 2026 cite studies that cannot be found online, up from 1 in 1,600 in 2023. While relatively few papers were affected, fabricated references were identified across every discipline examined: 25.6 per 10,000 papers in physics, 18.4 in materials science, 11.1 in computer science and artificial intelligence, 10.3 in engineering, and 4.3 in chemistry.

The study, “Evaluation of possibly fabricated references in 500,000 science, engineering, and computing papers,” was published in the Proceedings of the National Academy of Sciences (PNAS) and is part of a body of research made available this year by the team, examining this problem. 

A Lancet research letter in May, the first, identified 4,046 fabricated citations in 2,810 of 2.5 million medical papers. A July paper in the Journal of Internal Medicine reported fabricated references were about twice as common in medRxiv preprints as in peer-reviewed articles (37.2 versus 16.4 per 10,000). And a September arXiv preprint from the team, not yet peer reviewed, found 26 large language models fabricated 55% of the medical references they were asked to supply.

“The proportion of articles containing fabricated references remains small, but in early 2026 it was nearly four times as high as in 2023, and such references were found in all the fields we examined. This is why reference verification is, or at least should be, part of quality assurance across scholarly publishing,” says Laura-Maria Peltonen, Associate Professor at the University of Eastern Finland.

The PNAS study was led by Maxim Topaz, PhD, associate professor at Columbia Nursing and Columbia University Data Science Institute. Other authors of the PNAS study include Pallavi Gupta, PhD, and Zhihong Zhang, PhD, Columbia University School of Nursing; and Laura-Maria Peltonen, PhD, Department of Health and Social Management, University of Eastern Finland; Wellbeing Services County of North Savo; Wellbeing Services County of Southwest Finland; and Department of Nursing Science, University of Turku.

The audit reveals a small but accelerating problem

The researchers analyszed 500,000 papers in chemistry, physics, materials science, engineering, and computer science published from January 2023 through March 2026, drawn from OpenAlex, a large database of scholarly works. An automated verification tool checked the 21.6 million references that carried a digital object identifier (DOI). It classified 1,135 references across 619 papers as fabricated when the cited title could not be found in online databases. When two independent experts reviewed a random sample of 400 flagged references, they confirmed 85.8% were fabricated. The share of papers affected rose from 1 in 1,600 papers (6.3 per 10,000) in 2023 to 1 in 650 (15.4 per 10,000) in 2025 and 1 in 435 (23.0 per 10,000) in the first quarter of 2026. 

Most affected papers contained one or two fabricated references. But 27 papers contained five or more, and those 27 accounted for more than a third of all fabricated references identified. Applying each field’s rate to the approximately 7 million papers in these fields over the same period, the authors estimate that about 8,500 published papers carry at least one fabricated reference. At the time of the audit, two of the 619 affected papers had been retracted.

“Our study does not delve into why a fabricated reference has ended up in an article. However, the existence of a reference can be verified automatically before publication, and Finnish academic journals and universities should also incorporate such verification into their publication processes,” Peltonen says.

The authors recommend routine automated reference checks at submission, together with retroactive screening of the published literature. They also recommend that indexing services and research-integrity databases record fabricated references as a distinct category, separate from plagiarism or data falsification, so that they can be tracked and acted on.

What's next in the pipeline

As a next step, the researchers are screening up to 12 million medical papers published since 2020 and have experts grade how much several hundred of the fabricated references affect the papers that cite them. Working with journal editors and research integrity officers, they will use the findings to develop screening protocols, policies, and trainings for journal submissions. 

Research article:

Topaz M, Gupta P, Zhang Z, Peltonen LM. Evaluation of possibly fabricated references in 500,000 science, engineering, and computing papers. Proceedings of the National Academy of Sciences. Published 26.10.2026. https://doi.org/10.1073/pnas.2623869123