Apr 02, 2025 07:00:00

How did arXiv, the giant preprint server that supports modern science, come into being?

arXiv , the world's largest preprint server, provides free upload and download functions for papers in fields such as physics, mathematics, computer science, and statistics, and plays an important role in the development of academic fields. arXiv was born from the code of a single physicist.

Inside arXiv - the Most Transformative Platform in All of Science - Slashdot
https://science.slashdot.org/story/25/03/27/1456239/inside-arxiv---the-most-transformative-platform-in-all-of-science

Generally, papers published in academic journals are peer-reviewed by researchers, which can take several months to a year to be published. However, arXiv allows you to post your own paper as a 'preprint' that does not require peer review, so anyone can immediately make it available for free. Science journalist Claire Watson speculates that in a crisis such as the COVID-19 pandemic, preprint servers such as arXiv, bioRxiv, and medRxiv could quickly disseminate breakthroughs in treatment and prevention , potentially saving the lives of millions of people.

In 2021, the general science journal Nature recognized arXiv as one of the ' 10 computer codes that transformed science ,' praising its role in promoting academic development. At the time of writing, arXiv hosts more than 2.6 million papers and receives more than 20,000 new submissions every month. In addition, there are 5 million monthly active users, and a variety of papers have been uploaded to arXiv to date.

The paper on the machine learning model Transformer , which sparked the modern AI boom, has also been posted on arXiv, as has Gregory Perelman's paper on the solution to the Poincaré Conjecture , one of the Millennium Prize Problems . In light of these contributions to the scientific community, Wired has commented that arXiv 'is like imagining a world without libraries and GPS for scientists.'

arXiv was created by Paul Ginsberg, a physics professor at Cornell University. In 1991, Ginsberg, who was a researcher at Los Alamos National Laboratory, was approached by Joan Cohn, a postdoc at the Institute for Advanced Study in Princeton, who suggested automating the preprint distribution process, saying, 'There was no set way to access physics preprints, and researchers had to either subscribe to their institution's mailing list or contact them directly by email.'

Ginsberg also received a statement from a physicist who said, 'The papers sent to me by email while I was traveling were filling up my computer's storage.' Ginsberg took this seriously, and with Korn's advice, he wrote a script to automate the distribution of papers in just one day. Looking back on that time, Korn said, 'Ginsberg had the foresight.'

Thus, arXiv was born, initially just an automated email server, but in 1994, with the help of a grant from the National Science Foundation, it migrated to more reliable

Perl code.

Ginsberg initially expected to post around 100 articles per year, but the number of articles uploaded to arXiv gradually increased. Behind this growth of arXiv is a clause in arXiv that states, 'Users who upload preprints grant arXiv a non-exclusive license to distribute their articles in perpetuity.' This clause ensures that preprints posted on arXiv will not be removed, even if they are published in an academic paper.

In 2001, Ginsberg transferred the management of arXiv to the Cornell University Libraries. At the time, Ginsberg said, 'Their job is to disseminate resources to scholars, and it seemed natural to me that they should run arXiv in a similar role.'

However, the complex and enormous amount of code that Ginsberg built would cause great confusion at the transferred Cornell University Library. Ginsberg also worked behind the scenes at arXiv to check for errors in the code, but some developers criticized him for being too involved in development and said he was a good junior manager but had no management sense.

In 2019, arXiv was transferred to Cornell University's Department of Computing and Information Sciences. However, within months, arXiv's management was in turmoil, with a new director with a background in commercial academic publishing taking over. 'It was not a good time for arXiv,' one arXiv employee said.

Nevertheless, in 2023, arXiv received funding of approximately 1.5 billion yen from the Simons Foundation and the National Science Foundation, and Cornell University professor Ramin Zabi was appointed faculty director. Under a new governance structure, arXiv is moving to the cloud and refactoring to Python.

The world's largest preprint server 'arXiv' will receive approximately 1.5 billion yen in funding, which will be used for cloud migration and code modernization - GIGAZINE