Why institutions are turning to enriched data to help them track researcher outputs
2023๋ 9์ 7์ผ
์ ์: Linda Willems
![](http://images.ctfassets.net/zlnfaxb2lcqx/3ZTxBNzwayh3mrPr2iSMeQ/e57dab494625e7a21b48b3f68ec19d11/woman_smiling_at_laptop__cropped_.jpg?fm=webp&w=2140&q=90)
As a unique partnership between arXiv and Elsevier enters its second year, we look at how we generate data collaboratively and the benefits they bring.
In 2022, a new initiative was launched for arXivโs 275+ member institutions์ ํญ/์ฐฝ์์ ์ด๊ธฐ. For the first time in arXivโs 32-year history, data by institution -- including subject category breakdown โ has been offered to arXiv members. These data are now updated annually and can be accessed via dedicated digital dashboards.ย
June marked the 2023 dashboard update, covering 2020-22 submission statistics. And just like last year, Elsevier will draw on Scopus data to optimize statistics for arXiv free of charge, creating practical insights that institutions can leverage for decision-making, evaluations and more.
How the data collaboration works
The Scopus team usesโฏarXivโs open APIs์ ํญ/์ฐฝ์์ ์ด๊ธฐ to collect metadata records of submitted preprints from arXiv and then connects those records to lists of disambiguated authors and organizations drawn from Scopus. This is enriching the data; a process that brings meaning to existing data through added connections or information. The enriched data is then delivered back to arXiv, so they can upload it to the dashboards.ย ย
![](http://images.ctfassets.net/zlnfaxb2lcqx/4lOEy7GO62lOwR3lgUtMW5/95f2619135bb45aa248351eeb988ab4b/Connected_Gears.jpeg?fm=webp&w=1186&q=75)
The dashboards allow institutions to view preprint submission data at their institution, including a breakdown of preprints by subject category. Participating institutions are better able to track changes in their institutionโs research outputs posted to arXiv and identify arXiv usage in different subject categories over time. Ultimately, this supports institutions to build a more holistic picture of the research activities taking place across their campuses.ย
Managing data with transparency and integrityย ย
Itโs important to make clear that we do not retain or use in any way the data that arXiv shares for enrichment. Data privacy is something we donโt take lightly and, throughout the data enrichment stage, the Scopus team adhere to Elsevierโs five privacy principles.ย
Value: We collect and use personal information to facilitate efficiency and productivity in research, healthcare and education.ย
Transparency: We tell users about the personal information we collect, including how and why we will use and share it.ย
Choice: Users are given choice over the collection, use and sharing of their personal information.ย
Anonymization: We depersonalize and aggregate personal information where individual identification is not necessary.ย
Accountability: We are committed to acting as a responsible steward of personal information.ย
Building a more holistic view of research outputsย
The preprints hosted on arXiv and other preprint servers, such as SSRN and bioRxiv, are typically full-length research papers that have yet to be published in a scholarly journal or undergo peer review. While solutions like Scopus and SciVal can help institutions track publications in peer-reviewed journals and books, tracking their contributions to individual preprint servers at an institutional level is more challenging.ย ย
Yet, support for preprints as a research-sharing channel is rising. For example, in July 2020, Europe PMC began indexing the full text of COVID-19-related preprints alongside peer-reviewed articles, to make them searchable. And Scopus now includes preprints์ ํญ/์ฐฝ์์ ์ด๊ธฐ published from 2017 onwards.ย
![](http://images.ctfassets.net/zlnfaxb2lcqx/2SsNcJwl40z06UblXVail/d032ac7f7fa72e10cf9a70d9b12eb3dd/Puzzle_Pieces.jpeg?fm=webp&w=1186&q=75)
And although many journals wonโt consider papers previously published elsewhere, manuscripts that have already been shared as preprints are generally acceptable: in return, most publishers ask authors to update any pre-publication versions with a link to the finalโฏpublished article.ย
For institutions seeking to gain a more complete picture of their researchersโ outputs, understanding and identifying contributions to preprint servers is becoming increasingly important. For example, the insights can be used to:ย ย
Analyze and report on progress towards institutional open access goals and other key strategic targetsย
Provide evidence of open access contributions for institutional and national assessment exercisesย
Inform future planningย
Populate their open institutional repositoryย
Support the mission of the library to expand access to scholarshipย
In the case of the arXiv dashboards, librarians can not only identify which of their institutionโs research outputs have been posted on arXiv, they can also track changes in different subject categories over time.ย ย
arXiv has also introduced an additional service that is also available to non-members - worldwide submission ranks by organization์ ํญ/์ฐฝ์์ ์ด๊ธฐ, which can be filtered by an institution or country. For libraries and research offices, this offers a unique opportunity to understand how their arXiv usage compares to similar institutions or those in their geographic area.ย
Preprints โ the pros and consย
While posting research in preprint form can bring many benefits for researchers and their institutions, like any form of scholarly communication, they come with their drawbacks.ย
In the Library Connect article Preprints: best practice tips librarians can share with researchers Jay Bhatt, preprint advocate and Librarian for Engineering and Biomedical Engineering at Drexel University์ ํญ/์ฐฝ์์ ์ด๊ธฐ, ran through some of the preprint pros and cons.ย
According to Jay, benefits include:ย ย
![](http://images.ctfassets.net/zlnfaxb2lcqx/6zMRh5RnmWDVXnBU9TMqeV/52af9cd5d3899824d5bf869b1077dc58/Jhaybhatt.jpeg?fm=webp&w=393&q=75)
Speed:โฏโPreprints are a great way to share research quickly and get it discovered early. And because preprints are time stamped, it helps to establish who came up with an idea/solution first.โย
New opportunities:โฏโPreprints can lead to researchers discovering compatible interests, partnership opportunities, interdisciplinary avenues of research, or even result in joint grant applications. If you look at award eligibility criteria today, funders put a lot of emphasis on collaboration.โย
Improved manuscripts:โฏJay knows of several graduate students who used the comments posted on their preprints to refine their papers before submitting them to a peer-reviewed journal.ย
Ability to share negative or null results:โฏJay says: โโฆsignificant time and money can be saved by sharing them, so others donโt make the same mistakes. In fact, in situations like COVID, sharing negative results can literally save lives.โย
ย For Jay, other advantages include the fact that they can be cited, allowing authors to startโฏaccumulating citationsโฏright away. In addition, they are freely available, which can help to drive open access, accelerate and improve research, and ensure the workโฏreaches a wider audience, including the public.ย ย
In a recent Elsevier case study์ ํญ/์ฐฝ์์ ์ด๊ธฐ, Emily Hart, Liaison Librarian and Research Impact Lead at Syracuse University Libraries in the US, touched on another potential benefit of preprints โ their ability to help researchersโ careers. โIf [researchers] come to us maybe a year or two before they go up for tenure and promotion, we can do things like benchmark how their publications are being received by looking at their citations in Scopusโฆ based on what we find, we ask questions like have they put their preprint out and do they have an open access version of their article available?โ She adds: โEssentially, we are looking at how they can increase their reach so that they gain more visibility.โย ย Potential disadvantages of preprints include:ย ย
Accountability:โฏThe results in preprints havenโt been validated by peer review, yet some members of the public and media quote them as confirmed facts. This was a particular issue with some COVID preprints, but, as Jay notes: โโฆ.controversial COVID preprint studies were quickly disproved and results like that can help to indicate a more responsible way forward.โย
Challenges around tracking impact:โฏThere is currently no easy way to link the citations that preprints receive with the citations that an associated peer-reviewed article receives.ย
arXiv โ promoting the growth of open access
Since its launch three decades ago, arXiv has provided a fast, free digital service to share research results and increase the visibility of important research. Today, arXiv is home to more than 2.25 million scholarly articles in eight major subject areas. In many fields of mathematics and physics, the majority of scientific papers are postedโฏon arXiv prior to their publication in a peer-reviewed journal.ย ย
![](http://images.ctfassets.net/zlnfaxb2lcqx/77zs0SCqZ2ox0CshN039GS/dc7e56508348bd4b31f68665dfbf112d/Arxiv_Logo.png?fm=webp&w=1030&q=75)
arXiv is maintained and operated by Cornell Tech, a part of Cornell University, in the United States. As an open platform where researchers can share and discover new, relevant science freeโฏof charge, arXiv relies on funding sources. These include the Simons Foundation, other donors, and theโฏmember institutions (universities, libraries, research institutions and labs). The latter contribute approximately 30 percent of arXivโs operating budget, and in return they enjoy a series of benefits, including access to their arXiv digital dashboard.ย
โarXiv is an essential resource for researchers at our member institutions,โ said Stephanie Orphan, arXivโs Program Director. โProviding submission statistics allows us to better serve our members and enhances their understanding of their researchersโ contributions to scholarship.โย ย
Did you know that Scopus contains profiles for more than 84,000 organizations worldwide?โฏLearn more about Scopus organization profiles.์ ํญ/์ฐฝ์์ ์ด๊ธฐ Scopus subscribers can explore their organization profiles on Scopus.com์ ํญ/์ฐฝ์์ ์ด๊ธฐ.ย
Want to know more about your arXiv institutional dashboard or becoming an arXiv member? Contact arXiv atโฏ[email protected]์ ํญ/์ฐฝ์์ ์ด๊ธฐ.ย
๊ธฐ์ฌ์
![Portrait photo of Linda Willems](http://images.ctfassets.net/o78em1y1w4i4/asnaM35St5G7cAeKrwfkg/cb2e70eaa857c93dfb4832d6467e3b68/Linda-Willems.jpg?fm=webp&w=88&q=75)
LW