1 of 50

New Developments in Preprinting and Preprint Review

Jeroen Bosman (UU)�Bianca Kramer (Sesame Open Science)

Jeroen Sondervan (UU)�Ludo Waltman (CWTS)

DOI: https//doi.org/10.5281/zenodo.7040997

Slide deck (also) available at: https://tinyurl.com/OSF2022Preprints

NB most images in this slidedeck are clickable!

Open Science Festival, Amsterdam, 1 September 2022

2 of 50

Welcome and introduction (5 min.)�

Part 1 - Preprinting

  • Presentation
  • Interactive discussion (breakout groups; 20 min.)

Part 2 - Preprint peer review

  • Presentation
  • Interactive discussion (breakout groups; 25 min.)

Part 3 - Publish Your Reviews

  • Presentation

Interactive discussion (plenary; 25 min.)

Wrap up (5 min.)

Programme

3 of 50

Part 1 - Preprinting

4 of 50

  • Early version of paper, chapter or other publication
  • Before formal peer review
  • AKA “early version”, “submitted version/manuscript”, “working paper”
  • Shared publicly either before or on submission for more formal publication with peer review
  • Can have updated/corrected versions, e.g. based on comments
  • Manuscripts shared as preprint now accepted by almost all journals/publishers

Part 1: Preprints - Main characteristics

5 of 50

Dissemination and access reasons:

  • Speeding up discovery of (preliminary) research results
  • Generating early feedback, also before journal submission
  • Providing free access to research outcomes

Registration reasons:

  • Establishing evidence on researchers’ most recent activity
  • Establishing priority of discoveries
  • Early registration of who is working on what, facilitating new collaborations

Part 1: Preprinting - why?

6 of 50

Part 1: Preprinting - where?

7 of 50

disciplinary

linked to publisher

regional

at

at

by

by

used

by

by

by

Part 1: Preprinting - where?

8 of 50

Part 1: Preprinting - how?

Source: A Practical Guide to Preprints: Accelerating Scholarly Communication (1.0). Zenodo. https://doi.org/10.5281/zenodo.5600535

  • Fast
  • Free for author
  • Free for reader
  • Citable, with DOI
  • Linked to article

9 of 50

Part 1: Preprinting - uptake

10 of 50

Part 1: Preprinting - uptake

astronomy, mathematics:

  • take off in 1990s, currently at 20-35% of article output

physics, economics

  • take off in 1990s, currently at ~20% of article output

technology

  • take off in 2007, currently at ~10% of article output

psychology, biological sciences

  • take off in 2016, currently at 15-20% of article output

medicine

  • take off in 2018, currently at ~10% of article output

most other fields

  • slow take off after 2017 and mostly still (way) below 10% of article output

based on Dimensions data, checked 20210206 for 1990-2020 and 20220830 for 2021

11 of 50

Part 1: Preprints and COVID-19

12 of 50

  • Not yet mainstream in most fields, despite ‘Corona-boost’
  • Uncertainty over status of preprints vis-à-vis peer reviewed articles
  • Sustainability and funding of preprint archives
  • Lack of fostering of preprinting by institutions and societies
  • Risk of dissemination of pseudoscience despite sanity checks

Part 1: Preprinting - issues

13 of 50

Practical Preprint Guide

14 of 50

Practice

15 of 50

Breakout groups - interactive discussion

Pros and cons

Ways to advance

Disciplinary differences

Other topic(s)

Physical Sciences /�Life Sciences

Social Sciences

Humanities

16 of 50

Breakouts - 20 minutes

17 of 50

Part 2 - Preprint Peer Review

18 of 50

19 of 50

Journals, preprint servers, and peer review platforms

Different ways of organizing dissemination and evaluation of scientific knowledge

Journals

Dissemination

Evaluation

Peer review platforms

Evaluation

Preprint servers and repositories

Dissemination

20 of 50

Peer review platforms

21 of 50

Scenario: The extended journal

Journals

Preprint servers and repositories

Peer review platforms

The extended journal

22 of 50

23 of 50

24 of 50

Scenario: Mixed system

Journals

Preprint servers and repositories

Peer review platforms

25 of 50

26 of 50

27 of 50

15 PCIs

28 of 50

90 PCI friendly journals��Peer Community Journal

29 of 50

Scenario 3: No journal involved

Journals

Preprint servers and repositories

Peer review platforms

30 of 50

31 of 50

32 of 50

33 of 50

Preprint peer review

Different ways of organizing dissemination and evaluation of scientific knowledge ?

Journals

Dissemination

Evaluation

Peer review platforms

Evaluation

Preprint servers and repositories

Dissemination

34 of 50

Breakout groups - interactive discussion

Pros and cons

Ways to bring further

Disciplinary differences

Other topic(s)

Physical Sciences /�Life Sciences

Social Sciences

Humanities

35 of 50

Breakouts - 20 minutes

36 of 50

Slide deck available: ��https://tinyurl.com/OSF2022Preprints

37 of 50

Part 3: Publish Your Reviews

38 of 50

39 of 50

About 168 hours per year spent in peer review of journal articles

“By making reviews available only to the small group of individuals directly involved in the peer review process of an article, readers of the article are denied the opportunity to benefit from the information provided by the reviews

“Given the significant efforts made by many reviewers to provide detailed comments on the articles they review, this is a major waste of scientific labor

40 of 50

Publish Your Reviews

41 of 50

Publish Your Reviews

Journals

Dissemination

Evaluation

Peer review

Acceptance

Rejection

Publication

Preprint servers and repositories

Dissemination

Peer review platforms

Evaluation

42 of 50

Publish Your Reviews - Benefits

43 of 50

Publish Your Reviews - Supporters

10 publishers/journals (below)

25 other organizations (right)

11 ambassadors

70+ signatories

44 of 50

Publish Your Reviews - Sign the pledge

Join the 70+ colleagues that have already signed the Publish Your Reviews pledge:

When a journal invites me to review an article that is available as a preprint, I will publish my review alongside the preprint. I will make sure that the published version of my review does not include the journal name, a recommendation for publication, or other confidential information.

http://publishyourreviews.org

45 of 50

Interactive discussion

46 of 50

Participant takeaways, plans, intentions

47 of 50

Participant takeaways, plans, intentions

48 of 50

Participant takeaways, plans, intentions

49 of 50

Participant takeaways, plans, intentions

50 of 50

New Developments in Preprinting and Preprint Review

Jeroen Bosman (UU)�Bianca Kramer (Sesame Open Science)

Jeroen Sondervan (UU)�Ludo Waltman (CWTS)

Slide deck (also) available at: https://tinyurl.com/OSF2022Preprints

NB most images in this slidedeck are clickable!

Open Science Festival, Amsterdam, 1 September 2022