Iain Hrynaszkiewicz, ICOR, May 2023
How do we measure success for Open Science?
What we are trying to achieve
We need better tools to measure (Open) Science
Fosci, Mattia, Richens, Emma, & Johnson, Rob. (2019). Insights into European research funder Open policies and practices. Zenodo. https://doi.org/10.5281/zenodo.3401278
Quotes
“It's very labour-intensive!”
– Representative of a European university
“A very manual process”
– Representative of a North American funder
Hrynaszkiewicz, I. & Cadwallader, L. (2021, September 27). A survey of funders’ and institutions’ needs for understanding researchers’ open research practices. https://doi.org/10.31219/osf.io/z4py9
Goals of the Open Science Indicators project
Improve ability to measure success of solutions
Understand different communities and co-create new solutions
Support Open Science initiatives outside PLOS with reliable data
Increase adoption of Open Science globally
Shorter term
Longer term
Read the Scholarly Kitchen blog post:
1
2
3
4
Open Science Indicators principles (abridged)
1. Use established community definitions/ standards
2. Measure what is happening, not just what we want to happen
3. Be interoperable
4. Be scalable
5. Take an Open Science approach (open data, methods, etc)
6. Use Open Science Indicators responsibly
Hrynaszkiewicz and Kiermer: https://doi.org/10.6084/m9.figshare.21640889.v1
Results show steady increases in OS practices
Measures adoption of multiple OS practices and potential for adoption across the scholarly literature:
n= 78,600
What’s next?
Quarterly public data releases & new indicators (protocols is next)
Explore interest in cross-sector collaboration
Increase scope/ content coverage?
Provide alternative formats?
You tell us
ihrynaszkiewicz@plos.org
Access the OSI dataset and methods on Figshare:
+
1
2
3
4