1 of 33

(except logos)

101 innovations in scholarly communication

Science together - which tools? which rules?

@MsPhelps

@jeroenbosman

Bianca Kramer & Jeroen Bosman, Utrecht University LibraryMarch 2-3, 2017

2 of 33

3 of 33

How many tools do you use in your research?

4 of 33

How many tools people use

frequency

number of tools

5 of 33

Tools used together

6 of 33

Workflows

7 of 33

A model of the research workflow

preparation

analysis

writing

publication

outreach

assessment

discovery

Preparation:

  • Define & crowdsource �research priorities / ideas / collaborations
  • Get funding / contract

Discovery:

  • Search literature / data / code / …
  • Get access
  • Get alerts / recommendations
  • Read / view
  • Annotate

Analysis:

  • Collect / mine / extract data / experiment
  • Share protocols / notebooks / workflows
  • Analyze

Writing:

  • Write / code
  • Visualize
  • Cite
  • Translate

Publication:

  • Archive / share publications
  • Archive / share data & code
  • Select journal to submit to
  • Publish

Outreach:

  • Archive/share posters
  • Archive/share presentations
  • Tell about research outside academia
  • Researcher profiles/networks

Assessment:

  • Comment / peer review
  • Determine impact of research output
  • Determine impact of researchers

8 of 33

A model of the research workflow

preparation

analysis

writing

publication

outreach

assessment

discovery

Rounds of grant writing

and application

Iterations of

search and reading

Drafting, receiving comments,rewriting

Submit, peer review, rejection, resubmitting

Rounds of experiments and measurements

9 of 33

A model of the research workflow

preparation

analysis

writing

publication

outreach

assessment

discovery

Rounds of grant writing

and application

Iterations of

search and reading

Drafting, receiving comments,rewriting

Submit, peer review, rejection, resubmitting

Rounds of experiments and measurements

10 of 33

A model of the research workflow

preparation

analysis

writing

publication

outreach

assessment

discovery

Rounds of grant writing

and application

Iterations of

search and reading

Drafting, receiving comments,rewriting

Submit, peer review, rejection, resubmitting

Rounds of experiments and measurements

11 of 33

Hypothetical research workflows

12 of 33

Example research workflows: �traditional to experimental

Add no functionality compared to print era, except online accessibility

Represent radical change, with sometimes uncertain technologies and outcomes; still under development

Use scale and linking possibilities of the internet to increase speed and efficiency

Actually change ‘the way it’s always been done’ – e.g. user-driven, different business models, changes in the sequence of research activities, shifting stakeholder roles

13 of 33

Hypothetical research workflows

Elsevier

y

y

y

y

y

Digital Science

14 of 33

Tools used together – iPython/Jupyter

Online version allowing display of tool of your choice: http://tinyurl.com/toolcombinations

15 of 33

Tools used together - GitHub

Online version allowing display of tool of your choice: http://tinyurl.com/toolcombinations

16 of 33

What makes tools either a no-go

or highly attractive ?

17 of 33

18 of 33

Three goals for science & scholarship (G-E-O)

  • declaring competing interests
  • replication & reproducibility
  • meaningful assessment
  • effective quality checks
  • credit where it is due
  • no fraud, plagiarism
  • connected tools & platforms
  • no publ. size restrictions
  • null result publishing
  • speed of publication
  • (web)standards, IDs
  • semantic discovery
  • re-useability
  • versioning

open peer review

open (lab)notes

plain language

open drafting

open access

CC-0/BY

good

efficient

open

technical changes & standards

research governance changes

economic

& copyright changes

researcher

funder

publisher

public

government

library

19 of 33

Open Science practices

openly share

project proposals

involve public / patients

in drafting

research proposals

share hypothesis before

starting research

(if possible/relevant)

search for OA literature

extensively search for

existing data before

generating your own

use easily attainable

software to allow anyone to reproduce your results

20 of 33

Open Science practices

store data in the most

open format possible

cite OA versions of

literature & provide

data and code citations

executable, forkable

publications, including

text, code & data

acknowledge

contributor roles

in a publication

publish preprints,

encourage feedback /

open peer review

translate research objects

in world languages

21 of 33

Open Science practices

communicate analyzed data with: experts, non-expert scientists, lay-public

make re-use and licensing

guidelines explicit

assessment of scientists

based on a variety

of contributions,

not just H-index

refuse to be part of

all male of all white

panels

use metrics of

commercial /social

applications to

assess research

publish pre-publication

history (version + reviews)

22 of 33

23 of 33

Avalanche of tools

24 of 33

25 of 33

Supply: tools database

26 of 33

For checking functionalities and finding alternatives for tools that you are not content with:

400+ Tools and innovations in scholarly communication

27 of 33

OPEN

CLOSED

AGGREGATION

INTEGRATION

COLLABORATION

28 of 33

http://101innovations.wordpress.com

29 of 33

What choices do researchers make: �the survey

30 of 33

20,663 respondents

31 of 33

20,663 respondents

32 of 33

Data sharing

33 of 33

Experiment! - Tools used so far�in the 101 innovations project

files

search

share scripts

surveys

create csv

link tools

analyze

analyze

analyze

website

share code

share data

archive files

share data

visualize

dashboard

data paper

present

outreach

present

outreach

outreach

collaborate

outreach

assess