1 of 29

Open Science Adoption within Organizations: Lessons for individuals from theories about technology adoption

Eli Holmes

NOAA Fisheries

eeholmes

2 of 29

About me:

  • Fisheries research scientist – my primary activity is research
  • 20+ years at NOAA Fisheries
  • Not a manager or a supervisor but I am a team-leader and project leader
  • Early adopter of Open Science and I develop open source software
  • For 15+ years, I have been involved in advocating for open-source and open-science at NOAA Fisheries
  • I teach within NOAA and am affiliate faculty at Univ of Washington
  • I have been involved in 2 Openscapes cohorts and was a ‘mentor-in-training’ for 2nd

3 of 29

NOAA Fisheries (NMFS) Science Centers

NWFSC

AFSC

SWFSC

SEFSC

NEFSC

PIFSC

4 of 29

NMFS Openscapes Mentors Program

2021-2022 Four NMFS Openscapes Champions Cohorts

2023 NMFS Openscapes Mentors Program

  • Train local leaders
  • Collab on staff training
  • Equity across science centers

https://github.com/nmfs-openscapes

GRASSROOTS EFFORT

5 of 29

“The Open Science/Open Source train has left the station. Get on board or get left behind!”

Summarizing the participant chats during a public NASA presentation on their Open Science initiative. There was a train in the background at one point during one of the presentations.

6 of 29

How do innovations spread through organizations? How can Diffusion of Innovations theory help us with the next steps?

  • Where should we put our energy in 2022 – in prep for the mentor program and Year of Open Science in 2023?

  • How should we talk to leadership about the NMFS Openscapes mentor program?

7 of 29

EM Rogers (1962) “Diffusion of Innovation” theory

Predictable progression of stages as idea diffuses through a population: innovators, early adopters, early majority, late majority, laggards.

Time

Each group has different personalities, different motivations, and different objectives.

8 of 29

Tipping Point

There is a tipping point around 15% when the idea is widely spread enough that it begins being adopted faster. Between 3 to 15% adoption, progress is slow and process goes through a painful “Trough of Disillusionment”.

Time

Tipping point

9 of 29

The Early Adopters are critical

  1. You reach the tipping point by reaching Early Adopters
  2. Their energy and effort is what drives the initial diffusion process, but that is a hard and slow process.

Time

10 of 29

Early Adopters: Characteristics

Attributes of OS Early Adopters

Like new technology, but are a bit more practical than the ‘Innovators’

Embrace change and comfortable with new ideas

“How to” manual is enough for them. Don’t need convincing.

See the potential of the new idea even in the fairly early stages and have the temperament (doggedness) to develop ideas into full working implementations

Challenges for OS Early Adopters

Isolated. Each center only has a few ‘Early Adopters’

Differential support for OS at each center.

Not in leadership positions, though may be team/project leads. Many tend to be junior.

Embedded in teams that are not using OS workflow

11 of 29

In my agency, we are in the early Early Adopters stage of adopting Open Science (OS)

OS Early Adopter stage

  • Fishery Integrated Toolbox (FIT)
  • RStudio Connect licenses
  • Openscapes cohorts (2020-2022)
  • GitHub Enterprise at a few centers
  • NMFS-wide virtual R Workflow workshops
  • NMFS Openscapes (Nov 2021)
  • NMRS R UG (Nov 2021)

OS Innovator stage

  • Lots of individuals developing R packages
  • A few centers with GitHub orgs and scattering of repos
  • Individuals teaching R at their local center
  • Local R User Groups
  • Individuals using GitHub (or GitLab) but really just harder core coders
  • Individual workshops

There are a number of common Open Science & Open Source languages. Python & R are very common. R is more common in fisheries while Python more common in the earth sciences and data science fields (my impression). Both have large and active Open Science & Open Source communities.

12 of 29

Identify, support and develop the Early Adopters

Their energy and effort is what drives the initial diffusion process

Q1. Where should we put our energy right now – in prep for the mentor program?

13 of 29

Pre-2018 or so, very hard/impossible for OS Innovators to collaborate

Literally no way to get information to each other

NWFSC

AFSC

SWFSC

SEFSC

NEFSC

PIFSC

14 of 29

The Early Adopters are hard to reach and many are isolated

Early Adopter

15 of 29

Around 2018-2019, FIT begins filling the gap for providing R and software dev training. NMFS-wide email list. Interestingly, Google email integration also made it much easier to communicate across NMFS.

NWFSC

SWFSC

SEFSC

HQ

NEFSC

PIFSC

AFSC

16 of 29

2021: R Workflow Workshops opened up to all NMFS staff and advertised using FIT email list. Openscapes NMFS cohorts in 2021 involved 4 science centers. NASA Openscapes GitHub org (early 2021) provides a framework for moving forward. NMFS R UG (Nov 2021) joined by 100+ NMFS scientists across all centers

NWFSC

SWFSC

SEFSC

HQ

NEFSC

PIFSC

AFSC

NMFS R UG has members across all science centers. No more silo-ing!

17 of 29

2022 Main Goal: Reach the Early Adopters

OS Early Adopter does not mean they have already adopted OS. It is those who see it and think ‘This is great! Sign me up!’

  • Leverage NMFS R UG
  • Identify reps at each center to facilitate communication
  • Strengthen our connections across NMFS science centers
  • Amplify efforts of current leaders & mentors
    • Advertise their events, provide GH org,
  • Offer workshops/presentations at diverse events in order to reach new potential Early Adopters

18 of 29

Diffusion of Innovation theory: reduce barriers

The rate of diffusion depends on how easy it is to overcome the barriers for adopting the idea.

Time

19 of 29

Barriers to think about while reaching the Early Adopters

  • Compatibility: Does it fit with their current workflow?
  • Complexity: How easy is it to use?
  • Trialabiltiy: Can people try it out?
  • Observability: Are the benefits observable?

20 of 29

“The Open Science/Open Source train has left the station.”

Next slides are what I didn’t get to during the ESIP talk

21 of 29

Need to change our messaging

Q2. How should we talk to leadership about the NMFS Openscapes mentor program?

22 of 29

Geoffrey Moore (1991) “Crossing the Chasm

Time

23 of 29

Early Adopters

This is great! This is going to make our work so much more robust!!

Check out this cool new R package!

Wow, that is so cool. I want to try that!

I have a VISION of what our workflow would look like if everyone embraced this!

GitHub Actions! Wow! Let me try it too! 12 hours later…. That was so much fun! I learned so much!!

24 of 29

Early Adopters

Visionaries

Can see the future potential given the ideas and a test example

Looking for fundamental breakthroughs AND ARE EXCITED BY FUNDAMENTAL BREAKTHROUGHS

Willing (and excited) to put in substantial effort to get new technology working

Have the temperament to turn insight of potential into a working project

Risk Takers

There can be a disconnect between the vision in their heads and what they actually have in hand

Too willing to put in substantial effort to get new technology working?

Not all that excited by incremental change

25 of 29

Early Adopters need to convince ‘Early Majority’

The Chasm blocking organizational adoption of new ideas

26 of 29

Early Majority: Early Adopters need to target this group

Open to new technology but will need convincing

Risk averse; don’t want to head down a ‘rabbit hole’

Price sensitive

Note in many organizations the top leadership is not in the “Early Majority”. Yet the Early Majority are those open to the new ideas and are the ones the Late Majority will be influenced by.

Pragmatic

Want to see that the idea works and has value

27 of 29

Late Majority is next group after Early Majority and often includes organizational leadership

Generally resistant to change

Risk averse, price sensitive, really don’t want staff going down ‘rabbitholes’

Will need to see strong numbers to convince them: 1) Other organizations that have adopted this, 2) Fraction of people who have adopted, 3) “New” is a negative for this group.

Leadership of the organization is more likely to be in this group.

28 of 29

How to Cross the Divide

The Chasm blocking organizational adoption of new ideas

29 of 29

Key points

  • Recognize that messaging that excites the Early Adopters will not excite the Early Majority and could backfire
  • Show other organizations are adopting this
  • Collect examples of local success stories
  • Identify problems that OS solves that are high priority issues for Early Majority
  • Put effort into ‘metrics’. How much staff time saved? How many errors avoided?
  • Security, cost are important issues
  • Do research. Do any individuals on the leadership team have personal experience in their pre-leadership jobs with the “pain” points that OS is solving?