1 of 39

The Turing Way:�Guide to Reproducible, Ethical and Collaborative Research

Malvika Sharan

Pronouns: she/her

@malvikasharan @turingway, CC-BY 4.0, Zenodo: https://zenodo.org/record/5083747, DOI: 10.5281/zenodo.5497457

2 of 39

The Turing Way

@malvikasharan @turingway, CC-BY 4.0, https://github.com/alan-turing-institute/the-turing-way, DOI: 10.5281/zenodo.5497457

3 of 39

The Turing Way

@malvikasharan @turingway, CC-BY 4.0, https://github.com/alan-turing-institute/the-turing-way, DOI: 10.5281/zenodo.5497457

You are invited to join the research project that you really wanted to work on.

Hey you,

4 of 39

The Turing Way

@malvikasharan @turingway, CC-BY 4.0, https://github.com/alan-turing-institute/the-turing-way, DOI: 10.5281/zenodo.5497457

YEAH.

5 of 39

The Turing Way

@malvikasharan @turingway, CC-BY 4.0, https://github.com/alan-turing-institute/the-turing-way, DOI: 10.5281/zenodo.5497457

(Looks up about the project)

6 of 39

The Turing Way

http://phdcomics.com/, @malvikasharan, DOI: 10.5281/zenodo.5497457

BLEAH.

7 of 39

@malvikasharan @turingway, CC-BY 4.0, https://github.com/alan-turing-institute/the-turing-way, DOI: 10.5281/zenodo.5497457

Project

Development

Real-world

Deployment

So much to learn!

8 of 39

@malvikasharan @turingway, CC-BY 4.0, https://github.com/alan-turing-institute/the-turing-way, DOI: 10.5281/zenodo.5497457

So much to do!!

Feedback

Collaborate

Iterative

improvement

Model

Development

System

Deployment

Engineering

Impact

Celebrate success

User training

testing

9 of 39

@malvikasharan @turingway, CC-BY 4.0, https://github.com/alan-turing-institute/the-turing-way, DOI: 10.5281/zenodo.5497457

Feedback

Collaborate

testing

Iterative

improvement

Engineering

Impact

Celebrate success

User training

10 of 39

@malvikasharan @turingway, CC-BY 4.0, CC-BY image by The Turing Way and Scriberia, , DOI: 10.5281/zenodo.5497457

11 of 39

The Turing Way

An Open Source guide on Data Science.

We involve and supports a diverse community to make data science reproducible, ethical, collaborative and inclusive for everyone.

@malvikasharan @turingway, CC-BY 4.0, https://github.com/alan-turing-institute/the-turing-way, DOI: 10.5281/zenodo.5497457

12 of 39

The national institute for data science and artificial intelligence�

@malvikasharan @turingway, CC-BY 4.0, https://www.turing.ac.uk/, DOI: 10.5281/zenodo.5497457

13 of 39

Tools, Practices and Systems

The Alan Turing Institute, Tools, Practices and Systems

Trustworthy systems
Transparent reporting
Inclusive interoperable design
Ethical integrity
Respectful co-creation
Leadership in open research

@malvikasharan @turingway, CC-BY 4.0, https://www.turing.ac.uk/, DOI: 10.5281/zenodo.5497457

14 of 39

Lead of Tools, Practices & Systems Programme

Kirstie Whitaker

The Turing Way Book on Reproducibility

15 of 39

@malvikasharan @turingway, CC-BY 4.0, https://github.com/alan-turing-institute/the-turing-way, DOI: 10.5281/zenodo.5497457

Reproducibility

16 of 39

@malvikasharan @turingway, CC-BY 4.0, CC-BY image by The Turing Way and Scriberia, , DOI: 10.5281/zenodo.5497457

Reproducibility

17 of 39

Guide for Reproducible Research

@malvikasharan @turingway, CC-BY 4.0, Book: https://the-turing-way.netlify.app/welcome, DOI: 10.5281/zenodo.5497457

18 of 39

Guide for Project Design

@malvikasharan @turingway, CC-BY 4.0, Book: https://the-turing-way.netlify.app/welcome, DOI: 10.5281/zenodo.5497457

19 of 39

Guide for Communication

@malvikasharan @turingway, CC-BY 4.0, Book: https://the-turing-way.netlify.app/welcome, DOI: 10.5281/zenodo.5497457

20 of 39

Guide for Collaboration

@malvikasharan @turingway, CC-BY 4.0, Book: https://the-turing-way.netlify.app/welcome, DOI: 10.5281/zenodo.5497457

21 of 39

Project and Community Growth

@malvikasharan @turingway, CC-BY 4.0, https://star-history.t9t.io/#alan-turing-institute/the-turing-way, DOI: 10.5281/zenodo.5497457

2.5 years, >175 pages

Community resources, events, guidance, templates, training

285 direct GitHub contributors and thousands of users

https://zenodo.org/record/3332807

We have seen our project and community grow in the last two and half years. We currently host over 175 live sub-chapters across five guides, and several under development.

In order to ensure that our community members are able to participate irrespective of their previous experience of working with the Open Source or data science community, we provide the resources, guidance, templates, training and pathways that they can use to stay involved in the community.

We have over 275 direct contributors on GitHub, where we develop our resources and 1000s of users. For example, our illustrations, which I have intensively used in my talk, have been downloaded over 5000 times.

We also maintain social media presence and communicate about the project so that it can reach to as many people as possible and we can bring new voices in. For a community that started at a grassroot level, we are very grateful to have these members working with us.

22 of 39

Ethical Research

Researchers in data science have an obligation to consider the ethical standards and their impact on society.

CC-BY 4.0, https://the-turing-way.netlify.app/ethical-research/ethical-research.html, DOI: 10.5281/zenodo.5497457

23 of 39

CC-BY 4.0, https://the-turing-way.netlify.app/ethical-research/ethical-research.html, DOI: 10.5281/zenodo.5497457�Christopher Burr | Automating Ethics. (2021, February), https://chrisdburr.github.io/blog/automating-ethics/automating-ethics/

24 of 39

CC-BY 4.0, https://the-turing-way.netlify.app/ethical-research/ethical-research.html, DOI: 10.5281/zenodo.5497457

Core contributors: Laura Carter, Ismael Kherroubi-Garcia, Arielle Bennett, Laura Acion

25 of 39

https://the-turing-way.netlify.app/ethical-research/law-policy.html, The Universal Declaration of Human Rights at 70: Putting Human Rights at the Heart of the Design, Development and Deployment of Artificial Intelligence - HRBDT. (2019)

Researchers and data scientists should ensure that they respect, protect, and fulfil human rights.

Laura Carter, PhD candidate in the Human Rights Centre at the University of Essex, UK

I want to emphasise that when we discuss Ethical data research we should be making sure that our work is grounded within existing human rights frameworks.

There needs to be a wider shared understanding of what human rights means across different countries, cultures and groups of people. This means that we create opportunities to listen to everyone about what being able to enjoy their human rights means to them, and make sure that research complies with human rights.

Laura Carter has written a chapter explaining the relation between ethics, law, policy and human rights. It comes with a disclaimer that The Turing way guide to ethical research is not a legal advice. And There are numerous accountability and enforcement mechanisms that exist within the human rights framework.

But because they are a legal framework, they are not as easily accessible, and hard to apply to the daily work of data science and research.

This is where the ethical guidance and codes can allow us to interpret and implement human rights in our work.

26 of 39

CC-BY 4.0, https://the-turing-way.netlify.app/ethical-research/activism.html, DOI: 10.5281/zenodo.5497457

Laura Carter with Arielle Bennett, Research Project Manager, The Alan Turing Institute

27 of 39

The Turing Way GitHub issue: https://github.com/alan-turing-institute/the-turing-way/issues/1919 ,

Haraway, D. (1988). Situated Knowledges: The Science Question in Feminism and the Privilege of Partial Perspective.

Ricker, B. (2017, February 04). Reflexivity, Positionality and Rigor in the Context of Big Data Research.

The questions we ask, the analysis we conduct and the patterns we find are heavily influenced by the lenses by which we view the world.

Nina di Cara, PhD student in data science for mental health using social media data, University of Bristol

28 of 39

Every contribution counts

@malvikasharan, @turingway, CC-BY image by The Turing Way and Scriberia, DOI: 10.5281/zenodo.5497457

The Turing Way fosters a culture of collaboration

Open Leadership principles

29 of 39

Develop & share

Share resources

Review and update

Maintain & improve

Make it global

Share best practices

Pathways for Collaboration

30 of 39

A community-oriented collaborative book

Time Zone distribution by https://whena.re, @LauraC_rter, @malvikasharan, DOI: 10.5281/zenodo.5497457

Finally, To represent different perspectives, It’s important to us that the book is a community project: driven by the needs and wishes of the contributors, and built with those needs in mind. We involve diverse voices and acknowledge all contributions fairly.

We provide a dedicated page in the book for contributors’ record, that has unique links for all our contributors where they can highlight their personal work. They can share who they are, how people can learn more about them, and what kind of contributions they have made. They can write this in a way that's most meaningful for them. Some of them would want to build a new skill, such as working with a version control system or community building. They can choose to work on a specific task that matches their interest. They can then update their page describing how they achieved these skills and build evidence that can become part of their CV.

�As a community-developed resource, The Turing Way Guide to Ethical Research is always a work in progress.

31 of 39

@malvikasharan @turingway, DOI: 10.5281/zenodo.5497457

32 of 39

A Book with Five guides

An Open Source Project

A Community

A Culture of Collaboration

Book:

the- turing-way.netlify.app/

GitHub:

github.com/alan-turing-

institute/the- turing-way

Twitter:

twitter.com/turingway

Email:

theturingway@gmail.com

CC-BY 4.0, The Turing Way

33 of 39

Missing Narratives Around Diversity and Inclusion in RSE

Nominate someone else whose views and perspectives you would like to see represented in RSE

Event on 28 September, 11:00

Details: bit.ly/turingway

@malvikasharan @turingway, DOI: 10.5281/zenodo.5497457

34 of 39

Notable Impacts Beyond the project

Resources are being used by learners, educators, community builders, policy makers and researchers globally

Reproducibility of scientific results in the EU 2020 (report)
An Emerging Technology Charter by Mayor of London (policy)
Innovation Scholars: UKRI grant 2020 (funding)
CodeRefinary and Library Carpentries (training materials)
Projects by data scientists including at the Office for National Statistics
Cited by 10+ peer-reviewed articles & 10+ open source projects

@turingway, @malvikasharan, CC-BY 4.0, DOI: 10.5281/zenodo.5497457

Our moonshot goal is to make reproducibility too easy not to do. And that can happen when there are system and structure level changes by influencing research at the national and international levels, where inclusive practices and reproducibility are as important as a data and algorithm. We promote our resources for use by learners, educators, policymakers and researchers globally.

Some of the notable impact we had in 2020 with the support of our contributors are that the project was highlighted in the EU report for reproducibility for the scientific result, a policy by the Mayor of London On an emerging technology charter used The Turing Way for informing their open and inclusive projects, a funding call from UKRI referenced the project for the example of data science culture, communities for training like code refinery and library carpentries have cross-referenced The Turing Way and the work has been cited by multiple peer-reviewed articles.

35 of 39

Thanks to our community of contributors & users!

36 of 39

Meeting you where you are!

Join the community
Learn a new skill
Share your skills
Collaborate with others
Mentor others’ contributions
Represent this community

We value your participation!

CC-BY image by The Turing Way & Scriberia, @turingway, @malvikasharan, CC-BY 4.0, DOI: 10.5281/zenodo.5497457

37 of 39

Book Dash, 08-12 Nov

- Virtual event: 4 days, short development sessions (1-2 each day)

- Applications are open till 1st October

Collaborate, develop resource, add features, join discussions, informal chat, social hours etc.

CC-BY image by The Turing Way & Scriberia, @turingway, @malvikasharan, CC-BY 4.0, DOI: 10.5281/zenodo.5497457

https://tinyurl.com/tw-bookdash-template

Email Malvika: msharan@turing.ac.uk

38 of 39

Join a Community Event

- Collaboration Cafes

1^st & 3^rd Wednesdays (14:00 UTC)

- Coworking Calls

Mondays (10:00 UTC)

- Community calls

Starting in October

- More ways to connect

CC-BY image by The Turing Way & Scriberia, @turingway, @malvikasharan, CC-BY 4.0, DOI: 10.5281/zenodo.5497457

bit.ly/turingway

39 of 39

Acknowledgements:

Kirstie Whitaker, Whitaker Team Members
The Turing Way community, friends & collaborators

Book: the-turing-way.netlify.com
Twitter: twitter.com/turingway
Newsletter: tinyletter.com/TuringWay
Chat: gitter.im/alan-turing-institute/the-turing-way
GitHub: github.com/alan-turing-institute/the-turing-way
Original artwork by Scriberia: https://doi.org/10.5281/zenodo.3332807