1 of 102

New ways of sharing �one of psychology’s best “secrets”

Eric Youngstrom, PhD�CC BY 4.0

2 of 102

Disclosures

  • E. Youngstrom consults with Signant Health about assessment and psychometrics
  • Royalties from Guilford Press and �American Psychological Association
  • Co-Founder and Executive Director of HGAPS.org

3 of 102

Learning objectives

  1. Identify three advantages to using Wiki for disseminating information about psychology resources
  2. Identify the different audiences and uses of �Wikiversity versus Wikipedia
  3. State three advantages of linking OSF.io and Wiki
  4. Be able to use Creative Commons licenses � -Precise, titrated sharing!

4 of 102

(Secret objective….)

Bring the best information about psychological science directly to the people who would benefit

4

5 of 102

Overview

  • Frame: Big picture, and personal
  • Origin story
    • This is a personal mission
    • Implications for D5 and psychology

Why Wiki?

-One of the best ways of having our ideas reach people

Creative Commons licensing -- giving it away better

Commitment: What are you taking away from this? What giving back?

6 of 102

Why work?

Fortune -- (if citations and impact get us tenure….)

Fame -- Altmetrics, views… more citations

Filial love & altruism -- information only helps if people can find, understand, apply it

6

What is your rank order? �This talk will amplify two of the three (three with a stretch!)

7 of 102

Impact

Prestige

Ethics

Profit

Values

8 of 102

Zooming in & out

D5: We measure better!

Micro

Macro

9 of 102

D5 snapshot

History: One of the founding divisions

Thousands of members

Roots: Vedas, Aristotle, Galen…

Impact: Personality theories, cognitive abilities, statistical and qualitative methods….

Tremendous breadth of roles and perspectives

  • Assessment, Measurement, Qualitative (and a lot more!)

10 of 102

We measure better!

Latent variables, constructs -- things that matter:

Quality of Life, Subjective well being, Education

Psychometric methods, classical test theory & IRT

Qualitative methods

...cf. Chemistry!

And we punch way above our weight!

11 of 102

~117,000 APA Members (all included)

Also ~106,000 licensed psychologists in USA

~35,000 psychology professors in USA

~1,000,000 psychologists around world

… <2% are D5 members

(and not all of “our people” are licensed, �are professors...�...but still an outsized influence on field!)

12 of 102

Unmet need

1 psychologist per

3127 people in USA (331 million / 106,000 psychologists)

7,875 people in world (7.87 billion / 1 million psychologists)

1 psychiatrist per 10.870 people in the USA �(331 million/ 30,450 psychiatrists)

13 of 102

Why is Wikipedia so challenging?

Helps to have coding skills

Editors not selected for people skills

(think flame wars)

Don’t need to be content expert to edit

Suspicious of experts

  • Big business self-advertising
  • Narcissism trap (know own stuff best)

Most influential editors are putting in 80-120 hours/wk

  • More time, more technical skills, more clout

14 of 102

(Ignoring that neither people nor psychologists are uniformly distributed)

15 of 102

Recap of story so far...

D5 is awesome!

  • History, &
  • Influence, &
  • Ideas & Skills

But

  • Most people don’t know about us
  • There aren’t enough of us to go around

Therefore….

16 of 102

We need ways to share better

Tool

Benefit

Difficulty

Impact

1. Creative Commons

Share faster, better

Easy

2. OSF.io

Future proofing; registering

Moderate

3. Wikiversity

More technical; teaching; less interference

Moderate

4. Wiki Journals

Diamond Open access; Wiki ready

Moderate �(growing pains)

5. Wikipedia

Global reach, free

Hard

6. (Wikidata)

“ ” + AI

Hard

17 of 102

(there are even more ways to share better!)

Tool

Benefit

Difficulty

Impact

7. R, Python

8. GitHub

9. YouTube

10. Wikimedia Commons

11. Zotero

12. Reddit….

18 of 102

We need ways to share better

Tool

Benefit

Difficulty

Impact

1. Creative Commons

Share faster, better

Easy

2. OSF.io

Future proofing; registering

Moderate

3. Wikiversity

More technical; teaching; less interference

Moderate

4. Wiki Journals

Diamond Open access; Wiki ready

Moderate �(growing pains)

5. Wikipedia

Global reach, free

Hard

6. (Wikidata)

“ ” + AI

Hard

19 of 102

Tools �to expand �reach

19

20 of 102

Connecting to form Sharing

Ecology

20

Creative Commons

Licensing

21 of 102

???�Why Wiki?

22 of 102

5. Why Wikipedia?

Obvious reasons

  • Free
  • Global
  • Huge amount of information
  • “Anyone” can help

23 of 102

Who reads Wikipedia?

CC BY 4.0 Thomas Shafee, 2019

23

Thesis

1-10

Median Journal Paper

800

Top 5% Journal Paper

3,000

Median Wikipedia page

10,000 pa

Top 5% Wikipedia page

1,000,000 pa

24 of 102

Competing sources of medical information

  • Of the many competing sources, most are non-commercial
  • Wikipedia’s med content dominates most search engine results

Heilman, J.M. and West, A.G., 2015. Wikipedia and medicine: quantifying readership, editors, and the significance of natural language. Journal of medical Internet research, 17(3), p.e62.

24

25 of 102

Why Wiki?

Obvious reasons

  • Free
  • Global
  • Huge amount of information
  • “Anyone” can help

Surprising reasons

  • Strong version control
  • Easy to update
  • It’s where �the world is going
    • Humans
    • Also Google, artificial intelligence…

26 of 102

Wikipedia article shows up on first screenfull of hits!

No accident: �It’s part of �Google’s algorithm

27 of 102

Google Search

New: �Knowledge Panel

Built by AI: �Repackaging Wikipedia, Wikidata, other databases

Optimized for phones

28 of 102

Why Wiki?

And personal reasons….

29 of 102

29

30 of 102

Instant midlife crisis

30

31 of 102

Legacy?

Personal reasons….

31

32 of 102

33 of 102

iPhone 12

Apollo 11

Improvement

256 gigs RAM

24 megs RAM

10667x more

2100 MHz

1 MHz

2000x faster

Apollo 11 computer

ENIAC - first modern computer (WW II)

34 of 102

1970s, 1980s

1990s

Carroll Izard, PhD

How we write has changed...

35 of 102

Search

    • Google (scholar?)
    • PubMed
    • Web of ScienceTM

Distill

    • Triage hits
    • Decide what to get
    • Get PDFs

Gather

    • Add citations to reference manager
      • Zotero
      • EndnoteTM
    • Get PDFs

Publish

    • Reference list for final paper
      • APA 7th DOI hyperlink
      • Many search engines show citations now

Writing now (2020)

36 of 102

Search

    • Google (scholar?)
    • PubMed
    • Web of ScienceTM

Distill

    • Triage hits
    • Decide what to get
    • Get PDFs

Gather

    • Add citations to reference manager
      • Zotero
      • EndnoteTM
    • Get PDFs

Publish

    • Reference list for final paper
      • APA 7th DOI hyperlink
      • Many search engines show citations now

50,000 to 200,000 hits (easily)

50 to 200 references

Expertise distills the information by 1000x

Writing now (2020)

37 of 102

37

If we got 80% of the evidence past each leak, �the patient is only getting 20% of the benefit

Breakthrough!

Benefit

38 of 102

How Psychology �looks to Wikipedia

Bad news! Most of them are not great...

Good news! Lots of pages about Psychology topics! N > 12,500 pages

39 of 102

Okay, let’s fix it! �(Eric & Mian-Li, ~2016)

“Well, that didn’t go as planned!”

40 of 102

Why is Wikipedia so challenging?

Helps to have coding skills

Editors not selected for people skills

(think flame wars)

Don’t need to be content expert to edit

Suspicious of experts

  • Big business self-advertising
  • Narcissism trap (know own stuff best)

Most influential editors are putting in 80-120 hours/wk

  • More time, more technical skills, more clout

41 of 102

BARRIER: Coding (ewwww!)

41

42 of 102

43 of 102

The perfect editor

Altruistic

Knows Content

Unbiased

(WP: NPOV)

Free Time

Computer Skills

Programming Skills

Communicates Well

Teaches Well

44 of 102

Next solution: Build Teams

Content Experts

Professional Societies

Academics (but NPOV)

Communication Experts

Dissemination experts

Marketing

Shared Goal

Assessment

School Mental Health

Suicide prevention

COVID resources

Telehealth

Antiracism

Stigma reduction

Digital Natives

Students

CompSci

Stakeholders

Lived experience

Providers

45 of 102

45

46 of 102

HGAPS circa 2016 -- The OGs!

46

Mian-Li Ong, PhD

APA “Citizen Psychologist” 2018

47 of 102

HGAPS.org - Board 1.0

47

48 of 102

HGAPS.org - Board now

48

49 of 102

Thoughts for D5 vis Wikipedia

Why bother?

Biggest reach

Altruism:

We measure what matters

Tips:

  • Join a team!
  • Make it a hobby
  • Connect it to hobby
  • Make a project or campaign
  • Get consultation
  • Mental frame: Peer review
    • Opinionated from outside areas (~grants!)

50 of 102

3. What is this Wikiversity of which you speak?

Wikiversity is a �“sister project”

  • Same computers, software
  • Same Free!

Intended to be teaching platform

  • Okay to be more technical
  • Better fit for academics

Much less traffic

Less intrusive editors

51 of 102

Some intriguing possibilities

Platform for teaching

Graduate exercises

Technical skills

  • ROC Party
  • Clinical Assessment

Technical Manual in Cloud

Free measures often don’t have tech manuals...

52 of 102

D5 Symposium!

APS grant

52

Chloe Bryen

Carolyn Marsh

Lushna Mehra

Jaisal Merchant

53 of 102

Telepsychology Tips (New in 2020!)�bit.ly/HGAPStelepsychology

53

54 of 102

55 of 102

Manual in the Cloud

General Behavior Inventory

55

56 of 102

56

57 of 102

Feature! Table is sortable

57

58 of 102

58

59 of 102

If you made it now….

59

8.2021

Update:

1665 pages,

2 volumes

60 of 102

If you made the book

September 2019

282 printed pages

$25.80 with shipping

November 2020

643 printed pages

$36.05 with shipping

60

Plus some pleasant surprises….

61 of 102

Automatically includes:

An index!

A list of contributors*

61

62 of 102

The Manual in the Cloud:

EBA on Wikiversity

62

317,000 page views!

63 of 102

D5 Idea: Remixing Conferences

63

64 of 102

ABCT Bipolar SIG has Wikiversity pages

(@program chairs -- LMK if interested!)

64

15,000 page views!

65 of 102

Dashboard of impact across Wikis

66 of 102

Dashboard of impact across Wikis

67 of 102

Solutions

Visual editor getting better

Build vertical teams (students + experts)

Improve teaching materials

Or make it easier to re-mix expert content!

(and a long game….)

67

68 of 102

2. OSF.io

69 of 102

70 of 102

71 of 102

OSF.io

Pre-registration

Storage

  • Data
  • Code
  • Protocols
  • Measures

Version control

  • GitHub

Levels of sharing

Micro-publishing

  • DOIs & authorship
    • for code,
    • posters,
    • figures,
    • datasets

Preprint server

  • PsyArxiv

72 of 102

OSF.io as way to future proof + Share Credit

Jules Angst

  • Wrote one of the best free scales for hypomania
  • Translated into more than 30 languages
  • 3+ revisions, �multiple short versions

… He’s 94 years old… (gulp!)

OSF.io as way to create a library in cloud

  • Organized
  • Separating
    • Authorship
    • Librarian-ship
    • Derivative works

73 of 102

4. WikiJournals as disruptive innovation

74 of 102

4. WikiJournals as disruptive innovation

Diamond Open Access

  • No cost to access
  • No publication fee!
  • (Terrible business model!)
  • Made possible by using Wiki servers

Advantages:

Straight to digital

  • Color
  • Sortable, animated
  • Links to resources

Peer reviewed

DOI

Can re-use

Already on Wiki

75 of 102

WikiJournal weaknesses (2021)

Young

Not all fully indexed

Not well known

Tech skills helpful

Survived 4 years and counting

Getting added

IF ~3 already, winning awards

Teams:

  • Tech editors
  • Teaching students
  • Simplifying tools

76 of 102

1. Creative Commons

76

77 of 102

Copyright

  • Intended to protect ownership rights of creator
  • Covers writing, artistic works
  • Vs. Processes and devices covered under patent
  • Different laws for different countries

77

78 of 102

Sea changes

  • Internationalization
    • Long history of stealing from each other �& expropriation
  • Technology
    • Printing press
    • Digitization
      • What used to be illegal and difficult and expensive now is just illegal (cheap and easy)
      • Napster wars, digital rights management (iTunes as breakthrough)
  • Open access
    • Initially perceived as fringe, predatory … Now mandatory in many scenarios

78

79 of 102

Without a license, don’t know legal use

(or whom to thank!)

Who made it?

Are we allowed to use it?

Can’t put it on Wiki…

(gray zone about our website)

79

80 of 102

Which works best for academics?

80

License

Comment

CC BY-NC-ND

Most restrictive CC

CC BY-NC-SA

CC BY-NC

CC BY-ND

Might make sense for standardized assessments, translations

CC BY-SA

Tempting… but unintended consequence

CC BY

Least restrictive with attribution

CC0

Doesn’t even require attribution:

Terrible if trying to get tenure!

Public Domain Mark

Documents that something is Public Domain �(not always easy to tell)

More restrictive

Public Domain

Licenses

81 of 102

Order matters

  • CC-BY first:
    • Fine to cite in peer reviewed articles, books, upload on preprint server
    • It’s free for publisher to use
    • Doesn’t force them to change their business model
    • (CC BY-SA could force them to give away book/journal!)
  • Traditional publication first:
    • Now publisher owns it, and we have to ask permission (and may get charged!)

81

82 of 102

Eureka!�We can have our IP cake and eat it, too

82

CC licensing does not prevent copyright

Possible to have both on same product!

CC license does not restrict copyright owner –

-- it is granting a license to other users

Solves practical problems of finding author,

obtaining permission

CC BY 2.0 Squigfried 2009

83 of 102

83

84 of 102

How to do it (easy version)

84

I want to give this away,

but still get tenure!

CC BY 4.0 Eric Youngstrom

85 of 102

How to do it (hi tech version)

Use the Creative Commons license wizard

https://creativecommons.org/choose/

  • Helps pick license
  • Gives logo
  • Embeds code (“watermark”)
    • Prevents removing attribution
    • Lets computer searches find object by license
      • Easier to find the free stuff and re-mix!

85

[YOUR NAME]

Example of CC license (attribution only)

86 of 102

Hosting materials on Open Science Framework (OSF.io)

86

87 of 102

87

The pre-print gets a DOI

These can be merged when it finishes �peer review and gets publication DOI

525+downloads!

88 of 102

88

6200+ visits!

Update

89 of 102

Another preprint option

89

90 of 102

HGAPS on LinkedIn

90

91 of 102

HGAPS on YouTube

92 of 102

@_HGAPS on Twitter

92

93 of 102

Build a network

  1. Mailing list (send updates)
  2. Practitioner focus groups & beta-testers
    1. Feedback
    2. Suggestions & additions
  3. Want to learn to Wiki?
    • Thursday night Zooms
    • Workshops in 2021

https://bit.ly/Clin2HGAPS

94 of 102

Our journey towards the tipping point

2022?

2021 ← We are here

2020 -COVID, expand HGAPS Board

2019 - ran for D5, ABCT

2018 - HGAPS 501c3

2017 - HGAPS incorporates

2016 - teaching with Wiki, D53 initiative

2015 - teaching with Wiki; HGAPS club

2014 - Mian-Li hatches idea

2013 - (a fog…)

2012 - (extensive PT)

2011 - hit by car

2010 - yada, yada

2010

2011

2012

2013

2014

2015

2017

2018

2020

2019

2021?

2022?

95 of 102

Conclusion

D5: We are small but mighty!

We measure better!

Tremendous breadth & applicability

(umbrella vs. diamond)

The five ideas are techniques for:

  • Sharing better
  • Raising our visibility
  • Helping more people

96 of 102

Ways to share better

Tool

Benefit

Difficulty

Impact

Together

1. Creative Commons

Share faster, better

Easy

How to;

HGAPS can “re-tweet”

2. OSF.io

Future proofing; registering

Moderate

D5 could have �OSF Meeting; future-proof

3. Wikiversity

More technical; teaching; less interference

Moderate

Manuals in cloud

Share teaching materials

4. Wiki Journals

Diamond Open access; Wiki ready

Moderate �(growing pains)

Peer reviewed version of manuals!

Authorship & wiki

5. Wikipedia

Global reach, free

Hard

Partnerships on pages

6. (Wikidata)

“ ” + AI

Hard

(Email if interested)

97 of 102

Parting thoughts

2020 & 2021 have been humbling

A year goes fast

Learned a huge amount about D5

Much that I hope you can share with the world

And We already are doing more of this than we realized

98 of 102

HGAPS.org - Board now

98

D5 speaker at APA 2021!

D53 keynote at APA 2019 (Chicago)

HGAPS Board President

Speaker at APA

D5 Convention Program Chair APA 2021!

D5 discussant

Board Liaison to DiSSECT

99 of 102

100 of 102

100

This talk is a care package for dissemination and implementation!

Point your phone at the QR code, or go to bit.ly//D5-HGAPS

101 of 102

With deep gratitude,�

So much admiration for �the generosity �and tenacity �and grit,

Enthusiasm for how it is taking root,

And with hope for �reaching more people,

THANK YOU

102 of 102

102

If we got 80% of the evidence past each leak, �the patient is only getting 20% of the benefit

Breakthrough!

Benefit