1 of 56

Wikipedia and Medicine

James Heilman

MD, CCFP(EM)

All text is under a CC-BY-SA license

Wiki Project Med Foundation

Andrew G. West

PhD

2 of 56

A little about myself

  • Small town ER doc
  • Some academic affiliation but am a long way from my University (~800 Km)
  • Became involved in 2007/2008 after coming across a poor quality medical articles
  • An active volunteer ever since

3 of 56

?

4 of 56

5 of 56

6 of 56

Is Wikipedia Read by Nearly Everyone?

7 of 56

Medical stats

  • Wikipedia’s medical content received ~5 billion page views for 160,000 articles in 2013
  • 2-3% of all pageviews for Wikipedia are for health (0.6% of articles)
  • Half of this views were for English, the other half were in the other 275 languages

8 of 56

Medical stats

  • 50% to 100% of physicians use Wikipedia
  • 35 to 70% of pharmacists admit to its use(3)
  • Most frequently used source by junior MDs (besides Google)
  • 93% of medical students use Wikipedia

9 of 56

Why do medical students use Wikipedia?

The use of Wikipedia is almost ubiquitous throughout medical school for medical education. The ease of access and understanding, as well as readily usable and consumer-friendly interfaces, means students often turn to this, rather than traditional authoritative resources. While the reliance on Wikipedia reduces throughout medical school, this is likely due to confidence and ability to concurrently use other resources as well as perceived reduced reliability. Medical school administrators would benefit from embracing and developing web2.0 resources and include their use in ongoing dynamic medical education.

10 of 56

11 of 56

Does Wikipedia Cover Nearly Everything?

12 of 56

Size of the medical content across all languages

  • Equivalent to ~126.9 volumes of the Encyclopedia Britannica

13 of 56

Does Wikipedia Have a Huge Number of Editors?

14 of 56

A few numbers

  • Anyone can edit (22 million registered accounts), many more editing anonymously
  • 80,000 people contribute >5 edits a month
  • 12,000 people contribute more than 100 edits a month
  • All volunteers working for free

15 of 56

Medical numbers

  • 1.1M edits by 224,000 accounts.
  • 410,000 were in English by 92,672 accounts
  • 274 editors made more than 250 edits in 2013

16 of 56

English Wikipedia only

17 of 56

Who are they?

  • Half health care professionals
  • 52% have either a Masters, PhD or MD
  • 33% have a Bachelor's degree
  • 80% male, 10% female, 10% would rather not say
  • Many of the non professionals are fixing grammar or doing other maintenance

18 of 56

Why do they edit?

  • Positive about Wikipedia
  • Feel a responsibility to help others
  • Learning
  • Fun!

19 of 56

?

20 of 56

Is Wikipedia Peer Reviewed?

21 of 56

Featured articles / good articles

  • Must undergo semi formal peer review
  • Medicine has 58 FAs and 166 GAs (<1%)
  • More formal peer review and author credit in collaboration with journals

22 of 56

Collaborations

23 of 56

Cochrane

  • 31,000 members from 120 countries which work on high quality synthesis of the medical literature
  • WiR, Sydney Poore, former nurse, very experienced Wikipedian
  • Developing a weekly mailing list for all new / updated reviews
  • Speaking at the Cochrane Colloquium, India
  • Knowledge translation
  • wikipedian@cochrane.org

24 of 56

  • Largest cancer charity in the UK
  • Recently hired their first WiR, John Bryne
  • Currently concentrating on improving brain, pancreatic and esophageal cancer articles
  • Has begun donating images
  • John.Byrne@cancer.org.uk

25 of 56

  • Collaborating on definitions of disease
  • Currently a pilot project
  • Editing time given at work

26 of 56

Health Information for All in a Language of their Choice

(16)

27 of 56

Who are involved?

  • Translators Without Borders
    • An NGO founded in 1993
    • Humanitarian translations into other languages
  • Wikiproject Medicine
    • A group of volunteers within Wikipedia who are interested in improving medical content
  • Wikipedians in many languages

Wiki Project Med

Foundation

28 of 56

What we are working on?

  • Creating a base set of medical topics that should exist in all languages
  • Improving them to a professional standard in English while trying to keep language simple
  • Translating content into as many other languages as possible
  • Integration the translations with existing Wikipedia content
  • Get easy and inexpensive access for everyone (including via collaborations with cell phone companies)

29 of 56

Two tracks of article

  • Full articles
  • Brought to GA/FA
  • 2500-15000 words
  • Goal is 100
  • Suitable for mid to large languages
  • Short articles
  • 3 to 4 paragraph overviews
  • Leads of English articles
  • Goal is 1,000
  • Suitable for small to mid languages

30 of 56

31 of 56

Why do we need this?

  • Every day tens of thousands die for lack of low cost health care. Per HIFA 2015, a major factor is poor access to information(5)
    • 8 of 10 caregivers do not know the key symptoms of pneumonia
    • 4 of 10 mothers believe fluids should be withheld if their child has diarrhea
    • More than 60% of Africains said that a friend or family member could have been saved if they’d had information in their own language
  • Wikipedia is a viable way to address this knowledge gap.

32 of 56

Why other languages?

  • Issue: Little health care content exists in many languages
  • Problem: Partly because majority of medical research/publications in English
  • Solution: Translate from English into other languages

33 of 56

European: German, French, Italian, Spanish, Dutch, Polish, Russian, Portuguese, Swedish

34 of 56

The Digital Last Mile

  • Those in the developing world have poor access to computers / the Internet
  • Problem: Cell phones widespread but data charges are expensive
  • Solution: Convince cell phone companies to allow Wikipedia access without data charges
  • The WMF has signed agreements with cellphone companies to give access free of data charges to ~350 million people in Africa, the Middle East, Asia and Eastern Europe.

35 of 56

Successes

  • Working on content in nearly 100 languages (hoping to expand to all 286 languages and beyond)
  • more than 4 million words translated
  • Some languages have improved content specifically for their audience
  • 24 GAs/FAs in their respective language

36 of 56

Difficulties

  • Translators are not big fans of MediaWiki markup (we have it colored to make it a bit easier)
  • Some technical words do not exist in some of the languages
  • Simplification before translation is important but difficult
  • Some are against translation wanting content developed in their own language de novo
  • Trouble recruiting Wikipedians in some languages

37 of 56

  • Started in 2011
  • A textbook based partly on Wikipedia content
  • Will arrange content so that page numbering matches that of other similar texts
  • Used in 2000+ US colleges by 3 million students
  • One class at least is using it as their primary textbook
  • Competitors sued and settled / lost

Wikipedia Based Textbooks

38 of 56

  • No attribution, not under the same license
  • At least 44 of them

39 of 56

  • Bringing Wikipedia’s medical articles to FA followed by publication under the authors real names
  • First article has completed formal peer review at Open Medicine and to be published soon
  • Other journals also interested including JMIR
  • Academic credit for Wikipedians

40 of 56

  • Placed on the talk page of articles
  • Link to TRIP clicked on about 100x per month

41 of 56

Medical Student Elective

  • Two semesters of students (5 and 7)
  • 4 weeks to be working on just Wikipedia
  • Number of mainspace edits per student (29 and 25)
  • Most began work midway through the elective
  • Average number of days editing (7.8 and 7.6)
  • Struggled with consistently formating per the WP:MEDMOS

42 of 56

Mount Sinai Medical Student Club

  • 28 members
  • couple of meetings to edit medical content

43 of 56

More schools running projects

  • Great potential
    • we need more editors
  • Not scalable
    • new editors need feedback
    • retention is low
    • unclear how to improve understanding of guidelines

44 of 56

Wiki Project Med Foundation

  • An NGO incorporated in NY state
  • 100 members (mostly Wikipedians)
  • From 20 countries
  • Trying to support collaboration between language versions
  • No authority over any language version
  • Working on collaborations with other entities

45 of 56

Is Wikipedia reliable?

46 of 56

  • Verifiability not Truth
  • Depends on definitions and compared to what
  • As accurate as Britannica in 2005
  • More research needed

47 of 56

Reference, Reference, Reference

48 of 56

WP:MEDRS

[10]

49 of 56

50 of 56

51 of 56

52 of 56

Most commonly used journals

  • Lancet
  • NEJM
  • Nature
  • BMJ
  • JAMA
  • Science
  • Cochrane

53 of 56

Further research:

  • Comparing students performance on a standardized exam
  • With Wikipedia
  • With Uptodate
  • With Nothing

54 of 56

  • Used by a lot of schools to detect “copy and paste” issues
  • Has agreed to give Wikipedia free use
  • Plan is to run each new edit over a certain size as it comes in through the software and flag if concerns
  • Need programmer to lead efforts

55 of 56

Questions?

James Heilman

jmh649@gmail.com

http://enwp.org/User:Jmh649

“Imagine a world in which every single person on the planet is given free access to the sum of all human knowledge. That's what we're doing.” 

56 of 56

References

  1. http://en.wikipedia.org/wiki/Wikipedia:WikiProject_Medicine/Popular_pages
  2. http://en.wikipedia.org/wiki/Wikipedia:WikiProject_Pharmacology/Popular_pages
  3. Heilman JM, Kemmann E, Bonert M, et al. (2011). "Wikipedia: a key tool for global public health promotion". J. Med. Internet Res. 13 (1): e14.doi:10.2196/jmir.1589. PMID 21282098.
  4. "Usage of content languages for websites". W3Techs.com. Retrieved 30 December 2011.
  5. http://www.hifa2015.org/about/why-hifa2015-is-needed/
  6. http://infodisiac.com/blog/2012/02/wikipedia-readers/
  7. http://reportcard.wmflabs.org/
  8. http://en.wikipedia.org/wiki/List_of_languages_by_number_of_native_speakers#More_than_100_million_native_speakers
  9. http://en.wikipedia.org/wiki/Wikipedia:Size_of_Wikipedia
  10. http://xkcd.com/285/
  11. http://en.wikipedia.org/wiki/Wikipedia:IPs_are_human_too
  12. http://commons.wikimedia.org/wiki/File:Jimmy_Wales_Fundraiser_Appeal_edit.jpg
  13. http://commons.wikimedia.org/wiki/File:Wikimedia_logo_family_complete-2012.svg
  14. http://commons.wikimedia.org/wiki/File:Zentralstadion-Main_stand_crowd.JPG?uselang=fr
  15. http://commons.wikimedia.org/wiki/File:ActiveWikipedians.PNG
  16. http://commons.wikimedia.org/wiki/File:Translation_Barnstar.svg
  17. http://meta.wikimedia.org/wiki/List_of_Wikipedias
  18. http://reportcard.wmflabs.org/
  19. http://www.makovsky.com/insights/articles/25-insights/articles/article/229-as-the-web-goes-mobile-healthcare-stands-still