Dealing with the COVID-19 Infodemic: A Short Guide to Fact-Checking
DIGITAL CITIZENSHIP INITIATIVE: BRIDGING THE MAINSTREAM-ETHNIC DIGITAL DIVIDE IN COVID-19 LITERACY
BY ALICJA MINDA AND NASER MIFTARI
“Learning how to fact-check can help writers become better reporters, because in a way fact-checking is reporting in reverse. Knowing how a fact-checker might pick a story apart helps a writer learn to think twice before relying on a questionable source.”� ��Broke Borel, The Chicago Guide to Fact-Checking
DIGITAL CITIZENSHIP INITIATIVE: BRIDGING THE MAINSTREAM-ETHNIC DIGITAL DIVIDE IN COVID-19 LITERACY
Dealing with COVID-19 Infodemic
DIGITAL CITIZENSHIP INITIATIVE: BRIDGING THE MAINSTREAM-ETHNIC DIGITAL DIVIDE IN COVID-19 LITERACY
Knowing the enemy
DIGITAL CITIZENSHIP INITIATIVE: BRIDGING THE MAINSTREAM-ETHNIC DIGITAL DIVIDE IN COVID-19 LITERACY
DIGITAL CITIZENSHIP INITIATIVE: BRIDGING THE MAINSTREAM-ETHNIC DIGITAL DIVIDE IN COVID-19 LITERACY
��Knowing the enemy �Types of misinformation
DIGITAL CITIZENSHIP INITIATIVE: BRIDGING THE MAINSTREAM-ETHNIC DIGITAL DIVIDE IN COVID-19 LITERACY
DIGITAL CITIZENSHIP INITIATIVE: BRIDGING THE MAINSTREAM-ETHNIC DIGITAL DIVIDE IN COVID-19 LITERACY
Knowing the enemy �Types of misinformation
DIGITAL CITIZENSHIP INITIATIVE: BRIDGING THE MAINSTREAM-ETHNIC DIGITAL DIVIDE IN COVID-19 LITERACY
DIGITAL CITIZENSHIP INITIATIVE: BRIDGING THE MAINSTREAM-ETHNIC DIGITAL DIVIDE IN COVID-19 LITERACY
��Knowing the enemy �Examples of misleading content
DIGITAL CITIZENSHIP INITIATIVE: BRIDGING THE MAINSTREAM-ETHNIC DIGITAL DIVIDE IN COVID-19 LITERACY
This tweet from an account called @LotusOak2, which tweets almost exclusively anti-vax and pro-homeopathy messages, uses a real clip of Dr. Anthony Fauci to suggest he admits the COVID-19 vaccine could be dangerous, but the highlighted quote is taken out of context.
In what precedes the quote, Dr. Fauci says: “So at the same time that we're testing, we're going to try to make sure we don't have enhancement. It’s the worst possible thing you can do is to vaccinate somebody to prevent infection and actually to make them worse.”
https://twitter.com/LotusOak2/status/1328132237360062466
DIGITAL CITIZENSHIP INITIATIVE: BRIDGING THE MAINSTREAM-ETHNIC DIGITAL DIVIDE IN COVID-19 LITERACY
Knowing the enemy�Examples of misleading content: “False framing”
Compare these two tweets. Both refer to a real study published in a reputable medical journal, the BMJ.
The first, tweeted from an anonymous account, quotes only a part of a sentence taken from the summary of the study.
https://twitter.com/LotusOak2/status/1328440028469616646
The second, posted by a science journalist, quotes the entire sentence, completely changing the meaning. https://twitter.com/robivil/status/1185285514045378561
DIGITAL CITIZENSHIP INITIATIVE: BRIDGING THE MAINSTREAM-ETHNIC DIGITAL DIVIDE IN COVID-19 LITERACY
DIGITAL CITIZENSHIP INITIATIVE: BRIDGING THE MAINSTREAM-ETHNIC DIGITAL DIVIDE IN COVID-19 LITERACY
Knowing the enemy�Types of claims
Various studies on COVID-19 misinformation offer different classifications of types of claims or themes being the subject of mis- or disinformation.
In the initial months of the pandemic (January to end-March), a study by Brennen et al. found that the most popular claims pertained to actions of public authorities (governments, public health, WHO, etc.). Based on an analysis of 225 fact-checks collected by First Draft News:
Our finding that much misinformation directly or indirectly questions the actions, competence, or legitimacy of public authorities (including governments, health authorities, and international organisations) suggests it will be difficult for those institutions to address or correct it directly… (Brennen et al., 2020)
Other popular themes included community spread, general medical claims, and claims about prominent actors.
DIGITAL CITIZENSHIP INITIATIVE: BRIDGING THE MAINSTREAM-ETHNIC DIGITAL DIVIDE IN COVID-19 LITERACY
DIGITAL CITIZENSHIP INITIATIVE: BRIDGING THE MAINSTREAM-ETHNIC DIGITAL DIVIDE IN COVID-19 LITERACY
Knowing the enemy�Types of claims
A huge study by Evanega et al. analyzing 38 million articles published in English-language media around the world from January 1 up to May 26, 2020 identified 11 different conspiracy theory themes or misinformation sub-topics in the COVID-19 infodemic:
DIGITAL CITIZENSHIP INITIATIVE: BRIDGING THE MAINSTREAM-ETHNIC DIGITAL DIVIDE IN COVID-19 LITERACY
DIGITAL CITIZENSHIP INITIATIVE: BRIDGING THE MAINSTREAM-ETHNIC DIGITAL DIVIDE IN COVID-19 LITERACY
Knowing the enemy�Types of claims
To date, the CoronaVirusFacts Alliance’s interactive graphic shows that the most popular categories of fact-checks performed by members of the alliance around the world have been about:
DIGITAL CITIZENSHIP INITIATIVE: BRIDGING THE MAINSTREAM-ETHNIC DIGITAL DIVIDE IN COVID-19 LITERACY
DIGITAL CITIZENSHIP INITIATIVE: BRIDGING THE MAINSTREAM-ETHNIC DIGITAL DIVIDE IN COVID-19 LITERACY
Knowing the enemy�Sources of misinformation
DIGITAL CITIZENSHIP INITIATIVE: BRIDGING THE MAINSTREAM-ETHNIC DIGITAL DIVIDE IN COVID-19 LITERACY
DIGITAL CITIZENSHIP INITIATIVE: BRIDGING THE MAINSTREAM-ETHNIC DIGITAL DIVIDE IN COVID-19 LITERACY
Knowing the enemy�Reasons and motives of misinformation
… governments have not always succeeded in providing clear, useful, and trusted information to address pressing public questions. In the absence of sufficient information, misinformation about these topics may fill in gaps in public understanding, and those distrustful of their government or political elites may be disinclined to trust official communications on these matters.” (Brennen et al., 2020)
DIGITAL CITIZENSHIP INITIATIVE: BRIDGING THE MAINSTREAM-ETHNIC DIGITAL DIVIDE IN COVID-19 LITERACY
DIGITAL CITIZENSHIP INITIATIVE: BRIDGING THE MAINSTREAM-ETHNIC DIGITAL DIVIDE IN COVID-19 LITERACY
Fighting the enemy�Traditional fact-checking
Fact-checking is traditionally understood as a post-editing review process performed by an outsider who was not involved in the story’s creation. A fact-checker would take an edited story to assess the writer’s sources and probe the story’s foundations: confirm the presented facts and decide whether they were used to build a fair representation of reality. For that, the writer would be requested to hand over a draft of the story with sources cited in footnotes, all of the referenced material (including interview recordings and transcripts) as well as contact information to human sources. Even opinion pieces are based on some facts, and these can be subject to a fact-check, but not the conclusions drawn by the author. Fact-checking in this form is practiced mostly in magazines (The Walrus, New Yorker). Newspapers and other news outlets typically don’t follow this process.
A traditional fact-checker would probe for example:
DIGITAL CITIZENSHIP INITIATIVE: BRIDGING THE MAINSTREAM-ETHNIC DIGITAL DIVIDE IN COVID-19 LITERACY
DIGITAL CITIZENSHIP INITIATIVE: BRIDGING THE MAINSTREAM-ETHNIC DIGITAL DIVIDE IN COVID-19 LITERACY
Fighting the enemy�Traditional fact-checking
The Nisga’a First Nation lies at the northern edge of the Great Bear Rainforest in a valley that makes no secret of its volcanic history. The rutted ribbon of Highway 113 winds through ancient lava beds from Canada’s most recent eruption in the seventeenth century past sulphur hot springs, Lava Lake, and the dormant Tseax cinder cone. It is a region where forces of nature and humans have warred over space that’s plagued by overlapping powers.
“Grizzly hunts are the most profitable hunts that we do,” says Harry Nyce Jr., CEO of Nisga’a Pacific Ventures, as he reclines at the boardroom table in his office in Gitlaxt’aamiks, one of the four villages in the Nisga’a Nation. Copies of Huntin’ Fool and Mountain Hunter magazines, featuring images of big men holding big animals, cascade neatly across the table.
Try to identify them, then see a partial list of the facts to be checked on the next slide.
DIGITAL CITIZENSHIP INITIATIVE: BRIDGING THE MAINSTREAM-ETHNIC DIGITAL DIVIDE IN COVID-19 LITERACY
DIGITAL CITIZENSHIP INITIATIVE: BRIDGING THE MAINSTREAM-ETHNIC DIGITAL DIVIDE IN COVID-19 LITERACY
Fighting the enemy�Traditional fact-checking
1. “Nisga’a First Nation” is spelled properly
2. It is a First Nation (registered and self-identified as
such)
3. The nation’s boundaries lie in a valley at the northern
edge of the Great Bear Rainforest
4. “Great Bear Rainforest” is spelled properly
5. There is a valley at the northern edge
6. This valley has a volcanic history
7. Highway 113 winds through it
8. “Highway 113” is spelled properly
9. There are lava beds there
10. They come from an eruption in the seventeenth
century
11. This eruption was Canada’s most recent (there has been
no eruption in Canada since)
DIGITAL CITIZENSHIP INITIATIVE: BRIDGING THE MAINSTREAM-ETHNIC DIGITAL DIVIDE IN COVID-19 LITERACY
DIGITAL CITIZENSHIP INITIATIVE: BRIDGING THE MAINSTREAM-ETHNIC DIGITAL DIVIDE IN COVID-19 LITERACY
Fighting the enemy�Fact-checking
DIGITAL CITIZENSHIP INITIATIVE: BRIDGING THE MAINSTREAM-ETHNIC DIGITAL DIVIDE IN COVID-19 LITERACY
Primary sources include: | Secondary sources include: |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
Whether fact-checking an article or a claim by an elected official, you will need to refer to primary sources or reliable secondary sources.
DIGITAL CITIZENSHIP INITIATIVE: BRIDGING THE MAINSTREAM-ETHNIC DIGITAL DIVIDE IN COVID-19 LITERACY
Fighting the enemy�Fact-checking
DIGITAL CITIZENSHIP INITIATIVE: BRIDGING THE MAINSTREAM-ETHNIC DIGITAL DIVIDE IN COVID-19 LITERACY
DIGITAL CITIZENSHIP INITIATIVE: BRIDGING THE MAINSTREAM-ETHNIC DIGITAL DIVIDE IN COVID-19 LITERACY
Fighting the enemy�Fact-checking in today’s media landscape
Fact-checking in today’s media landscape more often means confirming or refuting claims of public relevance, often made by public officials. It is often performed by fact-checking organizations like PolitiFact or Snopes. Many of them are a part of the International Fact-Checking Network at the Poynter Institute for Media Studies.
DIGITAL CITIZENSHIP INITIATIVE: BRIDGING THE MAINSTREAM-ETHNIC DIGITAL DIVIDE IN COVID-19 LITERACY
DIGITAL CITIZENSHIP INITIATIVE: BRIDGING THE MAINSTREAM-ETHNIC DIGITAL DIVIDE IN COVID-19 LITERACY
Fighting the enemy�Assessing academic sources
DIGITAL CITIZENSHIP INITIATIVE: BRIDGING THE MAINSTREAM-ETHNIC DIGITAL DIVIDE IN COVID-19 LITERACY
DIGITAL CITIZENSHIP INITIATIVE: BRIDGING THE MAINSTREAM-ETHNIC DIGITAL DIVIDE IN COVID-19 LITERACY
Fighting the enemy�Consulting an academic paper
Consulting an academic paper
A typical academic paper has six essential parts:
If findings need to be confirmed, a fact-checker can go straight to the abstract. The author’s and the publisher’s credentials should also be looked up, for example on Google Scholar.
DIGITAL CITIZENSHIP INITIATIVE: BRIDGING THE MAINSTREAM-ETHNIC DIGITAL DIVIDE IN COVID-19 LITERACY
DIGITAL CITIZENSHIP INITIATIVE: BRIDGING THE MAINSTREAM-ETHNIC DIGITAL DIVIDE IN COVID-19 LITERACY
Fighting the enemy�Debunking fake news
As opposed to fact-checkable public claims, fake news pieces are dubious narratives of unknown or uncertain origin, often user-generated content (UGC). Debunking fake news, therefore, entails using primary evidence to verify the content.
Basic verification tools include:
- To verify photos: reverse image search
- To verify geolocation: Google Earth
DIGITAL CITIZENSHIP INITIATIVE: BRIDGING THE MAINSTREAM-ETHNIC DIGITAL DIVIDE IN COVID-19 LITERACY
Source: “Hands-On Fact-Checking: A Short Course,” Poynter Institute
DIGITAL CITIZENSHIP INITIATIVE: BRIDGING THE MAINSTREAM-ETHNIC DIGITAL DIVIDE IN COVID-19 LITERACY
Fighting the enemy�Practical steps and tools
S – Stop
I – Investigate the source
F – Find better coverage
T – Trace claims, quotes and media to the original context
Source: https://infodemic.blog/
DIGITAL CITIZENSHIP INITIATIVE: BRIDGING THE MAINSTREAM-ETHNIC DIGITAL DIVIDE IN COVID-19 LITERACY
DIGITAL CITIZENSHIP INITIATIVE: BRIDGING THE MAINSTREAM-ETHNIC DIGITAL DIVIDE IN COVID-19 LITERACY
Fighting the enemy �The SIFT method
DIGITAL CITIZENSHIP INITIATIVE: BRIDGING THE MAINSTREAM-ETHNIC DIGITAL DIVIDE IN COVID-19 LITERACY
DIGITAL CITIZENSHIP INITIATIVE: BRIDGING THE MAINSTREAM-ETHNIC DIGITAL DIVIDE IN COVID-19 LITERACY
Fighting the enemy �The SIFT method
DIGITAL CITIZENSHIP INITIATIVE: BRIDGING THE MAINSTREAM-ETHNIC DIGITAL DIVIDE IN COVID-19 LITERACY
<= Anonymous
No profile pic
No bio
=>
We know her name.
We can see her face.
Bio says “health writer and journalist.”
DIGITAL CITIZENSHIP INITIATIVE: BRIDGING THE MAINSTREAM-ETHNIC DIGITAL DIVIDE IN COVID-19 LITERACY
Fighting the enemy �The SIFT method
DIGITAL CITIZENSHIP INITIATIVE: BRIDGING THE MAINSTREAM-ETHNIC DIGITAL DIVIDE IN COVID-19 LITERACY
DIGITAL CITIZENSHIP INITIATIVE: BRIDGING THE MAINSTREAM-ETHNIC DIGITAL DIVIDE IN COVID-19 LITERACY
Fighting the enemy�Verification tools
A free Google-doc toolkit with verification tools for image/video search, social media, people, maps/satellites, transport, websites, archiving, companies, data visualization, et al.
The most popular tools are Google Images and TinEye (a Toronto-based company!)
DIGITAL CITIZENSHIP INITIATIVE: BRIDGING THE MAINSTREAM-ETHNIC DIGITAL DIVIDE IN COVID-19 LITERACY
DIGITAL CITIZENSHIP INITIATIVE: BRIDGING THE MAINSTREAM-ETHNIC DIGITAL DIVIDE IN COVID-19 LITERACY
Fighting the enemy�Verification tools
GOOGLE IMAGES
TINEYE
DIGITAL CITIZENSHIP INITIATIVE: BRIDGING THE MAINSTREAM-ETHNIC DIGITAL DIVIDE IN COVID-19 LITERACY
DIGITAL CITIZENSHIP INITIATIVE: BRIDGING THE MAINSTREAM-ETHNIC DIGITAL DIVIDE IN COVID-19 LITERACY
Fighting the enemy�Verification tools
If an account has one of these characteristics, it doesn’t necessarily mean it’s fake; many real accounts are anonymous or don’t have a human profile image. A combination of several of these is more likely to identify a bot.
DIGITAL CITIZENSHIP INITIATIVE: BRIDGING THE MAINSTREAM-ETHNIC DIGITAL DIVIDE IN COVID-19 LITERACY
DIGITAL CITIZENSHIP INITIATIVE: BRIDGING THE MAINSTREAM-ETHNIC DIGITAL DIVIDE IN COVID-19 LITERACY
Fighting the enemy�Verification tools
Fact-checkers often rely on Google Earth to verify whether a video or a photo was actually taken where it is claimed to have been taken.
A more advanced Google Earth Pro version, which is a free desktop app, has a collection of historical images of places, so you can go back in time and confirm what a place looked like in the past or try to figure out when a photo was taken.
DIGITAL CITIZENSHIP INITIATIVE: BRIDGING THE MAINSTREAM-ETHNIC DIGITAL DIVIDE IN COVID-19 LITERACY
DIGITAL CITIZENSHIP INITIATIVE: BRIDGING THE MAINSTREAM-ETHNIC DIGITAL DIVIDE IN COVID-19 LITERACY
Tips for journalists
Gary Schwitzwer, publisher at HealthNewsReview.org and Adjunct Associate Professor at the University of Minnesota School of Public Health, says:
DIGITAL CITIZENSHIP INITIATIVE: BRIDGING THE MAINSTREAM-ETHNIC DIGITAL DIVIDE IN COVID-19 LITERACY
DIGITAL CITIZENSHIP INITIATIVE: BRIDGING THE MAINSTREAM-ETHNIC DIGITAL DIVIDE IN COVID-19 LITERACY
Tips for journalists
Laura Helmuth, Washington Post Health and Science Editor, says:
DIGITAL CITIZENSHIP INITIATIVE: BRIDGING THE MAINSTREAM-ETHNIC DIGITAL DIVIDE IN COVID-19 LITERACY
DIGITAL CITIZENSHIP INITIATIVE: BRIDGING THE MAINSTREAM-ETHNIC DIGITAL DIVIDE IN COVID-19 LITERACY
Glossary of relevant terms
DIGITAL CITIZENSHIP INITIATIVE: BRIDGING THE MAINSTREAM-ETHNIC DIGITAL DIVIDE IN COVID-19 LITERACY
DIGITAL CITIZENSHIP INITIATIVE: BRIDGING THE MAINSTREAM-ETHNIC DIGITAL DIVIDE IN COVID-19 LITERACY
Glossary of relevant terms
Canada’s 2020 electric car sales volume rises by 100% y/y => seems like a big deal (relative increase)
vs.
Canada’s 2020 electric car sales volume rises from 2 to 4 y/y => it is a 100% increase, but it’s definitely not a big deal, since the sales were insignificant to start with (increase in absolute terms)
Similarly, medical studies that include statements about how a given treatment reduces or increases a risk of a given health outcome in relative terms can seem like a big deal, for example, a certain treatment can reduce mortality by 50%, but in absolute terms it may be that the treatment reduces death rates from 0.002% to 0.001%, which is not as significant.
(Source: https://academic.oup.com/ndt/article/32/suppl_2/ii13/3056571)
For health reporters, it’s important to understand the difference and, whenever possible, to report both the relative risk and the absolute risk.
DIGITAL CITIZENSHIP INITIATIVE: BRIDGING THE MAINSTREAM-ETHNIC DIGITAL DIVIDE IN COVID-19 LITERACY
DIGITAL CITIZENSHIP INITIATIVE: BRIDGING THE MAINSTREAM-ETHNIC DIGITAL DIVIDE IN COVID-19 LITERACY
Resources�Databases of COVID-19-related fact-checks
The CoronaVirusFacts Database, developed by the CoronaVirusFacts Alliance of fact-checkers in more than 70 countries, working in at least 40 languages, led by the International Fact-Checking Network (IFCN) at the Poynter Institute: https://www.poynter.org/ifcn-covid-19-misinformation/
Mythbusters, the World Health Organization’s database of facts countering the most common types of misinformation: https://www.who.int/emergencies/diseases/novel-coronavirus-2019/advice-for-public/myth-busters
DisinfoWatch, the Macdonald-Laurier Institute’s COVID-19 and foreign disinformation monitoring and debunking platform: https://disinfowatch.org/database/
Health Feedback, a worldwide network of scientists sorting fact from fiction in health and medical media coverage, led by the French not-for-profit Science Feedback: https://healthfeedback.org/
DIGITAL CITIZENSHIP INITIATIVE: BRIDGING THE MAINSTREAM-ETHNIC DIGITAL DIVIDE IN COVID-19 LITERACY
DIGITAL CITIZENSHIP INITIATIVE: BRIDGING THE MAINSTREAM-ETHNIC DIGITAL DIVIDE IN COVID-19 LITERACY
Resources�Databases of COVID-19-related fact-checks
COVIDGlobal Misinformation Dashboard 2020 and COVIDCanada News Dashboard by the Social Media Lab at the Ted Rogers School of Management at Ryerson University: https://datastudio.google.com/reporting/87b00158-5589-4154-a81b-c17cdb0d0d19/page/Kn2IB
https://datastudio.google.com/reporting/56e0d9fd-6c26-4d25-986c-9ec2e5e27ce7/page/1M
FAQs Fact Check by the University of Toronto Libraries: https://guides.library.utoronto.ca/c.php?g=715025&p=5097957#s-lg-box-16063992
Snopes Medical: https://www.snopes.com/fact-check/category/medical/
NewsGuard COVID-19 Misinformation Resources: https://www.newsguardtech.com/covid-19-resources/
DIGITAL CITIZENSHIP INITIATIVE: BRIDGING THE MAINSTREAM-ETHNIC DIGITAL DIVIDE IN COVID-19 LITERACY
DIGITAL CITIZENSHIP INITIATIVE: BRIDGING THE MAINSTREAM-ETHNIC DIGITAL DIVIDE IN COVID-19 LITERACY
Resources�Other resources
Multilingual Resources for Diverse Communities During COVID-19 from Ottawa Public Health: https://www.ottawapublichealth.ca/en/public-health-topics/multilingual-resources.aspx
Novel Coronavirus (COVID-19) Resource Center at the Center for Infectious Disease Research and Policy (CIDRAP): https://www.cidrap.umn.edu/covid-19
Canada’s COVID-19 Infobase: https://health-infobase.canada.ca/covid-19/epidemiological-summary-covid-19-cases.html)
Google Scholar: https://scholar.google.com/
How to review a PR news release from a pharmaceutical company: 10 criteria recommended by HealthNewsReview.org: https://www.healthnewsreview.org/about-us/review-criteria/
Free fact-checking courses:
DIGITAL CITIZENSHIP INITIATIVE: BRIDGING THE MAINSTREAM-ETHNIC DIGITAL DIVIDE IN COVID-19 LITERACY
DIGITAL CITIZENSHIP INITIATIVE: BRIDGING THE MAINSTREAM-ETHNIC DIGITAL DIVIDE IN COVID-19 LITERACY
Exercise
Have you found any information that’s not accurate?
Tip: https://www.google.com/search?client=firefox-b-d&q=Ticketmaster+mandatory+vaccine
DIGITAL CITIZENSHIP INITIATIVE: BRIDGING THE MAINSTREAM-ETHNIC DIGITAL DIVIDE IN COVID-19 LITERACY
DIGITAL CITIZENSHIP INITIATIVE: BRIDGING THE MAINSTREAM-ETHNIC DIGITAL DIVIDE IN COVID-19 LITERACY
References
DIGITAL CITIZENSHIP INITIATIVE: BRIDGING THE MAINSTREAM-ETHNIC DIGITAL DIVIDE IN COVID-19 LITERACY
DIGITAL CITIZENSHIP INITIATIVE: BRIDGING THE MAINSTREAM-ETHNIC DIGITAL DIVIDE IN COVID-19 LITERACY
References
DIGITAL CITIZENSHIP INITIATIVE: BRIDGING THE MAINSTREAM-ETHNIC DIGITAL DIVIDE IN COVID-19 LITERACY
DIGITAL CITIZENSHIP INITIATIVE: BRIDGING THE MAINSTREAM-ETHNIC DIGITAL DIVIDE IN COVID-19 LITERACY