Forget Big — It’s All About Small Data

​

March 23, 2016

Andi Argast & Steph McAllister

@techraiser

#16NTCsmalldata

Photo credit: dirkcuys via VisualHunt.com / CC BY-SA

ALL THE IMPORTANT DETAILS

• Collaboration Notes:

http://po.st/smalldata-16NTC

​

• The hashtag, again: #16NTCsmalldata

​

​

Photo via Visualhunt

​

WHO WE ARE

Photo via Justin Trudeau on Twitter

​

TODAY’S AGENDA

• Exploring key concepts
• Exercise: Identifying your small data
• Discussion: What’s your data dilemma?
• Resources: Template dashboard
• Civic tech meets small data: Product worksheet

​

​

Photo via Visualhunt

​

DEFINING DATA

Photo credit: jannekestaaks via VisualHunt / CC BY-NC

THE DIKW PYRAMID

Source: Longlivetheux. CC BY-SA 4.0

DATA LITERACY

​

“Data literacy involves understanding what data mean, including how to read graphs and charts appropriately, draw correct conclusions from data, and recognize when data are being used in misleading or inappropriate ways."

- Carlson et al, 2011, p. 633

​

​

Photo via Visualhunt

​

BIG DATA

​

​

Big data is…?

​

​

​

Photo credit: https://flic.kr/p/5YsTt8

BIG DATA

​

“ large quantities of rapidly changing data being collected from various sources.”

- Open Data Institute, Data Lexicon

​

​

​

Photo credit: https://flic.kr/p/5YsTt8

BIG DATA

• A combination of structured and unstructured data
• Usually measured in petabytes or exabytes
• Characterized by the 3Vs: volume of data, variety of data types, and the velocity at which data is processed

(Source: Ahmed Banafa, DataFloq)

​

​

​

​

​

Photo credit: https://flic.kr/p/5YsTt8

SMALL DATA IS...

​

Small data is human countable data that is accessible, understandable, and actionable*

*Our definition with credit to Allen Bonde

​

Photo credit: Eric Fischer via Visual Hunt / CC BY

SMALL DATA CHARACTERISTICS

​

• “Connects people to meaningful insights”
• Organized and packaged so as to be easily digestible
• Can be part of and used for everyday tasks
• Often represented visually

(Source: Allen Bonde, OpenText)

​

​

Photo credit: Eric Fischer via Visualhunt / CC BY-SA

DATA & THE SOCIAL GOOD SECTOR

​

• Actionable insights v.s. data overload�
• Small tech spend; less resource intensive�
• Potential to strengthen relationships with stakeholders

Photo via Visualhunt

THE DATA SPECTRUM

CLOSED DATA

Photo credit: kitch via Visualhunt / CC BY-NC-ND

​

• Internal access only
• HR data and employment data
• Sales or sensitive financial data

​

SHARED DATA

Photo credit: Jacoposki via Visualhunt / CC BY-NC-SA

​

• Can be shared with a limited group or widely (Twitter feed)
• Partnership documents
• Funding agreements
• Program metrics in an annual report

OPEN DATA

Photo via Visualhunt

​

• “Open data is data that anyone can access, use and share”
• Open Data Institute

​

• Government data: data.gov
• Transit/GIS data
• Is there data that should be open in the social good sector?

CASE STUDIES

Photo credit: EvelynGiggles via VisualHunt / CC BY

AUGUST

Check it out: http://aug.co/

Photo credit: blackbirdrising via Visual Hunt / CC BY

FRAMEWORK

Photo credit: quinn.anya via VisualHunt / CC BY-SA

Check it out: http://weareframework.org/impact/timeraiser-impact/

CANADA COUNCIL FOR THE ARTS

Photo credit: ahisgett via Visualhunt / CC BY

Check it out: http://statsandstories.canadacouncil.ca

IDENTIFYING YOUR DATA

Photo via Visualhunt

​

​

“ECOSYSTEM OF SMALL DATA”

“This story isn't about large organisations running parallel software on tens of thousand of servers, but about more people than ever being able to collaborate effectively around a distributed ecosystem of information, an ecosystem of small data.”

- Rufus Pollock, Open Knowledge Foundation (2013)

Photo credit: Patrick Goossens via Visualhunt / CC BY-SA

THE DATA LIFECYCLE

Graphic source: DigitalImpact.io

Check out: Digitalimpact.io

WORKSHEET: bit.ly/dataIDworksheet

​

(Navigate to the document, click File and Save a copy)

IDENTIFYING YOUR DATA

Complete the three sections of the work sheet

1. Types of Data
1. Think: donor data, program feedback, event registrations, tweets, Likes, attendee info
2. Collection Methods
• Think: surveys, Google analytics, Eventbrite etc.
3. Outcomes
• Think: strategic planning, annual reports, program development

​

​

​

​

Photo via Visualhunt

WHAT’S YOUR DATA DILEMMA?

Photo credit: benitolamalfa via Visualhunt / CC BY-NC-ND

WHERE TO BEGIN

• Isolate what is getting in the way of effective data use

​

• Infrastructure challenges�
• Communications challenges

​

Photo credit: jenniferbuyshouses.com via VisualHunt.com / CC BY-NC-ND

INFRASTRUCTURE CHALLENGES

Data is not

• Collected
• Centralized
• Machine Readable

​

Photo credit: isado via Visual hunt / CC BY-ND

COMMUNICATIONS CHALLENGES

​

• Large amounts of data but no insights
• No statisticians on staff
• Make insights accessible to staff and stakeholders

​

​

Photo credit: NS Newsflash via Visual hunt / CC BY

CHALLENGE TIME

• How would you define your challenges? Communications or infrastructure

​

Too much data, not enough?

Difficulties in analysis or interpretation?

Fractured datasets/sources?

​

​

Photo credit: benitolamalfa via Visualhunt / CC BY-NC-ND

TOP 5 WAYS TO BETTER COLLECT DATA

1. Automate collection, avoid manual data entry
2. Don’t collect everything
3. Digitize ASAP
4. Collect enough (digitalimpact.io)
5. Choose apps that allow you to export or manipulate data

Photo credit: marfis75 via Visual Hunt / CC BY-SA

DATA MANAGEMENT

Applications with structured data:

Relational Databases:

CiviCRM; Salesforce; Raiser’s Edge; Sumac; Wild Apricot

​

Photo credit: NightRStar via VisualHunt / CC BY

TOP 5 WAYS TO BETTER COMMUNICATE DATA

• Be selective; Know your top stats
• Be careful with data that’s layered & complex
• Test out impact reports on people who are not steeped in your work (Ask Mom)
• Be transparent about collection processes and how numbers are calculated
• Leverage the power of data visualizations

Photo credit: marfis75 via Visualhunt.com / CC BY-SA

DATA VISUALIZATION

Spreadsheet charts:

Google Sheets - Excel - Tableau

Infographics:

Piktochart - Infogr.am - Easel.ly

Javascript Libraries

R.js - Google Visualizations API

�

​

Photo credit: areta ekarafi via Visual hunt / CC BY-NC-ND

EXTERNAL AND INTERNAL DATA VIS

• External Uses
• accessible funder reports
• Share successes on website & social media �
• Internal Uses
• compelling cases for decision makers
• Easy access for fundraisers

​

Photo credit: areta ekarafi via Visual hunt / CC BY-NC-ND

DON’T JUST MAKE CHARTS

MAKE DASHBOARDS

Photo credit: myoldpostcards via VisualHunt.com / CC BY-NC-ND

Dashboard Template

bit.ly/smalldatadashboard

SYSTEMS OVERHAUL

How to begin:

• Gather your team
• Allocate resources (financial and human)
• Find volunteers and organizations in your area
• Attend a civic tech event

SOLUTIONING WORKSHEET

bit.ly/solutionworksheet

​

Photo via Visual hunt

CIVIC TECH

​

“technology that spurs citizen engagement, improves communities and makes governments more effective.”

- Tom Steinberg, Civicist (formerly mysociety)

​

Check out: http://civichall.org/civicist/

​

​

Photo via Visualhunt

SOLUTIONING WORKSHEET

• bit.ly/solutionworksheet
• What is your challenge, succinctly
• Envision Success
• Who needs to be involved
• Who do we want to emulate?
• List your data resources

Photo via Visual hunt

SOLUTIONING WORKSHEET

Photo via Visual hunt

ONWARDS:

KEEPING DATA PROJECTS ALIVE

MAINTAINING YEAR OVER YEAR

• Assign data management tasks to a member of staff, and ensure appropriate staff turnover processes�
• Carefully store, backup, and protect datasets�
• Ensure that you continue to invest resources in the structural and practical elements of data management

Photo via Visual hunt

Questions? Comments?

​

Please fill in the survey and let us know how we can improve!

http://po.st/WoX4H7

Get in touch!

​

Andi Argast

@andiargast

andi@weareframework.org

​

Steph McAllister

@smcallister_

steph@weareframework.org

​

@techraiser

facebook.com/TechraiserCanada

​

​