1 of 31

Quantitative Data Collection �Non-Survey Instruments

Module 8, PUBH 381

2 of 31

Types of data

Overview

Table of Contents

Quantitative Methods

01

02

03

Qualitative vs. Quantitative

Quantitative Data

Non-survey Methods

04

Assessment

Development

04

Examples

3 of 31

01: Types of Data

Qualitative vs. Quantitative

4 of 31

5 of 31

Types of Data

Qualitative

Quantitative

Type of data

Text, non-numerical

Numerical

Purpose

Used to explore and develop theories and hypotheses

In-depth understanding of individual or group motivation, reasoning, and experiences

Used to test theories and hypotheses

Generalize findings to larger group

Sample

Small and specific, not representative of population

Large and broad, results can be generalized to a larger group

Method

Interviews, focus groups, observations

Close question surveys,

Analysis

Subjective, content analysis

Statistical analysis

Advantages

Provides depth of understanding, interactive process, promotes

Relatively inexpensive to collect large amount of data quickly

No trained moderator needed

Faster data analysis

Disadvantages

Expensive, time consuming, requires trained facilitator/moderator

Cannot go beyond the scope of survey questions

*table adapted from Section 5.1, Introduction to Research Methods, Eric van Holm, 2021

Module 7

Modules 8-11

6 of 31

Types of Data

Quantitative

Type of data

Numerical

Purpose

Used to test theories and hypotheses

Generalize findings to larger group

Sample

Large and broad, results can be generalized to a larger group

Method

Closed question surveys, observations, secondary data analysis

Analysis

Statistical analysis

Advantages

Relatively inexpensive to collect large amount of data quickly

No trained moderator needed

Faster data analysis

Disadvantages

Limited by the scope of the research questions

*table adapted from Section 5.1, Introduction to Research Methods, Eric van Holm, 2021

7 of 31

02: Overview: Quantitative Data

Surveys vs. Other Methods

8 of 31

Quantitative Data Collection Methods

Surveys

Observations

Purchasing decisions

Implicit Association Tests

Polls

Existing/

archival data

Checklists

Experiments

Games

Vignettes

Most common methods

9 of 31

Problems with Surveys

Survey data are only as good as the survey questions

Response bias

Social response bias- respondent try and please researcher

Non-response bias- respondent does not complete survey

Order effects- order of questions affects responses

Subject to recall error (memory)

Hard to measure subconscious biases

Surveys are an excellent way to quickly collect information but there are some common problems associated with survey data.

10 of 31

Uses �of non-survey data collection methods

Reduce response bias

Reduce

Explore unconscious biases

Explore

Observe interaction between individuals

Observe

Collect accurate information on sensitive information

Collect

Add to baseline data

Add

Follow-up on survey data

Follow

11 of 31

03: Quantitative Methods

12 of 31

Direct Observation

13 of 31

Purchasing Decisions

14 of 31

Secondary (Existing/Archival) Data

15 of 31

Checklist Assessment

16 of 31

Additional Methods

17 of 31

Most common assessment tools:

Observation assessment tools

Health screening tools

18 of 31

04: Assessment Development

19 of 31

Assessment Development� Process

Analyze

Collect

Pilot

Design

Determine

Decide

20 of 31

Assessment Development� Process

Ex. #of people entering facility, # of vegetables consumed daily

Decide what should be recorded

Decide

21 of 31

Assessment Development� Process

Pay close attention to face validity or how the instrument looks

Design assessment form

Design

22 of 31

Assessment Development� Process

Ex. When and how frequently will the data be collected?

Determine data collection intervals

Determine

23 of 31

Assessment Development� Process

Test the assessment form with members of the target population to ensure the form is well organized and easy to understand

Pilot assessment form

Pilot

24 of 31

Assessment Development� Process

Analyze

If using multiple observers, train all users to increase consistent data collection

Collect Data

Collect

25 of 31

05: Examples

26 of 31

Observation Form EXAMPLE

27 of 31

Observation Form EXAMPLE

28 of 31

Health Screening EXAMPLE

29 of 31

Health Screening EXAMPLE

30 of 31

Scored Assessment EXAMPLE

31 of 31

Scored Assessment EXAMPLE