Week 1 & 2:  Programming and the Crowds

Week 3:  Who is the Crowd?

Week 4: Designing for Quality Work

Week 5:  Finding Quality Work

Week 6: Task Decomposition and Workflows

Week 7: Real-Time Human Computation

Week 8: Working Better Together

Week 9: Expert Crowdsourcing

Week 10: Unintended Experts

Week 11: CrowdFunding & Citizen Science

Week 12: Workers Over Time

Week 13: Applications -- Computer Vision and NLP

Week 14: Learnersourcing & Selfsourcing

Week 15: Final Project Presentations & Wrap-Up

Please note that the lecture materials for each week are available in the Google Drive folder.

Posts about the readings are due on the Associated Google Slide Deck one day before their associated class time. Please read some of the other posts, and post at least one follow up before class.

Week 1 & 2:  Programming and the Crowds

Readings

      (8/30)

      (9/6)

Topics, Tasks, and Activities

- Introductions

- Why Program the Crowd?

- How many M&Ms?

- Course Logistics & Overview

- Definitions: Collective Intelligence, Social Computing, Crowdsourcing, and Human Computation

- Using Amazon Mechanical Turk (1 of 3) -- completing tasks as a worker

Notes:

No class on 9/4/2017 in observance of Labor Day

Week 3:  Who is the Crowd?

Readings

      (9/11)

      (9/13)

Topics, Tasks, and Activities

- Gold Standards, Input Agreement, Output Agreement Mechanisms

- Using mechanical turk (2 of 3) - posting a job with the GUI

Notes:

Week 4: Designing for Quality Work

Readings

     (9/18)

     (9/20)

Topics, Tasks, and Activities

- Quality Control in Crowdsourcing

- Usability in Crowdsourcing

Notes:

Week 5:  Finding Quality Work

Readings

     (9/25)

      (9/27)

Topics, Tasks, and Activities

- (intro to) Statistical Consensus Algorithms

- Mechanical Turk example from Class

- Creating Counting People HIT Video

Notes:

Week 6: Task Decomposition and Workflows

Readings

     (10/2)

     (10/4)

Week 7: Real-Time Human Computation

Readings

     (10/9)

     (10/11)

Notes:

Project 3 is out!

Tsing-Hao (Kenneth) Huang will be our guest lecturer on 10/11.

Week 8: Working Better Together

Readings

     (10/16)

     (10/18)

Topics, Tasks, and Activities

Notes:

Week 9: Expert Crowdsourcing

Readings

     (10/23)

     (10/25)

Topics, Tasks, and Activities

What is an expert?

Engaging experts in crowdsourcing
Aardvark, oDesk, Creating Experts, Education

Notes:

Week 10: Unintended Experts

Readings

     (10/30)

     (11/1)

Week 11: CrowdFunding & Citizen Science

Readings

      (11/6)

      (11/8)

Topics, Tasks, and Activities

Notes:

Week 12: Workers Over Time

Readings

     (11/13)

     (11/15)

Topics, Tasks, and Activities

Notes:

Week 13: Crowds to Support Research

Readings

     (11/20)

Topics, Tasks, and Activities

Notes:

Week 14: Learnersourcing & Selfsourcing

Readings

     (11/27)

     (11/29)

Topics, Tasks, and Activities

Notes:

Week 15: Final Project Presentations & Wrap-Up

Readings

Topics, Tasks, and Activities

Notes: