Week 1 & 2: Programming and the Crowds
Week 3: Who is the Crowd?
Week 4: Designing for Quality Work
Week 5: Finding Quality Work
Week 6: Task Decomposition and Workflows
Week 7: Real-Time Human Computation
Week 8: Working Better Together
Week 9: Expert Crowdsourcing
Week 10: Unintended Experts
Week 11: CrowdFunding & Citizen Science
Week 12: Workers Over Time
Week 13: Applications -- Computer Vision and NLP
Week 14: Learnersourcing & Selfsourcing
Week 15: Final Project Presentations & Wrap-Up
Please note that the lecture materials for each week are available in the Google Drive folder.
Posts about the readings are due on the Associated Google Slide Deck one day before their associated class time. Please read some of the other posts, and post at least one follow up before class.
- Why Program the Crowd?
- How many M&Ms?
- Course Logistics & Overview
- Definitions: Collective Intelligence, Social Computing, Crowdsourcing, and Human Computation
- Using Amazon Mechanical Turk (1 of 3) -- completing tasks as a worker
No class on 9/4/2017 in observance of Labor Day
- Gold Standards, Input Agreement, Output Agreement Mechanisms
- Using mechanical turk (2 of 3) - posting a job with the GUI
- Quality Control in Crowdsourcing
- Usability in Crowdsourcing
- (intro to) Statistical Consensus Algorithms
- Mechanical Turk example from Class
- Creating Counting People HIT Video
Project 3 is out!
Tsing-Hao (Kenneth) Huang will be our guest lecturer on 10/11.
What is an expert?
Engaging experts in crowdsourcing
Aardvark, oDesk, Creating Experts, Education