1 of 32

Crowd-Powered

Conversational

Assistant

Lecturer: Kenneth Huang

txh710@psu.edu

​

Feb 18, 2020

2 of 32

We’re Going to Talk About…

  • Chorus
    • System Overview
    • Example Conversations
    • Recruiting Method: Ignition Model
    • …Do workers like it?

​

​

3 of 32

4 of 32

5 of 32

6 of 32

7 of 32

8 of 32

9 of 32

10 of 32

11 of 32

12 of 32

13 of 32

14 of 32

15 of 32

16 of 32

17 of 32

18 of 32

19 of 32

20 of 32

21 of 32

22 of 32

23 of 32

24 of 32

25 of 32

26 of 32

27 of 32

28 of 32

29 of 32

Automating Open Conversations

  • Setup
    • A 5-month-long deployment, 80 Users
    • 4 chatbots + 1 voting bot�
  • Result
    • Automated responses were chosen 12.44% of the time.
    • Human upvotes were reduced by 13.81%.
    • The cost of each message is reduced by 32.76%.

​

​

30 of 32

Automating Open Conversations

  • Conversation quality and user satisfaction level remains.
    • Conversation Quality: Satisfaction, Clarity, Responsiveness, Comfort (Liu, et al., 2010)

31 of 32

Assignment 2-1

  • Go to Canvas!

32 of 32

Crowd-Powered

Conversational

Assistant

Lecturer: Kenneth Huang

txh710@psu.edu

​

Feb 18, 2020