1 of 58

Steering in Online Markets:

The Role of Platform Incentives and Credibility

http://john-joseph-horton.com/papers/badging.pdf

Moshe Barach, John Horton (@johnjhorton), Joe Golden

http://bit.ly/2M0i64r

2 of 58

Platform markets have preferences over matches that are formed

3 of 58

Platform markets have preferences over the matches that are formed on the platform

  • Direct revenue might differ for different sellers
    • Platform "take" differs
    • Customer service costs
  • Bad experiences spill-over on other sellers
    • Repeat business (Jaffe et al. "Airbnb paper"; Nosko & Tadelis "eBay paper")

4 of 58

Platform markets tools to steer buyers and/or make transactions more likely

5 of 58

Platform explicit (algorithmic)

recommendations

6 of 58

Expose or highlight product "facts" / reviews

7 of 58

Auction off visibility (hope for pos. selection)

8 of 58

Offer incentives

(for example, money-backed guarantees)

9 of 58

Money-backed guarantees

  • Pro:
    • Reduces the financial risk to buyers; platform better able to absorb risk
    • Cheaper for the platform to guarantee the "best" sellers, which in turn might make these implicit recommendations more credible
  • Con:
    • Might encourage moral hazard in selection
    • Could be expensive

10 of 58

This paper

  • Report the results of two steering experiments in an online labor market
  • Main result: Money-backed guarantees strongly affect which buyer is selected, but don't increase matches overall & seem to work just as well as (non-financial) recommendations.

11 of 58

Who gets "guaranteed"?

12 of 58

Suppose a would-be employer (buyer) receives applications from some number of workers (sellers):

13 of 58

Score = f(WageBid, Stars, Hours-Worked)

14 of 58

Score

0.95

0.72

0.45

0.42

0.23

0.10

15 of 58

Score

0.95

0.72

0.45

0.42

0.23

0.10

Platform picks some cutoff score, with all sellers above that being "preferred"

16 of 58

Score

0.95

0.72

0.45

0.42

0.23

0.10

"Molly" and "Ada" would be "preferred" because they have scores above 0.5

17 of 58

First experiment

18 of 58

Employer posts job opening

Opening gets applicants; Platform scores

Score > 0.5

"Guaranteed"

Status quo

19 of 58

Guaranteed

20 of 58

Status quo (not marked)

21 of 58

Sample size

22 of 58

Terms of the guarantee

23 of 58

Guaranteed sellers are really, really positively selected

24 of 58

> 50% more hours-worked

25 of 58

> 100% more past jobs

26 of 58

~ 50% higher wage bids

27 of 58

"Same" guarantee-eligible

sellers across two groups?

28 of 58

No difference in Guarantee-eligible sellers by buyer treatment status

29 of 58

Did offering the guarantee increase the number of buyers willing to hire?

30 of 58

No discernable increase in matches formed

31 of 58

Or in revenue conditional upon match being formed

32 of 58

No evidence of better matches

33 of 58

Uptake of the guarantee

34 of 58

Perhaps the guarantee was not salient and had no effect on buyers?

35 of 58

36 of 58

Even in the control, positive relationship between hiring & score

37 of 58

Above the cutoff, guaranteed sellers more likely to be hired

38 of 58

Some evidence for guarantee crowd-out

39 of 58

At the application level, we can interact I(score > 0.5) with applied-to opening treatment indicator

40 of 58

We can include a seller-specific FE in application level analysis

41 of 58

Being above threshold effect doubles when applying to an MBG opening

42 of 58

Some evidence of crowd-out---being below threshold and applying to an MBG job "hurts"

43 of 58

44 of 58

An ex ante concern was that buyers with guarantees would be less price sensitive

45 of 58

Higher wage bids; lower hire probability

46 of 58

No evidence treated employers less price sensitive

47 of 58

Could the same effects on selection have been achieved without the guarantee?

48 of 58

Employer posts job opening

Opening gets applicants; Platform scores

Score > 0.5

"Guaranteed"

Score > 0.5

"Recommended"

Sellers who would have been guaranteed are "recommended"

49 of 58

50 of 58

No difference in probability contract formed

51 of 58

No apparent difference in selection

52 of 58

Comparing the two experiments side by side

53 of 58

Concluding thoughts

  • Platform recommendations alone were powerful
    • Buyers trust the platform
  • Financial risks of hiring do not seem to be important
    • Labor market implications (explains lack of bonds?)
  • Ideas for future work
    • Seller-provided guarantees

54 of 58

55 of 58

56 of 58

57 of 58

58 of 58