PAI Trust Literature Bibliography - Public View
 Share
The version of the browser you are using is no longer supported. Please upgrade to a supported browser.Dismiss

View only
 
 
ABCDEFGHIJKLMNOPQRSTUVWXYZ
1
PAI TRUST LITERATURE BIBLIOGRAPHY
2
For more information, see PAI Research
3
In order to better understand trust between humans and artificially intelligent systems, the Partnership on AI (PAI), supported by members of its Collaborations Between People and AI Systems (CPAIS) Expert Group, conducted an initial survey and analysis of the multidisciplinary literature on AI, humans, and trust. Tab 2 of this speadsheet includes a Multidisciplinary Bibliography listing titles, links, and abstracts for 78 research articles, tagged with the themes outlined below. An overview document presenting 7 key insights from this literature review is also available on the main page for this project on the PAI website. These key insights, themes, and aggregated texts can serve as fruitful entry points for those investigating the nuances in the literature on humans, trust, and AI, and can help align understandings related to trust between people and AI systems. This work can also inform future research, which should investigate gaps in the research and our bibliography to improve our understanding of how human-AI trust facilitates, or sometimes hinders, the responsible implementation and application of AI technologies.
4
METHODS: The process of collecting articles for this Bibliography sourced content from a multidisciplinary community all aligned around an interest and expertise in human-AI collaboration. Submitted articles were evaluated for inclusion and analyzed by members of a smaller project group from within the PAI Partner community. Four thematic tags were developed, highlighting the ways the article abstracts approached the issue of trust. Specifically:
1. UNDERSTANDING - lays out a conceptual framework for trust or is primarily a survey of trust-related issues.
2. PROMOTING - focuses on means for increasing trust
3. RECEIVING - focuses on the entity (e.g., a robot, a system, a website) that is trusted
4. IMPACTING - focuses on the nature of changes due to trust being present (e.g., the impact on a group or an organization when it experiences trust)
5
Two individuals from the smaller project group undertook a thematic tagging exercise to assess inter-rater reliability and the distribution of articles across tags. They tagged themes as primary and secondary (first and second order) for each article from the four thematic options above. There was 69% rater agreement when considering tags included in either first or second order thematic tagging, and 48% rater reliability for the total articles in which both reviewers tagged the same first-order theme.

The CPAIS Trust Literature Bibliography identifies thematic tags for each article, at levels 1 and 2. The “themes” column lists the first order themes (twice if they were tagged as first by both reviewers) and the second order themes, where applicable. The total tags for each article (at both levels) are also provided. “Understanding trust” was the most frequent theme - used with 61 articles (78% of the total). 50 articles (64%) were tagged with “promoting trust,” and 29 articles (37%) were tagged with “receiving trust”. Finally, 13 articles (16%) were tagged with a focus on impacting trust. .

This bibliography and thematic tags serve as fruitful entry points for those investigating the nuances in the literature on humans, trust, and AI, especially when contextualized with the insights drawn from the corpus presented above.
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
Loading...