ABCDEFGHIJKLMNOPQRSTUVWXYZ
1
Goal:
2
The aim of this task is to find percentage of similarity between participants' original and revised responses.
3
4
Explanation of columns:
5
OwnSummary Original
Participant's own original summary of article
6
OwnSummary Revised
Participant's own revision of their original summary (no assistance from AI)
7
OwnGenAISummary Original
Participant's own original summary of article
8
OwnGenAISummary Revised
Participant's revison of original summary with the assistance of AI
9
10
Step 1: Find your name under "assigned RA"
11
Step 2: There will be two corresponding texts either under the "OwnSummary Original" AND "OwnSummary Revised" OR "OwnGenAISummary Original" AND "OwnGenAISummary Revised." Each will have it's own row because each participant was assigned to one condition. Simply go to the next participant row and choose both of those corresponding summaries.
12
***NOTE - PLEASE SKIP BLANK ROWS, BUT DO NOT ERASE THEM. These are the rows for the only AI generated condition.
13
***NOTE 2 - If there are AI instructions before the texts (i.e. Bard will include a heading that reads "Bard has just updated..."), please omit that from the similarity/word/character counts.
14
Step 2: Insert both corresponding texts from the same participant into each similarity platform.
15
16
17
Similarity Platforms
***NOTE - WHEN YOU ARE REPORTING PERCENTAGE, PLEASE JUST STATE NUMBER WITHOUT SYMBOL. For example, if there is 94% similarity, please just put 94 in the cell.
18
ToolsADay
Insert both texts, report similarity
19
GoTranscript
Insert both texts, report similarity and number of corrections
20
CountWords
Insert both texts, report common %, difference %, common characters, difference characters
21
Calculla
Insert both texts, choose comparison method "character by character." Report # added characters and # removed characters. Then, choose comparison method "word by word." Report # added words and # removed words.
22
23
Contact Me with Questions
24
If you have any questions about this, please email me at tdm5kz@virginia.edu or text me at 215-534-3319.
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100