Strategy: Claim Validation (public)
 Share
The version of the browser you are using is no longer supported. Please upgrade to a supported browser.Dismiss

View only
 
 
ABCDEFGHIJKLMNOPQRSTUVWXYZAA
1
DepthQuestion and Answers
2
L0Question
What does the author of the review (LINK) think of the work being reviewed?
3
Expert Answer 1
$1
4
Expert Answer 2
$2
5
L1Sub QuestionHow many claims are there in $1 and does each one have solid evidence for it? Return number of well supported claims(n1X) over total number of claims(N1X). Provide the list of all claims inside a pointer.
6
Expert Answer 1
n11 / N11, $3
7
Expert Answer 2
n12 / N12, $4
8
L2Sub QuestionWhat is the best supporting evidence for each claim in $3? Return answer as <Claim>:[<Evidence>] (Leave blank if there's no evidence)
9
Expert Answer 1
<Claim1>:$5, <Claim2>:$7...
10
Expert Answer 2
<Claim1>:$6, <Claim2>:$8...
11
L3Sub QuestionWhat is the best argument re: <Claim1> that establishes one of the evidences $5 or $6 being better?
12
Expert Answer 1
$9
13
Expert Answer 2
$10
14
L4Sub QuestionIs there a good argument refuting $9 in light of evidence?
15
Expert Answer 1
16
Expert Answer 2
17
L4Sub QuestionIs there a good argument refuting $10 in light of evidence?
18
Expert Answer 1
19
Expert Answer 2
20
L3Sub QuestionWhat is the best argument re: <Claim1> that establishes one of the evidences $7 or $8 being better?1+
21
Expert Answer 1
$11
22
Expert Answer 2
$12
23
L4Sub QuestionIs there a good argument refuting $11 in light of evidence?
24
Expert Answer 1
25
Expert Answer 2
26
L4Sub QuestionIs there a good argument refuting $12 in light of evidence?
27
Expert Answer 1
28
Expert Answer 2
29
At this point Judges at L3 should have information on which evidence is better for which claim. If there's ambiguity for a claim it can be followed up.
30
L3Sub QuestionIs there any other evidence for <Claim1> besides $5? Answer Y/N and provide quote in a pointer.
31
Expert Answer 1
Y, $13
32
Expert Answer 2
N, $14
33
Above question can be repeated for other claims as needed.
34
Now at L2, one list of <Claim>:<Evidence> reaches the judge. Context can be investigated. Let's say Expert Answer 1 came up (Level 2, Sub question 1, Expert Answer 1 - L2-SQ1-EA1)
35
L2Sub QuestionIs there a claim-evidence pair in L2-SQ1-EA1 that's refuted by context?
36
Expert Answer 1
N
37
Expert Answer 2
Y, <claim2>:$7
38
Sub Branches Continue to investigate refutation by context
39
Back at L1, judge receives a certain answer - let's say L1-SQ1-EA2.
40
L1Sub QuestionHow many claims are there in $2 and does each have solid evidence for it? Return number of well supported claims (n2X) over total number of claims (N2X). Provide the list of claims inside a pointer.
41
Expert Answer 1
n21 / N21, $15
42
Expert Answer 2
n22 / N22, $16
43
Sub Branches Continue in a similar way to what's shown above for $1
44
Back at L1, judge receives a certain answer - let's say L1-SQ2-EA1.
45
Situation: Both answers indicate there are claims that are not well supported.
46
L1Sub QuestionAre the (N21-n21) weakly supported claims in $15 disprove $2 more than the (N12-n12) weakly supported claims in $4 disprove $1?
47
Expert Answer 1
48
Expert Answer 2
49
L2Sub QuestionWhat claims in $15 are weakly supported and what is the best evidence for them?
50
Expert Answer 1
51
Expert Answer 2
52
L2Sub QuestionWhat claims in $4 are weakly supported and what is the best evidence for them?
53
Expert Answer 1
54
Expert Answer 2
55
Sub Branches Continue to investigate best evidence for weakly supported claims are actually weak
56
Situation: One answer indicates full support, other one has some number of claims not well supported. Let's say that was L1-SQ2-EA1.
57
L1Sub QuestionFor the (N21-n21) weakly supported claims in $15, what is the best evidence?
58
Expert Answer 1
<Claim K>:<Evidence K>
59
Expert Answer 2
<Claim L>:No Evidence
60
Sub Branches Investigate evidence or the lack of it and make sure weakly supported claim has weak evidence
61
Situation: Both answers indicate that all claims are well supported. This means the ME has written a top level answer where support comes from the text but interpretation belongs not to the author but to ME.
62
L1Sub QuestionThe claims in $4 and $15 are all well supported. Which of them are not stated by the author?
63
Expert Answer 1
<Claim M> & <Claim O>
64
Expert Answer 2
<Claim P>
65
Sub Branches partition the expert answers and verify each re: who states it
66
Situation: One answer should be favored over the other - if evidence offered seems conclusive go ahead and pick that answer.
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
Loading...