Labwise file drawer
 Share
The version of the browser you are using is no longer supported. Please upgrade to a supported browser.Dismiss

 
View only
 
 
Still loading...
ABCDEFGHIJKLMNOPQRSTUVWXYZAAABAC
1
Roger Giner-Sorolla, 2017
Demonstration of labwise file drawer effects
rsg@kent.ac.uk
Currently under revision
Hybrid lab with 5 topics at each of 3 power levels, .5, .8 and .05
2
Rule 1: run up to 3, abandon after 1 nonreplicated positive or 2 ns, publish with 2+ significant
3
0.5nnnAbandon0.1250.130.3280.8nnnAbandon0.0080.0970.38190.05nnnAbandon0.8573750.4750.1065
Abandonment rate
4
powersnnAbandon0.125
Median p value & power of ns studies (est.)
powersnnAbandon0.032
Median p value of ns studies (est.)
powersnnAbandon0.045125
Median p value and power of ns studies (est.)
61.74%
5
nsnAbandon0.12577.78%nsnAbandon0.03288.89%nsnAbandon0.04512567.52%
Number of studies run
6
nnsAbandon0.125
% published studies significant
nnsAbandon0.032
% published studies significant
nnsAbandon0.045125
% published studies significant
37.5
7
nssPublish0.12575%nssPublish0.12886%nssPublish0.00237561%
Studies run per publication
8
snsAbandon0.125
Observed power of sig studies
snsAbandon0.128
Observed power w/selection bias
snsAbandon0.002375
Observed power w/selection bias
4.049402713
9
ssnPublish0.12567%ssnPublish0.12882%ssnPublish0.00237545%
Average observed power, published findings only
10
sssPublish0.125
Observed power including ns studies
sssPublish0.512
Observed power including ns studies
sssPublish0.000125
Observed power including ns studies
0.77
11
2.5purple = studies not run62.50%77.78%55.29%2.523.20%88.89%74.69%2.599.51%67.52%23.16%
%published findings sig
R index
12
studies /topicabandon rate% pub findings sigR index (link)studies /topicabandon rate% pub findings sigR indexstudies /topicabandon rate
% pub findings sig
R index85.17%68.14%
13
14
Rule 2: run up to 3, abandon after 2 ns, publish with 2+ significant
Hybrid lab (see above)
15
0.5nnnAbandon0.1250.130.3280.8nnnAbandon0.0080.05nnnAbandon0.857375
Abandonment rate
16
powersnnAbandon0.125
Median p value & power of ns studies (est.)
powersnnAbandon0.032powersnnAbandon0.04512553.23%
17
nsnAbandon0.12575.00%nsnAbandon0.03285.71%nsnAbandon0.04512567.24%
Number of studies run
18
nnsAbandon0.125
% published studies significant
nnsAbandon0.032
% published studies significant
nnsAbandon0.045125
% published studies significant
41.25
19
nssPublish0.12575%nssPublish0.12886%nssPublish0.00237561%
Studies run per publication
20
snsPublish0.125
Observed power w/selection bias
snsPublish0.128
Observed power w/selection bias
snsPublish0.002375
Observed power w/selection bias
5.166744951
21
ssnPublish0.12564%ssnPublish0.12877%ssnPublish0.00237548%
Average power of published findings only
22
sssPublish0.125
Observed power including ns studies
sssPublish0.512
Observed power including ns studies
sssPublish0.000125
Observed power including ns studies
0.69
23
2.7550.00%75.00%53.90%2.7510.40%85.71%67.43%2.7599.28%67.24%27.90%
%published findings sig
R index
24
studies /topicabandon rate% pub findings sigR indexstudies /topicabandon rate% pub findings sigR indexstudies /topicabandon rate
% pub findings sig
R index81.80%56.04%
25
26
Rule 3: run up to 3, abandon after 1 ns, publish with 2+ significant
Hybrid lab (see above)
27
0.5nnnAbandon0.1250.130.3280.8nnnAbandon0.0080.05nnnAbandon0.857375
Abandonment rate
28
powersnnAbandon0.125
Median p value & power of ns studies (est.)
powersnnAbandon0.032powersnnAbandon0.04512570.25%
29
nsnAbandon0.12583.33%nsnAbandon0.03293.33%nsnAbandon0.04512568.33%
Number of studies run
30
nnsAbandon0.125
% published studies significant
nnsAbandon0.032
% published studies significant
nnsAbandon0.045125
% published studies significant
41.25
31
nssAbandon0.12575%nssAbandon0.12886%nssAbandon0.00237561%
Studies run per publication
32
snsAbandon0.125
Observed power w/selection bias
snsAbandon0.128
Observed power w/selection bias
snsAbandon0.002375
Observed power w/selection bias
3.914590747
33
ssnPublish0.12571%ssnPublish0.12886%ssnPublish0.00237543%
Average power of published findings only
34
sssPublish0.125
Observed power including ns studies
sssPublish0.512
Observed power including ns studies
sssPublish0.000125
Observed power including ns studies
0.71
35
2.2575.00%83.33%58.07%2.7536.00%93.33%77.87%2.7599.75%68.33%18.20%
%published findings sig
R index
36
studies /topicabandon rate% pub findings sigR indexstudies /topicabandon rate% pub findings sigR indexstudies /topicabandon rate
% pub findings sig
R index90.46%52.31%
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
Loading...
 
 
 
Sheet1