ABCDEFGHIJKLMNOPQRSTUVWXYZAAABACADAEAFAGAHAIAJAKALAMANAOAPAQARASATAUAVAWAXAYAZBABBBCBDBEBFBGBHBIBJBKBLBMBNBOBPBQBRBSBTBUBVBWBXBY
1
2
Clinical Utility Index Calculator
3
 Qualitative and Quantitative Clinical Utility of Diagnostic and Screening TestsAlex J Mitchell ajm80@le.ac.uk
4
5
 Instructions: enter your data from diagnostic/screening test results in green cells in section a. All results are automatically calculated b) accuracy c) utility
6
7
8
a) User Data Entryb) Accuracy Statistics
9
Lower CIUpper CITPFNTNFPTrue Depression (gold stand)Detected DepressionSensitivitySECIMissed Depressions (False Negatives)True Non-DepressionsDetected non-DepressedSpecificitySECIFalse PositivesPPVSECINPVSECIPrev (D /Total)Utility (+) [SexPPV]SECIUtility (-) [Sp x NPV]SECICU+ InterpretationCU- InterpretationCorrect ID/100Efficiency Testlikelihood ratio (LR+) = sensitivity / (1-specificity)likelihood ratio (LR-) = (1-sensitivity) / specificity
10
Enter Total # Cases:2677Sensitivity =>12.7%11.5%14.0%3412336.00146213782.00267734112.7%0.6%1.3%2336.0018403.001462179.4%0.3%0.6%3782.008.3%0.4%0.8%86.2%0.3%0.5%0.1270.0110.0000.0000.6850.0000.000vPoorGood70.9811.830.621.10
11
12
Enter # Cases Detected:341Specificity =>79.4%78.9%80.0%
13
14
Enter Total # Non-Cases:18403Positive Predictive Value = >8.3%7.4%9.1%
15
16
Enter # Cases Detected:14621Negative Predictive Value = >86.2%85.7%86.7%
17
18
Likelihood Ratio +ve =>0.62
19
20
Likelihood Ratio -ve =>1.10
21
I developed the clinical utility index in 2007 in order to take into account both occurrence
22
 and discrimination. Both are important aspects of test performance for clinicians. Further
23
 it is vital to realize that test results can be valuable both when positive and negative. The Test Score % =>71.0
24
product of sensitivity and PPV is only a useful calculation when a positive result of a test is
25
under scrutiny. A mirror image calculation namely specificity x NPV is recommended when Prevalence = >12.7%
26
a negative test is under scrutiny. In the case of a high PPV or high NPV, a correction is needed
27
for occurrence of that test in each respective population. Take for example the occurrence Data check =>Looks OK
28
of all five symptoms from DSM-IV as a “test” for depression. In those who test positive
29
 (that is those who suffer all five symptoms) let us say the PPV is hypothetically 88%
30
 but often actually having all five symptoms is rare (say 28%) in clinical practice. Any test c) Utility Statistics
31
with a high PPV will be devalued if it occurs rarely in true cases. Clinically relevant rule in
32
accuracy can be considered a product of the PPV and sensitivity and in this example the CUI+ Clinical Utility +Ve =>vPoorLower CIUpper CI
33
for all five symptoms is 0.88 x 0.28 = 0.32. Now consider the calculation needed for ruling-out 0.0110.0100.011
34
a diagnosis. For example the absence of the symptom loss of drive might have a high NPV of
35
96% but might only be absent (negative) in 70% of non-depressed patients. Thus the negative
36
 clinical utility index (CUI-) would be 0.96 x 0.70 = 0.67. To help with the application of this indexClinical Utility -Ve =>GoodLower CIUpper CI
37
 I proposed scores can be converted into qualitative grades as follows: 0.6850.6850.685
38
excellent utility >= 0.81, good utility >=0.64 and fair utility >=0.49 and poor utility < 0.49
39
40
41
42
43
d) Citations
44
45
1. Mitchell AJ. The clinical significance of subjective memory complaints in the diagnosis of mild cognitive impairment and dementia: a meta-analysis. Int J Geriatr Psychiatry. 2008 Nov;23(11):1191-202.
46
2. Pentzek M, Wollny A, Wiese B et al AgeCoDe Study Group. Apart from nihilism and stigma: what influences general practitioners' accuracy in identifying incident dementia? Am J Geriatr Psychiatry. 2009 Nov;17(11):965-75.
47
3. Goncalves et al. Case finding in dementia: comparative utility of three brief instruments in the memory clinic setting. Int Psychogeriatr. 2011 Jan 12:1-9. [Epub ahead of print]
48
4. Mitchell AJ. 5. How Do We Know When a Screening Test is Clinically Useful? In Screening for Depression in Clinical Practice: An Evidence-Based Guide (Eds) Alex J. Mitchell and James C. Coyne ISBN10: 0195380193 OUP 2009
49
5. R. Rhys Davies and Andrew J. Larner. Addenbrooke’s Cognitive Examination (ACE) and Its Revision (ACE-R). In A.J. Larner (ed.), Cognitive Screening Instruments, DOI 10.1007/978-1-4471-2452-8_4, © Springer-Verlag London 2013
50
6. Mitchell AJ. Sensitivity × PPV is a recognized test called the clinical utility index (CUI+). Eur J Epidemiol. 2011 Mar;26(3):251-2; author reply 252. Epub 2011 Mar 26.
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100