1 of 4

AI as a Change Management Challenge

Jason Jones, PhD

Chief Data Scientist, Health Catalyst

Health

Catalyst

2 of 4

Supporting Leadership Decision Making

3 Levels of Predictive Model Understanding

2

Functional

Does the model make sense?

Contextual

How does it fit into the workflow?

Operational

What benefits and risks am I trading?

Deploying a predictive model is a change management activity that tools can help.

Health

Catalyst

Operational Model Understanding

Wanted…

Find 50% of people who develop CHD in 10 years. (Sensitivity)
50% of our statin prescriptions would have been associated with CHD. (Positive Predictive Value)

…but not possible now.

3

Health

Catalyst

Operational Model Understanding

Are you okay with…

Find 50% of people who develop CHD in 10 years. (Sensitivity)
35% of our statin prescriptions would have been associated with CHD. (Positive Predictive Value)

4

Health

Catalyst