transformation importance
with applications to cosmology
singh*, ha*, lanusse, boehm, liu & yu
input
prediction
MassiveNuS simulations (liu et al. 2017)
attribution methods
shap (lundberg & lee 2017)
contextual decomposition (murdoch et al. 2018; singh et al. 2019)
lime (ribeiro et al. 2016)
integrated gradients (sundarajan et al. 2017)
TRIM(s)
T -1
x’
f’(s)
f(x)
x
s
T
x - x’
TRIM (CD) score
Central scale (angular multipole ℓ)
TRIM (CD) score
Central scale (angular multipole ℓ)
fake news classification
mean importance (cd)
audio classification
mean importance �(integrated gradients)
mnist
simulations
X
Y
training
importance
cd | deeplift | shap | ig |
0.4 | 3.6 | 4.0 | 4.2 |
error (%)
next steps: learning a transformation with desirable properties
cd importance
relevant part
residuals
T
appendix
prior knowledge: should be pretty flat
A_s
first layer filters
filters from ribli et al. 2019
cosmology
posthoc interp
model-based interp
next steps