��Space-Time Modeling of Hydroclimate Extremes for Risk and Resiliency� �Balaji Rajagopalan�Department of Civil, Environmental and Architectural Engineering�&�CIRES�University of Colorado, Boulder, USA��&�Will Kleiber�Applied Math����
NSF Workshop on Extremes
Nov 5 – 8, 2024
Colorado School of Mines
Golden, CO
Contact:
University of Colorado, Boulder, USA
WRR, HESS, Earths Future, J. Hydrology, Climate Dynamics, Monthly Weather Review
Collaborators
Motivation
SwissRe Sigma Report 2020
Motivation
CEEW 2022 Report
Increasing frequency of
Build India’s resilience through improved public early warnings
Nov 28 – Dec 4, 2015
Dec 2 – Dec 4, 2023
climate
SST Sep-Nov 2023 – El Nino
(Mis)-Management of Water Resources�Leading to Massive Floods
Nov 9 – 16, 2015
Pakistan Floods 2022
-Extensive Flooding
-Major crop loss
Kerala Floods 2018
Mitigate the impact of extreme events (e.g., rainfall, streamflow) - need to
Building Resiliency
Ossandon et al. (2021, J. Hydrology)
Ossandon et al. (2021, WRR, 2022, Earth’s Future)
Lakshmi et al. (2019, j. Atm. Sol. Terr. Phys.)
Nanditha et al. (2022, Clim. Dyn.)
IVT direction (vectors) and intensity (kg m−1 s−1; color shading) fields at (a) 0000, (b) 0600, (c) 1200, (d) 1800 UTC 26 Jul 2005, of mean daily composite on (e) 27 Jul 2005, (f) 28 Jul 2005, (g) 29 Jul 2005 and IMD daily rainfall (mm day−1; colors over land) distribution for the above period [(h)–(k)] during Mumbai floods.
forward problem
likelihood
inverse problem
posterior distribution
“Occam’s razor” :
model evidence p(y|m)
space of all data sets
Model evidence:
Statistical Learning - Bayesian Paradigm
Likelihood:
Prior:
Bayes rule:
Model m
Rev. Thomas Bayes (1701-1761) a
f
Statistical Learning - Bayesian Paradigm
Hydroclimate problems are fraught with uncertainty in
hierarchy
causality
Sample from the posterior PDF
Akin to Generalized Linear Model (GLM) Framework using MLE
Statistical Learning - Bayesian Hierarchical Models directed acyclic graphs (DAGs)
randomForest R package*
*Liaw, A., & Wiener, M. (2002)
Ho, T.K. (1995)
Breiman, L. (2001)
Statistical Learning – Random Forest
Recent Bayesian/Statistical Learning Research
Recent Bayesian Statistical Learning Research
Recent Bayesian Statistical Learning Research
‘Semi-Bayesian Blending’
Gauge Data
Satellite-derived Estimates
Solution: Blending information from multiple sources for accurate estimation of the underlying field with uncertainty
Verdin et al., 2015, WRR)
Data Sources
“Bayesian Blending” – Bayesian Hierarchical Model
July 2009
July 2009
Uncertainty:
July 2009
Precipitation
Covariates
Climatology of the extreme seasonal precipitation for 73 precipitation stations and 0.5-degree elevation grid in (m) of the study area. The red square corresponds to the site of interest, considered in Section 4.
Space-Time Field of Extremes
Ossandon et al. (2021, J. Hydrology)
Connections to Large Scale Climate
��Data layer: “True” values of the GEV regression coefficients
Model Structure – Semi-Bayesian Hierarchical Model (SBHM)
Model Structure
Priors
on regression parameters
Model Structure
Priors
on regression parameters
28
Implementation and Fitting
Caption. a) Q-Q plot , (b) PDF of the GEV distribution fitting, and (c) time series of nonstationary of the MLE return levels for different return periods for extreme summer precipitation at Pasamonte station, NM. In panel (b), the data are first transformed to an appropriate standardized GEV scale. The empirical PDF is obtained by a kernel density estimator. In panel (c), the black line corresponds to the observed.
Model Fit
Model Fits – Posterior �distributions of�Model Parameters
Fitting
Spatial-Time Variability of Return Levels 2-year
Return Levels
Conditional posterior median (2-year return level) of extreme summer precipitation and the corresponding 95% confidence interval width for the
Spatial Variability of Return Levels – 100-year
Fitting
Temporal Variability
stations dropped (7) for the cross-validation (red circles) and the subset data (66 stations) using to fit the model (gray circles).
Cross Validation
Predicted extreme summer precipitation
Semi-BHM - Summary
Outline
1473 ~ 1997
Streamflow
Traditional Methods
Bayesian Hierarchical Nonhomogeneous Hidden Markov Model - Study Region / Data
Bracken et al., 2016 (WRR)
A doubly embedded stochastic process that can be used to model time series data
2. The sequence of underlying distributions, or hidden states, follow a Markov chain
Observation 1
t=1
Observation 2
t=2
Observation 3
t=3
Observation 4
t=4
State 1
State 1
State 1
State 2
TPM
TPM
TPM
Coles (2001), Zucchini (2016)
Hidden Markov Model
Yst are streamflow at location s, in year t
Data Layer:
Pocess Layer:
State Transitions
where is the joint cdf of an S-dimensional multivariate normal distribution with covariance matrix Σ
Spatial Model
to obtain posteriors of
the parameters the flows
BHNHMM
(1906 – 1997) BHNMM Captures
to observed, relative to a
linear regression-based
model
Network Model - Study Region / Data
Spatial correlations among the sites are
Very well captured due to Copulas
Past streamflow reconstruction
Bracken et al., 2016
Multivariate Extremes
Application - Taylor Park Dam
Bracken et al. 2018 (WRR)
106°20'0"W
106°20'0"W
106°30'0"W
106°30'0"W
106°40'0"W
106°40'0"W
106°50'0"W
106°50'0"W
39°0'0"N
39°0'0"N
38°50'0"N
38°50'0"N
■
Colorado
57 / 68
60 / 68
Taylor Park model structure
(y(t), z(t), h(t)) ⇠ Cg (S; {µy (t), sy, xy, µz (t), sz, xz, µh (t), sh, xh }) y(t) ⇠ GEV(µy (t), sy, xy )
z(t) ⇠ GEV(µz (t), sz, xz )
(11)
(12)
(13)
(14)
(15)
(16)
(17)
h(t) ⇠ GEV(µh (t), sh, xh )
µy (t)= µy0 + x(t)T by
µz (t)= µz0 + x(t)T bz
µh (t)= a - exp(-bµz (t))
where x(t)T is a vector of climate covariates.
Results - Joint distributions
●
●
●
●
●
●
●
●
● ●
●
●
●
●
●
●● ●
● ●●
● ●
● ● ●
●
●
●● ●
●●●
●
0.5
1.0
1.5
2.0
2.5
3
4
5
6
7
snow
flow
●
●
●
●●
● ●
● ●
●
●
● ●● ●
●
●
●
●
●
● ●
● ●
●
● ●
● ● ●
●
●
● ●
●
9.315
9.320
9.325
9.330
3 4 5 6 7
snow
elev
●
●● ●
●
● ●
●
●
●
● ●
●● ●
●
●
●
●
● ●
●
● ●● ●
●
●
● ●
●
●
●
9.315
9.320
9.325
9.330
0.5 1.0 1.5 2.0 2.5
flow
elev
●
●
●
●
●
●
● ●
● ●
●●
●
●●
●
●
● ●
● ● ●
●
●●
●●● ● ●●
●●●
●
0.5
1.0
1.5
2.0
2.5
2 3 4 5 6 7
snow
flow
●
●
●
●●
● ●
● ●
●
●
● ●● ●
●
●
●
●
●
● ●
● ●
●
● ●
● ● ●
●
●
● ●
●
9.315
9.320
9.325
9.330
3 4 5 6 7
snow
elev
●
63 / 68
●● ●
●
● ●
●
●
●
●
●
● ●
●
●
●
●
●
● ●
● ● ●●●
●
●
● ●
●
●
●
9.315
9.320
9.325
9.330
0.5 1.0 1.5 2.0 2.5
flow
elev
Results - Nonstationary return levels
bayes_ind
bayes_joint
mle_ns
9.37
9.36
9.35
9.34
9.33
9.32
62 / 68
2
3
9
8
7
6
5
1980 1990 2000 2010 1980 1990 2000 2010 1980 1990 2000 2010
year
elev
flow
snow
Network model for daily streamflow
Ossandon et al. (2021a,b, 2022a,b, 2023)
Outline
Streamflow
Hydro-Meteorological Variable
Narmada River basin, India
Network Model - Study Region / Data
In the Bayesian Hierarchical Network Model (BHNM) streamflow at each gauge follows a Gamma distribution. Data Layer:
Model Structure
Process Layer: Parameters vary in space and time
Priors: Parameters vary in space and time
As potential covariates, we considered:
Model Covariates
Data layer distribution – Gamma, Lognormal etc.)
are fitted and the best model selected using
DIC (Deviance Information Criteria)
Implementation and Model Fitting
Calibration
distribution of simulated
July-August daily streamflow for Mandleshwar gauge
(a) For 1978-2014
(b) scatterplot
(c) For 2013
BHNW - Calibration
Calibration
Pairs plot (upper triangular matrix) and Pearson correlation coefficients (R, lower triangular matrix) of July-August daily
(b) ensembles mean forecast streamflow from BHNM for the three gauges analyzed in this study.
Streamflow values are in (100cms).
BHNW - Calibration
Cross Validation
Predictive posterior distribution of July-August daily streamflow at
Mandaleshwar gauge
(a) For 1978-2014
(b) scatterplot
(c) For 2013
BHNW – Cross Validation
cross validation also
BHNW – Skill Scores
compared to traditional Linear Model (GLM)
Worse
better
0 (equal)
1 (Perfect skill)
CRPSS (ESS)
BHNW – Skill Scores
BHNM - Summary
Physical hydrological model
Meteorological forcing
Streamflow
Bayesian Hierarchical model (BHM)
Other covariates
Q(t)
Q(t)
Streamflow ensembles
BNHM – Extensions
Physical Model – Post Processing
Ossandon et al. 2022, AMS J. of Hydromet
Model Structure
Relative to Single ensemble performance(mean)
Skill of model combination higher than VIC
Results – Cross-Validation
Two model combination shows higher ensemble performance than single model
Results – Two Models – VIC and SAC
Thota et al., 2023 – in preparation
To develop a Bayesian Hierarchical model combination (BHMC) approach for skillful real-time forecast of daily streamflow at multiple lead times
For k-day lead times
BNHM – Extensions
Realtime Forecasting
Ossandon et al., HESS 2022
Ossandon et al., Earths Future 2023
Handia
Realtime forecast of 2021 Season
BHM for seasonal maximum flow projections in the UCRB (Ossandon et al., 2022, 2023)
Daily seasonal maximum streamflow at each gauge (q)
Gaussian copula
July 1th
Climate covariates
Forecast precipitation
BHM
BHM
Peak monsoon season
BNHM – Extensions
Seasonal Maximum flow
Ossandon et al., 2022, HESS
Colorado River spring season maximum
Ossandon et al., WRR, 2023
Covariates selection for each lead time
Covariate Selection
Lead time | Covariates | LOOIC |
0-month | AMTP forecast, NI | 247.4 |
1-month | NI | 254.4 |
2-month | AMTP forecast, NI, PWPR | 250.0 |
3-month | NI, PWPR | 264.7 |
Covariates Selection
Handia
Results – Cross Validation
Model performance
Distributional performance
Results – Cross Validation
Space-Time Bayesian Hierarchical (Hot off the Press)
Process Layers
as a linear functional model of ‘ covariates’.
Gaussian processes
Ossandon et al. (2024) Paleoceanography and Paleoclimate (in review)
Space-Time Bayesian Hierarchical (Hot off the Press)
Space-Time Bayesian Hierarchical
Central Pacific > 1 oC
In the Western Pacific
Before decreasing
Space-Time Bayesian Hierarchical
Central Pacific > 1 oC Peak in cooling 6~4Ka
Before decreasing
In the Western Pacific
Present day monsoon-ENSO teleconnection
71
Percentage of Seasonal Rainfall
0 20 40 60 80 100 120 140
full
early
middle
late
70 – 100% increase in early season precipitation in north-central India and the Indo-Gangetic Plains;
30 – 80% increase in peak season precipitation in south-central India;
60 – 100% increase in late season precipitation in northern, northwestern, and central India.
Percentage rainfall increase for each season (full, early, middle, or late) due to a 1°C cooling of the NINO3.4 region in the tropical Pacific:
Gill et al., 2015, JGR
Random Forest Based Flow forecasting
Woodson et al. (2021, 2024)
73
Goal: Develop skillful forecasts of spring flow (April 1 – July 31 total flow) at lead times of 0 ~ 18 months
Streamflow Forecasting Framework
Streamflow Forecasting Framework
Example hindcast:
75
Pluvial
Drought
Streamflow Hindcast
At longer lead times (5 ~ 18 months)
At shorter lead times (0 ~ 4 months – ESP, short term forecast of precip and Temp from climate models)
76
Random Forest Variable Importance
Ranked Probability Skill Score (RPSS)
Ensemble Mean Root Mean Square Error (RMSE)
77
Good performance
Bad performance
Random Forest Model Performance
(vegetation, drought indices etc.), hot/cold
spells, tropical cyclones
Contact:
Parting Thoughts