Infrastructure Engineering - Research Publications

Permanent URI for this collection

Search Results

Now showing 1 - 4 of 4
  • Item
    Thumbnail Image
    Characterizing dominant hydrological processes under uncertainty: evaluating the interplay between model structure, parameter sampling, error metrics, and data information content
    Khatami, S ; Peel, M ; Peterson, T ; Western, A (Copernicus Publications, 2020-03-23)
    <p>Hydrological models are conventionally evaluated in terms of their response surface or likelihood surface constructed with the model parameter space. To evaluate models as hypotheses, we developed the method of <em>Flux Mapping</em> to construct a hypothesis space based on model process representation. Here we defined the hypothesis space based on dominant runoff generating mechanisms, and acceptable model runs are defined as total simulated flow with similar (and minimal) model error simulated by distinct combinations of runoff components. We demonstrate that the hypothesis space in each modeling case is the result of interplay between the factors of model structure, parameter sampling, choice of error metric, and data information content. The aim of this study is to disentangle the role of each factor in this interplay. We used two model structures (SACRAMENTO and SIMHYD), two parameter sampling approaches (small samples based on guided-search and large samples based on Latin Hypercube Sampling), three widely used error metrics (NSE, KGE, and WIA — Willmott’s Index of Agreement), and hydrological data from a range of Australian catchments. First, we characterized how the three error metrics behave under different error regimes independent of any modeling. We then conducted a series of controlled experiments, i.e. a type of one-factor-at-a-time sensitivity analysis, to unpack the role of each factor in runoff simulation. We show that KGE is a more reliable error metric compared to NSE and WIA for model evaluation. We also argue that robust error metrics and sufficient parameter sampling are necessary conditions for evaluating models as hypotheses under uncertainty. We particularly argue that sampling sufficiency, regardless of the sampling strategy, should be further evaluated based on its interaction with other modeling factors determining the model response. We conclude that the interplay of these modeling factors is complex and unique to each modeling case, and hence generalizing model-based inferences should be done with caution particularly in characterizing hydrological processes in large-sample hydrology.</p>
  • Item
    Thumbnail Image
    On the relationship between the variability of catchment hydroclimate and physiography, and the uncertainty of runoff generation hypotheses
    Khatami, S ; Fowler, K ; Peel, M ; Peterson, TP ; Western, A ; Kalantari, Z (Copernicus Publications, 2021-03-04)
    <p>Question #20 of the UPH aspires to disentangle and reduce model prediction uncertainty. One feasible approach is to first formulate the relationship between variability (of real-world hydrological processes and catchment characteristics) and uncertainty (of model components and variables), which links the UPH theme of “modelling methods” to “time variability and change” and “space variability and scaling”. Building on this premise, we explored the relationship between runoff generation hypotheses, derived from a large ensemble of catchment model simulations, and catchment characteristics (physiographic, climatic, and streamflow response characteristics) across a large sample of 221 Australian catchments. Using ensembles of 10<sup>6 </sup>runs of SIMHYD model for each catchment, runoff generation hypotheses were formulated based on the interaction of 3 runoff generating fluxes of SIMHYD, namely intensity-based, wetness-based, and slow responses. The hypotheses were derived from model runs with acceptable performance and sufficient parameter sampling. For model performance acceptability, we benchmarked Kling-Gupta Efficiency (KGE) skill score against the calendar day average observed flow, a catchment-specific and more informative benchmark than the conventional observed flow mean. The relative parameter sampling sufficiency was also defined based on the comparative efficacy of two common model parameterisation routines of Latin Hypercube Sampling and Shuffled Complex Evolution for each catchment. Across 186 catchments with acceptable catchment models, we examined the association of uncertain runoff generation hypotheses (i.e. ensemble of modeled runoff fluxes) with 22 catchment attributes. We used the Flux Mapping method (https://doi.org/10.1029/2018WR023750) to characterise the uncertainty of runoff generation hypotheses, and a range of daily and annual summary statistics to characterise catchment attributes. Among the metrics used, Spearman rank correlation coefficient (R<sub>s</sub>) was the most informative metric to capture the functional connectivity of catchment attributes with the internal dynamics of model runoff fluxes, compared to linear Pearson correlation and distance correlation coefficients. We found that streamflow characteristics generally have the most important influence on runoff generation hypotheses, followed by climate and then physiographic attributes. Particularly, daily flow coefficient of variability (Qcv) and skewness (Q Skewness), followed by the same summary statistics of precipitation (Pcv and P Skewness), were most important. These four attributes are strongly correlated with one another, and represent the dynamics of the rainfall-runoff signal within a catchment system. A higher Pcv denotes a higher day-to-day variability in rainfall on the catchment, responded by a higher Qcv flow response. A higher variability in rainfall propagates through the catchment model and translates into a higher degree of equifinality in model runoff fluxes, which implies larger uncertainties of runoff generation hypotheses at catchment scale, and hence a greater challenge for reliable/realistic simulation and prediction of streamflow.</p>
  • Item
    Thumbnail Image
    Evaluating Participatory Modeling Methods for Co-creating Pathways to Sustainability
    Moallemi, EA ; de Haan, FJ ; Hadjikakou, M ; Khatami, S ; Malekpour, S ; Smajgl, A ; Smith, MS ; Voinov, A ; Bandari, R ; Lamichhane, P ; Miller, KK ; Nicholson, E ; Novalia, W ; Ritchie, EG ; Rojas, AM ; Shaikh, MA ; Szetey, K ; Bryan, BA (AMER GEOPHYSICAL UNION, 2021-03)
    Abstract The achievement of global sustainability agendas, such as the Sustainable Development Goals, relies on transformational change across society, economy, and environment that are co‐created in a transdisciplinary exercise by all stakeholders. Within this context, environmental and societal change is increasingly understood and represented via participatory modeling for genuine engagement with multiple collaborators in the modeling process. Despite the diversity of participatory modeling methods to promote engagement and co‐creation, it remains uncertain what the extent and modes of participation are in different contexts, and how to select the suitable methods to use in a given situation. Based on a review of available methods and specification of potential contextual requirements, we propose a unifying framework to guide how collaborators of different backgrounds can work together and evaluate the suitability of participatory modeling methods for co‐creating sustainability pathways. The evaluation of method suitability promises the integration of concepts and approaches necessary to address the complexities of problems at hand while ensuring robust methodologies based on well‐tested evidence and negotiated among participants. Using two illustrative case studies, we demonstrate how to explore and evaluate the choice of methods for participatory modeling in varying contexts. The insights gained can inform creative participatory approaches to pathway development through tailored combinations of methods that best serve the specific sustainability context of particular case studies.
  • Item