Decomposition of the mean squared error and NSE performance criteria: Implications for improving hydrological modelling
Journal of Hydrology · 2009
Abstract
Research topics
Related research
Model Evaluation Guidelines for Systematic Quantification of Accuracy in Watershed Simulations
Watershed models are powerful tools for simulating the effect of watershed processes and management on soil and water resources. However, no comprehensive guidance is available to facilitate model evaluation in terms of the accuracy of simulated data compared to measured flow and constituent values. Thus, the objectives of this research were to: (1) determine recommended model evaluation techniques (statistical and graphical), (2) review reported ranges of values and corresponding performance ratings for the recommended statistics, and (3) establish guidelines for model evaluation based on the review results and project-specific considerations; all of these objectives focus on simulation of streamflow and transport of sediment and nutrients. These objectives were achieved with a thorough review of relevant literature on model application and recommended model evaluation methods. Based on this analysis, we recommend that three quantitative statistics, Nash-Sutcliffe efficiency (NSE), percent bias (PBIAS), and ratio of the root mean square error to the standard deviation of measured data (RSR), in addition to the graphical techniques, be used in model evaluation. The following model evaluation performance ratings were established for each recommended statistic. In general, model simulation can be judged as satisfactory if NSE > 0.50 and RSR < 0.70, and if PBIAS + 25% for streamflow, PBIAS + 55% for sediment, and PBIAS + 70% for N and P. For PBIAS, constituent-specific performance ratings were determined based on uncertainty of measured data. Additional considerations related to model evaluation guidelines are also discussed. These considerations include: single-event simulation, quality and quantity of measured data, model calibration procedure, evaluation time step, and project scope and magnitude. A case study illustrating the application of the model evaluation guidelines is also provided.
LARGE AREA HYDROLOGIC MODELING AND ASSESSMENT PART I: MODEL DEVELOPMENT<sup>1</sup>
ABSTRACT: A conceptual, continuous time model called SWAT (Soil and Water Assessment Tool) was developed to assist water resource managers in assessing the impact of management on water supplies and nonpoint source pollution in watersheds and large river basins. The model is currently being utilized in several large area projects by EPA, NOAA, NRCS and others to estimate the off‐site impacts of climate and management on water use, non‐point source loadings, and pesticide contamination. Model development, operation, limitations, and assumptions are discussed and components of the model are described. In Part II, a GIS input/output interface is presented along with model validation on three basins within the Upper Trinity basin in Texas.