A new method for analysing the interrelationship between performance indicators with an application to agrometeorological models

Mattia Sanna, Gianni Bellocchi, Mattia Fumagalli, Marco Acutis

Research output: Contribution to journalArticle

2 Citations (Scopus)

Abstract

The use of a variety of metrics is advocated to assess model performance but correlated metrics may convey the same information, thus leading to redundancy. Starting from this assumption, a method was developed for selecting, from among a collection of performance indicators, one or more subsets providing the same information as the entire set. The method, based on the definition of "stable correlation", was applied to 23 performance indicators of agrometeorological models, calculated on large sets of simulated and observed data of four agronomic and meteorological variables: above-ground biomass, leaf area index, hourly air relative humidity and daily solar radiation. Two subsets were determined: {Squared Bias, Root Mean Squared Relative Error, Coefficient of Determination, Pattern Index, Modified Modelling Efficiency}, {Persistence Model Efficiency, Root Mean Squared Relative Error, Coefficient of Determination, Pattern Index}. The method needs corroboration but is statistically founded and can support the implementation of standardized evaluation tools.

Original languageEnglish
Pages (from-to)286-304
Number of pages19
JournalEnvironmental Modelling and Software
Volume73
DOIs
Publication statusPublished - Nov 1 2015
Externally publishedYes

Fingerprint

aboveground biomass
Solar radiation
leaf area index
Redundancy
relative humidity
solar radiation
Atmospheric humidity
Biomass
persistence
air
Air
modeling
indicator
method
index
evaluation
need

Keywords

  • Model evaluation
  • Performance indicators
  • Stable correlation

ASJC Scopus subject areas

  • Software
  • Environmental Engineering
  • Ecological Modelling

Cite this

A new method for analysing the interrelationship between performance indicators with an application to agrometeorological models. / Sanna, Mattia; Bellocchi, Gianni; Fumagalli, Mattia; Acutis, Marco.

In: Environmental Modelling and Software, Vol. 73, 01.11.2015, p. 286-304.

Research output: Contribution to journalArticle

@article{fd37e35aa9af403392a9c4b7f2d8df88,
title = "A new method for analysing the interrelationship between performance indicators with an application to agrometeorological models",
abstract = "The use of a variety of metrics is advocated to assess model performance but correlated metrics may convey the same information, thus leading to redundancy. Starting from this assumption, a method was developed for selecting, from among a collection of performance indicators, one or more subsets providing the same information as the entire set. The method, based on the definition of {"}stable correlation{"}, was applied to 23 performance indicators of agrometeorological models, calculated on large sets of simulated and observed data of four agronomic and meteorological variables: above-ground biomass, leaf area index, hourly air relative humidity and daily solar radiation. Two subsets were determined: {Squared Bias, Root Mean Squared Relative Error, Coefficient of Determination, Pattern Index, Modified Modelling Efficiency}, {Persistence Model Efficiency, Root Mean Squared Relative Error, Coefficient of Determination, Pattern Index}. The method needs corroboration but is statistically founded and can support the implementation of standardized evaluation tools.",
keywords = "Model evaluation, Performance indicators, Stable correlation",
author = "Mattia Sanna and Gianni Bellocchi and Mattia Fumagalli and Marco Acutis",
year = "2015",
month = "11",
day = "1",
doi = "10.1016/j.envsoft.2015.08.017",
language = "English",
volume = "73",
pages = "286--304",
journal = "Environmental Modelling and Software",
issn = "1364-8152",
publisher = "Elsevier BV",

}

TY - JOUR

T1 - A new method for analysing the interrelationship between performance indicators with an application to agrometeorological models

AU - Sanna, Mattia

AU - Bellocchi, Gianni

AU - Fumagalli, Mattia

AU - Acutis, Marco

PY - 2015/11/1

Y1 - 2015/11/1

N2 - The use of a variety of metrics is advocated to assess model performance but correlated metrics may convey the same information, thus leading to redundancy. Starting from this assumption, a method was developed for selecting, from among a collection of performance indicators, one or more subsets providing the same information as the entire set. The method, based on the definition of "stable correlation", was applied to 23 performance indicators of agrometeorological models, calculated on large sets of simulated and observed data of four agronomic and meteorological variables: above-ground biomass, leaf area index, hourly air relative humidity and daily solar radiation. Two subsets were determined: {Squared Bias, Root Mean Squared Relative Error, Coefficient of Determination, Pattern Index, Modified Modelling Efficiency}, {Persistence Model Efficiency, Root Mean Squared Relative Error, Coefficient of Determination, Pattern Index}. The method needs corroboration but is statistically founded and can support the implementation of standardized evaluation tools.

AB - The use of a variety of metrics is advocated to assess model performance but correlated metrics may convey the same information, thus leading to redundancy. Starting from this assumption, a method was developed for selecting, from among a collection of performance indicators, one or more subsets providing the same information as the entire set. The method, based on the definition of "stable correlation", was applied to 23 performance indicators of agrometeorological models, calculated on large sets of simulated and observed data of four agronomic and meteorological variables: above-ground biomass, leaf area index, hourly air relative humidity and daily solar radiation. Two subsets were determined: {Squared Bias, Root Mean Squared Relative Error, Coefficient of Determination, Pattern Index, Modified Modelling Efficiency}, {Persistence Model Efficiency, Root Mean Squared Relative Error, Coefficient of Determination, Pattern Index}. The method needs corroboration but is statistically founded and can support the implementation of standardized evaluation tools.

KW - Model evaluation

KW - Performance indicators

KW - Stable correlation

UR - http://www.scopus.com/inward/record.url?scp=84940902834&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84940902834&partnerID=8YFLogxK

U2 - 10.1016/j.envsoft.2015.08.017

DO - 10.1016/j.envsoft.2015.08.017

M3 - Article

AN - SCOPUS:84940902834

VL - 73

SP - 286

EP - 304

JO - Environmental Modelling and Software

JF - Environmental Modelling and Software

SN - 1364-8152

ER -