An R package for climate forecast verification
Environmental Modelling & SoftwarePublished 22 February 2018Open access
Nicolau Manubens, Louis‐Philippe Caron, Alasdair Hunter, Omar Bellprat, Eleftheria Exarchou, Neven S. Fučkar
Citations48
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
Abstract
Forecast verification is necessary to determine the skill and quality of a forecasting system, and whether it shows improvement with pre- or post-processing. s2dverification v2.8.0 is an open-source R package for the quality assessment of climate forecasts using state-of-the-art verification scores. The package provides tools for each step of the forecast verification process: data retrieval, processing, calculation of verification measures and visualisation of the results. Examples are provided and explained for each of these stages using climate model output.
Keywords
Earth and Planetary SciencesEnvironmental Science
Quarterly Journal of the Royal Meteorological SocietyThe ERA‐Interim reanalysis: configuration and performance of the data assimilation system
26,362 Citations2011Dick Dee, S. Uppala +34 more
ScienceDecadal Trends in the North Atlantic Oscillation: Regional Temperatures and Precipitation
8,012 Citations1995James W. Hurrell
An evaluation of the atmospheric moisture budget reveals coherent large-scale changes since 1980 that are linked to recent dry conditions over southern Europe and the Mediterranean, whereas northern Europe and parts of Scandinavia have generally experienced wetter than normal conditions.
NatureIncreasing destructiveness of tropical cyclones over the past 30 years
4,047 Citations2005Kerry Emanuel
An index of the potential destructiveness of hurricanes based on the total dissipation of power, integrated over the lifetime of the cyclone, is defined and shows that this index has increased markedly since the mid-1970s, due to both longer storm lifetimes and greater storm intensities.
Cambridge University Press eBooksStatistical Analysis in Climate Research
2,738 Citations1999Hans von Storch, Francis W. Zwiers
Journal of ClimateAn Intercomparison of Methods for Finding Coupled Patterns in Climate Data
1,564 Citations1992Christopher S. Bretherton, Catherine A. Smith +1 more
Environmental Modelling & SoftwareCharacterising performance of environmental models
1,503 Citations2012Neil Bennett, Barry Croke +14 more
General classes of direct value comparison, coupling real and modelled values, preserving data patterns, indirect metrics based on parameter values, and data transformations are discussed.
Quarterly Journal of the Royal Meteorological SocietyEvaluation of the ECMWF ocean reanalysis system ORAS4
1,046 Citations2012Magdalena Balmaseda, Kristian Mogensen +1 more
ScienceMeteorological Aspects of the El Niño/Southern Oscillation
918 Citations1983Eugene M. Rasmusson, John M. Wallace
In this review meteorological aspects of the time history of the 1982-1983 episode are described and compared with a composite based on six previous events between 1950 and 1975, and the impact of these new observations on theoretical interpretations of the event is discussed.
ScienceImproved Surface Temperature Prediction for the Coming Decade from a Global Climate Model
777 Citations2007Doug Smith, S. Cusack +4 more
Bulletin of the American Meteorological SocietyDecadal Climate Prediction: An Update from the Trenches
569 Citations2013Gerald A. Meehl, Lisa Goddard +25 more
Wiley Interdisciplinary Reviews Climate ChangeSeasonal climate predictability and forecasting: status and prospects
488 Citations2013Francisco J. Doblas‐Reyes, Javier García‐Serrano +3 more
Ocean ModellingAn ERA40-based atmospheric forcing for global ocean circulation models
422 Citations2009Laurent Brodeau, Bernard Barnier +3 more
Journal of the Atmospheric SciencesRelationship between Cyclone Tracks, Anticyclone Tracks and Baroclinic Waveguides
354 Citations1988John M. Wallace, Gyu‐Ho Lim +1 more
Philosophical Transactions of the Royal Society A Mathematical Physical and Engineering SciencesUncertainty in weather and climate prediction
341 Citations2011Julia Slingo, T. N. Palmer
A perspective on Lorenz's work is given and how the uncertainty in projections of climate change can be addressed to deliver more reliable and confident assessments that support decision-making on adaptation and mitigation.
Quarterly Journal of the Royal Meteorological SocietyCan multi‐model combination really enhance the prediction skill of probabilistic ensemble forecasts?
330 Citations2008Andreas Weigel, Mark A. Liniger +1 more
The aim of this paper is to resolve the apparent paradox of why, and under what conditions, a multi‐model can outperform the best participating single model.
International Journal of ClimatologyIs the North Atlantic Oscillation a random walk?
282 Citations2000David B. Stephenson, Valentina Pavan +1 more
Tellus A Dynamic Meteorology and OceanographyA review of the Southern Oscillation: oceanic-atmospheric circulation changes and related rainfall anomalies
266 Citations1984Vernon E. Kousky, Mary T. Kagano +1 more
Geoscientific model developmentESMValTool (v1.0) – a community diagnostic and performance metrics tool for routine evaluation of Earth system models in CMIP
203 Citations2016Veronika Eyring, Mattia Righi +33 more
The ESMValTool is envisage running alongside the Earth System Grid Federation (ESGF) as part of a more routine evaluation of CMIP model simulations while utilizing observations available in standard formats (obs4MIPs) or provided by the user.
Environmental Modelling & SoftwareThe Ensemble Verification System (EVS): A software tool for verifying ensemble forecasts of hydrometeorological and hydrologic variables at discrete locations
157 Citations2010James Dean Brown, Julie Demargne +2 more
The Ensemble Verification System (EVS) is a flexible, user-friendly, software tool designed to verify ensemble forecasts of numeric variables, such as temperature, precipitation and streamflow, which can be applied to forecasts from any number of discrete locations and can aggregate verification statistics across several discrete locations.
Monthly Weather ReviewStatistical–Dynamical Predictions of Seasonal North Atlantic Hurricane Activity
157 Citations2010Gabriel A. Vecchi, Ming Zhao +6 more
Geophysical Research LettersStatistical adjustment of decadal predictions in a changing climate
138 Citations2012V. V. Kharin, G. J. Boer +3 more
Monthly Weather ReviewModeling the Dependence of Tropical Storm Counts in the North Atlantic Basin on Climate Indices
127 Citations2010Gabriele Villarini, Gabriel A. Vecchi +1 more
Quarterly Journal of the Royal Meteorological SocietyFair scores for ensemble forecasts
111 Citations2013Christopher A. T. Ferro
A definition of fairness is proposed for ensembles with members that are interpreted as being dependent and it is shown that fair scores exist only for some forms of dependence.
Geophysical Research LettersAttribution of extreme weather and climate events overestimated by unreliable climate simulations
96 Citations2016Omar Bellprat, Francisco J. Doblas‐Reyes
The results suggest that event attribution approaches comprising of a single climate model would benefit from ensemble calibration in order to account for model inadequacies similarly as operational forecasting systems.
FigshareA Bayesian framework for verification and recalibration of ensemble forecasts: How uncertain is NAO predictability?
83 Citations2015Stefan Siegert (8336130), David B. Stephenson (9655808) +4 more
Climate DynamicsOn the assessment of near-surface global temperature and North Atlantic multi-decadal variability in the ENSEMBLES decadal hindcast
83 Citations2012Javier García‐Serrano, Francisco J. Doblas‐Reyes
Weather and ForecastingTwo Extra Components in the Brier Score Decomposition
83 Citations2008David B. Stephenson, Caio A. S. Coelho +1 more
Monthly Weather ReviewSome Effects of Finite Sample Size and Persistence on Meteorological Statistics.Part II: Potential Predictability
77 Citations1984Kevin E. Trenberth
Monthly Weather ReviewImproved Skill for the Anomaly Correlation of Geopotential Heights at 500 hPa
70 Citations2003T. N. Krishnamurti, Kusala Rajendran +7 more
Climate DynamicsSensitivity of decadal predictions to the initial atmospheric and oceanic perturbations
65 Citations2012Hui Du, Francisco J. Doblas‐Reyes +4 more
Journal of ClimateNorth Atlantic Power Dissipation Index (PDI) and Accumulated Cyclone Energy (ACE): Statistical Modeling and Sensitivity to Sea Surface Temperature Changes
61 Citations2011Gabriele Villarini, Gabriel A. Vecchi
Monthly Weather ReviewU.S. Landfalling and North Atlantic Hurricanes: Statistical Modeling of Their Frequencies and Ratios
50 Citations2011Gabriele Villarini, Gabriel A. Vecchi +1 more
Geophysical Research LettersA posteriori adjustment of near‐term climate predictions: Accounting for the drift dependence on the initial conditions
47 Citations2014Neven S. Fučkar, Danila Volpi +2 more
Quarterly Journal of the Royal Meteorological SocietyA bias‐corrected decomposition of the Brier score
44 Citations2012Christopher A. T. Ferro, Thomas E. Fricker
Journal of ClimateTropical Atlantic Variability Modes (1979–2002). Part II: Time-Evolving Atmospheric Circulation Related to SST-Forced Tropical Convection
41 Citations2008Javier García‐Serrano, Teresa Losada +2 more
Journal of ClimateOn the Variability and Predictability of Eastern Pacific Tropical Cyclone Activity*
35 Citations2015Louis‐Philippe Caron, Mathieu Boudreault +1 more
Climate DynamicsMulti-year prediction skill of Atlantic hurricane activity in CMIP5 decadal hindcasts
27 Citations2013Louis‐Philippe Caron, Colin Jones +1 more
ESMValTool (v1.0) – a community diagnostic and performance metrics tool for routine evaluation of Earth System Models in CMIP
23 Citations2015Veronika Eyring, Mattia Righi +33 more
Journal of Statistical Software<b>remote</b>: Empirical Orthogonal Teleconnections in<i>R</i>
23 Citations2015Tim Appelhans, Florian Detsch +1 more
This paper presents the R implementation of the original empirical orthogonal teleconnections algorithm in the remote package and highlights the algorithm’s use for crosscorrelations between two different geographic fields, as well as statistical downscaling from coarse to fine grids.
Climate DynamicsClusters of interannual sea ice variability in the northern hemisphere
23 Citations2015Neven S. Fučkar, Virginie Guémas +3 more
easyVerification: Ensemble Forecast Verification for Large Data Sets
17 Citations2015MeteoSwiss
remote: Empirical Orthogonal Teleconnections in R
3 Citations2014Tim Appelhans, Florian Detsch
