Chart catalog#

Time series#

Observation and simulation time series can be drawn with plot_time_series function.

../_images/time_series.png

Average of a score as a function of the forecast time#

plot_average_ft_scores

The score can be computed spatially (for each time) or temporally (for each station) and then average (mean or median) to get a value for each forecast time.

../_images/average_ft_scores.png

Median scores for each year quarter#

Median of scores computed every quarters can be drawn combining quarterlyMedianScore method and plot_quarterly_score function.

../_images/quarterlyMedianScore.png

Time scores#

Scores at a given term can be drawn with plot_time_scores function. For hourly series, the term is a interger corresponding to a forecast hour, whereas for daily series, it corresponds to a forecast day.

../_images/time_scores.png

Station scores#

Scores per station for a choosen forecast day can be displayed on a map with plot_station_scores function.

../_images/station_scores.png

Taylor diagram#

A taylor diagram for the first forecast day can be displayed with plot_taylor_diagram function.

../_images/taylor_diagram.png

Scatter plot of score quartiles#

The function plot_score_quartiles draws a scatter plot with axis corresponding to the median of two choosen scores. Each point on the scatter plot represents one model and the rectangle around the point is drawn from the quartiles of the two scores.

../_images/score_quartiles.png

Scatter plot of station scores for two models#

The function plot_comparison_scatter_plot displays the score calculated at every stations for two different Evaluator objects.

../_images/comparison_scatter_plot.png

Significant differences#

The function plot_significant_differences tests the significativity of differences between the distribution of station scores of two Evaluator objects. Several scores an several couple of Evaluator objects can be tested.

../_images/significant_differences.png

Diurnal cycle per station#

The function plot_diurnal_cycle displays the median of observed and simulated concentration values at each station as a function of the forecast time.

../_images/diurnal_cycle.png

Probability density of raw data#

The function plot_data_density displays the probability density of observation and simulation values.

../_images/data_density.png

Probability density of a score#

The function plot_score_density displays the probability density of score values.

../_images/score_density.png

Boxplot of data values#

The function plot_data_box displays the distribution of observation and simulation values.

../_images/data_box.png

Boxplot of score values#

The function plot_score_box displays the distribution of score values.

../_images/score_box.png

FAIRMODE diagrams#

The functions plot_target_diagram, plot_fairmode_summary and plot_forecast_target_diagram displays three of the Fairmode diagrams: the assessment target plot, the summary report and the forecast target plot. A description of these diagrams can be found on FAIRMODE website.

../_images/target.png ../_images/summary.png ../_images/forecast_target.png

Scores as a barplot#

The function plot_bar_scores displays the barplots of the average of scores computed per station. It is possible to compute different bars for different country sets.

../_images/bar_scores.png

Threshold exceedances#

The function plot_bar_exceedances displays the daily number of exceedances. It is possible to select different country sets.

../_images/bar_exceedances.png

The function plot_bar_contingency_table displays, as a barplot, the contingency table regarding the number of exceedances of a threshold.

../_images/bar_contingency_table.png

The function plot_line_exceedances displays the daily number of exceedances.

../_images/line_exceedances.png

Observations vs simulations scatter plot#

Observation and simulation values can be compared with plot_values_scatter_plot function.

../_images/values_scatter_plot.png

Performance diagram#

This function plot_performance_diagram draws the performance diagram by P.J. Roebber (“Visualizing multiple measures of forecast quality”, 2009).

../_images/performance_diagram.png

ROC curves#

This function plot_roc_curve draws the ROC curve relative to the choosen thresholds for each object.

../_images/roc_curve.png

Scores computed from a concentration limit value#

The function plot_exceedances_scores draws a barplot displaying:

  • Accuracy

  • Bias score

  • Success ratio

  • probability of detection (Hit rate)

  • false alarm ratio

  • probability of false detection = false alarm rate

  • Threat Score

  • Equitable Threat Score

  • Peirce Skill Score (Hanssen and Kuipers discriminant)

  • Heidke Skill Score

  • Rousseau Skill Score

  • Odds Ratio

  • Odds Ratio Skill Score

More information on these scores can be found here https://www.cawcr.gov.au/projects/verification/.

../_images/exceedances_scores.png

Summary bar chart#

The function plot_summary_bar_chart plots a bar for RMSE and lollipops for bias and correlation.

../_images/summary_bar_chart.png

Bar chart of scores computed for different concentration classes#

The function plot_bar_scores_conc plots scores computed for each required concentration range (scores are computed for each site and averaged).

../_images/bar_scores_conc.png