Quality assessment of HC3v4 and HC3v5 against 14 BSRN stations

Last update: Dec. 2017

<< BACK to HC3 validation page

Methodology

HelioClim-3 version 4 and version 5

Date: Oct. 2017

Authors:

  • Dr Etienne Wey, Transvalor
  • Pr Lucien Wald, MINES ParisTech
  • Dr Philippe Blanc, MINES ParisTech
  • and Dr Claire Thomas, Transvalor

HelioClim-3 version 4 and version 5 radiation values are compared to the BSRN measurements of 14 stations located in the Meteosat Second Generation satellite coverage following the protocol of validation described here on SoDa. The 1 min BSRN station measurements have been qualified using the quality check procedure available here. The validation results are available for the 15 min, hourly, daily and monthly time step, and for the Global Horizontal and the Direct Normal components.

NB: please note that in Oct. 2017, HC3v5 has been modified to take into account McClear v3. This generate a difference of approx. 1 to 2% compared to previous statistics (McClear v2 + no bias correction).


More information on the BSRN stations

Top of page

Validation results

Quality assessment results of GHI values

HelioClim-3 v4 and v5 -- GHI Quality assessment results vs. the BSRN stations
MONTHLY SUM OF 15 MIN IRRADIATION
Station Number of values Mean
- BSRN -
(kWh/m²)
Bias HC3v4
(kWh/m2)
(relative in %
)
Bias HC3v5
(kWh/m2)
(relative in %
)
RMSE HC3v4
(kWh/m2)
(relative in %
)
RMSE HC3v5
(kWh/m2)
(relative in %
)
Correl. coeff.
HC3v4
Correl. coeff.
HC3v5
Lerwick 29 81.2 2.8 (3.4%) 3.4 (4.2%) 7.7 (9.5%) 7.0 (8.6%) 0.995 0.997
Toravere 104 83.4 -2.0 (-2.4%) -3.0 (-3.6%) 7.8 (9.3%) 7.0 (8.4%) 0.989 0.992
Lindenberg 37 90.0 -4.2 (-4.7%) -3.5 (-3.9%) 6.5 (7.2%) 5.6 (6.3%) 0.996 0.997
Cabauw 112 87.9 -3.4 (-3.9%) -2.6 (-2.9%) 7.4 (8.4%) 5.9 (6.7%) 0.994 0.996
Camborne 41 93.5 -1.0 (-1.1%) -0.3 (-0.3%) 3.3 (3.6%) 2.5 (2.7%) 0.999 0.999
Palaiseau 93 98.1 3.6 (3.6%) 2.0 (2.0%) 6.2 (6.3%) 3.3 (3.4%) 0.998 0.999
Payerne 88 99.1 -8.1 (-8.2%) -1.2 (-1.2%) 10.1 (10.2%) 4.6 (4.7%) 0.995 0.997
Carpentras 120 128.7 1.6 (1.3%) 2.2 (1.7%) 4.5 (3.5%) 3.0 (2.3%) 0.998 1.000
Cener 44 115.7 3.1 (2.6%) 3.5 (3.1%) 4.6 (4.0%) 5.0 (4.3%) 0.998 0.998
Sede Boqer 100 169.1 -11.1 (-6.6%) -6.9 (-4.1%) 13.1 (7.8%) 8.8 (5.2%) 0.993 0.996
Tamanrasset 124 174.5 1.2 (0.7%) -0.5 (-0.3%) 8.0 (4.6%) 5.0 (2.9%) 0.981 0.991
Brasilia 65 147.5 7.0 (4.8%) 4.5 (3.1%) 9.8 (6.6%) 6.5 (4.4%) 0.973 0.988
Sao Martinho da Serra 72 143.7 -0.3 (-0.2%) -2.9 (-2.0%) 5.1 (3.5%) 5.2 (3.6%) 0.995 0.997
De Aar 11 172.1 0.1 (0.0%) -0.6 (-0.4%) 2.0 (1.2%) 2.1 (1.2%) 0.999 0.999

Top of page

HelioClim-3 v4 and v5 -- GHI Quality assessment results vs. the BSRN stations
DAILY SUM OF 15 MIN IRRADIATION
Station Number of values Mean
- BSRN -
(Wh/m²)
Bias HC3v4
(Wh/m2)
(relative in %
)
Bias HC3v5
(Wh/m2)
(relative in %
)
RMSE HC3v4
(Wh/m2)
(relative in %
)
RMSE HC3v5
(Wh/m2)
(relative in %
)
Correl. coeff.
HC3v4
Correl. coeff.
HC3v5
Lerwick 885 2668.1 85.9 (3.2%) 108.3 (4.1%) 470.3 (17.6%) 429.3 (16.1%) 0.972 0.978
Toravere 2975 2831.1 -68.1 (-2.4%) -96.4 (-3.4%) 439.5 (15.5%) 397.6 (14.0%) 0.979 0.984
Lindenberg 1110 2998.9 -140.3 (-4.7%) -118.3 (-3.9%) 392.1 (13.1%) 361.5 (12.1%) 0.987 0.988
Cabauw 3312 2959.1 -116.9 (-3.9%) -87.8 (-3.0%) 385.9 (13.0%) 337.8 (11.4%) 0.986 0.989
Camborne 1202 3181.3 -35.6 (-1.1%) -10.6 (-0.3%) 319.0 (10.0%) 286.0 (9.0%) 0.990 0.992
Palaiseau 2814 3244.4 117.0 (3.6%) 64.6 (2.0%) 332.2 (10.2%) 257.4 (7.9%) 0.991 0.994
Payerne 2544 3344.7 -270.3 (-8.1%) -38.0 (-1.1%) 477.4 (14.3%) 379.4 (11.3%) 0.986 0.987
Carpentras 3536 4378.7 55.0 (1.3%) 74.8 (1.7%) 335.6 (7.7%) 263.1 (6.0%) 0.991 0.995
Cener 1251 3987.1 103.9 (2.6%) 121.0 (3.0%) 356.2 (8.9%) 335.2 (8.4%) 0.990 0.992
Sede Boqer 2891 5765.4 -381.0 (-6.6%) -238.3 (-4.1%) 534.8 (9.3%) 395.0 (6.9%) 0.981 0.987
Tamanrasset 3483 6001.5 41.6 (0.7%) -8.7 (-0.1%) 563.1 (9.4%) 426.1 (7.1%) 0.925 0.958
Brasilia 1882 5246.9 241.3 (4.6%) 153.0 (2.9%) 638.0 (12.2%) 574.5 (10.9%) 0.900 0.915
Sao Martinho da Serra 2170 4778.0 -12.8 (-0.3%) -96.7 (-2.0%) 414.9 (8.7%) 379.9 (8.0%) 0.985 0.989
De Aar 330 5724.0 2.7 (0.0%) -19.9 (-0.3%) 410.3 (7.2%) 325.1 (5.7%) 0.981 0.988

Top of page

HelioClim-3 v4 and v5 -- GHI Quality assessment results vs. the BSRN stations
HOURLY SUM OF 15 MIN IRRADIATION
Station Number of values Mean
- BSRN -
(Wh/m²)
Bias HC3v4
(Wh/m2)
(relative in %
)
Bias HC3v5
(Wh/m2)
(relative in %
)
RMSE HC3v4
(Wh/m2)
(relative in %
)
RMSE HC3v5
(Wh/m2)
(relative in %
)
Correl. coeff.
HC3v4
Correl. coeff.
HC3v5
Lerwick 11302 208.6 6.7 (3.2%) 8.6 (4.1%) 64.8 (31.1%) 62.8 (30.1%) 0.941 0.946
Toravere 35768 225.2 -4.8 (-2.1%) -7.2 (-3.2%) 61.8 (27.4%) 58.6 (26.0%) 0.956 0.961
Lindenberg 13004 255.4 -12.0 (-4.7%) -10.1 (-4.0%) 59.6 (23.3%) 57.4 (22.5%) 0.965 0.968
Cabauw 39152 250.3 -10.0 (-4.0%) -7.4 (-3.0%) 58.2 (23.3%) 55.4 (22.2%) 0.966 0.969
Camborne 14372 265.9 -3.1 (-1.2%) -0.9 (-0.4%) 54.7 (20.6%) 52.8 (19.9%) 0.973 0.975
Palaiseau 33167 275.2 9.7 (3.5%) 5.4 (2.0%) 51.3 (18.6%) 47.9 (17.4%) 0.977 0.979
Payerne 29029 290.3 -23.2 (-8.0%) -2.9 (-1.0%) 67.5 (23.3%) 61.7 (21.2%) 0.969 0.971
Carpentras 42717 362.2 4.4 (1.2%) 6.1 (1.7%) 48.3 (13.3%) 45.4 (12.5%) 0.985 0.987
Cener 15131 333.4 8.6 (2.6%) 10.1 (3.0%) 57.2 (17.2%) 56.8 (17.0%) 0.978 0.979
Sede Boqer 32397 519.0 -33.6 (-6.5%) -20.3 (-3.9%) 67.6 (13.0%) 58.7 (11.3%) 0.982 0.985
Tamanrasset 42183 503.5 3.6 (0.7%) -1.2 (-0.2%) 70.8 (14.1%) 63.1 (12.5%) 0.977 0.981
Brasilia 22787 435.4 20.1 (4.6%) 12.8 (2.9%) 115.4 (26.5%) 111.4 (25.6%) 0.932 0.935
Sao Martinho da Serra 25979 399.4 -1.1 (-0.3%) -8.1 (-2.0%) 73.7 (18.4%) 70.7 (17.7%) 0.972 0.974
De Aar 3793 496.2 0.3 (0.1%) -1.5 (-0.3%) 56.8 (11.5%) 51.5 (10.4%) 0.983 0.986

Top of page

HelioClim-3 v4 and v5 -- GHI Quality assessment results vs. the BSRN stations
15 MIN IRRADIATION
Station Number of values Mean
- BSRN -
(Wh/m²)
Bias HC3v4
(Wh/m2)
(relative in %
)
Bias HC3v5
(Wh/m2)
(relative in %
)
RMSE HC3v4
(Wh/m2)
(relative in %
)
RMSE HC3v5
(Wh/m2)
(relative in %
)
Correl. coeff.
HC3v4
Correl. coeff.
HC3v5
Lerwick 44688 53.0 1.7 (3.3%) 2.2 (4.1%) 20.0 (37.7%) 19.6 (37.0%) 0.915 0.920
Toravere 141050 62.0 -1.6 (-2.6%) -2.2 (-3.6%) 21.1 (34.0%) 20.4 (33.0%) 0.930 0.935
Lindenberg 50544 65.9 -3.1 (-4.7%) -2.6 (-3.9%) 19.8 (30.0%) 19.3 (29.4%) 0.941 0.944
Cabauw 151725 64.9 -2.5 (-3.9%) -1.9 (-2.9%) 19.5 (30.0%) 19.0 (29.2%) 0.941 0.944
Camborne 55814 68.7 -0.8 (-1.1%) -0.2 (-0.3%) 18.1 (26.3%) 17.7 (25.8%) 0.954 0.956
Palaiseau 129085 70.9 2.6 (3.6%) 1.4 (2.0%) 18.1 (25.5%) 17.4 (24.6%) 0.955 0.958
Payerne 114527 76.1 -6.2 (-8.2%) -0.9 (-1.2%) 21.7 (28.5%) 20.5 (26.9%) 0.949 0.951
Carpentras 164142 94.4 1.2 (1.3%) 1.6 (1.7%) 15.8 (16.7%) 15.2 (16.1%) 0.974 0.976
Cener 57987 87.8 2.3 (2.6%) 2.7 (3.1%) 19.2 (21.8%) 19.1 (21.7%) 0.961 0.961
Sede Boqer 128603 133.1 -8.7 (-6.5%) -5.4 (-4.0%) 20.4 (15.3%) 18.6 (14.0%) 0.970 0.973
Tamanrasset 162632 133.0 0.9 (0.7%) -0.4 (-0.3%) 22.4 (16.9%) 20.8 (15.7%) 0.962 0.967
Brasilia 87251 115.1 5.4 (4.7%) 3.5 (3.0%) 38.1 (33.1%) 37.2 (32.4%) 0.882 0.885
Sao Martinho da Serra 99160 105.2 -0.2 (-0.2%) -2.1 (-2.0%) 24.9 (23.7%) 24.3 (23.1%) 0.949 0.952
De Aar 14640 129.3 0.0 (0.0%) -0.5 (-0.4%) 19.7 (15.2%) 18.7 (14.5%) 0.967 0.971

Top of page

Quality assessment results of DNI values

HelioClim-3 v4 and v5 -- DNI Quality assessment results vs. the BSRN stations
MONTHLY SUM OF 15 MIN IRRADIATION
Station Number of values Mean
- BSRN -
(kWh/m²)
Bias HC3v4
(kWh/m2)
(relative in %
)
Bias HC3v5
(kWh/m2)
(relative in %
)
RMSE HC3v4
(kWh/m2)
(relative in %
)
RMSE HC3v5
(kWh/m2)
(relative in %
)
Correl. coeff.
HC3v4
Correl. coeff.
HC3v5
Lerwick 2 82.5 10.9 (13.2%) 17.5 (21.2%) 17.6 (21.4%) 20.1 (24.3%) 1.000 1.000
Toravere 52 135.1 -9.3 (-6.9%) -13.8 (-10.2%) 24.1 (17.8%) 21.7 (16.1%) 0.860 0.898
Lindenberg 22 116.2 2.7 (2.3%) 2.0 (1.7%) 9.6 (8.2%) 10.6 (9.1%) 0.973 0.962
Cabauw 69 99.9 5.6 (5.6%) 8.3 (8.3%) 12.6 (12.6%) 11.8 (11.8%) 0.962 0.978
Camborne 25 93.3 11.6 (12.5%) 13.5 (14.5%) 16.6 (17.8%) 16.4 (17.6%) 0.964 0.969
Palaiseau 71 110.0 17.7 (16.0%) 10.6 (9.7%) 23.4 (21.3%) 13.7 (12.4%) 0.948 0.972
Payerne 44 136.0 -11.9 (-8.7%) 9.3 (6.8%) 15.4 (11.3%) 13.1 (9.7%) 0.965 0.968
Carpentras 119 154.6 -2.7 (-1.7%) -0.2 (-0.1%) 14.0 (9.1%) 9.4 (6.1%) 0.981 0.986
Cener 36 136.8 4.2 (3.1%) 4.8 (3.5%) 9.9 (7.2%) 9.4 (6.8%) 0.984 0.987
Sede Boqer 97 185.3 -29.9 (-16.1%) -20.9 (-11.3%) 32.8 (17.7%) 24.0 (12.9%) 0.965 0.975
Tamanrasset 118 181.3 21.6 (11.9%) 18.4 (10.1%) 41.8 (23.1%) 29.6 (16.3%) 0.658 0.872
Brasilia 55 139.5 12.6 (9.0%) 8.1 (5.8%) 21.7 (15.6%) 15.3 (10.9%) 0.955 0.977
Sao Martinho da Serra 39 143.1 -1.8 (-1.2%) -6.4 (-4.5%) 13.5 (9.4%) 11.4 (8.0%) 0.951 0.969
De Aar 12 235.9 -21.4 (-9.1%) -23.1 (-9.8%) 23.1 (9.8%) 24.5 (10.4%) 0.981 0.979

Top of page

HelioClim-3 v4 and v5 -- DNI Quality assessment results vs. the BSRN stations
DAILY SUM OF 15 MIN IRRADIATION
Station Number of values Mean
- BSRN -
(Wh/m²)
Bias HC3v4
(Wh/m2)
(relative in %
)
Bias HC3v5
(Wh/m2)
(relative in %
)
RMSE HC3v4
(Wh/m2)
(relative in %
)
RMSE HC3v5
(Wh/m2)
(relative in %
)
Correl. coeff.
HC3v4
Correl. coeff.
HC3v5
Lerwick 251 4243.9 393.1 (9.3%) 724.7 (17.1%) 1507.9 (35.5%) 1565.6 (36.9%) 0.843 0.856
Toravere 1155 6385.8 -874.4 (-13.7%) -915.8 (-14.3%) 1840.4 (28.8%) 1555.6 (24.4%) 0.845 0.900
Lindenberg 514 5214.5 -228.5 (-4.4%) -155.7 (-3.0%) 1299.2 (24.9%) 1096.1 (21.0%) 0.873 0.908
Cabauw 1522 4633.1 40.0 (0.9%) 202.7 (4.4%) 1164.8 (25.1%) 991.8 (21.4%) 0.889 0.924
Camborne 490 4929.6 220.6 (4.5%) 419.3 (8.5%) 1195.3 (24.2%) 1067.5 (21.7%) 0.905 0.932
Palaiseau 1639 5002.9 439.9 (8.8%) 271.2 (5.4%) 1345.5 (26.9%) 984.7 (19.7%) 0.876 0.929
Payerne 1095 6123.0 -773.7 (-12.6%) 274.5 (4.5%) 1467.8 (24.0%) 1131.9 (18.5%) 0.876 0.908
Carpentras 2690 6601.1 -218.6 (-3.3%) -102.8 (-1.6%) 1331.4 (20.2%) 1013.0 (15.3%) 0.860 0.926
Cener 808 5991.6 21.0 (0.4%) 81.7 (1.4%) 1275.5 (21.3%) 1100.4 (18.4%) 0.886 0.925
Sede Boqer 2646 6668.4 -1105.5 (-16.6%) -785.1 (-11.8%) 1703.4 (25.5%) 1281.6 (19.2%) 0.811 0.892
Tamanrasset 2959 6766.7 577.7 (8.5%) 538.3 (8.0%) 2111.9 (31.2%) 1624.0 (24.0%) 0.559 0.808
Brasilia 1312 5675.5 383.3 (6.8%) 241.3 (4.3%) 1365.9 (24.1%) 1159.6 (20.4%) 0.823 0.870
Sao Martinho da Serra 977 6566.3 -137.2 (-2.1%) -281.2 (-4.3%) 1372.4 (20.9%) 1134.2 (17.3%) 0.857 0.923
De Aar 327 8427.7 -860.1 (-10.2%) -889.6 (-10.6%) 1520.2 (18.0%) 1317.9 (15.6%) 0.906 0.939

Top of page

HelioClim-3 v4 and v5 -- DNI Quality assessment results vs. the BSRN stations
HOURLY SUM OF 15 MIN IRRADIATION
Station Number of values Mean
- BSRN -
(Wh/m²)
Bias HC3v4
(Wh/m2)
(relative in %
)
Bias HC3v5
(Wh/m2)
(relative in %
)
RMSE HC3v4
(Wh/m2)
(relative in %
)
RMSE HC3v5
(Wh/m2)
(relative in %
)
Correl. coeff.
HC3v4
Correl. coeff.
HC3v5
Lerwick 4525 319.5 54.4 (17.0%) 74.9 (23.4%) 200.9 (62.9%) 208.3 (65.2%) 0.711 0.730
Toravere 19538 458.1 -56.6 (-12.4%) -64.8 (-14.1%) 197.6 (43.1%) 182.5 (39.8%) 0.781 0.826
Lindenberg 7535 398.7 -13.4 (-3.4%) -6.8 (-1.7%) 160.9 (40.3%) 155.9 (39.1%) 0.819 0.840
Cabauw 22284 361.6 8.6 (2.4%) 20.3 (5.6%) 150.8 (41.7%) 149.9 (41.5%) 0.829 0.849
Camborne 7310 375.6 29.1 (7.7%) 42.9 (11.4%) 156.7 (41.7%) 156.3 (41.6%) 0.837 0.855
Palaiseau 23171 393.8 44.9 (11.4%) 31.0 (7.9%) 162.4 (41.2%) 147.6 (37.5%) 0.831 0.859
Payerne 15907 484.9 -61.5 (-12.7%) 22.4 (4.6%) 171.3 (35.3%) 161.7 (33.4%) 0.842 0.862
Carpentras 33216 551.8 -11.8 (-2.1%) -1.9 (-0.3%) 158.1 (28.6%) 147.9 (26.8%) 0.840 0.867
Cener 10769 484.1 11.3 (2.3%) 16.8 (3.5%) 161.5 (33.4%) 159.6 (33.0%) 0.851 0.860
Sede Boqer 29295 606.7 -93.4 (-15.4%) -62.6 (-10.3%) 196.0 (32.3%) 172.2 (28.4%) 0.818 0.855
Tamanrasset 36358 584.5 66.6 (11.4%) 56.2 (9.6%) 228.8 (39.1%) 195.3 (33.4%) 0.747 0.827
Brasilia 16496 483.1 42.4 (8.8%) 27.0 (5.6%) 205.4 (42.5%) 192.4 (39.8%) 0.772 0.799
Sao Martinho da Serra 12428 543.8 -4.5 (-0.8%) -19.1 (-3.5%) 195.1 (35.9%) 184.9 (34.0%) 0.809 0.834
De Aar 3887 718.2 -65.4 (-9.1%) -69.3 (-9.6%) 169.6 (23.6%) 159.4 (22.2%) 0.863 0.889

Top of page

HelioClim-3 v4 and v5 -- DNI Quality assessment results vs. the BSRN stations
15 MIN IRRADIATION
Station Number of values Mean
- BSRN -
(Wh/m²)
Bias HC3v4
(Wh/m2)
(relative in %
)
Bias HC3v5
(Wh/m2)
(relative in %
)
RMSE HC3v4
(Wh/m2)
(relative in %
)
RMSE HC3v5
(Wh/m2)
(relative in %
)
Correl. coeff.
HC3v4
Correl. coeff.
HC3v5
Lerwick 19410 77.1 15.5 (20.2%) 20.3 (26.3%) 59.6 (77.4%) 61.4 (79.6%) 0.647 0.665
Toravere 83697 116.0 -12.8 (-11.1%) -15.2 (-13.1%) 58.1 (50.0%) 54.7 (47.2%) 0.724 0.766
Lindenberg 30696 99.5 -2.6 (-2.6%) -1.1 (-1.1%) 48.0 (48.3%) 47.1 (47.3%) 0.765 0.785
Cabauw 90858 90.6 3.1 (3.4%) 5.9 (6.5%) 45.9 (50.7%) 45.9 (50.7%) 0.772 0.792
Camborne 29696 94.1 8.7 (9.3%) 12.0 (12.8%) 47.6 (50.6%) 47.5 (50.5%) 0.782 0.800
Palaiseau 94612 98.3 12.6 (12.8%) 8.8 (9.0%) 48.6 (49.5%) 45.4 (46.1%) 0.778 0.805
Payerne 67250 120.8 -14.8 (-12.2%) 6.2 (5.1%) 50.5 (41.8%) 49.2 (40.7%) 0.792 0.812
Carpentras 132433 139.8 -2.3 (-1.6%) -0.1 (-0.1%) 45.7 (32.7%) 43.7 (31.3%) 0.791 0.820
Cener 43047 123.2 4.2 (3.4%) 5.4 (4.4%) 48.6 (39.4%) 48.4 (39.3%) 0.795 0.803
Sede Boqer 118273 155.4 -25.0 (-16.1%) -17.4 (-11.2%) 55.0 (35.4%) 50.0 (32.2%) 0.761 0.801
Tamanrasset 143909 151.2 18.9 (12.5%) 15.6 (10.3%) 63.4 (41.9%) 55.1 (36.4%) 0.681 0.774
Brasilia 65398 125.0 12.2 (9.8%) 7.9 (6.3%) 63.4 (50.7%) 60.3 (48.3%) 0.674 0.704
Sao Martinho da Serra 48470 141.5 -0.4 (-0.3%) -4.5 (-3.2%) 58.0 (41.0%) 55.7 (39.4%) 0.736 0.763
De Aar 15102 187.4 -17.0 (-9.1%) -18.4 (-9.8%) 56.8 (30.3%) 55.0 (29.4%) 0.724 0.758

Top of page