Statistics of validation of HelioClim-3 versus ground stations - 31 Brazil INMET stations

Last update: Jan. 2016

    Generalities - BSRN - Belgium - Brazil INMET - Brazil INPE

Protocol

Date & Authors: Jan. 2016

  • Dr Etienne Wey, Transvalor
  • Pr Lucien Wald, MINES ParisTech
  • Dr Philippe Blanc, MINES ParisTech
  • and Dr Claire Thomas, Transvalor

(A publication is on the way)

The HelioClim-3 radiation values are compared to the hourly Global Horizontal Irradiation measurements from the 31 stations of the INMET network.
The measurements, also named observations, were originally quality checked using the procedure described here. As only the GHI component is available in the observations for both datasets, no consistency check is possible via cross-comparison from one component to another. Unfortunately, this protocol turned out to be insufficient for these hourly measurements and that the test to discard the not plausible values ("Extremely Rare Limits" and "Physical Possible Limits") were too permissive; Too many outlyers remained after the QC. Prior the computation of the different quantities to assess the deviation between the satellite estimates and the station measurements as depicted in the protocol of validation, we decided to discard also the measurement values when they are:

  • below 5% * clear sky dry, which corresponds to the ESRA clear sky with no turbidity
  • above 100% * clear sky dry

We remind that the other steps are:

  • Set night, sunrise and sunset observation values to zero
  • Set satellite values to Not a Number ("NaN"), when the observation is missing.
  • Set observation values below 10 W/m² to zero
  • As soon as the quality check procedure is over, then aggregate the hourly values to generate partial daily and monthly sums as depicted in the protocol of validation.

Illustration: list of the INMET and INPE stations used for the validation


 

List of the 31 stations

Station State Latitude (°) Longitude (°) Altitude (m) Period of data availability
Agua-Clara MS -20.444 -52.876 338 2010-08-16 to 2014-12-31
Aquidauana MS -20.475 -55.784 155 2006-11-01 to 2014-12-31
Ararangua SC -28.931 -49.498 12 2008-09-29 to 2014-12-31
Bataguassu MS -21.750 -52.471 387 2013-04-09 to 2014-12-31
Cacoal RO -11.446 -61.434 210 2008-07-20 to 2014-12-31
Campo-Bom RS -29.674 -51.064 24 2013-12-02 to 2014-12-31
Canela RS -29.369 -50.827 830 2008-08-27 to 2014-12-31
Cidade-Gaucha PR -23.359 -52.932 381 2008-03-11 to 2014-12-31
Clevelandia PR -26.417 -52.349 980 2008-05-16 to 2014-12-31
Corumba MS -18.997 -57.638 126 2006-10-26 to 2014-12-31
Costa-Rica MS -18.493 -53.171 730 2012-12-06 to 2014-12-31
Curitibanos SC -27.289 -50.604 982 2008-02-29 to 2014-12-31
Dionisio-Cerqueira SC -26.287 -53.633 810 2008-05-31 to 2014-12-31
Dom-Pedrito RS -30.992 -54.815 170 2010-04-27 to 2014-12-31
Dourados MS -22.194 -54.911 469 2006-10-21 to 2014-12-31
Fos-do-Iguacu PR -25.602 -54.483 321 2008-02-15 to 2014-12-31
Ibiruba RS -28.653 -53.112 456 2012-12-12 to 2014-12-31
Jardim MS -21.479 -56.138 249 2011-08-09 to 2014-12-31
Joacaba SC -27.169 -51.559 776 2007-10-16 to 2014-12-31
Joaquim-Tavora PR -23.505 -49.946 522 2006-11-24 to 2014-12-31
Major-Vieira SC -26.394 -50.363 808 2009-02-10 to 2014-12-31
Maringa PR -23.405 -51.933 542 2006-11-21 to 2014-12-31
Nova-Tebas PR -24.437 -51.963 654 2006-12-21 to 2014-12-31
Porto-Velho RO -8.794 -63.846 95 2007-07-12 to 2014-12-31
Santiago RS -29.192 -54.886 394 2009-02-04 to 2014-12-31
Sonora MS -17.635 -54.760 495 2012-12-03 to 2014-12-31
Teutonia RS -29.450 -51.824 81 2012-08-08 to 2014-12-31
Uruguaiana RS -29.840 -57.082 62 2006-09-28 to 2014-12-31
Ventania PR -24.280 -50.210 1106 2011-04-18 to 2014-12-31
Vilhena RO -12.735 -60.158 590 2008-08-26 to 2014-12-31
Xanxere SC -26.939 -52.398 889 2008-03-16 to 2014-12-31

 

Quality assessment results of GHI values

HelioClim-3 v4 and v5 -- GHI Quality assessment results vs. the INMET stations in Brazil
MONTHLY SUM OF HOURLY IRRADIATION
Station Number of values Mean
- INMET Station -
(kWh/m²)
Bias HC3v4
(kWh/m2)
(relative in %
)
Bias HC3v5
(kWh/m2)
(relative in %
)
RMSE HC3v4
(kWh/m2)
(relative in %
)
RMSE HC3v5
(kWh/m2)
(relative in %
)
Correl. coeff.
HC3v4
Correl. coeff.
HC3v5
Agua-Clara (MS) 35 152.8 3.0 (2.0%) 2.4 (1.6%) 5.1 (3.4%) 3.6 (2.3%) 0.985 0.994
Aquidauana (MS) 88 148.6 1.6 (1.1%) 3.0 (2.0%) 4.4 (2.9%) 4.2 (2.8%) 0.988 0.994
Ararangua (SC) 63 123.6 8.3 (6.8%) 1.9 (1.5%) 11.6 (9.4%) 3.1 (2.5%) 0.991 0.998
Bataguassu (MS) 14 153.5 -0.8 (-0.5%) -2.2 (-1.4%) 2.9 (1.9%) 3.2 (2.1%) 0.997 0.997
Cacoal (RO) 70 130.5 11.5 (8.8%) 4.8 (3.7%) 13.5 (10.3%) 7.9 (6.1%) 0.968 0.973
Campo-Bom (RS) 6 149.5 7.7 (5.2%) -1.2 (-0.8%) 8.3 (5.5%) 4.1 (2.8%) 1.000 0.999
Canela (RS) 69 130.2 7.3 (5.6%) 1.9 (1.5%) 9.8 (7.5%) 3.3 (2.5%) 0.996 0.998
Cidade-Gaucha (PR) 66 146.3 3.3 (2.3%) -1.2 (-0.8%) 5.1 (3.5%) 3.1 (2.1%) 0.995 0.997
Clevelandia (PR) 73 138.2 9.7 (7.0%) 4.0 (2.9%) 12.7 (9.2%) 5.2 (3.7%) 0.992 0.997
Corumba (MS) 85 148.5 3.6 (2.4%) 3.7 (2.5%) 7.0 (4.7%) 5.4 (3.7%) 0.968 0.987
Costa-Rica (MS) 18 147.9 -1.0 (-0.7%) 3.7 (2.5%) 4.3 (2.9%) 5.9 (4.0%) 0.958 0.965
Curitibanos (SC) 76 131.4 7.3 (5.5%) 2.1 (1.6%) 9.7 (7.4%) 4.0 (3.1%) 0.993 0.997
Dionisio-Cerqueira (SC) 60 143.5 4.8 (3.3%) 0.6 (0.4%) 8.3 (5.8%) 2.8 (2.0%) 0.993 0.998
Dom-Pedrito (RS) 50 142.2 -3.8 (-2.7%) -5.8 (-4.1%) 4.7 (3.3%) 6.8 (4.8%) 0.999 1.000
Dourados (MS) 86 148.8 3.2 (2.2%) 2.4 (1.6%) 5.8 (3.9%) 4.7 (3.2%) 0.987 0.991
Fos-do-Iguacu (PR) 69 139.3 -0.1 (-0.1%) -3.3 (-2.4%) 3.9 (2.8%) 5.6 (4.0%) 0.996 0.997
Ibiruba (RS) 10 140.7 3.5 (2.5%) -1.5 (-1.1%) 6.7 (4.8%) 3.8 (2.7%) 0.997 0.995
Jardim (MS) 33 153.3 3.3 (2.1%) 3.0 (1.9%) 5.3 (3.5%) 4.9 (3.2%) 0.994 0.995
Joacaba (SC) 79 139.2 9.5 (6.8%) 3.8 (2.8%) 12.1 (8.7%) 4.8 (3.5%) 0.994 0.997
Joaquim-Tavora (PR) 91 147.4 8.6 (5.9%) 1.6 (1.1%) 10.7 (7.3%) 3.9 (2.6%) 0.989 0.995
Major-Vieira (SC) 61 116.4 13.7 (11.8%) 4.9 (4.2%) 16.1 (13.9%) 5.6 (4.8%) 0.991 0.997
Maringa (PR) 67 152.9 1.4 (0.9%) -4.2 (-2.7%) 6.4 (4.2%) 5.8 (3.8%) 0.985 0.991
Nova-Tebas (PR) 85 147.1 1.0 (0.6%) -4.1 (-2.8%) 7.5 (5.1%) 7.8 (5.3%) 0.981 0.986
Porto-Velho (RO) 72 122.7 16.6 (13.6%) 9.8 (8.0%) 18.3 (14.9%) 12.2 (10.0%) 0.959 0.948
Santiago (RS) 61 144.1 -2.5 (-1.7%) -4.3 (-3.0%) 4.3 (3.0%) 5.8 (4.0%) 0.998 0.998
Sonora (MS) 18 141.5 -3.2 (-2.2%) 1.7 (1.2%) 4.4 (3.1%) 4.9 (3.5%) 0.986 0.987
Teutonia (RS) 5 139.5 7.0 (5.0%) 0.1 (0.1%) 8.0 (5.7%) 2.7 (1.9%) 1.000 0.999
Uruguaiana (RS) 86 148.4 -4.1 (-2.8%) -5.4 (-3.6%) 5.4 (3.7%) 6.4 (4.3%) 0.998 0.999
Ventania (PR) 23 148.6 12.7 (8.6%) 6.1 (4.1%) 15.1 (10.2%) 7.1 (4.8%) 0.987 0.994
Vilhena (RO) 69 127.7 10.7 (8.4%) 7.9 (6.2%) 11.9 (9.3%) 9.7 (7.6%) 0.976 0.981
Xanxere (SC) 68 142.1 3.1 (2.2%) -0.1 (-0.1%) 6.8 (4.8%) 3.3 (2.3%) 0.994 0.997

Top of page

HelioClim-3 v4 and v5 -- GHI Quality assessment results vs. the INMET stations in Brazil
DAILY SUM OF HOURLY IRRADIATION
Station Number of values Mean
- INMET Station -
(Wh/m²)
Bias HC3v4
(Wh/m2)
(relative in %
)
Bias HC3v5
(Wh/m2)
(relative in %
)
RMSE HC3v4
(Wh/m2)
(relative in %
)
RMSE HC3v5
(Wh/m2)
(relative in %
)
Correl. coeff.
HC3v4
Correl. coeff.
HC3v5
Agua-Clara (MS) 1035 5345.0 90.6 (1.7%) 68.6 (1.3%) 443.7 (8.3%) 439.2 (8.2%) 0.962 0.966
Aquidauana (MS) 2476 5304.3 58.0 (1.1%) 106.2 (2.0%) 425.2 (8.0%) 412.6 (7.8%) 0.966 0.973
Ararangua (SC) 1752 4449.6 300.8 (6.8%) 67.7 (1.5%) 521.6 (11.7%) 315.3 (7.1%) 0.979 0.988
Bataguassu (MS) 393 5453.6 -28.4 (-0.5%) -79.3 (-1.5%) 384.6 (7.1%) 352.8 (6.5%) 0.975 0.980
Cacoal (RO) 1888 4807.7 426.7 (8.9%) 179.1 (3.7%) 717.6 (14.9%) 593.9 (12.4%) 0.879 0.881
Campo-Bom (RS) 164 5460.3 282.3 (5.2%) -43.2 (-0.8%) 477.0 (8.7%) 352.1 (6.4%) 0.986 0.988
Canela (RS) 1828 4950.4 276.7 (5.6%) 74.2 (1.5%) 541.8 (10.9%) 400.2 (8.1%) 0.975 0.984
Cidade-Gaucha (PR) 1902 5127.5 116.0 (2.3%) -40.8 (-0.8%) 359.5 (7.0%) 307.6 (6.0%) 0.983 0.986
Clevelandia (PR) 1991 5056.9 353.8 (7.0%) 147.5 (2.9%) 590.3 (11.7%) 390.9 (7.7%) 0.968 0.981
Corumba (MS) 2356 5350.4 131.7 (2.5%) 135.7 (2.5%) 514.0 (9.6%) 467.3 (8.7%) 0.942 0.957
Costa-Rica (MS) 500 5305.8 -37.0 (-0.7%) 132.6 (2.5%) 489.3 (9.2%) 528.1 (10.0%) 0.929 0.934
Curitibanos (SC) 2118 4714.4 260.1 (5.5%) 75.7 (1.6%) 513.2 (10.9%) 379.0 (8.0%) 0.972 0.980
Dionisio-Cerqueira (SC) 1740 5110.2 167.0 (3.3%) 20.7 (0.4%) 496.3 (9.7%) 374.6 (7.3%) 0.973 0.983
Dom-Pedrito (RS) 1373 5146.0 -136.6 (-2.7%) -210.4 (-4.1%) 357.0 (6.9%) 354.9 (6.9%) 0.991 0.994
Dourados (MS) 2473 5202.8 113.3 (2.2%) 82.5 (1.6%) 455.5 (8.8%) 420.4 (8.1%) 0.969 0.975
Fos-do-Iguacu (PR) 1945 5038.6 -4.6 (-0.1%) -122.3 (-2.4%) 379.8 (7.5%) 375.2 (7.4%) 0.984 0.987
Ibiruba (RS) 307 5770.6 110.1 (1.9%) -37.5 (-0.6%) 648.0 (11.2%) 605.3 (10.5%) 0.957 0.960
Jardim (MS) 938 5430.4 116.5 (2.1%) 105.0 (1.9%) 436.4 (8.0%) 415.4 (7.6%) 0.970 0.976
Joacaba (SC) 2253 4877.0 331.4 (6.8%) 134.5 (2.8%) 548.3 (11.2%) 361.1 (7.4%) 0.978 0.986
Joaquim-Tavora (PR) 2658 5040.5 295.3 (5.9%) 55.4 (1.1%) 499.3 (9.9%) 349.3 (6.9%) 0.975 0.980
Major-Vieira (SC) 1606 4448.6 524.6 (11.8%) 186.7 (4.2%) 692.6 (15.6%) 386.1 (8.7%) 0.967 0.982
Maringa (PR) 1943 5267.6 49.1 (0.9%) -144.5 (-2.7%) 474.4 (9.0%) 433.9 (8.2%) 0.965 0.973
Nova-Tebas (PR) 2420 5238.9 31.3 (0.6%) -149.8 (-2.9%) 480.1 (9.2%) 459.6 (8.8%) 0.968 0.974
Porto-Velho (RO) 1896 4642.4 626.3 (13.5%) 368.4 (7.9%) 887.2 (19.1%) 720.7 (15.5%) 0.875 0.874
Santiago (RS) 1730 5128.8 -89.3 (-1.7%) -153.5 (-3.0%) 374.9 (7.3%) 356.6 (7.0%) 0.987 0.991
Sonora (MS) 475 5355.4 -119.3 (-2.2%) 67.1 (1.3%) 490.0 (9.1%) 512.9 (9.6%) 0.937 0.937
Teutonia (RS) 272 4958.8 405.4 (8.2%) 184.3 (3.7%) 822.5 (16.6%) 690.0 (13.9%) 0.945 0.945
Uruguaiana (RS) 2430 5277.0 -144.3 (-2.7%) -191.0 (-3.6%) 411.8 (7.8%) 373.7 (7.1%) 0.987 0.991
Ventania (PR) 661 5180.7 443.0 (8.6%) 214.6 (4.1%) 654.4 (12.6%) 431.3 (8.3%) 0.962 0.977
Vilhena (RO) 1852 4754.5 397.0 (8.3%) 294.1 (6.2%) 680.0 (14.3%) 621.8 (13.1%) 0.890 0.899
Xanxere (SC) 1926 5069.8 120.7 (2.4%) 2.0 (0.0%) 476.5 (9.4%) 395.8 (7.8%) 0.974 0.981

Top of page

HelioClim-3 v4 and v5 -- GHI Quality assessment results vs. the INMET stations in Brazil
HOURLY IRRADIATION
Station Number of values Mean
- INMET Station -
(Wh/m²)
Bias HC3v4
(Wh/m2)
(relative in %
)
Bias HC3v5
(Wh/m2)
(relative in %
)
RMSE HC3v4
(Wh/m2)
(relative in %
)
RMSE HC3v5
(Wh/m2)
(relative in %
)
Correl. coeff.
HC3v4
Correl. coeff.
HC3v5
Agua-Clara (MS) 12305 463.9 8.4 (1.8%) 6.6 (1.4%) 102.2 (22.0%) 101.1 (21.8%) 0.947 0.949
Aquidauana (MS) 28434 463.5 5.1 (1.1%) 9.3 (2.0%) 93.0 (20.1%) 92.0 (19.9%) 0.956 0.959
Ararangua (SC) 20607 381.7 26.3 (6.9%) 6.1 (1.6%) 84.0 (22.0%) 72.5 (19.0%) 0.965 0.969
Bataguassu (MS) 4562 471.2 -2.3 (-0.5%) -6.8 (-1.4%) 81.7 (17.3%) 79.1 (16.8%) 0.964 0.967
Cacoal (RO) 22106 415.8 36.8 (8.9%) 15.5 (3.7%) 142.6 (34.3%) 132.8 (31.9%) 0.898 0.900
Campo-Bom (RS) 2037 440.5 22.8 (5.2%) -3.5 (-0.8%) 86.8 (19.7%) 78.9 (17.9%) 0.967 0.969
Canela (RS) 21314 425.1 23.7 (5.6%) 6.4 (1.5%) 91.2 (21.5%) 83.4 (19.6%) 0.958 0.961
Cidade-Gaucha (PR) 21972 444.3 10.1 (2.3%) -3.5 (-0.8%) 78.6 (17.7%) 74.7 (16.8%) 0.967 0.969
Clevelandia (PR) 23248 434.1 30.4 (7.0%) 12.7 (2.9%) 93.9 (21.6%) 82.7 (19.0%) 0.957 0.961
Corumba (MS) 27045 473.9 12.0 (2.5%) 12.3 (2.6%) 103.9 (21.9%) 100.7 (21.2%) 0.946 0.951
Costa-Rica (MS) 5712 466.1 -3.2 (-0.7%) 11.7 (2.5%) 113.3 (24.3%) 116.0 (24.9%) 0.930 0.931
Curitibanos (SC) 24616 405.7 22.4 (5.5%) 6.5 (1.6%) 90.7 (22.4%) 83.8 (20.6%) 0.955 0.958
Dionisio-Cerqueira (SC) 20124 442.6 14.5 (3.3%) 1.9 (0.4%) 92.8 (21.0%) 85.7 (19.4%) 0.955 0.959
Dom-Pedrito (RS) 15765 451.0 -12.0 (-2.7%) -18.5 (-4.1%) 64.0 (14.2%) 62.5 (13.8%) 0.979 0.981
Dourados (MS) 28524 452.6 9.8 (2.2%) 7.2 (1.6%) 95.9 (21.2%) 93.3 (20.6%) 0.953 0.956
Fos-do-Iguacu (PR) 22009 452.4 -0.3 (-0.1%) -10.7 (-2.4%) 82.0 (18.1%) 79.9 (17.7%) 0.965 0.967
Ibiruba (RS) 3653 493.0 9.0 (1.8%) -2.9 (-0.6%) 114.7 (23.3%) 110.5 (22.4%) 0.935 0.938
Jardim (MS) 10837 470.2 10.1 (2.1%) 9.1 (1.9%) 93.7 (19.9%) 91.8 (19.5%) 0.957 0.960
Joacaba (SC) 26362 417.3 28.3 (6.8%) 11.5 (2.8%) 88.2 (21.1%) 78.0 (18.7%) 0.963 0.967
Joaquim-Tavora (PR) 31140 430.7 25.2 (5.9%) 4.7 (1.1%) 85.1 (19.8%) 76.0 (17.6%) 0.965 0.967
Major-Vieira (SC) 18658 383.5 45.2 (11.8%) 16.1 (4.2%) 96.5 (25.1%) 79.5 (20.7%) 0.957 0.961
Maringa (PR) 22577 453.7 4.3 (0.9%) -12.4 (-2.7%) 95.8 (21.1%) 92.2 (20.3%) 0.951 0.954
Nova-Tebas (PR) 27930 454.6 2.8 (0.6%) -12.9 (-2.8%) 92.7 (20.4%) 89.8 (19.7%) 0.954 0.957
Porto-Velho (RO) 21725 415.4 55.8 (13.4%) 32.9 (7.9%) 161.9 (39.0%) 149.5 (36.0%) 0.881 0.882
Santiago (RS) 19827 449.4 -7.8 (-1.7%) -13.4 (-3.0%) 71.6 (15.9%) 69.1 (15.4%) 0.974 0.976
Sonora (MS) 5430 469.2 -10.5 (-2.2%) 5.8 (1.2%) 122.2 (26.0%) 124.7 (26.6%) 0.919 0.921
Teutonia (RS) 3177 433.7 34.7 (8.0%) 16.0 (3.7%) 133.4 (30.8%) 125.8 (29.0%) 0.912 0.913
Uruguaiana (RS) 27839 462.5 -12.6 (-2.7%) -16.8 (-3.6%) 72.7 (15.7%) 69.1 (14.9%) 0.974 0.977
Ventania (PR) 7803 438.9 37.5 (8.6%) 18.2 (4.1%) 99.3 (22.6%) 86.6 (19.7%) 0.954 0.959
Vilhena (RO) 21838 404.8 33.8 (8.3%) 25.0 (6.2%) 137.1 (33.9%) 132.8 (32.8%) 0.903 0.905
Xanxere (SC) 22384 438.0 10.9 (2.5%) 0.7 (0.2%) 94.8 (21.6%) 90.4 (20.6%) 0.952 0.954

Top of page