TOA testing

test_modtran_parameters.cpp benchmarking

Report generated by:

   void UVEG::DEBUG::markdown_tools::print_markdown(const string&, std::ostream&) const // "markdown_tools.cpp" 358

Machine environment

---[GENERAL]--------------------------------------------
             Hostname: leo02
 Number of processors: 72
              Machine: x86_64
              Sysname: Linux
           OS Release: 3.10.0-957.1.3.el7.x86_64
             Nodename: leo02
              Version: #1 SMP Thu Nov 29 14:49:43 UTC 2018
---[HARDWARE]----------------------------------------------
                Loads: 50.8,32.1,13.6
            Total Ram: 252 GB.
             Free Ram: 43.8 GB.
            Total Ram: 252 GB.
           Shared Ram: 0 KB.
         Buffered Ram: 153 MB.
           Total Swap: 2 GB.
            Free Swap: 153 MB.
---[SOFTWARE]--------------------------------------------
                 Date: Friday, 17 July 2020
          Software Id: $Id: d2e580c190da31c55ddf430aa182c7a2a164a4c9 $
User software version: V2.0_pre_development
          Institution: (UVEG) Universitat de Valencia-Estudi General/(CSIC) IFIC
        Software name: SGM C++ program V2.0 or above
             Comments: File generated by SGM software (c) 2020
--------------------------------------------------------

Timing benchmark

Name Time Loops Speed (iters/s)
do_corine: Loading full Earth corrine class map 0.35 secs. s. 6.9e+05 2e+06
test_dem: Loading full global earth DEM in a reduced image 11 secs. s. 6.9e+05 6.4e+04
do_dem: Loading full global earth DEM in a reduced image 10 secs. s. 6.9e+05 6.8e+04
First pass 1.9 mins. s. - -
Second pass 1.9 mins. s. 6.9e+05 5.9e+03

Long test reports

Corine class test

This tests shows the current CORINE configuration.

Corine reflectances

Corine class handler evaluation

This test is a geometrical TEST about the corine map handling

Corine CLASS MAP projected.

False color corine class map

Corine MAP region file used.

Corine map region used for this plot

Lambda resampling test

This test is aimed to check the LUT resampling algorithm some plots are included.

Spectral comparation by wavelength

Atmosphere resampled

Spectral comparation by channel

Before resampling (channel)

Spectral comparation by channel

Before resampling (channel)

Spectral comparation by channel

Before resampling (channel)

Spectral comparation by channel

Before resampling (channel)

Spectral comparation by channel

Before resampling (channel)

Spectral comparation by channel

Before resampling (channel)

Spectral shape [Lp0] before and latter resampling

Before resampling 1 nm

Spectral shape [Edir0] before and latter resampling

Before resampling 1 nm

Spectral shape [Edif0] before and latter resampling

Before resampling 1 nm

Spectral shape [S] before and latter resampling

Before resampling 1 nm

Spectral shape [tdir] before and latter resampling

Before resampling 1 nm

Spectral shape [tdif] before and latter resampling

Before resampling 1 nm

Dem colormaps

This test is aimed check several included data related with DEM calculation. Including order in execution and outputs of the full DEM.

Block execution order of this calculation

TBB parallel block execution order Colormap relief16_colormap.png

Colormap testing Colormap poster_colormap.png

Colormap testing Colormap spiral_colormap.png

Colormap testing Colormap textbook_colormap.png

Colormap testing Colormap natural_colormap.png

Colormap testing Colormap neutral.png

Colormap testing

Precalculated TOA, max, min, mean median

This tests shows the current CORINE configuration.

TOA statistics

All files required for this test

This test is aimed check auditing facilities included in the program.

"/media/FLEXE01/auxiliary/DEM/00N000E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/00N015E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/00N015W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/00N030E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/00N030W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/00N045E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/00N045W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/00N060E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/00N060W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/00N075E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/00N075W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/00N090E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/00N090W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/00N105E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/00N105W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/00N120E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/00N120W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/00N135E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/00N135W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/00N150E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/00N150W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/00N165E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/00N165W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/00N180W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/15N000E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/15N015E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/15N015W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/15N030E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/15N030W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/15N045E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/15N045W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/15N060E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/15N060W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/15N075E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/15N075W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/15N090E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/15N090W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/15N105E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/15N105W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/15N120E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/15N120W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/15N135E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/15N135W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/15N150E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/15N150W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/15N165E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/15N165W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/15N180W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/15S000E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/15S015E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/15S015W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/15S030E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/15S030W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/15S045E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/15S045W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/15S060E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/15S060W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/15S075E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/15S075W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/15S090E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/15S090W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/15S105E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/15S105W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/15S120E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/15S120W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/15S135E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/15S135W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/15S150E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/15S150W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/15S165E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/15S165W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/15S180W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/30N000E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/30N015E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/30N015W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/30N030E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/30N030W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/30N045E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/30N045W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/30N060E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/30N060W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/30N075E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/30N075W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/30N090E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/30N090W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/30N105E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/30N105W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/30N120E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/30N120W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/30N135E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/30N135W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/30N150E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/30N150W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/30N165E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/30N165W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/30N180W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/30S000E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/30S015E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/30S015W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/30S030E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/30S030W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/30S045E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/30S045W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/30S060E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/30S060W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/30S075E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/30S075W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/30S090E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/30S090W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/30S105E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/30S105W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/30S120E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/30S120W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/30S135E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/30S135W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/30S150E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/30S150W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/30S165E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/30S165W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/30S180W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/45N000E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/45N015E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/45N015W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/45N030E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/45N030W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/45N045E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/45N045W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/45N060E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/45N060W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/45N075E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/45N075W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/45N090E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/45N090W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/45N105E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/45N105W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/45N120E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/45N120W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/45N135E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/45N135W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/45N150E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/45N150W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/45N165E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/45N165W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/45N180W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/45S000E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/45S015E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/45S015W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/45S030E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/45S030W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/45S045E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/45S045W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/45S060E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/45S060W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/45S075E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/45S075W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/45S090E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/45S090W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/45S105E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/45S105W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/45S120E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/45S120W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/45S135E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/45S135W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/45S150E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/45S150W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/45S165E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/45S165W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/45S180W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/60S000E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/60S015E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/60S015W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/60S030E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/60S030W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/60S045E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/60S045W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/60S060E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/60S060W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/60S075E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/60S075W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/60S090E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/60S090W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/60S105E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/60S105W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/60S120E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/60S120W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/60S135E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/60S135W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/60S150E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/60S150W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/60S165E.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/60S165W.GETASSE30"
"/media/FLEXE01/auxiliary/DEM/60S180W.GETASSE30"
"/usr/local/flexe/current/auxiliary/SGM/DB_BIO_USER/Corine_spectral_library.csv"
"/usr/local/flexe/current/auxiliary/SGM/LCC_CORINE/africasia.nc"
"/usr/local/flexe/current/auxiliary/SGM/LCC_CORINE/africasiaext.nc"
"/usr/local/flexe/current/auxiliary/SGM/LCC_CORINE/america.nc"
"/usr/local/flexe/current/auxiliary/SGM/LCC_CORINE/europe.nc"
"/usr/local/flexe/current/auxiliary/SGM/LCC_CORINE/europext.nc"
"/usr/local/flexe/current/auxiliary/SGM/LCC_CORINE/norte.nc"
"/usr/local/flexe/current/auxiliary/SGM/METEO//ECMWF/CWV_int_h_vM.mat"
"/usr/local/flexe/current/auxiliary/SGM/METEO//ECMWF/DATOS_AOT_CWV_O_GEOP/Month7_CWV_O3_AOT_GEOP.cdf"
"/usr/local/flexe/current/auxiliary/SGM/METEO//ECMWF/METEO_range.mat"
"/usr/local/flexe/current/auxiliary/SGM/METEO//ECMWF/O2_int_h.mat"
"/usr/local/flexe/current/auxiliary/SGM/METEO//ECMWF/O3_int_h.mat"

Probe list used for this test

Probe list used for this test

do_corine: Loading full Earth corrine class map

Perform full earth maping of Corine classes

Time used:0.35 secs.

   void UVEG::TOA_TEST::do_corine(UVEG::TOA_TEST::markdown_tools&) // "toa_test.cpp" 136

test_dem: Loading full global earth DEM in a reduced image

Generating a full random DB size: 1024

Time used:11 secs.

   void UVEG::TOA_TEST::test_dem(UVEG::TOA_TEST::markdown_tools&) // "toa_test.cpp" 1153

do_dem: Loading full global earth DEM in a reduced image

Perform full earth maping of DEM

Time used:10 secs.

   void UVEG::TOA_TEST::do_dem(UVEG::TOA_TEST::markdown_tools&) // "toa_test.cpp" 508

First pass

MIN MAX calculation, first pass. All calculations are performed with and without shadow. Statisticis will show only shadowed images.

Time used:1.9 mins.

Second pass

First TOA generation. Shadows forced every 4 lines. RGB from averaging the map.

Time used:1.9 mins.

Number of nodes requested by the full LUT atmosphere: [5238] nodes.

   std::vector<boost::filesystem::path> UVEG::TOA_TEST::do_toa_test(UVEG::TOA_TEST::markdown_tools&, UVEG::LUT_spectrum::io_controller::Ptr, size_t, const string&, UVEG::PARAMS::full_earth_corine_class_map_handler::Ptr, const ossimDate&) // "toa_test.cpp" 935

Atmos SZA SZA.png

Solar Zenital Angle Atmos CWV CWV.png

Column Water Vapor in the scene Atmos MODEL MODEL.png

Atmosphere model selection Atmos IHAZE IHAZE.png

IHAZE (MODTRAN aerosol mode) Atmos AOT AOT.png

AOT (pcent visibility) TOA calculated with SUN toa_with_sun.png

Full sun TOA calculation TOA calculated with shadow toa_with_shadow.png

TOA calculated with shadow TOA with shadow artifacts toa_with_artifacts.png

Alternated TOA (ceck about shadows) TOA spectral HEAT map toa_heat_map.png

Alternated TOA heatmap (with sun) TOA spectral HEAT map toa_heat_map.png

Alternated TOA heatmap (with sun)