Veg_Nov19 file

Work resume

Report generated by:

   void UVEG::DEBUG::markdown_tools::print_markdown(const string&, std::ostream&) const // "markdown_tools.cpp" 363

Machine environment

---[GENERAL]--------------------------------------------
             Hostname: mlwn02
 Number of processors: 96
      Used processors: 56
              Machine: x86_64
              Sysname: Linux
           OS Release: 3.10.0-1062.12.1.el7.x86_64
             Nodename: mlwn02.ific.uv.es
              Version: #1 SMP Tue Feb 4 23:02:59 UTC 2020
---[HARDWARE]----------------------------------------------
                Loads: 1.38,2.08,2.86
            Total Ram: 377 GB.
             Free Ram: 153 GB.
            Total Ram: 377 GB.
           Shared Ram: 0 KB.
         Buffered Ram: 16.3 MB.
           Total Swap: 4 GB.
            Free Swap: 16.3 MB.
---[SOFTWARE]--------------------------------------------
                 Date: Thursday, 3 September 2020
          Software Id: $Id: d2e580c190da31c55ddf430aa182c7a2a164a4c9 $
User software version: V2.0_pre_development
          Institution: (UVEG) Universitat de Valencia-Estudi General/(CSIC) IFIC
        Software name: SGM C++ program V2.0 or above
             Comments: File generated by SGM software (c) 2020
--------------------------------------------------------

Timing benchmark

Name	Time	Loops	Speed (iters/s)
Normalization GAIN/OFFSET	11 mins.	3.6e+07	5.6e+04
TOA calculation	1.6 hours.	1.1e+08	1.9e+04

Long test reports

Sensor simulation

This is an standard test of a CHIME containing these main simulation parameters

Parameter	Value
Date time	2029-06-02T10:22:27.2.86102e-06Z
Zone Hemisphere	ZONE:33HEM:’N
HR_min_wavelength	400
HR_max_wavelength	2480
HR_spectral_resolution	1
HR_spatial_scale_factor	3
HR_spatial_margin	150
DEM_flag	2
land_cover_map_option	2
land_cover_user_map_input	Veg_Nov19.nc
atmospheric_parameters_map_option	1
atmospheric_parameter_name	CWV;AOT;ICLD
atmospheric_parameter_units	“g/cm^2”;“_";"”
cloud_map_option	0
atmospheric_parameter_units	“g/cm^2”;“_";"”

Final tasks output writer

Map UTM no oriented full_oriented_los_state_sensor.png

DEM Map projection Pure sensor view generated internally oriented_sensor.png

DEM Map Sensor view ROI projected in REALDEM sensor_region_area_full_map.png

ROI sensor view RGB averaged TOA rgb_toa_normalized.png

Toa radiance RGB averaged TOA rgb_toa.png

Toa radiance Spectrum heatmap heat_map_logaritmic.png

Heatmap (linear values) Spectrum heatmap heat_map.png

Heatmap (logarigmic values) LOS map lacasitos_los.png

LOS map) STATE map lacasitos_state.png

STATE map) Computational ORDER gain/offset calculation computational_order_pre.png

Computational map order Computational ORDER TOA calculation computational_order_toa.png

Computational map order Raw elevation elevation.png

Raw elevation BW RGB colormap for DEM real elevation elevation_color.png

RGB colormap for DEM real elevation (colormap poster) Lambertian light reflexion lambertian_ligth_component.png

RGB colormap for DEM real elevation width lambertian light reflexion lambertian_with_dem.png

DEM with scene lambertian light reflexion Mountain shadow mask shadows_mask.png

Mountain shadow mask RGB colormap for DEM real elevation width SHOADOW attenuation shadow_with_dem.png

DEM with scene idth SHOADOW attenuation Clound mak cloud_mask.png

Clooud mask Solar Zenit Angle sza.png

cos(Solar Zenit Angle) Sun Visualization angle raa.png

cos(Sun Visualization angle) Column Water Vapour cwv.png

The current map of CWV Aerosol Optical Thickness aot.png

The current map of ‘AOT’ Latitide lat.png

Residual latitide, latitude at elipsoid residual_lat_elipsoid.png

Residual latitide, latitude at elipsoid Longitude lon.png

Residual longitude, longitude at elipsoid lon_elipsoid.png

Opened files for writing

Inventory of files opened for writing

"/workspace/DATOS_SEP_2020/Veg_Nov19/new_file_format/output/SGM.MO.01.nc"
"/workspace/DATOS_SEP_2020/Veg_Nov19/new_file_format/output/SGM.MO.02.nc"
"/workspace/DATOS_SEP_2020/Veg_Nov19/new_file_format/output/SGM.MO.03.nc"
"/workspace/DATOS_SEP_2020/Veg_Nov19/new_file_format/output/auxiliary/aot.png"
"/workspace/DATOS_SEP_2020/Veg_Nov19/new_file_format/output/auxiliary/aot.png.cimgz"
"/workspace/DATOS_SEP_2020/Veg_Nov19/new_file_format/output/auxiliary/cloud_mask.png"
"/workspace/DATOS_SEP_2020/Veg_Nov19/new_file_format/output/auxiliary/computational_order_pre.png"
"/workspace/DATOS_SEP_2020/Veg_Nov19/new_file_format/output/auxiliary/computational_order_toa.png"
"/workspace/DATOS_SEP_2020/Veg_Nov19/new_file_format/output/auxiliary/cwv.png"
"/workspace/DATOS_SEP_2020/Veg_Nov19/new_file_format/output/auxiliary/cwv.png.cimgz"
"/workspace/DATOS_SEP_2020/Veg_Nov19/new_file_format/output/auxiliary/elevation.png"
"/workspace/DATOS_SEP_2020/Veg_Nov19/new_file_format/output/auxiliary/elevation.png.cimgz"
"/workspace/DATOS_SEP_2020/Veg_Nov19/new_file_format/output/auxiliary/elevation_color.png"
"/workspace/DATOS_SEP_2020/Veg_Nov19/new_file_format/output/auxiliary/full_oriented_los_state_sensor.png"
"/workspace/DATOS_SEP_2020/Veg_Nov19/new_file_format/output/auxiliary/heat_map.png"
"/workspace/DATOS_SEP_2020/Veg_Nov19/new_file_format/output/auxiliary/heat_map_logaritmic.png"
"/workspace/DATOS_SEP_2020/Veg_Nov19/new_file_format/output/auxiliary/lacasitos_los.png"
"/workspace/DATOS_SEP_2020/Veg_Nov19/new_file_format/output/auxiliary/lacasitos_state.png"
"/workspace/DATOS_SEP_2020/Veg_Nov19/new_file_format/output/auxiliary/lambertian_ligth_component.png"
"/workspace/DATOS_SEP_2020/Veg_Nov19/new_file_format/output/auxiliary/lambertian_ligth_component.png.cimgz"
"/workspace/DATOS_SEP_2020/Veg_Nov19/new_file_format/output/auxiliary/lambertian_with_dem.png"
"/workspace/DATOS_SEP_2020/Veg_Nov19/new_file_format/output/auxiliary/lat.png"
"/workspace/DATOS_SEP_2020/Veg_Nov19/new_file_format/output/auxiliary/lon.png"
"/workspace/DATOS_SEP_2020/Veg_Nov19/new_file_format/output/auxiliary/lon_elipsoid.png"
"/workspace/DATOS_SEP_2020/Veg_Nov19/new_file_format/output/auxiliary/oriented_sensor.png"
"/workspace/DATOS_SEP_2020/Veg_Nov19/new_file_format/output/auxiliary/raa.png"
"/workspace/DATOS_SEP_2020/Veg_Nov19/new_file_format/output/auxiliary/residual_lat_elipsoid.png"
"/workspace/DATOS_SEP_2020/Veg_Nov19/new_file_format/output/auxiliary/rgb_toa.png"
"/workspace/DATOS_SEP_2020/Veg_Nov19/new_file_format/output/auxiliary/rgb_toa.png.cimgz"
"/workspace/DATOS_SEP_2020/Veg_Nov19/new_file_format/output/auxiliary/rgb_toa_normalized.png"
"/workspace/DATOS_SEP_2020/Veg_Nov19/new_file_format/output/auxiliary/rgb_toa_normalized.png.cimgz"
"/workspace/DATOS_SEP_2020/Veg_Nov19/new_file_format/output/auxiliary/sensor_region_area_full_map.png"
"/workspace/DATOS_SEP_2020/Veg_Nov19/new_file_format/output/auxiliary/shadow_with_dem.png"
"/workspace/DATOS_SEP_2020/Veg_Nov19/new_file_format/output/auxiliary/shadows_mask.png"
"/workspace/DATOS_SEP_2020/Veg_Nov19/new_file_format/output/auxiliary/shadows_mask.png.cimgz"
"/workspace/DATOS_SEP_2020/Veg_Nov19/new_file_format/output/auxiliary/sza.png"

Opened files for reading

Inventory of files opened for writing

"/usr/local/flexe/current/auxiliary/SGM/ATMOS/CHIME_ATM_LUT.nc.bdb"
"/usr/local/flexe/current/auxiliary/SGM/METEO/ECMWF/CWV_int_h_vM.mat"
"/usr/local/flexe/current/auxiliary/SGM/METEO/ECMWF/DATOS_AOT_CWV_O_GEOP/Month6_CWV_O3_AOT_GEOP.cdf"
"/usr/local/flexe/current/auxiliary/SGM/METEO/ECMWF/METEO_range.mat"
"/usr/local/flexe/current/auxiliary/SGM/METEO/ECMWF/O2_int_h.mat"
"/usr/local/flexe/current/auxiliary/SGM/METEO/ECMWF/O3_int_h.mat"
"/workspace/DATOS_SEP_2020/Veg_Nov19/UVEG_translatedOGM.MO.01.nc"
"/workspace/DATOS_SEP_2020/Veg_Nov19/Veg_Nov19.nc"

Probe list used for this test

Normalization GAIN/OFFSET
TOA calculation

Probe list used for this test

Normalization GAIN/OFFSET

First pass evaluation over all pixels to find the gain and the offset to provide compression.

Time used:11 mins.

TOA calculation

Full TOA calculation and saving

Time used:1.6 hours.