Alpine summer clouds

Work resume

Report generated by:

   void UVEG::DEBUG::markdown_tools::print_markdown(const string&, std::ostream&) const // "markdown_tools.cpp" 363

Machine environment

---[GENERAL]--------------------------------------------
             Hostname: mlwn01
 Number of processors: 96
      Used processors: 56
              Machine: x86_64
              Sysname: Linux
           OS Release: 3.10.0-1062.12.1.el7.x86_64
             Nodename: mlwn01.ific.uv.es
              Version: #1 SMP Tue Feb 4 23:02:59 UTC 2020
---[HARDWARE]----------------------------------------------
                Loads: 30.1,19.2,9.34
            Total Ram: 377 GB.
             Free Ram: 360 GB.
            Total Ram: 377 GB.
           Shared Ram: 0 KB.
         Buffered Ram: 15.1 MB.
           Total Swap: 4 GB.
            Free Swap: 15.1 MB.
---[SOFTWARE]--------------------------------------------
                 Date: Friday, 6 November 2020
          Software Id: $Id: 09c82bb7a67ca0548a9402c0327ace296efb934e $
         Running UUID: af194d81-6404-4498-ab56-02be276619c6
User software version: V2.0_pre_development
          Institution: (UVEG) Universitat de Valencia-Estudi General/(CSIC) IFIC
        Software name: SGM C++ program V2.0 or above
             Comments: File generated by SGM software (c) 2020
     Compilation Date: Nov  6 2020 13:32:32
--------------------------------------------------------

Timing benchmark

Name Time Loops Speed (iters/s)
Normalization GAIN/OFFSET 1.7 mins. 4.1e+06 4e+04
TOA calculation 1.7 mins. 1.2e+07 1.2e+05

Long test reports

Sensor simulation

This is an standard test of a CHIME containing these main simulation parameters

Parameter Value
Date time 2029-06-02T10:22:27.2.86102e-06Z
Zone Hemisphere ZONE:33HEM:’N
HR_min_wavelength 400
HR_max_wavelength 2480
HR_spectral_resolution 1
HR_spatial_scale_factor 1
HR_spatial_margin 150
DEM_flag 1
land_cover_map_option 2
land_cover_user_map_input Alpine.nc
atmospheric_parameters_map_option 1
atmospheric_parameter_name CWV;AOT;ICLD
atmospheric_parameter_units g/cm^2;;
cloud_map_option 1
cloud_parameters_vector 30;1;2;3;4;5
atmospheric_parameter_units g/cm^2;;

Final tasks output writer

Map UTM North is UP full_oriented_los_state_sensor.png

DEM Map projection Pure sensor view generated internally oriented_sensor.png

DEM Map Sensor view ROI projected in REALDEM sensor_region_area_full_map.png

ROI sensor view Cloud map from file full_clouds.png

Full cloud map Elevation limited Cloud map from file full_clouds_cut.png

ElevationFull cloud map RGB averaged TOA rgb_toa_normalized.png

Toa radiance RGB averaged TOA rgb_toa.png

Toa radiance Logarithmic Spectrum heatmap Max value: 659.248 heat_map_logaritmic.png

Heatmap (log values) Max value: 659.248 Linear Spectrum heatmap Max value: 659.248 heat_map.png

Heatmap (linear values) Max value: 659.248 LOS map lacasitos_los.png

LOS map) STATE map lacasitos_state.png

STATE map) Computational ORDER gain/offset calculation computational_order_pre.png

Computational map order Computational ORDER TOA calculation computational_order_toa.png

Computational map order Raw elevation elevation.png

Raw elevation BW RGB colormap for DEM real elevation elevation_color.png

RGB colormap for DEM real elevation (colormap poster) Lambertian light reflexion lambertian_ligth_component.png

Lambertian light reflexion RGB colormap for DEM real elevation width lambertian light reflexion lambertian_with_dem.png

DEM with scene lambertian light reflexion Mountain shadow mask shadows_mask.png

Mountain shadow mask RGB colormap for DEM real elevation width SHOADOW attenuation shadow_with_dem.png

DEM with scene idth SHOADOW attenuation Clound mak cloud_mask.png

Clooud mask Solar Zenit Angle sza.png

Solar Zenit Angle Sun Azimuth Angle saa.png

Sun Azimuth Angle Relative Azimuth Angle raa.png

cos(Relative Azimuth Angle) Column Water Vapour cwv.png

The current map of CWV Aerosol Optical Thickness aot.png

The current map of ‘AOT’ Latitide lat.png

Latitide Residual latitide, latitude at elipsoid residual_lat_elipsoid.png

Residual latitide, latitude at elipsoid Longitude lon.png

Longitude Residual longitude, longitude at elipsoid lon_elipsoid.png

Residual longitude, longitude at elipsoid

Opened files for writing

Inventory of files opened for writing

"/workspace///chime_stress_test/test_alpine/chime_stress_test/output/HIRES_SPATIAL_ALPINE/sgm_out/SGM.MO.01.nc"
"/workspace///chime_stress_test/test_alpine/chime_stress_test/output/HIRES_SPATIAL_ALPINE/sgm_out/SGM.MO.02.nc"
"/workspace///chime_stress_test/test_alpine/chime_stress_test/output/HIRES_SPATIAL_ALPINE/sgm_out/SGM.MO.03.nc"
"/workspace///chime_stress_test/test_alpine/chime_stress_test/output/HIRES_SPATIAL_ALPINE/sgm_out/auxiliary/aot.png"
"/workspace///chime_stress_test/test_alpine/chime_stress_test/output/HIRES_SPATIAL_ALPINE/sgm_out/auxiliary/aot.png.cimgz"
"/workspace///chime_stress_test/test_alpine/chime_stress_test/output/HIRES_SPATIAL_ALPINE/sgm_out/auxiliary/cloud_mask.png"
"/workspace///chime_stress_test/test_alpine/chime_stress_test/output/HIRES_SPATIAL_ALPINE/sgm_out/auxiliary/computational_order_pre.png"
"/workspace///chime_stress_test/test_alpine/chime_stress_test/output/HIRES_SPATIAL_ALPINE/sgm_out/auxiliary/computational_order_toa.png"
"/workspace///chime_stress_test/test_alpine/chime_stress_test/output/HIRES_SPATIAL_ALPINE/sgm_out/auxiliary/cwv.png"
"/workspace///chime_stress_test/test_alpine/chime_stress_test/output/HIRES_SPATIAL_ALPINE/sgm_out/auxiliary/cwv.png.cimgz"
"/workspace///chime_stress_test/test_alpine/chime_stress_test/output/HIRES_SPATIAL_ALPINE/sgm_out/auxiliary/elevation.png"
"/workspace///chime_stress_test/test_alpine/chime_stress_test/output/HIRES_SPATIAL_ALPINE/sgm_out/auxiliary/elevation.png.cimgz"
"/workspace///chime_stress_test/test_alpine/chime_stress_test/output/HIRES_SPATIAL_ALPINE/sgm_out/auxiliary/elevation_color.png"
"/workspace///chime_stress_test/test_alpine/chime_stress_test/output/HIRES_SPATIAL_ALPINE/sgm_out/auxiliary/full_clouds.png"
"/workspace///chime_stress_test/test_alpine/chime_stress_test/output/HIRES_SPATIAL_ALPINE/sgm_out/auxiliary/full_clouds_cut.png"
"/workspace///chime_stress_test/test_alpine/chime_stress_test/output/HIRES_SPATIAL_ALPINE/sgm_out/auxiliary/full_oriented_los_state_sensor.png"
"/workspace///chime_stress_test/test_alpine/chime_stress_test/output/HIRES_SPATIAL_ALPINE/sgm_out/auxiliary/heat_map.png"
"/workspace///chime_stress_test/test_alpine/chime_stress_test/output/HIRES_SPATIAL_ALPINE/sgm_out/auxiliary/heat_map_logaritmic.png"
"/workspace///chime_stress_test/test_alpine/chime_stress_test/output/HIRES_SPATIAL_ALPINE/sgm_out/auxiliary/lacasitos_los.png"
"/workspace///chime_stress_test/test_alpine/chime_stress_test/output/HIRES_SPATIAL_ALPINE/sgm_out/auxiliary/lacasitos_state.png"
"/workspace///chime_stress_test/test_alpine/chime_stress_test/output/HIRES_SPATIAL_ALPINE/sgm_out/auxiliary/lambertian_ligth_component.png"
"/workspace///chime_stress_test/test_alpine/chime_stress_test/output/HIRES_SPATIAL_ALPINE/sgm_out/auxiliary/lambertian_ligth_component.png.cimgz"
"/workspace///chime_stress_test/test_alpine/chime_stress_test/output/HIRES_SPATIAL_ALPINE/sgm_out/auxiliary/lambertian_with_dem.png"
"/workspace///chime_stress_test/test_alpine/chime_stress_test/output/HIRES_SPATIAL_ALPINE/sgm_out/auxiliary/lat.png"
"/workspace///chime_stress_test/test_alpine/chime_stress_test/output/HIRES_SPATIAL_ALPINE/sgm_out/auxiliary/lon.png"
"/workspace///chime_stress_test/test_alpine/chime_stress_test/output/HIRES_SPATIAL_ALPINE/sgm_out/auxiliary/lon_elipsoid.png"
"/workspace///chime_stress_test/test_alpine/chime_stress_test/output/HIRES_SPATIAL_ALPINE/sgm_out/auxiliary/max_toa_value.txt"
"/workspace///chime_stress_test/test_alpine/chime_stress_test/output/HIRES_SPATIAL_ALPINE/sgm_out/auxiliary/oriented_sensor.png"
"/workspace///chime_stress_test/test_alpine/chime_stress_test/output/HIRES_SPATIAL_ALPINE/sgm_out/auxiliary/raa.png"
"/workspace///chime_stress_test/test_alpine/chime_stress_test/output/HIRES_SPATIAL_ALPINE/sgm_out/auxiliary/residual_lat_elipsoid.png"
"/workspace///chime_stress_test/test_alpine/chime_stress_test/output/HIRES_SPATIAL_ALPINE/sgm_out/auxiliary/rgb_toa.png"
"/workspace///chime_stress_test/test_alpine/chime_stress_test/output/HIRES_SPATIAL_ALPINE/sgm_out/auxiliary/rgb_toa.png.cimgz"
"/workspace///chime_stress_test/test_alpine/chime_stress_test/output/HIRES_SPATIAL_ALPINE/sgm_out/auxiliary/rgb_toa_normalized.png"
"/workspace///chime_stress_test/test_alpine/chime_stress_test/output/HIRES_SPATIAL_ALPINE/sgm_out/auxiliary/rgb_toa_normalized.png.cimgz"
"/workspace///chime_stress_test/test_alpine/chime_stress_test/output/HIRES_SPATIAL_ALPINE/sgm_out/auxiliary/saa.png"
"/workspace///chime_stress_test/test_alpine/chime_stress_test/output/HIRES_SPATIAL_ALPINE/sgm_out/auxiliary/sensor_region_area_full_map.png"
"/workspace///chime_stress_test/test_alpine/chime_stress_test/output/HIRES_SPATIAL_ALPINE/sgm_out/auxiliary/shadow_with_dem.png"
"/workspace///chime_stress_test/test_alpine/chime_stress_test/output/HIRES_SPATIAL_ALPINE/sgm_out/auxiliary/shadows_mask.png"
"/workspace///chime_stress_test/test_alpine/chime_stress_test/output/HIRES_SPATIAL_ALPINE/sgm_out/auxiliary/shadows_mask.png.cimgz"
"/workspace///chime_stress_test/test_alpine/chime_stress_test/output/HIRES_SPATIAL_ALPINE/sgm_out/auxiliary/sza.png"

Opened files for reading

Inventory of files opened for writing

""
"/usr/local/flexe/current/auxiliary/DEM_ASTER_V3/ASTGTMV003_N46E010_dem.tif"
"/usr/local/flexe/current/auxiliary/DEM_ASTER_V3/ASTGTMV003_N46E011_dem.tif"
"/usr/local/flexe/current/auxiliary/DEM_ASTER_V3/ASTGTMV003_N46E012_dem.tif"
"/usr/local/flexe/current/auxiliary/DEM_ASTER_V3/ASTGTMV003_N47E010_dem.tif"
"/usr/local/flexe/current/auxiliary/DEM_ASTER_V3/ASTGTMV003_N47E011_dem.tif"
"/usr/local/flexe/current/auxiliary/DEM_ASTER_V3/ASTGTMV003_N47E012_dem.tif"
"/usr/local/flexe/current/auxiliary/SGM/ATMOS/CHIME_ATM_LUT.nc.bdb"
"/usr/local/flexe/current/auxiliary/SGM/CLOUD_LUT/CHIME_CLOUD_LUTs.nc.bdb"
"/usr/local/flexe/current/auxiliary/SGM/CLOUD_PRE/CLD_mask_CC_26_resol_100.mat"
"/usr/local/flexe/current/auxiliary/SGM/METEO/ECMWF/CWV_int_h_vM.mat"
"/usr/local/flexe/current/auxiliary/SGM/METEO/ECMWF/DATOS_AOT_CWV_O_GEOP/Month6_CWV_O3_AOT_GEOP.cdf"
"/usr/local/flexe/current/auxiliary/SGM/METEO/ECMWF/METEO_range.mat"
"/usr/local/flexe/current/auxiliary/SGM/METEO/ECMWF/O2_int_h.mat"
"/usr/local/flexe/current/auxiliary/SGM/METEO/ECMWF/O3_int_h.mat"
"/workspace///chime_stress_test/test_alpine/ALPINESGM_Local_Configuration.xml"
"/workspace///chime_stress_test/test_alpine/Alpine.nc"
"/workspace///chime_stress_test/test_alpine/SPATIAL_HIGH_RES_Global_Configuration.xml"
"/workspace///chime_stress_test/test_alpine/geo_out/UVEG_translatedOGM.MO.01.nc"

Probe list used for this test

Probe list used for this test

Normalization GAIN/OFFSET

First pass evaluation over all pixels to find the gain and the offset to provide compression.

Time used:1.7 mins.

TOA calculation

Full TOA calculation and saving

Time used:1.7 mins.