## Variables

The table below lists the variables that are present in the HARP product that results from an ingestion of GOME2_L1_radiance data.

field name

type

dimensions

unit

description

datetime

double

{time}

[seconds since 2000-01-01]

time of the measurement at the end of the integration time

orbit_index

int32

absolute orbit number

latitude

double

{time}

[degree_north]

center latitude of the measurement

longitude

double

{time}

[degree_east]

center longitude of the measurement

latitude_bounds

double

{time, 4}

[degree_north]

corner latitudes for the ground pixel of the measurement

longitude_bounds

double

{time, 4}

[degree_east]

corner longitudes for the ground pixel of the measurement

double

{time, spectral}

[count/s/cm2/sr/nm]

wavelength

double

{time, spectral}

[nm]

nominal wavelength assignment for each of the detector pixels

integration_time

double

{time, spectral}

[s]

integration time for each pixel

scan_subindex

int8

{time}

relative index (0-15) of this measurement within a scan (forward+backward)

scan_direction_type

int8

{time}

scan direction for each measurement; enumeration values: forward (0), backward (1)

cloud_top_pressure

double

{time}

[hPa]

cloud top pressure

cloud_fraction

double

{time}

[]

cloud fraction

solar_zenith_angle_toa

double

{time}

[degree]

solar zenith angle at top of atmosphere

solar_azimuth_angle_toa

double

{time}

[degree]

solar azimuth angle at top of atmosphere

viewing_zenith_angle_toa

double

{time}

[degree]

viewing zenith angle at top of atmosphere

viewing_azimuth_angle_toa

double

{time}

[degree]

viewing azimuth angle at top of atmosphere

index

int32

{time}

zero-based index of the sample within the source product

## Ingestion options

The table below lists the available ingestion options for GOME2_L1 products.

option name

legal values

description

band

band-1a, band-1b, band-2a, band-2b, band-3, band-4

only include data from the specified band (‘band-1a’, ‘band-1b’, ‘band-2a’, ‘band-2b’, ‘band-3’, ‘band-4’); by default data from all bands is retrieved

data

transmission, sun, moon, sun_reference

retrieve the measured radiances (default), the transmission spectra (data=transmission), the sun measurement spectra (data=sun), the moon measurement spectra (data=moon) or the sun reference spectrum (data=sun_reference

This definition is only applicable when: data unset

## Mapping description

The GOME2 spectral data in the GOME2 L1b product is stored inside MDRs. There are separate MDRs for Earthshine, Calibration, Sun, and Moon measurements. In addition there are also ‘Dummy Records’ (DMDR) that can be present when there is lost data in the product. With HARP only Earthshine, Sun, and Moon measurements can be ingested.

Each MDR roughly contains a single scan. However, an MDR does not exactly correspond 1-to-1 with a GOME-2 scan. This is an important fact to be aware of. The real situation is as follows:

Within a single scan (a scan takes 6 seconds) there are 16 Instrument Source Packets (covering 375ms each) coming from the satellite. Each ISP contains at most two readouts (there are two if the integration time for a band is 187.5ms (or 93.75ms)). The problem is that the two readouts of the first ISP of a scan contain the last measurement of the previous scan and the first measurement of the new scan. The second ISP contains data for measurements #2 and #3, the third for #4 and #5, etc. The last measurement of a scan will again be found in the first ISP of the next scan. Instead of shifting the data and grouping all data of a single scan together in a single MDR the Level 1a and Level 1b processors just place the MDR boundary at the start of the first ISP of a scan and terminate the MDR at the end of ISP 16. This means that in Level 1b (but also 1a) products the first measurement in an MDR will always be the last measurement of the previous scan.

Nearly all meta-data for a readout (time, geolocation, viewing/solar angles, etc.) in an MDR are filled taking into account this same shift. This means that for retrieving the geolocation of the first readout of an MDR from the GEO_EARTH_ACTUAL record, one will in fact get the geolocation information of the last backscan pixel of the previous scan. However, the integration time meta-data for the first readout in an MDR is not shifted this way (the GEO_EARTH information is also not shifted, by the way, and just contains the 32 geolocation pixels for the scan). As long as the integration time does not change from one scan to another this won’t impact anything, but the L1 products will contain invalid metadata for the first MDR readout if there is a change of integration time between two consecutive scans. In that case the calculated geolocation, angles, etc. of the first readout are values based on the integration time of the _new_ scan instead of the _old_ scan (e.g. the ground pixel will thus either be too large or too small). The (relative) good news to this is that, if a change in integration time occurs, the last pixel readout of the final scan with the ‘old’ integration time will never be valid and will have undefined values in the product (this is because the instrument prematurely terminates the final readout if a scan configuration change occurs). This means that the readout that has the ‘invalid’ meta-data will never be a valid measurement anyway.

Because of all this, HARP will exercise the following rules during ingestion: 1) the first readout of the first MDR will always be ignored (and you will never see the last readout of the last scan, because it won’t be in the product) 2) the first readout after a change in measurement mode (i.e. earthshine vs. calibration vs. sun vs. moon) will be ignored 3) if a change in integration time occurs (for any of the bands) then the first readout (for all bands) of the next MDR will be ignored 4) if two MDRs are not continuous (i.e. there is a time gap) then the first readout of the second MDR will be ignored

GOME-2 uses 6 bands for the main spectra (1A, 1B, 2A, 2B, 3, and 4). Within a scan each band can have its own integration time. There will be at most 32 readouts per scan (corresponding with an integration time of 187.5ms). If the integration time is 375ms, 750ms, 1.5s, 3s or 6s there will be 16, 8, 4, 2, or 1 measurement(s) respectively for this band in a scan. Some readouts may even cover multiple scans if the integration time is larger than 6s. HARP will combine the data for all bands into a single two-dimensional pixel_readout array and uses a fixed resolution of 187.5ms for the variables. Because bands might have higher integration time this means that for those bands there will be multiple rows in the pixel_readout array for a single readout. Each of those multiple rows will be filled with the same measurement value. This comes down to breaking the measurement up into pieces of 187.5ms (the actual integration time can still be found from the integration_time variable). All meta-data, such as geolocation, angles, etc. will also be ingested for this minimum integration time of 187.5ms and filtering on time and geolocation will also always be performed using the 187.5ms resolution.

If the band configuration changes somewhere during the orbit and a band filter is given, then only detector pixels that are inside the requested band for the duration of the whole orbit will be included. i.e. detector pixels that change band during the orbit will always be excluded when a band filter is given.

The table below details where and how each variable was retrieved from the input product.

field name

mapping description

datetime

path

description

The record start time is the start time of the scan and thus the start time of the second readout in the MDR. The start time for readout i (0..31) is thus RECORD_START_TIME + (i - 1) * 0.1875 and the time at end of integration time (which is the time that is returned) is RECORD_START_TIME + i * 0.1875

orbit_index

path

/MPHR/ORBIT_START

latitude

condition

CODA product version < 12

path

/MDR[]/Earthshine/GEO_EARTH_ACTUAL/CENTRE_ACTUAL[INT_INDEX[band_id],]/latitude

description

The integration time index INT_INDEX[band_id] is the index of the band with the minimum integration time (limited to those bands that are ingested)

condition

CODA product version >= 12

path

/MDR[]/Earthshine/GEO_EARTH_ACTUAL_k[]/CENTRE_ACTUAL/latitude

description

The integration time index k is the index (starting with 1) of the minimum integration time such that UNIQUE_INT[k-1] == min(INTEGRATION_TIMES[j]) for all bands j (0..9) that are ingeste.

longitude

condition

CODA product version < 12

path

/MDR[]/Earthshine/GEO_EARTH_ACTUAL/CENTRE_ACTUAL[INT_INDEX[band_id],]/longitude

description

The integration time index INT_INDEX[band_id] is the index of the band with the minimum integration time (limited to those bands that are ingested).

condition

CODA product version >= 12

path

/MDR[]/Earthshine/GEO_EARTH_ACTUAL_k[]/CENTRE_ACTUAL/longitude

description

The integration time index k is the index (starting with 1) of the minimum integration time such that UNIQUE_INT[k-1] == min(INTEGRATION_TIMES[j]) for all bands j (0..9) that are ingeste.

latitude_bounds

condition

CODA product version < 12

path

/MDR[]/Earthshine/GEO_EARTH_ACTUAL/CORNER_ACTUAL[INT_INDEX[band_id],,]/latitude

description

The integration time index INT_INDEX[band_id] is the index of the band with the minimum integration time (limited to those bands that are ingested). The corners ABCD are reordered as BDCA.

condition

CODA product version >= 12

path

/MDR[]/Earthshine/GEO_EARTH_ACTUAL_k[]/CORNER_ACTUAL[]/latitude

description

The integration time index k is the index (starting with 1) of the minimum integration time such that UNIQUE_INT[k-1] == min(INTEGRATION_TIMES[j]) for all bands j (0..9) that are ingeste.

longitude_bounds

condition

CODA product version < 12

path

/MDR[]/Earthshine/GEO_EARTH_ACTUAL/CORNER_ACTUAL[INT_INDEX[band_id],,]/longitude

description

The integration time index INT_INDEX[band_id] is the index of the band with the minimum integration time (limited to those bands that are ingested). The corners ABCD are reordered as BDCA.

condition

CODA product version >= 12

path

/MDR[]/Earthshine/GEO_EARTH_ACTUAL_k[]/CORNER_ACTUAL[]/longitude

description

The integration time index k is the index (starting with 1) of the minimum integration time such that UNIQUE_INT[k-1] == min(INTEGRATION_TIMES[j]) for all bands j (0..9) that are ingeste.

path

wavelength

path

/MDR[]/Earthshine/WAVELENGTH_1A[], /MDR[]/Earthshine/WAVELENGTH_1B[], /MDR[]/Earthshine/WAVELENGTH_2A[], /MDR/Earthshine[]/WAVELENGTH_2B[], /MDR[]/Earthshine/WAVELENGTH_3[], /MDR[]/Earthshine/WAVELENGTH_4[]

integration_time

path

/MDR[]/Earthshine/INTEGRATION_TIMES[]

scan_direction_type

path

/MDR[]/Earthshine/INTEGRATION_TIMES[]

description

the scan direction is based on the subset counter of the measurement; 0-11: forward (0), 12-15: backward (1)

cloud_top_pressure

path

/MDR[]/Earthshine/CLOUD/FIT_1[]

description

If the minimum ingested integration time > 187.5ms then the corresponding cloud top pressures will be combined using logarithmic averaging. The cloud top pressure will be set to NaN if FIT_MODE in the CLOUD structure is not equal to 0 or if FIT_1 is set to a fill value (even when this holds for only one of the averaged items)

cloud_fraction

path

/MDR[]/Earthshine/CLOUD/FIT_2[]

description

If the minimum ingested integration time > 187.5ms then the corresponding cloud fractions will be combined using averaging. The cloud fraction will be set to NaN if FIT_MODE in the CLOUD structure is not equal to 0 or if FIT_2 is set to a fill value (even when this holds for only one of the averaged items)

solar_zenith_angle_toa

condition

CODA product version < 12

path

/MDR[]/Earthshine/GEO_EARTH_ACTUAL/SOLAR_ZENITH_ACTUAL[INT_INDEX[band_id],1,]

description

The integration time index INT_INDEX[band_id] is the index of the band with the minimum integration time (limited to those bands that are ingested).

condition

CODA product version >= 12

path

/MDR[]/Earthshine/GEO_EARTH_ACTUAL_k[]/SOLAR_ZENITH_ACTUAL[1]

description

The integration time index k is the index (starting with 1) of the minimum integration time such that UNIQUE_INT[k-1] == min(INTEGRATION_TIMES[j]) for all bands j (0..9) that are ingeste.

solar_azimuth_angle_toa

condition

CODA product version < 12

path

/MDR[]/Earthshine/GEO_EARTH_ACTUAL/SOLAR_AZIMUTH_ACTUAL[INT_INDEX[band_id],1,]

description

The integration time index INT_INDEX[band_id] is the index of the band with the minimum integration time (limited to those bands that are ingested).

condition

CODA product version >= 12

path

/MDR[]/Earthshine/GEO_EARTH_ACTUAL_k[]/SOLAR_AZIMUTH_ACTUAL[1]

description

The integration time index k is the index (starting with 1) of the minimum integration time such that UNIQUE_INT[k-1] == min(INTEGRATION_TIMES[j]) for all bands j (0..9) that are ingeste.

viewing_zenith_angle_toa

condition

CODA product version < 12

path

/MDR[]/Earthshine/GEO_EARTH_ACTUAL/SAT_ZENITH_ACTUAL[INT_INDEX[band_id],1,]

description

The integration time index INT_INDEX[band_id] is the index of the band with the minimum integration time (limited to those bands that are ingested).

condition

CODA product version >= 12

path

/MDR[]/Earthshine/GEO_EARTH_ACTUAL_k[]/SAT_ZENITH_ACTUAL[1]

description

The integration time index k is the index (starting with 1) of the minimum integration time such that UNIQUE_INT[k-1] == min(INTEGRATION_TIMES[j]) for all bands j (0..9) that are ingeste.

viewing_azimuth_angle_toa

condition

CODA product version < 12

path

/MDR[]/Earthshine/GEO_EARTH_ACTUAL/SAT_AZIMUTH_ACTUAL[INT_INDEX[band_id],1,]

description

The integration time index INT_INDEX[band_id] is the index of the band with the minimum integration time (limited to those bands that are ingested).

condition

CODA product version >= 12

path

/MDR[]/Earthshine/GEO_EARTH_ACTUAL_k[]/SAT_AZIMUTH_ACTUAL[1]

description

The integration time index k is the index (starting with 1) of the minimum integration time such that UNIQUE_INT[k-1] == min(INTEGRATION_TIMES[j]) for all bands j (0..9) that are ingeste.