Search NASA⌕ Search

SEARCH · Search NASA

Results for “Validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16

A Vehicle Management End-to-End Testing and Analysis Platform for Validation of Mission and Fault Management Algorithms to Reduce Risk for NASA's Space Launch System

The engineering development of the new Space Launch System (SLS) launch vehicle requires cross discipline teams with extensive knowledge of launch vehicle subsystems, information theory, and autonomous algorithms dealing with all operations from pre-launch through on orbit operations. The characteristics of these spacecraft systems must be matched with the autonomous algorithm monitoring and mitigation capabilities for accurate control and response to abnormal conditions throughout all vehicle mission flight phases, including precipitating safing actions and crew aborts. This presents a large and complex system engineering challenge, which is being addressed in part by focusing on the specific subsystems involved in the handling of off-nominal mission and fault tolerance with response management. Using traditional model based system and software engineering design principles from the Unified Modeling Language (UML) and Systems Modeling Language (SysML), the Mission and Fault Management (M&FM) algorithms for the vehicle are crafted and vetted in specialized Integrated Development Teams (IDTs) composed of multiple development disciplines such as Systems Engineering (SE), Flight Software (FSW), Safety and Mission Assurance (S&MA) and the major subsystems and vehicle elements such as Main Propulsion Systems (MPS), boosters, avionics, Guidance, Navigation, and Control (GNC), Thrust Vector Control (TVC), and liquid engines. These model based algorithms and their development lifecycle from inception through Flight Software certification are an important focus of this development effort to further insure reliable detection and response to off-nominal vehicle states during all phases of vehicle operation from pre-launch through end of flight. NASA formed a dedicated M&FM team for addressing fault management early in the development lifecycle for the SLS initiative. As part of the development of the M&FM capabilities, this team has developed a dedicated testbed that integrates specific M&FM algorithms, specialized nominal and off-nominal test cases, and vendor-supplied physics-based launch vehicle subsystem models. Additionally, the team has developed processes for implementing and validating these algorithms for concept validation and risk reduction for the SLS program. The flexibility of the Vehicle Management End-to-end Testbed (VMET) enables thorough testing of the M&FM algorithms by providing configurable suites of both nominal and off-nominal test cases to validate the developed algorithms utilizing actual subsystem models such as MPS. The intent of VMET is to validate the M&FM algorithms and substantiate them with performance baselines for each of the target vehicle subsystems in an independent platform exterior to the flight software development infrastructure and its related testing entities. In any software development process there is inherent risk in the interpretation and implementation of concepts into software through requirements and test cases into flight software compounded with potential human errors throughout the development lifecycle. Risk reduction is addressed by the M&FM analysis group working with other organizations such as S&MA, Structures and Environments, GNC, Orion, the Crew Office, Flight Operations, and Ground Operations by assessing performance of the M&FM algorithms in terms of their ability to reduce Loss of Mission and Loss of Crew probabilities. In addition, through state machine and diagnostic modeling, analysis efforts investigate a broader suite of failure effects and associated detection and responses that can be tested in VMET to ensure that failures can be detected, and confirm that responses do not create additional risks or cause undesired states through interactive dynamic effects with other algorithms and systems. VMET further contributes to risk reduction by prototyping and exercising the M&FM algorithms early in their implementation and without any inherent hindrances such as meeting FSW processor scheduling constraints due to their target platform - ARINC 653 partitioned OS, resource limitations, and other factors related to integration with other subsystems not directly involved with M&FM such as telemetry packing and processing. The baseline plan for use of VMET encompasses testing the original M&FM algorithms coded in the same C++ language and state machine architectural concepts as that used by Flight Software. This enables the development of performance standards and test cases to characterize the M&FM algorithms and sets a benchmark from which to measure the effectiveness of M&FM algorithms performance in the FSW development and test processes.

Trevino, Luis↗

CFD Validation Experiment of a Mach 2.5 Axisymmetric Shock-Wave/Boundary-Layer Interaction

Experimental investigations of specific flow phenomena, e.g., Shock Wave Boundary-Layer Interactions (SWBLI), provide great insight to the flow behavior but often lack the necessary details to be useful as CFD validation experiments. Reasons include: 1.Undefined boundary conditions Inconsistent results 2.Undocumented 3D effects (CL only measurements) 3.Lack of uncertainty analysis While there are a number of good subsonic experimental investigations that are sufficiently documented to be considered test cases for CFD and turbulence model validation, the number of supersonic and hypersonic cases is much less. This was highlighted by Settles and Dodsons [1] comprehensive review of available supersonic and hypersonic experimental studies. In all, several hundred studies were considered for their database.Of these, over a hundred were subjected to rigorous acceptance criteria. Based on their criteria, only 19 (12 supersonic, 7 hypersonic) were considered of sufficient quality to be used for validation purposes. Aeschliman and Oberkampf [2] recognized the need to develop a specific methodology for experimental studies intended specifically for validation purposes.

Turbulence Modeling↗

Double-Pulsed 2-Micrometer Lidar Validation for Atmospheric CO2 Measurements

A double-pulsed, 2-micron Integrated Path Differential Absorption (IPDA) lidar instrument for atmospheric carbon dioxide (CO2) measurements is successfully developed at NASA Langley Research Center (LaRC). Based on direct detection technique, the instrument can be operated on ground or onboard a small aircraft. Key features of this compact, rugged and reliable IPDA lidar includes high transmitted laser energy, wavelength tuning, switching and locking, and sensitive detection. As a proof of concept, the IPDA ground and airborne CO2 measurement and validation will be presented. IPDA lidar CO2 measurements ground validation were conducted at NASA LaRC using hard targets and a calibrated in-situ sensor. Airborne validation, conducted onboard the NASA B-200 aircraft, included CO2 plum detection from power stations incinerators, comparison to in-flight CO2 in-situ sensor and comparison to air sampling at different altitude conducted by NOAA at the same site. Airborne measurements, spanning for 20 hours, were obtained from different target conditions. Ground targets included soil, vegetation, sand, snow and ocean. In addition, cloud slicing was examined over the ocean. These flight validations were conducted at different altitudes, up to 7 km, with different wavelength controlled weighing functions. CO2 measurement results agree with modeling conducted through the different sensors, as will be discussed.

Singh, Upendra N.↗

Verification and Validation Process for Progressive Damage and Failure Analysis Methods in the NASA Advanced Composites Consortium

The Advanced Composites Consortium is a US Government/Industry partnership supporting technologies to enable timeline and cost reduction in the development of certified composite aerospace structures. A key component of the consortium's approach is the development and validation of improved progressive damage and failure analysis methods for composite structures. These methods will enable increased use of simulations in design trade studies and detailed design development, and thereby enable more targeted physical test programs to validate designs. To accomplish this goal with confidence, a rigorous verification and validation process was developed. The process was used to evaluate analysis methods and associated implementation requirements to ensure calculation accuracy and to gage predictability for composite failure modes of interest. This paper introduces the verification and validation process developed by the consortium during the Phase I effort of the Advanced Composites Project. Specific structural failure modes of interest are first identified, and a subset of standard composite test articles are proposed to interrogate a progressive damage analysis method's ability to predict each failure mode of interest. Test articles are designed to capture the underlying composite material constitutive response as well as the interaction of failure modes representing typical failure patterns observed in aerospace structures.

Wanthal, Steven↗

Further Validation of a CFD Code for Calculating the Performance of Two-Stage Light Gas Guns

Earlier validations of a higher-order Godunov code for modeling the performance of two-stage light gas guns are reviewed. These validation comparisons were made between code predictions and experimental data from the NASA Ames 1.5" and 0.28" guns and covered muzzle velocities of 6.5 to 7.2 km/s. In the present report, five more series of code validation comparisons involving experimental data from the Ames 0.22" (1.28" pump tube diameter), 0.28", 0.50", 1.00" and 1.50" guns are presented. The total muzzle velocity range of the validation data presented herein is 3 to 11.3 km/s. The agreement between the experimental data and CFD results is judged to be very good. Muzzle velocities were predicted within 0.35 km/s for 74% of the cases studied with maximum differences being 0.5 km/s and for 4 out of 50 cases, 0.5 - 0.7 km/s.

Ballistic Range↗

A Ground Validation Network for the Global Precipitation Measurement Mission

A prototype Validation Network (VN) is currently operating as part of the Ground Validation System for NASA's Global Precipitation Measurement (GPM) mission. The VN supports precipitation retrieval algorithm development in the GPM prelaunch era. Postlaunch, the VN will be used to validate GPM spacecraft instrument measurements and retrieved precipitation data products. The period of record for the VN prototype starts on 8 August 2006 and runs to the present day. The VN database includes spacecraft data from the Tropical Rainfall Measuring Mission (TRMM) precipitation radar (PR) and coincident ground radar (GR) data from operational meteorological networks in the United States, Australia, Korea, and the Kwajalein Atoll in the Marshall Islands. Satellite and ground radar data products are collected whenever the PR satellite track crosses within 200 km of a VN ground radar, and these data are stored permanently in the VN database. VN products are generated from coincident PR and GR observations when a significant rain event occurs. The VN algorithm matches PR and GR radar data (including retrieved precipitation data in the case of the PR) by calculating averages of PR reflectivity (both raw and attenuation corrected) and rain rate, and GR reflectivity at the geometric intersection of the PR rays with the individual GR elevation sweeps. The algorithm thus averages the minimum PR and GR sample volumes needed to "matchup" the spatially coincident PR and GR data types. The result of this technique is a set of vertical profiles for a given rainfall event, with coincident PR and GR samples matched at specified heights throughout the profile. VN data can be used to validate satellite measurements and to track ground radar calibration over time. A comparison of matched TRMM PR and GR radar reflectivity factor data found a remarkably small difference between the PR and GR radar reflectivity factor averaged over this period of record in stratiform and convective rain cases when samples were taken from high in the atmosphere. A significant difference in PR and GR reflectivity was found in convective cases, particularly in convective samples from the lower part of the atmosphere. In this case, the mean difference between PR and corrected GR reflectivity was −1.88 dBZ. The PR-GR bias was found to increase with the amount of PR attenuation correction applied, with the PR-GR bias reaching −3.07 dBZ in cases where the attenuation correction applied is greater than 6 dBZ. Additional analysis indicated that the version 6 TRMM PR retrieval algorithm underestimates rainfall in case of convective rain in the lower part of the atmosphere by 30%-40%.

Schwaller, Mathew R.↗

A Ground Validation Network for the Global Precipitation Measurement Mission

A prototype Validation Network (VN) is currently operating as part of the Ground Validation System for NASA's Global Precipitation Measurement (GPM) mission. The VN supports precipitation retrieval algorithm development in the GPM prelaunch era. Postlaunch, the VN will be used to validate GPM spacecraft instrument measurements and retrieved precipitation data products. The period of record for the VN prototype starts on 8 August 2006 and runs to the present day. The VN database includes spacecraft data from the Tropical Rainfall Measuring Mission (TRMM) precipitation radar (PR) and coincident ground radar (GR) data from operational meteorological networks in the United States, Australia, Korea, and the Kwajalein Atoll in the Marshall Islands. Satellite and ground radar data products are collected whenever the PR satellite track crosses within 200 km of a VN ground radar, and these data are stored permanently in the VN database. VN products are generated from coincident PR and GR observations when a significant rain event occurs. The VN algorithm matches PR and GR radar data (including retrieved precipitation data in the case of the PR) by calculating averages of PR reflectivity (both raw and attenuation corrected) and rain rate, and GR reflectivity at the geometric intersection of the PR rays with the individual GR elevation sweeps. The algorithm thus averages the minimum PR and GR sample volumes needed to "matchup" the spatially coincident PR and GR data types. The result of this technique is a set of vertical profiles for a given rainfall event, with coincident PR and GR samples matched at specified heights throughout the profile. VN data can be used to validate satellite measurements and to track ground radar calibration over time. A comparison of matched TRMM PR and GR radar reflectivity factor data found a remarkably small difference between the PR and GR radar reflectivity factor averaged over this period of record in stratiform and convective rain cases when samples were taken from high in the atmosphere. A significant difference in PR and GR reflectivity was found in convective cases, particularly in convective samples from the lower part of the atmosphere. In this case, the mean difference between PR and corrected GR reflectivity was -1.88 dBZ. The PR-GR bias was found to increase with the amount of PR attenuation correction applied, with the PR-GR bias reaching -3.07 dBZ in cases where the attenuation correction applied is greater than 6 dBZ. Additional analysis indicated that the version 6 TRMM PR retrieval algorithm underestimates rainfall in case of convective rain in the lower part of the atmosphere by 30%-40%.

Schwaller, Mathew R.↗

Quantification of Dynamic Model Validation Metrics Using Uncertainty Propagation from Requirements

The Space Launch System, NASA's new large launch vehicle for long range space exploration, is presently in the final design and construction phases, with the first launch scheduled for 2019. A dynamic model of the system has been created and is critical for calculation of interface loads and natural frequencies and mode shapes for guidance, navigation, and control (GNC). Because of the program and schedule constraints, a single modal test of the SLS will be performed while bolted down to the Mobile Launch Pad just before the first launch. A Monte Carlo and optimization scheme will be performed to create thousands of possible models based on given dispersions in model properties and to determine which model best fits the natural frequencies and mode shapes from modal test. However, the question still remains as to whether this model is acceptable for the loads and GNC requirements. An uncertainty propagation and quantification (UP and UQ) technique to develop a quantitative set of validation metrics that is based on the flight requirements has therefore been developed and is discussed in this paper. There has been considerable research on UQ and UP and validation in the literature, but very little on propagating the uncertainties from requirements, so most validation metrics are "rules-of-thumb;" this research seeks to come up with more reason-based metrics. One of the main assumptions used to achieve this task is that the uncertainty in the modeling of the fixed boundary condition is accurate, so therefore that same uncertainty can be used in propagating the fixed-test configuration to the free-free actual configuration. The second main technique applied here is the usage of the limit-state formulation to quantify the final probabilistic parameters and to compare them with the requirements. These techniques are explored with a simple lumped spring-mass system and a simplified SLS model. When completed, it is anticipated that this requirements-based validation metric will provide a quantified confidence and probability of success for the final SLS dynamics model, which will be critical for a successful launch program, and can be applied in the many other industries where an accurate dynamic model is required.

Brown, Andrew M.↗

Portable, Low-Cost, Column Carbon Dioxide and Methane Measurements for Validating Satellite Observations in Remote Locations

We present a low-cost (~$10K per instrument), portable solution to ground-based validation of satellite observations for difficult to reach locations with precisions of 1 ppm XCO2 and 10 ppb XCH4 for hourly data products. While Total Carbon Column Observing Network (TCCON) is the gold-standard for ground validation, there are locations where a ground column validation data point would be useful but conditions are not conducive to a permanent station. Examples include wetlands, thawing permafrost, the tropics, the Amazon, sub-Saharan Africa, as well as locations without a power grid or with geopolitical conflict. In addition, the low-cost and portability mean a geographical region can be studied in depth with multiple instruments. This passive, sun-pointing instrument is a miniaturized, laser heterodyne radiometer (mini-LHR) that has been under development by our team since 2009. It can be operated either in tandem with AERONET (a global network of 500 instruments that measure aerosol optical depth), or as a stand-alone instrument with a low-cost (~$3K), light-weight sun tracker. One of the main benefits of the mini-LHR is that it can quickly reach remote locations and provide a validation measurement even if there is limited or no infrastructure at the site. The instrument weighs ~10 lbs, fits into a backpack, and is powered by two folding solar panels and a battery pack. In clear conditions, the instrument can be set-up in under an hour. Portability means that mini-LHRs can be easily moved for side-by-side comparisons with other mini-LHRs and with TCCON which simplifies assessing instrument bias as well as accuracy. Like TCCON, the mini-LHR points directly at the sun with a narrow field-of-view and is its insensitivity to cloud and aerosol scattering that is common to nadir-pointing passive satellite approaches. Here we present a collection of sample data sets to demonstrate performance from locations that vary in climate, altitude, solar zenith angle, hours of sun per day, etc., as well as data from side-by-side TCCON comparisons. Retrievals of CO2 and CH4 were completed using the NASA/Goddard's Planetary Spectrum Generator (PSG) that incorporates meteorological inputs from Modern-Era Retrospective analysis for Research and Applications, Version 2 (MERRA-2) data set.

Wilson, Emily W.↗

Simplifying Satellite and Ground Data Validation with Level-2 Subsetting

We demonstrate that scientists can simplify their satellite data validation workflow with the use of NASA Godddard Earth Sciences Data and Information Services Center (GES DISC) subsetting services. We perform a sample validation of Aura ozone products collocated with ground-based ozone measurements using subsetting services to trim satellite data to only the relevant user-defined variables and spatio-temporal region. Because the subsetting service automatically returns only relevant data granules that adhere to a set of user-defined coincidence criteria, user workload is greatly reduced. Moreover, the resultant data files are substantially smaller than full data granules due to the subsetting service further culling the data to the relevant geospatio-temporal coincidence criteria, user-defined variables, and user-defined dimensions of variables. This decreases data download throughput and file storage requirements. The validation presented here quantifies the time and file size savings that can be achieved by utilizing subsetting services within the satellite data validation workflow.

Johnson, James↗

ExEP Yield Modeling Tool and Validation Test Results

EXOSIMS is an open-source simulation tool for parametric modeling of the detection yield and characterization of exoplanets. EXOSIMS has been adopted by the Exoplanet Exploration Programs Standards De nition and Evaluation Team (ExSDET) as a common mechanism for comparison of exoplanet mission concept studies. To ensure trustworthiness of the tool, we developed a validation test plan that leverages the Python-language unit-test framework, utilizes integration tests for selected module interactions, and performs end-to-end cross- validation with other yield tools. This paper presents the test methods and results, with the physics-based tests such as photometry and integration time calculation treated in detail and the functional tests treated summarily. The test case utilized a 4m unobscured telescope with an idealized coronagraph and an exoplanet population from the IPAC radial velocity (RV) exoplanet catalog. The known RV planets were set at quadrature to allow deterministic validation of the calculation of physical parameters, such as working angle, photon counts and integration time. The observing keepout region was tested by generating plots and movies of the targets and the keepout zone over a year. Although the keepout integration test required the interpretation of a user, the test revealed problems in the L2 halo orbit and the parameterization of keepout applied to some solar system bodies, which the development team was able to address. The validation testing of EXOSIMS was performed iteratively with the developers of EXOSIMS and resulted in a more robust, stable, and trustworthy tool that the exoplanet community can use to simulate exoplanet direct-detection missions from probe class, to WFIRST, up to large mission concepts such as HabEx and LUVOIR.

Nunez, Paul↗

Follow-up and Validation of K2 and TESS Planetary Systems with Keck NIRC2 Adaptive Optics Imaging

High resolution imaging (HRI) is a critical part of the transiting exoplanet follow-up and validation process. HRI allows previously unresolved stellar companions and background blends to be resolved, vetting false positive signals and improving the radii measurements of true planets. Through a multi-semester Keck NIRC2 adaptive optics imaging program, we have pursued HRI of K2 and TESS candidate planet host systems to provide the transiting exoplanet community with necessary data for system validation and characterization. Here we present a summary of our ongoing program that includes an up to date list of targets observed, a description of the observations and data reduction, and a discussion of planetary systems validated by the community using these data. This observing program has been key in NASA’s K2 and TESS missions reaching their goals of identifying new exoplanets ideal for continued follow-up observations to measure their masses and investigate their atmospheres. All observations presented here are available as calibrated images and resulting contrast curves through the Exoplanet Follow-up Observing Program (ExoFOP) website. We encourage members of the exoplanet community to use these data products in their ongoing planetary system validation and characterization efforts.

Adaptive optics↗

A Method for Validating Causal Diagrams of Human Health Risk in Space Flight

The complexity of cause-and-effect relationships between spaceflight hazards and resulting health conditions clouds understanding of the totality of human system risk in space. In response, NASA has introduced Directed Acyclic Graphs (causal diagrams) into the human systems risk management process. These diagrams allow for a common understanding of the mechanisms that lead from unique hazards of spaceflight to the health outcomes important to agencies and astronauts. However, the paucity of available biomedical data from spaceflight creates a need for methods of validating causal models that can accommodate data from spaceflight model analogs. Here we outline one approach utilizing open-access rodent bone datasets from the Ames Life Sciences Data Archive. The properties of directed acyclic graphs themselves can provide an epistemological and statistical framework for validation of a priori causal representations of human system risk in space flight. The assumed causal connections on the graph creates sets of logical implications: variables that – if the causal diagram is correct – should be correlated, as well as sets that should be conditionally independent. By testing these implied correlations and conditional independencies both statistically and heuristically, we can provide evidence for or against specific causal pathways on the causal diagram. In addition to validation of expert-generated causal diagrams, machine learning techniques can learn the most likely structure of a causal diagram from a given dataset. Comparison with and reconciliation between machine-learned causal diagrams and expert-generated diagrams is another technique for challenging assumptions and improving our understanding of causal mechanisms. Accurately representing complex causation is essential to systemic understanding of human health risks in space travel. Having a robust system of validating causal diagrams helps us arrive at more accurate representations of causal systems. This process will be integral to developing the countermeasures necessary for extended exploration of the moon and Mars.

Robert Reynolds↗

Validation of Small Satellite Dynamics Simulation Modules using ASTERIA Flight Data

ASTERIA (Arcsecond Space Telescope Enabling Research in Astrophysics) was a CubeSat space telescope that operated in low-Earth orbit, having been deployed from the International Space Station in 2017. The spacecraft has achieved sub-arcsecond pointing stability and millikelvin thermal stability over 20-minute observations. A key enabling feature of the ASTERIA mission is the low level of pointing error that has been demonstrated under ASTERIA’s fine pointing control mode. Prior to launch, the ASTERIA mission performed analysis and simulations to estimate the in-flight pointing performance. This analysis used reaction wheel models provided by JPL’s Small Satellite Dynamics Testbed (SSDT), which had performed Kistler table testing to characterize the jitter caused by the reaction wheels of the Blue Canyon Technologies XACT attitude control unit within ASTERIA. These models were subsequently incorporated into the SSDT simulation. The main source of jitter, the high-frequency attitude disturbance over the camera exposure time, on ASTERIA is the set of rotating reaction wheels that are used for maintaining fine pointing during observations. The reaction wheels impart disturbance forces and torques continuously that cause unwanted motion during imaging. Increased jitter consequently leads to blurring of the image. Therefore, to benefit all SmallSat missions devoted to photometric or spectroscopic astrophysics applications, an on-orbit flight data acquisition and jitter testing campaign was performed in an attempt to help validate the SSDT’s simulation models. This paper describes the process used to validate several simulation models and attempt to characterize the ASTERIA jitter by analyzing the size of the resulting spot size for the target stars as a function of wheel speed, having commanded four wheel speeds for each of three stars of known brightness. After summarizing the on-orbit observation and jitter level measurement process, this paper compares the results obtained from the flight operational environment to the corresponding set of simulation jitter levels. Though the flight data obtained during this experiment was not sufficient to validate the simulation’s jitter model, other models have been validated with flight data, including the magnetic field, orbit propagation, sun position, and long-duration orbit decay models, which may be used by all other projects that use the SSDT’s simulation to increase system capability knowledge.

Mohan, Swati↗

Aerosol Models from the AERONET Database: Application to Surface Reflectance Validation Satellite Data

Aerosols play a critical role in radiative transfer within the atmosphere, and they have a significant impact on climate change. In this paper, we propose and implement a framework for developing an aerosol model using their microphysical properties. Such microphysical properties as the size distribution, the complex refractive index, and the percentage of sphericity are derived from the global AERosol RObotic NETwork (AERONET). These measurements, however, are typically retrieved when almucantar measurement procedures are performed (i.e., early mornings and late afternoons with clear sky) and might not have a temporal correspondence to a satellite overpass time, so a valid validation of satellite-derived products cannot be carried out. To address this problem of temporal inconsistency of satellite and ground-based measurements, we developed an approach to retrieve these microphysical properties (and the corresponding aerosol model) using the optical thickness at 440 nm, τ440, and the Ångström coefficient between 440 and 870 nm, α440–870. Such aerosol models were developed for 851 AERONET sites within the last 28 years. Obtained results suggest that empirically microphysical properties can be retrieved with uncertainties of up to 23 %. An exception is the imaginary part of the refractive index ni, for which the derived uncertainties reach up to 38 %. These specific parametric models of aerosol can be used for the studies when retrieval of microphysical properties is required as well as validation of satellite-derived products over land. Specifically, we demonstrate the usefulness of the aerosol models to validate surface reflectance records over land derived from optical remote sensing sensors. We then quantify the propagation of uncertainties in the surface reflectance due to uncertainties with the aerosol model retrieval that is used as a reference from radiative transfer simulations. Results indicate that individual aerosol microphysical properties can impact uncertainties in surface reflectance retrievals between 3.5 × 10(exp -5) to 1 × 10(exp -3) (in reflectance units). The overall impact of microphysical properties combined yields an overall uncertainty in surface reflectance <0.004 (in reflectance units). That corresponds, for example, to 1 to 3 % of the retrieved surface reflectance in the red spectral band (620–670 nm) by the Moderate Resolution Imaging Spectroradiometer (MODIS) instrument. These uncertainty values are well below the specification (0.005 + 0.05ρ; ρ is the retrieved surface reflectance) used for the MODIS atmospheric correction.

Jean-Claude Roger↗

Validation of CrIS Ozone and Carbon Oxide Products from CrIS Single-Field-of-View Retrievals

Single Field-of-view Sounder Atmospheric Products (SiFSAP) from Cross-track Infrared Sounder (CrIS) on S-NPP have been developed at NASA Langley Research center, and recently a significant improvement in its trace gases products has been made. These products are derived based on the Principal Component (PC)-based Radiative Transfer Model (PCRTM) and an optimal estimation retrieval method (PCRTM-RA). Use of the PCRTM in this method allows for fast and accurate calculations for thousands of spectral channels under clear and cloudy sky conditions. The use of principal component to compress information from all spectral channels into the PC domain enables to reduce the observational noise and use the information from all hyperspectral infrared channels. The retrieval is made on PC-domain, and temperature, water vapor, trace gases, cloud and surface parameters are retrieved simultaneously. This presentation will present some validation to the SiFSAP ozone (O3) and carbon monoxide (CO) products. Since the SiFSAP has a spatial resolution of about 14 km at nadir, which is better than most global weather and climate models and enables to make process-oriented analysis of the transport of these gases, this study will focus on validation of CO and O3 products under some extreme weather and/or climate events, such as CO emission and transport from large biomass burning, and O3 variation impacted by fire emission, stratospheric intrusion, and tropical cyclones. Data used in our validation include CO and O3 from NASA aircraft campaigns, plus other satellite products such as CO and O3 from AIRS, IASI and TROPOMI, MOPPIT CO and OMPS O3. Some comparison of SiFSAP O3 with the O3 from the fifth-generation ECMWF reanalysis (ERA5) data the NASA Modern-Era Retrospective Analysis for Research and Applications, Version 2 (MERRA-2) will also present. Such a validation not only helps to quantify the performance of the retrievals in these extreme conditions, but also displays the capability of satellite observation to capture the fine-scale spatial pattern of CO and O3 variation.

Xiaozhen Xiong↗

Slosh-Induced Ullage Collapse Validation by Computational Fluid Dynamics and Application to In-space Propellant Dynamics

Ullage collapse predictions made using Computational Fluid Dynamics (CFD) were validated then made for an in-space cryogenic propellant unsettling application. Ullage collapse is the decrease in propellant tank pressure due to cooling of the ullage gas, which can be significant for cryogenic propulsion systems. Vehicles may be developed that are robust to temperature and pressure changes caused by heat leaks, e.g., propellant tanks with high maximum operation pressures, technologies yielding active thermal conditioning, and systems with ample pressurant for conditioning. These methods are robust because additional mass, cost, and complexity are used to address cryogenic fluid management (CFM). As vehicles are optimized for increased payload capacity, tracking of events such as ullage collapse and self-pressurization in tanks will become increasingly important for propellant inventory calculations. Some ullage collapse events can be studied through ground experimentation, but propellant unsettling in and around in-space coast mission phases must be studied in the absence of an acceleration field. Computational Fluid Dynamics is a powerful tool to address this need, enabling prediction of complex physics prior to flight. Validation of the chosen CFD tool and modeling methodology was done using data from a previously conducted subscale slosh-induced ullage collapse ground test performed in part by the Japan Aerospace Exploration Agency (JAXA). A small tank was partially filled with liquid nitrogen and pressurized with gaseous nitrogen at various temperatures. The tank was oscillated laterally to induce high amplitude slosh dynamics resulting in wave breakup. Successful qualitative validation of slosh wave dynamics and quantitative validation of ullage collapse promoted confidence in extending ullage collapse predictions to a flight application. Mechanisms of ullage collapse caused by main engine cutoff while in-space were identified. Both slosh dynamics leading to engine shutdown and body dynamics following shutdown were shown to contribute to propellant unsettling and ullage collapse.

J M Brodnick↗

Validations of Satellite Ozone Profiles in Austral Spring Using Ozonesonde Measurements in the Jang Bogo Station, Antarctica

Using ozonesonde measurements from 2015 to 2018 at the Jang Bogo station located in the southeastern Antarctic region, we evaluate ozone profiles retrieved from the three satellite measurements that are widely used: Ozone Monitoring Instrument (OMI), Microwave Limb Sounder (MLS), and Ozone Mapping Profiler Suite (OMPS) data. For the fair validation, ozonesonde profiles are smoothed using the weighting function of each satellite retrieval algorithm (i.e., convolution process). Compared with limb-viewing MLS and OMPS ozone profiles, the OMI ozone profiles are relatively less qualified: coarser vertical resolution and larger inter-annual variation. Nevertheless, our validation reveals that the quality of all three satellite ozone profiles looks comparable; In general, difference from ozonesonde profile is ∼1 ppm absolutely, and −20 to 30% relatively at maximum. This quantitative range well corresponds to previous work, meaning that our new validation confirms the reliability of satellite ozone profiles in the southeastern Antarctic region where the measurement data for the validation were not enough. Another interesting feature is the role of a priori ozone profile; Nadir-viewing OMI satellite can have qualified ozone profiles by a proper assumption of a priori ozone profile. Since the performance of limb-viewing ozone profiles is better, however, the careful usage of nadir-viewing ozone profile is still required. We think that the simultaneous usage of multiple satellite ozone profiles can contribute to better understanding of Antarctic ozone characteristics.

Antarctica↗