Search NASA⌕ Search

SEARCH · Search NASA

Results for “Validating”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14

Simplifying Satellite and Ground Data Validation with Level-2 Subsetting

We demonstrate that scientists can simplify their satellite data validation workflow with the use of NASA Godddard Earth Sciences Data and Information Services Center (GES DISC) subsetting services. We perform a sample validation of Aura ozone products collocated with ground-based ozone measurements using subsetting services to trim satellite data to only the relevant user-defined variables and spatio-temporal region. Because the subsetting service automatically returns only relevant data granules that adhere to a set of user-defined coincidence criteria, user workload is greatly reduced. Moreover, the resultant data files are substantially smaller than full data granules due to the subsetting service further culling the data to the relevant geospatio-temporal coincidence criteria, user-defined variables, and user-defined dimensions of variables. This decreases data download throughput and file storage requirements. The validation presented here quantifies the time and file size savings that can be achieved by utilizing subsetting services within the satellite data validation workflow.

Johnson, James↗

ExEP Yield Modeling Tool and Validation Test Results

EXOSIMS is an open-source simulation tool for parametric modeling of the detection yield and characterization of exoplanets. EXOSIMS has been adopted by the Exoplanet Exploration Programs Standards De nition and Evaluation Team (ExSDET) as a common mechanism for comparison of exoplanet mission concept studies. To ensure trustworthiness of the tool, we developed a validation test plan that leverages the Python-language unit-test framework, utilizes integration tests for selected module interactions, and performs end-to-end cross- validation with other yield tools. This paper presents the test methods and results, with the physics-based tests such as photometry and integration time calculation treated in detail and the functional tests treated summarily. The test case utilized a 4m unobscured telescope with an idealized coronagraph and an exoplanet population from the IPAC radial velocity (RV) exoplanet catalog. The known RV planets were set at quadrature to allow deterministic validation of the calculation of physical parameters, such as working angle, photon counts and integration time. The observing keepout region was tested by generating plots and movies of the targets and the keepout zone over a year. Although the keepout integration test required the interpretation of a user, the test revealed problems in the L2 halo orbit and the parameterization of keepout applied to some solar system bodies, which the development team was able to address. The validation testing of EXOSIMS was performed iteratively with the developers of EXOSIMS and resulted in a more robust, stable, and trustworthy tool that the exoplanet community can use to simulate exoplanet direct-detection missions from probe class, to WFIRST, up to large mission concepts such as HabEx and LUVOIR.

Nunez, Paul↗

Follow-up and Validation of K2 and TESS Planetary Systems with Keck NIRC2 Adaptive Optics Imaging

High resolution imaging (HRI) is a critical part of the transiting exoplanet follow-up and validation process. HRI allows previously unresolved stellar companions and background blends to be resolved, vetting false positive signals and improving the radii measurements of true planets. Through a multi-semester Keck NIRC2 adaptive optics imaging program, we have pursued HRI of K2 and TESS candidate planet host systems to provide the transiting exoplanet community with necessary data for system validation and characterization. Here we present a summary of our ongoing program that includes an up to date list of targets observed, a description of the observations and data reduction, and a discussion of planetary systems validated by the community using these data. This observing program has been key in NASA’s K2 and TESS missions reaching their goals of identifying new exoplanets ideal for continued follow-up observations to measure their masses and investigate their atmospheres. All observations presented here are available as calibrated images and resulting contrast curves through the Exoplanet Follow-up Observing Program (ExoFOP) website. We encourage members of the exoplanet community to use these data products in their ongoing planetary system validation and characterization efforts.

Adaptive optics↗

A Method for Validating Causal Diagrams of Human Health Risk in Space Flight

The complexity of cause-and-effect relationships between spaceflight hazards and resulting health conditions clouds understanding of the totality of human system risk in space. In response, NASA has introduced Directed Acyclic Graphs (causal diagrams) into the human systems risk management process. These diagrams allow for a common understanding of the mechanisms that lead from unique hazards of spaceflight to the health outcomes important to agencies and astronauts. However, the paucity of available biomedical data from spaceflight creates a need for methods of validating causal models that can accommodate data from spaceflight model analogs. Here we outline one approach utilizing open-access rodent bone datasets from the Ames Life Sciences Data Archive. The properties of directed acyclic graphs themselves can provide an epistemological and statistical framework for validation of a priori causal representations of human system risk in space flight. The assumed causal connections on the graph creates sets of logical implications: variables that – if the causal diagram is correct – should be correlated, as well as sets that should be conditionally independent. By testing these implied correlations and conditional independencies both statistically and heuristically, we can provide evidence for or against specific causal pathways on the causal diagram. In addition to validation of expert-generated causal diagrams, machine learning techniques can learn the most likely structure of a causal diagram from a given dataset. Comparison with and reconciliation between machine-learned causal diagrams and expert-generated diagrams is another technique for challenging assumptions and improving our understanding of causal mechanisms. Accurately representing complex causation is essential to systemic understanding of human health risks in space travel. Having a robust system of validating causal diagrams helps us arrive at more accurate representations of causal systems. This process will be integral to developing the countermeasures necessary for extended exploration of the moon and Mars.

Robert Reynolds↗

Validation of Small Satellite Dynamics Simulation Modules using ASTERIA Flight Data

ASTERIA (Arcsecond Space Telescope Enabling Research in Astrophysics) was a CubeSat space telescope that operated in low-Earth orbit, having been deployed from the International Space Station in 2017. The spacecraft has achieved sub-arcsecond pointing stability and millikelvin thermal stability over 20-minute observations. A key enabling feature of the ASTERIA mission is the low level of pointing error that has been demonstrated under ASTERIA’s fine pointing control mode. Prior to launch, the ASTERIA mission performed analysis and simulations to estimate the in-flight pointing performance. This analysis used reaction wheel models provided by JPL’s Small Satellite Dynamics Testbed (SSDT), which had performed Kistler table testing to characterize the jitter caused by the reaction wheels of the Blue Canyon Technologies XACT attitude control unit within ASTERIA. These models were subsequently incorporated into the SSDT simulation. The main source of jitter, the high-frequency attitude disturbance over the camera exposure time, on ASTERIA is the set of rotating reaction wheels that are used for maintaining fine pointing during observations. The reaction wheels impart disturbance forces and torques continuously that cause unwanted motion during imaging. Increased jitter consequently leads to blurring of the image. Therefore, to benefit all SmallSat missions devoted to photometric or spectroscopic astrophysics applications, an on-orbit flight data acquisition and jitter testing campaign was performed in an attempt to help validate the SSDT’s simulation models. This paper describes the process used to validate several simulation models and attempt to characterize the ASTERIA jitter by analyzing the size of the resulting spot size for the target stars as a function of wheel speed, having commanded four wheel speeds for each of three stars of known brightness. After summarizing the on-orbit observation and jitter level measurement process, this paper compares the results obtained from the flight operational environment to the corresponding set of simulation jitter levels. Though the flight data obtained during this experiment was not sufficient to validate the simulation’s jitter model, other models have been validated with flight data, including the magnetic field, orbit propagation, sun position, and long-duration orbit decay models, which may be used by all other projects that use the SSDT’s simulation to increase system capability knowledge.

Mohan, Swati↗

Aerosol Models from the AERONET Database: Application to Surface Reflectance Validation Satellite Data

Aerosols play a critical role in radiative transfer within the atmosphere, and they have a significant impact on climate change. In this paper, we propose and implement a framework for developing an aerosol model using their microphysical properties. Such microphysical properties as the size distribution, the complex refractive index, and the percentage of sphericity are derived from the global AERosol RObotic NETwork (AERONET). These measurements, however, are typically retrieved when almucantar measurement procedures are performed (i.e., early mornings and late afternoons with clear sky) and might not have a temporal correspondence to a satellite overpass time, so a valid validation of satellite-derived products cannot be carried out. To address this problem of temporal inconsistency of satellite and ground-based measurements, we developed an approach to retrieve these microphysical properties (and the corresponding aerosol model) using the optical thickness at 440 nm, τ440, and the Ångström coefficient between 440 and 870 nm, α440–870. Such aerosol models were developed for 851 AERONET sites within the last 28 years. Obtained results suggest that empirically microphysical properties can be retrieved with uncertainties of up to 23 %. An exception is the imaginary part of the refractive index ni, for which the derived uncertainties reach up to 38 %. These specific parametric models of aerosol can be used for the studies when retrieval of microphysical properties is required as well as validation of satellite-derived products over land. Specifically, we demonstrate the usefulness of the aerosol models to validate surface reflectance records over land derived from optical remote sensing sensors. We then quantify the propagation of uncertainties in the surface reflectance due to uncertainties with the aerosol model retrieval that is used as a reference from radiative transfer simulations. Results indicate that individual aerosol microphysical properties can impact uncertainties in surface reflectance retrievals between 3.5 × 10(exp -5) to 1 × 10(exp -3) (in reflectance units). The overall impact of microphysical properties combined yields an overall uncertainty in surface reflectance <0.004 (in reflectance units). That corresponds, for example, to 1 to 3 % of the retrieved surface reflectance in the red spectral band (620–670 nm) by the Moderate Resolution Imaging Spectroradiometer (MODIS) instrument. These uncertainty values are well below the specification (0.005 + 0.05ρ; ρ is the retrieved surface reflectance) used for the MODIS atmospheric correction.

Jean-Claude Roger↗

Validation of CrIS Ozone and Carbon Oxide Products from CrIS Single-Field-of-View Retrievals

Single Field-of-view Sounder Atmospheric Products (SiFSAP) from Cross-track Infrared Sounder (CrIS) on S-NPP have been developed at NASA Langley Research center, and recently a significant improvement in its trace gases products has been made. These products are derived based on the Principal Component (PC)-based Radiative Transfer Model (PCRTM) and an optimal estimation retrieval method (PCRTM-RA). Use of the PCRTM in this method allows for fast and accurate calculations for thousands of spectral channels under clear and cloudy sky conditions. The use of principal component to compress information from all spectral channels into the PC domain enables to reduce the observational noise and use the information from all hyperspectral infrared channels. The retrieval is made on PC-domain, and temperature, water vapor, trace gases, cloud and surface parameters are retrieved simultaneously. This presentation will present some validation to the SiFSAP ozone (O3) and carbon monoxide (CO) products. Since the SiFSAP has a spatial resolution of about 14 km at nadir, which is better than most global weather and climate models and enables to make process-oriented analysis of the transport of these gases, this study will focus on validation of CO and O3 products under some extreme weather and/or climate events, such as CO emission and transport from large biomass burning, and O3 variation impacted by fire emission, stratospheric intrusion, and tropical cyclones. Data used in our validation include CO and O3 from NASA aircraft campaigns, plus other satellite products such as CO and O3 from AIRS, IASI and TROPOMI, MOPPIT CO and OMPS O3. Some comparison of SiFSAP O3 with the O3 from the fifth-generation ECMWF reanalysis (ERA5) data the NASA Modern-Era Retrospective Analysis for Research and Applications, Version 2 (MERRA-2) will also present. Such a validation not only helps to quantify the performance of the retrievals in these extreme conditions, but also displays the capability of satellite observation to capture the fine-scale spatial pattern of CO and O3 variation.

Xiaozhen Xiong↗

Slosh-Induced Ullage Collapse Validation by Computational Fluid Dynamics and Application to In-space Propellant Dynamics

Ullage collapse predictions made using Computational Fluid Dynamics (CFD) were validated then made for an in-space cryogenic propellant unsettling application. Ullage collapse is the decrease in propellant tank pressure due to cooling of the ullage gas, which can be significant for cryogenic propulsion systems. Vehicles may be developed that are robust to temperature and pressure changes caused by heat leaks, e.g., propellant tanks with high maximum operation pressures, technologies yielding active thermal conditioning, and systems with ample pressurant for conditioning. These methods are robust because additional mass, cost, and complexity are used to address cryogenic fluid management (CFM). As vehicles are optimized for increased payload capacity, tracking of events such as ullage collapse and self-pressurization in tanks will become increasingly important for propellant inventory calculations. Some ullage collapse events can be studied through ground experimentation, but propellant unsettling in and around in-space coast mission phases must be studied in the absence of an acceleration field. Computational Fluid Dynamics is a powerful tool to address this need, enabling prediction of complex physics prior to flight. Validation of the chosen CFD tool and modeling methodology was done using data from a previously conducted subscale slosh-induced ullage collapse ground test performed in part by the Japan Aerospace Exploration Agency (JAXA). A small tank was partially filled with liquid nitrogen and pressurized with gaseous nitrogen at various temperatures. The tank was oscillated laterally to induce high amplitude slosh dynamics resulting in wave breakup. Successful qualitative validation of slosh wave dynamics and quantitative validation of ullage collapse promoted confidence in extending ullage collapse predictions to a flight application. Mechanisms of ullage collapse caused by main engine cutoff while in-space were identified. Both slosh dynamics leading to engine shutdown and body dynamics following shutdown were shown to contribute to propellant unsettling and ullage collapse.

J M Brodnick↗

Validations of Satellite Ozone Profiles in Austral Spring Using Ozonesonde Measurements in the Jang Bogo Station, Antarctica

Using ozonesonde measurements from 2015 to 2018 at the Jang Bogo station located in the southeastern Antarctic region, we evaluate ozone profiles retrieved from the three satellite measurements that are widely used: Ozone Monitoring Instrument (OMI), Microwave Limb Sounder (MLS), and Ozone Mapping Profiler Suite (OMPS) data. For the fair validation, ozonesonde profiles are smoothed using the weighting function of each satellite retrieval algorithm (i.e., convolution process). Compared with limb-viewing MLS and OMPS ozone profiles, the OMI ozone profiles are relatively less qualified: coarser vertical resolution and larger inter-annual variation. Nevertheless, our validation reveals that the quality of all three satellite ozone profiles looks comparable; In general, difference from ozonesonde profile is ∼1 ppm absolutely, and −20 to 30% relatively at maximum. This quantitative range well corresponds to previous work, meaning that our new validation confirms the reliability of satellite ozone profiles in the southeastern Antarctic region where the measurement data for the validation were not enough. Another interesting feature is the role of a priori ozone profile; Nadir-viewing OMI satellite can have qualified ozone profiles by a proper assumption of a priori ozone profile. Since the performance of limb-viewing ozone profiles is better, however, the careful usage of nadir-viewing ozone profile is still required. We think that the simultaneous usage of multiple satellite ozone profiles can contribute to better understanding of Antarctic ozone characteristics.

Antarctica↗

A Multi-Year Effort to Forward the Validation of Solar Energetic Particle Prediction Models

To enable a consistent and quantitative understanding of solar energetic particle (SEP) model performance, a generalized, automated validation infrastructure, called SPHINX, is being developed by the NASA Space Radiation Analysis Group (SRAG) in close collaboration with the NASA Community Coordinated Modeling Center (CCMC), NASA Moon to Mars Space Weather Analysis Office (M2M), NOAA Space Weather Prediction Center (SWPC), and the Royal Belgian Institute for Space Aeronomy (BIRA-IASB). SPHINX is being developed to evaluate the SEP Scoreboards (https://ccmc.gsfc.nasa.gov/scoreboards/sep/), which are being used by SRAG to support space radiation operations for Mission Control. SPHINX is also being developed through a series of community challenges, which have defined a list of challenge events and a prescribed set of rules of participation. The participation of the research community has enabled the generalization of the infrastructure to validate all the types of outputs being produced by SEP models and fully exercised the framework. The most recent challenge includes 30 SEP events and 33 non-event (quiet) periods and was supported by two dedicated SEPVAL working meetings, one in the US and one in Europe (https://ccmc.gsfc.nasa.gov/community-workshops/ccmc-sepval-2023/). Here, we describe SPHINX and its interactive user interface, SPHINX-VIVID, which will eventually be made available for public use. We present selected results, outcomes, and lessons learned from the SEPVAL working meetings and validation results of the SEP Scoreboards from 2019 to present. These efforts aim to define a set of community standards for SEP model validation and describe the current state-of-the-art of SEP model performance.

Kathryn Whitman↗

A CFD Validation Study using Artemis 1 Orbital Slosh Test Data

Advancements in liquid propellant management science and technologies are key to increasing safety, decreasing cost, and increasing payload mass of NASA space missions. Liquid propellant usually comprises a large portion of the total mass of launch vehicles and spacecraft, so predicting and controlling the motion of it are important. Computational fluid dynamics (CFD) programs are critical to predicting slosh dynamics, but CFD programs require experimental validation with physically relevant test data before the results can be trusted. Low-gravity slosh test data is lacking, and most of what exists is inadequate for CFD validation. A potential slosh risk for Orion, and the lack of validated low-gravity slosh models, led to performing on-orbit slosh tests during the Artemis 1 mission to assess the impacts of slosh on the guidance, navigation, and control of Orion. This work details the validation of a coupled slosh-motion CFD model using the Orion orbital slosh test data set.

CFD↗

A CFD Validation Study Using Artemis 1 Orbital Slosh Test Data

Advancements in liquid propellant management science and technologies are key to increasing safety, decreasing cost, and increasing payload mass of NASA space missions. Liquid propellant usually comprises a large portion of the total mass of launch vehicles and spacecraft, so predicting and controlling the motion of it are important. Computational fluid dynamics (CFD) programs are critical to predicting slosh dynamics, but CFD programs require experimental validation with physically relevant test data before the results can be trusted. Low-gravity slosh test data is lacking, and most of what exists is inadequate for CFD validation. A potential slosh risk for Orion, and the lack of validated low-gravity slosh models, led to performing on-orbit slosh tests during the Artemis 1 mission to assess the impacts of slosh on the guidance, navigation, and control of Orion. This work details the validation of a coupled slosh-motion CFD model using the Orion orbital slosh test data set.

CFD↗

Assessing Technology Maturity for ST-9 Technology Validation Experiments

This viewgraph presentation reviews the process of assessing the maturity of a technology for use in NASA missions. The NASA New Millennium Program (NMP) identifies and flight validates breakthrough technologi es that will significantly benefit future operational Space and Earth Science missions NMP conducts two types of flight validation projec ts for the Space Science Enterprise: (1) Integrated System Validatio n Projects, and (2) Stand-Alone Subsystem Validation Projects.

Space Technology (ST) 9↗

Thermal Design Validation of the Mars Scout Phoenix Payload

This slide presentation reviews the validation of the thermal design for the Mars Scout Phoenix Payload. It includes a description of the Phoenix Mission, the science objectives, the timeline, and the flight system and payloads that were on the lander. The initial responsibility for the development and validation the thermal design was with the developers. This process lacked overall system engineering, there was a difference of thermal expertise, and the number of institutions involved complicated the interactions. The revised approach for payload thermal design validation is described.

thermal design validation↗

Retrieval, Inter-Comparison, and Validation of Above-Cloud Aerosol Optical Depth from A-train Sensors

Absorbing aerosols produced from biomass burning and dust outbreaks are often found to overlay lower level cloud decks and pose greater potentials of exerting positive radiative effects (warming) whose magnitude directly depends on the aerosol loading above cloud, optical properties of clouds and aerosols, and cloud fraction. Recent development of a 'color ratio' (CR) algorithm applied to observations made by the Aura/OMI and Aqua/MODIS constitutes a major breakthrough and has provided unprecedented maps of above-cloud aerosol optical depth (ACAOD). The CR technique employs reflectance measurements at TOA in two channels (354 and 388 nm for OMI; 470 and 860 nm for MODIS) to retrieve ACAOD in near-UV and visible regions and aerosol-corrected cloud optical depth, simultaneously. An inter-satellite comparison of ACAOD retrieved from NASA's A-train sensors reveals a good level of agreement between the passive sensors over the homogeneous cloud fields. Direct measurements of ACA such as carried out by the NASA Ames Airborne Tracking Sunphotometer (AATS) and Spectrometer for Sky-Scanning, Sun-Tracking Atmospheric Research (4STAR) can be of immense help in validating ACA retrievals. We validate the ACA optical depth retrieved using the CR method applied to the MODIS cloudy-sky reflectance against the airborne AATS and 4STAR measurements. A thorough search of the historic AATS-4STAR database collected during different field campaigns revealed five events where biomass burning, dust, and wildfire-emitted aerosols were found to overlay lower level cloud decks observed during SAFARI-2000, ACE-ASIA 2001, and SEAC4RS- 2013, respectively. The co-located satellite-airborne measurements revealed a good agreement (RMSE less than 0.1 for AOD at 500 nm) with most matchups falling within the estimated uncertainties in the MODIS retrievals. An extensive validation of satellite-based ACA retrievals requires equivalent field measurements particularly over the regions where ACA are often observed from satellites, i.e., south-eastern Atlantic Ocean, tropical Atlantic Ocean, northern Arabian Sea, South-East and North-East Asia.

validation↗

Integrated Medical Model Verification, Validation, and Credibility

The Integrated Medical Model (IMM) was designed to forecast relative changes for a specified set of crew health and mission success risk metrics by using a probabilistic (stochastic process) model based on historical data, cohort data, and subject matter expert opinion. A probabilistic approach is taken since exact (deterministic) results would not appropriately reflect the uncertainty in the IMM inputs. Once the IMM was conceptualized, a plan was needed to rigorously assess input information, framework and code, and output results of the IMM, and ensure that end user requests and requirements were considered during all stages of model development and implementation. METHODS: In 2008, the IMM team developed a comprehensive verification and validation (VV) plan, which specified internal and external review criteria encompassing 1) verification of data and IMM structure to ensure proper implementation of the IMM, 2) several validation techniques to confirm that the simulation capability of the IMM appropriately represents occurrences and consequences of medical conditions during space missions, and 3) credibility processes to develop user confidence in the information derived from the IMM. When the NASA-STD-7009 (7009) was published, the IMM team updated their verification, validation, and credibility (VVC) project plan to meet 7009 requirements and include 7009 tools in reporting VVC status of the IMM. RESULTS: IMM VVC updates are compiled recurrently and include 7009 Compliance and Credibility matrices, IMM VV Plan status, and a synopsis of any changes or updates to the IMM during the reporting period. Reporting tools have evolved over the lifetime of the IMM project to better communicate VVC status. This has included refining original 7009 methodology with augmentation from the NASA-STD-7009 Guidance Document. End user requests and requirements are being satisfied as evidenced by ISS Program acceptance of IMM risk forecasts, transition to an operational model and simulation tool, and completion of service requests from a broad end user consortium including Operations, Science and Technology Planning, and Exploration Planning. CONCLUSIONS: The VVC approach established by the IMM project of combining the IMM VV Plan with 7009 requirements is comprehensive and includes the involvement of end users at every stage in IMM evolution. Methods and techniques used to quantify the VVC status of the IMM have not only received approval from the local NASA community but have also garnered recognition by other federal agencies seeking to develop similar guidelines in the medical modeling community.

Validation↗

Qualitative Validation of the IMM Model for ISS and STS Programs

To validate and further improve the Integrated Medical Model (IMM), medical event data were obtained from 32 ISS and 122 STS person-missions. Using the crew characteristics from these observed missions, IMM v4.0 was used to forecast medical events and medical resource utilization. The IMM medical condition incidence values were compared to the actual observed medical event incidence values, and the IMM forecasted medical resource utilization was compared to actual observed medical resource utilization. Qualitative comparisons of these parameters were conducted for both the ISS and STS programs. The results of these analyses will provide validation of IMM v4.0 and reveal areas of the model requiring adjustments to improve the overall accuracy of IMM outputs. This validation effort should result in enhanced credibility of the IMM and improved confidence in the use of IMM as a decision support tool for human space flight.

risk assessment↗

Recalibration and Validation of the SMAP L-Band Radiometer

SMAP mission was launched on 31st January 2015 in a 6 AM 6 PM sun-synchronous orbit at 685 km altitude to measure soil moisture and freethaw globally. The passive instrument of SMAP is a fully polarimetric L-band radiometer (1.4GHz) operating with a bandwidth of 24MHz. The radiometer L1B data product version 3 has been released for public science activities. Post-launch calibration and validation activities are described in [4,5]. Validation results show that SMAP antenna temperature (TA) is 2.6 K warmer over galactic Cold Sky (CS), and land TB is 2.6 K colder comparing to SMOS land TB (compared at the top of the atmosphere) after the update of the reflectors thermal model. Due to the biases, the SMAP radiometer is under re-calibration for next data release in 2018.We present the updated calibration approaches for the SMAP radiometer product. We will discuss the various radiometer calibration parameters and part of the validation process and result.

SMAP↗