SEARCH · Search NASA

Results for “validations”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8

All sources NASA NTRS DOE OSTI

NASA NTRS2016

The Geoscience Spaceborne Imaging Spectroscopy Technical Committees Calibration and Validation Workshop

Calibration is the process of quantitatively defining a system's responses to known, controlled signal inputs, and validation is the process of assessing, by independent means, the quality of the data products derived from those system outputs [1]. Similar to other Earth observation (EO) sensors, the calibration and validation of spaceborne imaging spectroscopy sensors is a fundamental underpinning activity. Calibration and validation determine the quality and integrity of the data provided by spaceborne imaging spectroscopy sensors and have enormous downstream impacts on the accuracy and reliability of products generated from these sensors. At least five imaging spectroscopy satellites are planned to be launched within the next five years, with the two most advanced scheduled to be launched in the next two years [2]. The launch of these sensors requires the establishment of suitable, standardized, and harmonized calibration and validation strategies to ensure that high-quality data are acquired and comparable between these sensor systems. Such activities are extremely important for the community of imaging spectroscopy users. Recognizing the need to focus on this underpinning topic, the Geoscience Spaceborne Imaging Spectroscopy (previously, the International Spaceborne Imaging Spectroscopy) Technical Committee launched a calibration and validation initiative at the 2013 International Geoscience and Remote Sensing Symposium (IGARSS) in Melbourne, Australia, and a post-conference activity of a vicarious calibration field trip at Lake Lefroy in Western Australia.

Ong, Cindy↗

NASA NTRS2018

Use of the Ames Check Standard Model for the Validation of Wall Interference Corrections

The new check standard model of the NASA Ames 11-ft Transonic Wind Tunnel was chosen for a future validation of the facility's wall interference correction system. The chosen validation approach takes advantage of the fact that test conditions experienced by a large model in the slotted part of the tunnel's test section will change significantly if a subset of the slots is temporarily sealed. Therefore, the model's aerodynamic coefficients have to be recorded, corrected, and compared for two different test section configurations in order to perform the validation. Test section configurations with highly accurate Mach number and dynamic pressure calibrations were selected for the validation. First, the model is tested with all test section slots in open configuration while keeping the model's center of rotation on the tunnel centerline. In the next step, slots on the test section floor are sealed and the model is moved to a new center of rotation that is 33 inches below the tunnel centerline. Then, the original angle of attack sweeps are repeated. Afterwards, wall interference corrections are applied to both test data sets and response surface models of the resulting aerodynamic coefficients in interference-free flow are generated. Finally, the response surface models are used to predict the aerodynamic coefficients for a family of angles of attack while keeping dynamic pressure, Mach number, and Reynolds number constant. The validation is considered successful if the corrected aerodynamic coefficients obtained from the related response surface model pair show good agreement. Residual differences between the corrected coefficient sets will be analyzed as well because they are an indicator of the overall accuracy of the facility's wall interference correction process.

wind tunnel wall interferenc↗

NASA NTRSDate not supplied

Validation of the Aeroplanets Model in a Present-Day Earth Simulation

We present a validation of the Aeroplanets/Aerochemistry model (Gronoff et al. 2012; Airapetian et al. 2016), a one-dimensional photochemistry model, with another one-dimensional photochemistry model implemented in Hu et al. 2016. Results from a simulation of the atmosphere of present-day Earth from both models were used in the validation. Realistic initial conditions and concentrations were used in the validation, including surface emissions of CO, CH4, NH3, N2O, NO, SO2, OCS, H2S, and H2SO4. As part of the validation, we compare the vertical profile of concentration of key chemical species, including O3, N2O, NO, NO2, HNO3, HO2, OH, and CH4. Our model was able to create vertical concentration profiles of these species that closely matched the results from Hu et al. 2016. With the successful validation, we plan to use the Aeroplanets model to explore the role of ions and aerosols, formed the interaction of solar energetic particles and the atmosphere of early Earth, in generating key greenhouse gas species and gas species that support the formation of molecules crucial for life.

Bradley Michael Hegyi↗

NASA NTRSDate not supplied

Virtual Fit Assessment: Validation using Historical Spacesuit Fit Data

Virtual fit tests using 3D body scans have provided a cost-effective means to predictively assess spacesuit fit for the current and future astronaut population. However, fit is a complex issue influenced by physical interferences, subjective preference, and many other factors. Fit can substantially differ between the type of hardware, environmental conditions, and tasks being performed. Namely, fit changes across different contexts, such as 3D printed mockup evaluations, pressurized one-g suited test events, neutral buoyancy and other training events, and flight extravehicular activities (EVA). These challenges make it difficult to validate virtual fit frameworks to physical suit sizing. This study proposes a new method of validation using the wealth of historically archived suit fit data. Physically Assessed Fit (PAF) data was assessed from astronauts and test volunteers who wore the legacy Extravehicular Mobility Unit (EMU). The data was collected during the past decades at NASA and considered to be most reliable and dependable. Each participant was 3D scanned for body shape and spacesuit-critical dimensions were measured per NASA guidelines. The participants’ size preference for hard upper torso (HUT) assembly was retrieved from their pressurized suit fit check records. Fit assessments were also updated after one-g EVA training, neutral buoyancy training, and EVA flights. Virtually Assessed Fit (VAF) was done by overlaying the CAD model of a HUT with the 3D body scans of the PAF participants. Each body scan was iteratively adjusted for the position inside the HUT to minimize the suit-to-body contact interference while satisfying a set of prescribed requirements. Then the residual contact area, depth, and volume were quantified as VAF metrics. This process was repeated for the different HUT sizes, including medium, large, and extra-large. Statistical modeling is currently in progress and will be presented at the conference. A statistical classifier will be developed to predict a fit probability for different HUT sizes as a function of the corresponding person’s VAF metrics. The HUT size with the highest fit probability will constitute the most likely size selection for the person, and the prediction will be compared against the corresponding PAF data. The participant data will be randomly pre-grouped into either a model development or validation subset. While the model development subset will be used to build the probability model, the validation subset will be used to assess the model accuracy. Also, the locations and magnitudes of suit-body-contacts will be estimated from VAF. This information can identify the critical suit geometry and body shape features that influence suit fit. The variations found in PAF size selections by subjects with similar VAF metrics will allow for investigations into subjective preferences, for example, tight versus loose fit. Overall, this study is expected to provide a structured validation of a virtual suit fit framework, which has not been possible in the past. The outcome can also provide useful insights and potential limitations for interpreting virtual fit tests for future spacesuit designs and population accommodation.

Han Kim↗

NASA NTRS2020

Spatial validation reveals poor predictive performance of large-scale ecological mapping models

Mapping aboveground forest biomass is central for assessing the global carbon balance. However, current large-scale maps show strong disparities, despite good validation statistics of their underlying models. Here, we attribute this contradiction to a flaw in the validation methods, which ignore spatial autocorrelation (SAC) in data, leading to overoptimistic assessment of model predictive power. To illustrate this issue, we reproduce the approach of large-scale mapping studies using a massive forest inventory dataset of 11.8 million trees in central Africa to train and validate a random forest model based on multispectral and environmental variables. A standard nonspatial validation method suggests that the model predicts more than half of the forest biomass variation, while spatial validation methods accounting for SAC reveal quasi-null predictive power. This study underscores how a common practice in big data mapping studies shows an apparent high predictive power, even when predictors have poor relationships with the ecological variable of interest, thus possibly leading to erroneous maps and interpretations.

biomass↗

NASA NTRSDate not supplied

Validation of Actuator Disk, Actuator Line and Sliding Mesh Methods within the LAVA Solver

In this study the implementation of actuator-disk, actuator-line and sliding-mesh methodologies in the Launch Ascent and Vehicle Aerodynamics (LAVA) solver is described and validated against several test-cases. The different models are validated against available numerical as well as experimental data. Both steady and unsteady Reynolds-Averaged Navier-Stokes (RANS) simulations using the Spallart Allmaras (SA) turbulence model are performed for several different configurations representative of aeroscience applications. The first part of the paper is focused on the verification and validation of the implemented propulsor models. The first validation case is a theoretical rotor in hover, compared with the 1D analytical solution derived from momentum theory. The second validation is the Rotor-Airframe Interaction Model of Georgia Institute of Technology (GIT), representing the application of actuator disks to top-mounted rotorcraft vehicles or unmanned aerial vehicles (UAVs). The third case is a representative configuration for tip-mounted rotor-craft vehicles such as NASA’s X57 airplane. The second part of the paper shows the implemented models applied to realistic engineering configurations such as NASA’s X57 airplane and the R4 Advanced Ducted Propellor (ADT). A modification to the actuator line method in order to represent the blade geometry more closely is proposed and comparisons with simulations modeling the blade utilizing a sliding-mesh approach are made.

ARMD↗

NASA NTRSDate not supplied

A Ground-Based Network for Improved Validation of Satellite Carbon Dioxide and Methane Observations Over the Eastern United States

Satellite observations of greenhouse gases (GHGs), notably carbon dioxide and methane, over the Eastern United States, are currently only validated indirectly and/or sporadically. There are only four existing routine, ground-based remote sensing locations in the United States suitable for validation of satellite GHG observations: Edwards and Pasadena, CA, Lamont, OK, and Park Falls, WI as part of the Total Carbon Column Observing Network (TCCON). Among other efforts, e.g. the Network for the Detection of Atmospheric Composition Change (NDACC) and EM27/SUN deployments led by the University of Toronto, the only sites west of the Mississippi River are Park Falls, WI and Toronto, ON. The only remaining validation tools, vicarious calibration and airborne campaigns, are sporadic in space and/or time and thus coincide with only a small subsample of available soundings and conditions. As a result, satellite GHG observations over the east coast of the United States, home to more than half of its population, lack a consistent, widespread means of validation. We describe an ongoing effort to position 8 EM27/SUN spectrometers along the Eastern Seaboard over the next two years. The goals of this effort are to improve both satellite validation and our understanding of human and natural influences on the carbon cycle of the Eastern US, the former enabling the latter. This work is intended to augment past, ongoing, and future inter-agency programs, e.g., the NIST Urban Testbed, routine aircraft and aircore sampling by NOAA, and NASA’s Atmospheric Carbon and Transport (ACT)-America sub-orbital campaign, in particular by offering information on broader time and spatial scales than what is already available while maintaining the high-accuracy constraints of in situ data. We will present early analysis including siting considerations to capture local and/or background conditions and comparison to NASA’s Goddard Earth Observing System (GEOS) modeling and assimilation systems. This includes a 40-day, 3-km horizontal resolution global simulation of early 2020 and a 50-km retrospective analysis of Orbiting Carbon Observatory 2 (OCO-2) observations over 2015-present. Both are valuable tools for analyzing expected and observed signals and are useful boundary conditions for yet higher-resolution studies.

Brad Weir↗

NASA NTRSDate not supplied

Impact Real World System Validation

Introduction NASA has developed a new evidence-based data-driven probabilistic risk assessment and tradespace analysis tool as a successor to the Integrated Medical Model. This updated decision support tool is known as IMPACT (Informing Mission Planning via Analysis of Complex Tradespaces). IMPACT estimates the frequency and consequences of medical conditions that might arise during exploration missions. A validation analysis of IMPACT was performed with respect to a set of International Space Station (ISS) and Shuttle Transportation System (STS) real world system (RWS) referent data due to the limited referent data available from exploration missions. Methods Observed mission and crew characteristics from STS and ISS missions were used as model inputs within MEDPRAT (Medical Extensible Dynamic Probabilistic Risk Assessment Tool). For each mission, two hundred thousand simulations were generated. For each mission, model outputs included occurrence counts for each condition, total medical events (TME), and the probability of loss of crew life (LOCL). These simulated model outputs were compared to the RWS referent data. Results The predicted number of total medical events exceeded the total RWS medical events for ISS missions and combined ISS and STS missions and fell within the 90% confidence interval for STS missions. For the 32 ISS missions simulated by IMPACT, the number of total medical events was overpredicted for 19 missions and fell within the 90% confidence interval for 13 missions. For the 21 STS missions, the total number of medical events was overpredicted for 3 missions, fell within the 90% confidence interval for 16 missions, and was underpredicted for 2 missions. Combined, 29 missions were in range, 22 were overpredicted, and 2 were underpredicted. The predicted LOCL probability for the 32 ISS missions, the 21 STS missions, and the combined ISS and STS missions was consistent with the zero LOCL events observed in the RWS referent data. The validation analysis included a comparison of the number of medical events predicted by IMPACT and the number of medical events observed in the RWS data on a condition-by-condition basis. For ISS missions, 50 conditions were in range, 52 conditions were statistically underpowered (not enough observed sample to draw any conclusions on precision), 8 conditions were overpredicted, and 9 conditions were underpredicted. Overall, only 14% (17/119) of conditions were out of range for STS missions, 40 conditions were in range, 59 conditions were statistically underpowered, 10 conditions were overpredicted, and 10 conditions were underpredicted. Overall, only 17% (20/119) of conditions were out of range. For combined ISS and STS missions, 11 conditions were overpredicted, and 11 conditions were underpredicted. Overall, only 18% (22/119) of conditions were out of range. For combined ISS and STS missions, 49 conditions were in range, 46 conditions were statistically underpowered, 18 conditions were overpredicted, and 8 conditions were underpredicted. Overall, 21% (26/121) of conditions were out of range. Conclusion The results of this validation analysis should not be interpreted as a pass/fail test of the validity of IMPACT. Instead, this validation analysis should be used to assess some of the IMPACT outcomes in terms of consistencies and inconsistencies with the ISS and STS RWS referent data.

L. Boley↗

NASA NTRS2024

NASA HECC Geometry and Performance Review Part 1: Validation of a Computational Model for the Vaneless Diffuser Configuration with As-Manufactured Impeller Geometry

An investigation of the NASA High Efficiency Centrifugal Compressor (HECC) vaneless diffuser configuration was performed. This multipart investigation presents an extensive validation of the computational model against experimental data. The validated model was then used to explore the effects geometric differences between the as-manufactured and design-intent impellers. Lastly, the validated model was used for comparison against an experimental tip clearance study. Part I of the investigation focused on describing the HECC vaneless computational model and its validation against the experimental data published in GT2023-103128. To generate the model, a verification of the manufactured impeller was performed and was confirmed to match the impeller CAD. Section data from the impeller CAD, referred to as the As-Manufactured geometry, were used for development of the computational model. Steady RANS simulations utilizing the Wilcox K-Omega 98 turbulence model and a multiblock structured mesh were used to conduct a mesh convergence study. The resultant mesh was then used for simulations at both design-speed and off-design speed conditions. The simulations compared well to data in both 1D and 2D terms for the major performance metrics of efficiency, total pressure rise, and total temperature rise. Based on the observed results the model was deemed validated and was used in the latter two parts of the multipart investigation.

centrifugal compressor↗

NASA NTRSDate not supplied

NASA HECC Geometry and Performance Review Part 1: Validation of a Computational Model for the Vaneless Diffuser Configuration with As-Manufactured Impeller Geometry

An investigation of the NASA High Efficiency Centrifugal Compressor (HECC) vaneless diffuser configuration was performed. This multipart investigation focused on validating the computational model against experimental data. The validated model was then used to explore the effects of observed geometric differences between the as-manufactured and design-intent impellers. Lastly, the validated model was used for comparison against an experimental tip clearance study. Details regarding each of the parts are detailed below: A multipart investigation of the NASA High Efficiency Centrifugal Compressor (HECC) vaneless diffuser configuration was performed. Part I of the investigation focused on describing the HECC vaneless computational model and its validation against the experimental data published in GT2023-103128. To generate the model, a verification of the manufactured impeller was performed and was confirmed to match the impeller CAD. Section data from the impeller CAD, referred to as As-Manufactured, were used in the model. Steady RANS simulations using a multiblock structured mesh were used to conduct a mesh convergence study. The resultant mesh was then used for simulations at both design-speed and off-design speed conditions. The simulations compared well to data in both 1D and 2D terms. Based on the observed results the model was deemed validated and was used in the latter two parts of the multipart investigation.

centrifugal compressor↗

NASA NTRSDate not supplied

In-Situ Scanning Electron Microscope Experiments for Microscale Mechanical Testing and Validated Modeling of Fiber Reinforced Thermoplastics

A novel, in-situ, scanning electron microscope (SEM) mechanical testing capability for materials at the microscale which provides experimental validation to a machine learning (ML) toolset for full-field validation of physics-based micromechanics models is being developed by researchers at NASA Glenn Research Center. These are enabling technologies for the integration of multiscale digital twins for materials into system level models which will result in the improved performance, material discovery, reduced production cost and time, rapid characterization, and prognostic structural health monitoring (SHM) for materials and structures for extreme environments in support of NASA space exploration missions. In order to bridge the material structure-to-system gap for digital twins, physics-based models must be experimentally validated at multiple length scales. Seminal microscale experiments, conducted at the Air Force Research Laboratory (AFRL), were limited to transverse compression of single-layer, unidirectional thermoset polymer matrix composite (PMC) micropillar specimens [1]. The early phases of the current project followed those initial results and setup to reproduce the compression testing of PMC material on the custom-built piezoelectric actuated micromechanical testing rig built by MicroTesting Solutions LLC. In this work, samples of thermoplastic PMC material were first machined into 3 mm cubes, and then further machining and final milling was done using a Focused Ion Beam (FIB). The initial experiment was done on a pillar roughly 20 µm x 20 µm x 40 µm tall. Additional pillars were milled with final sizes ranging from 20 µm x 20 µm x 40 µm tall to 40 µm x 40 µm x 65 µm tall. A speckle pattern for in-situ full-field measurements using Digital Image Correlation (DIC) was applied with platinum, which was coated on the surface, and then the FIB was used to mill away some of the coating to produce an irregular pattern of Pt on the pillar surface. The samples were loaded into the custom testing rig and placed into the SEM and loaded under compression until failure. Images were collected in the SEM during testing. Post-processing of the images was conducted using DIC to obtain full-field displacement and strain measurements elucidating the role of the matrix as well as fiber-fiber interaction at the microscale within the composite subjected to compression loading well into the non-linear regime of the material. Moreover, the evolution of fiber-matrix debonding and matrix cracking is observed in-situ at the microscale. This data, along with images segmented with a newly developed ML toolset [2], was used to create and validate physics-based micromechanics models. An image of the failed micropillar is shown in Figure 1. The techniques developed in the initial compression experiment was tailored to the validation needs of the models and expanded to include different sized samples as well as possibly tension and fatigue.

Laura Wilson↗

NASA NTRS2021

Validation of Soil Moisture Data Products from the NASA SMAP Mission

The National Aeronautics and Space Administration (NASA)Soil Moisture Active Passive(SMAP) mission has been validatingits soil moisture (SM) products since the start of data production onMarch 31, 2015. Prior to launch, the mission defined a set of criteria for core validation sites (CVS) that enable the testing of the key mission SM accuracy requirement(unbiased root-mean-square error <0.04 m3/m3). Thevalidation approach also includes other (“sparse network”) in situSM measurements, satellite SM products, model-based SM products, and field experiments. Over the past six years, the SMAP SM products have been analyzed with respect to thesereference data,and the analysis approaches themselves have been scrutinizedin an effort to best understand the products’ performance. Validation of themost recent SMAP Level 2 and 3 SMretrievalproducts (R17000) shows that the L-band (1.4 GHz) radiometer-based SM record continues to meet mission requirements. The products aregenerallyconsistentwith SM retrievals from the European Space Agency (ESA)Soil Moisture Ocean Salinity mission, althoughthere aredifferencesin some regions. The high-resolution (3-km) SM retrieval product,generated by combining Copernicus Sentinel-1 data with SMAP observations,performswithin expectations. Currently, however,there is limited availability of3-kmCVSdatato support extensive validation at this spatial scale. The most recent (version 5)SMAP Level4 SMdata assimilation productprovidingsurface and root-zone SM with complete spatio-temporal coverageat 9-km resolution also meets performance requirements. The SMAP SM validation program will continue throughout the mission life; futureplans include expanding ittoforestedand high-latituderegions

SMAP↗

NASA NTRSDate not supplied

Exploitation of a Validation Hierarchy for Modeling and Simulation

Across engineering there is an evolving need to increase reliance on physics-based simulation to develop, design and optimize engineering systems. This increased reliance on modeling and simulation has highlighted a growing need to transform the confidence that modeling and simulation analysts have in their results into credibility for systems engineers to design and field systems more quickly and with less physical testing. For isolated components of a complex system, where a single discipline may drive product design, this is less of a concern as the relationship is often straightforward and easy to explain. However, when these isolated components are integrated, and are expected to operate in a multi-disciplinary context in which safety critical systems are involved, new concepts and model assurance standards are required. In this paper we address this challenge by showing how a model validation hierarchy can be exploited to identify those model validation experiments that will contribute most to increasing confidence and credibility of modeling and simulation predictions. The approach that is adopted contains four main steps. The first step is the construction of a model validation hierarchy that links subsystems, assemblies, and components to a hierarchy of physical experiments that can be used support model validation. This hierarchy connects the concerns of systems engineers to those of the modeling and simulation analyst in a clear and logical way. The structure and content of this hierarchy is then used in a second step to establish which physical phenomena have the greatest impact on overall system performance metrics. A gap analysis technique, based upon modeling and simulation concerns, is then used to prioritize the important physical phenomenon. Unfortunately, a common outcome of such gap analyses is the identification of many important gaps and so, in the final step of our process, we advocate the use of a global sensitivity analysis as a means to complete the prioritization.

Verification and Validation↗

NASA NTRSDate not supplied

Exploitation of a Validation Hierarchy for Modeling and Simulation

Verification and Validation↗

NASA NTRS2001

A semi-automatic method for left ventricle volume estimate: an in vivo validation study

This study aims to the validation of the left ventricular (LV) volume estimates obtained by processing volumetric data utilizing a segmentation model based on level set technique. The validation has been performed by comparing real-time volumetric echo data (RT3DE) and magnetic resonance (MRI) data. A validation protocol has been defined. The validation protocol was applied to twenty-four estimates (range 61-467 ml) obtained from normal and pathologic subjects, which underwent both RT3DE and MRI. A statistical analysis was performed on each estimate and on clinical parameters as stroke volume (SV) and ejection fraction (EF). Assuming MRI estimates (x) as a reference, an excellent correlation was found with volume measured by utilizing the segmentation procedure (y) (y=0.89x + 13.78, r=0.98). The mean error on SV was 8 ml and the mean error on EF was 2%. This study demonstrated that the segmentation technique is reliably applicable on human hearts in clinical practice.

NASA Discipline Cardiopulmonary↗

NASA NTRS2004

Mars Exploration Rover Mission: Entry, Descent, and Landing System Validation

System validation for a Mars entry, descent, and landing system is not simply a demonstration that the electrical system functions in the associated environments. The function of this system is its interaction with the atmospheric and surface environment. Thus, in addition to traditional test-bed, hardware-in-the-loop, testing, a validation program that confirms the environmental interaction is required. Unfortunately, it is not possible to conduct a meaningful end-to-end test of a Mars landing system on Earth. The validation plan must be constructed from an interconnected combination of simulation, analysis and test. For the Mars Exploration Rover mission, this combination of activities and the logic of how they combined to the system's validation was explicitly stated, reviewed, and tracked as part of the development plan.

system validation↗

NASA NTRS2017

Development of Level 2 Calibration and Validation Plans for GOES-R; What is a RIMP?

Calibration and Validation (CalVal) plans for Geostationary Operational Environmental Satellite version R (GOES-R) Level 2 (L2) products were documented via Resource, Implementation, and Management Plans (RIMPs) for all of the official L2 products required from the GOES-R Advanced Baseline Imager (ABI). In 2015 the GOES-R program decided to replace the typical CalVal plans with RIMPs that covered, for a given L2 product, what was required from that product, how it would be validated, and what tools would be used to do so. Similar to Level 1b products, the intent was to cover the full spectrum of planning required for the CalVal of L2 ABI products. Instead of focusing on step-by-step procedures, the RIMPs concentrated on the criteria for each stage of the validation process (Beta, Provisional, and Full Validation) and the many elements required to prove when each stage was reached.

Validation↗

NASA NTRS2017

Development of Level 2 Calibration and Validation Plans for GOES-R; What is a RIMP?

Validation↗