SEARCH · Search NASA

Results for “benchmark and validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14

All sources NASA NTRS DOE OSTI

NASA NTRS1997

The Benchmark Active Controls Technology Model Aerodynamic Data

The Benchmark Active Controls Technology (BACT) model is a part of the Benchmark Models Program (BMP). The BMP is a NASA Langley Research Center program that includes a series of models which were used to study different aeroelastic phenomena and to validate computational fluid dynamics codes. The primary objective of BACT testing was to obtain steady and unsteady loads, accelerations, and aerodynamic pressures due to control surface activity in order to calibrate unsteady CFD codes and active control design tools. Three wind-tunnel tests in the Transonic Dynamics Tunnel (TDT) have been completed. The first and parts of the second and third tests focused on collecting open-loop data to define the model's aeroservoelastic characteristics, including the flutter boundary across the Mach range. It is this data that is being presented in this paper. An extensive database of over 3000 data sets was obtained. This database includes steady and unsteady control surface effectiveness data, including pressure distributions, control surface hinge moments, and overall model loads due to deflections of a trailing edge control surface and upper and lower surface

Scott, Robert C.↗

NASA NTRS2015

On-Orbit Quantitative Real-Time Gene Expression Analysis Using the Wetlab-2 System

NASA Ames Research Center's WetLab-2 Project enables on-orbit quantitative Reverse Transcriptase PCR (qRT-PCR) analysis without the need for sample return. The WetLab-2 system is capable of processing sample types ranging from microbial cultures to animal tissues dissected on-orbit. The project developed a RNA preparation module that can lyse cells and extract RNA of sufficient quality and quantity for use as templates in qRT-PCR reactions. Our protocol has the advantage of using non-toxic chemicals and does not require alcohols or other organics. The resulting RNA is dispensed into reaction tubes that contain all lyophilized reagents needed to perform qRT-PCR reactions. System operations require simple and limited crew actions including syringe pushes, valve turns and pipette dispenses. The project selected the Cepheid SmartCycler (TradeMark), a Commercial-Off-The-Shelf (COTS) qRT-PCR unit, because of its advantages including rugged modular design, low power consumption, rapid thermal ramp times and four-color multiplex detection. Single tube multiplex assays can be used to normalize for RNA concentration and integrity, and to study multiple genes of interest in each module. The WetLab-2 system can downlink data from the ISS to the ground after a completed run and uplink new thermal cycling programs. The ability to conduct qRT-PCR and generate results on-orbit is an important step towards utilizing the ISS as a National Laboratory facility. Specifically, the ability to get on-orbit data will provide investigators with the opportunity to adjust experimental parameters in real time without the need for sample return and re-flight. On orbit gene expression analysis can also eliminate the confounding effects on gene expression of reentry stresses and shock acting on live cells and organisms or the concern of RNA degradation of fixed samples and provide on-orbit gene expression benchmarking prior to sample return. Finally, the system can also be used for analysis of air, surface, water, and clinical samples to monitor environmental pathogens and crew health. The validation flight of the WetLab-2 system using E. coli bacteria and mouse liver launched on SpaceX-7 in June 2015 and will remain on the ISS National Laboratory.

ISS tools↗

NASA NTRSDate not supplied

Reconstruction of Thermal Protection System Aeroheating using a Green’s Function Approach

Inverse heat transfer (IHT) techniques are often used to reconstruct the surface heating conditions on spacecraft thermal protection systems (TPS) during atmospheric entry. Current IHT techniques for entry spacecraft applications, however, demand substantial computational resources, and are impractical for analyses such as uncertainty quantification and real-time health monitoring. In this paper, a Green’s function sensor fusion approach is used to reconstruct the TPS surface aeroheating conditions on experimental spaceflight and ground test systems from collocated temperature and heat flux sensors embedded in the TPS. The algorithm leverages Green’s functions to model the heat conduction within the spacecraft TPS and stabilizes the recovery of the surface heating condition using the direct heat flux sensor measurement. The algorithm is validated using arc-jet ground test data and applied to the reconstruction of the Mars 2020 backshell heating during Martian atmospheric entry. The performance of the algorithm is benchmarked against a current state-of-the-art IHT framework, FIAT_Opt. The Green’s function-based reconstruction algorithm recovers the net hot-wall heat flux absorbed by the TPS and the incident heat flux from the atmospheric entry environment in close agreement with FIAT_Opt. Notably, computation of the surface heating condition is completed in three orders of magnitude less time with the Green’s function sensor fusion approach using a consumer-grade PC, versus with FIAT_Opt running on a high performance computer cluster. The efficiency of the algorithm is leveraged to compute the uncertainty contributions of input parameters to the total uncertainty in reconstructed Mars 2020 backshell heating for the full atmospheric entry heat pulse. The sensitivity analysis uncovers that, at different times throughout the entry heat pulse, uncertainties in the TPS specific heat, thermal conductivity, and emissivity are all dominant drivers of the reconstruction uncertainty. These results demonstrate Green’s functions and sensor-fusion techniques as promising IHT approaches to reconstruct atmospheric entry environments from TPS-embedded measurements, and highlight how these techniques may give access to post-flight analyses previously hindered by the prohibitive cost of current methods.

Kenneth McAfee↗

NASA NTRSDate not supplied

Reconstruction of Thermal Protection System Aeroheating using a Green’s Function Approach

Kenneth McAfee↗

NASA NTRS2013

Global Light System for JEM-EUSO

The Global Light System (GLS) is a network of ground-based Xenon flash lamps and steered UV lasers to validate the key functions of the JEM-EUSO instrument. These functions include triggering efficiency, the accuracy of intrinsic luminosity measurements, and the reconstructed pointing direction accuracy. GLS units will generate benchmark optical signatures in the atmosphere with similar characteristics to the optical signals of cosmic ray EASs. The lasers will generate tracks and the flashers will generate point flashes. But unlike air showers, the number, energy, precise time, direction (lasers) can be specified. JEM-EUSO will reconstruct the pointing directions of the lasers and the energy of the lasers and flash lamps to monitor the detector's triggers, and accuracy of energy and direction reconstruction. 12 GLS units will be deployed at selected sites around the globe. The JEM-EUSO footprint will pass over a GLS unit on average once per (near) moonless night under clear conditions for appropriately selected sites. The 12 units will be supplemented by campaign style measurements with an airborne unit that will be flown over the open ocean at selected altitudes under JEM-EUSO. A GLS prototype in an airplane will support a high-altitude balloon flight in 2014 of a proto-type JEM-EUSO telescope. We will describe the concept and system design and report on the status of prototyping and the selection process for candidates sites.

Christl, Mark↗

NASA NTRSDate not supplied

A Combined Computational, Experimental, and Technology Development Approach to In-Space Laser Manufacturing Maturation at NASA Marshall Space Flight Center

In-space manufacturing (ISM) is emerging as a field vital to continued access and capabilities in the space environment. NASA Marshall Space Flight Center (MSFC) is advancing the frontier of in-space laser manufacturing (ISLM) techniques through work initially focused on maturing laser beam welding (LBW) and laser forming (LF) for use in space. Such techniques proffer the ability to assemble and join structures in space from sheet metal or other stock – extant satellites, in situ resource utilization of Lunar regolith, etc. – by forming to desired shapes and then joining via in-space welding (ISW). ISLM processes are useful for assembly, joining, modification, and repair of structures in free space and on the Lunar surface such as large observatories, antennas, trusses, blast/thermal/radiation shields, pressure vessels, and more. However, these techniques are not yet qualified & certified (Q&C) for regular application in space. It would be prohibitively expensive, laborious, and time-consuming to perform Q&C via traditional experimental approaches as data collection & experimentation in space is resource-intensive. As such, benchmark experiments and focused, properly instrumented technology demonstration efforts in space can collect sufficient data that – when combined with verified computational models in an integrated computational materials engineering (ICME) approach – can validate ICME tools capable of translating more readily obtained ground data to in-space, in situ, computationally informed Q&C of ISLM techniques. Several ISLM projects at MSFC are obtaining the data required to validate ICME tools through both ground and flight experiments. A parabolic flight experiment of LBW under vacuum is manifested for August 2024, including both microgravity and Lunar gravity profiles. This collaboration with the Ohio State University is investigating common aerospace alloys such as 316L stainless steel, 2219 aluminum alloy, and Ti64 titanium alloy. In situ data collection includes videography, thermography, and reference thermocouples to build a thermal model of the welds. This will elucidate the relevant physics when combined with post-flight microstructural examination and mechanical testing. MSFC is also progressing towards a suborbital flight experiment of LBW under vacuum, which could provide reams of data on ISW during sustained, high-quality reduced gravity. The effect of combined thermal (cryogenic and high-temperature) and vacuum exposure on both LBW (NASA-funded) and LF (DARPA-funded) is being investigated through ground experiments. In addition to the copious data collected during these ground experiments, ruggedization of LBW hardware will also be pursued. The datasets from these experiments will be used to validate computational models which will inform future ISLM efforts in an ICME framework. A variety of techniques across lengths scales, from CALPHAD-driven thermodynamics & kinetics to phase field modeling of solidification to kinetic Monte Carlo simulations of grain evolution at the mesoscale, will be employed to accelerate the infusion and eventual Q&C of LBW and LF for use in space. The development of data-driven surrogate models to bridge ground to flight experiments and thereby reduce the need for resource-intensive experiments in space will also be investigated. These ICME techniques, surrogate models, and datasets from ground testing can also be employed to advance manufacturing in terrestrial environments.

in-space welding↗

NASA NTRS1999

Spaceflight Validation of Hzetrn Code

HZETRN is being developed as a fast deterministic radiation transport code applicable to neutrons, protons, and multiply charged ions in the space environment. It was recently applied to 50 hours of IMP8 data measured during the August 4, 1972 solar event to map the hourly exposures within the human body under several shield configurations. This calculation required only 18 hours on a VAX 4000 machine. A similar calculation using the Monte Carlo method would have required two years of dedicated computer time. The code has been benchmarked against well documented and tested Monte Carlo proton transport codes with good success. The code will allow important trade studies to be made with relative ease due to the computational speed and will be useful in assessing design alternatives in an integrated system software environment. Since there are no well tested Monte Carlo codes for HZE particles, we have been engaged in flight validation of the HZETRN results. To date we have made comparison with TEPC, CR-39, charge particle telescopes, and Bonner spheres. This broad range of detectors allows us to test a number of functions related to differing physical processes which add to the complicated radiation fields within a spacecraft or the human body, which functions can be calculated by the HZETRN code system. In the present report we will review these results.

Wilson, J. W.↗

NASA NTRS2022

Robotics Verification and Validation Strategies for Perseverance Rover Sampling and Caching

The Mars 2020 Sampling and Caching Subsystem(SCS) is the most complex robotic system ever fielded on a MarsRover. It includes a 5 degree-of-freedom Robotic Arm, coringdrill, gas Dust Removal Tool, interfaces for two turret-mountedinstruments, and an Adaptive Caching Assembly (ACA). TheACA is itself a complex robotic system, containing hardware tosupport docking and bit exchange, a 3 degree-of-freedomSample Handling Assembly for manipulating sample tubes,storage for several drill bits and sample tubes, and mechanismsto support observing and sealing samples collected by the drill.To successfully verify and validate the SCS hardware andsoftware and its integration with the Mars 2020 flight systemseveral key strategies were employed.The SCS Verification and Validation (V&V) program utilizedmultiple test venues with tiered levels of fidelity. These includedsimulation and visualization software environments, low fidelitydevelopment testbeds, testbeds with high fidelity SCS hardwareand commercial off-the shelf avionics, integrated systemtestbeds with flight-like avionics, and environmental testbedscapable of simulating Martian surface temperature andpressure. Multiple units of each SCS hardware componentmoved fluidly between test venues to accomplish myriadstandalone and coordinated test objectives. Test preparationand executions were performed by a diverse team of engineerswith training and technical ownership tailored for individualexperience and role. Despite significant differences between testvenues, the SCS V&V team established efficient and consistentprocesses and tools for procedure development, test execution,and data review that enabled personnel, as well as technicalproducts such as sequences and parameter configurations, toflow between venues effectively. A series of benchmark testsprovided evidence of performance consistency as elements weretransferred between venues and as system capability evolved.This paper provides an overview of the SCS V&V program andexplores several overarching strategies that enabled successfuloperation in the face of unprecedented complexity. Keyoutcomes of the SCS validation effort are summarized, alongwith lessons learned and beneficial integrations of validationtool and process innovations into Mars surface operations.

Brooks, Sawyer↗

NASA NTRS1997

Enabling Propulsion Materials (EPM) Structural Component Successfully Tested Under Pseudo-Operating Conditions

A fabrication feasibility demonstration component for the Enabling Propulsion Materials (EPM) program was evaluated under prototypical engine loading conditions at the Structural Benchmark Test Facility at the NASA Lewis Research Center. The purpose for this test was to verify EPM casting, joining, coating, and life-prediction methods. Electron beam welding techniques developed in the EPM program were used to join two large superalloy cast sections of an exhaust nozzle flap to fabricate the demonstration component. After the joints were inspected, the component was coated with an oxidation-resistant barrier coating and was sent to Lewis for testing. The special test fixture shown in the photo (the Structural Benchmark Test Facility) was designed and built at Lewis to produce a biaxial bending condition similar to the loading condition this part would encounter during engine operation. Several finite element analyses were conducted to validate the mechanical test method. A floating furnace was then designed to provide prototypical thermal profiles in the component. An isothermal low-cycle fatigue test was used to evaluate the component at a cyclic load of 13 kN (maximum) to 1 kN (minimum) at a frequency of 1 Hz. Component failure was defined as a 30-percent increase in the component's compliance. On the basis of this definition, the low-cycle fatigue life of this component would be 35,000 cycles.

Bartolotta, Paul A.↗

NASA NTRS2002

WIND Validation Cases: Computational Study of Thermally-perfect Gases

The ability of the WIND Navier-Stokes code to predict the physics of multi-species gases is investigated in support of future high-speed, high-temperature propulsion applications relevant to NASA's Space Transportation efforts. Three benchmark cases are investigated to evaluate the capability of the WIND chemistry model to accurately predict the aerodynamics of multi-species chemically non-reacting (frozen) gases. Case 1 represents turbulent mixing of sonic hydrogen and supersonic vitiated air. Case 2 consists of heated and unheated round supersonic jet exiting to ambient. Case 3 represents 2-D flow through a converging-diverging Mach 2 nozzle. For Case 1, the WIND results agree fairly well with experimental results and that significant mixing occurs downstream of the hydrogen injection point. For Case 2, the results show that the Wilke and Sutherland viscosity laws gave similar results, and the available SST turbulence model does not predict round supersonic nozzle flows accurately. For Case 3, results show that experimental, frozen, and 1-D gas results agree fairly well, and that frozen, homogeneous, multi-species gas calculations can be approximated by running in perfect gas mode while specifying the mixture gas constant and Ratio of Specific Heats.

DalBello, Teryn↗

NASA NTRS2004

The Isolated Synthetic Jet in Crossflow: A Benchmark for Flow Control Simulation

An overview of the data acquisition, reduction, and uncertainty of experimental measurements of the flowfield created by the interaction of an isolated synthetic jet and a turbulent boundary layer is presented. The experimental measurements were undertaken to serve as the second of three computational fluid dynamics validation databases for Active Flow Control. The validation databases were presented at the NASA Langley Research Center Workshop on CFD Validation of Synthetic Jets and Turbulent Separation Control in March, 2004. Detailed measurements were made to document the boundary conditions for the flow and also for the phase-averaged flowfield itself. Three component Laser-Doppler Velocimetry, 2-D Particle Image Velocimetry, and Stereo Particle Image Velocimetry were utilized to document the phase averaged velocity field and the turbulent stresses.

Schaeffler, Norman W.↗

NASA NTRS2006

The Isolated Synthetic Jet in Crossflow: A Benchmark for Flow Control Simulation

An overview of the data acquisition, reduction, and uncertainty of experimental measurements made of the flowfield created by the interaction of an isolated synthetic jet and a turbulent boundary layer is presented. The experimental measurements were undertaken to serve as the second of three computational fluid dynamics validation databases for Active Flow Control. The validation databases were presented at the NASA Langley Research Center Workshop on CFD Validation of Synthetic Jets and Turbulent Separation Control in March, 2004. Detailed measurements were made to document the boundary conditions for the flow and also for the phase-averaged flowfield itself. Three component Laser-Doppler Velocimetry, 2-D Particle Image Velocimetry, and Stereo Particle Image Velocimetry were utilized to document the phase-averaged velocity field and the turbulent stresses.

Schaeffler, Norman W.↗

NASA NTRS1983

Detailed fuel spray analysis techniques

Detailed fuel spray analyses are a necessary input to the analytical modeling of the complex mixing and combustion processes which occur in advanced combustor systems. It is anticipated that by controlling fuel-air reaction conditions, combustor temperatures can be better controlled, leading to improved combustion system durability. Thus, a research program is underway to demonstrate the capability to measure liquid droplet size, velocity, and number density throughout a fuel spray and to utilize this measurement technique in laboratory benchmark experiments. The research activities from two contracts and one grant are described with results to data. The experiment to characterize fuel sprays is also described. These experiments and data should be useful for application to and validation of turbulent flow modeling to improve the design systems of future advanced technology engines.

Mularz, E. J.↗

NASA NTRSDate not supplied

Unsupervised Anomaly Detection in High-Dimensional Flight Data Using Convolutional Variational Auto-Encoder

The modern National Airspace System (NAS) is an extremely safe system. The industry has experienced a steady decrease in fatalities over the years. This can be contributed to both improved flight critical systems with redundant hardware and software protections as well as an increased focus on active monitoring and response to real time and historically identified vulnerabilities by implementing more resilient procedures and protocols. The main practice for identifying vulnerabilities in operations leverages domain expertise using knowledge about how the system should behave with the expected tolerances to known safety margins. This approach works well when the system has a well-defined operating condition. However, the operations in the NAS can be highly complex with various nuances that render it difficult to clearly pre-define all known safety vulnerabilities. With the advancement of data science and machine learning techniques, the potential to automatically identify emerging vulnerabilities in the observed operations has become more practical in recent years. The state-of-the-art anomaly detection approaches in aerospace data usually rely on supervised or semi-supervised learning. However, in many real-world problems such as flight safety creating labels for the data requires huge amount of efforts and is largely expensive. As a result, in this article, we develop a Convolutional Variational Auto-Encoder (CVAE), an unsupervised learning approach for anomaly detection in high-dimensional heterogeneous time-series data. We validate performance of CVAE compared to the state-of-the-art supervised learning approach (as an upper bound) as well as an supervised clustering based on K-Means (as a lower bound) on Yahoo!'s benchmark time series anomaly detection data. Finally, we showcase performance of CVAE on a case study of identifying anomalies in the first 60 seconds of commercial flights' take-offs using Flight Operational Quality Assurance (FOQA) data.

Milad Memarzadeh↗

NASA NTRS2014

Parallelization of Unsteady Adaptive Mesh Refinement for Unstructured Navier-Stokes Solvers

This paper explores the implementation of the MPI parallelization in a Navier-Stokes solver using adaptive mesh re nement. Viscous and inviscid test problems are considered for the purpose of benchmarking, as are implicit and explicit time advancement methods. The main test problem for comparison includes e ects from boundary layers and other viscous features and requires a large number of grid points for accurate computation. Ex- perimental validation against double cone experiments in hypersonic ow are shown. The adaptive mesh re nement shows promise for a staple test problem in the hypersonic com- munity. Extension to more advanced techniques for more complicated ows is described.

Schwing, Alan M.↗

NASA NTRSDate not supplied

Training and Validation of Spectral Gap Filling Algorithm for Cpf-Ceres Intercalibration

The Climate Absolute Radiance and Refractivity Observatory (CLARREO) Pathfinder (CPF) mission is set to launch an SI-traceable reflective solar (RS) spectrometer aboard the International Space Station to measure Earth-reflected solar radiation with a radiometric uncertainty of 0.3% (k=1). The CPF intercalibration team has devised a cutting-edge methodology to accurately transfer the benchmark CPF calibration reference to the shortwave (SW) channel (200-5000 nm) of the Clouds and the Earth’s Radiant Energy System (CERES) instrument. The spectral range of CPF measurements spans from 350-2300 nm, while the CERES SW channel measures the Earth-reflected broadband solar radiances between 200 nm to 5 μm. To conduct precise CPF-CERES intercalibration analysis, the CPF-like spectral radiances outside the CPF spectral range need to be estimated to match the CERES SW spectral range. In response, the team has developed a fast algorithm that leverages spectrally redundant information within the CPF-measured portion through principal component analysis (PCA) and utilizes pre-established spectral correlation relationships among wavelengths to extend the CPF spectrum below 350 nm and above 2300 nm. Our results show that the algorithm achieves excellent accuracy in generating the missing energy in the UV and IR portions. The RMS error in the UV region is less than 4.5x10-3 W/m2/sr/nm, while in the IR region, it is smaller than 8x10-5 W/m2/sr/nm. Our methodology was validated using measured EMIT radiance data, which covers the spectral range from 0.381 μm to 2.493 μm. We employed EMIT radiances within the wavelength range of 0.43 – 2.25 μm to generate radiances for both the shorter wavelength range (0.381 – 0.43 μm) and longer wavelength range (2.25 – 2.493 μm). The generated radiances agree very well with the measured EMIT radiances. The standard deviation in the integrated broadband radiances was about 0.1%, and the bias is less than 0.004% for over 1.5 million EMIT measured samples. These statistics show that the spectral gap filling algorithm is robust and effective in substantially reducing the spectral difference-induced uncertainty in the CPF-CERES intercalibration samples.

Qiguang Yang↗

NASA NTRS2019

Benchmarking CME Arrival Time and Impact: Progress on Metadata, Metrics, and Events

Accurate forecasting of the arrival time and subsequent geomagnetic impacts of coronal mass ejections (CMEs) at Earth is an important objective for space weather forecasting agencies. Recently, the CME Arrival and Impact working team has made significant progress toward defining communit yagreed metrics and validation methods to assess the current state of CME modeling capabilities. This will allow the community to quantify our current capabilities and track progress in models over time. First, it is crucial that the community focuses on the collection of the necessary metadata for transparency and reproducibility of results. Concerning CME arrival and impact we have identified six different metadata types: 3D CME measurement, model description, model input, CME (non)arrival observation, model output data, and metrics and validation methods. Second, the working team has also identified a validation time period, where all events within the following two periods will be considered: 1 January 2011 to 31 December 2012 and January 2015 to 31 December 2015. Those two periods amount to a total of about 100 hit events at Earth and a large amount of misses. Considering a time period will remove any bias in selecting events and the event set will represent a sample set that will not be biased by user selection. Lastly, we have defined the basic metrics and skill scores that the CME Arrival and Impact working team will focus on.

Verbeke, C.↗

NASA NTRSDate not supplied

Validation of the HyperSolve CFD Solver for Entry Descent and Landing Applications

The functional equivalence of the HyperSolve unstructured edge-based, finite-volume computational fluid dynamics code to the Langley Aerothermodynamic Upwind Relaxation Algorithm multiblock structured grid code is documented for applications of interest to the Entry, Descent, and Landing community. A suite of cases using a range of thermochemical gas models on relevant vehicle configurations were analyzed with both codes and the results compared. A tolerance of ±4% difference in surface pressure and surface heat flux from a benchmark LAURA solution was used as the criterion for functional equivalence, and comparisons of flowfield quantities are also included to verify that the thermochemical nonequilibrium capabilities in HyperSolve match those of the LAURA code. The functional equivalence of the HyperSolve unstructured edge-based finite-volume computational fluid dynamics (CFD) code to the Langley Aerothermodynamic Upwind Relaxation Algorithm (LAURA) multiblock structured grid code is documented for applications of interest to the Entry, Descent, and Landing (EDL) community. A suite of cases using a range of thermochemical gas models on EDL-relevant vehicle configurations were analyzed with both codes and the results compared. A tolerance of ±4% difference in surface pressure and surface heat flux from a benchmark LAURA solution was used as the criterion for functional equivalence, and comparisons of flow field quantities are also included to verify that the thermochemical nonequilibrium capabilities in HyperSolve match those of the LAURA code. In general, HyperSolve predictions for surface pressure and surface heat flux are in close agreement with those predicted by LAURA.

hypersolve↗