Search NASA⌕ Search

SEARCH · Search NASA

Results for “Validation Methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,747 records · Page 97

DNS of Flow in a Low-Pressure Turbine Cascade Using a Discontinuous-Galerkin Spectral-Element Method

A new computational capability under development for accurate and efficient high-fidelity direct numerical simulation (DNS) and large eddy simulation (LES) of turbomachinery is described. This capability is based on an entropy-stable Discontinuous-Galerkin spectral-element approach that extends to arbitrarily high orders of spatial and temporal accuracy and is implemented in a computationally efficient manner on a modern high performance computer architecture. A validation study using this method to perform DNS of flow in a low-pressure turbine airfoil cascade are presented. Preliminary results indicate that the method captures the main features of the flow. Discrepancies between the predicted results and the experiments are likely due to the effects of freestream turbulence not being included in the simulation and will be addressed in the final paper.

Low-Pressure Turbine Cascade↗

Comparison of aircraft noise measured in flight test and in the NASA Ames 40- by 80-foot wind tunnel.

A method to determine free-field aircraft noise spectra from wind-tunnel measurements has been developed. The crux of the method is the correction for reverberations. Calibrated loud speakers are used to simulate model sound sources in the wind tunnel. Corrections based on the difference between the direct and reverberant field levels are applied to wind-tunnel data for a wide range of aircraft noise sources. To establish the validity of the correction method, two research aircraft - one propeller-driven (YOV-10A) and one turbojet-powered (XV-5B) - were flown in free field and then tested in the wind tunnel. Corrected noise spectra from the two environments agree closely.

Atencio, A., Jr.↗

Evaluation of a strained-coordinate perturbation procedure - Nonlinear subsonic and transonic flows

An evaluation is made of a perturbation method devised to obtain highly accurate approximations to families of strongly nonlinear solutions which are either continuous or discontinuous, and which represent variations in some arbitrary parameter. The method first defines a unit perturbation by using two nonlinear solutions which differ from one another by a nominal change in some geometric or flow parameter, then employs this unit perturbation to predict a family of related nonlinear solutions over a range of parameter variation. Coordinate straining is incorporated into this perturbation method for determining the unit perturbation to account for the movement of discontinuities and maxima of high-gradient regions due to the perturbation. Attention is given to transonic and subsonic flows. Comparisons of the perturbation results with the corresponding 'exact' nonlinear solutions show a remarkable accuracy and range of validity of the perturbation method across the spectrum of examples considered.

Stahara, S. S.↗

Towards Hyper-Dimensional Variography Using the Product-Sum Covariance Model

Modeling hyper-dimensional spatial variability is a complex task from both practical and theoretical standpoints. In this paper we develop a method for modeling hyper-dimensional covariance (variogram) structures using the product-sum covariance model initially developed to model spatio-temporal variability. We show that the product-sum model can be used recursively up to an arbitrarily large number of dimensions while preserving relative modeling simplicity and yielding valid covariance models. The method can be used to model variability in anisotropic conditions with multiple axes of anisotropy or when temporal evolution is involved, and thus is applicable to “full anisotropic 3D+time” situations often encountered in environmental sciences. It requires fewer assumptions than the traditional product-sum modeling approach. The new method also presents an alternative to classical approaches to modeling zonal anisotropy and requires fewer parameters to be estimated from data. We present an example by applying the method in conjunction with ordinary kriging to map photosynthetically-active radiation (PAR) for 2006, in Oklahoma, CA, USA and to explore effects of spatio-temporal variability in PAR on gross primary productivity (GPP).

54 ENVIRONMENTAL SCIENCES↗

An Empirical Model For Intrinsic Alignments: Insights From Cosmological Simulations

We extend current models of the halo occupation distribution (HOD) to include a flexible, empirical framework for the forward modeling of the intrinsic alignment (IA) of galaxies. A primary goal of this work is to produce mock galaxy catalogs for the purpose of validating existing models and methods for the mitigation of IA in weak lensing measurements. This technique can also be used to produce new, simulation-based predictions for IA and galaxy clustering. Our model is probabilistically formulated, and rests upon the assumption that the orientations of galaxies exhibit a correlation with their host dark matter (sub)halo orientation or with their position within the halo. We examine the necessary components and phenomenology of such a model by considering the alignments between (sub)halos in a cosmological dark matter only simulation. We then validate this model for a realistic galaxy population in a set of simulations in the Illustris-TNG suite. We create an HOD mock with Illustris-like correlations using our method, constraining the associated IA model parameters, with the $\mathcal{X}$$^{2}_{dof}$ between our model’s correlations and those of Illustris matching as closely as 1.4 and 1.1 for orientation–position and orientation–orientation correlation functions, respectively. By modeling the misalignment between galaxies and their host halo, we show that the 3-dimensional two-point position and orientation correlation functions of simulated (sub)halos and galaxies can be accurately reproduced from quasi-linear scales down to 0.1 $\mathcal{h}$ –1 Mpc. We also find evidence for environmental influence on IA within a halo. Our publicly-available software provides a key component enabling efficient determination of Bayesian posteriors on IA model parameters using observational measurements of galaxy-orientation correlation functions in the highly nonlinear regime.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Validation of Statistical Uncertainties in Subcritical Benchmark Measurements: Part I - Theory and Simulations

Subcritical neutron noise measurements are often used to determine multiplication of a system with Special Nuclear Material. This work presents an uncertainty approach which incorporates the singles and doubles counting rates determined by the Hage-Cifarelli formalism. This is a moments-based approach which utilizes time correlations between prompt neutrons in order to assess the system multiplication. After the method is described, a validation is presented which utilizes simulated data generated using a 0-D point-kinetics Monte Carlo code.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Development of a continuous synthesis process for carbamazepine using validated in-line Raman spectroscopy and kinetic modelling for disturbance simulation

Mitigation of failure modes in the continuous synthesis (CS) of a drug substance (DS) has the potential to widen the adoption of continuous manufacturing (CM) technologies by the pharmaceutical industry. Here, this work demonstrates the development of a robust continuous process for the synthesis of carbamazepine (CBZ), an essential medicine as per the World Health Organization (WHO), facilitated by kinetic modelling and monitored by in-line Raman spectroscopy. Accurate kinetic modelling and the use of validated process analytical technology (PAT) models for quantitative measurement were found to play an important role in developing CS of drug substances. Kinetic data for the formation of CBZ from iminostilbene (ISB) were collected by batch reaction sampling and high-performance liquid chromatography (HPLC) analysis. A non-linear solver and iterative method was applied to determine two sets of Arrhenius parameters simultaneously for the reaction system by minimizing the standard error of the model fit. The start-up and dynamic equilibrium stages for the CS of CBZ using a continuous stirred tank reactor (CSTR) were modelled based on the batch kinetic data and employed to optimize conversion and simulate process disturbances. An in-line Raman spectroscopy method was successfully developed, validated, and integrated to determine the concentrations of CBZ and ISB within the operating range for the CS. The CS kinetic model was evaluated experimentally from startup to dynamic equilibrium over 10 residence times with monitoring by HPLC and in-line Raman spectroscopy. The developed kinetic model in tandem with in-line Raman spectroscopy successfully predicted disturbances due to changes in process variables and can serve as a useful tool in the future design of advanced process control strategies for the continuous synthesis of CBZ.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Automated Signal Timing Plan Reconstruction Using High-Resolution Event-Based Controller Data for Digital Twins

Transportation digital twins are essential tools for evaluating emerging technologies such as connected and automated vehicles, adaptive traffic signal control, and mobility optimization strategies. Realistic digital twins require accurate emulation of real-world signal controllers and detailed signal timing plans. However, signal timing plans are often unavailable or difficult to access, forcing researchers and modelers to rely on assumed fixed timings or halt their analysis. To overcome this challenge, we present a method that directly estimates signal timing plan parameters using high-resolution, event-based data from traffic signal controllers. The proposed method extracts key parameters, including cycle length, offset, phase sequence, coordinated phases, phase-specific minimum and maximum green durations, vehicle extensions, and splits under coordination. A rule-based deterministic signal timing reconstruction algorithm based on traffic signal operation rules, such as those outlined in the Signal Timing Manual, is developed and validated. We evaluate this method, which uses high-resolution controller event logs and verified signal timing plans, on 94 signalized intersections in Nashville, Tennessee, demonstrating their ability to generate accurate, simulation-ready signal timing plans for tools such as SUMO and Vissim.

Saroj, Abhilasha [ORNL] (ORCID:0000000191178063)↗

Simplified Abrasion Test Methodology for Candidate EVA Glove Lay-Ups

During the Apollo Program, space suit outer‐layer fabrics were badly abraded after performing just a few extravehicular activities (EVAs). For example, the Apollo 12 commander reported abrasive wear on the boots that penetrated the outer‐layer fabric into the thermal protection layers after less than 8 hrs of surface operations. Current plans for the exploration planetary space suits require the space suits to support hundreds of hours of EVA on a lunar or Martian surface, creating a challenge for space suit designers to utilize materials advances made over the last 40 years and improve on the space suit fabrics used in the Apollo Program. Over the past 25 years the NASA Johnson Space Center Crew and Thermal Systems Division has focused on tumble testing as means of simulating wear on the outer layer of the space suit fabric. Most recently, in 2009, testing was performed on 4 different candidate outer layers to gather baseline data for future use in design of planetary space suit outer layers. In support of the High Performance EVA Glove Element of the Next Generation Life Support Project, testing a new configuration was recently attempted in which require 10% of the fabric per replicate of that need in 2009. The smaller fabric samples allowed for reduced per sample cost and flexibility to test small samples from manufacturers without the overhead to have a production run completed. Data collected from this iteration was compared to that taken in 2009 to validate the new test method. In addition the method also evaluated the fabrics and fabric layups used in a prototype thermal micrometeoroid garment (TMG) developed for EVA gloves under the NASA High Performance EVA Glove Project. This paper provides a review of previous abrasion studies on space suit fabrics, details methodologies used for abrasion testing in this particular study, results of the validation study, and results of the TMG testing.

Rabel, Emily↗

Integral Full Core Multi-Physics PWR Benchmark with Measured Data

In recent years, the importance of modeling and simulation has been highlighted extensively in the DOE research portfolio with concrete examples in nuclear engineering with the CASL and NEAMS programs. These research efforts and similar efforts worldwide aim at the development of high-fidelity multi-physics analysis tools for the simulation of current and next-generation nuclear power reactors. Like all analysis tools, verification and validation is essential to guarantee proper functioning of the software and methods employed. The current approach relies mainly on the validation of single physic phenomena (e.g. critical experiment, flow loops, etc.) and there is a lack of relevant multiphysics benchmark measurements that are necessary to validate high-fidelity methods being developed today. This work introduces a new multi-cycle full-core Pressurized Water Reactor (PWR) depletion benchmark based on two operational cycles of a commercial nuclear power plant that provides a detailed description of fuel assemblies, burnable absorbers, in-core fission detectors, core loading and re-loading patterns. This benchmark enables analysts to develop extremely detailed reactor core models that can be used for testing and validation of coupled neutron transport, thermal-hydraulics, and fuel isotopic depletion. The benchmark also provides measured reactor data for Hot Zero Power (HZP) physics tests, boron letdown curves, and three-dimensional in-core flux maps from 58 instrumented assemblies. The benchmark description is now available online and has been used by many groups. However, much work remains to be done on the quantification of uncertainties and modeling sensitivities. This work aims to address these deficiencies and make this benchmark a true non-proprietary international benchmark for the validation of high-fidelity tools. This report details the BEAVRS uncertainty quantification for the first two cycle of operations and serves as the final report of the project.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Ground-based measurements of galactic cosmic ray fragmentation in shielding

The mean free path for nuclear interactions of galactic cosmic-rays is comparable to shielding and tissue thicknesses present in human interplanetary exploration, resulting in a significant fraction of nuclear reaction products at depth. In order to characterize the radiation field, the energy spectrum, the angular distribution, and the multiplicity of each type of secondary particles must also be known as a function of depth. Reactions can take place anywhere in a thick absorber; therefore, it is necessary to know these quantities as a function of particle energy for all particles produced. HZE transport methods are used to predict the radiation field; they are dependent on models of the interaction of man-made systems with the space environment to an even greater extent than methods used for other types of radiation. Hence, there is a major need to validate these transport codes by comparison with experimental data. The most cost-effective method of validation is a comparison with ground-based experimental measurements. A research program to provide such validation measurements using neon, iron and other accelerated heavy ion beams will be discussed and illustrated using results from ongoing experiments and their comparison with current transport codes. The extent to which physical measurements yield radiobiological predictions will be discussed.

NASA Discipline Radiation Health↗

Rapid Detection of Anomalies in Battery Energy Storage System Data

Data analytics is pivotal in assessing the technical characteristics and performance of Battery Energy Storage Systems (BESS), underpinning BESS modeling, optimization, and control. However, raw datasets frequently harbor anomalies from measurement errors and equipment malfunctions, impacting BESS reliability and analysis accuracy To address the challenge, this paper presents a novel methodology for the rapid detection of anomalous charge or discharge cycles within BESS operational data, expediting the cleaning process while ensuring data integrity. We’ve collected diverse and comprehensive real-world BESS operational datasets in collaboration with the Electric Power Research Institute and multiple Washington State utilities. These datasets serve dual roles: enabling comprehensive data exploration and analysis for understanding underlying challenges and method development, while also acting as a vital validation resource, demonstrating practical effectiveness. The proposed method detects anomalies and aids in their resolution, improving system performance characterization precision. It also reveals recurring data anomaly sources, offering insights for data collection and handling enhancement. Practitioners can gain valuable insights from the identified anomalous cycles in the real-world datasets along with the investigative process for root cause analyses and essential data cleaning steps.

Crawford, Aladsair J.↗

The statistical defensibility of forensic proteomics

The U.S. Federal court system maintains very high standards for admissibility of scientific evidence. In particular, to allow such evidence into court, a judge must be satisfied it is both reliable, in other words, based on a robust, reproducible, and accurate method, and relevant, meaning it adds weight to the prosecution or defense claims in a case. In 1993, the U.S. Supreme Court issued landmark guidelines for judges considering whether or not to admit scientific testimony. The resulting Daubert criteria changed the forensic sciences in a profound way, leading investigators, researchers, and legal experts to question the scientific validity of established forensic methods that had been widely accepted for years. The Daubert criteria also caused a paradigm shift in the development of new forensic methods, forcing researchers to better prepare new techniques for use in an increasingly adversarial environment. In this chapter, we discuss the current state of forensic proteomics in the context of modern forensics. We present the Daubert criteria, discuss seven elements of a defensible method, and provide guidelines for building statistical defensibility of this emerging discipline.

Jarman, Kristin H.↗

A Machine Learning Approach to Quantitative Analysis of Enamel Microstructure from Scanning Electron Microscopy Images

Dental enamel, the outermost tissue of mammalian teeth, must withstand a lifetime of wear and cyclic contact. To meet this demand, enamel possesses a combination of high hardness and resistance to fracture, properties that are typically mutually exclusive. The impressive damage tolerance has been attributed largely to decussation of the enamel rods, the principal unit of its microstructure. As such, enamel is inspiring the design of next‐generation structural materials. However, quantitative descriptions of the decussated enamel rod microstructure remain limited due to challenges encountered in applying computed tomography and in acquiring quality images appropriate for traditional digital processing methods. Here, a machine learning segmentation method is applied to images of the enamel obtained using scanning electron microscopy to support quantitative analysis of the microstructure. A pretrained convolutional neural network is used to expand the input training image dataset to allow the training of a random forest classifier, which ultimately segments the image with a very small training set ( n = 3 images). A validation of this segmentation method is presented, in addition to its application to calculate relevant microstructural parameters for images of tooth enamel from selected mammalian species. The methodology applied here is equally applicable to other hard tissues.

36 MATERIALS SCIENCE↗

First Experimental Test of the Ratio Method

The ratio is a new reaction observable suggested to extract accurately structure information on halo nuclei. It corresponds to the ratio of differential cross sections for scattering and breakup, which is predicted to remove the uncertainty related to the reaction dynamics. We present here the first experimental test of the method for the 11 Be + 12 C collision at E Lab = 20A MeV performed at Texas A&M University. Differential cross sections for scattering and inclusive one-neutron breakup have been measured with the new detector array BlueSTEAl. The ratio of cross sections is very smooth and independent of the projectile-target interaction, which demonstrates the validity of the ratio method. We extend our analysis to existing 11 Be + 208 Pb data, confirming that the method works well on any target.

11Be↗

Environmental Assessments in the Riparian Corridor of the Colorado River Delta

We will develop remote sensing methods to conduct environmental assessments in the riparian corridor of the Colorado River delta, shared by the United States and Mexico. This important regional ecosystem is dependent upon US water flows, yet the most important wildlife habitats are in Mexico. The delta region is poorly known and difficult to monitor on the ground. We will use ground-validated, aerial and satellite methods to develop accurate vegetation and habitat maps and predictive hydrological and vegetation models of this ecosystem in response to US flood releases. The work products will advance our understanding of water resource issues in dryland climates and provide a specific application tool for a critical binational natural resource area.

Source record↗

Computational Design and Analysis of a Transonic Natural Laminar Flow Wing for a Wind Tunnel Model

A natural laminar flow (NLF) wind tunnel model has been designed and analyzed for a wind tunnel test in the National Transonic Facility (NTF) at the NASA Langley Research Center. The NLF design method is built into the CDISC design module and uses a Navier-Stokes flow solver, a boundary layer profile solver, and stability analysis and transition prediction software. The NLF design method alters the pressure distribution to support laminar flow on the upper surface of wings with high sweep and flight Reynolds numbers. The method addresses transition due to attachment line contamination/transition, Gortler vortices, and crossflow and Tollmien-Schlichting modal instabilities. The design method is applied to the wing of the Common Research Model (CRM) at transonic flight conditions. Computational analysis predicts significant extents of laminar flow on the wing upper surface, which results in drag savings. A 5.2 percent scale semispan model of the CRM NLF wing will be built and tested in the NTF. This test will aim to validate the NLF design method, as well as characterize the laminar flow testing capabilities in the wind tunnel facility.

Lynde, Michelle N.↗

The design of a joined wing flight demonstrator aircraft

A joined-wing flight demonstrator aircraft has been developed at the NASA Ames Research Center in collaboration with ACA Industries. The aircraft is designed to utilize the fuselage, engines, and undercarriage of the existing NASA AD-1 flight demonstrator aircraft. The design objectives, methods, constraints, and the resulting aircraft design, called the JW-1, are presented. A wind-tunnel model of the JW-1 was tested in the NASA Ames 12-foot wind tunnel. The test results indicate that the JW-1 has satisfactory flying qualities for a flight demonstrator aircraft. Good agreement of test results with design predictions confirmed the validity of the design methods used for application to joined-wing configurations.

Smith, S. C.↗