Search NASA⌕ Search

SEARCH · Search NASA

Results for “Validation Methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14

Active learning using hybrid surrogate tool life modeling for machining process optimization

Here, this paper describes an active learning approach for part-to-part iterative machining process optimization using a hybrid surrogate tool life model. A probabilistic interpolating tool life model is developed by combining the empirical Taylor-type tool life equation and the model fit error. The probabilistic tool life model is then used to calculate the machining cost per part distribution. The optimal machining parameters are selected using an expected improvement in machining cost per part criterion. The method is validated numerically using experimental results; the results show a median convergence error of 2.2% after three tests over 400 simulations. The method is validated experimentally on two industrial applications for Ti-6Al-4V roughing resulting in a cost per part reduction greater than 23% after two tests. The described method is a robust solution for rapid convergence to optimal machining parameters in an industrial production environment.

Active learning↗

Spatio-Temporal Deep Graph Network for Event Detection, Localization, and Classification in Cyber-Physical Electric Distribution System

This work proposes a deep graph learning framework to identify, locate, and classify power, cyber, and cyber power events at the distribution system level. The proposed algorithm jointly exploits spatial, temporal, and node-level cyber and physical data features. The developed graph neural network, together with a deep autoencoder, utilizes physical measurements from distribution level phasor measurement units and cyber data from communication network logs. The spatial structure of the synchrophasor measurements and network is incorporated through a weighted adjacency matrix. The temporal structure is incorporated by defining a spatial operation in the gated recurrent unit. This spatio-temporal learning element resides inside a power event detection, localization, and classification module that provides the degree of confidence for an event label. To accurately pinpoint the location of an event to the nearest bus equipped with a measurement unit, a combination of squared error and proximity score is utilized. Also included is a cyber event detection module that employs heteroskedasticity to analyze the significance of various cyber features during different types of attacks. Finally, a dual-bit cyber-power decision table determines the nature of the event. The proposed method is validated on two distribution systems modeled in OPAL-RT/Hypersim with limited phasor measurement units for different possible physical and cyber events. Further analyses include comparison with other state-of-the-art methods and validation in the presence of measurement noise. As a result, our method outperforms existing approaches and achieves an average detection accuracy of 97.97%, F1-score of 96.88%, precision of 96.53%, and recall of 98.57%.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Space Suit Joint Torque Testing

In 2009 and early 2010, a test was performed to quantify the torque required to manipulate joints in several existing operational and prototype space suits in an effort to develop joint torque requirements appropriate for a new Constellation Program space suit system. The same test method was levied on the Constellation space suit contractors to verify that their suit design meets the requirements. However, because the original test was set up and conducted by a single test operator there was some question as to whether this method was repeatable enough to be considered a standard verification method for Constellation or other future space suits. In order to validate the method itself, a representative subset of the previous test was repeated, using the same information that would be available to space suit contractors, but set up and conducted by someone not familiar with the previous test. The resultant data was compared using graphical and statistical analysis and a variance in torque values for some of the tested joints was apparent. Potential variables that could have affected the data were identified and re-testing was conducted in an attempt to eliminate these variables. The results of the retest will be used to determine if further testing and modification is necessary before the method can be validated.

Valish, Dana J.↗

Image Processing Methods for Coronal Hole Segmentation, Matching, and Map Classification

The paper presents the results from a multi-year effort to develop and validate image processing methods forselecting the best physical models based on solar image observations. The approach consists of selecting the physical models based on their agreement with coronal holes extracted from the images. Ultimately, the goal is to use physical models to predict geomagnetic storms. We decompose the problem into three subproblems: (i) coronal hole segmentation based on physical constraints, (ii) matching clusters of coronal holes between different maps, and (iii) physical map classification. For segmenting coronal holes, we develop a multi-modal method that uses segmentation maps from three different methods to initialize a level-set method that evolves the initial coronal hole segmentation to the magnetic boundary. Then, we introducea new method based on Linear Programming for matchingclusters of coronal holes. The final matching is then performedusing Random Forests. The methods were carefully validatedusing consensus maps derived from multiple readers, manualclustering, manual map classification, and method validation for50 maps. The proposed multi-modal segmentation method significantly outperformed SegNet, U-net, Henney-Harvey, and FCNby providing accurate boundary detection. Overall, the methodgave a 95.5% map classification accuracy.

Jatla, Venkatesh↗

Validation of structural analysis methods using the in-house liner cyclic rigs

Test conditions and variables to be considered in each of the test rigs and test configurations, and also used in the validation of the structural predictive theories and tools, include: thermal and mechanical load histories (simulating an engine mission cycle; different boundary conditions; specimens and components of different dimensions and geometries; different materials; various cooling schemes and cooling hole configurations; several advanced burner liner structural design concepts; and the simulation of hot streaks. Based on these test conditions and test variables, the test matrices for each rig and configurations can be established to verify the predictive tools over as wide a range of test conditions as possible using the simplest possible tests. A flow chart for the thermal/structural analysis of a burner liner and how the analysis relates to the tests is shown schematically. The chart shows that several nonlinear constitutive theories are to be evaluated.

Thompson, R. L.↗

Merging Fungal and Bacterial Community Profiles via an Internal Control

Integrated measurements of fungi and bacteria are critical to understand how interactions between these taxa drive key processes in ecosystems ranging from soils to animal guts. High-throughput amplicon sequencing is commonly used to census microbiomes, but the genetic markers targeted for fungi and bacteria (typically ribosomal regions) are domain-specific so profiling must be performed separately, obscuring relationships between these groups. To solve this problem, we developed a spike-in method with an internal control (IC) construct containing primer sites commonly used for bacterial and fungal taxonomic profiling. The internal control offers several advantages: estimation of absolute abundances, estimation of fungal to bacterial ratios (F:B), integration of bacterial and fungal profiles for holistic community analysis, and lower costs compared to other quantitation methods. To validate the IC as a scaling method, we compared IC-derived measures of F:B to measures from quantitative PCR (qPCR) using a commercial mock community (the ZymoBiomic Microbial Community DNA Standard II, containing two fungi and eight bacteria) and complex environmental samples. For both the mock community and the environmental samples, the IC produced F:B values that were statistically consistent with qPCR. Merging the environmental fungal and bacterial profiles based on the IC-derived F:B values revealed new relationships among samples in terms of community similarity. As a result, this IC method is the first spike-in method to employ a single construct for cross-domain amplicon sequencing, offering more reliable measurements.

59 BASIC BIOLOGICAL SCIENCES↗

New Capability at ORNL: High Precision Uranium Titration

Destructive analytical measurements establish a nuclear facility’s nuclear material inventory and inventory differences for Nuclear Material Accountancy and Control. A nuclear laboratory’s ability to perform accurate high-precision analytical measurements is key for tracking large inventories within a facility’s material balance areas and during production to track material movement through dynamic processes. For uranium, these measurements are made by using several established high-precision measurement protocols. These include isotope dilution mass spectrometry, gravimetry, and potentiometric titrations. Whatever measurement technique a nuclear lab chooses to use, reference materials (RMs) with certified attributes and accompanying uncertainties are used to calibrate measurement systems, and are the cornerstone for accurate results. In addition to calibration, RMs provide for metrological traceability, are used for method development and validation, and thus provide critical evaluations of the appropriateness and performance of analytical processes used. Evaluations may include validation that a method is fit-for-purpose, quantification of systematic and random biases, and the evaluation of long-term and short-term performance metrics. High-precision measurement techniques require that measured attributes be certified to a high degree of precision in the RMs used—ultimately, to a higher degree than that of the measurement technique itself. The US authority on the production of special nuclear material Certified Reference Materials is the NBL Program Office (NBLPO), formally known as New Brunswick Laboratory (NBL). The NBLPO is responsible for the sales and distribution of existing NBL certified reference materials (CRMs) and for the production of the next generation of nuclear RMs. To accomplish its mission, NBLPO is establishing key base capabilities within the DOE laboratory complex that formerly existed at the NBL laboratory. The Nuclear Analytical Chemistry (NAC) section within the Chemical Sciences Division (CSD) at Oak Ridge National Laboratory (ORNL) is currently working with NBLPO to set up laboratory and measurement capabilities to provide measurements and capabilities for production and/or recertification of existing and future CRMs for uranium assay. The NBL-developed high-precision titration (HPT) method is a critically-evaluated, extremely precise and accurate primary method utilized for the determination of uranium content in a variety of uranium materials. The HPT method, combined with detailed balance weighing protocols, provides for an analytical methodology that is unsurpassed in precision and one in which all sources of error have been evaluated, a requirement of CRM certification. HPT capability within the United States was lost with the closure of the labs at NBL. The NAC has been collaborating with NBLPO to stand up and demonstrate the capability to perform uranium assay via HPT at ORNL. HPT can produce results with an expanded uncertainty of approximately 0.01% for pure uranium compounds, with typical precisions of <0.006%. The major tasks required to stand up the method at ORNL were the refurbishment of a dedicated lab and equipment setup, procedure development, analyst training, establishing method-specific quality assurance, and qualification of an analyst to perform the method. This report summarizes these tasks, outlines the documents drafted, and gives the outcome of the qualification titrations.

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗

Finite Difference Time Marching in the Frequency Domain: A Parabolic Formulation for Aircraft Acoustic Nacelle Design

An explicit finite difference iteration scheme is developed to study harmonic sound propagation in aircraft engine nacelles. To reduce storage requirements for large 3D problems, the time dependent potential form of the acoustic wave equation is used. To insure that the finite difference scheme is both explicit and stable, time is introduced into the Fourier transformed (steady-state) acoustic potential field as a parameter. Under a suitable transformation, the time dependent governing equation in frequency space is simplified to yield a parabolic partial differential equation, which is then marched through time to attain the steady-state solution. The input to the system is the amplitude of an incident harmonic sound source entering a quiescent duct at the input boundary, with standard impedance boundary conditions on the duct walls and duct exit. The introduction of the time parameter eliminates the large matrix storage requirements normally associated with frequency domain solutions, and time marching attains the steady-state quickly enough to make the method favorable when compared to frequency domain methods. For validation, this transient-frequency domain method is applied to sound propagation in a 2D hard wall duct with plug flow.

Baumeister, Kenneth J.↗

Time-Dependent Parabolic Finite Difference Formulation for Harmonic Sound Propagation in a Two-Dimensional Duct with Flow

An explicit finite difference real time iteration scheme is developed to study harmonic sound propagation in aircraft engine nacelles. To reduce storage requirements for future large 3D problems, the time dependent potential form of the acoustic wave equation is used. To insure that the finite difference scheme is both explicit and stable for a harmonic monochromatic sound field, a parabolic (in time) approximation is introduced to reduce the order of the governing equation. The analysis begins with a harmonic sound source radiating into a quiescent duct. This fully explicit iteration method then calculates stepwise in time to obtain the 'steady state' harmonic solutions of the acoustic field. For stability, applications of conventional impedance boundary conditions requires coupling to explicit hyperbolic difference equations at the boundary. The introduction of the time parameter eliminates the large matrix storage requirements normally associated with frequency domain solutions, and time marching attains the steady-state quickly enough to make the method favorable when compared to frequency domain methods. For validation, this transient-frequency domain method is applied to sound propagation in a 2D hard wall duct with plug flow.

Kreider, Kevin L.↗

Finite Difference Time Marching in the Frequency Domain: A Parabolic Formulation for the Convective Wave Equation

An explicit finite difference iteration scheme is developed to study harmonic sound propagation in ducts. To reduce storage requirements for large 3D problems, the time dependent potential form of the acoustic wave equation is used. To insure that the finite difference scheme is both explicit and stable, time is introduced into the Fourier transformed (steady-state) acoustic potential field as a parameter. Under a suitable transformation, the time dependent governing equation in frequency space is simplified to yield a parabolic partial differential equation, which is then marched through time to attain the steady-state solution. The input to the system is the amplitude of an incident harmonic sound source entering a quiescent duct at the input boundary, with standard impedance boundary conditions on the duct walls and duct exit. The introduction of the time parameter eliminates the large matrix storage requirements normally associated with frequency domain solutions, and time marching attains the steady-state quickly enough to make the method favorable when compared to frequency domain methods. For validation, this transient-frequency domain method is applied to sound propagation in a 2D hard wall duct with plug flow.

Baumeister, K. J.↗

A Newton-Raphson Method Approach to Adjusting Multi-Source Solar Simulators

NASA Glenn Research Center has been using an in house designed X25 based multi-source solar simulator since 2003. The simulator is set up for triple junction solar cells prior to measurements b y adjusting the three sources to produce the correct short circuit current, lsc, in each of three AM0 calibrated sub-cells. The past practice has been to adjust one source on one sub-cell at a time, iterating until all the sub-cells have the calibrated Isc. The new approach is to create a matrix of measured lsc for small source changes on each sub-cell. A matrix, A, is produced. This is normalized to unit changes in the sources so that Ax(delta)s = (delta)isc. This matrix can now be inverted and used with the known Isc differences from the AM0 calibrated values to indicate changes in the source settings, (delta)s = A ·'x.(delta)isc This approach is still an iterative one, but all sources are changed during each iteration step. It typically takes four to six steps to converge on the calibrated lsc values. Even though the source lamps may degrade over time, the initial matrix evaluation i s not performed each time, since measurement matrix needs to be only approximate. Because an iterative approach is used the method will still continue to be valid. This method may become more important as state-of-the-art solar cell junction responses overlap the sources of the simulator. Also, as the number of cell junctions and sources increase, this method should remain applicable.

Snyder, David B.↗

Testing the Accuracy of Data-Driven MHD Simulations of Active Region Evolution

Models for the evolution of the solar coronal magnetic field are vital for understanding solar activity, yet the best measurements of the magnetic field lie at the photosphere, necessitating the development of coronal models which are "data-driven" at the photosphere. We present an investigation to determine the feasibility and accuracy of such methods. Our validation framework uses a simulation of active region (AR) formation, modeling the emergence of magnetic flux from the convection zone to the corona, as a ground-truth data set, to supply both the photospheric information and to perform the validation of the data-driven method. We focus our investigation on how the accuracy of the data-driven model depends on the temporal frequency of the driving data. The Helioseismic and Magnetic Imager on NASA's Solar Dynamics Observatory produces full-disk vector magnetic field measurements at a 12-minute cadence. Using our framework we show that ARs that emerge over 25 hours can be modeled by the data-driving method with only approximately 1 percent error in the free magnetic energy, assuming the photospheric information is specified every 12 minutes. However, for rapidly evolving features, under-sampling of the dynamics at this cadence leads to a strobe effect, generating large electric currents and incorrect coronal morphology and energies. We derive a sampling condition for the driving cadence based on the evolution of these small-scale features, and show that higher-cadence driving can lead to acceptable errors. Future work will investigate the source of errors associated with deriving plasma variables from the photospheric magnetograms as well as other sources of errors, such as reduced resolution, instrument bias, and noise.

Leake, James E.↗

NASA GMAO GEOS S2S Prediction System: Metrics, Post-Processing and Products

In this presentation we present an overview of the GMAO Sub-Seasonal and Seasonal Prediction System, current users and products, and methods for validation and evaluation of the system. Methods for evaluation include baseline evaluations metrics, the ability to simulate key modes of variability, and evaluation of new development areas.

Molod, Andrea M.↗

Comparison and validation of the QuEChERSER mega-method for determination of per- and polyfluoroalkyl substances in foods by liquid chromatography with high-resolution and triple quadrupole mass spectrometry

Instances of food contamination with per- and polyfluoroalkyl substances (PFAS) continue to occur globally, but sample preparation and analytical methods are quite limited and often monitor for a small percentage of known PFAS. This study aimed to evaluate, validate, and compare performance of two instruments with the recently developed “quick, easy, cheap, effective, rugged, safe, efficient, and robust” (QuEChERSER) sample preparation mega-method – a method developed to monitor chemicals over a broad range of physicochemical properties. Initial evaluation of the QuEChERSER mega-method for determination of PFAS in food demonstrated recoveries, matrix interferences, and co-extractive removal comparable to (or better than) US Food and Drug Administration (FDA) and USDA Food Safety and Inspection Service (FSIS) methods. Subsequent validation of QuEChERSER in beef, catfish, chicken, pork, liquid eggs, and powdered eggs on a high-resolution mass spectrometer achieved acceptable recoveries (70–120%) and precision (RSDs ≤20%) for all 33 target analytes at the 1 and 5 ng g –1 levels and 67–88% of analytes at the 0.1 ng g –1 level, depending on the matrix. Additional validation was performed by tandem mass spectrometry on a triple quadrupole instrument. This approach provided no non-detects and better recoveries at the 0.1 ng g –1 level than the HRMS method but exhibited more variability at 1 and 5 ng g –1 spiking levels. Analysis of NIST SRMs 1946 and 1947 gave accuracies of 70–117%. Furthermore, these results demonstrate the capability of combining PFAS analysis with a mega-method previously validated for 350 analytes, while collecting non-target data for future retrospective analysis of emerging alternatives with a high-resolution mass spectrometry method.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Thermal Hydraulics Validation Activities in the ART-GCR Campaign

The Advanced Reactor Technologies - Gas Cooled Reactor Campaign (ART-GCR) is part of the United States Department of Energy - Office of Nuclear Energy's Advanced Reactor Technologies program aimed at developing a High Temperature Gas-cooled Reactor (HTGR) which will offer enhancements in safety and efficiency. The Design, Methods, and Validation arm of the ART-GCR program provides experience and advanced tools for HTGR design and analysis. The Methods and Validation arm is developing data to validate predictions of decay heat removal through an extensive experimental campaign the Natural Convection Shutdown Heat Removal Test Facility at Argonne National Laboratory. In-core thermal hydraulics validation is being facilitated through the OECD/NEA's Thermal Hydraulic Code Validation Benchmark for High Temperature Gas-Cooled Reactors using HTTF Data. That benchmark contains code-to-code and code-to-data comparisons for 3 sets of HTGR thermal hydraulics phenomena. This ongoing benchmark activity has 16 participants from 9 countries developing leading insights into HTGR thermal hydraulics code validation. The ART-GCR campaign is also working on the development of state-of-the-art MOOSE-based models of the High Temperature Engineering Test Reactor (HTTR). Through the OECD/NEA's HTTR Loss of Forced Cooling (LOFC) program, the ART-GCR campaign is developing a multiphysics transient code validation benchmark based on 3 HTTR experiments that will provide an opportunity for international collaboration on multiphysics code validation.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗

Directed Design of Experiments for Validating Probability of Detection Capability of a Testing System

A method of validating a probability of detection (POD) testing system using directed design of experiments (DOE) includes recording an input data set of observed hit and miss or analog data for sample components as a function of size of a flaw in the components. The method also includes processing the input data set to generate an output data set having an optimal class width, assigning a case number to the output data set, and generating validation instructions based on the assigned case number. An apparatus includes a host machine for receiving the input data set from the testing system and an algorithm for executing DOE to validate the test system. The algorithm applies DOE to the input data set to determine a data set having an optimal class width, assigns a case number to that data set, and generates validation instructions based on the case number.

Generazio, Edward R.↗

Synthetic High Impedance Fault Data through Deep Convolutional Generated Adversarial Network

High impedance faults (HIFs) have always been significant challenge in the power grids. Researchers have developed some advanced protective methods to detect the HIFs. To test and validate these methods, large amounts of HIF data are required. This paper presents a synthetic HIF data generating method using the deep convolutional generated adversarial network (DCGAN). The DCGAN includes a generator module to create synthetic HIF waveform from random noises; and a discriminator module to identify the flaws of those synthetic data, which ultimately help improve the quality of the synthetic data created by the generator. To test the fidelity of the generated synthetic HIF data, two different HIF-detection methods have been applied. Extensive simulation results have validated the effectiveness of using the DCGAN to create synthetic HIF data.

Yang, Kun↗

Updated Guidance on Sensitivity/Uncertainty Methods Use for Nuclear Criticality Safety Validation

The use of sensitivity/uncertainty (S/U) methods in nuclear criticality safety (NCS) was established more than 25 years ago and has been increasing ever since. Recent interest in commercial applications involving uranium enrichments above 5 wt% 235 U has increased focus on demonstrating the applicability of existing critical experiments to this enrichment range. S/U techniques can also be particularly useful in assessing the similarity of new fuel forms in relation to those documented in existing published evaluations of benchmark critical experiments. Publishing updated recommendations for the use of these methods is thus important to ensure that new S/U practitioners can benefit from the years of development and application invested in generating a set of best practices to maximize the utility of these tools.

NCS↗