Search NASA⌕ Search

SEARCH · Search NASA

Results for “validation method”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

Mercury Concentrations in the Two-Toed Amphiuma ( Amphiuma means ) and the Lesser Siren ( Siren intermedia ): Validating Non-lethal Sampling Methods in Southeastern Aquatic Salamanders

The global decline of amphibians is a major conservation issue. Many stressors are recognized for this decline including exposure to environmental contaminants. Mercury (Hg) is an environmental contaminant that bioaccumulates in wildlife and can cause a variety of negative impacts across taxa, including amphibians. Amphiuma and Siren spp. can comprise a large portion of biomass within their respective ecosystems, and thus, likely serve as important predators or prey in wetland communities. However, due to their cryptic nature, little is known about their ecology, diet, and accumulation potential. Here, we sought to validate a non-lethal sampling method to quantify total mercury (THg) in two enigmatic species of aquatic salamanders: the two-toed amphiuma (Amphiuma means) and the lesser siren (Siren intermedia). We examined relationships between THg content in lethal (whole-body) and non-lethal (tail clip) samples. Tail clips were significant predictors of whole body THg (all p < 0.001), explaining 84-89% of variation in whole body THg. Average whole-body THg (mg/kg did not significantly differ between the two species (p = 0.97), and overall, they had similar whole body THg content (LESI = 0.330 ± 0.04, n = 18; AMME = 0.333 ± 0.07, n = 11). To our knowledge, these data represent the first reported Hg burdens in A. means and S. intermedia.

63 RADIATION, THERMAL, AND OTHER ENVIRON. POLLUTAN↗

Verification and Validation of Two Hydrodynamic Methods for Simulations of High Energy Density Physics Problems

A 3D verification and validation suite of test problems is presented and used to evaluate hydrodynamic methods within a radiation hydrodynamics code, xRAGE. These test problems exercise different levels of complexity, building towards ICF problems which in addition to hydrodynamics also include three temperature plasma physics, thermal conduction, and radiation diffusion. Among the problems in the test suite are the Kidder ball problem, the Verney shell problem, and a 5-material compression problem, which exercise different purely hydrodynamic methods implemented within xRAGE. There is excellent agreement between 2D and 3D XRAGE simulation results and between the xRAGE results and the benchmark solutions. Two 3D ICF test problems are also presented, based on an OMEGA direct drive capsule experiment and on a NIF indirect drive capsule experiment. It is demonstrated that the newer unsplit hydrodynamic method in xRAGE produces more vorticity relative to the older default method. For the indirect drive capsule, the 3D simulations are in reasonable agreement with the experimental values of ion temperature and neutron production.

47 OTHER INSTRUMENTATION↗

Software Verification Toolkit (SVT): Survey on Available Software Verification Tools and Future Direction

Writing software is difficult. However, writing complex, well tested and designed, and functionally correct software is incredibly difficult. An entire field of study is devoted to the validation and verification of software to address this problem, and in this paper we analyze the landscape of currently available third party software. We have divided our analyses into three separate subsections with regards to software validation: formal methods, static analysis, and test generation. Formal verification is the most complex method in which to validate software correctness, but also the most thorough as it truly validates the mathematical validity of the source code. Static analysis generally is relegated to abstract syntax tree traversal techniques to find errors related to faulty software such as memory leaks or stack overflow issues. Automatic test generation is similar in implementation to static analysis, but pushes a bit further in verifying the boundedness of function inputs and outputs with regards to annotated or parsed criteria. The crux of this report is to analyze and describe the software tools that implement these techniques to validate and verify software. Pros and cons related to installation, utilization, and capabilities of the frameworks are described, and reproducible examples are provided with a focus on usability. The initial survey concluded that the most interesting tools of note are Z3, Isabelle/HOL, and TLA+ with regards to formal verification; and Infer, Frama-C, and SonarQube with regards to static analysis. With these tools in mind, a final conjecture is provided that describes future avenues of utilizing these tools for developing a verification framework to assist in validating existing software at Sandia National Laboratories.

97 MATHEMATICS AND COMPUTING↗

The 1st International Round-Robin on Bi-Facial Modules

This presentation discusses validation of methods and ensuring the validity of results when testing bifacial PV modules, both of which are requirements in ISO/IEC 17025:2017; electrical parameters to be reported per IEC TS 60904-1-2; and statistical design proficiency testing per ISO 17043.

14 SOLAR ENERGY↗

Efficient modeling of optically-complex, non-coplanar exterior shading: Validation of matrix algebraic methods

It has long been established that shading windows with overhangs, fins, and other types of non-coplanar systems (NCS) is one of the most effective ways of controlling solar heat gains in buildings because they intercept solar radiation prior to entry into the building. Designers however often specify non-opaque materials (e.g., louvers, fritted glass, expanded metal mesh) for these systems in order to admit daylight, reduce lighting energy use, and improve indoor environmental quality. Most simulation tools rely on geometric calculations and radiosity methods to model the solar heat gain impacts of NCS and cannot model optically-complex materials or geometries. For daylighting analysis, optically-complex NCS can be modeled using matrix algebraic methods, although time-efficient parametric analysis has not yet been implemented. Determining the best design and/or material for static or operable NCS that minimize cooling, heating, and lighting energy use and peak demand requires an iterative process. This study describes and validates a matrix algebraic method that enables parametric energy analysis of NCS. Such capabilities would be useful not only for design but also for development of prescriptive energy-efficiency standards, rating and labeling systems for commercial products, development of design guidelines, and development of more optimal NCS technologies. A facade or “F” matrix, which maps the transfer of flux from the NCS to the surface of the window, is introduced and its use is explained. A field study was conducted in a full-scale outdoor testbed to measure the daylight performance of an operable drop-arm awning. Simulated data were compared to measured data in order to validate the models. Results demonstrated model accuracy: simulated workplane illuminance was within 11–13%, surface luminance was within 16–18%, and the daylight glare probability was within 6–9% of measured results. Methods used to achieve accurate results are discussed. Results of the validation of daylighting performance are applicable to solar heat gain performance. Since exterior shading can also significantly reduce peak demand, these models enable stakeholders to more accurately assess HVAC and lighting impacts in support of grid management and resiliency goals.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Neutrinoless double-β decay of 124 Sn, 130 Te, and 136 Xe in the Hamiltonian-based generator-coordinate method

We present a generator-coordinate method for realistic shell-model Hamiltonians that closely approximates the full shell model calculations of the matrix elements for the neutrinoless double-β decay of 124 Sn, 130 Te, and 136 Xe. Here, we treat not only quadrupole deformations but also the proton-neutron pairing amplitudes as generator coordinates. We validate this method by calculating and comparing spectroscopic quantities with the exact shell model results and experimental data. Our Hamiltonian-based generator-coordinate method produces 0νββ matrix elements much closer to the shell model ones, compared to the existing energy-density-functional-based generator-coordinate approaches. The remaining overestimation of 0νββ nuclear matrix element suggests that additional correlations may be needed to be taken into account for 124 Sn, 130 Te, and 136 Xe when calculating with the Hamiltonian-based generator-coordinate method. The validation of this method may open the possibility of calculating 0νββ matrix element of 150 Nd in a large shell-model space.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Solidification and crystallographic texture modeling of laser powder bed fusion Ti-6Al-4V using finite difference-monte carlo method

Laser powder bed fusion (LPBF) additive manufacturing makes near-net-shaped parts with reduced material cost and time, rising as a promising technology to fabricate Ti-6Al-4V, a widely used titanium alloy in aerospace and medical industries. However, LPBF Ti-6Al-4V parts produced with 67° rotation between layers, a scan strategy commonly used to reduce microstructure and property inhomogeneity, have varying grain morphologies and weak crystallographic textures that change depending on processing parameters. Here, this study predicts LPBF Ti-6Al-4V solidification at three energy levels using a finite difference-Monte Carlo method and validates the simulations with large-area electron backscatter diffraction (EBSD) scans. The developed model accurately shows that a <001> texture forms at low energy and a <111> texture occurs at higher energies parallel to the build direction but with a lower strength than the textures observed from EBSD. A validated and well-established method of combining spatial correlation and general spherical harmonics representation of texture is developed to calculate a difference score between simulations and experiments. The quantitative comparison enables effective fine-tuning of nucleation density (N 0 ) input, which shows a nonlinear relationship with increasing energy level. Future improvements in texture prediction code and a more comprehensive study of N 0 with different energy levels will further advance the optimization of LPBF Ti-6Al-4V components. These developments contribute a novel understanding of crystallographic texture formation in LPBF Ti-6Al-4V, the development of robust model validation and calibration pipeline methodologies, and provide a platform for mechanical property prediction and process parameter optimization.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

A relative radiometric correction method for airborne SWIR hyperspectral image using the side-slither technique

Stripe noise still remains in airborne short-wave infrared (SWIR) hyperspectral (HS) images after laboratory calibration due to the stray light of HS imager, nonlinear response of infrared focal plane array, and the distinct difference of equivalent color temperature between the integrating sphere and the sun. It is difficult to get a sun-like radiation source, and we apply the side-slither technique for relative radiometric correction of HS images. The calibration data corresponding to different irradiance were obtained by the side-slither technique of imager. Then, the two-point multi-section method is used for relative radiometric correction of HS images. This paper presents the principle, the experimental results, and the analysis of the proposed method. To validate the effectiveness of this method, it was compared with other methods and evaluated by quantitative quality indices. The results reveal that this method has a good performance in relative radiometric correction of HS image and is superior to the laboratory calibration based on integrating sphere. Consequently, the proposed method can successfully eliminate the adverse effect caused by the difference of equivalent color temperature between radiation sources, and also can improve the accuracy of HS applications such as absolute radiation correction and target recognition.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Efficient Data-Driven Geologic Feature Characterization from Pre-stack Seismic Measurements using Randomized Machine-Learning Algorithm

Conventional seismic techniques for detecting the subsurface geologic features are challenged by limited data coverage, computational inefficiency and subjective human factors. We developed a novel data-driven geological feature characterization approach based on pre-stack seismic measurements. Our characterization method employs an efficient and accurate machine learning method to extract useful subsurface geologic features automatically. Specifically, we use kernel ridge regression to account for the nonlinear relationship between seismic data and geological features. We moreover employ kernel tricks to avoid the explicit nonlinear mapping and infinite dimension of feature space. Yet, the conventional kernel ridge regression can be computationally prohibitive because of the large volume of seismic measurements. We employ a data reduction technique in combination with the conventional kernel ridge regression method to improve the computational efficiency and reduce memory usage. In particular, we utilize a randomized numerical linear algebra technique, named Nyström method, to effectively reduce the dimensionality of the feature space without compromising the information content required for accurate characterization. We provide thorough computational cost analysis to show the efficiency of our new geological feature characterization methods. We validate the performance of our method in characterizing geologic fault zones because faults play an important role in various subsurface applications. Our numerical examples demonstrate that our new characterization method significantly improves the computational efficiency while maintaining comparable accuracy. Interestingly, we demonstrate that our approach yields a speedup ratio on the order of ~102 to ~103 in a multicore computational environment.

58 GEOSCIENCES↗

Estimation of Behind-the-Meter Solar Generation by Integrating Physical with Statistical Models

Accurate estimation of solar photovoltaic (PV) generation is crucial for distribution grid control and optimization. Unfortunately, most of the residential solar PV installations are behind-the-meter. Thus, utilities only have access to the net load readings. This paper presents an unsupervised framework for estimating solar PV generation by disaggregating the net load readings. The proposed framework synergistically combines a physical PV system performance model with a statistical model for load estimation. Specifically, our algorithm iteratively estimates solar PV generation with a physical model and electric load with the Hidden Markov model regression. The proposed algorithm is also capable of estimating the key technical parameters of the solar PV systems. Our proposed method is validated against net load and solar PV generation data gathered from residential customers located in Austin, Texas. The validation results show that our method reduces mean squared error by 44% compared to the state-of-the-art disaggregation algorithm.

24 POWER TRANSMISSION AND DISTRIBUTION↗

A Causal Approach to Model Validation and Calibration

This poster presents a novel method for validation and verification that focuses on identifying causal relationships between data elements, moving beyond traditional statistical and machine learning approaches. These methods employ causal discovery techniques to reveal the underlying mechanisms of data generation. The research utilizes structural causal models and directed acyclic graphs to depict causal relationships. This approach assists in achieving alignment between simulation models and reality.

97 MATHEMATICS AND COMPUTING↗

Development and validation of an automatic method to detect the latest contracting viable left ventricular segments to assist guide CRT therapy from gated SPECT myocardial perfusion imaging

Objectives: The purpose of this study is to use ECG-gated SPECT MPI to detect the latest contracting viable left ventricular (LV) segments to help guide the LV probe placement used in CRT therapy and to validate segment selection against the visual integration method by experts. Methods: For each patient, the resting ECG-gated SPECT MPI short-axis images were sampled in 3D to generate a polar map of the perfusion distribution used to determine LV myocardial viability, and to measure LV synchronicity using our phase analysis tool. In the visual integration method, two experts visually interpreted the LV viability and mechanical dyssynchrony from the short-axis images and polar maps of viability and phase, to determine the latest contracting viable segments using the 17-segment model. In the automatic method, the apical segments, septal segments, and segments with more than 50% scar were excluded as these are not candidates for CRT LV probe placement. Amongst the remaining viable segments, the segments, whose phase angles were within 10° of the latest phase angle (the most delayed contracting segment), were identified for potential CRT LV probe placement and ranked based on the phase angles of the segments. Both methods were tested in 36 pre-CRT patients who underwent ECG-gated SPECT MPI. The accuracy was determined as the percent agreement between the visual integration and automatic methods. The automatic method was performed by a second independent operator to evaluate the inter-operator processing reproducibility. Results: In all the 36 patients, the LV lead positions of the 1st choices recommended by the automatic and visual integration methods were in the same segments in 35 patients, which achieved an agreement rate of 97.2%. In the inter-operator reproducibility test, the LV lead positions of the 1st choices recommended by the two operators were in the same segments in 25 patients, and were in the adjacent segments in 7 patients, which achieved an overall agreement of 88.8%. Conclusions: An automatic method has been developed to detect the latest contracting viable LV segments to help guide the LV probe placement used in CRT therapy. The retrospective clinical study with 36 patients suggests that this method has high agreement against the visual integration method by experts and good inter-operator reproducibility. Consequently, this method is promising to be a clinical tool to recommend the CRT LV lead positions.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Active learning using hybrid surrogate tool life modeling for machining process optimization

Here, this paper describes an active learning approach for part-to-part iterative machining process optimization using a hybrid surrogate tool life model. A probabilistic interpolating tool life model is developed by combining the empirical Taylor-type tool life equation and the model fit error. The probabilistic tool life model is then used to calculate the machining cost per part distribution. The optimal machining parameters are selected using an expected improvement in machining cost per part criterion. The method is validated numerically using experimental results; the results show a median convergence error of 2.2% after three tests over 400 simulations. The method is validated experimentally on two industrial applications for Ti-6Al-4V roughing resulting in a cost per part reduction greater than 23% after two tests. The described method is a robust solution for rapid convergence to optimal machining parameters in an industrial production environment.

Active learning↗

Spatio-Temporal Deep Graph Network for Event Detection, Localization, and Classification in Cyber-Physical Electric Distribution System

This work proposes a deep graph learning framework to identify, locate, and classify power, cyber, and cyber power events at the distribution system level. The proposed algorithm jointly exploits spatial, temporal, and node-level cyber and physical data features. The developed graph neural network, together with a deep autoencoder, utilizes physical measurements from distribution level phasor measurement units and cyber data from communication network logs. The spatial structure of the synchrophasor measurements and network is incorporated through a weighted adjacency matrix. The temporal structure is incorporated by defining a spatial operation in the gated recurrent unit. This spatio-temporal learning element resides inside a power event detection, localization, and classification module that provides the degree of confidence for an event label. To accurately pinpoint the location of an event to the nearest bus equipped with a measurement unit, a combination of squared error and proximity score is utilized. Also included is a cyber event detection module that employs heteroskedasticity to analyze the significance of various cyber features during different types of attacks. Finally, a dual-bit cyber-power decision table determines the nature of the event. The proposed method is validated on two distribution systems modeled in OPAL-RT/Hypersim with limited phasor measurement units for different possible physical and cyber events. Further analyses include comparison with other state-of-the-art methods and validation in the presence of measurement noise. As a result, our method outperforms existing approaches and achieves an average detection accuracy of 97.97%, F1-score of 96.88%, precision of 96.53%, and recall of 98.57%.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Merging Fungal and Bacterial Community Profiles via an Internal Control

Integrated measurements of fungi and bacteria are critical to understand how interactions between these taxa drive key processes in ecosystems ranging from soils to animal guts. High-throughput amplicon sequencing is commonly used to census microbiomes, but the genetic markers targeted for fungi and bacteria (typically ribosomal regions) are domain-specific so profiling must be performed separately, obscuring relationships between these groups. To solve this problem, we developed a spike-in method with an internal control (IC) construct containing primer sites commonly used for bacterial and fungal taxonomic profiling. The internal control offers several advantages: estimation of absolute abundances, estimation of fungal to bacterial ratios (F:B), integration of bacterial and fungal profiles for holistic community analysis, and lower costs compared to other quantitation methods. To validate the IC as a scaling method, we compared IC-derived measures of F:B to measures from quantitative PCR (qPCR) using a commercial mock community (the ZymoBiomic Microbial Community DNA Standard II, containing two fungi and eight bacteria) and complex environmental samples. For both the mock community and the environmental samples, the IC produced F:B values that were statistically consistent with qPCR. Merging the environmental fungal and bacterial profiles based on the IC-derived F:B values revealed new relationships among samples in terms of community similarity. As a result, this IC method is the first spike-in method to employ a single construct for cross-domain amplicon sequencing, offering more reliable measurements.

59 BASIC BIOLOGICAL SCIENCES↗

Direct determination of one-dimensional interphase structures using normalized crystal truncation rod analysis

Here, a one-dimensional non-iterative direct method was employed for normalized crystal truncation rod analysis. The non-iterative approach, utilizing the Kramers–Kronig relation, avoids the ambiguities due to an improper initial model or incomplete convergence in the conventional iterative methods. The validity and limitations of the present method are demonstrated through both numerical simulations and experiments with Pt(111) in a 0.1 M CsF aqueous solution. The present method is compared with conventional iterative phase-retrieval methods.

36 MATERIALS SCIENCE↗

New Capability at ORNL: High Precision Uranium Titration

Destructive analytical measurements establish a nuclear facility’s nuclear material inventory and inventory differences for Nuclear Material Accountancy and Control. A nuclear laboratory’s ability to perform accurate high-precision analytical measurements is key for tracking large inventories within a facility’s material balance areas and during production to track material movement through dynamic processes. For uranium, these measurements are made by using several established high-precision measurement protocols. These include isotope dilution mass spectrometry, gravimetry, and potentiometric titrations. Whatever measurement technique a nuclear lab chooses to use, reference materials (RMs) with certified attributes and accompanying uncertainties are used to calibrate measurement systems, and are the cornerstone for accurate results. In addition to calibration, RMs provide for metrological traceability, are used for method development and validation, and thus provide critical evaluations of the appropriateness and performance of analytical processes used. Evaluations may include validation that a method is fit-for-purpose, quantification of systematic and random biases, and the evaluation of long-term and short-term performance metrics. High-precision measurement techniques require that measured attributes be certified to a high degree of precision in the RMs used—ultimately, to a higher degree than that of the measurement technique itself. The US authority on the production of special nuclear material Certified Reference Materials is the NBL Program Office (NBLPO), formally known as New Brunswick Laboratory (NBL). The NBLPO is responsible for the sales and distribution of existing NBL certified reference materials (CRMs) and for the production of the next generation of nuclear RMs. To accomplish its mission, NBLPO is establishing key base capabilities within the DOE laboratory complex that formerly existed at the NBL laboratory. The Nuclear Analytical Chemistry (NAC) section within the Chemical Sciences Division (CSD) at Oak Ridge National Laboratory (ORNL) is currently working with NBLPO to set up laboratory and measurement capabilities to provide measurements and capabilities for production and/or recertification of existing and future CRMs for uranium assay. The NBL-developed high-precision titration (HPT) method is a critically-evaluated, extremely precise and accurate primary method utilized for the determination of uranium content in a variety of uranium materials. The HPT method, combined with detailed balance weighing protocols, provides for an analytical methodology that is unsurpassed in precision and one in which all sources of error have been evaluated, a requirement of CRM certification. HPT capability within the United States was lost with the closure of the labs at NBL. The NAC has been collaborating with NBLPO to stand up and demonstrate the capability to perform uranium assay via HPT at ORNL. HPT can produce results with an expanded uncertainty of approximately 0.01% for pure uranium compounds, with typical precisions of <0.006%. The major tasks required to stand up the method at ORNL were the refurbishment of a dedicated lab and equipment setup, procedure development, analyst training, establishing method-specific quality assurance, and qualification of an analyst to perform the method. This report summarizes these tasks, outlines the documents drafted, and gives the outcome of the qualification titrations.

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗