SEARCH · Search NASA

Results for “error testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14

All sources NASA NTRS DOE OSTI

DOE OSTI2025

A comparison of effective field theory models of redshift space galaxy power spectra for DESI 2024 and future surveys

In preparation for the next generation of galaxy redshift surveys, and in particular the year-one data release from the Dark Energy Spectroscopic Instrument (DESI), we investigate the consistency of a variety of effective field theory models that describe the galaxy-galaxy power spectra in redshift space into the quasi-linear regime using 1-loop perturbation theory. These models are employed in the pipelines velocileptors, PyBird, and Folpsν. While these models have been validated independently, a detailed comparison with consistent choices has not been attempted. After briefly discussing the theoretical differences between the models we describe how to provide a more apples-to-apples comparison between them. We present the results of fitting mock spectra from the AbacusSummit suite of N-body simulations provided in three redshift bins to mimic the types of dark time tracers targeted by the DESI survey. We show that the theories behave similarly and give consistent constraints in both the forward-modeling and ShapeFit compressed fitting approaches. We additionally generate (noiseless) synthetic data from each pipeline to be fit by the others, varying the scale cuts in order to show that the models agree within the range of scales for which we expect 1-loop perturbation theory to be applicable. Finally, this work lays the foundation of Full-Shape analysis with DESI Y1 galaxy samples where in the tests we performed, we found no systematic error associated with the modeling of the galaxy redshift space power spectrum for this volume.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2023

Explainable machine learning for hydrogen diffusion in metals and random binary alloys

Hydrogen diffusion in metals and alloys plays an important role in the discovery of new materials for fuel cell and energy storage technology. While analytic models use hand-selected features that have clear physical ties to hydrogen diffusion, they often lack accuracy when making quantitative predictions. Machine learning models are capable of making accurate predictions, but their inner workings are obscured, rendering it unclear which physical features are truly important. To develop interpretable machine learning models to predict the activation energies of hydrogen diffusion in metals and random binary alloys, we create a database for physical and chemical properties of the species and use it to fit six machine learning models. Our models achieve root-mean-squared errors between 98–119 meV on the testing data and accurately predict that elemental Ru has a large activation energy, while elemental Cr and Fe have small activation energies. By analyzing the feature importances of these fitted models, we identify relevant physical properties for predicting hydrogen diffusivity. While metrics for measuring the individual feature importances for machine learning models exist, correlations between the features lead to disagreement between models and limit the conclusions that can be drawn. Instead grouped feature importance, formed by combining the features via their correlations, agree across the six models and reveal that the two groups containing the packing factor and electronic specific heat are particularly significant for predicting hydrogen diffusion in metals and random binary alloys. In conclusion, this framework allows us to interpret machine learning models and enables rapid screening of new materials with the desired rates of hydrogen diffusion.

36 MATERIALS SCIENCE↗

DOE OSTI2023

Adaptive Envelope Detector-Based Phase Fault Detection Method for Power System Grid Distortions

In this study, a phase fault detection algorithm is developed by employing the envelope detector method. The proposed method diagnoses faults among phases and defines fault areas in the incoming signal. The designed algorithm consists of three steps: analytical signal conversion, complex magnitude, and fault detection. Initially, an analytical signal is obtained from the incoming power signal to determine the instantaneous amplitude and phase of the signal. A complex magnitude operation is applied to analytical signals to display changes in amplitude. On the basis of the threshold values specified by the user, the last step identifies the distortion signal in terms of the type of error and size. The proposed method is tested with realistically simulated substation power signal data and real power system data from the Grid Event Signature Library. The obtained results revealed that the proposed method detects distortions accurately.

Alaca, Ozgur↗

DOE OSTI2022

Experimental and Numerical Study on the Effect of Annular Combustor Design on Thermal Uniformity Jet in Crossflow

Abstract Non-uniformity of the exit flow temperature represents one of the significant damages to gas-turbine components, particularly turbine blades. This may occur in the course of gas-turbine operation. This paper aims to provide passive techniques by modifying the combustor design rather than changing the flow parameters to improve the thermal uniformity and turbine blades to reduce thermal stresses and increase turbine blades’ life span. An acceptable agreement between the numerical and experimental results has been achieved, and the agreement includes the velocity and temperature profile. Four different angles have been tested numerically and experimentally with a maximum error of 5% at two different Reynolds numbers. Designing the outer combustor surface with a 45-deg angle bend can give a more uniform temperature distribution of 37% higher than the basic design with only a 0.5% higher pressure drop.

Energy & Fuels↗

DOE OSTI2023

Code Coverage Status of ARC Code-DIF3D

The Argonne Reactor Code (ARC) software system supports users in their fast reactor design goals by providing neutronic, thermal-hydraulic, and structural analysis capabilities. DIF3D plays a pivotal role in the ARC system as the primary homogenized assembly neutronic calculation methodology for fast reactor problems. Over its 40 years history, ARC software usage with DIF3D has been applied to numerous fast and thermal spectrum reactor analysis projects with good to excellent comparison against experiments. With continued improvement of computation resources, many of the geometry modeling capabilities in DIF3D that were primarily used in low order schemes are not really needed anymore. Today, the diffusion and transport capabilities of DIF3D-VARIANT are primarily used in the reactor design process with some scattered usage of DIF3D-FD and DIF3D-Nodal. In recent work, the DIF3D software verification was completed for DIF3D-FD and DIF3D-VARIANT on the geometry options used in the Versatile Test Reactor project. While we can be confident that these capabilities of DIF3D are well used and thus trusted, it does not demonstrate that all possible input options of DIF3D are actually working, but just those that were tested as part of VTR are and that they are correct. Thus, the purpose of the present work is to identify a set of test problems for DIF3D and assess the code coverage of DIF3D for those test problems. The goal is to document what parts of the existing DIF3D code are touched by the set of test problems and which are not. Because the verification work done on DIF3D-VARIANT and DIF3D-FD was focused on the most common uses of DIF3D for fast reactor analysis, the code coverage assessment of those capabilities is the highest priority. This will ensure that nothing is being missed by the existing verification test problems that DIF3D relies upon. The DIF3D-Nodal capability will also be inspected for code coverage as part of this work to further ensure that regular regression testing of DIF3D will trap any likely errors the end user might experience with the DIF3D software. The code coverage analysis of DIF3D was performed with the Code Coverage Tool of the Intel Fortran compiler which requires modifications to the compilation of DIF3D. The detailed coverage tables are given for each submodule of DIF3D separately, and for the submodules which are primarily developed for DIF3D, most of the source files could be at least partially touched. Most of the uncovered parts/files could be easily ignored, because they are either for error message and debugging output or obviously not needed by DIF3D. Out of the entire source codes of DIF3D, only a few uncovered modules deserve further investigation.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

DOE OSTI2025

Code Coverage Status of the ARC Code DIF3D

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

DOE OSTI2022

A Wireless Underground Sensor Network Field Pilot for Agriculture and Ecology: Soil Moisture Mapping Using Signal Attenuation

Wireless Underground Sensor Networks (WUSNs) that collect geospatial in situ sensor data are a backbone of internet-of-things (IoT) applications for agriculture and terrestrial ecology. In this paper, we first show how WUSNs can operate reliably under field conditions year-round and at the same time be used for determining and mapping soil conditions from the buried sensor nodes. We demonstrate the design and deployment of a 23-node WUSN installed at an agricultural field site that covers an area with a 530 m radius. The WUSN has continuously operated since September 2019, enabling real-time monitoring of soil volumetric water content (VWC), soil temperature (ST), and soil electrical conductivity. Secondly, we present data collected over a nine-month period across three seasons. We evaluate the performance of a deep learning algorithm in predicting soil VWC using various combinations of the received signal strength (RSSI) from each buried wireless node, above-ground pathloss, the distance between wireless node and receive antenna (D), ST, air temperature (AT), relative humidity (RH), and precipitation as input parameters to the model. The AT, RH, and precipitation were obtained from a nearby weather station. We find that a model with RSSI, D, AT, ST, and RH as inputs was able to predict soil VWC with an R 2 of 0.82 for test datasets, with a Root Mean Square Error of ±0.012 (m 3 /m 3 ). Hence, a combination of deep learning and other easily available soil and climatic parameters can be a viable candidate for replacing expensive soil VWC sensors in WUSNs.

47 OTHER INSTRUMENTATION↗

DOE OSTI2022

Autoencoder Neural Network for chemically reacting systems

Incorporating detailed chemical kinetic models is critical for accurate simulations of reacting flows. However, detailed models involve a large number of thermochemical (TC) state variables. Solving the governing equations to evolve these TC variables becomes impractical for real-world applications. In this work, we propose an autoencoder (AE) neural network (NN)-based reduced model to accelerate such simulations. The AE NN is first trained to find a low-dimensional latent representation of the TC states. Then, the evolving state of a chemical system can be tracked by solving the equations of the latent variables instead of the original TC equations. We demonstrate the reduced model in a syngas CO/H 2 combustion system, using training data collected from canonical perfectly stirred reactors (PSRs). It is found that the AE model can reduce the dimension of the combustion system from 12 to 2 while maintaining low reconstruction error and excellent elemental mass conservation for the test dataset. In the a posteriori test, the combustion states obtained from solving the two latent equations are compared to those from solving the 12 equations of the full model. The AE reduced method is found to be able to capture the diverse combustion states on the top two branches of the S-curve well including the extinction turning point, but with higher prediction errors for states near the ignition turning point.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2024

Comparison of Full-Field and Integrated CFD Convergence Based on Richardson Extrapolation

This work investigated the usefulness of Richardson extrapolation--based discretization error estimates across all points in a solution field to produce a spatial convergence field for a computational fluid dynamics (CFD) simulation. The presented work used previously developed methods for Richardson extrapolation to compute the convergence orders of a CFD simulation at all points of the base (coarsest) mesh solution. Three test cases of increasing complexity were considered: Poiseuille flow, incompressible flow around a sharp corner, and transonic flow over an RAE 2822 airfoil. These test cases highlighted the potential of the proposed method to identify error sources and their relation to the model system-response-quantity convergence orders. However, these test cases also revealed the immaturity of the proposed method stemming from the unreliability of computing observed convergence orders at single points. Nonetheless, the test cases highlighted that the observed convergence orders allow for a more accurate diagnosis of constructive and destructive error transport than mesh pair error estimates. In the long run, the proposed method can be a tool for developing efficient and advanced error management strategies like adaptive mesh refinement.

Weinmeister, Justin↗

DOE OSTI2020

Improved performance of stellarator coil design optimization

Following up on earlier work which demonstrated an improved numerical stellarator coil design optimization performance by the use of stochastic optimization (Lobsien et al., Nucl. Fusion, vol. 58 (10), 2018, 106013), it is demonstrated here that significant further improvements can be made – lower field errors and improved robustness – for a Wendelstein 7-X test case. This is done by increasing the sample size and applying fully three-dimensional perturbations, but most importantly, by changing the design sequence in which the optimization targets are applied: optimization for field error is conducted first, with coil shape penalties only added to the objective function at a later step in the design process. A robust, feasible coil configuration with a local maximum field error of 3.66 % and an average field error of 0.95 % is achieved here, as compared to a maximum local field error of 6.08 % and average field error of 1.56 % found in our earlier work. These new results are compared to those found without stochastic optimization using the FOCUS and ONSET suites. The relationship between local minima in the optimization space and coil shape penalties is also discussed.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

DOE OSTI2022

Revenue prediction for integrated renewable energy and energy storage system using machine learning techniques

Revenue estimation for integrated renewable energy and energy storage systems is important to support plant owners or operators’ decisions in battery sizing selection that leads to maximized financial performances. A common approach to optimizing revenues of a hybrid hydro and energy storage system is using mixed-integer linear programming (MILP). Although MILP models can provide accurate production cost estimations, they are typically very computationally expensive. To provide a fast yet accurate first-step information to hydropower plant owners or operators who consider integrating energy storage systems, we propose an innovative approach to predicting optimal revenues of an integrated energy generation and storage system. In this study, we examined the performance of two prediction techniques: Generalized Additive Models (GAMs) and machine learning (ML) models developed based on artificial neural networks (ANN). Predictive equations and models are generated based on optimized solutions from a market participation optimization model, the Conventional Hydropower Energy and Environmental Resource System (CHEERS) model. The two predicting techniques reduce the computational time to evaluate annual revenue for one set of battery configurations from 3 h to 1 to 4 min per run while also being implementable with significantly less data. The model validation prediction errors of developed GAMs and ML models are generally below 5%; for model testing predictions, the ML models consistently outperform the regression equations in terms of root mean square errors. This new approach allows plant owners, operators, or potential investors to quickly access multiple battery configurations under different energy generation and market scenarios. This new revenue prediction method will therefore help reduce the barriers, and thereby promoting the deployment of battery hybridization with existing renewable energy sources.

13 HYDRO ENERGY↗

DOE OSTI2022

PELICAN Status Report for Year 2021

The Pressure Drop Experimental Loop for Investigations of Core Assemblies in Advanced Nuclear Reactors, PELICAN, is a novel experimental facility designed and constructed to recreate the prototypic full scale hydraulic flow conditions for the Versatile Test Reactor (VTR) currently under development by the U.S. Department of Energy. To support VTR design efforts, PELICAN is used to replicate VTR’s primary heat transport system (PHTS) in the core assembly region. The measurement objectives for data generated from this test facility are to mimic the prototypic VTR assembly and to meet the validation needs for code calculations and simulations of the reference design for the VTR core. These objectives focus on the need to validate pressure drop results across the various segments of the fuel assembly, including the axial reflectors, fuel, and transition regions, as they relate directly to the pumping power and safety behavior of the reactor. In the following sections, the major milestones for the experimental work performed on PELICAN over the calendar year (CY) 2021 are presented. In the next section, we discuss the assembly and shakedown testing of the facility. In Section 3, an analysis of the errors in the major measurements is performed. In Section 4 and 5 we present the results from the first set of test articles placed inside the loop. The design of the remaining test articles as part of the full assembly are shown in Section 6 and the conclusion and path forward for the following year, CY22 is given in the final section.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

DOE OSTI2024

Positioning Accuracy in a Concurrent Robot-CNC Hybrid Manufacturing System

Abstract Additive manufacturing (AM) has gained notoriety for offering advantages over traditional manufacturing methods, such as increased design complexity and flexibility. However, it has not found widespread use beyond rapid prototyping. One hindrance to the acceptance of AM processes in industry is the time and cost of fabrication per component. While metal AM by itself can be inexpensive, extra manufacturing steps in the form of subtractive manufacturing (SM) may need to be performed to reach final part tolerances, leading to hybrid additive-subtractive manufacturing (HASM) of a part, which increases time and cost. A potential area to reduce cost is through increasing the efficiency of the HASM process by conducting additive and subtractive manufacturing simultaneously. Usually, HASM is performed in a process where AM is completed in one machine or cell and transferred to another machine or cell for SM in a sequential assembly line process. This efficiency decreases part cost, but high aspect ratio parts or parts with internal geometry that require interleaved additive deposition and machining cannot be produced. One unexplored solution to simultaneous HASM that allows for interleaved operations is to operate the deposition head and machining spindle concurrently within the same machine envelope, known as concurrent HASM (CHASM). In this type of process, both AM and SM occur simultaneously on a batch of small parts or a single large part, maintaining a high efficiency without sacrificing the full range of complex geometries that AM allows for. A potential approach to the single-machine method could be to combine a robot and mill within the same envelope. A challenge to this approach, however, is control of both systems. Most machine controllers have limited external communication or, if a robot has been integrated, only offer movement of either the robot or mill at any given time. As a result, systems must pause either the AM or SM process to switch between them rather than working simultaneously. The present work investigates the positional accuracy of such a CHASM system comprised of a robotic arm and a 3-axis mill. Open-loop tests with limited communication between machines are performed on the system to verify positional error during concurrent robot-mill movements. Under certain conditions, it is demonstrated that position error can stay within 2 mm for the duration of a single layer; however, these tests show that, generally, the open-loop positioning performance of the system is inadequate for CHASM without part-specific hand-tuning of parameters. Based on these results, a set of requirements for successful robot-CNC CHASM is proposed for future integrations.

Goodwin, Jesse↗

DOE OSTI2022

DeepAdversaries: examining the robustness of deep learning models for galaxy morphology classification

With increased adoption of supervised deep learning methods for work with cosmological survey data, the assessment of data perturbation effects (that can naturally occur in the data processing and analysis pipelines) and the development of methods that increase model robustness are increasingly important. In the context of morphological classification of galaxies, we study the effects of perturbations in imaging data. In particular, we examine the consequences of using neural networks when training on baseline data and testing on perturbed data. We consider perturbations associated with two primary sources: (a) increased observational noise as represented by higher levels of Poisson noise and (b) data processing noise incurred by steps such as image compression or telescope errors as represented by one-pixel adversarial attacks. We also test the efficacy of domain adaptation techniques in mitigating the perturbation-driven errors. We use classification accuracy, latent space visualizations, and latent space distance to assess model robustness in the face of these perturbations. For deep learning models without domain adaptation, we find that processing pixel-level errors easily flip the classification into an incorrect class and that higher observational noise makes the model trained on low-noise data unable to classify galaxy morphologies. On the other hand, we show that training with domain adaptation improves model robustness and mitigates the effects of these perturbations, improving the classification accuracy up to 23% on data with higher observational noise. Domain adaptation also increases up to a factor of ${\approx}2.3$ the latent space distance between the baseline and the incorrectly classified one-pixel perturbed image, making the model more robust to inadvertent perturbations. Successful development and implementation of methods that increase model robustness in astronomical survey pipelines will help pave the way for many more uses of deep learning for astronomy.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2022

Model Evaluation by Measurements from Collocated Remote Sensors in Complex Terrain

Model improvement efforts involve an evaluation of changes in model skill in response to changes in model physics and parameterization. When using wind measurements from various remote sensors to determine model forecast accuracy, it is important to understand the effects of measurement-uncertainty differences among the sensors resulting from differences in the methods of measurement, the vertical and temporal resolution of the measurements, and the spatial variability of these differences. Here we quantify instrument measurement variability in 80-m wind speed during WFIP2 and its impact on the calculated errors and the change in error from one model version to another. Here the model versions tested involved updates in model physics from HRRRv1 to HRRRv4, and reductions in grid interval from 3 km to 750 m. Model errors were found to be 2–3 m s –1 . Differences in errors as determined by various instruments at each site amounted to about 10% of this value, or 0.2–0.3 m s –1 . Changes in model skill due to physics or grid-resolution updates also differed depending on the instrument used to determine the errors; most of the instrument-to-instrument differences were ~0.1 m s –1 , but some reached 0.3 m s –1 . All instruments at a given site mostly showed consistency in the sign of the change in error. In two examples, though, the sign changed, illustrating a consequence of differences in measurements: errors determined using one instrument may show improvement in model skill, whereas errors determined using another instrument may indicate degradation. This possibility underscores the importance of having accurate measurements to determine the model error.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2020

Toward a systematic improvement of the fixed-node approximation in diffusion Monte Carlo for solids—A case study in diamond

While Diffusion Monte Carlo (DMC) is in principle an exact stochastic method for ab initio electronic structure calculations, in practice, the fermionic sign problem necessitates the use of the fixed-node approximation and trial wavefunctions with approximate nodes (or zeros). This approximation introduces a variational error in the energy that potentially can be tested and systematically improved. Here, we present a computational method that produces trial wavefunctions with systematically improvable nodes for DMC calculations of periodic solids. These trial wavefunctions are efficiently generated with the configuration interaction using a perturbative selection made iteratively (CIPSI) method. A simple protocol in which both exact and approximate results for finite supercells are used to extrapolate to the thermodynamic limit is introduced. This approach is illustrated in the case of the carbon diamond using Slater–Jastrow trial wavefunctions including up to one million Slater determinants. Fixed-node DMC energies obtained with such large expansions are much improved, and the fixed-node error is found to decrease monotonically and smoothly as a function of the number of determinants in the trial wavefunction, a property opening the way to a better control of this error. The cohesive energy extrapolated to the thermodynamic limit is in close agreement with the estimated experimental value. Interestingly, this is also the case at the single-determinant level, thus, indicating a very good error cancellation in carbon diamond between the bulk and atomic total fixed-node energies when using single-determinant nodes.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2024

Fast permeability measurement for tight reservoir cores using only initial data of the one chamber pressure pulse decay test

Here, in this study, a mathematical model for fast determination of the permeabilities of tight rocks using measurements taken from the initial period of the One Chamber Pressure Pulse Decay (OC-PPD) test is presented. The model applies to measurements taken both before and after the pressure pulse front has reached the downstream end of the specimen. The analytical solutions for the pressure decay in the upstream chamber are derived based on a parabolic arc approximation of pore pressure distribution along the test specimen. This approximation allows converting the initial–boundary value problem of fluid diffusion in the specimen, governed by partial differential equations, to a system of ordinary differential equations that can be easily solved by explicit formulae. Thus, an explicit formula for the pressure decay rate is obtained, which enables inverse analysis of the initial experimental data to estimate the rock permeability. The proposed method expedites the pulse decay test as it does not require the system to reach equilibrium. The method is validated with three sets of experimental data of the OC-PPD test using helium as the diffusing fluid, for which the relative error of the permeability is found to be less than 6%. This method is particularly useful if the equilibrium time of the pulse decay test for rock specimens with permeabilities in the range of nano-Darcy takes hours or days.

early-time solution↗

DOE OSTI2023

The Effects of Gamma Ray Integrated Dose on a Commercial 65-nm SRAM Device

Here this work shows that the static random access memory (SRAM) error rate for a commercial 65-nm device in a dose rate environment can be highly dependent upon the integrated dose (dose rate × pulse duration). While the typical metric for such testing is dose rate upset (DRU) level in rad(Si)/s, a series of dose rate experiments at Little Mountain Test Facility (LMTF) shows dependence on the integrated dose. The error rate is also found to be dependent on the core voltage, and the preradiation value of the bits. We believe that these effects are explained by a well charge depletion caused by gamma ray photocurrent.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗