Search NASASearch

SEARCH · Search NASA

Results for “generalization error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

Effects of machine learning errors on human decision-making: manipulations of model accuracy, error types, and error importance

Abstract This study addressed the cognitive impacts of providing correct and incorrect machine learning (ML) outputs in support of an object detection task. The study consisted of five experiments that manipulated the accuracy and importance of mock ML outputs. In each of the experiments, participants were given the T and L task with T-shaped targets and L-shaped distractors. They were tasked with categorizing each image as target present or target absent. In Experiment 1, they performed this task without the aid of ML outputs. In Experiments 2–5, they were shown images with bounding boxes, representing the output of an ML model. The outputs could be correct (hits and correct rejections), or they could be erroneous (false alarms and misses). Experiment 2 manipulated the overall accuracy of these mock ML outputs. Experiment 3 manipulated the proportion of different types of errors. Experiments 4 and 5 manipulated the importance of specific types of stimuli or model errors, as well as the framing of the task in terms of human or model performance. These experiments showed that model misses were consistently harder for participants to detect than model false alarms. In general, as the model’s performance increased, human performance increased as well, but in many cases the participants were more likely to overlook model errors when the model had high accuracy overall. Warning participants to be on the lookout for specific types of model errors had very little impact on their performance. Overall, our results emphasize the importance of considering human cognition when determining what level of model performance and types of model errors are acceptable for a given task.

97 MATHEMATICS AND COMPUTING

Nuclear microreactor transient and load-following control with deep reinforcement learning

The economic feasibility of nuclear microreactors will depend on minimizing operating costs through advancements in autonomous control, especially when these microreactors are operating alongside other types of energy systems (e.g., renewable energy). This study explores the application of deep reinforcement learning (RL) for real-time drum control in microreactors, exploring performance in regard to load-following scenarios. By leveraging a point kinetics model with thermal and xenon feedback, we first establish a baseline using a single-output RL agent, then compare it against a traditional proportional–integral–derivative (PID) controller. This study demonstrates that RL controllers, including both single- and multi-agent RL (MARL) frameworks, can achieve similar or even superior load-following performance as traditional PID control across a range of load-following scenarios. In short transients, the RL agent was able to reduce the tracking error rate in comparison to PID by one half to one third. Over extended 300-minute load-following scenarios in which xenon feedback becomes a dominant factor, PID maintained better accuracy, but RL still remained within a 1% error margin despite being trained only on short-duration scenarios. This highlights RL’s strong ability to generalize and extrapolate to longer, more complex transients, affording substantial reductions in training costs and reduced overfitting. Furthermore, when control was extended to multiple drums, MARL enabled independent drum control as well as maintained reactor symmetry constraints without sacrificing performance---an objective that standard single-agent RL could not learn. We also found that, as increasing levels of Gaussian noise were added to the power measurements, the RL controllers were able to maintain lower error rates than PID, and to do so with at least 10% and upwards of 150% less control effort. These findings illustrate RL's potential for autonomous nuclear reactor control, laying the groundwork for future integration into high-fidelity simulations and experimental validation efforts.

22 - GENERAL STUDIES OF NUCLEAR REACTORS

Subregion-subalgebra duality: Emergence of space and time in holography

In holographic duality, a higher dimensional quantum gravity system emerges from a lower dimensional conformal field theory (CFT) with a large number of degrees of freedom. We propose a formulation of duality for a general causally complete bulk spacetime region, called subregion-subalgebra duality, which provides a framework to describe how geometric notions in the gravity system, such as spacetime subregions, different notions of times, and causal structure, emerge from the dual CFT. Subregion-subalgebra duality generalizes and brings new insights into subregion-subregion duality (or equivalently entanglement wedge reconstruction). It provides a mathematically precise definition of subregion-subregion duality and gives an independent definition of entanglement wedges without using entropy. Geometric properties of entanglement wedges, including those that play a crucial role in interpreting the bulk as a quantum error correcting code, can be understood from the duality as the geometrization of the superadditivity of certain algebras. Using general boundary subalgebras rather than those associated with geometric subregions makes it possible to find duals for general bulk spacetime regions, including those not touching the boundary. Applying subregion-subalgebra duality to a boundary state describing a single-sided black hole also provides a precise way to define mirror operators. Published by the American Physical Society 2025

Leutheusser, Sam (ORCID:0000000339228128)

Profusion of symmetry-protected qubits from stable ergodicity breaking

We show how combining a discrete symmetry with topological Hilbert space fragmentation can give rise to exponentially many topologically stable qubits protected by a single discrete symmetry. We illustrate this explicitly with the example of the CZ𝑝 model, where the encoded qubits are prethermally stable to arbitrary symmetry-respecting perturbations for parametrically long times, substantially enhancing the robustness of a recently proposed construction based on nontopological fragmentation. In this model, the encoded qubits naturally come in pairs for which a universal set of transversal logical gates can be performed, ruling out (by the Eastin-Knill theorem) the possibility of using them for quantum error correction. We also comment on the combination of symmetry enrichment and topological fragmentation more generally, and the implications for use of systems exhibiting Hilbert space fragmentation as quantum memories.

kinetically constrained models

Braiding for the win: Harnessing braiding statistics in topological states to play quantum games

Nonlocal quantum games provide proof of principle that quantum resources can confer an advantage at certain tasks. They also provide a compelling way to explore the computational utility of phases of matter on quantum hardware. In a recent paper [O. Hart et al., Phys. Rev. Lett. 134, 130602 (2025)], we demonstrated that a toric code resource state conferred advantage at a certain nonlocal game, which remained robust to small deformations of the resource state. In this paper we demonstrate that this robust advantage is a generic property of resource states drawn from topological or fracton ordered phases of quantum matter. To this end, we illustrate how several other states from paradigmatic topological and fracton ordered phases can function as resources for suitably defined nonlocal games, notably the three-dimensional toric-code phase, the X-cube fracton phase, and the double-semion phase. The key in every case is to design a nonlocal game that harnesses the characteristic braiding processes of a quantum phase as a source of contextuality. We unify the strategies that take advantage of mutual statistics by relating the operators to be measured to order and disorder parameters of an underlying generalized symmetry-breaking phase transition. Additionally, by connecting the win probability to twist products, we show that success at the game serves as a many-body entanglement witness. Namely, if the players implement a perfect quantum strategy on large length scales, the quantum state they share cannot be connected to a trivial product state via a constant-depth local unitary circuit. Lastly, we massively generalize the family of games that admit perfect strategies when codewords of homological quantum error-correcting codes are used as resources.

Fractons

Noisy Approach to Intrinsically Mixed-State Topological Order

We propose a general framework for studying two-dimensional (2D) topologically ordered states subject to local correlated errors and show that the resulting mixed state can display (imTO)—topological order that is not expected to occur in the ground state of 2D local gapped Hamiltonians. Specifically, we show that decoherence, previously interpreted as anyon condensation in a doubled Hilbert space, is more naturally phrased as, and provides a physical mechanism for, “gauging out” anyons in the original Hilbert space. We find that gauging out anyons generically results in imTO, with the decohered mixed state strongly symmetric under certain anomalous 1-form symmetries. This framework lays bare a striking connection between the decohered density matrix and , which can appear as anomalous surface states of three-dimensional topological orders. Through a series of examples, we show that the decohered state can display a classical memory, encode logical qubits (i.e., exhibit a quantum memory), and even host chiral or nonmodular topological order. We argue that a partial classification of imTO is given in terms of nonmodular braided-fusion categories. Published by the American Physical Society 2025

Sohal, Ramanjit (ORCID:0000000292975715)

Diagnostics of Mixed-State Topological Order and Breakdown of Quantum Memory

Topological quantum memory can protect information against local errors up to finite error thresholds. Such thresholds are usually determined based on the success of decoding algorithms rather than the intrinsic properties of the mixed states describing corrupted memories. Here we provide an intrinsic characterization of the breakdown of topological quantum memory, which both gives a bound on the performance of decoding algorithms and provides examples of topologically distinct mixed states. We employ three information-theoretical quantities that can be regarded as generalizations of the diagnostics of ground-state topological order, and serve as a definition for topological order in error-corrupted mixed states. We consider the topological contribution to entanglement negativity and two other metrics based on quantum relative entropy and coherent information. In the concrete example of the two-dimensional (2D) Toric code with local bit-flip and phase errors, we map three quantities to observables in 2D classical spin models and analytically show they all undergo a transition at the same error threshold. This threshold is an upper bound on that achieved in any decoding algorithm and is indeed saturated by that in the optimal decoding algorithm for the Toric code. Published by the American Physical Society 2024

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND

Superadditivity at large charge

The weak gravity conjecture has been invoked to conjecture that the dimensions of charged operators in a CFT should obey a superadditivity relation (sometimes referred to as convexity). In this paper, we study superadditivity of the operator spectrum in theories expanded about the semi-classical saddle point that dominates correlators of large charge operators. We explore this in two contexts. The first is a model with two scalar fields that carry different charges, at a non-trivial Wilson-Fisher fixed point. A careful analysis of the semi-classics for this two field model demonstrates that ‘quantum’ violations of superadditivity (those not forbidden by the conjecture) persist in the large charge regime. We then turn to study the general properties of CFTs at large charge as bottom-up EFTs. By a trial and error procedure we come up with a seemingly consistent family of examples violating the conjecture. In so doing the presence of a genuine dilaton field appears necessary. On the one hand our result demonstrates that the superadditivity conjecture cannot be proven purely on the basis of a bottom-up analysis. On the other hand, the need for a dilaton, with the corresponding infinite fine tuning, indicates the conjecture-violating EFTs are unlikely to be UV completable.

effective field theories

..delta..-Learning of High-Fidelity Electronic Structure Using Graph Neural Networks with Modified Node-Level Features

In this work, we present a ..delta..-learning approach for predicting the eigenvalues calculated with the hybrid functional HSE06 (..epsilon..nkHSE) for a set of metal and nitrogen doped graphene catalysts (MNCs) from Perdew-Burke-Ernzerhof (PBE) inputs. The model presented here incorporates electronic scalar features along with structural information in a graph neural network (GNN). In particular, the PBE eigenvalues for different bands and k-points and orbital-resolved projectors are combined with the applied potential as node-level features along with structural information within the Atomistic Line Graph Neural Network (ALIGNN) architecture. These features enable flexibility for systems with electrified interfaces, such as in electrocatalysts and achieves mean absolute error (MAE) of less than 0.1 eV. The machine learning model reported here achieves a strong generalization to left-out adsorbates (MAE = 0.074 eV) and leave-one-chemical-space-out (MAE = 0.08 eV) and completely left-out metals (MAE = 0.072 eV), confirming the robustness of the machine learning (ML) model in predicting ..epsilon..nkHSE.

36 MATERIALS SCIENCE

Systematic improvement of redox potential calculation of Fe(III)/Fe(II) complexes using a three-layer micro-solvation model

Electrochemical transformations of metal ions in aqueous media are challenging to model accurately due to the dynamic solvation structure surrounding ions at different charge states. Predictive modeling at the atomistic scale is essential for understanding these solvation architectures but is often computationally prohibitive. In this contribution, we present a simple, fast, and accurate three-layer micro-solvation model to evaluate the redox potential of metal ions in aqueous solutions. Our model, developed and validated for Fe 3+ /Fe 2+ redox potentials, combines the DFT-based geometry optimizations of the octahedral Fe complex with two layers of explicit water molecules to capture solute–solvent interactions and an implicit solvation model to account for bulk solvent effects. This approach yields accurate predictions for Fe 3+ /Fe 2+ redox potentials in water, achieving errors of 0.02 V with ωB97X-V, 0.01 V with ωB97X-D3, 0.04 V with ωB97M-V, and 0.02 V with B3LYP-D3 functionals. We further demonstrate the generality of our model by applying it to additional metal complexes, including the challenging Fe(CN) 6 3−/4− system, where our model successfully achieves close agreement with experimental values, with an error of 0.07 V and an average error of 0.21 V for all five systems. In summary, the presented simple solvation model has broad applicability and potential for enhancing computational efficiency in redox potential predictions across various chemical and industrial processes of metal ions.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH

HydroDCM: Hydrological Domain-Conditioned Modulation for Cross-Reservoir Inflow Prediction

Deep learning models have shown promise in reservoir inflow prediction, yet their performance often deteriorates when applied to different reservoirs due to distributional differences, referred to as the domain shift problem. Domain generalization (DG) solutions aim to address this issue by extracting domain-invariant representations that mitigate errors in unseen domains. However, in hydrological settings, each reservoir exhibits unique inflow patterns, while some metadata beyond observations like spatial information exerts indirect but significant influence. This mismatch limits the applicability of conventional DG techniques to many-domain hydrological systems. To overcome these challenges, we propose HydroDCM, a scalable DG framework for cross-reservoir inflow forecasting. Spatial metadata of reservoirs is used to construct pseudo-domain labels that guide adversarial learning of invariant temporal features. During inference, HydroDCM adapts these features through light-weight conditioning layers informed by the target reservoir’s metadata, reconciling DG’s invariance with location-specific adaptation. Experiment results on 30 real-world reservoirs in the Upper Colorado River Basin demonstrate that our method substantially outperforms state-of-the-art DG baselines under many-domain conditions and remains computationally efficient.

Hu, Pengfei [ORNL] (ORCID:0009000367130950)

Evaluating probabilistic deep learning methods for uncertainty quantification of temperature downscaling

Deep learning (DL) has emerged as a promising tool for downscaling coarse-resolution climate data to high-resolution outputs, enabling improved regional climate predictions. A critical aspect of DL-based downscaling is the incorporation of uncertainty quantification (UQ), which enhances the interpretability and reliability of predictions—key factors for climate risk assessment and decision-making. This study develops a DL model to downscale 2 m temperature across the contiguous United States using reanalysis datasets. We systematically evaluate three epistemic UQ methods—deep ensembles (DEns), Monte Carlo dropout (MCD), and Flipout—based on their probabilistic accuracy, downscaling performance, sensitivity to geographical features, and computational efficiency. Results indicate that MCD generally outperforms Flipout and DEns in terms of calibration and downscaling accuracy. However, DEns demonstrate lower calibration errors in coastal regions, indicating its higher confidence within these areas. Flipout, in contrast, is more sensitive to elevation gradients and exhibits higher calibration errors in mountainous regions. Hence, the choice of UQ method for this task depends on the specific requirements of the application. For applications that prioritize overall calibration, downscaling accuracy, and computational efficiency, MCD is a strong candidate. These findings highlight the importance of selecting UQ methods based on application-specific requirements, such as geographical context and computational constraints. By addressing the trade-offs between UQ methods, this study provides actionable insights for improving the reliability, scalability, and utility of DL-based downscaling in climate science.

Environmental sciences

Assessment of the Impact of Realistic Sensor Physics and the Integration of Ex-Core Sensors on Reactor Power Synthesis

In the work documented in this report, a weighting function–based core power synthesis method was applied to multiple Monte Carlo N-Particle (MCNP) reactor models, which are informed based on simulated self-powered neutron detector (SPND) responses. The weighting function method used has been coined the point-based iterative (PBI) method. The goal of this application is to assess the impact of considering realistic sensor physics in the generation of the simulated SPND outputs as well as to consider how the synthesis is impacted based on the inclusion of ex-core detectors in the model. The NuScale small modular reactor (SMR) and Westinghouse AP1000 pressurized water reactor (PWR) are the models that served as the testbeds for the assessment of realistic sensor physics; this was achieved by using Geant4 SPND models in comparison with analytical models, such that the effect of electron transport in realistic SPND geometries in the Geant4 model can be understood in terms of synthesis error and convergence time. The comparison was considered for fuel burnup–induced perturbations, for a range of sensor string densities and synthesized power distribution axial fidelities. The Texas A&M Testing, Research, Isotopes, General Atomics Reactor (TAMU TRIGA) reactor MCNP model was used to assess the impact of ex-core sensors; this was done by performing synthesis with and without the ex-core detectors and by quantifying the synthesis error and number of iterations associated with Gaussian-type perturbations in many locations in the core. The TAMU TRIGA model was particularly pertinent for this study because of the interest in future experimental tests with SPNDs in this reactor, as well as the ease of modifying the MCNP model to include ex-core detectors with heterogeneously described response functions. Results from the comparison between the Geant4 and analytical SPND models indicate that similar average and maximum synthesis errors were obtained for burnup-induced perturbations in both the NuScale SMR and the AP1000. This was true for a range of sensor string densities and axial fidelities. However, there were marked differences between both the Geant4 and analytically informed models in terms of the iterations required to converge on the synthesized power distribution. Namely, the Geant4-informed models tended to lead to fewer iterations, except for a few sensor–core configurations that had particularly numerous iterations. Results from the ex-core sensor assessment with the TAMU TRIGA model indicate that the inclusion of ex-core sensors drastically reduces the synthesis error of Gaussian-type perturbations close to the edge of the core, and it slightly reduces synthesis errors for perturbations closer to the center of the core. This was achieved with a minimal increase in computational cost—that is, the number of iterations required for convergence. The errors were identified to be in the same location as the perturbation in the core, indicating that the methodology remains robust for unperturbed regions of the core. A secondary result from this study with the TAMU TRIGA was yielded by analysis of the neutron flux levels in the in-core and ex-core sensor locations of the core; these flux levels indicate that SPNDs could be used as both in-core and ex-core sensors, so long as the emitter material is sensitive to thermal neutrons. The results from these studies provide a quantitative understanding of the importance of considering realistic sensor physics and including ex-core sensors to perform accurate and timely power distribution synthesis of a reactor core.

22 GENERAL STUDIES OF NUCLEAR REACTORS

Statistics and sensitivity of axion wind detection with the homogeneous precession domain of superfluid helium-3

The homogeneous precession domain (HPD) of superfluid He 3 has recently been identified as a detection medium which might provide sensitivity to the axion-nucleon coupling g a N N competitive with, or surpassing, existing experimental proposals. In this work, we make a detailed study of the statistical and dynamical properties of the HPD system in order to make realistic projections for a full-fledged experimental program. We include the effects of clock error and measurement error in a concrete readout scheme using superconducting qubits and quantum metrology. This work also provides a more general framework to describe the statistics associated with the axion gradient coupling through the treatment of a transient resonance with a nonstationary background in a time-series analysis. Incorporating an optimal data-taking and analysis strategy, we project a sensitivity approaching g a N N ∼ 10 − 12 GeV − 1 across a decade in axion mass. Published by the American Physical Society 2024

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS

Positioning Accuracy in a Concurrent Robot-CNC Hybrid Manufacturing System

Abstract Additive manufacturing (AM) has gained notoriety for offering advantages over traditional manufacturing methods, such as increased design complexity and flexibility. However, it has not found widespread use beyond rapid prototyping. One hindrance to the acceptance of AM processes in industry is the time and cost of fabrication per component. While metal AM by itself can be inexpensive, extra manufacturing steps in the form of subtractive manufacturing (SM) may need to be performed to reach final part tolerances, leading to hybrid additive-subtractive manufacturing (HASM) of a part, which increases time and cost. A potential area to reduce cost is through increasing the efficiency of the HASM process by conducting additive and subtractive manufacturing simultaneously. Usually, HASM is performed in a process where AM is completed in one machine or cell and transferred to another machine or cell for SM in a sequential assembly line process. This efficiency decreases part cost, but high aspect ratio parts or parts with internal geometry that require interleaved additive deposition and machining cannot be produced. One unexplored solution to simultaneous HASM that allows for interleaved operations is to operate the deposition head and machining spindle concurrently within the same machine envelope, known as concurrent HASM (CHASM). In this type of process, both AM and SM occur simultaneously on a batch of small parts or a single large part, maintaining a high efficiency without sacrificing the full range of complex geometries that AM allows for. A potential approach to the single-machine method could be to combine a robot and mill within the same envelope. A challenge to this approach, however, is control of both systems. Most machine controllers have limited external communication or, if a robot has been integrated, only offer movement of either the robot or mill at any given time. As a result, systems must pause either the AM or SM process to switch between them rather than working simultaneously. The present work investigates the positional accuracy of such a CHASM system comprised of a robotic arm and a 3-axis mill. Open-loop tests with limited communication between machines are performed on the system to verify positional error during concurrent robot-mill movements. Under certain conditions, it is demonstrated that position error can stay within 2 mm for the duration of a single layer; however, these tests show that, generally, the open-loop positioning performance of the system is inadequate for CHASM without part-specific hand-tuning of parameters. Based on these results, a set of requirements for successful robot-CNC CHASM is proposed for future integrations.

Goodwin, Jesse

Final Report for Zero-noise Extrapolation for Quantum Sensing

Final Report for the DOE EXPRESS 2022 project "Zero-noise Extrapolation for Quantum Sensing." Contains a description of the motivation, accomplishments, and implications of the technical work performed.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC

Encrypted Control Using Modified Learning With Errors-based Schemes

Cyber-physical systems (CPSs) require reliable, safe, and secure control of critical infrastructure, combining computational and networking capabilities, which heighten the risk of cyber attacks. These attacks can disrupt the physical process, causing unforeseen consequences. One solution is the use of fully homomorphic encryption (FHE) to protect the control loop, allowing for secure computations and communications without compromising signal and control system privacy. The challenge with FHE, however, is its requirement for inputs to be integers. This paper introduces a modified Learning With Errors (LWE) FHE approach that encodes control system dynamics and signals into integers. Our proposed scheme leverages a generalized LWE encoding function and modifies the Gentry-Sahai-Waters (GSW) gadget decomposition tool to encrypt the control system. Using the modified LWE scheme, we formalize a fully encrypted control system, supported by simulated results.

42 - ENGINEERING

Lattice QCD estimates of thermal photon production from the QGP

Thermal photons produced in heavy-ion collision experiments are an important observable for understanding quark-gluon plasma (QGP). The thermal photon rate from the QGP at a given temperature can be calculated from the spectral function of the vector current correlator. Extraction of the spectral function from the lattice correlator is known to be an ill-conditioned problem, as there is no unique solution for a spectral function for a given lattice correlator with statistical errors. The vector current correlator, on the other hand, receives a large ultraviolet contribution from the vacuum, which makes the extraction of the thermal photon rate difficult from this channel. We therefore consider the difference between the transverse and longitudinal part of the spectral function, only capturing the thermal contribution to the current correlator, simplifying the reconstruction significantly. The lattice correlator is calculated for light quarks in quenched QCD at T = 470 MeV ( ∼ 1.5 T c ), as well as in 2 + 1 flavor QCD at T = 220 MeV ( ∼ 1.2 T p c ) with m π = 320 MeV . In order to quantify the nonperturbative effects, the lattice correlator is compared with the corresponding NLO + LPM LO estimate of correlator. The reconstruction of the spectral function is performed in several different frameworks, ranging from physics-informed models of the spectral function to more general models in the Backus-Gilbert method and Gaussian process regression. We find that the resulting photon rates agree within errors. Published by the American Physical Society 2024

Astronomy & Astrophysics