Search NASA⌕ Search

SEARCH · Search NASA

Results for “correspondence learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9

Learning quantum computers' errors using interpretable neural networks

Learning and reducing the errors and noise in quantum computing systems is necessary for achieving quantum computation’s promise. However, rapid advances in experimental quantum computing are making this task increasingly difficult, because state-of-the-art systems now contain hundreds of qubits and many characterization techniques are hard to apply at this scale. Furthermore, complex kinds of errors in these systems, such as crosstalk and non-Markovian effects, must be understood and decreased, but these errors are challenging to study with most existing methods. In this project, we explored using neural networks for scalable characterization of complex errors in quantum computers. We proposed and demonstrated characterizing a quantum computer’s errors with neural networks that have interpretable parameters corresponding to the rates of different kinds of errors, within a sparse Lindbladian parameterization for errors. To enable scaling to many qubit systems, these networks then predict how these errors combine within quantum circuits and impact their outcomes using an efficient approximations. We demonstrated these networks ability to learn coherent crosstalk errors and context-dependent errors in a simulated 4-qubit system.

97 MATHEMATICS AND COMPUTING↗

LossLens: Diagnostics for Machine Learning Through Loss Landscape Visual Analytics

Modern machine learning often relies on optimizing a neural network's parameters using a loss function to learn complex features. Beyond training, examining the loss function with respect to a network's parameters (i.e., as a loss landscape) can reveal insights into the architecture and learning process. While the local structure of the loss landscape surrounding an individual solution can be characterized using a variety of approaches, the global structure of a loss landscape, which includes potentially many local minima corresponding to different solutions, remains far more difficult to conceptualize and visualize. To address this difficulty, we introduce LossLens, a visual analytics framework that explores loss landscapes at multiple scales. LossLens integrates metrics from global and local scales into a comprehensive visual representation, enhancing model diagnostics. Here we demonstrate LossLens through two case studies: visualizing how residual connections influence a ResNet-20, and visualizing how physical parameters influence a physics-informed neural network (PINN) solving a simple convection problem.

97 MATHEMATICS AND COMPUTING↗

A Communication Channel Density Estimating Generative Adversarial Network

Autoencoder-based communication systems use neural network channel models to backwardly propagate message reconstruction error gradients across an approximation of the physical communication channel. In this work, we develop and test a new generative adversarial network (GAN) architecture for the purpose of training a stochastic channel approximating neural network. In previous research, investigators have focused on additive white Gaussian noise (AWGN) channels and/or simplified Rayleigh fading channels, both of which are linear and have well defined analytic solutions. Given that training a neural network is computationally expensive, channel approximation networks— and more generally the autoencoder systems—should be evaluated in communication environments that are traditionally difficult. To that end, our investigation focuses on channels that contain a combination of non-linear amplifier distortion, pulse shape filtering, intersymbol interference, frequency-dependent group delay, multipath, and non-Gaussian statistics. Each of our models are trained without any prior knowledge of the channel. We show that the trained models have learned to generalize over an arbitrary amplifier drive level and constellation alphabet. We demonstrate the versatility of our GAN architecture by comparing the marginal probability density function of several channel simulations with that of their corresponding neural network approximations

Smith, Aaron↗

Efficient sampling of free energy landscapes with functions in Sobolev spaces

Molecular simulations of biological and physical phenomena generally involve sampling complicated, rough energy landscapes characterized by multiple local minima. In this work, we introduce a new family of methods for advanced sampling that draw inspiration from functional representations used in machine learning and approximation theory. As shown here, such representations are particularly well suited for learning free energies using artificial neural networks. As a system evolves through phase space, the proposed methods gradually build a model for the free energy as a function of one or more collective variables, from both the frequency of visits to distinct states and generalized force estimates corresponding to such states. Implementation of the methods is relatively simple and, more importantly, for the representative examples considered in this work, they provide computational efficiency gains of up to several orders of magnitude over other widely used simulation techniques.

Approximation theory↗

Learning a general model of single phase flow in complex 3D porous media

Modeling effective transport properties of 3D porous media, such as permeability, at multiple scales is challenging as a result of the combined complexity of the pore structures and fluid physics—in particular, confinement effects which vary across the nanoscale to the microscale. While numerical simulation is possible, the computational cost is prohibitive for realistic domains, which are large and complex. Although machine learning (ML) models have been proposed to circumvent simulation, none so far has simultaneously accounted for heterogeneous 3D structures, fluid confinement effects, and multiple simulation resolutions. By utilizing numerous computer science techniques to improve the scalability of training, we have for the first time developed a general flow model that accounts for the pore-structure and corresponding physical phenomena at scales from Angstrom to the micrometer. Using synthetic computational domains for training, our ML model exhibits strong performance (R 2 = 0.9) when tested on extremely diverse real domains at multiple scales.

36 MATERIALS SCIENCE↗

Ductility mechanisms in complex concentrated refractory alloys from atomistic fracture simulations

The striking variation in damage tolerance among refractory complex concentrated alloys is examined through the analysis of atomistic fracture simulations, contrasting behavior in elemental Nb with that in brittle NbMoTaW and ductile Nb45Ta25Ti15Hf15. We employ machine-learning interatomic potentials (MLIPs), including a new MLIP developed for NbTaTiHf, in atomistic simulations of crack tip extension mechanisms based on analyses of atomistic fracture resistance curves. While the initial behavior of sharp cracks shows good correspondence with the Rice theory, fracture resistance curves reveal marked changes in fracture modes for the complex alloys as crack extension proceeds. In NbMoTaW, compositional complexity appears to promote dislocation nucleation relative to pure Nb, despite theoretical predictions that the alloy should be relatively more brittle. In Nb45Ta25Ti15Hf15, alloying alters the fracture mode compared to elemental Nb, promoting crack tip blunting and enhancing resistance to crack propagation.

Computational methods↗

Data driven methods to recognize patterns in EIC weak-strong simulation

Beam-Beam simulations are currently being studied in preparation for future EIC experiments to study beam-beam effects and, in turn, maximize luminosity. Weak-strong methods are studied for single-particle dynamics during collision. 1 million macro-particles for 1 million turns are typically tracked, corresponding to only 10 seconds in the EIC. The goal of this study is to predict beam properties over the scale of hours. A potential solution focuses on using data-driven methods such as machine learning methods to analyze and extend the insights of the beam properties such as long-term nonlinear effects. This would aid in long-term predictions where results would be more efficiently acquired than a typical tracking simulation. Some limitations such as inaccurate predictions and spatial complexity are also discussed. These methods can then be applied to strong-strong simulations in the future studies.

Accelerator Physics↗

Obstacle detection by recognizing binary expansion patterns

This paper describes a technique for obstacle detection, based on the expansion of the image-plane projection of a textured object, as its distance from the sensor decreases. Information is conveyed by vectors whose components represent first-order temporal and spatial derivatives of the image intensity, which are related to the time to collision through the local divergence. Such vectors may be characterized as patterns corresponding to 'safe' or 'dangerous' situations. We show that essential information is conveyed by single-bit vector components, representing the signs of the relevant derivatives. We use two recently developed, high capacity classifiers, employing neural learning techniques, to recognize the imminence of collision from such patterns.

Baram, Yoram↗

A Look at the Truths and Misconceptions of the Variational Quantum Eigensolver and the Implications of Overparameterization

In this work, we investigate loss landscapes of the variational quantum eigensolver (VQE) by quantifying the number of local minima through empirical analyses. We focus on minimal models in chemistry and physics so that we can do a complete analysis using more computationally expensive tools. We employ Hessian eigenvalue calculations and the nudged elastic band algorithm to characterize these landscapes. Our results expand upon the existing literature by highlighting the optimization challenges faced by VQE. We find that, as the number of parameters in our ansatz increases, the number of basins increases while the corresponding loss function values converge toward the global minimum value. This observation implies that overparameterization may lead to an ``effective convexity'' in VQE loss landscapes, a phenomenon supported by theoretical and numerical work in classical machine learning.

quantum computing↗

Learning a General Model of Single Phase Flow in Complex 3D Porous Media

Modeling effective transport properties of 3D porous media, such as permeability, at multiple scales is challenging as a result of the combined complexity of the pore structures and fluid physics—in particular, confinement effects which vary across the nanoscale to the microscale. While numerical simulation is possible, the computational cost is prohibitive for realistic domains, which are large and complex. Although machine learning (ML) models have been proposed to circumvent simulation, none so far has simultaneously accounted for heterogeneous 3D structures, fluid confinement effects, and multiple simulation resolutions. By utilizing numerous computer science techniques to improve the scalability of training, we have for the first time developed a general flow model that accounts for the pore-structure and corresponding physical phenomena at scales from Angstrom to the micrometer. Using synthetic computational domains for training, our ML model exhibits strong performance (R 2 = 0.9) when tested on extremely diverse real domains at multiple scales.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Automatic detection of methane emissions in multispectral satellite imagery using a vision transformer

Curbing methane emissions is among the most effective actions that can be taken to slow down global warming. However, monitoring emissions remains challenging, as detection methods have a limited quantification completeness due to trade-offs that have to be made between coverage, resolution and detection accuracy. Here we show that deep learning can overcome the trade-off in terms of spectral resolution that comes with multi-spectral satellite data, resulting in a methane detection tool with global coverage and high temporal and spatial resolution. We compare our detections with airborne methane measurement campaigns, which suggests that our method can detect methane point sources in Sentinel-2 data down to plumes of 0.01 km 2 , corresponding to 200 to 300 kg CH 4 /h -1 sources. Our model shows an order of magnitude improvement over the state-of-the-art, providing a significant step towards the automated, high resolution detection of methane emissions at a global scale, every few days.

54 ENVIRONMENTAL SCIENCES↗

Filling data analysis gaps in time-resolved crystallography by machine learning

There is a growing understanding of the structural dynamics of biological molecules fueled by x-ray crystallography experiments. Time-resolved serial femtosecond crystallography (TR-SFX) with x-ray Free Electron Lasers allows the measurement of ultrafast structural changes in proteins. Nevertheless, this technique comes with some limitations. One major challenge is the quality of data from TR-SFX measurements, which often faces issues like data sparsity, partial recording of Bragg reflections, timing errors, and pixel noise. To overcome these difficulties, conventionally, large volumes of data are collected and grouped into a few temporal bins. The data in each bin are then averaged and paired with the mean of their corresponding jittered timestamps. This procedure provides one structure per bin, resulting in a limited number of averaged structures for the entire time interval spanned by the experiment. Therefore, the information on ultrafast structural dynamics at high temporal resolution is lost. This has initiated research for advanced methods of analyzing experimental TR-SFX data beyond the standard binning and averaging method. To address this problem, we use a machine learning algorithm called Nonlinear Laplacian Spectral Analysis (NLSA), which has emerged as a promising technique for studying the dynamics of complex systems. In this work, we demonstrate the power of this algorithm using synthetic x-ray diffraction snapshots from a protein with significant data incompleteness, timing uncertainties, and noise. Our study confirms that NLSA is a suitable approach that effectively mitigates the effects of these artifacts in TR-SFX data and recovers accurate structural dynamics information hidden in such data.

Trujillo, Justin (ORCID:0000000285505360)↗

Implementations of learning control systems using neural networks

The systematic storage in neural networks of prior information to be used in the design of various control subsystems is investigated. Assuming that the prior information is available in a certain form (namely, input/output data points and specifications between the data points), a particular neural network and a corresponding parameter design method are introduced. The proposed neural network addresses the issue of effectively using prior information in the areas of dynamical system (plant and controller) modeling, fault detection and identification, information extraction, and control law scheduling.

Sartori, Michael A.↗

Search for CP violation in events with top quarks and Z bosons at $\sqrt{s}$ = 13 and 13.6 TeV

A search for the violation of the charge-parity (CP) symmetry in the production of top quarks in association with Z bosons is presented, using events with at least three charged leptons and additional jets. The search is performed in a sample of proton-proton collision data collected by the CMS experiment at the CERN LHC in 2016–2018 at a center-of-mass energy of 13 TeV and in 2022 at 13.6 TeV, corresponding to a total integrated luminosity of 173 fb –1 . For the first time in this final state, observables that are odd under the CP transformation are employed. Also for the first time, physics-informed machine-learning techniques are used to construct these observables. While for standard model (SM) processes the distributions of these observables are predicted to be symmetric around zero, CP-violating modifications of the SM would introduce asymmetries. Two CP-odd operators $\mathcal{O}$$^{I}_{tW}$ and $\mathcal{O}$$^{I}_{tZ}$ in the SM effective field theory are considered that may modify the interactions between top quarks and electroweak bosons. The obtained results are consistent with the SM prediction within two standard deviations, and exclusion limits on the associated Wilson coefficients of –2.7 < $c$$^{I}_{tW}$ < 2.5 and –0.2 < $c$$^{I}_{tZ}$ < 2.0 and are set at 95 % confidence level. The largest discrepancy is observed in $c$$^{I}_{tZ}$ where data is consistent with positive values, with an observed local significance with respect to the SM hypothesis of 2.5 standard deviations, when only linear terms are considered.

CMS↗

Micromechanical Surrogate Machine Learning Model for Creep Deformation Modeling

Process variability during the manufacture of gas turbine engine hot section components can significantly affect the material’s resulting microstructure. In casting, for instance, geometric variation within a component (thin sections versus thick sections, radial location) influences cooling rates and the resulting grain size. The high temperature creep response is known to be sensitive to grain size owing to a diffusional creep mechanism which occurs more readily along grain boundaries. Microstructural variation correspondingly drives mechanical behavior which propagates into component scale performance uncertainty. These factors are essential when planning inspection, maintenance, and repair strategies within a reliability framework. These benefits provide opportunities to increase overall energy efficiency through refined margins. Critically, there is an opportunity to bolster existing data-driven reliability models using physics-driven process-structure-property relations. Here we present recent work establishing a framework for evaluating the probabilistic creep performance of high-temperature materials. A novel microstructure-sensitive crystal plasticity finite element model is established that captures both grain boundary and crystallographic deformation effects. The computationally expensive physics model is calibrated using a statistical approach and this high-fidelity model is subsequently used to train a computationally efficient machine learning surrogate model. The surrogate model is essential for sampling a large ensemble of simulated structure-property pair results. The ensemble data are then mined to extract salient trends to be incorporated into a microstructure-sensitive reliability model. The proposed approach represents a novel way to capture microstructure-sensitive trends from physics-based models within a modern reliability framework.

Fernandez-Zelaia, Patxi [ORNL]↗

Synthetic Atmospheric River Ensembles Generated by Deep-AR

This dataset contains 35,850 synthetic landfalling atmospheric river (AR) realizations generated by the Deep-AR two-stage deep-learning framework over the Northeast Pacific and U.S. West Coast. The archive contains 25 stochastic ensemble members for each of 1,434 held-out observed seed events. Each synthetic realization is initialized from conditions 48 hours before the corresponding observed AR landfall and is generated autoregressively at 6-hour intervals over a 144-hour period. Deep-AR combines a deterministic residual network (ResNet) that advances the large-scale atmospheric state with a Wasserstein generative adversarial network (WGAN) that produces stochastic, high-resolution fields. Each HDF5 file contains 0.25° gridded synthetic integrated vapor transport components (qu, qv), 10 m wind components (u10, v10), and 6-hour accumulated precipitation on a common 200 × 480 grid. The files also include coordinate and datetime arrays. This dataset supports AR hazard analysis, ensemble-based uncertainty characterization, precipitation-extremes research, and regional stress testing. Synthetic files follow the naming convention deepar.model.YYYYMMDD.HHMMSS.vNN.h5. YYYYMMDD.HHMMSS identifies the UTC initial-condition timestamp, which occurs 48 hours before the diagnosed observed landfall, and vNN identifies the zero-padded ensemble member, ranging from v01 through v25. Each synthetic file can be paired with its corresponding observed file by matching the initial-condition timestamp. The paired observed file follows the naming convention deepar.obs.YYYYMMDD.HHMMSS.h5 and is available in the separately registered oracle/deepar.obs dataset at https://wdh.energy.gov/ds/oracle/deepar.obs (DOI: https://doi.org/10.21947/3377671).

17 WIND ENERGY↗

Seal Technology for Hypersonic Vehicle and Propulsion: An Overview

Hypersonic vehicles and propulsion systems pose an extraordinary challenge for structures and materials. Airframes and engines require lightweight, high-temperature materials and structural configurations that can withstand the extreme environment of hypersonic flight. Some of the challenges posed include very high temperatures, heating of the whole vehicle, steady-state and transient localized heating from shock waves, high aerodynamic loads, high fluctuating pressure loads, potential for severe flutter, vibration, and acoustic loads and erosion. Correspondingly high temperature seals are required to meet these aggressive requirements. This presentation reviews relevant seal technology for both heritage (e.g. Space Shuttle, X-15, and X-38) vehicles and presents several seal case studies aimed at providing lessons learned for future hypersonic vehicle seal development. This presentation also reviews seal technology developed for the National Aerospace Plane propulsion systems and presents several seal case studies aimed at providing lessons learned for future hypersonic propulsion seal development.

Steinetz, Bruce M.↗

Lessons Learned from the Arecibo Observatory Auxiliary M4N Socket Analysis and Implications for Future Observatory Designs

The Arecibo Observatory collapsed after a progressive structural failure stemming from the failure of a single socket joint cable termination. A failure investigation was conducted to identify the cause of the first failed cable termination socket. Due to the nature of the suspended observatory receiver, the dominant source of loading in the suspension cables was due to deadload, with secondary contributions coming from environmental effects and observatory operation. The high ratio of deadload vs. live load applied to the cable over many years resulted in a creep failure mode of the cast zinc within the socket which further induced stress into the highly stress wires at the entrance of the socket. The design of the socket joint did not explicitly consider socket constituent stress margins and time-dependent damage mechanisms such as creep. Lessons learned from this investigation led to recommendations for revising civil engineering cable standards, and recommendations for manufacturers and designers. The design of cables employing socket terminations should consider the cumulative damage effects from creep and cyclic loading identify their corresponding worst-case inspectable defects or establish a sufficiently high factor of safety so that the design is sufficiently robust to defects and time-dependent failure modes. The design should specify end-of-life capability and set service life inspection intervals with pass/fail inspection criteria. Finally, trial studies on design iterations were conducted to increase the reliability of cables with socket joints.

Pavel Babuska↗