Search NASA⌕ Search

SEARCH · Search NASA

Results for “adaptive weights”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9

Meta-Learning Enhanced Physics-Informed Graph Attention Convolutional Network for Distribution Power System State Estimation

Promptly perceiving distribution system states is challenged by frequent topology changes and uncertain power injections. To address these issues, a Meta-learning enhanced physics-informed graph attention convolutional network (Meta-PIGACN) model is proposed to handle topological variability in distribution system state estimation (DSSE). Specifically, physics information is integrated into the graph convolutional network, enabling a physics-informed edge-weighting process that incorporates physical information to control the aggregation of neighboring nodes. Besides, the graph attention mechanism automatically adjusts the importance of different neighboring nodes, allowing the capture and preservation of inherent system features across varying topologies, thereby improving state estimation accuracy. Furthermore, meta-learning is proposed to acquire empirical knowledge across multiple topologies so that the model can rapidly adapt to new configurations through iterative gradient descent updates even in large-scale systems. In conclusion, the simulation results based on the 33/118/1746-node distribution systems show the high accuracy and efficiency of the proposed model.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Adapting In Situ Accelerators for Sparsity With Granular Matrix Reordering

Neural network (NN) inference is an essential part of modern systems and is found at the heart of numerous applications ranging from image recognition to natural language processing. In situ NN accelerators can efficiently perform NN inference using resistive crossbars, which makes them a promising solution to the data movement challenges faced by conventional architectures. Although such accelerators demonstrate significant potential for dense NNs, they often do not benefit from sparse NNs, which contain relatively few non-zero weights. Processing sparse NNs on in situ accelerators results in wasted energy to charge the entire crossbar where most elements are zeros. To address this limitation, this paper proposes Granular Matrix Reordering (GMR): a preprocessing technique that enables an energy-efficient computation of sparse NNs on in situ accelerators. GMR reorders the rows and columns of sparse weight matrices to maximize the crossbars' utilization and minimize the total number of crossbars needed to be charged. The reordering process does not rely on sparsity patterns and incurs no accuracy loss. Finally, GMR achieves an average of 28% and up to 34% reduction in energy consumption over seven pruned NNs across four different pruning methods and network architectures.

97 MATHEMATICS AND COMPUTING↗

EQC: Ensembled Quantum Computing for Variational Quantum Algorithms

Variational quantum algorithms (VQA), which are comprised of a classical optimizer and a parameterized quantum circuit, emerges as one of the most promising approaches of harvesting quantum power in the noisy-intermediate-scale-quantum (NISQ) era. However, the deployment of VQAs on today's NISQ devices often faces considerable system noise and prohibitively slow training speeds. On the other hand, the expensive supporting sources and infrastructure make quantum computers extremely keen on high utilization. In this paper, we propose a novel way of thinking about a quantum backend: rather than relying on one physical device which tends to introduce platform-specific noise and bias, a quantum ensemble, which distributes quantum tasks across parallel devices, can serve as a virtualized quantum computer for offering reduced noise levels through an adaptive mixture and also provide significantly improved training speeds through parallelization. With this idea, we build a distributive VQA optimization framework called DVQA, serving as the first effort in adopting parallel quantum devices for cooperative VQA training. To further constraint noise and speed-up convergence, we design a model for individual NISQ devices concerning their properties and running conditions, and propose a weighting mechanism for regularizing the returned gradients. Extensive evaluations on 10 IBM-Q quantum devices using the VQE example show that the distributive VQA training framework can substantially boost the training speed by 10.5x on average (up to 86x and at least 5.2x) with improved training accuracy.

Stein, Samuel A.↗

Arm and shoulder muscle segmentation in axial MRI with UNet deep learning model

Quantifying individual upper-limb muscle volumes from MRI provides key insight into muscle-specific strength, deficits, and adaptations. Manual delineation is the gold standard but time‑intensive, and the performance of current deep learning approaches, particularly for small or anatomically complex muscles, remains incompletely characterized. We evaluated a state‑of‑the‑art deep learning framework across the entire upper limb and analyzed factors governing segmentation performance, with attention to the forearm. Three previously published MRI datasets (1.5 T, 3D GRE T1‑weighted; total n = 39) spanning young, middle‑aged, and older adults were curated and quality‑checked, including expert manual segmentations for 31 muscles. Following multiclass mask reconstruction, we trained three 3D nnU‑Net multiclass models matched to the muscle subsets present across datasets, using five‑fold cross‑validation and a composite Dice Similarity Coefficient (DSC) + cross entropy loss. Segmentation accuracy was assessed with DSC. Performance varied across muscles (mean DSC = 0.806 ± 0.098), ranging from 0.920 (Deltoid) to 0.461 (Extensor pollicis brevis). In uncertainty‑weighted regressions, muscle volume was positively associated with DSC (R2 = 0.36, p < 0.001), whereas training segmentation count and muscle orientation showed negligible associations (R2 ≤ 0.06). A weighted mixed‑effects model identified volume as the strongest evaluated predictor, explaining 23.9% of variance in DSC; orientation and training count each contributed <1%, leaving 61.5% unexplained. These results indicate that deep learning–based segmentation can accurately quantify muscle volume for many upper‑limb muscles but remains constrained for small, low‑contrast forearm muscles.

Gillespie, Samuel↗

Integration of multiple coinflip devices for high-quality random sampling

Artificial intelligence, scientific computing, and probabilistic computing use random sampling to approximate solutions to various problems, with larger models requiring a substantial quantity of random numbers. To generate the required vast quantity of random numbers at high rates, we explore so-called “coinflip” devices, which are stochastic microelectronic devices ideally capable of independently generating random bits with a tunable weight at a high rate. However, coinflip devices are inherently analog and demonstrate nonidealities, like temperature dependence and drift, that can introduce determinism into the outputs. We present important considerations for building systems of multiple coinflip devices to produce high-quality bitstreams with low error and little dependency on previous bits. Using tunnel diodes as coinflip devices, we implement a control loop to adapt to temperature dependence and generate fair bitstreams with each device. While this can lead to dependencies between bits in a single bitstream, we demonstrate that combining results generated in parallel with individual tunnel diodes can produce fair and unpredictable bitstreams. The suitability of these bitstreams for use in probabilistic computing is then demonstrated through a Monte Carlo approximation of π.

Taylor, Brady Garland [Sandia National Laboratorie↗

A Holistic Algorithmic Approach to Improving Accuracy, Robustness, and Computational Efficiency for Atmospheric Dynamics

Atmospheric weather and climate models must perform simulations very quickly to be useful. Therefore, modelers have traditionally focused on reducing computations as much as possible. However, in our new era of increasingly compute-capable hardware, data movement is now the prohibiting expense. This study examines the computational benefits of a new algorithmic approach to modeling atmospheric dynamics on scales relevant to weather and climate simulation. Rather than minimizing computations, this new approach considers the larger problem more holistically, including spatial accuracy, temporal accuracy, robustness (i.e., oscillations), on-node efficiency, and internode data transfers together at once. Numerical experiments demonstrate how computations can be strategically increased to simultaneously address each of these constraints while reducing data movement to adapt to modern accelerated hardware. The new algorithm can achieve at times up to 80% peak floating point throughput in single precision on the Nvidia Tesla V100 GPU, where the traditional approach is shown to only achieve single-digit floating point efficiency. Further, the new algorithm is twice as fast as a standard Runge--Kutta time integrator, and high-order accuracy with Weighted Essentially Non-Oscillatory (WENO) limiting came at less than 30% additional runtime cost on a GPU, thus increasing the accuracy per degree of freedom.

54 ENVIRONMENTAL SCIENCES↗

Direct numerical simulations of turbulent reacting flows with shock waves and stiff chemistry using many-core/GPU acceleration

Compressible reacting flows may display sharp spatial variation related to shocks, contact discontinuities or reactive zones embedded within relatively smooth regions. The presence of such phenomena emphasizes the relevance of shock-capturing schemes such as the weighted essentially non-oscillatory (WENO) scheme as an essential ingredient of the numerical solver. However, these schemes are complex and have more computational cost than the simple high-order compact or non-compact schemes. In this paper, we present the implementation of a seventh-order, minimally-dissipative mapped WENO (WENO7M) scheme in a newly developed direct numerical simulation (DNS) code called KAUST Adaptive Reactive Flows Solver (KARFS). In order to make efficient use of the computer resources and reduce the solution time, without compromising the resolution requirement, the WENO routines are accelerated via graphics processing unit (GPU) computation. The performance characteristics and scalability of the code are studied using different grid sizes and block decomposition. Furthermore, the performance portability of KARFS is demonstrated on a variety of architectures including NVIDIA Tesla P100 GPUs and NVIDIA Kepler K20X GPUs. In addition, the capability and potential of the newly implemented WENO7M scheme in KARFS to perform DNS of compressible flows is also demonstrated with model problems involving shocks, isotropic turbulence, detonations and flame propagation into a stratified mixture with complex chemical kinetics.

97 MATHEMATICS AND COMPUTING↗

Evaluation of data collection bias of third molar stages of mineralisation for age estimation in the living

Abstract Age assessment of the living is a fundamental procedure in the process of human identification, in order to guarantee fair treatment of individuals, which has ethical, civil, legal, and medical repercussions. The careful selection of the appropriate methods requires evaluation of several parameters: accuracy, precision of the method, as well as its reproducibility. The approach proposed by Mincer et al. adapted from Demirjian et al. exploring third molar mineralisation, is one of the most frequently considered for age estimation of the living. Thus, this work aims to assess potential bias in the data collection when applying the classification stages for dental mineralisation adapted by Mincer et al. A total of 102 orthopantomographs, of clinical origin, belonging to individuals aged between 12 and 25 years ($ \bar{\textit x} $ = 20.12 years, SD = 3.49 years; 65 females, 37 males, all of Portuguese nationality) were included and a retrospective analysis performed by five observers with different levels of experience (high, average, and basic). The performance and agreement between five observers were evaluated using Weighted Cohen’s Kappa and the Intraclass Correlation Coefficient. To access the influence of impaction on third molar classification, variables were tested using ordinal logistic regression Generalised Linear Model. It was observed that there were variations in the number of teeth identified among the observers, but the agreement levels ranged from moderate to substantial (0.4–0.8). Upon closer examination of the results, it was observed that although there were discernible differences between highly experienced observers and those with less experience, the gap was not as significant as initially hypothesised, and a greater disparity between the classifications of the upper (0.24–0.49) and lower third molars (>0.55) was observed. When bone superimposition is present, the classification process is not significantly influenced; however, variation in teeth angulation affects the assessment. The results suggest that with an efficient preparation, the level of experience as a factor can be overcome. Mincer and colleague's classification system can be replicated with ease and consistency, even though the classification of upper and lower third molars presents distinct challenges.

de Oliveira Santos, Inês (ORCID:0000000267324347)↗

An adaptive Hessian approximated stochastic gradient MCMC method

Bayesian approaches have been successfully integrated into training deep neural networks. One popular family is stochastic gradient Markov chain Monte Carlo methods (SG-MCMC), which have gained increasing interest due to their ability to handle large datasets and the potential to avoid overfitting. Although standard SG-MCMC methods have shown great performance in a variety of problems, they may be inefficient when the random variables in the target posterior densities have scale differences or are highly correlated. Here, we present an adaptive Hessian approximated stochastic gradient MCMC method to incorporate local geometric information while sampling from the posterior. The idea is to apply stochastic approximation (SA) to sequentially update a preconditioning matrix at each iteration. The preconditioner possesses second-order information and can guide the random walk of a sampler efficiently. Instead of computing and saving the full Hessian of the log posterior, we use limited memory of the samples and their stochastic gradients to approximate the inverse Hessian-vector multiplication in the updating formula. Moreover, by smoothly optimizing the preconditioning matrix via SA, our proposed algorithm can asymptotically converge to the target distribution with a controllable bias under mild conditions. To reduce the training and testing computational burden, we adopt a magnitude-based weight pruning method to enforce the sparsity of the network. Our method is user-friendly and demonstrates better learning results compared to standard SG-MCMC updating rules. The approximation of inverse Hessian alleviates storage and computational complexities for large dimensional models. Numerical experiments are performed on several problems, including sampling from 2D correlated distribution, synthetic regression problems, and learning the numerical solutions of heterogeneous elliptic PDE. The numerical results demonstrate great improvement in both the convergence rate and accuracy.

97 MATHEMATICS AND COMPUTING↗

Dynamic Model Development of a Wind Power Plant Using Neural Net Method to Forecast Wind Power Output (CRADA Final Report)

This project is intended to model wind power plant based on monitored data at the wind power plant. This project will promote the university research in Renewable Energy area and trains the future highly qualified engineers. The dynamic model will be based on neural net model with the input from the two met towers (12 inputs), and the number of turbines in operation (one input). The overall input will be 13 inputs to drive the simulations. The output power at the point of interconnection will be used to tune the neural net weight coefficients. Two neural net concepts will be investigated (the back propagation neural net and the dynamic recurrent neural net with feedback).

17 WIND ENERGY↗

A neural network‐enhanced reproducing kernel particle method for modeling strain localization

Abstract Modeling the localized intensive deformation in a damaged solid requires highly refined discretization for accurate prediction, which significantly increases the computational cost. Although adaptive model refinement can be employed for enhanced effectiveness, it is cumbersome for the traditional mesh‐based methods to perform while modeling the evolving localizations. In this work, neural network‐enhanced reproducing kernel particle method (NN‐RKPM) is proposed, where the location, orientation, and shape of the solution transition near a localization is automatically captured by the NN approximation via a block‐level neural network (NN) optimization. The weights and biases in the blocked parameterization network control the location and orientation of the localization. The designed basic four‐kernel NN block is capable of capturing a triple junction or a quadruple junction topological pattern, while more complicated localization topological patters are captured by the superposition of multiple four‐kernel NN blocks. The standard RK approximation is then utilized to approximate the smooth part of the solution, which permits a much coarser discretization than the high‐resolution discretization needed to capture sharp solution transitions with the conventional methods. A regularization of the NN approximation is additionally introduced for discretization‐independent material responses. The effectiveness of the proposed NN‐RKPM is verified by a series of numerical verifications.

Baek, Jonghyuk↗

Optical diagnostics of laser-produced plasmas

Laser-produced plasmas (LPPs) engulf exotic and complex conditions ranging in temperature, density, pressure, magnetic and electric fields, charge states, charged particle kinetics, and gas-phase reactions, based on the irradiation conditions, target geometries, and the background cover gas. The application potential of the LPP is so diverse that it generates considerable interest for both basic and applied research areas. The fundamental research on LPPs can be traced back to the early 1960s, immediately after the invention of the laser. In the 1970s, the laser was identified as a tool to pursue inertial confinement fusion, and since then, several other technologies emerged out of LPPs. These applications prompted the development and adaptation of innovative diagnostic tools for understanding the fundamental nature and spatiotemporal properties of these complex systems. Although most of the traditional characterization techniques developed for other plasma sources can be used to characterize the LPPs, care must be taken to interpret the results because of their small size, transient nature, and inhomogeneities. The existence of the large spatiotemporal density and temperature gradients often necessitates non-uniform weighted averaging over distance and time. Among the various plasma characterization tools, optical-based diagnostic tools play a key role in the accurate measurements of LPP parameters. The optical toolbox contains optical spectroscopy (emission, absorption, and fluorescence), passive and active imaging and optical probing methods (shadowgraphy, Schlieren, interferometry, Thomson scattering, deflectometry, and velocimetry). Each technique is useful for measuring a specific property, and its use is limited to a certain time span during the LPP evolution because of the sensitivity issues related to the selected measuring tool. Therefore, multiple diagnostic tools are essential for a comprehensive insight into the entire plasma behavior. In recent times, the improvements in performance in the lasers and detector systems expanded the capability of the aforementioned passive and active diagnostics tools. Furthermore, this review provides an overview of optical diagnostic tools frequently employed for the characterization of the LPPs and emphasizes techniques, associated assumptions, and challenges. Considering most of the industrial and other applications of the LPP belong to low to moderate laser intensities (10 8 – 10 15 Wcm –2 ), this review focuses on diagnostic tools pertaining to this regime.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

High Power Density, Carbon Neutral Electrical Power Generation for Air Vehicles

The synergistic integration of a Solid Oxide Fuel Cell-Combustor (SOFC-C) with a turbogenerator (TG) will provide a very high fuel-to-electricity conversion efficiency while maintaining high power-to-weight ratio during high-altitude flight. The proposed SOFC-C-TG power generation technology exceeds the REEACH technical performance targets (TPT). This unique concept addresses many of the challenges faced in all electric propulsion-based aviation. The system has high part-load efficiency (more than 65% lower heating value (LHV)) during long cruise times, load following capability, high-power capacity at high altitudes adapting to low temperatures and pressures, rapid startup time of less than 30 minutes (proven with current SOFC technology), high power density (more than 3.2 kW/kg), efficient thermal management, and a foundation for a compact, efficient electrical storage and power generation system (ESPG). The SOFC-C concept achieves the technology targets by reducing the complexity of traditional fuel cell-gas turbine hybrid systems (FC-GT). The SOFC-C does not require heat exchangers and dramatically reduces the balance of plant increasing power density and performance in efficiency. The reduction in mass through elimination of heat exchangers, external reformer, and other components dramatically decreases the overall thermal dampening of the system which enables rapid startup and load following capability. Direct control of the cathode inlet temperature of the SOFC-C enables rapid warm-up of the SOFC tubes with the ability to reach operating temperature and full power in less than 30 minutes.

03 NATURAL GAS↗

Reweighting Underlying Event and Colour Reconnection parameter variations in Sherpa

We propose and validate a new method to trace the impact of parameter variations in the simulation of multi-parton interactions and colour reconnections in the Sherpa event generator. They are reflected, at an event-by-event basis, through relative weights with respect to the central production parameters that give rise to the generated events and distributions. Our method facilitates the tuning of the Monte Carlo event generator at a dramatically reduced computational cost, alleviates parameter sensitivity studies, and enables robust quantification of parametric uncertainties on-the-fly, one of the missing ingredients for future simulations of high-energy particle collisions. The method can easily be adapted to and implemented in other event generators. To illustrate its potential, we here consider combined tunes of the multi-parton-interaction and colour-reconnection models in Sherpa using LHC proton-proton collision data at $\sqrt{s}=7\,\text{TeV}$. We furthermore calibrate the energy-scaling behaviour of dimensionful model parameters based on $\sqrt{s}=13\,\text{TeV}$ LHC data and Tevatron data taken at $\sqrt{s}=1.96\,\text{TeV}$.

Pabst, Moritz [Gottingen U.]↗

A phase-field diffraction model for thermo-hydro-mechanical propagating fractures

This paper introduces a novel diffraction based thermo-hydraulic–mechanical (THM) model for fracture propagation using a phase-field fracture (PFF) approach. The key innovation of the THM-PFF model lies in its integrated treatment of four solution variables—displacements, phase-field, pressure, and temperature—each governed by a combination of conservation of momentum (mechanics problem), a variational inequality (constrained minimization problem), mass conservation (pressure problem), and energy conservation (temperature problem). This leads to a new formulation of a coupled variational inequality system. A major advancement is the development of an extended fixed-stress algorithm, where displacements, phase-field, pressures, and temperatures are solved in a staggered sequence. An important aspect of this work is the global coupling of pressures and temperatures across the domain using diffraction systems, with diffraction coefficients defined by material parameters weighted by the diffusive phase-field variable. To ensure robust local mass conservation, we employ enriched Galerkin finite elements (EG) for both pressure and temperature diffraction equations. By enriching the continuous Galerkin basis functions with discontinuous piecewise constants, EG accurately represents solution and parameter discontinuities while preserving local mass and energy conservation—crucial aspects for THM problems and realistic behavior. Moreover, the use of a predictor–corrector local mesh adaptivity scheme is employed, allowing the model to handle small phase-field length-scale parameters while maintaining high numerical accuracy and reasonable computational cost. Furthermore, these new model and algorithmic developments represent significant advances in the field and have been substantiated through rigorous numerical tests.

Diffraction systems↗

Online evolutionary neural architecture search for multivariate non-stationary time series forecasting

Time series forecasting (TSF) is one of the most important tasks in data science. TSF models are usually pre-trained with historical data and then applied on future unseen datapoints. However, real-world time series data is usually non-stationary and models trained offline usually face problems from data drift. Models trained and designed in an offline fashion can not quickly adapt to changes quickly or be deployed in real-time. To address these issues, this work presents the Online NeuroEvolution-based Neural Architecture Search (ONE-NAS) algorithm, which is a novel neural architecture search method capable of automatically designing and dynamically training recurrent neural networks (RNNs) for online forecasting tasks. Without any pre-training, ONE-NAS utilizes populations of RNNs that are continuously updated with new network structures and weights in response to new multivariate input data. ONE-NAS is tested on real-world, large-scale multivariate wind turbine data as well as the univariate Dow Jones Industrial Average (DJIA) dataset. These results demonstrate that ONE-NAS outperforms traditional statistical time series forecasting methods, including online linear regression, fixed long short-term memory (LSTM) and gated recurrent unit (GRU) models trained online, as well as state-of-the-art, online ARIMA strategies. Additionally, results show that utilizing multiple populations of RNNs which are periodically repopulated provide significant performance improvements, allowing this online neural network architecture design and training to be successful.

97 MATHEMATICS AND COMPUTING↗

The Schwarz Alternating Method for the Seamless Coupling of Nonlinear Reduced Order Models and Full Order Models

Projection-based model order reduction allows for the parsimonious representation of full order models (FOMs), typically obtained through the discretization of a set of partial differential equations (PDEs) using conventional techniques (e.g., finite element, finite volume, finite difference methods) where the discretization may contain a very large number of degrees of freedom. As a result of this more compact representation, the resulting projection-based reduced order models (ROMs) can achieve considerable computational speedups, which are especially useful in real-time or multi-query analyses. One known deficiency of projection-based ROMs is that they can suffer from a lack of robustness, stability and accuracy, especially in the predictive regime, which ultimately limits their useful application. Another research gap that has prevented the widespread adoption of ROMs within the modeling and simulation community is the lack of theoretical and algorithmic foundations necessary for the “plug-and-play” integration of these models into existing multi-scale and multi-physics frameworks. This paper describes a new methodology that has the potential to address both of the aforementioned deficiencies by coupling projection-based ROMs with each other as well as with conventional FOMs by means of the Schwarz alternating method [41]. Leveraging recent work that adapted the Schwarz alternating method to enable consistent and concurrent multiscale coupling of finite element FOMs in solid mechanics [35, 36], we present a new extension of the Schwarz framework that enables FOM-ROM and ROM-ROM coupling, following a domain decomposition of the physical geometry on which a PDE is posed. In order to maintain efficiency and achieve computation speed-ups, we employ hyper-reduction via the Energy-Conserving Sampling and Weighting (ECSW) approach [13]. We evaluate the proposed coupling approach in the reproductive as well as in the predictive regime on a canonical test case that involves the dynamic propagation of a traveling wave in a nonlinear hyper-elastic material.

97 MATHEMATICS AND COMPUTING↗

Reducing the Overnight Capital Cost of Advanced Reactors Using Equipment-Level Seismic Protective Systems

Consideration of the effects of earthquake shaking on the design and construction of nuclear power plants adds substantially to the overnight capital cost, with anecdotal estimates as high as 35+%, attributed to additional construction materials, need for one-off and sub-optimal designs of equipment due to conflicting design choices, the high cost of seismic qualification of equipment, and regulatory review. Safety-critical equipment in large light water reactors is designed and qualified for seismic demands imposed by the supporting reactor building, optimal mechanical designs are not possible, and designs of a given piece of equipment may vary with height above grade. Similar negative impacts are expected for advanced reactors unless the seismic design paradigm is changed. The overarching goal of this transformational MEITNER project, which involved a multidisciplinary engineering team and designers of three fundamentally different advanced reactors, was to adapt proven seismic isolation and damping technologies to operationalize modular protective systems for safety-class equipment inside advanced reactor buildings. Such seismic protective systems would be tightly integrated into design development for reactor support systems and balance-of-plant construction. The adoption of the technology, which is widely used in non-nuclear sectors, would simplify plant design, enable the use of standardized equipment and buildings, optimized for operational performance, and reduce plant size and weight. The need for site-specific equipment would be eliminated, enabling identical equipment to be used across multiple plants sited across the US and economies of scale, and catalyzing new interest and investment. The equipment-based protective systems would allow siting of advanced reactors in regions of high seismic hazard.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗