Search NASASearch

SEARCH · Search NASA

Results for “Initialization method”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Triangle Method for Dense ReLU Layers [SWR-25-72]

This software is an implementation of the methods for initializing and training neural networks to be more efficient per parameter, described more fully below and in the related publication: In theory, depth should make a ReLU network EXPONENTIALLY more efficient by enabling it to produce an exponential number of piecewise linear sections in its output. This reasoning is largely based on the work of mathematicians that have hand-constructed networks that make good use of depth. In practice however, even very deep ReLU networks that have been randomly initialized will behave identically to their shallow counterparts - missing an entire exponential dimension of efficiency. The triangle method is a first attempt at realizing the exponential potential of deep networks. Instead of randomly setting weights, we force pairs of neurons in each layer learn to build triangles (i.e. functions from [0,1] -> [0,1] that look like triangles). This is a very efficient pattern for generating lots of linear pieces because composing two triangular functions doubles the number of pieces with each composition. The triangle method is more than just a different initialization, it is a new paradigm of training. Instead of making direct updates to the matrix weights, we do an extra step of backpropagation to collect the derivatives of the loss function with respect to the shapes of the triangles, training them to tilt left or right. This process essentially holds the networks hand throughout the loss landscape and forces it to always use depth effectively by producing triangular shapes internally. This can produce several orders of magnitude of improvement on convex one-dimensional regression problems. Much more theoretical work is needed to realize its full potential beyond this context, but the implementation in this repository will still work in arbitrary numbers of dimensions. The file Triangle_Method.py is a generalized form of the method that will build each neuron its own custom 1-d convex activation function (with exponential efficiency). Example usage on one dimensional problems can be found in Example_Usage.ipynb and an example of using this in a real neural network can be found in Example_VGG16_CIFAR10.ipynb.

Milkert, Max [National Renewable Energy Laboratory

FLORA Equilibrium and Stability Code Archive

FLORA solves, in a 2-D domain (radial and axial dimensions) with a specified azimuthal Fourier mode, for the linearized stability of a long, thin, axisymmetric plasma equilibrium in an applied magnetic field. Before the stability equation is solved, FLORA solves a set of simple equations for pressure balance that specify the equilibrium magnetic field and plasma pressure in the long-thin limit given a simplified description of the magnetic coils. It uses an initial-value method for the linear stability problem in which an equilibrium is given an initial perturbation to its magnetic field, and the temporal behavior of the perturbation is followed. The perturbation has been Fourier expanded in the azimuthal coordinate; each azimuthal mode must be examined separately. The complex partial differential equation of motion for the perturbed radial displacement of the field lines is solved as a coupled system of two real p.d.e.'s and the solution consists of two parts, the real part and the imaginary part. The system is solved by bringing the coupling terms in each equation to the right side and using an iterative technique.

Cohen, Bruce [Lawrence Livermore National Laborato

Simultaneous Celestial Navigation

GPS technology is used in a multitude of applications around the world for navigation. However, GPS can be contested or denied and thus alternatives to GPS are needed for positioning in high-consequence systems. This project investigates a non-RF based method to produce an estimated geolocation using stellar/celestial measurements in combination with measurements from inclinometers and a real time clock. The initial iteration of this method, developed in FY20/21, achieved an estimated location accuracy within approximately 3 kilometers of the true location with a 3-sigma bound of about 8 kilometers. The next iteration aims to enhance this technology further, targeting an estimation accuracy within 100 meters of the true location, representing a 30-fold improvement over the initial method.

42 ENGINEERING

Instrumentation and methods for efficient time-resolved X-ray crystallography of biomolecular systems with sub-10 ms time resolution

Time-resolved X-ray crystallography has great promise to illuminate structure–function relations and key steps of enzymatic reactions with atomic resolution. The dominant methods for chemically-initiated reactions require complex instrumentation at the X-ray beamline, significant effort to operate and maintain this instrumentation, and enormous numbers (∼10 5 –10 9 ) of crystals per time point. We describe instrumentation and methods that enable high-throughput time-resolved study of biomolecular systems using standard crystallography sample supports and mail-in X-ray data collection at standard high-throughput cryocrystallography synchrotron beamlines. The instrumentation allows rapid reaction initiation by mixing of crystals and substrate/ligand solution, rapid capture of structural states via thermal quenching with no pre-cooling perturbations, and yields time resolutions in the single-millisecond range, comparable to the best achieved by any non-photo-initiated method in both crystallography and cryo-electron microscopy. Our approach to reaction initiation has the advantages of simplicity, robustness, low cost, adaptability to diverse ligand solutions and small minimum volume requirements, making it well suited to routine laboratory use and to high-throughput screening. We report the detailed characterization of instrument performance, present structures of binding of N -acetylglucosamine to lysozyme at time points from 8 ms to 2 s determined using only one crystal per time point, and discuss additional improvements that will push time resolution toward 1 ms.

Indergaard, John A. (ORCID:000000022367699X)

Evaluation of methods and improvement of predictions for specification properties of petroleum-based and alternative aviation fuels

To support our research and process modeling for liquid fuels, including blends, from petroleum and synthetic sources such as from biomass intermediates, we evaluated composition-based prediction methods and improved predictions for five key specification properties of petroleum-based and alternative aviation fuels, namely distillation temperatures (10 % distilled, t 10 , and final boiling point, t FBP ), density, flash point, net heat of combustion, and freezing point. The types of fuels included were petroleum-based jet fuels, jet-fuel surrogate mixtures, synthetic blending components obtained from different sources, and blends of Jet A with many synthetic blending components. Expanded datasets to update associated parameters allowed significant improvements for one of the prediction methods used in earlier work, namely the Modified Weighted Average method published initially by Shi et al. By considering the importance of lighter compounds for flash points and heavier compounds for freezing points, the revised Modified Weighted Average method was further improved. For liquid density, the revised Modified Weighted Average method gave the best overall results. The revised Modified Weighted Average method, the American Society for Testing and Materials D7215 method, and the D7215 method modified by another group gave comparable results for flash point, while the revised Modified Weighted Average and D3338 methods gave the best results for net heat of combustion. Freezing point was well predicted using the revised Modified Weighted Average method and showed the most significant improvements over current predictions. Distillation temperature t 10 was not well predicted, while t FBP was predicted with a mean absolute error comparable to experimental reproducibility.

09 BIOMASS FUELS

Enabling topography-resolving structural dynamic contact simulation

Damping of structures and systems is often dominated by frictional dissipation in connections, the prediction of which remains a longstanding scientific challenge. Previous studies have shown that the actual topography of contact interfaces may have a strong effect, especially in the partial slip/liftoff regime. We recently proposed a multi-scale method, which couples finite element and boundary element modeling. The primary benefit of this approach is that it permits to analyze the effect of the actual contact topography on the dynamics of jointed structures. While this multi-scale modeling method was initially developed for quasi-static analysis, we demonstrate herein how it can be used for time step integration and Harmonic Balance analysis. We cross-verify those fully dynamic analysis methods against each other and quasi-static results, for the S4 Beam benchmark. We compare the multi-scale method against state-of-the-art full-FE analysis, in terms of numerical damping and computational performance. Some discrepancy is found to be of physical origin. Depending on the load history, it is shown that the system settles to a slightly different equilibrium. Finally, transient multi-scale simulations enable the prediction of this interesting phenomenon, for the first time, for a structure with bolted joints.

Frictional-unilateral contact

State Dependent Optimization with Quantum Circuit Cutting

Quantum circuits can be reduced through optimization to better fit the constraints of quantum hardware. One such method, initial-state dependent optimization (ISDO), reduces gate count by leveraging knowledge of the input quantum states. Surprisingly, we found that ISDO is broadly applicable to the downstream circuits produced by circuit cutting. Circuit cutting also requires measuring upstream qubits and has some flexibility of selection observables to do reconstruction. Therefore, we propose a state-dependent optimization (SDO) framework that incorporates ISDO, our newly proposed measure-state dependent optimization (MSDO), and a biased observable selection strategy. Building on the strengths of the SDO framework and recognizing the scalability challenges of circuit cutting, we propose nonseparate circuit cutting-a more flexible approach that enables optimizing gates without fully separating them. We validate our methods on noisy simulations of QAOA, QFT, and BV circuits. Results show that our approach consistently mitigates noise and improves overall circuit performance, demonstrating its promise for enhancing quantum algorithm execution on near-term hardware.

Li, Xinpeng

Predicting Li-Ion Battery Capacity Fade Using Early-Life Data and a Hybrid Data-Driven Gaussian Process-Bayesian Regression Approach

Accurately predicting Li-ion battery capacity trajectories using early-life data can dramatically improve battery-life understandings and be used to rapidly evaluate design/cost/performance trade-offs when developing new battery materials. Accurate early-life predictions enable researchers to quickly iterate over cell designs and material precursor properties without consistently cycling cells to failure. To this end, we present a toolbox that uses a combined Gaussian Process and Bayesian regression approach that capitalizes on signals other than just capacity (e.g., dQ/dV, voltage drops) to rapidly predict capacity-fade trajectories. The prediction tool uses Bayesian regression to fit functional forms, e.g., power law, sigmoids, etc., to predict capacity-fade dynamics. By fitting functional forms, the capacity fade can be interrogated at any point in the future, allowing for early cell-failure prediction. Additionally, Bayesian regression allows for accurate uncertainty estimates that account for cell-to-cell variability (aleatoric uncertainty) and the lack of observation data (epistemic uncertainty). By only using early cycle data to predict the capacity fade trajectory, uncertainty bounds at end-of-life can be extremely large. The large uncertainty bounds are further exacerbated because there is no systematic way to define the prior distribution of the functional forms' parameters. We improve our the predicted trajectory confidence interval of our predicted trajectory using two methods. First, we shows that a small amount of held-out cycling data is sufficientuse some train cells, that have been cycled to failure to derive information regarding the appropriate prior distributions for the functional forms' parameters of the functional form, effectively leading to data-driven priors.. We propose constructing the data-driven priors by first running a Bayesian regression starting with uninformed priors to generate intermediate cell-specific posterior parameter distributions. These posterior distributions are combined using a Ggaussian mixture model for each parameter to create the data-driven priors. These mixture models serve as the data-driven prior distributions for the parameters for. Second, we derive multiple features, e.g., C_dchg 0.5 DoD 0.5, log (|mean(dQ/dV_(w_3-w_0 ) (V)|), etc., from the train cellsheld-out cycling data, identify which the features are that best predicting capacity at early/mid-life cycles, and then create Ggaussian process regression models that are used for predicting capacity at early/mid-life cycles for the test cells (see blue dots with error bars in Fig 1b). Finally, these predicted data-points are used in addition to the actual early cycle data capacity fade to construct the Bayesian regression trajectory for the test cell s. Notably. We note that these two methods are complementary and can be combined with each other. We evaluate the performance of our proposed method on an testing open-source dataset from Iowa State University and Iowa Lakes Community College (ISU-ILCC). This dataset comprises of 251 nickel-manganese-cobalt/graphite Lithium-ion cells that are cycled under 63 different conditions. We compute the mean average percentage error (MAPE) and negative log predictive density (NLPD) to quantify the efficacy of our method. Our initial findings suggest that, when only few observations are available, for test cells, when using only Bayesian regression with uninformed priors, a power law functional provides the most accurate predictions. with very few data points. However, asHowever, a the number of data points increases, a twin sigmoidal function becomes more accurate as the number of observations further increases. We also find that using as little as 10% of the data set towards generating data-driven priors can lead to significant improvement in prediction accuracy when using early cycle data. Lastly, we found that augmenting early-cycle data with Gaussian process-predicted capacity data for Bayesian regression greatly improves the prediction accuracy. We will present a comprehensive comparison of our methods to other methods available in the literature and apply this method to additional battery datasets.

42 ENGINEERING

Sensitivity of Fine‐Resolution Urban Heat Island Simulations to Soil Moisture Parameterization

ABSTRACT Urban areas experience the impact of natural disasters, such as heatwaves and flash floods, disparately in different neighbourhoods across a city. The demand for precise urban hydrometeorological and hydroclimatological modelling to examine this disparity, and the interacting challenges posed by climate change and urbanisation, has thus surged. The Weather Research and Forecasting (WRF) model has served such operational and research purposes for decades. Recent advancements in WRF, including enhanced numerical schemes and sophisticated urban atmospheric‐hydrological parameterizations, have empowered the simulation of urban geophysical processes at high resolution (~1 km), but even this resolution misses significant urban microclimate variability. This study applies the large‐eddy simulations (LES) mode within WRF, coupled with single‐layer urban canopy models (SLUCM), to enable even finer‐scale modelling (150 m) of the Urban Heat Island (UHI) effect in the Baltimore metropolitan area. We run nine scenarios to evaluate various methods of initializing soil moisture and various spinup lead times, and to assess the impact of WRF's Mosaic approach in depicting subgrid‐scale processes. We evaluate the scenarios by comparing the WRF simulated land surface temperature (LST) against Landsat LST and the WRF simulated hourly 2‐m air temperatures (AT) with observations from eight weather stations across the domain. Results underscore the paramount influence of the lead spinup time on the spatiotemporal distribution of simulated soil moisture, consequently shaping WRF's efficacy in predicting the UHI. Furthermore, interpolating soil moisture‐related parameters from the parent for child domain initialization yields a notable reduction in mean and root‐mean‐squared errors. This improvement was particularly evident in simulations with the longest spinup time, affirming the importance of carefully designing the initialization of soil moisture for improved urban temperature predictions.

Talebpour, Mahdad

AI-assisted rapid crystal structure generation towards a target local environment

In material design, traditional crystal structure prediction approaches are expensive as they require extensive structural sampling through expensive energy minimization methods. Emerging artificial intelligence (AI) generative models have shown great promise in rapidly generating realistic crystals, but they typically handle only a few tens of atoms per unit cell. To overcome this limitation, we introduce a symmetry-informed approach, the Local Environment Geometry-Oriented Crystal Generator (LEGO-xtal). Our method generates initial structures using AI models trained on an augmented dataset, and then optimizes them using structure descriptors rather than energy-based optimization. We demonstrate its effectiveness by expanding from 25 known low-energy sp2 carbon allotropes to over 1700, all within 0.5 eV/atom of the ground-state energy of graphite. This framework offers a generalizable strategy for the targeted design of materials with modular building blocks, such as metal-organic frameworks and battery materials.

Ridwan, Osman Goni [University of North Carolina a

Dispersive X-ray absorption spectroscopy using independent grazing-incidence focusing and convexly bent Bragg-crystal dispersing optics

We present a modular instrument for dispersive X-ray absorption spectroscopy (DXAS) developed for the Advanced Spectroscopy Beamline at Sector 25 of the Advanced Photon Source. The setup employs a double-multilayer monochromator to provide X-rays with a broad energy bandwidth, Kirkpatrick–Baez mirrors for focusing, a convexly bent Bragg-crystal polychromator for energy dispersion, and a pixel-array detector to resolve all X-ray energies and collect their intensity simultaneously, thereby enabling acquisition of a full X-ray absorption spectrum in a single shot. The use of separate optics for X-ray focusing and energy dispersion provides high spatial resolution and avoids chromatic aberrations inherent in focusing bent-crystal optics, and a modular design makes implementation of the technique at other beamlines possible without requiring modifications to the upstream beamline configurations. Theoretical calculations are performed to determine optimal instrument operating parameters and demonstrate that an energy resolution better than the K-edge core-hole lifetime broadening can be maintained while providing a sufficient bandwidth for X-ray absorption near-edge structure spectroscopy through the full operating range of 5–11 keV. Additionally, instrument design, data analysis methods, and initial DXAS results on lithium–manganese–nickel oxide laminates are presented.

47 OTHER INSTRUMENTATION

Field To Farm Aggregation For Agricultural Systems

The Fields to Farms methodology illustrates the generation of farm parcels from the Crop Data Layer (CDL), a raster dataset containing 133 categories representing various crop types and land uses. This methodology involves two primary steps: Field Delineation and Farm Aggregation. The code specifically addresses the aggregation of pre-delineated fields within a county to form farms, adhering to predefined criteria for farm size categories. It is assumed that the field delineation process, which involves creating vector polygons from CDL raster, has been completed beforehand, possibly through external tools or methods. Upon initialization, the script processes county-level fields, preparing them for farm aggregation. In the Farm Aggregation phase, the code iteratively combines delineated fields into farms based on specified criteria, continuing until the aggregated farm size meets predefined thresholds derived from data from the 2017 National Agricultural Statistics Service (NASS) census. Throughout this iterative process, the script dynamically adjusts the aggregation to ensure alignment with the desired distribution reported by NASS. The resulting output of the script is a GeoDataFrame containing classified farms, which are subsequently saved as GeoPackage files. These files enable further analysis and visualization, facilitating comprehensive exploration of the farm landscape generated through the methodology.

Paudel, Rajiv [Idaho National Laboratory (INL), Id

Utah FORGE: Neubrex Well 16B(78)-32 Fiber Optics Reports - Stimulation and Circulation, 2024

This zip file contains reports discussing the use of fiber optics during well 16B(78)-32 stimulation and circulation tests in the summer of 2024. The reports cover the collection of strain rate and temperature change data during these well events. Theory, methods, and initial data visualizations are included in the reports, highlighting the value of these data types.

15 GEOTHERMAL ENERGY

A deep learning approach to fast analysis of collective Thomson scattering spectra

Fast analysis of collective Thomson scattering ion acoustic wave features using a deep convolutional neural network model is presented. The network was trained from spectra to predict the plasma parameters, including ion velocities, population fractions, and ion and electron temperatures. A fully kinetic particle-in-cell simulation was used to model a laboratory astrophysics experiment and simulate a diagnostic image of the ion acoustic wave feature. Network predictions were compared with Bayesian inference of the plasma model parameters for both the simulated and experimentally measured images. Both approaches were fairly accurate predicting the simulated image and the network predictions matched a good portion of the Bayesian results for the experimentally measured image. The Bayesian approach is more robust to noise and motivates future work to train deep learning models with realistic noise. The advantage of the deep learning model is making thousands of predictions in a few hundred milliseconds, compared to a few seconds to minutes per prediction for the optimization and Bayesian approaches presented here. The results demonstrate promising capabilities of deep learning models to analyze Thomson data orders of magnitude faster than conventional methods when using the neural network for standalone analysis. If more rigorous analysis is needed, neural network predictions can be used to quickly initialize other optimization methods and increase chances of success. This is especially useful when the dataset becomes very large or highly dimensional and manually refining initial conditions for the entire dataset are no longer tractable.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY

A meshless stochastic method for Poisson–Nernst–Planck equations

A plethora of biological, physical, and chemical phenomena involve transport of charged particles (ions). Its continuum-scale description relies on the Poisson–Nernst–Planck (PNP) system, which encapsulates the conservation of mass and charge. The numerical solution of these coupled partial differential equations is challenging and suffers from both the curse of dimensionality and difficulty in efficiently parallelizing. We present a novel particle-based framework to solve the full PNP system by simulating a drift–diffusion process with time- and space-varying drift. We leverage Green’s functions, kernel-independent fast multipole methods, and kernel density estimation to solve the PNP system in a meshless manner, capable of handling discontinuous initial states. The method is embarrassingly parallel, and the computational cost scales linearly with the number of particles and dimension. We use a series of numerical experiments to demonstrate both the method’s convergence with respect to the number of particles and computational cost vis-à-vis a traditional partial differential equation solver.

Chemistry

Achieving geometric accuracy in FFT-based micromechanical models using conformal grid

Owing to its efficiency, simplicity and robustness, the FFT-based method has become the standard for computation of mechanical fields in a heterogeneous periodic unit cell. One of the main disadvantages of the FFT-based method is the inaccurate representation of the initial microstructure on a regular grid of voxels, which can be alleviated through the use of distorted initial grids. Here, in this paper, a method for generation of distorted initial grids conforming to the microstructural features (e.g. straight/curved boundaries) is proposed. The method determines the positions of the grid nodes in the initial configuration by solving a system of springs connecting the nodes. Microstructures consisting of layers, Voronoi tessellation and circular/spherical inclusions are considered, and mechanical fields simulated using the FFT-based method. It is found that distorted initial grids, conforming to the microstructural features, lead to more accurate mechanical fields in comparison to the corresponding non-distorted initial grid solution. The effect of initial grid distortion on the convergence of the FFT-based method is analyzed and discussed.

36 MATERIALS SCIENCE

Initial position optimization in molecular dynamics simulations for a Coulomb system

A new algorithm for molecular dynamics (MD) simulations is developed to optimize plasma particle distributions at given initial temperatures. By combining velocity scaling and reassignment, the method effectively eliminates the initial rise and oscillation in temperatures observed with randomly distributed positions. These rises and oscillations are undesired numerical artifacts observed in conventional plasma MD simulations, arising from unoptimized particle positions. The algorithm demonstrates temperature relaxation without initial rises or oscillations, as well as precise flow velocity relaxation, enabling accurate measurement of relaxation times. The code is accelerated using graphics processing units for parallel processing, enhancing the study of plasma dynamics. The proposed method for distributing physically valid particles in MD simulations enables accurate studies of intrinsic collision processes in plasmas, including the dynamics of strongly coupled plasmas, plasma–wave interactions, and transport phenomena in magnetized plasmas. The paper concludes with a discussion of potential applications and future enhancements to the algorithm.

Jo, Jawon (ORCID:0009000924193285)

IDAES-PSE 2.6.0 Release

The Institute for the Design of Advanced Energy Systems (IDAES) Integrated Platform is a versatile computational environment offering extensive process systems engineering (PSE) capabilities for optimizing the design and operation of complex, interacting technologies and systems. IDAES enables users to efficiently search vast, complex design spaces to discover the lowest cost solutions while supporting the full process modeling lifecycle, from conceptual design to dynamic optimization and control. The extensible, open platform empowers users to create models of novel processes and rapidly develop custom analyses, workflows, and end-user applications. IDAES-PSE 2.6.0 Release Highlights Upcoming Changes IDAES will be switching to the new Pyomo solver interface in the next release. Whilst this will hopefully be a smooth transition for most users, there are a few important changes to be aware of. The new solver interface uses a different version of the IPOPT writer (“ipopt_v2”) and thus any custom configuration options you might have set for IPOPT will not carry over and will need to be reset. By default, the new Pyomo linear presolver will be activated with ipopt_v2. Whilst are working to identify any bugs in the presolver, it is possible that some edge cases will remain. IDAES will begin deploying a new set of scaling tools and APIs over the next few releases that make use of the new solver writers. The old scaling tools and APIs will remain for backward compatibility but will begin to be deprecated. New Models, Tools and Features New Intersphinx extension automatically linking Jupyter notebook examples to project documentation New end-to-end diagnostics example demonstrated on a real problem New complementarity formulation for VLE with cubic equations of state, backward compatibility for old formulation New solver interface with presolve (ipopt_v2) in support of upcoming changes to the initialization and APIs methods, with default set to ipopt to maintain backwards compatibility; this will deprecate once all examples have been updated New forecaster and parameterized bidder methods within grid integration library Updated surrogates API and examples to support Keras 3, with backwards compatibility for older formats such as TensorFlow SavedModel (TFSM) Updated costing base dictionary to include the 2023 cost year index value Updated ProcessBlock to include information on the constructing block class Updated Flowsheet Visualizer to allow visualize() method to return value and functions Bug Fixes Fixed bug in the Modular Property Framework that would cause errors when trying to use phase-based material balances with phase equilibria. Fixed bug in Modular Properties Framework that caused errors when initializing models with non-vapor-liquid phase equilibria. Fixed typos flagged by June update to crate-ci/typos and removed DMF-related exceptions Minor corrections of units of measurement handling in power plant waste/transport costing expressions, control volume material holdup expressions, and BTX property package parameters Fixed throwing >7500 numpy deprecation warnings by replacing scalar value assignment with element extraction and item iteration calls Testing and Robustness Migrated slow tests (>10s) to integration, impacting test coverage but also yielding a nearly 30% decrease in local test runtime Pinned pint to avoid issues with older supported Python versions Pinned codecov versions to avoid tokenless upload behavior with latest version Bumped extensions to version 3.4.2 to allow pointing to non-standard install location Deprecations and Removals Python 3.8 is no longer supported. The supported Python versions are 3.9 through 3.12 The Data Management Framework (DMF) is no longer supported. Importing idaes.core.dmf will cause a deprecation warning to be displayed until the next release The SOFC Keras surrogates have been removed. The current version of the SOFC surrogate model in the examples repository is a PySMO Kriging model.

AS