Search NASA⌕ Search

SEARCH · Search NASA

Results for “Scaling and squaring method”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Resource Recovery and Environmental Protection in Wyoming’s Greater Green River Basin Using Selective Nanostructured Membranes (Final Report)

Produced water (PW) represents a sizable waste stream that is co-generated with oil and natural gas production. In 2021 Wyoming ranked 8th and 9th, respectively in domestic oil and natural gas production. In 2017 Wyoming ranked as the 4th highest generator of PW in the U.S, accounting for 7% of the total volume generated. In the context of being the 3rd most arid state in the U.S., the value of water reuse becomes obvious. PW reuse, and resource recovery, in any form requires some level of treatment to remove particulates, residual (free, dispersed) hydrocarbons, organics, and salts. The level of treatment depends on the requirements of the reuse, or resource recovery, application. PW management systems in Wyoming employ in order of volume of PW managed the following management strategies: reinjection for enhanced oil recovery, surface discharge, deep well injection, evaporation ponds (impoundments), and commercial management/treatment. Complicating treatment efforts are the relatively high concentrations of organics (natural and synthetic), dispersed/free hydrocarbons, benzene-toluene-ethylbenzene, and xylenes (BTEX) compounds, biologicals, salts, and minerals. Hydrocarbons (dispersed/dissolved crude oils) and BTEX compounds, as well as synthetic organics, present economic and environmental concerns. The former represents lost revenue, while the latter results in negative environmental impacts like emissions from surface impoundments. The overall objective of this proposal was to synthesize superhydrophilic/oleophobic and superhydrophobic/oleophilic membranes for selectively concentrating and then separating BTEX compounds and oil and grease (O&G) from PW originating from the Greater Green River Basin (GGRB) in Wyoming. Three specific research aims were pursued to accomplish this overall objective. This final report details the development of the superhydrophobic and superhydrophilic membranes, as well as the design of the membrane module prototypes specifically. The technoeconomic assessment is separately reported in another document. 1. Aim #1 – Material optimization and performance evaluation of superhydrophilic/oleophobic and superhydrophobic/oleophilic membranes made by electrospinning/spraying. 2. Aim #2 – Design and construction of cross-flow membrane modules for selectively concentrating and then separating BTEX/oil from GGRB produced water. 3. Aim #3 – Techno-economic assessment of BTEX/oil recovery, and clean water production, using superhydrophilic/oleophobic and superhydrophobic/oleophilic membrane separation for GGRB PW. Superhydrophobic membranes were synthesized by electrospinning poly(vinylidene fluoride-co-hexafluoropropylene) (PVDF-HFP) nanofibers onto polyester (PET) substrates and electrospraying nano-carbon black/PVDF-HFP onto the nanofibrous layer. These membranes were characterized by high (>8000 liters per square meter per hour per bar (LMH/bar)) permeance values for pure hydrocarbon phases and a high hydrocarbon selectivity (>96%) when treating GGRB PW. All results were obtained when operating the membrane in a crossflow configuration representative of actual field operating conditions. Solvent/oil properties, specifically viscosity and total surface energy/tension, affected permeance across the membrane, which resulted in light mineral oil (394 LMH/bar) and o-xylene (1834 LMH/bar) being characterized by lower permeance values in the pure phase tests. Mixed phase fluxes between 40 to 80 LMH were obtained for the PW when operating the membrane at a feed pressure of 0.3 bar. Flux decreased as the mixed phase concentration in the feed decreased pointing to the importance of maximizing the collision efficiency between the emulsion and the membrane surface and maximizing the emulsion concentration in the feed and the turbulence within the feed channel. These tests demonstrated that the superhydrophobic membranes developed here are a viable hydrocarbon recovery method for GGRB PWs and should be pursued for testing in pilot-scale trials. Superhydrophilic membranes were successfully synthesized via electrospinning/spraying using polyacrylonitrile (PAN) nanofibers as a base nanofibrous matrix. Integration of polyaniline (PANI) into the nanofibrous matrix produced a superior membrane, for water filtration applications, relative to PAN alone and reduced graphene oxide (RGO) when integrated into the nanofibrous matrix. This conclusion was based on the PANI-PAN resistance to flux loss (fouling) when treating model solvent/oil solutions representative of GGRB PWs and field collected PW from the GGRB. The synthesized PAN membranes outperformed a commercially available PAN membrane designed for oil/water separation. This finding indicates that the surface chemical and physical characteristics of the electrospun membranes presents improved properties for filtration of challenging waters like GGRB PWs. The electrospun membranes therefore show promise overall as a substitute for conventionally polymerized membranes in PW treatment applications. The PANI-PAN membrane specifically presents superior performance characteristics for concentration O&G prior to treatment by the hydrocarbon recovery membrane and producing high-quality filtrate for reuse and/or additional treatment (desalination).

02 PETROLEUM↗
DOE OSTI2022

Global Barotropic Tide Modeling Using Inline Self‐Attraction and Loading in MPAS‐Ocean

Abstract We examine ocean tides in the barotropic version of the Model for Prediction Across Scales (MPAS‐Ocean), the ocean component of the Department of Energy Earth system model. We focus on four factors that affect tidal accuracy: self‐attraction and loading (SAL), model resolution, details of the underlying bathymetry, and parameterized topographic wave drag. The SAL term accounts for the tidal loading of Earth's crust and the self‐gravitation of the ocean and the load‐deformed Earth. A common method for calculating SAL is to decompose mass anomalies into their spherical harmonic constituents. Here, we compare a scalar SAL approximation versus an inline SAL using a fast spherical harmonic transform package. Wave drag accounts for energy lost by breaking internal tides that are produced by barotropic tidal flow over topographic features. We compare a series of successively finer quasi‐uniform resolution meshes (62.9, 31.5, 15.7, and 7.87 km) to a variable resolution (45 to 5 km) configuration. We ran MPAS‐Ocean in a single‐layer barotropic mode forced by five tidal constituents. The 45 to 5 km variable resolution mesh obtained the best total root‐mean‐square error (5.4 cm) for the deep ocean ( 1,000 m) tide compared to TPXO8 and ran twice as fast as the quasi‐uniform 8 km mesh, which had an error of 5.8 cm. This error is comparable to those found in other forward (non‐assimilative) ocean tide models. In future work, we plan to use MPAS‐Ocean to study tidal interactions with other Earth system components, and the tidal response to climate change.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Unfolding quantum computer readout noise

Abstract In the current era of noisy intermediate-scale quantum computers, noisy qubits can result in biased results for early quantum algorithm applications. This is a significant challenge for interpreting results from quantum computer simulations for quantum chemistry, nuclear physics, high energy physics (HEP), and other emerging scientific applications. An important class of qubit errors are readout errors. The most basic method to correct readout errors is matrix inversion, using a response matrix built from simple operations to probe the rate of transitions from known initial quantum states to readout outcomes. One challenge with inverting matrices with large off-diagonal components is that the results are sensitive to statistical fluctuations. This challenge is familiar to HEP, where prior-independent regularized matrix inversion techniques (“unfolding”) have been developed for years to correct for acceptance and detector effects, when performing differential cross section measurements. We study one such method, known as iterative Bayesian unfolding, as a potential tool for correcting readout errors from universal gate-based quantum computers. This method is shown to avoid pathologies from commonly used matrix inversion and least squares methods.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2026

Reference floating wind array designs for three representative regions

This work presents the systematic development of three open-source reference floating wind array designs. The designs are tailored to representative site conditions for three regions of the United States: Humboldt Bay off the coast of California, the Gulf of Maine, and the Gulf of America. We adopted existing reference designs for the individual 15 MW turbines, semisubmersible floating platforms, substations, mooring systems, and power cables – integrating and adapting them as needed for each location. We adapted existing dynamic cable designs to use larger conductor sizes to meet the arrays' power transmission requirements, and we set up redundant mooring systems for each substation. The layout of each array is a uniform-grid design optimized to approximately minimize the levelized cost of energy (LCOE) within a square lease area while satisfying spatial constraints. These constraints ensure adequate clearances between adjacent turbines and between underwater components during the layout optimization to prevent clashing and ensure that all components reside within the lease boundaries. Substations are included to allow accounting for intra-array cable costs. They are placed within the uniform grid to maintain the navigability of the arrays. For each feasible layout considered, annual energy production and cable routing costs are calculated and updated in the LCOE objective function. After the optimization, we refined the cable routing with a mix of algorithmic and manual methods to ensure that the cables avoid mooring system components and approach the substation with adequate clearances. We confirmed the suitability of each reference array's layout by comparing the wake losses at each wind heading angle to the wind rose, observing that the optimized layouts largely avoid wake losses in the predominant wind directions. These reference arrays provide open-source baseline designs to enable future research and innovation of floating wind technology at the array scale.

17 WIND ENERGY↗
DOE OSTI2026

Detector alignment for X-ray crystallography using Millepede-II

I describe a method for accurately refining the geometrical parameters of segmented X-ray area detectors on the basis of serial crystallography data, using 'Millepede' – an algorithm created for a very similar problem in high-energy physics. The Millepede method for serial crystallography builds on the approach of Brewster et al. [Acta Cryst. (2018), D74, 877–894], in which the detector parameters are refined simultaneously with the parameters for each individual crystal. This accounts for the mutual dependency between the parameters and thereby avoids the bias and slow convergence problems that have afflicted older approaches in which the deviations between observed and calculated Bragg peak positions were taken directly as the updates for the detector panel positions. The Millepede method uses the special structure of the least-squares normal equations to reduce them to a much smaller form that can be solved very quickly, even compared with the sparse matrix methods used previously. This makes it practical to refine the detector geometry frequently and thereby maintain accurate calibration without specialized alignment campaigns. Tilts of detector panels out of the plane can be reliably refined, as can the overall distance of the detector in the beam direction. With a simulated test case, the new method produced panel shifts within 7% of the correct values with only one iteration, and produced almost exactly correct shifts after a second iteration. A simulated out-of-plane panel rotation was correctly determined to within 0.001°. Applied to experimental data from an X-ray free-electron laser, the method increased the indexable fraction of frames from 30% to 91% in a single iteration, and to 96% after two further iterations. Computing the geometry updates on the basis of 2060 crystals took only 0.819 s on desktop computing hardware, including the time taken to read the required data from disk. The scaling was found to be very close to linear for up to 100 980 sets of crystal parameters, which took only 78.2 s to process under the same conditions. The method has been applied as part of a real-time feedback system at a synchrotron radiation beamline, in which an out-of-plane detector tilt of 0.04° was detected and corrected. Possible further applications are also described here.

Millepede-II↗
DOE OSTI2021

Probabilistic Day-Ahead Forecasting Using an Analog Ensemble Approach for Wind Farm Grid Services

Wind resource assessment and wind power forecasting are used in research and industry to anticipate future power output at scales ranging from individual wind turbines to entire wind farms. Probabilistic day-ahead wind forecasting is useful for anticipating how a wind farm could potentially participate in the day-ahead market by providing upper and lower bounds for expected power generation, thus informing grid operators of its uncertainty. Understanding this uncertainty is part of a larger project focused on building a platform that combines efforts in weather forecasting, aerodynamic and economic modeling to create maximum value of a wind plant to better provide services to the grid. This effort is also known as the Atmosphere to Electrons to Grid (A2E2G) project. One method for producing a probabilistic forecast is through the analog ensemble approach (Delle Monache et al., 2011). This method leverages historical forecasts and their corresponding observations as a training data set from which future forecasts can be made. For some future forecast, the most similar historical forecasts (analogs) are identified on a regular time basis such as once per a 3-hour window. The most similar analogs, based on a metric such as root mean square error (RMSE), are recorded and their corresponding verifying observations are used as an ensemble member for this future forecast. Prior work in this area demonstrates improvements over raw Numerical Weather Prediction (NWP) forecasts and shows skill similar to techniques such as logistic regression and machine learning (Delle Monache et al., 2013; Alessandrini et al., 2015). Here, we take the High-Resolution Rapid Refresh model (HRRR) day-ahead forecast (0-36 hours) to create a probabilistic day-ahead forecast using an analog ensemble approach. The HRRR has an hourly temporal resolution, with a spatial resolution of 3 km. The 12 UTC HRRR model run is downloaded every day for one year from August 2019 - July 2020, with the first 11 months serving as a bank of analogs from which the forecasting algorithm can create a probabilistic forecast. Once downloaded, the original HRRR forecast is temporally interpolated to 5-minutes, aligning with both the temporal resolution of the observations as well as the timescale relevant for day-ahead power forecasts. The forecast is validated at the M2 tower at the Flatirons Campus of the National Renewable Energy Laboratory (NREL) at a typical wind turbine height of 80 m. Variables such as wind speed, wind direction, and turbulence intensity are incorporated into the probabilistic forecast model and weighted according to their relative importance to the forecast. Based on metrics such as mean bias error (MBE), mean absolute error (MAE), and root mean square error, the analog ensemble forecast outperforms the raw HRRR forecast during the testing period of July 2020. Figure 1 illustrates an example day-ahead forecast compared against the verifying observations. The general variability and ramps are captured throughout the day, with potential to further improve the analog ensemble model through machine learning techniques.

numerical weather prediction↗
DOE OSTI2026

TEM Approaches for Microstructure-Informed Prediction of Mechanical Properties in Structural Alloys

Predicting the mechanical performance of structural alloys from their evolving microstructure remains a major challenge in materials science, particularly for nuclear structural materials, where irradiation-induced defects span multiple types and length scales and interact through complex mechanisms. The dispersed barrier hardening (DBH) [1] and Friedel–Kroupa–Hirsch (FKH) [2,3] models have been widely used to evaluate the hardening contributions of individual obstacles and to estimate tensile strength from quantified microstructures; however, when multiple size-dependent obstacles coexist and evolve, predicting temperature-dependent tensile strength becomes significantly more complex, and a fully consistent hardening model is still lacking. Transmission electron microscopy (TEM) plays a central role in refining hardening models and enabling predictive assessments of tensile strength evolution by providing quantitative characterization of dislocations, irradiation-induced defects (e.g., dislocation loops and cavities), precipitates, and grain structure (Fig. 1.). These experimentally measured defect densities are incorporated into physically based hardening models with size- and shape- dependent obstacle strengths [4], using root-sum-square superposition for obstacles of comparable strength and linear superposition for dissimilar ones [5]. In addition, recent advances in TEM [6-8], including high-resolution imaging, 4D-STEM strain mapping, EDS/EELS elemental analysis, and flash-polishing-based TEM specimen preparation and extraction-replica methods (Fig. 2), further improve the accuracy of microstructural quantification. By comparison with prior studies as well as our own results, we show that when TEM-derived microstructural information is carefully integrated with physically grounded hardening models, yield strength (or irradiation-induced hardening) measured at room temperature can be predicted with good quantitative agreement across multiple alloy classes. In-situ TEM combined with high-temperature mechanical testing represents an important next step for refining hardening models by directly probing dislocation–obstacle interactions across varying irradiation doses and temperatures [9]. Because the barrier strength factor (α) depends on both temperature and obstacle size, it should not be treated as a constant fitting parameter; rather, it must be explicitly evaluated to achieve physically meaningful predictions of mechanical behaviour at operating temperatures. This presentation therefore discusses why all strengthening contributions (e.g., Peierls stress, solid-solution strengthening, voids, bubbles, dislocation loops, dislocation lines, and grain boundaries) must be considered collectively, why appropriate superposition methods are essential when obstacles possess different barrier strength factors, how hardness measurements can be meaningfully related to tensile properties, and how TEM-derived microstructural information can be systematically incorporated into hardening models. More broadly, it outlines a pathway toward microstructure-informed prediction of mechanical properties and supports the goal of establishing science-based tools for evaluating structural materials in extreme environments [10].

Lin, Yan-Ru [ORNL] (ORCID:0000000339991473)↗
DOE OSTI2021

Influence of geometry on columnar to equiaxed transition during electron beam powder bed fusion of IN718

Correlation between spot-melt scan parameters (linear spot-density aka areal energy density), build geometry, and solidification microstructure evolution (columnar vs equiaxed) in a powder bed fusion technology is investigated. It is shown that to maintain the equiaxed solidification microstructure evolution in electron beam powder bed additive manufacturing (AM), the areal energy density per layer needs to be scaled with respect to the 2D cross-sectional area of the layer being melted. Samples with two different cross-sectional areas (40 × 40 mm and 20 × 20 mm) have been fabricated with varying areal energy densities. For a given square cross-section (20 × 20 mm), increasing the areal energy density (4.8 MJ/sq.m to 14.7 MJ/sq.m) transitioned the solidification microstructure from columnar to equiaxed. The observed microstructure data (Electron Back Scattered Diffraction - EBSD) is quantified by calculating the principal component (PC) score using a spatial statistics methodology. The sample with equiaxed grains is found to have a low PC score while the sample with columnar grain had a high PC score. A semi-analytical model is used to simulate the heat transfer and the local solidification conditions as a function of processing parameters (linear spot-density). The result from the heat transfer model is correlated with previously quantified microstructure data. Space-Time analysis of the melt pattern is done and correlated with the observed microstructure. In addition, from the findings, appropriate parameters have been used to additively manufacture a turbine blade with site-specific or hybrid solidification microstructure (traditional fabrication possible via a patented method of localized cold working and heat treatment).

36 MATERIALS SCIENCE↗
DOE OSTI2022

Analytics-at-scale of Sensor Data for Digital Monitoring in Nuclear Plants (3 rd Annual Report)

Nuclear power plants collect and store large volumes of heterogeneous data from various components and systems. With recent advances in machine learning (ML) techniques, these data can be leveraged to develop diagnostic and short-term forecasting models to better predict future equipment condition. Maintenance operations can then be planned in advance whenever degraded performance is predicted, thus resulting in fewer unplanned outages and the optimization of maintenance activities. This enables lower maintenance costs and improves the overall economics of nuclear power. This report primarily focuses on developing a short-term forecasting process that leverages a feature selection process to distill large volumes of heterogeneous data and predict specific equipment parameters. A variety of feature selection methods, including Shapley Additive Explanations (SHAP) and variance inflation factor (VIF), were used to select the optimal features as inputs for three ML methods: long short-term memory (LSTM) networks, support vector regression (SVR), and random forest (RF). Each combination of model and input features was used to predict a pump bearing temperature both 1 and 24 hours in advance, based on actual plant system data. The optimal inputs for the LSTM and SVR were selected using the SHAP values, while the optimal input for the RF consisted solely of the response variable itself. Each model produced similar 1-hour-ahead predictions, with root mean square errors (RMSEs) of roughly 0.006. For the 24-hour-ahead predictions, differences could be seen between LSTM, SVR, and RF, as reflected by model performances of 0.036 ± 0.014, 0.0026 ± 0, and 0.063 ± 0.004 RMSE, respectively. As big data and continuous online monitoring become more widely available, the proposed feature selection process can be used for many applications beyond the prediction of process parameters within nuclear infrastructure. This report summarizes the Fiscal Year 2021 research progress encompassing the (1) data cleaning and feature selection necessary for ML applications; (2) development of short-term forecasting models to predict future plant process parameters for both single and multiple time steps ahead; and (3) validation of the feature selection methods and short-term forecasting models given new data from different systems.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2025

DESI 2024 III: baryon acoustic oscillations from galaxies and quasars

We present the DESI 2024 galaxy and quasar baryon acoustic oscillations (BAO) measurements using over 5.7 million unique galaxy and quasar redshifts in the range 0.1 < z < 2.1. Divided by tracer type, we utilize 300,017 galaxies from the magnitude-limited Bright Galaxy Survey with 0.1 < z < 0.4, 2,138,600 Luminous Red Galaxies with 0.4 < z < 1.1, 2,432,022 Emission Line Galaxies with 0.8 < z < 1.6, and 856,652 quasars with 0.8 < z < 2.1, over a ∼ 7,500 square degree footprint. The analysis was blinded at the catalog-level to avoid confirmation bias. All fiducial choices of the BAO fitting and reconstruction methodology, as well as the size of the systematic errors, were determined on the basis of the tests with mock catalogs and the blinded data catalogs. We present several improvements to the BAO analysis pipeline, including enhancing the BAO fitting and reconstruction methods in a more physically-motivated direction, and also present results using combinations of tracers. We employ a unified BAO analysis method across all tracers. We present a re-analysis of SDSS BOSS and eBOSS results applying the improved DESI methodology and find scatter consistent with the level of the quoted SDSS theoretical systematic uncertainties. With the total effective survey volume of ∼ 18 Gpc3, the combined precision of the BAO measurements across the six different redshift bins is ∼0.52%, marking a 1.2-fold improvement over the previous state-of-the-art results using only first-year data. We detect the BAO in all of these six redshift bins. The highest significance of BAO detection is 9.1σ at the effective redshift of 0.93, with a constraint of 0.86% placed on the BAO scale. We find that our observed BAO scales are systematically larger than the prediction of the Planck 2018-ΛCDM at z < 0.8. We translate the results into transverse comoving distance and radial Hubble distance measurements, which are used to constrain cosmological models in our companion paper.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Machine Learning Assisted HPC Workload Trace Generation for Leadership Scale Storage Systems

Monitoring and analyzing a wide range of I/O activities in an HPC cluster is important in maintaining mission-critical performance in a large-scale, multi-user, parallel storage system. Center-wide I/O traces can provide high-level information and fine-grained activities per application or per user running in the system. Studying such large-scale traces can provide helpful insights into the system. It can be used to develop predictive methods for making predictive decisions, adjusting scheduling policies, or providing decisions for the design of next-generation systems. However, sharing real-world I/O traces to expedite such research efforts leaves a few concerns; i) the cost of sharing the large traces is expensive due to this large size, and ii) privacy concern is an issue.We address such issues by building an end-to-end machine learn- ing (ML) workflow that can generate I/O traces for large-scale HPC applications. We leverage ML based feature selection and gener- ative models for I/O trace generation. The generative models are trained on I/O traces collected by the darshan I/O characterization tool over a period of one year. We present a two-step generation process consisting of two deep-learning models, called the feature generator and the trace generator. The combination of two-step generative models provides robustness by reducing the bias of the model and accounting for the stochastic nature of the I/O traces across different runs of an application. We evaluate the performance of the generative models and show that the two-step model can generate time-series I/O traces with less than 20% root mean square error.

Paul, Arnab↗
DOE OSTI2023

Skyrme-Hartree-Fock-Bogoliubov mass models on a 3D mesh: III. From atomic nuclei to neutron stars

Here, we present BSkG3, the latest entry in the Brussels-Skyrme-on-a-grid series of large-scale models of nuclear structure based on an energy density functional. Compared to its predecessors, the new model offers a more realistic description of nucleonic matter at the extreme densities relevant to neutron stars. This achievement is made possible by incorporating a constraint on the infinite nuclear matter properties at high densities in the parameter adjustment, ensuring in this way that the predictions of BSkG3 for the nuclear Equation of State are compatible with the observational evidence for heavy pulsars with M > 2M ⊙ . Instead of the usual phenomenological pairing terms, we also employ a more microscopically founded treatment of nucleon pairing, resulting in extrapolations to high densities that are in line with the predictions of advanced many-body methods and are hence more suited to the study of superfluidity in neutron stars. By adopting an extended form of the Skyrme functional, we are able to reconcile the description of matter at high densities and at saturation density: the new model further refines the description of atomic nuclei offered by its predecessors. A qualitative improvement is our inclusion of ground state reflection asymmetry, in addition to the spontaneous breaking of rotational, axial, and time-reversal symmetry. Quantitatively, the model offers lowered root-mean-square deviations on 2457 masses (0.631 MeV), 810 charge radii (0.0237 fm) and an unmatched accuracy with respect to 45 primary fission barriers of actinide nuclei (0.33 MeV). Reconciling the complexity of neutron stars with those of atomic nuclei establishes BSkG3 as a tool of choice for applications to nuclear structure, the nuclear equation of state and nuclear astrophysics in general.

Physics↗
DOE OSTI2021

Numerical solution of singular Lyapunov equations

We consider the numerical solution of large scale singular (continuous-time) Lyapunov equations of the form AX + XA T + BB T = 0, where A is semistable, that is, its spectrum is contained in the left half plane, with the exception of a few semisimple eigenvalues at zero. We also consider the case of a few semisimple eigenvalues on the imaginary axis. We assume that we know these few eigenvalues (zero or imaginary), and that we have or can compute the corresponding invariant subspaces. We use this information to build an appropriate newly proposed subspace on which to project the Lyapunov equations, and then compute a low-rank approximation to the least squares solution. Selected illustrative numerical examples are provided.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Gradient Coding With Iterative Block Leverage Score Sampling

Gradient coding is a method for mitigating straggling servers in a centralized computing network that uses erasure-coding techniques to distributively carry out first-order optimization methods. Randomized numerical linear algebra uses randomization to develop improved algorithms for large-scale linear algebra computations. In this study, we propose a method for distributed optimization that combines gradient coding and randomized numerical linear algebra. The proposed method uses a randomized ℓ 2 -subspace embedding and a gradient coding technique to distribute blocks of data to the computational nodes of a centralized network, and at each iteration the central server only requires a small number of computations to obtain the steepest descent update. The novelty of our approach is that the data is replicated according to importance scores, called block leverage scores, in contrast to most gradient coding approaches that uniformly replicate the data blocks. Furthermore, we do not require a decoding step at each iteration, avoiding a bottleneck in previous gradient coding schemes. We show that our approach results in a valid ℓ 2 -subspace embedding, and that our resulting approximation converges to the optimal solution.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Deep learning to estimate permeability using geophysical data

Time-lapse electrical resistivity tomography (ERT) is a popular geophysical method to estimate three-dimensional (3D) permeability fields from electrical potential difference measurements. Traditional inversion and data assimilation methods are used to ingest this ERT data into hydrogeophysical models to estimate permeability. Due to ill-posedness and the curse of dimensionality, existing inversion strategies provide poor estimates and low resolution of the 3D permeability field. Recent advances in deep learning provide us with powerful algorithms to overcome this challenge. This paper presents a deep learning (DL) framework to estimate the 3D subsurface permeability from time-lapse ERT data. To test the feasibility of the proposed framework, we train DL-enabled inverse models on simulation data. Each measurement in both synthetic and field data is standardized by removing the mean and scaling the time-series to unit variance. This pre-processing step is necessary to bring simulation data closer to field observations. Subsurface process models based on hydrogeophysics are used to generate this synthetic data. Training performed on limited simulation data resulted in the DL model over-fitting. An advanced data augmentation based on mixup is implemented to generate additional training samples to overcome this issue. This mixup technique creates weakly labeled (low-fidelity) samples from strongly labeled (high-fidelity) data. The weakly labeled training data is then used to develop DL-enabled inverse models and reduce over-fitting. As both time-lapse ERT (1133048 features/realization) and 3D permeability (585453 features/realization) data samples are from a high-dimensional space, principal component analysis (PCA) is employed to reduce dimensionality. Encoded ERT and encoded permeability are generated using the trained PCA estimators. A deep neural network is then trained to map the encoded ERT to encoded permeability. This mixup training and unsupervised learning allowed us to build a fast and reasonably accurate DL-based inverse model under limited simulation data. Results show that proposed weak supervised learning can capture salient spatial features in the 3D permeability field. Quantitatively, the average mean squared error (in terms of the natural log) on the strongly labeled training, validation, and test datasets is less than 0.5. The R 2 -score (global metric) is greater than 0.75, and the percent error in each cell (local metric) is less than 10%. Finally, an added benefit in terms of computational cost is that the proposed DL-based inverse model is at least O(10 4 ) times faster than running a forward model once it is trained. Data generation, DL model training, and hyperparameter tuning to identify optimal neural network architectures utilized high-performance computing resources while the DL inference is performed on a standard laptop. Approximately, O(10 5 ) processor hours are used for generating data and DL tuning and training. We acknowledge that the data generation and DL model development are expensive. But once a DL model is trained, it can be re-used for inversion rapidly for the given system, with set physics and domain. Note that traditional inversion may require multiple forward model simulations (e.g., in the order of 10 to 1000), which are very expensive. This computational savings ≈ O(10 5 ) – O(10 7 )) makes the proposed DL-based inverse model attractive for subsurface imaging and real-time ERT monitoring applications due to fast and yet reasonably accurate estimations of permeability field.

58 GEOSCIENCES↗
DOE OSTI2020

Explicitly correlated coupled cluster method for accurate treatment of open-shell molecules with hundreds of atoms

We present a near-linear scaling formulation of the explicitly correlated coupled-cluster singles and doubles with the perturbative triples method [CCSD(T)F12¯] for high-spin states of open-shell species. The approach is based on the conventional open-shell CCSD formalism [M. Saitow et al., J. Chem. Phys. 146, 164105 (2017)] utilizing the domain local pair-natural orbitals (DLPNO) framework. The use of spin-independent set of pair-natural orbitals ensures exact agreement with the closed-shell formalism reported previously, with only marginally impact on the cost (e.g., the open-shell formalism is only 1.5 times slower than the closed-shell counterpart for the C160H322 n-alkane, with the measured size complexity of ≈1.2). Evaluation of coupled-cluster energies near the complete-basis-set (CBS) limit for open-shell systems with more than 550 atoms and 5000 basis functions is feasible on a single multi-core computer in less than 3 days. The aug-cc-pVTZ DLPNO-CCSD(T)F12¯ contribution to the heat of formation for the 50 largest molecules among the 348 core combustion species benchmark set [J. Klippenstein et al., J. Phys. Chem. A 121, 6580–6602 (2017)] had root-mean-square deviation (RMSD) from the extrapolated CBS CCSD(T) reference values of 0.3 kcal/mol. For a more challenging set of 50 reactions involving small closed- and open-shell molecules [G. Knizia et al., J. Chem. Phys. 130, 054104 (2009)], the aug-cc-pVQ(+d)Z DLPNO-CCSD(T)F12¯ yielded a RMSD of ∼0.4 kcal/mol with respect to the CBS CCSD(T) estimate.

Kumar, Ashutosh (ORCID:0000000175896030)↗
DOE OSTI2021

From hard spheres to hard-core spins

A system of hard spheres exhibits physics that is controlled only by their density. This comes about because the interaction energy is either infinite or zero, so all allowed configurations have exactly the same energy. The low-density phase is liquid, while the high-density phase is crystalline, an example of “order by disorder” as it is driven purely by entropic considerations. Here we study a family of hard spin models, which we call hard-core spin models, where we replace the translational degrees of freedom of hard spheres with the orientational degrees of freedom of lattice spins. Their hard-core interaction serves analogously to divide configurations of the many spin system into allowed and disallowed sectors. We present detailed results on the square lattice in d = 2 for a set of models with $\mathbb{Z}_n$ symmetry, which generalize Potts models, and their U(1) limits, for ferromagnetic and antiferromagnetic senses of the interaction, which we refer to as exclusion and inclusion models. As the exclusion and inclusion angles are varied, we find a Kosterlitz-Thouless phase transition between a disordered phase and an ordered phase with quasi-long-ranged order, which is the form order by disorder takes in these systems. These results follow from a set of height representations, an ergodic cluster algorithm, and transfer matrix calculations.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2024

LSTM-Based Data Integration to Improve Snow Water Equivalent Prediction and Diagnose Error Sources

Accurate prediction of snow water equivalent (SWE) can be valuable for water resource managers. Recently, deep learning methods such as long short-term memory (LSTM) have exhibited high accuracy in simulating hydrologic variables and can integrate lagged observations to improve prediction, but their benefits were not clear for SWE simulations. Here we tested an LSTM network with data integration (DI) for SWE in the western United States to integrate 30-day-lagged or 7-day-lagged observations of either SWE or satellite-observed snow cover fraction (SCF) to improve future predictions. SCF proved beneficial only for shallow-snow sites during snowmelt, while lagged SWE integration significantly improved prediction accuracy for both shallow- and deep-snow sites. The median Nash–Sutcliffe model efficiency coefficient (NSE) in temporal testing improved from 0.92 to 0.97 with 30-day-lagged SWE integration, and root-mean-square error (RMSE) and the difference between estimated and observed peak SWE values d max were reduced by 41% and 57%, respectively. DI effectively mitigated accumulated model and forcing errors that would otherwise be persistent. Moreover, by applying DI to different observations (30-day-lagged, 7-day-lagged), we revealed the spatial distribution of errors with different persistent lengths. For example, integrating 30-day-lagged SWE was ineffective for ephemeral snow sites in the southwestern United States, but significantly reduced monthly-scale biases for regions with stable seasonal snowpack such as high-elevation sites in California. These biases are likely attributable to large interannual variability in snowfall or site-specific snow redistribution patterns that can accumulate to impactful levels over time for nonephemeral sites. These results set up benchmark levels and provide guidance for future model improvement strategies.

54 ENVIRONMENTAL SCIENCES↗