Enabling Nonlinear Manifold Projection Reduced-Order Models by Extending Convolutional Neural Networks to Unstructured Data.
Abstract not provided.
Tencer, John↗
SEARCH · Search NASA
Results for “data ordering”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Flow Ordering and Hierarchical Bottleneck Identification for High-Speed Data Networks - Phase II Final Report
Explore the source record for details and available documents.
97 MATHEMATICS AND COMPUTING↗
Data-scarce surrogate modeling of shock-induced pore collapse process
Understanding the mechanisms of shock-induced pore collapse is of great interest in various disciplines in sciences and engineering, including materials science, biological sciences, and geophysics. However, numerical modeling of the complex pore collapse processes can be costly. To this end, a strong need exists to develop surrogate models for generating economic predictions of pore collapse processes. Here, in this work, we study the use of a data-driven reduced-order model, namely dynamic mode decomposition, and a deep generative model, namely conditional generative adversarial networks, to resemble the numerical simulations of the pore collapse process at representative training shock pressures. Since the simulations are expensive, the training data are scarce, which makes training an accurate surrogate model challenging. To overcome the difficulties posed by the complex physics phenomena, we make several crucial treatments to the plain original form of the methods to increase the capability of approximating and predicting the dynamics. In particular, physics information is used as indicators or conditional inputs to guide the prediction. In realizing these methods, the training of each dynamic mode composition model takes only around 30 s on CPU. In contrast, training a generative adversarial network model takes 8 h on GPU. Moreover, using dynamic mode decomposition, the final-time relative error is around 0.3% in the reproductive cases. We also demonstrate the predictive power of the methods at unseen testing shock pressures, where the error ranges from 1.3 to 5% in the interpolatory cases and 8 to 9% in extrapolatory cases.
97 MATHEMATICS AND COMPUTING↗
Stem psychrometer and flux data from US-CdM
Cleaned midday and predawn water potential data from 14 stem psychrometers installed within the footprint of the US-CdM flux tower, from May-October 2021. These data were collected in order to link environmental drivers, vegetation responses to seasonal water stress, and ecosystem fluxes of carbon and water at a pinyon-juniper woodland in southeastern Utah.Data include a comma separated values file containing all water potential data used in the published paper. Data were first published in Kannenberg et al. 2023 Agricultural and Forest Meteorology (doi: 10.1016/j.agrformet.2022.109269). Flux data are publicly available from the AmeriFlux portal (doi: 10.17190/AMF/1865477). This data file and the AmeriFlux data are all that is necessary to replicate the analyses in Kannenberg et al. 2023 Agricultural and Forest Meteorology.
54 ENVIRONMENTAL SCIENCES↗
Evaluation of a Reduced-Order Model for IBR Fault Response Representation via OEM Blackbox Models: Preprint
Driven by the need to capture the electromagnetic transients of transmission lines, inverter switching behavior, and detailed control systems, electromagnetic transient (EMT) studies have become increasingly important in industry, such as IBR interconnection study and fault study. However, original equipment manufacturer (OEM) inverter models typically include extensive parameters and proprietary settings that are unavailable to protection engineers. This paper introduces a data-driven, reduced-order model (ROM) developed as a PSCAD library component for use in EMT-based fault studies. The ROM replicates key OEM model behaviors without requiring detailed knowledge of control design or parameterization. The accompanying Python automation scripts streamline data generation, parameter fitting, and validation. The ROM's performance is demonstrated through comparison with both IEEE 2800-compliant and non-compliant OEM models in a real-world power system. Relay responses show nearly identical results, while simulation runtime is reduced by an average of 32.8\%, highlighting the ROM's practicality for protection engineers.
14 SOLAR ENERGY↗
Disentangling Coexisting Structural Order Through Phase Lock-In Analysis of Atomic-Resolution STEM Data
As a real-space technique, atomic-resolution STEM imaging contains both amplitude and geometric phase information about structural order in materials, with the latter encoding important information about local variations and heterogeneities present in crystalline lattices. Such phase information can be extracted using geometric phase analysis (GPA), a method which has generally focused on spatially mapping elastic strain. Here we demonstrate an alternative phase demodulation technique and its application to reveal complex structural phenomena in correlated quantum materials. As with other methods of image phase analysis, the phase lock-in approach can be implemented to extract detailed information about structural order and disorder, including dislocations and compound defects in crystals. Extending the application of this phase analysis to Fourier components that encode periodic modulations of the crystalline lattice, such as superlattice or secondary frequency peaks, we extract the behavior of multiple distinct order parameters within the same image, yielding insights into not only the crystalline heterogeneity but also subtle emergent order parameters such as antipolar displacements. When applied to atomic-resolution images spanning large (~0.5 × 0.5 μm 2 ) fields of view, this approach enables vivid visualizations of the spatial interplay between various structural orders in novel materials.
74 ATOMIC AND MOLECULAR PHYSICS↗
Probabilistic neural networks for fluid flow surrogate modeling and data recovery
We consider the use of probabilistic neural networks for fluid flow surrogate modeling and data recovery. This framework is constructed by assuming that the target variables are sampled from a Gaussian distribution conditioned on the inputs. Consequently, the overall formulation sets up a procedure to predict the hyperparameters of this distribution which are then used to compute an objective function given training data. We demonstrate that this framework has the ability to provide for prediction confidence intervals based on the assumption of a probabilistic posterior, given an appropriate model architecture and adequate training data. The applicability of the present framework to cases with noisy measurements and limited observations is also assessed. To demonstrate the capabilities of this framework, we consider canonical regression problems of fluid dynamics from the viewpoint of reduced-order modeling and spatial data recovery for four canonical data sets. The examples considered in this study arise from (i) the shallow-water equations, (ii) a two-dimensional cylinder flow, (iii) the wake of a NACA0012 airfoil with a Gurney flap, and (iv) the NOAA sea surface temperature data set. Furthermore, the present results indicate that the probabilistic neural network not only produces a machine-learning-based fluid flow surrogate model but also systematically quantifies the uncertainty therein to assist with model interpretability.
42 ENGINEERING↗
Models and Strategies for Optimal Demand Side Management in the Chemical Industries
Deregulation and the increase of renewable electricity generation from wind and solar photovoltaics have transformed the U.S. electricity market. Economic and environmental benefits notwithstanding, the presence of renewables has increased variability and uncertainty on the supply side of the grid. Managing demand, rather than generation – a strategy referred to as “demand response (DR)” – is an attractive approach for mitigating this imbalance. DR efforts aim to reduce electricity usage during peak demand times, lessening stress on the grid. Industrial users are particularly attractive entities for DR participation since they present large, localized loads that can provide significant relief on grid demand and –unlike other large loads, such as buildings – are minimally dependent on human needs and preferences. In this project, we accomplished three main objectives. (1) We developed data-driven low-order DR scheduling-relevant dynamic models of chemical processes. Concurrently, we studied the formulation and solution of the associated optimal DR production scheduling problems. (a) A prototype air separation unit (ASU) model was used to generate simulated operating data for initial modeling efforts, which enabled the later use of industrial data for data-driven modeling. (b) We utilized Hammerstein-Wiener (HW) and Finite Step Response (FSR) models to represent nonlinear plant dynamics. (c) The HW models were linearized using exact linearization so they could potentially be embedded in power system models, which are formulated as mixed integer linear programs (MILPs). (d) We solved DR optimization problems under uncertainty and found that even naïve predictions of electricity price and product demand led to significant cost savings benefits. (2) Our DR scheduling optimization problem formulations are amenable to real-time solution. (a) We utilized Lagrangian Relaxation (LR) to efficiently solve the optimization problem by decoupling subproblems linked by complicating constraints. (b) We have achieved computation times for the 3-day DR scheduling problem of an ASU as low as 1.88 minutes. (3) Our representations of the DR behavior of chemical process as grid-level batteries were embedded in power system models. (a) For a small-scale grid, we found that incorporating the dynamics of the chemical plant in the optimal power flow calculations resulted in better resource management leading to up to 15% and 46% cost reduction for the grid and chemical plant operations, respectively, during periods of power line congestion. We have published several works dedicated to modeling and solving DR optimization problems from the user side. These were published in top peer-reviewed journals and are summarized in this report. The most recent work (and papers in preparation) considers DR scheduling from the grid side. Future efforts will consider networked plants (e.g., air separation units operating on a common pipeline) for DR participation, which is expected to amplify the capabilities of industrial DR participants to perform load-shifting. Our consideration of uncertainty in DR has inspired future directions in this area as well: we plan to develop multistage methods to fully account for the effects of uncertainty in DR scheduling.
24 POWER TRANSMISSION AND DISTRIBUTION↗
Model fusion with physics-guided machine learning: Projection-based reduced-order modeling
The unprecedented amount of data generated from experiments, field observations, and large-scale numerical simulations at a wide range of spatiotemporal scales has enabled the rapid advancement of data-driven and especially deep learning models in the field of fluid mechanics. Although these methods are proven successful for many applications, there is a grand challenge of improving their generalizability. This is particularly essential when data-driven models are employed within outer-loop applications like optimization. In this work, we put forth a physics-guided machine learning (PGML) framework that leverages the interpretable physics-based model with a deep learning model. Leveraging a concatenated neural network design from multi-modal data sources, the PGML framework is capable of enhancing the generalizability of data-driven models and effectively protects against or inform about the inaccurate predictions resulting from extrapolation. We apply the PGML framework as a novel model fusion approach combining the physics-based Galerkin projection model and long- to short-term memory (LSTM) network for parametric model order reduction of fluid flows. We demonstrate the improved generalizability of the PGML framework against a purely data-driven approach through the injection of physics features into intermediate LSTM layers. Our quantitative analysis shows that the overall model uncertainty can be reduced through the PGML approach, especially for test data coming from a distribution different than the training data. Moreover, we demonstrate that our approach can be used as an inverse diagnostic tool providing a confidence score associated with models and observations. The proposed framework also allows for multi-fidelity computing by making use of low-fidelity models in the online deployment of quantified data-driven models.
42 ENGINEERING↗
2017 Meander C and O floodplain groundwater chemistry from the East River, Colorado
This dataset includes groundwater geochemistry data from floodplain piezometers collected as a part of the Watershed Function Scientific Focus Area (SFA) located in the Upper Colorado River Basin. The data were collected in order to investigate the role of hyporheic exchange and other river corridor processes on riverine export of solutes. Floodplain piezometers in the Pumphouse vicinity (Meander C: MCP, MCB; Meander O: MOP) were sampled on daily to weekly time scales during summer-fall 2017. Data includes in-field measurements (pH, electrical conductivity [EC], oxidation reduction potential [ORP], dissolved oxygen [DO], Fe(II), and groundwater level) along with laboratory measurements (dissolved inorganic carbon [DIC], dissolved organic carbon [DOC], metals and major cations, anions [chloride, sulfate, nitrate], and dissolved ammonium). The chemistry data is contained in a csv file, sampling protocol in a pdf document, and sample locations in both a kmz file which can be opened in Google Earth and a csv file.
54 ENVIRONMENTAL SCIENCES↗
2016 Floodplain Geochemistry from the East River Watershed, Colorado
This dataset includes groundwater geochemistry data from floodplain piezometers collected as a part of the Watershed Function Scientific Focus Area (SFA) located in the Upper Colorado River Basin. The data were collected in order to investigate the role of hyporheic exchange and other river corridor processes on riverine export of solutes. Floodplain piezometers installed in several meanders (Meander C, Meander D, and Meander O) in the vicinity of the Pumphouse were sampled at several dates in 2016. Data includes in-field measurements (pH, electrical conductivity, oxidation reduction potential, dissolved oxygen, dissolved Fe(II), dissolved sulfide, and groundwater level) along with laboratory measurements (dissolved inorganic carbon, dissolved organic carbon, metals and major cations). Five files are included in this dataset, including: sample locations and depths in a csv file (metadata.csv), aqueous geochemistry data in a csv file, analytical detection limits in a csv file, a file-level metadata (flmd.csv) file, and a data dictionary (dd.csv) file. Data that was below the detection limit is reported as one half of the detection limit and missing data is listed as "-9999".
54 ENVIRONMENTAL SCIENCES↗
Characterization data of an (AlFeNiTiVZr) 1-x Cr x multi-principal element alloy continuous composition spread library
The data provided in this article is related to the research article entitled “Phase stabilization and oxidation of a continuous composition spread multi-principal element (AlFeNiTiVZr) 1-x Cr x alloy”. This data article describes the high-throughput synthesis and characterization processes of an (AlFeNiTiVZr) 1-x Cr x alloy system. Continuous composition spread (CCS) thin-film libraries were synthesized by co-depositing an AlFeNiTiVZr metal alloy target and Cr target via magnetron sputtering. Post-processing was performed on the sample libraries with a vacuum anneal at 873 K and an air anneal at 873 K. Compositional data was determined via WDS in order to verify parameters provided by an in-house sputter model. Crystallographic data was captured via synchrotron diffraction and diffractograms were compared as a function of the change in Cr concentration. These measurements were taken in order to observe phase behavior after oxidation throughout the composition library. Furthermore, vibrational spectrographic data is provided of the oxidized library to show surface speciation along the composition gradient of the alloy system. The structural and oxidative behavior of the (AlFeNiTiVZr) 1-x Cr x alloy can be analysed using the data provided in this article. Additionally, this characterization dataset can be utilized in machine learning algorithms for determining important features and parameters for future hypothesis generation of functional multi-principal element alloys (MPEAs).
36 MATERIALS SCIENCE↗
Sensor Anomaly Detection for Nuclear Reactor Systems Utilizing Linear Regression and K-Means Unsupervised Machine Learning
Nuclear reactors and related systems are becoming increasingly complex due to advancing technologies in next-generation power reactors. This increased complexity necessitates enhanced automation and data management capabilities. To successfully realize autonomous systems, methods must be developed to handle vast volumes of data and effectively distinguish anomalous data from noise and expected data. While impressive models utilizing digital twins and similar approaches are under development, here we propose a simplified model for analyzing fundamental methods and techniques. Initially, we created a general dataset by using initial data from PCTRAN in order to represent ideal steady-state conditions. We then inserted anomalies based on prevalent sensor anomaly types (e.g., point anomalies, linear drift, and downward deviations), along with unusual anomalies such as exponential drift and upward deviations. To detect anomalies, we developed a program that employs data partitioning and linear regression to preprocess and filter the anomalous data. A K-Means machine learning (ML) method was then applied to separate and count the data within the anomalous partition. The results from all datasets—apart from exponential growth—demonstrated positive outcomes, with each returning multiple instances of greaterthan-95% accuracy. We conducted further investigations using Idaho National Laboratory’s RAVEN software to perform a sensitivity analysis on the input variables (R 2 Tolerance, Slope Tolerance, and Window Size) and found that the output variables (Accuracy and Time) were most sensitive to the Window Size. Despite the promising results published, further development is required to effectively apply these methods to nuclear systems. Nevertheless, the strengths of this approach are evident and hold promise for future applications in the field.
21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
Discussion on “Saving Storage in Climate Ensembles: A Model-Based Stochastic Approach”
Abstract We thank the authors for this interesting paper that highlights important ideas and concepts for the future of climate model ensembles and their storage, as well as future uses of stochastic emulators. Stochastic emulators are particularly relevant because of the statistical nature of climate model ensembles, as discussed in previous work of the authors (Castruccio et al. in J Clim 32:8511–8522, 2019; Hu and Castruccio in J Clim 34:8409–8418, 2021). We thank the authors for sharing of some of their data with us in order to illustrate this discussion. In the following, in Sect. 1 we discuss alternative techniques currently used and studied, namely lossy compression and ideas emerging from the climate modeling community, that could feed the discussion on ensemble and storage. In that section, we also present numerical results of compression performed on the data shared by the authors. In Sect. 2, we discuss the current statistical model proposed by the authors and its context. We discuss other potential uses of stochastic emulators in climate and Earth modeling.
97 MATHEMATICS AND COMPUTING↗
Towards Online Machine Learning in DUNE Data Acquisition
Processing the large volumes of data produced by liquid argon time projection chamber (LArTPC) experiments presents a significant challenge, especially those at the scale of DUNE. This is a particular challenge when aiming to trigger on low-energy neutrinos from core-collapse supernovae, which are typically buried in a high-rate radiological background. To enable real-time event selection suitable for such rare signals, we are developing machine learning based data filtering methods. In order to demonstrate the feasibility of this approach, we implemented such pipeline using the ICEBERG detector at Fermilab as a small-scale LArTPC, with a focus on identifying Michel electrons as a proxy for low-energy neutrino interactions. This poster will present the current status of integrating these machine learning models into the data acquisition (DAQ) system of this detector.
Dalager, Olivia [Fermilab]↗
2018 Meander C floodplain groundwater chemistry from the East River Watershed, Colorado
This dataset includes groundwater geochemistry data from floodplain piezometers collected as a part of the Watershed Function Scientific Focus Area (SFA) located in the Upper Colorado River Basin. The data were collected in order to investigate the role of hyporheic exchange and other river corridor processes on riverine export of solutes. Floodplain piezometers installed along two transects across Meander C in the Pumphouse vicinity (MCP and MCB wells) were sampled on daily to weekly time scales during summer-fall 2018. Some river water grab samples are also included. Data includes in-field measurements (pH, electrical conductivity [EC], oxidation reduction potential [ORP], dissolved oxygen [DO], Fe(II), and groundwater level) along with laboratory measurements (dissolved inorganic carbon [DIC], dissolved organic carbon [DOC], metals and major cations, anions [chloride, sulfate, nitrate], and dissolved ammonium). Five files are included in this dataset, including: sample locations and depths in both a kmz file which can be opened in Google Earth and a csv file, sampling protocol as a pdf document, aqueous geochemistry data in a csv file, and analytical detection limits in a csv file.
54 ENVIRONMENTAL SCIENCES↗
Analysis techniques for blob properties from gas puff imaging data
Filamentary structures, also known as blobs, are a prominent feature of turbulence and transport at the edge of magnetically confined plasmas. They cause cross-field particle and energy transport and are, therefore, of interest in tokamak physics and, more generally, nuclear fusion research. Several experimental techniques have been developed to study their properties. Among these, measurements are routinely performed with stationary probes, passive imaging, and, in more recent years, Gas Puff Imaging (GPI). In this work, we present different analysis techniques developed and used on 2D data from the suite of GPI diagnostics in the Tokamak à Configuration Variable, featuring different temporal and spatial resolutions. Although specifically developed to be used on GPI data, these techniques can be employed to analyze 2D turbulence data presenting intermittent, coherent structures. We focus on size, velocity, and appearance frequency evaluation with, among other methods, conditional averaging sampling, individual structure tracking, and a recently developed machine learning algorithm. We describe in detail the implementation of these techniques, compare them against each other, and comment on the scenarios to which these techniques are best applied and on the requirements that the data must fulfill in order to yield meaningful results.
70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
Dynamic scaling of order parameter fluctuations in model B
Brookhaven National Laboratory has performed a dedicated set of experiments, called the Beam Energy Scan (BES), with the goal of location a possible critical point in the phase diagram of nuclear matter, This point is analogous to the endpoint of the liquid-gas phase transition in water, where the liquid phase corresponds to a phase of hadrons, and the gas phase to a plasma of quarks and gluons. In order to describe the data generated by these experiments we have studied numerical simulations of the stochastic diffusion equation with a conserved charge. Here, we focus on the dynamics in the vicinity of a critical point in the Ising universality class. The model we consider is expected to describe the critical dynamics near a possible QCD critical point if the coupling of the order parameter to the momentum density of the fluid can be neglected. The simulations are performed on a spatial lattice, and the time evolution is performed using a Metropolis algorithm. We determine the dynamical critical exponent z ≃ 3.972(2), which agrees with predictions of the epsilon expansion. We also study non-equilibrium sweeps of the reduced temperature and observe approximate Kibble-Zurek scaling.
73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗