Search NASA⌕ Search

SEARCH · Search NASA

Results for “data driven model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 595 records · Page 33

Machine learning-based surrogate modeling for data-driven optimization: a comparison of subset selection for regression techniques

Optimization of simulation-based or data-driven systems is a challenging task, which has attracted significant attention in the recent literature. A very efficient approach for optimizing systems without analytical expressions is through fitting surrogate models. Due to their increased flexibility, nonlinear interpolating functions, such as radial basis functions and Kriging, have been predominantly used as surrogates for data-driven optimization; however, these methods lead to complex nonconvex formulations. Alternatively, commonly used regression-based surrogates lead to simpler formulations, but they are less flexible and inaccurate if the form is not known a priori. In this work, we investigate the efficiency of subset selection regression techniques for developing surrogate functions that balance both accuracy and complexity. Subset selection creates sparse regression models by selecting only a subset of original features, which are linearly combined to generate a diverse set of surrogate models. Five different subset selection techniques are compared with commonly used nonlinear interpolating surrogate functions with respect to optimization solution accuracy, computation time, sampling requirements, and model sparsity. Furthermore, our results indicate that subset selection-based regression functions exhibit promising performance when the dimensionality is low, while interpolation performs better for higher dimensional problems.

42 ENGINEERING↗

A Hybrid Framework Combining Model-Based and Data-Driven Methods for Hierarchical Decentralized Robust Dynamic State Estimation: Preprint

This paper combines model-based and data-driven methods to develop a hierarchical decentralized robust dynamic state estimator (DSE). A two-level hierarchy is proposed, where the lower level is comprised of robust model-based decentralized DSEs. The state estimates sent from the lower level are received at the upper level, where they are filtered by a robust data- driven DSE, after a principled sparse selection. This selection allows us to shrink the dimension of the problem at the upper level, and hence to speed up the computational time significantly. The proposed hybrid framework does not depend upon the centralized infrastructure of the control centers, thus it can be completely embedded into the wide-area measurement systems. This feature will ultimately facilitate the placement of hierarchical decentralized control schemes at the phasor data concentrator (PDC) locations. Also, the network model is not necessary, thus a topology processor is not required. Finally, there is no assumption on the dynamics of the electric loads. The proposed framework is tested on a 2000-bus network.

24 POWER TRANSMISSION AND DISTRIBUTION↗

A data-driven peridynamic continuum model for upscaling molecular dynamics

Nonlocal models, including peridynamics, often use integral operators that embed lengthscales in their definition. However, the integrands in these operators are difficult to define from the data that are typically available for a given physical system, such as laboratory mechanical property tests. In contrast, molecular dynamics (MD) does not require these integrands, but it suffers from computational limitations in the length and time scales it can address. To combine the strengths of both methods and to obtain a coarse-grained, homogenized continuum model that efficiently and accurately captures materials’ behavior, we propose a learning framework to extract, from MD data, an optimal Linear Peridynamic Solid (LPS) model as a surrogate for MD displacements. To maximize the accuracy of the learnt model we allow the peridynamic influence function to be partially negative, while preserving the well-posedness of the resulting model. To achieve this, we provide sufficient well-posedness conditions for discretized LPS models with sign-changing influence functions and develop a constrained optimization algorithm that minimizes the equation residual while enforcing such solvability conditions. This framework guarantees that the resulting model is mathematically well-posed, physically consistent, and that it generalizes well to settings that are different from the ones used during training. We illustrate the efficacy of the proposed approach with several numerical tests for single layer graphene. Our two-dimensional tests show the robustness of the proposed algorithm on validation data sets that include thermal noise, different domain shapes and external loadings, and discretizations substantially different from the ones used for training.

homogenization↗

Data-driven Mori–Zwanzig modeling of Lagrangian particle dynamics in turbulent flows

The dynamics of Lagrangian particles in turbulence play a crucial role in mixing, transport, and dispersion in complex flows. Their trajectories exhibit highly nontrivial statistical behavior, motivating the development of surrogate models that can reproduce these trajectories without incurring the high computational cost of direct numerical simulations of the full Eulerian field. This task is particularly challenging because reduced-order models typically lack access to the full set of interactions with the underlying turbulent field. Novel data-driven machine learning techniques can be powerful in capturing and reproducing complex statistics of the reduced-order/surrogate dynamics. In this work, we show how one can learn a surrogate dynamical system that is able to evolve a turbulent Lagrangian trajectory in a way that is point-wise accurate for short-time predictions (with respect to Kolmogorov time) and stable and statistically accurate at long times. This approach is based on the Mori–Zwanzig formalism, which prescribes a mathematical decomposition of the full dynamical system into resolved dynamics that depend on the current state and the past history of a reduced set of observables, and the unresolved orthogonal dynamics due to unresolved degrees of freedom of the initial state. We show how by training this reduced order model on a point-wise error metric on short time-prediction, we are able to correctly learn the dynamics of Lagrangian turbulence, such that also the long-time statistical behavior is stably recovered at test time. This opens up a range of applications, for example, for the control of active Lagrangian agents in turbulence.

97 MATHEMATICS AND COMPUTING↗

SeeQ: A Programming Model for Portable Data-Driven Building Applications

This paper introduces SeeQ, a programming model and an abstraction framework that facilitates the development of portable data- driven building applications. Data-driven approaches can provide insights into building operations and guide decision-making to achieve operational objectives. Yet the configuration of such applications per building requires extensive effort and tacit knowledge. In SeeQ, we propose a portable programming model and build a software system that enables self-configuration and execution across diverse buildings. The configuration of each building is captured in a unified data model - in this paper, we work with the Brick ontology without loss of generality. SeeQ focuses on the distinction between the application logic and the configuration of an application against building-specific data inputs and systems. We test the proposed approach by configuring and deploying a diverse range of applications across five heterogeneous real-world buildings. The analysis shows the potential of SeeQ to significantly reduce the efforts associated with the delivery of building analytics.

analytics↗

Development of machine learning framework for interface force closures based on bubble tracking data

Interfacial force closures in the two-fluid model play a critical role for the predictive capabilities of void fraction distribution. However, the practices of interfacial force modeling have long been challenged by the inherent physical complexity of the two-phase flows. The rapidly expanding computational capabilities in the recent years have made high-fidelity data from the interface-captured direct numerical simulation become more available, and hence potential for data-driven interfacial force modeling has prevailed. In this work, we established a data-driven modeling framework integrated to the HZDR multiphase Eulerian-Eulerian framework for computational fluid dynamics simulations. The data-driven framework is verified in a benchmark problem, where a feedforward neural network managed to capture the non-linear mapping between bubble Reynolds number and drag coefficient and reproduce the void distribution resulting from the baseline model in the test case. The second focus is on utilizing the bubble tracking data set to form a closure for the bubble drag in the turbulent bubbly flow, in which the drag coefficient is set to be correlated with the bubble Reynolds number and the Eötvös number. Pseudo-steady state filtering in the Frenet Frame was carried out to obtain the drag coefficient from the turbulent bubbly flow data. The performance of the data-driven drag model is also examined through a case study, where improvement of model’s prediction near-wall is regarded necessary. In conclusion, discussion and further plans of investigation are provided.

42 ENGINEERING↗

A data-driven approach to modeling cancer cell mechanics during microcirculatory transport

In order to understand the effect of cellular level features on the transport of circulating cancer cells in the microcirculation, there has been an increasing reliance on high-resolution in silico models. Accurate simulation of cancer cells flowing with blood cells requires resolving cellular-scale interactions in 3D, which is a significant computational undertaking warranting a cancer cell model that is both computationally efficient yet sufficiently complex to capture relevant behavior. Given that the characteristics of metastatic spread are known to depend on cancer type, it is crucial to account for mechanistic behavior representative of a specific cancer’s cells. To address this gap, in the present work we develop and validate a means by which an efficient and popular membrane model-based approach can be used to simulate deformable cancer cells and reproduce experimental data from specific cell lines. Here, cells are modeled using the immersed boundary method (IBM) within a lattice Boltzmann method (LBM) fluid solver, and the finite element method (FEM) is used to model cell membrane resistance to deformation. Through detailed comparisons with experiments, we (i) validate this model to represent cancer cells undergoing large deformation, (ii) outline a systematic approach to parameterize different cell lines to optimally fit experimental data over a range of deformations, and (iii) provide new insight into nucleated vs. non-nucleated cell models and their ability to match experiments. While many works have used the membrane-model based method employed here to model generic cancer cells, no quantitative comparisons with experiments exist in the literature for specific cell lines undergoing large deformation. Here, we describe a phenomenological, data-driven approach that can not only yield good agreement for large deformations, but explicitly detail how it can be used to represent different cancer cell lines. This model is readily incorporated into cell-resolved hemodynamic transport simulations, and thus offers significant potential to complement experiments towards providing new insights into various aspects of cancer progression.

59 BASIC BIOLOGICAL SCIENCES↗

Data and Model-Driven Decision Support for Environmental Management of a Chromium Plume at Los Alamos National Laboratory - 13264

A series of site investigations and decision-support analyses have been performed related to a chromium plume in the regional aquifer beneath the Los Alamos National Laboratory (LANL). Based on the collected data and site information, alternative conceptual and numerical models representing governing subsurface processes with different complexity and resolution have been developed. The current conceptual model is supported by multiple lines of evidence based on comprehensive analyses of the available data and modeling results. The model is applied for decision-support analyses related to estimation of contaminant- arrival locations and chromium mass flux reaching the regional aquifer, and to optimization of a site monitoring-well network. Plume characterization is a challenging and non-unique problem because multiple models and contamination scenarios are consistent with the site data and conceptual knowledge. To solve this complex problem, an advanced methodology based on model calibration and uncertainty quantification has been developed within the computational framework MADS (http://mads.lanl.gov). This work implements high-performance computing and novel, efficient and robust model analysis techniques for optimization and uncertainty quantification (ABAGUS, Squads, multi-try (multi-start) techniques), which allow for solving problems with large degrees of freedom. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Data-Driven Reduced-Order Modeling of Convective Heat Transfer in Porous Media

This work presents a data-driven Reduced-Order Model (ROM) for parametric convective heat transfer problems in porous media. The intrusive Proper Orthogonal Decomposition aided Reduced-Basis (POD-RB) technique is employed to reduce the porous medium formulation of the incompressible Reynolds-Averaged Navier–Stokes (RANS) equations coupled with heat transfer. Instead of resolving the exact flow configuration with high fidelity, the porous medium formulation solves a homogenized flow in which the fluid-structure interactions are captured via volumetric flow resistances with nonlinear, semi-empirical friction correlations. A supremizer approach is implemented for the stabilization of the reduced fluid dynamics equations. The reduced nonlinear flow resistances are treated using the Discrete Empirical Interpolation Method (DEIM), while the turbulent eddy viscosity and diffusivity are approximated by adopting a Radial Basis Function (RBF) interpolation-based approach. The proposed method is tested using a 2D numerical model of the Molten Salt Fast Reactor (MSFR), which involves the simulation of both clean and porous medium regions in the same domain. For the steady-state example, five model parameters are considered to be uncertain: the magnitude of the pumping force, the external coolant temperature, the heat transfer coefficient, the thermal expansion coefficient, and the Prandtl number. For transient scenarios, on the other hand, the coastdown-time of the pump is the only uncertain parameter. The results indicate that the POD-RB-ROMs are suitable for the reduction of similar problems. The relative L2 errors are below 3.34% for every field of interest for all cases analyzed, while the speedup factors vary between 54 (transient) and 40,000 (steady-state).

German, Péter (ORCID:0000000307285283)↗

A data-driven method for modelling dissipation rates in stratified turbulence

We present a deep probabilistic convolutional neural network (PCNN) model for predicting local values of small-scale mixing properties in stratified turbulent flows, namely the dissipation rates of turbulent kinetic energy and density variance, $\varepsilon$ and $\chi$ . Inputs to the PCNN are vertical columns of velocity and density gradients, motivated by data typically available from microstructure profilers in the ocean. The architecture is designed to enable the model to capture several characteristic features of stratified turbulence, in particular the dependence of small-scale isotropy on the buoyancy Reynolds number $Re_b:=\varepsilon /(\nu N^2)$ , where $\nu$ is the kinematic viscosity and $N$ is the background buoyancy frequency, the correlation between suitably locally averaged density gradients and turbulence intensity and the importance of capturing the tails of the probability distribution functions of values of dissipation. Empirically modified versions of commonly used isotropic models for $\varepsilon$ and $\chi$ that depend only on vertical derivatives of density and velocity are proposed based on the asymptotic regimes $Re_b\ll 1$ and $Re_b\gg 1$ , and serve as an instructive benchmark for comparison with the data-driven approach. When trained and tested on a simulation of stratified decaying turbulence which accesses a range of turbulent regimes (associated with differing values of $Re_b$ ), the PCNN outperforms assumptions of isotropy significantly as $Re_b$ decreases, and additionally demonstrates improvements over the fitted empirical models. A differential sensitivity analysis of the PCNN facilitates a comparison with the theoretical models and provides a physical interpretation of the features enabling it to make improved predictions.

42 ENGINEERING↗

Data-Driven Distribution System Load Modeling for Quasi-Static Time-Series Simulation

This paper presents a data-driven distribution system load modeling methodology targeting quasi-static time-series (QSTS) simulation. The proposed methodology is appropriate for modeling down to the level of the customer transformer, and it has three main features: 1) both load pattern diversity and intra-second load variability are considered, 2) the load profiles can be populated for multiple nodes on a circuit in such a way that the diversity factor of the feeder can be defined and tuned, and 3) the load aggregation method can be used to populate the profiles for different nodes at various load aggregation levels. Furthermore, as the foundation of the modeling methodology, variability and diversity libraries have been established based on high-resolution load data collected on customer transformers from real utility feeders. The proposed modeling methodology has been used to build load data sets for both the IEEE 123-bus feeder model and a realistic utility feeder model. The QSTS simulation results on the two evaluation feeders have demonstrated that the load data sets established from the proposed modeling methodology can effectively capture the load impact on feeder operations. For the realistic utility feeder, the effectiveness of the proposed methodology has also been validated by comparing the voltage characteristics of the feeder with modeled loads and the voltage characteristics of realistic voltage data from the same feeder.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Transferability of data-driven, many-body models for CO 2 simulations in the vapor and liquid phases

Here, extending on the previous work by Riera et al. [J. Chem. Theory Comput. 16, 2246–2257 (2020)], we introduce a second generation family of data-driven many-body MB-nrg models for CO 2 and systematically assess how the strength and anisotropy of the CO 2 –CO 2 interactions affect the models’ ability to predict vapor, liquid, and vapor–liquid equilibrium properties. Building upon the many-body expansion formalism, we construct a series of MB-nrg models by fitting one-body and two-body reference energies calculated at the coupled cluster level of theory for large monomer and dimer training sets. Advancing from the first generation models, we employ the charge model 5 scheme to determine the atomic charges and systematically scale the two-body energies to obtain more accurate descriptions of vapor, liquid, and vapor–liquid equilibrium properties. Challenges in model construction arise due to the anisotropic nature and small magnitude of the interaction energies in CO 2 , calling for the necessity of highly accurate descriptions of the multidimensional energy landscape of liquid CO 2 . These findings emphasize the key role played by the training set quality in the development of transferable, data-driven models, which, accurately representing high-dimensional many-body effects, can enable predictive computer simulations of molecular fluids across the entire phase diagram.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

A dynamic data-driven method for dealing with model structural error in soil moisture data assimilation

Attributing to the flexibility in considering various types of observation error and model error, data assimilation has been increasingly applied to dynamically improve soil moisture modeling in many hydrological practices. However, accurate characterization of model error, especially the part caused by defective model structure, presents a significant challenge to the successful implementation of data assimilation. Model structural error has received limited attention relative to parameter and input errors, mainly due to our poor understanding of structural inadequacy and the difficulties in parameterizing structural error. In this paper, we present a dynamic data-driven approach to estimate the model structural error in soil moisture data assimilation without the need for identifying error generation mechanism or specifying particular form for the error model. The error model is based on the Gaussian process regression and then integrated into the ensemble Kalman filter (EnKF) to form a hybrid method for dealing with multi-source model errors. Two variants of the hybrid method in terms of two different error correction manners are proposed. The effectiveness of the proposed method is tested through a suit of synthetic cases and a real-world case. Results demonstrate the potential of the proposed hybrid method for estimating model structural error and providing improved model predictions. Compared to the traditional EnKF without explicitly considering the model structural error, parameter compensation issue is obviously reduced and soil moisture retrieval is substantially improved.

54 ENVIRONMENTAL SCIENCES↗

Data-Driven Residential Load Modeling and Validation in GridLAB-D

Accurately characterizing the impacts of high penetrations of distributed energy resources (DER) on the electric distribution system has driven modeling methods from traditional static snap shots, often representing a critical point in time (e.g., summer peak load), to quasi-static time series (QSTS) simulations capturing all the effects of variable DER, associated controls and hence, impacts on the distribution system over a given time period. Unfortunately, the high time resolution DER source and load data required for model inputs is often scarce or non-existent. This paper presents work performed within the GridLAB-D model environment to synthesize, calibrate, and validate 1-second residential load models based on measured transformer loads and physics-based models suitable for QSTS electric distribution system modeling. The modeling and validation approach taken was to create a typical GridLAB-D model home that, when replicated to represent multiple diverse houses on a single transformer, creates a statistically similar load to a measured load for a given weather input. The model homes are constructed to represent the range of actual homes on an instrumented transformer: square footage, thermal integrity, heating and cooling system definition as well as realistic occupancy schedules. House model calibration and validation was performed using the distribution transformer load data and corresponding weather. The modeled loads were found to be similar to the measured loads for four evaluation metrics: 1) daily average energy, 2) daily average and standard deviation of power, 3) power spectral density, and 4) load shape.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Hybrid Data-Driven Physics-Based Model Framework Implementation: Towards a Secure Cyber-Physical Operation of the Smart Grid

False data injection cyber-attack detection models on smart grid operation have been much explored recently, considering analytical physics-based and data-driven solutions. Recently, a hybrid data-driven physics-based model framework for monitoring the smart grid is developed. However, the framework has not been implemented in real-time environment yet. In this paper, the framework of the hybrid model is developed within a real-time simulation environment. OPAL-RT real-time simulator is used to enable Hardware-in-the-Loop testing of the framework. IEEE 9-bus system is considered as a testing grid for gaining insight. The process of building the framework and the challenges faced during development are presented. The performance of the framework is investigated under various false data injection attacks.

false data injection attack, machine learning, sta↗

Deep Modeling: Circuit Characterization Using Theory Based Models in a Data Driven Framework

Analog computational circuits have been demonstrated to provide substantial improvements in power and speed relative to digital circuits, especially for applications requiring extreme parallelism but only modest precision. Deep machine learning is one such area and stands to benefit greatly from analog and mixed-signal implementations. However, even at modest precisions, offsets and non-linearity can degrade system performance. Furthermore, in all but the simplest systems, it is impossible to directly measure the intermediate outputs of all sub-circuits. The result is that circuit designers are unable to accurately evaluate the non-idealities of computational circuits in-situ and are therefore unable to fully utilize measurement results to improve future designs. In this paper we present a technique to use deep learning frameworks to model physical systems. Recently developed libraries like TensorFlow make it possible to use back propagation to learn parameters in the context of modeling circuit behavior. Offsets and scaling errors can be discovered even for sub-circuits that are deeply embedded in a computational system and not directly observable. The learned parameters can be used to refine simulation methods or to identify appropriate compensation strategies. We demonstrate the framework using a mixed-signal convolution operator as an example circuit.

Bolme, David S↗

Data-driven learning of nonlocal physics from high-fidelity synthetic data

A key challenge to nonlocal models is the analytical complexity of deriving them from first principles, and frequently their use is justified a posteriori. Here, we extract nonlocal models from data, circumventing these challenges and providing data-driven justification for the resulting model form. Extracting data-driven surrogates is a major challenge for machine learning (ML) approaches, due to nonlinearities and lack of convexity — it is particularly challenging to extract surrogates which are provably well-posed and numerically stable. Our scheme not only yields a convex optimization problem, but also allows extraction of nonlocal models whose kernels may be partially negative while maintaining well-posedness even in small-data regimes. To achieve this, based on established nonlocal theory, we embed in our algorithm sufficient conditions on the non-positive part of the kernel that guarantee well-posedness of the learnt operator. These conditions are imposed as inequality constraints to meet the requisite conditions of the nonlocal theory. We demonstrate this workflow for a range of applications, including reproduction of manufactured nonlocal kernels; numerical homogenization of Darcy flow associated with a heterogeneous periodic microstructure; nonlocal approximation to high-order local transport phenomena; and approximation of globally supported fractional diffusion operators by truncated kernels.

42 ENGINEERING↗