Search NASA⌕ Search

SEARCH · Search NASA

Results for “data driven model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13

HMI Data Driven Magnetohydrodynamic Model Predicted Active Region Photospheric Heating Rates: Their Scale Invariant, Flare Like Power Law Distributions, and Their Possible Association With Flares

A data driven, near photospheric, 3 D, non-force free magnetohydrodynamic model predicts time series of the complete current density, and the resistive heating rate Q at the photosphere in neutral line regions (NLRs) of 14 active regions (ARs). The model is driven by time series of the magnetic field B observed by the Helioseismic and Magnetic Imager on the Solar Dynamics Observatory (SDO) satellite. Spurious Doppler periods due to SDO orbital motion are filtered out of the time series for B in every AR pixel. Errors in B due to these periods can be significant. The number of occurrences N(q) of values of Q > or = q for each AR time series is found to be a scale invariant power law distribution, N(Q) / Q−s, above an AR dependent threshold value of Q, where 0.3952 < or = s < or = 0.5298 with mean and standard deviation of 0.4678 and 0.0454, indicating little variation between ARs. Observations show that the number of occurrences N(E) of coronal flares with a total energy released > or = E obeys the same type of distribution, N(E) / E−S, above an AR dependent threshold value of E, with 0.38 < or approx. S < or approx. 0.60, also with little variation among ARs. Within error margins the ranges of s and S are nearly identical. This strong similarity between N(Q) and N(E) suggests a fundamental connection between the process that drives coronal flares and the process that drives photospheric NLR heating rates in ARs. In addition, results suggest it is plausible that spikes in Q, several orders of magnitude above background values, are correlated with times of the subsequent occurrence of M or X flares.

Goodman, Michael L.↗

Change in terrestrial ecosystem water‐use efficiency over the last three decades

Abstract Defined as the ratio between gross primary productivity ( GPP ) and evapotranspiration ( ET ), ecosystem‐scale water‐use efficiency ( EWUE ) is an indicator of the adjustment of vegetation photosynthesis to water loss. The processes controlling EWUE are complex and reflect both a slow evolution of plants and plant communities as well as fast adjustments of ecosystem functioning to changes of limiting resources. In this study, we investigated EWUE trends from 1982 to 2008 using data‐driven models derived from satellite observations and process‐oriented carbon cycle models. Our findings suggest positive EWUE trends of 0.0056, 0.0007 and 0.0001 g C m −2 mm −1 yr −1 under the single effect of rising CO 2 (‘ CO 2 ’), climate change (‘ CLIM ’) and nitrogen deposition (‘ NDEP ’), respectively. Global patterns of EWUE trends under different scenarios suggest that (i) EWUE ‐ CO 2 shows global increases, (ii) EWUE ‐ CLIM increases in mainly high latitudes and decreases at middle and low latitudes, (iii) EWUE ‐ NDEP displays slight increasing trends except in west Siberia, eastern Europe, parts of North America and central Amazonia. The data‐driven MTE model, however, shows a slight decline of EWUE during the same period (−0.0005 g C m −2 mm −1 yr −1 ), which differs from process‐model (0.0064 g C m −2 mm −1 yr −1 ) simulations with all drivers taken into account. We attribute this discrepancy to the fact that the nonmodeled physiological effects of elevated CO 2 reducing stomatal conductance and transpiration ( TR ) in the MTE model. Partial correlation analysis between EWUE and climate drivers shows similar responses to climatic variables with the data‐driven model and the process‐oriented models across different ecosystems. Change in water‐use efficiency defined from transpiration‐based WUE t ( GPP / TR ) and inherent water‐use efficiency ( IWUE t , GPP × VPD / TR ) in response to rising CO 2 , climate change, and nitrogen deposition are also discussed. Our analyses will facilitate mechanistic understanding of the carbon–water interactions over terrestrial ecosystems under global change.

Huang, Mengtian↗

HMI Data Driven Magnetohydrodynamic Model Predicted Active Region Photospheric Heating Rates: Their Scale Invariant, Flare Like Power Law Distributions, and Their Possible Association With Flares

There are many flare forecasting models. For an excellent review and comparison of some of them see Barnes et al. (2016). All these models are successful to some degree, but there is a need for better models. We claim the most successful models explicitly or implicitly base their forecasts on various estimates of components of the photospheric current density J, based on observations of the photospheric magnetic field B. However, none of the models we are aware of compute the complete J. We seek to develop a better model based on computing the complete photospheric J. Initial results from this model are presented in this talk. We present a data driven, near photospheric, 3 D, non-force free magnetohydrodynamic (MHD) model that computes time series of the total J, and associated resistive heating rate in each pixel at the photosphere in the neutral line regions (NLRs) of 14 active regions (ARs). The model is driven by time series of B measured by the Helioseismic & Magnetic Imager (HMI) on the Solar Dynamics Observatory (SDO) satellite. Spurious Doppler periods due to SDO orbital motion are filtered out of the time series of B in every AR pixel. Errors in B due to these periods can be significant.

Goodman, Michael L.↗

Physics constrained learning for data-driven inverse modeling from sparse observations

Deep neural networks (DNN) have been used to model nonlinear relations between physical quantities. Those DNNs are embedded in physical systems described by partial differential equations (PDE) and trained by minimizing a loss function that measures the discrepancy between predictions and observations in some chosen norm. This loss function often includes the PDE constraints as a penalty term when only sparse observations are available. As a result, the PDE is only satisfied approximately by the solution. However, the penalty term typically slows down the convergence of the optimizer for stiff problems. We present a new approach that trains the embedded DNNs while numerically satisfying the PDE constraints. We develop an algorithm that enables differentiating both explicit and implicit numerical solvers in reverse-mode automatic differentiation. This allows the gradients of the DNNs and the PDE solvers to be computed in a unified framework. We demonstrate that our approach enjoys faster convergence and better stability in relatively stiff problems compared to the penalty method. Furthermore, our approach allows for the potential to solve and accelerate a wide range of data-driven inverse modeling, where the physical constraints are described by PDEs and need to be satisfied accurately.

97 MATHEMATICS AND COMPUTING↗

mphys-surrogate-model

This repository contains python scripts for building and studying reduced-order-modeling representations of droplet coalescence for eventual use in atmospheric models. The included data are generated from high-fidelity superdroplet methods and are utilized by machine learning pipelines to build data-driven models of droplet size distributions that evolve under coalescence. This repository further includes scripts to determine prediction (uncertainty) intervals on the data-driven model products based on conformal prediction.

Katona, JonasE [Lawrence Livermore National Labora↗

Sharing is caring: An extensive analysis of parameter-based transfer learning for the prediction of building thermal dynamics

In recent years deep neural networks have been proposed as a lightweight data-driven model to capture high-dimensional, nonlinear physical processes to predict building thermal responses. However, the need of a large amount of data for the training process of deep neural networks clashes with the potential limited data availability in most existing or new buildings. Transfer learning aims to enhance the performance of a target learner exploiting knowledge from related and similar environments. This study conducted a suite of experiments that leveraged 250 data-driven models based on a synthetic dataset of a building archetype to study the influence of data availability, energy efficiency level, occupancy and climate for the transfer process of thermal dynamics. The performance of the transfer learning process was compared against a classical machine learning approach. Here, the results suggest that building thermal dynamics can be effectively transferred under the same climatic conditions, increasing performance when dealing with different occupancy schedules, efficiency levels and low data availability. Furthermore, the paper compares the performance of both transfer learning and machine learning approaches in an online fashion, to support the implementation in real-world deployment.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Electronic spectra from TDDFT and machine learning in chemical space

Due to its favorable computational efficiency, time-dependent (TD) density functional theory (DFT) enables the prediction of electronic spectra in a high-throughput manner across chemical space. Its predictions, however, can be quite inaccurate. We resolve this issue with machine learning models trained on deviations of reference second-order approximate coupled-cluster (CC2) singles and doubles spectra from TDDFT counterparts, or even from DFT gap. We applied this approach to low-lying singlet-singlet vertical electronic spectra of over 20 000 synthetically feasible small organic molecules with up to eight CONF atoms. The prediction errors decay monotonously as a function of training set size. For a training set of 10 000 molecules, CC2 excitation energies can be reproduced to within ±0.1 eV for the remaining molecules. Analysis of our spectral database via chromophore counting suggests that even higher accuracies can be achieved. Based on the evidence collected, we discuss open challenges associated with data-driven modeling of high-lying spectra and transition intensities.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

ET-AL: Entropy-targeted active learning for bias mitigation in materials data

Growing materials data and data-driven informatics drastically promote the discovery and design of materials. While there are significant advancements in data-driven models, the quality of data resources is less studied despite its huge impact on model performance. In this work, we focus on data bias arising from uneven coverage of materials families in existing knowledge. Observing different diversities among crystal systems in common materials databases, we propose an information entropy-based metric for measuring this bias. To mitigate the bias, we develop an entropy-targeted active learning (ET-AL) framework, which guides the acquisition of new data to improve the diversity of underrepresented crystal systems. We demonstrate the capability of ET-AL for bias mitigation and the resulting improvement in downstream machine learning models. This approach is broadly applicable to data-driven materials discovery, including autonomous data acquisition and dataset trimming to reduce bias, as well as data-driven informatics in other scientific domains.

36 MATERIALS SCIENCE↗

Effects of Optimisation Parameters on Data-Driven Magnetofrictional Modelling of Active Regions

Context . The solar magnetic field plays an essential role in the formation, evolution, and dynamics of large-scale eruptive structures in the corona. The estimation of the coronal magnetic field, the ultimate driver of space weather, particularly in the ‘low’ and ‘middle’ corona, is presently limited due to practical difficulties. Data-driven time-dependent magnetofrictional modelling (TMFM) of active region magnetic fields has been proven to be a useful tool to study the corona. The input to the model is the photospheric electric field that is inverted from a time series of the photospheric magnetic field. Constraining the complete electric field, that is, including the non-inductive component, is critical for capturing the eruption dynamics. We present a detailed study of the effects of optimisation of the non-inductive electric field on the TMFM of AR 12473. Aims . We aim to study the effects of varying the non-inductive electric field on the data-driven coronal simulations, for two alternative parametrisations. By varying parameters controlling the strength of the non-inductive electric field, we wish to explore the changes in flux rope formation and their early evolution and other parameters, for instance, axial flux and magnetic field magnitude. Methods . We used the high temporal and spatial resolution cadence vector magnetograms from the Helioseismic and Magnetic Imager (HMI) on board the Solar Dynamics Observatory (SDO). The non-inductive electric field component in the photosphere is critical for energising and introducing twist to the coronal magnetic field, thereby allowing unstable configurations to be formed. We estimated this component using an approach based on optimising the injection of magnetic energy. Results . Our data show that flux ropes are formed in all of the simulations except for those with the lower values of these optimised parameters. However, the flux rope formation, evolution and eruption time varies depending on the values of the optimisation parameters. The flux rope is formed and has overall similar evolution and properties with a large range of non-inductive electric fields needed to determine the non-inductive electric field component that is critical for energising and introducing twist to the coronal magnetic field. Conclusions . This study shows that irrespective of non-inductive electric field values, flux ropes are formed and erupted, which indicates that data-driven TMFM can be used to estimate flux rope properties early in their evolution without needing to employ a lengthy optimisation process.

A. Kumari↗

Data-driven Thermal Model Inference with ARMAX, in Smart Environments, based on Normalized Mutual Information

Understanding the models that characterize the thermal dynamics in a smart building is important for the comfort of its occupants and for its energy optimization. Here, a significant amount of research has attempted to utilize thermodynamics (physical) models for smart building control, but these approaches remain challenging due to the stochastic nature of the intermittent environmental disturbances. This paper presents a novel data-driven approach for indoor thermal model inference, which combines an Autoregressive Moving Average with eXogenous inputs model (ARMAX) with a Normalized Mutual Information scheme (NMI). Based on this information-theoretic method, NMI, causal dependencies between the indoor temperature and exogenous inputs are explicitly obtained as a guideline for the ARMAX model to find the dominating inputs. For validation, we use three datasets based on building energy systems-against which we compare our method to an autoregressive model with exogenous inputs (ARX), a regularized ARMAX model, and state-space models.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Towards Improved Real-Time Observability of Behind-Meter PhotoVoltaic Systems: A Data-Driven Approach

The stochasticity in energy supply introduced by increased PV penetration in grid distribution systems can lead to frequent and sudden supply-demand imbalances, thereby causing voltage and frequency fluctuations. Enhanced observability, in real-time, of grid attributes such as real and reactive power flows, power injections/consumption and voltages is becoming increasingly essential to ensure smooth grid operation under these new large-scale PV integration scenarios. Two significant challenges prevent grid operators from achieving this objective: 1) Computational complexity of quasi-static timeseries simulations, and 2) Partial observability of behind-meter grid assets. In this work, we take a step towards this objective by enhancing the observability of smart inverter equipped PV systems located behind AMI meters. Smart inverters convert the DC output of PV systems into real and reactive power, the ratio of which is governed by a power factor setting. This in turn is governed by the real-time voltage at its terminal, as per a pre-set volt/var curve. While it is possible to infer the power factor setting - thereby, real and reactive power injection of the PV system - at each time interval by quasi-static time series simulations, such methods are not scalable to large grid sizes. We propose to reduce the reliance on simulations by developing a deep neural network based data-driven model which predicts the time dependent power factors of the PV systems in the grid. The model uses a small amount of simulated data to learn the dependence of power factor on 1) load and apparent PV power injection (root mean square of real and reactive power) data, and 2) AMI net-load data (for BTM PV assets). Our results show that our model can predict power factors with mean absolute error of less than 6.2% under full observability scenario and under 8.6% under the partial observability scenario. Thus, our data-driven model can reduce the amount of simulations required to compute real and reactive injections from PV systems in the distribution system with or without complete information.

14 SOLAR ENERGY↗

A simplified regression building thermal modelling method for detached two-floor house in U.S.

The residential building sector accounts for approximately 37% of total U.S. electricity consumption. Within the residential building sector, heating and cooling is the main target for peak load shifting/reduction since it is the largest contributor to peak demand. In fact, the flexibility of residential HVAC loads can provide continuous variation of demand to provide grid services by varying their demand over a baseline. The performance of HVAC load control to provide grid services relies heavily on the accuracy of indoor air temperature or cooling/heating demand predictions and therefore the quality of building model. Besides forward models, popular building models are data-driven models which can be broken down into two categories: gray-box model, e.g. Resistance-Capacitance (RC) model and black-box model. RC model, also called lumped capacitance or network model, which is constituted with electrical analogue pattern with resistance (R) and capacitance (C). In general, RC models require considerable computation burden and long periods of data to train limited number of model coefficients. Black-box models have gained increasing interest due to their capability in analyzing large-scale data and flexibility in practical applications. But, the data-mining based (machine learning algorithms/techniques based) models tend to have invisible model structures which poses a problem when trying to use the model for optimal control or model predictive control of the HVAC system. Hence, there is a continuing need for efficient online system identification techniques, which can provide explicit parameters for the model. Traditional regression models fit well for this specific purpose. This paper presents an innovative way to predict average indoor temperature in separate floors of typical detached residential house. A rolling horizon linear regression model, which includes online adaptive correction component, is proposed to predict the temperature difference between downstairs and upstairs. A RC model is used to predict the overall mean indoor air temperature. Since the adaptive algorithm needs to be implemented online, a less computation-demanding polynomial fitting algorithm is adopted. This kind of fitting problem can be cast as linear regression problem with multiple variables, parameters of which can be efficiently obtained by well-known gradient descent method.The validation is conducted by comparing the predicted results with the results from data-mining based models as well as measured data from a real typical detached two-floor house. The results show that the developed method has satisfactory performance in predicting the building indoor temperature in 1st and 2nd floors.

Cui, Borui↗

Physics-informed machine learning for building performance simulation-A review of a nascent field

Building performance simulation (BPS) is critical for understanding building dynamics and behavior, analyzing the performance of the built environment, optimizing energy efficiency, improving demand flexibility, and enhancing building resilience. However, conducting BPS is not trivial. Traditional BPS relies on accurate building energy models, which are primarily physics-based and heavily dependent on detailed building information, expert knowledge, and case-by-case model calibrations, significantly limiting their scalability. With the development of sensing technology and the increased availability of data, there is growing attention and interest in data-driven BPS. However, purely data-driven models often suffer from limited generalization ability and a lack of physical consistency, resulting in poor performance in real-world applications. To address these limitations, recent studies have begun integrating physics priors into data-driven models, a methodology known as physics-informed machine learning (PIML). PIML is an emerging field where its definitions, methodologies, evaluation criteria, application scenarios, and future directions remain open. To bridge those gaps, this study systematically reviews the state-of-the-art PIML for BPS, offering a comprehensive definition of PIML and comparing it to traditional BPS approaches regarding data requirements, modeling effort, performance, and computational cost. We also summarize the commonly used methodologies, validation approaches, application domains, available data sources, open-source packages, and testbeds. In addition, this study provides a general guideline for selecting appropriate PIML models based on BPS applications. Finally, this study identifies key challenges and outlines future research directions, providing a solid foundation and valuable insights to advance R&D of PIML in BPS.

Jiang, Zixin↗

A Learning Framework for Control-Oriented Modeling of Buildings

Buildings consume a significant amount of energy worldwide. Several building optimization and control use cases require models of energy consumption which are control oriented, have high predictive capability, imposes minimal data pre-processing requirements, and have the ability to be adapted continuously to account for changing conditions as new data becomes available. Data driven modeling techniques, that have been investigated so far, while promising in the context of buildings, have been unable to simultaneously satisfy all the requirements mentioned above. In this context, deep learning techniques such as Recurrent Neural Networks (RNNs) hold promise, empowered by advanced computational capabilities and big data opportunities. In this paper, we propose a deep learning based methodology for the development of control oriented models for building energy management and test in on data from a real building. Results show that the proposed methodology outperforms other data driven modeling techniques significantly. We perform a detailed analysis of the proposed methodology along dimensions such as topology, sensitivity, and downsampling. Lastly, we conclude by envisioning a building analytics suite empowered by the proposed deep framework, that can drive several use cases related to building energy management.

buildings↗

Pavement condition and climatic data in southeast Texas: A dataset for evaluating flood impacts on pavement performance

Effective pavement maintenance is essential for economic stability, optimal network performance, and roadway safety. Achieving this requires thorough evaluation of pavement conditions, including structural integrity, surface roughness, and distress characteristics. Pavement performance indicators play a critical role in influencing vehicle safety and ride quality. Recent advances have emphasized the use of data-driven modeling to anticipate pavement behavior, with the goal of optimizing resource allocation and refining Maintenance and Rehabilitation (M&R) strategies through accurate condition assessment. A foundational requirement for these modeling efforts is the availability of standardized, high-quality datasets that can support robust and reproducible infrastructure analysis. This data article presents a comprehensive dataset assembled to facilitate pavement performance prediction, with a geographic focus on Southeast Texas, particularly the flood-vulnerable area of Beaumont. The dataset encompasses pavement and traffic attributes, meteorological records, flood simulation outputs, ground deformation measurements, and topographic indices, enabling detailed examination of both load-associated and non-load-associated degradation mechanisms. Data preprocessing was performed using ArcGIS Pro, Microsoft Excel, and Python to ensure consistency and usability in data-driven modeling applications, including machine learning workflows. Key contributions of this dataset include its utility in analyzing the climatic and environmental factors affecting pavement conditions, identifying critical predictive features, and enabling in-depth correlation analysis across diverse variables. By filling existing gaps in input variable selection resources, this dataset supports the development of predictive tools for estimating future maintenance demand and enhancing the resilience of pavement networks in flood-impacted areas. The resource highlights the importance of standardized datasets for advancing pavement management practices and provides a robust foundation for ongoing infrastructure performance modeling.

42 ENGINEERING↗

Data-Driven Turbulence Modeling: Summary and Outcomes of the 2022 NASA Symposium

A three-day symposium sponsored by NASA was held in July 2022 in Suffolk, Virginia on the subject of Turbulence Modeling: Roadblocks, and the Potential for Machine Learning. This meeting brought together over 80 experts from academia, government, and industry to discuss critical issues for Reynolds-averaged Navier-Stokes (RANS) turbulence and transition models, as well as to evaluate the results from a collaborative testing challenge based on data-driven methods and machine learning (ML) technology. The symposium represents a continuation of an earlier symposium sponsored by the University of Michigan and NASA, held in Ann Arbor, MI in 2017. The 2022 symposium included a wide variety of talks on the subjects of RANS and ML, five invited talks, and three panel discussions. This talk summarizes the main outcomes of the symposium, and includes suggested recommendations and future directions.

machine learning↗