SEARCH · Search NASA

Results for “Data-driven partitioned modeling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

26 records · Page 2

All sources NASA NTRS DOE OSTI

NASA NTRS2020

The Global Methane Budget 2000–2017

Understanding and quantifying the global methane (CH4) budget is important for assessing realistic pathways to mitigate climate change. Atmospheric emissions and concentrations of CH4 continue to increase, making CH4 the second most important human-influenced greenhouse gas in terms of climate forcing, after carbon dioxide (CO2). The relative importance of CH4 compared to CO2 depends on its shorter atmospheric lifetime, stronger warming potential, and variations in atmospheric growth rate over the past decade, the causes of which are still debated. Two major challenges in reducing uncertainties in the atmospheric growth rate arise from the variety of geographically overlapping CH4 sources and from the destruction of CH4 by short-lived hydroxyl radicals (OH). To address these challenges, we have established a consortium of multidisciplinary scientists under the umbrella of the Global Carbon Project to synthesize and stimulate new research aimed at improving and regularly updating the global methane budget. Following Saunois et al. (2016), we present here the second version of the living review paper dedicated to the decadal methane budget, integrating results of top-down studies (atmospheric observations within an atmospheric inverse-modelling framework) and bottom-up estimates (including process-based models for estimating land surface emissions and atmospheric chemistry, inventories of anthropogenic emissions, and data-driven extrapolations). For the 2008–2017 decade, global methane emissions are estimated by atmospheric inversions (a top-down approach) to be 576 Tg CH4/yr (range 550–594, corresponding to the minimum and maximum estimates of the model ensemble). Of this total, 359 Tg CH4/yr or ∼ 60 % is attributed to anthropogenic sources, that is emissions caused by direct human activity (i.e. anthropogenic emissions; range 336–376 Tg CH4/yr or 50 %–65 %). The mean annual total emission for the new decade (2008–2017) is 29 Tg CH4/yr larger than our estimate for the previous decade (2000–2009), and 24 Tg CH4/yr larger than the one reported in the previous budget for 2003–2012 (Saunois et al., 2016). Since 2012, global CH4 emissions have been tracking the warmest scenarios assessed by the Intergovernmental Panel on Climate Change. Bottom-up methods suggest almost 30 % larger global emissions (737 Tg CH4/yr, range 594–881) than top-down inversion methods. Indeed, bottom-up estimates for natural sources such as natural wetlands, other inland water systems, and geological sources are higher than top-down estimates. The atmospheric constraints on the top-down budget suggest that at least some of these bottom-up emissions are overestimated. The latitudinal distribution of atmospheric observation-based emissions indicates a predominance of tropical emissions (∼ 65 % of the global budget, < 30° N) compared to mid-latitudes (∼ 30 %, 30–60° N) and high northern latitudes (∼ 4 %, 60–90° N). The most important source of uncertainty in the methane budget is attributable to natural emissions, especially those from wetlands and other inland waters. Some of our global source estimates are smaller than those in previously published budgets (Saunois et al., 2016; Kirschke et al., 2013). In particular wetland emissions are about 35 Tg CH4/yr lower due to improved partition wetlands and other inland waters. Emissions from geological sources and wild animals are also found to be smaller by 7 Tg CH4/yr by 8 Tg CH4/yr, respectively. However, the overall discrepancy between bottom-up and top-down estimates has been reduced by only 5 % compared to Saunois et al. (2016), due to a higher estimate of emissions from inland waters, highlighting the need for more detailed research on emissions factors. Priorities for improving the methane budget include (i) a global, high-resolution map of water-saturated soils and inundated areas emitting methane based on a robust classification of different types of emitting habitats; (ii) further development of process-based models for inland-water emissions; (iii) intensification of methane observations at local scales (e.g., FLUXNET-CH4 measurements) and urban-scale monitoring to constrain bottom-up land surface models, and at regional scales (surface networks and satellites) to constrain atmospheric inversions; (iv) improvements of transport models and the representation of photochemical sinks in top-down inversions; and (v) development of a 3D variational inversion system using isotopic and/or co-emitted species such as ethane to improve source partitioning.

methane budget↗

DOE OSTI2021

Scalable statistical inference of photometric redshift via data subsampling

Handling big data has largely been a major bottleneck in traditional statistical models. Consequently, when accurate point prediction is the primary target, machine learning models are often preferred over their statistical counterparts for bigger problems. But full probabilistic statistical models often outperform other models in quantifying uncertainties associated with model predictions. We develop a data-driven statistical modeling framework that combines the uncertainties from an ensemble of statistical models learned on smaller subsets of data carefully chosen to account for imbalances in the input space. We demonstrate this method on a photometric redshift estimation problem in cosmology, which seeks to infer a distribution of the redshift—the stretching effect in observing the light of far-away galaxies—given multivariate color information observed for an object in the sky. Our proposed method performs balanced partitioning, graph-based data subsampling across the partitions, and training of an ensemble of Gaussian process models.

data subsampling↗

DOE OSTI2026

U-net architected deep material network training with microstructure local field information

The Deep Material Network (DMN) has recently emerged as a powerful reduced-order modeling framework for simulating the mechanical response of heterogeneous materials such as composites. Unlike most data-driven approaches that directly learn a material’s response under prescribed loading, the DMN acts as a homogenization operator, learning the kinematic constraints and mechanical interactions of the underlying microstructure. However, traditional DMN training relies exclusively on homogenized effective properties derived from Direct Numerical Simulations (DNS), discarding the rich local field data that govern microstructural interactions. In this work, we extend the DMN framework to incorporate such local field information into the offline training process. Utilizing a U-Net architecture, we augment the DMN training objective to include the first and second statistical moments of the local stress fields obtained from linear DNS. This ensures that the learned network topology not only fits the effective stiffness but also accurately reflects the internal local stress and strain partitioning of the microstructure. The results confirm that supervising the localization process during training yields a superior surrogate model, reducing local prediction errors by an order of magnitude and significantly improving generalization to unseen nonlinear constitutive behaviors compared to traditional DMNs.

36 MATERIALS SCIENCE↗

DOE OSTI2026

Identifying Differential Equations in Fourier Domain (FourierIdent)

We investigate identifying differential equations in the frequency domain. Fourier analysis is an important tool in theoretical analysis and numerical solvers of differential equations, yet there is limited work in exploring this connection in the identification of differential equations. This paper aims to identify the underlying differential equation in the frequency domain, from a given single realization of the differential equation perturbed by noise. Such setting imposes difficulties which are different from other identification methods where computation is carried out in the physical domain. We propose several ways to mitigate the challenges arising from noise in data and large differences in the magnitudes of frequency responses. The main takeaways are that identifying differential equations solely in the frequency domain is challenging, the method we propose is based on a form of domain partitions in the frequency domain, and this method shows benefits for complex data even with high level of noise. We introduce a Fourier feature denoising, and define the meaningful data region and the core regions of features to reduce the effect of noise in the frequency domain and to enhance the accuracy in coefficient identification. The proposed method is tested on various differential equations with linear, nonlinear, and high-order derivative feature terms, and shows advantages on complex data with many frequency modes, even under high level of noise.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2024

Machine learning-aided inverse design for biogas upgrading through biological CO 2 conversion

The biogas upgrading process through bioconversion of CO 2 to CH 4 by hydrogenotrophic methanogens is an attractive strategy for energy decarbonation. Many studies have optimized operational parameters to improve key performance indicators such as CH 4 % and H 2 utilization efficiency. However, inconsistent laboratory conditions make it challenging to compare results. Existing models for analyzing operating conditions can only assess the impact of individual conditions and lack the ability to simultaneously optimize multiple conditions. To address this, two XGBoost models were built with R 2 of 0.779 and 0.903 with data collected from literatures and were embedded into multi-objective partitive swarm optimization algorithm to optimal operating conditions. Predictions were compared with experimental validations under optimized conditions, revealing an 8.50% and 2.95% relative error in CH 4 % and H 2 conversion rate, respectively. This approach streamlines biogas upgrading processes, offering a data-driven solution to enhance efficiency and consistency in the pursuit of sustainable methane production.

Biogas upgrading↗

DOE OSTI2021

A Data-Driven Approach to Nation-Scale Building Energy Modeling

In 2019, 125 million U.S. residential and commercial buildings consumed $412 billion in energy bills. These buildings currently consume 40% of the nation's primary energy, 73% of electricity, 80% of energy during peak electric grid use, and responsible for 39% of greenhouse gas emissions [14]. Urban-scale building energy modeling has grown significantly in the past decade, allowing individual campuses or communities of buildings to be modeled, simulated, and cost-effective solutions for intelligent management to be identified and implemented. While traditionally limited to individual counties and usually less than 2,000 buildings, the Automatic Building Energy Modeling (AutoBEM) soft-ware suite has been developed to process unconventional, nation-scale data sources to generate unique OpenStudio and EnergyPlus models of each building. Through the use of High Performance Computing (HPC) resources, every U.S. building has been simulated. This paper showcases the data layout, node partitioning, algorithmic approaches, and analytic results that were used to create, share, and analyze 124.4 million U.S. building models.

Berres, Andy↗

DOE OSTI2021

AGGREGATE: dAta-driven modelinG preservinG contRollable dEr for outaGe mAnagemenT and rEsiliency (Final Report)

The AGGREGATE project team successfully developed and validated various modules for outage management. Brief summaries of each module are provided to showcase their strength for outage management and restoration for a distribution system with a high penetration of connected distribution energy resources (DERs). In recent years, inverter-based DERs have been widely deployed in distribution system. A most of behind-the-meter (BTM) solar power generation is not visible to the utility. The data-driven DER and load estimation modules are using machine learning (ML) and artificial intelligence (AI) to manage this issue, which provides an opportunity for distribution system operators (DSOs) to operate systems and make decisions in real-time for a distribution system with a high penetration of DERs deployed. Also, the estimated DER and true load can be further leveraged in network aggregation and cold-load pick up estimation for reducing the computing complexity and providing for fast restoration. After load demand and DER power generations have been estimated, the information will support topology and state estimation (SE). The topology estimation module demonstrated the viability of mixed integer linear programming (MILP) formulation to estimate the most likely operational radial topology and outage sections using power flow measurements, historical/estimated load and DERs data and smart meter ping measurements. Formulation includes continuous (power flow, load and DERs data) and binary measurements (smart meter ping measurements) in a single formulation. Errors in continuous data and binary data are modeled as normal distribution and Bernoulli distribution, respectively. In the future distribution grid, the power injection from controllable DERs will be essential for efficient and resilient grid operation. However, determining the optimal DER injections and restoration actions is dependent on knowledge of the system states. State estimation (SE), already the cornerstone of transmission energy management systems, will become commonplace in distribution management systems as more measurements become available from deployment of automated metering infrastructure (AMI). Observability analysis is the first step in SE, as it determines the sufficiency of the available measurements for accurately estimating the current system states. A new type of pseudo-measurement called a Correlational Measurement (CM) is introduced in this module, to enhance the observability of the system to enable more accurate SE. CMs encapsulate knowledge of correlation between demand patterns for similar classes of loads as well as injection patterns for same-technology renewable DERs. During grid contingency scenarios, DERs have been traditionally disconnected, without any fault ride-through capabilities. However, with new regulations and better technology, it is feasible for these resources to contribute to the grid’s restoration after an adverse event and hence enhance resilience. The controllability module proposes a two-step restoration scheme for the power system restoration process by leveraging additional degrees of freedom in power electronics interfaced DERs for mitigating voltage problems. In a resilience mode without the utility system, the distribution grid relies on DERs to serve critical load. In such a severe event with multiple faults on the distribution feeders, actuation of various protective devices (PDs) divides the distribution system into electrical islands. The undetected actuated PDs due to fault current contributions from DERs can delay the restoration process, thereby reducing the system resilience. The Advanced Outage Management (AOM) and the Advanced Feeder Restoration (AFR) modules developed in this project provide improved system resilience with multiple DERs. AOM identifies the faulted sections and actuated PDs in a distribution system with DERs by incorporating smart meter data. The most credible outage scenario including fault locations, PD actuations, and fault indicator (FI) failures is identified by a set of binary integer linear programming incorporating hypotheses. The AFR module serves to restore a distribution system with available energy resources taking into consideration the availability of utility sources and DERs. By partitioning the system into islands, critical load will be served with the available generation resources within islands based on the solution of a MILP. When the utility systems become available, the optimal path will be determined by a spanning tree search algorithm that reconnects these islands back to substations and restores the remaining load. The transmission and distribution (T&D) co-simulation module was used to validate the effect of a control action performed on the distribution side assets as it propagates to the transmission side. This ensures that the control action performed results in a feasible operating point on both the transmission and the distribution system. In addition to validation, the team used the T&D co-simulation module to demonstrate how distribution system assets can be used to mitigate issues on the transmission system. Specifically, the team demonstrated that appropriate switching operations on the distribution side can alleviate the line overload condition on the transmission side without causing new operational constraint violations.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2025

Global Methane Budget 2000–2020

Abstract. Understanding and quantifying the global methane (CH4) budget is important for assessing realistic pathways to mitigate climate change. CH4 is the second most important human-influenced greenhouse gas in terms of climate forcing after carbon dioxide (CO2), and both emissions and atmospheric concentrations of CH4 have continued to increase since 2007 after a temporary pause. The relative importance of CH4 emissions compared to those of CO2 for temperature change is related to its shorter atmospheric lifetime, stronger radiative effect, and acceleration in atmospheric growth rate over the past decade, the causes of which are still debated. Two major challenges in quantifying the factors responsible for the observed atmospheric growth rate arise from diverse, geographically overlapping CH4 sources and from the uncertain magnitude and temporal change in the destruction of CH4 by short-lived and highly variable hydroxyl radicals (OH). To address these challenges, we have established a consortium of multidisciplinary scientists under the umbrella of the Global Carbon Project to improve, synthesise, and update the global CH4 budget regularly and to stimulate new research on the methane cycle. Following Saunois et al. (2016, 2020), we present here the third version of the living review paper dedicated to the decadal CH4 budget, integrating results of top-down CH4 emission estimates (based on in situ and Greenhouse Gases Observing SATellite (GOSAT) atmospheric observations and an ensemble of atmospheric inverse-model results) and bottom-up estimates (based on process-based models for estimating land surface emissions and atmospheric chemistry, inventories of anthropogenic emissions, and data-driven extrapolations). We present a budget for the most recent 2010–2019 calendar decade (the latest period for which full data sets are available), for the previous decade of 2000–2009 and for the year 2020. The revision of the bottom-up budget in this 2025 edition benefits from important progress in estimating inland freshwater emissions, with better counting of emissions from lakes and ponds, reservoirs, and streams and rivers. This budget also reduces double counting across freshwater and wetland emissions and, for the first time, includes an estimate of the potential double counting that may exist (average of 23 Tg CH4 yr−1). Bottom-up approaches show that the combined wetland and inland freshwater emissions average 248 [159–369] Tg CH4 yr−1 for the 2010–2019 decade. Natural fluxes are perturbed by human activities through climate, eutrophication, and land use. In this budget, we also estimate, for the first time, this anthropogenic component contributing to wetland and inland freshwater emissions. Newly available gridded products also allowed us to derive an almost complete latitudinal and regional budget based on bottom-up approaches. For the 2010–2019 decade, global CH4 emissions are estimated by atmospheric inversions (top-down) to be 575 Tg CH4 yr−1 (range 553–586, corresponding to the minimum and maximum estimates of the model ensemble). Of this amount, 369 Tg CH4 yr−1 or ∼ 65 % is attributed to direct anthropogenic sources in the fossil, agriculture, and waste and anthropogenic biomass burning (range 350–391 Tg CH4 yr−1 or 63 %–68 %). For the 2000–2009 period, the atmospheric inversions give a slightly lower total emission than for 2010–2019, by 32 Tg CH4 yr−1 (range 9–40). The 2020 emission rate is the highest of the period and reaches 608 Tg CH4 yr−1 (range 581–627), which is 12 % higher than the average emissions in the 2000s. Since 2012, global direct anthropogenic CH4 emission trends have been tracking scenarios that assume no or minimal climate mitigation policies proposed by the Intergovernmental Panel on Climate Change (shared socio-economic pathways SSP5 and SSP3). Bottom-up methods suggest 16 % (94 Tg CH4 yr−1) larger global emissions (669 Tg CH4 yr−1, range 512–849) than top-down inversion methods for the 2010–2019 period. The discrepancy between the bottom-up and the top-down budgets has been greatly reduced compared to the previous differences (167 and 156 Tg CH4 yr−1 in Saunois et al. (2016, 2020) respectively), and for the first time uncertainties in bottom-up and top-down budgets overlap. Although differences have been reduced between inversions and bottom-up, the most important source of uncertainty in the global CH4 budget is still attributable to natural emissions, especially those from wetlands and inland freshwaters. The tropospheric loss of methane, as the main contributor to methane lifetime, has been estimated at 563 [510–663] Tg CH4 yr−1 based on chemistry–climate models. These values are slightly larger than for 2000–2009 due to the impact of the rise in atmospheric methane and remaining large uncertainty (∼ 25 %). The total sink of CH4 is estimated at 633 [507–796] Tg CH4 yr−1 by the bottom-up approaches and at 554 [550–567] Tg CH4 yr−1 by top-down approaches. However, most of the top-down models use the same OH distribution, which introduces less uncertainty to the global budget than is likely justified. For 2010–2019, agriculture and waste contributed an estimated 228 [213–242] Tg CH4 yr−1 in the top-down budget and 211 [195–231] Tg CH4 yr−1 in the bottom-up budget. Fossil fuel emissions contributed 115 [100–124] Tg CH4 yr−1 in the top-down budget and 120 [117–125] Tg CH4 yr−1 in the bottom-up budget. Biomass and biofuel burning contributed 27 [26–27] Tg CH4 yr−1 in the top-down budget and 28 [21–39] Tg CH4 yr−1 in the bottom-up budget. We identify five major priorities for improving the CH4 budget: (i) producing a global, high-resolution map of water-saturated soils and inundated areas emitting CH4 based on a robust classification of different types of emitting ecosystems; (ii) further development of process-based models for inland-water emissions; (iii) intensification of CH4 observations at local (e.g. FLUXNET-CH4 measurements, urban-scale monitoring, satellite imagery with pointing capabilities) to regional scales (surface networks and global remote sensing measurements from satellites) to constrain both bottom-up models and atmospheric inversions; (iv) improvements of transport models and the representation of photochemical sinks in top-down inversions; and (v) integration of 3D variational inversion systems using isotopic and/or co-emitted species such as ethane as well as information in the bottom-up inventories on anthropogenic super-emitters detected by remote sensing (mainly oil and gas sector but also coal, agriculture, and landfills) to improve source partitioning. The data presented here can be downloaded from https://doi.org/10.18160/GKQ9-2RHT (Martinez et al., 2024).

54 ENVIRONMENTAL SCIENCES↗