Search NASA⌕ Search

SEARCH · Search NASA

Results for “DATA ASSIMILATION”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 361 records · Page 20

Development of a Time-Height Profile Assimilation Technique for Large-Eddy Simulation

Mesoscale-to-microscale coupling (MMC) aims to address the limited scope of traditional large-eddy simulations by driving the microscale flow with information concerning large-scale weather patterns provided by mesoscale models. We present a new offline MMC technique for horizontally homogeneous microscale flow conditions, in which internal forcing terms are computed based on mesoscale time–height profiles of mean-flow quantities. The advantage of such an approach is that it can be used to drive a microscale simulation with either mesoscale or observational data, and that it does not rely on specific terms in the mesoscale budget equations, which are typically not part of the default output of a mesoscale solver. The performance of the proposed profile assimilation technique is assessed based on the simulation of a typical diurnal cycle over the Scaled Wind Farm Technology site in west Texas. Results indicate that simple data assimilation techniques lead to unphysically high levels of shear and turbulence caused by the algorithm’s inability to cope with inaccuracies in the mesoscale time–height profiles. Modifying the algorithm to account for vertical coherence in the mesoscale source terms gives the microscale solver a greater ability to correct the provided mesoscale time–height profiles, leading to improved predictions of shear and turbulence statistics. The resulting turbulence statistics are in good agreement with meteorological tower observations and simulation results obtained with state-of-the-art coupling techniques using mesoscale budget components.

data assimilation↗

Horizontal Split Table Conceptual Design for Advanced Reactor Validation

Oak Ridge National Laboratory and Lawrence Livermore National Laboratory are collaborating to develop a conceptual design for a horizontal split table for use in performing critical experiments. The goal of this design effort is to provide nuclear data testing and validation capabilities for advanced reactors such as pebble-bed high-temperature gas-cooled reactors, molten salt reactors, and heat pipe microreactor, but it could also be used for the current generation of reactors. The first concept being explored for the horizontal split table, a pebble-bed design based on the HTR-10 reactor, is described in this paper. A critical configuration corresponding to a footprint of about 4.5 m 2 was determined with SCALE/KENO-VI to fit the planned dimensions of the horizontal split table. The similarity of the pebble-bed design and the HTR-10 reactor application was assessed using SCALE/TSUNAMI, and a similarity coefficient $c_k$ of 0.9982 was obtained, proving that the concept will be useful for nuclear data validation and assimilation of pebble-bed type advanced reactors. In the proposed design, the materials with the highest $k_{eff}$ sensitivity are graphite and uranium, demonstrating that particular care must be given to carbon-related cross-section data. The effect of mechanical uncertainties between the fixed and moving tables was also assessed by calculating the reactivity change caused by vertical and horizontal gaps, as well as angular and torsion offsets between the two sides of the horizontal split table concept. The highest relative changes on the concept’s reactivity were caused by angular perturbations. The same analysis process is currently being used to create a molten salt advanced reactor type horizontal split table concept based on the Molten Salt Reactor Experiment (MSRE).

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Integrating Models with Real-time Field Data for Extreme Events: From Field Sensors to Models and Back with AI in the Loop

Focal Area(s): This whitepaper is responsive to focal area (1) Data acquisition and assimilation enabled by machine learning, AI, and advanced methods including experimental/network design/optimization, unsupervised learning (including deep learning), and hardware-related efforts involving AI (e.g., edge computing). We discuss Artificial Intelligence and Machine Learning (AI/ML) enabled integration of real-time data into the extreme event modeling workflow to improve the predictive capabilities of these models, and deliver real-time feedback to remote sensors, including software and data engineering challenges.

54 ENVIRONMENTAL SCIENCES↗

AI to Automate ModEx for Optimal Predictive Improvement and Scientific Discovery

Focal Areas: Data acquisition and assimilation enabled by machine learning, AI, advanced experimental optimization, unsupervised learning, and hardware-related AI efforts; Predictive modeling through AI techniques and AI-derived model components; Using AI to design a hierarchical model prediction system consisting and model selection; and, Interrogating complex data (observed and simulated) using AI, big data analytics, and other advanced methods such as explainable AI and physics- or knowledge-guided AI.

54 ENVIRONMENTAL SCIENCES↗

EdgeAI: How to Use AI to Collect Reliable and Relevant Watershed Data

Focal Area(s): Focal areas are on data acquisition and assimilation enabled by AI, advanced methods including experimental/network design/optimization, unsupervised learning (including deep learning), and hardware-related efforts involving AI (e.g., edge computing). Science Challenge: The transformational science challenge that we address is the following: – Ensuring, in near real-time, that the data collected from distributed sensor networks is accurate and contains useful information to identify, quantify, and predict watershed and ecosystem dynamic responses to short- and long-term perturbations.

54 ENVIRONMENTAL SCIENCES↗

A library of AI-assisted FAIR water cycle and related disturbance datasets to enable model training, parameterization and validation

This whitepaper is responsive to focal area Data acquisition and assimilation enabled by machine learning, AI, and advanced methods. Here we describe how FAIR (Findable, Accessible, Reusable, Interoperable) datasets related to water cycle extremes are essential for successful implementation of ML in Earth System and other models. We also describe how AI can be used to acquire and integrate water cycle data related to extreme events to create a library of FAIR datasets for training and evaluating algorithms.

58 GEOSCIENCES↗

Observational Capabilities to Capture Water Cycle Event Dynamics and Impacts in the Age of AI

This whitepaper is responsive to focal area (1) Data acquisition and assimilation enabled by machine learning (ML), Artificial Intelligence (AI), and advanced methods. Here we describe how Earth observations specific to water cycle disturbances can be collected in parallel with and integrated into future model development, and make use of the latest technologies other than AI/ ML such as 5G/satellite, edge computing, big data technologies, and cloud computing.

58 GEOSCIENCES↗

Elucidating and predicting the dynamic evolution of water and land systems due to natural and energy-related forcings

Focal Area(s): 3. Insight gleaned from complex data (both observed and simulated) using AI, big data analytics, and other advanced methods, including explainable AI and physics- or knowledge-guided AI; & 1. Data acquisition and assimilation enabled by machine learning, AI, and advanced methods including experimental/network design/optimization, unsupervised learning (including deep learning), and hardware-related efforts involving AI (e.g., edge computing). Science Challenge: Interactions between water, land, and energy systems are complex and occur on a variety of scales, ranging from local to basinal to regional. Accurately predicting the behavior of ground water and surface water systems for 5-10 years and beyond requires an understanding of the current system and the ability to model both the natural system at scale and human-induced forcings related to energy and other activities. Artificial intelligence and machine learning (AI/ML) combined with modern compilation and integration efforts for U.S. groundwater and surface water systems present potential solutions to bolstering detailed physics-based models of these systems. Big data tied with ML and physics-based modeling can drive breakthroughs in understanding the earth system, but research is often impeded by data access (e.g., privacy issues), quality, formats, gaps, multi-source, multi-scale, integration, and spatiotemporal challenges. Effective integration of real data and simulated (synthetic) data that fill gaps is critical. Overcoming these complex data and model integration challenges will enable a transformational approach to acquiring enhanced understanding of environmental systems.

54 ENVIRONMENTAL SCIENCES↗

End-to-End Differentiable Modeling and Management of the Environment

Focal Area: (2) Data acquisition and assimilation enabled by machine learning, AI, and advanced methods including experimental/network design/optimization. We emphasize the importance of leveraging optimization techniques from AI/machine learning (ML) to solve challenging problems in Earth system modeling. Science Challenge: Automatic differentiation has had a transformative effect on ML by allowing the calculation of gradients of arbitrary functions in an incredibly large class of models. We can potentially realize similar improvements in parameter estimation and control for Earth system models (ESMs) by reimplementing them in computational frameworks from ML. Practitioners working with large (>10 7 parameters) models in ML and AI can obtain good predictive performance in a range of spatiotemporal tasks by making use of optimization via stochastic gradient descent and incorporating prior knowledge at multiple levels. We propose writing ESMs in open-source computational frameworks such as Torch, Tensorflow, and JAX to greatly expand the scope of environmental forecasting and management challenges, which can be addressed by leveraging automatic differentiation and gradient descent-like algorithms. We do not call for a wholesale replacement of physical models with data-driven surrogates, but rather advocate for interleaving physical and empirical equations in a manner that is most faithful to the extent of our scientific knowledge and observational data. Central to this topic is the merging of differentiable physical simulations with differentiable optimization layers, which are now both beginning to come to the forefront.

54 ENVIRONMENTAL SCIENCES↗

Matrix Approach to Land Carbon Cycle Modeling

Land ecosystems contribute to climate change mitigation by taking up approximately 30% of anthropogenically emitted carbon. However, estimates of the amount and distribution of carbon uptake across the world's ecosystems or biomes display great uncertainty. The latter hinders a full understanding of the mechanisms and drivers of land carbon uptake, and predictions of the future fate of the land carbon sink. The latter is needed as evidence to inform climate mitigation strategies such as afforestation schemes. To advance land carbon cycle modeling, we have developed a matrix approach. Land carbon cycle models use carbon balance equations to represent carbon exchanges among pools. Our approach organizes this set of equations into a single matrix equation without altering any processes of the original model. The matrix equation enables the development of a theoretical framework for understanding the general, transient behavior of the land carbon cycle. While carbon input and residence time are used to quantify carbon storage capacity at steady state, a third quantity, carbon storage potential, integrates fluxes with time to define dynamic disequilibrium of the carbon cycle under global change. The matrix approach can help address critical contemporary issues in modeling, including pinpointing sources of model uncertainty and accelerating spin-up of land carbon cycle models by tens of times. The accelerated spin-up liberates models from the computational burden that hinders comprehensive parameter sensitivity analysis and assimilation of observational data to improve model accuracy. Such computational efficiency offered by the matrix approach enables substantial improvement of model predictions using ever-increasing data availability. Overall, the matrix approach offers a step change forward for understanding and modeling the land carbon cycle.

54 ENVIRONMENTAL SCIENCES↗

A Fire Community Observatory: Interdisciplinary, AI-informed Post-Fire Rapid Response for Improved Water Cycle Science at Watershed Scale

Wildfire is an ecological disturbance that disrupts the hydrological cycle. In the past few years, a record number of multiple-and-compounding fires have occurred across urban-wildland gradients in the Western United States. Changes to watershed hydrological partitioning in response to fires (infiltration, runoff, evapotranspiration) presents unprecedented challenges to “Water-in-the-West” through negative impacts to water supply and its quality, and is a direct threat to downstream communities, groundwater, and drinking water supply infrastructure. While much work is being done to advance Artificial Intelligence and Machine Learning (AI/ML) use during fires for emergency response (i.e. predict fire movement, direct evacuations), significant potential exists to use AI/ML to address three scientific grand challenges that are rarely addressed in a convergent science context: 1) how to enhance the potential resiliency of a landscape before fire(s), 2) how to cost-effectively and optimally monitor watershed changes after fires, and 3) how to predict future hydrological and biogeochemical trajectories in fire-impacted watershed given climate change. This whitepaper addresses DOE Focal Area 1: Data acquisition and assimilation enabled by machine learning, AI, and advanced methods.

58 GEOSCIENCES↗

A Self-Evolution Data Fusion Platform for Large-Scale Water Models

Focal Area: Data acquisition and assimilation enabled by machine learning (ML), artificial intelligence (AI), and advanced methods including experimental/network design/optimization, unsupervised learning (deep learning), leveraging advanced hardware (e.g., edge computing). This development is to enable solving the science questions regarding the human and climatic factors that interact with and drive global water scarcity.

54 ENVIRONMENTAL SCIENCES↗

AI-Based Integrated Modeling and Observational Framework for Improving Seasonal to Decadal Prediction of Terrestrial Ecohydrological Extremes

Focal Areas: (1) Insight gleaned from complex data (both observed and simulated) using artificial intelligence(AI), big data analytics, and other advanced methods, including explainable AI and physics- or knowledge-guided AI (2) Data acquisition and assimilation enabled by machine learning, AI, and advanced methods including experimental/network design/optimization, unsupervised learning (including deep learning), and hardware-related efforts involving AI (e.g., edge computing).

54 ENVIRONMENTAL SCIENCES↗

The Influence of Soil Properties on Sea-Breeze Circulations in the Southeast U.S.

Sea-breeze circulations (SBCs) are common weather phenomena at and near coastal regions. They form because of a thermal gradient between the land surface at the coast and the sea surface. In a mid-day regime, a “thermal low” generated at the warm coast will lead to rising air motion, creating a wind shift coming from the sea near the surface displacing the coastal air. A “return flow” moving back towards the sea is generated by upper-level divergence because of the rising motion from the thermal low. SBCs propagate and serve as a method of urban pollutant dispersion in the Los Angeles region of California and are constrained to the coast due to the topography of surrounding mountains serving as a boundary for further inland propagation. Within the northeast U.S. SBCs are seen in the warm season but tend to remain coastally bound due to Coriolis distortion over long distances. Within the southeast U.S. (SEUS), the paradigmatic example of SBCs occurs over the Florida peninsula, where thunderstorms form on a nearly daily occurrence due to the convergence of SBCs from the east and west sides of the peninsula. However, there are further examples of sea-breezes in the SEUS that warrant study. Within the region bordering the SEUS and the Mid-Atlantic, just east of the southern Appalachian Mountains, warm-season SBCs form at the coast of Georgia and the Carolinas. Relatively flat topography ~150-200km inland allows for mostly unimpeded inland SBC propagation. Through visual analysis, Viner et al. catalogued several SBCs that propagated as far inland as the Central Savannah River Area surrounding Augusta, Georgia. Wermter et al. found that while the land-sea thermal gradient at the coast can influence coastal SBC genesis, the inland-coastal thermal gradient over the land is the primary influencer on the speed and depth of inland propagation of SBCs in this region. Additionally, soil moisture itself is a known correlative factor to sea-breeze formation, as it influences the soil temperature and the thermal gradient needed for SBC genesis and inland penetration. Physick determined that higher latent heat fluxes associated with wetter soil dampen the land-sea thermal gradient and suppress the formation of a SBC. Physick determined that higher latent heat fluxes associated with wetter soil dampen the land-sea thermal gradient and suppress the formation of a SBC. Conversely, drier soil enhances the thermal gradient and promotes SBC formation. However, while there is an inverse relationship between soil moisture and SBCs, higher soil moisture can actually promote more convective rainfall following a SBC if it does not significantly impact the thermal gradient. While the relationship between soil moisture and SBC formation has been conceptually explored and modeled numerically, there is a research gap in observed connections. The Soil Moisture Active Passive (SMAP) satellite mission has been operational since 2015 and has been used to create high-resolution re-analytical Level 4 (L4) datasets of soil moisture and soil temperature at different soil depths: the surface (0-5cm) and rootzone (0-1m). The surface soil temperature effectively acts as the “skin temperature” of the surface at these levels, and a spatial map of the land-sea as well as the coastal-inland thermal gradients can be represented. SMAP data are also assimilated in some atmospheric models such at the High Resolution Rapid Refresh (HRRR) mesoscale model. We propose leveraging the use of SMAP products to fill in spatial gaps left by weather and mesonet stations within the SEUS region, as well as assessing the effectiveness of utilizing SMAP products towards SBC forecasting in both deterministic and machine learning (ML) models.

58 GEOSCIENCES↗

Photovoltaic Analysis and Response Support (PARS) Platform for Solar Situational Awareness and Resiliency Services

The project's primary objective is to develop a digital-twin based Photovoltaic (PV) Analysis and Response Support (PARS) platform, which aims to provide real-time situational awareness and optimal response plans. This platform is designed to enhance the performance of hybrid PV systems, making them competitive with or even superior to conventional generation resources. The PARS platform enabled the project team to develop and evaluate an extensive suite of grid support functionalities for the hybrid PV systems to enhance grid performance, across key areas including visibility, dispatchability, security, resilience, and reliability. Given the global push toward achieving 100% clean energy by 2035, there is a significant increase in the integration of inverter-based resources (IBRs) throughout the energy grid. Effectively managing the inherent variability and uncertainty associated with IBRs is crucial for ensuring cost-effectiveness, reliability, and security in both the main grid and islanded microgrids. Constrained to a limited array of IEEE test systems or standard feeder models, traditional IBR modeling struggles to assimilate new field data, accurately reflect system dynamics, and adapt to the evolving energy landscape. In our project, we embraced a Digital Twin (DT) strategy for crafting the PARS platform. A digital twin acts as a precise virtual counterpart of a physical system, built on historical data and continuously honed with real-time insights. This enables the high-fidelity DT to accurately mirror current system operations and forecast future scenarios. Consequently, the PARS platform becomes an ideal environment for testing and refining monitoring, control, power, and energy management algorithms designed to boost hybrid PV system performance. The defining feature of the PARS platform, distinguishing it from other advanced simulation tools, is its exceptional adaptability. This is achieved by employing actual network topologies and utilizing real-time field data for fine-tuning and calibration, ensuring a close emulation of real-world conditions. The project deliverables include: 1) High-fidelity IBR models and tools for real-time parameterization, utilizing real-time field measurements to refine IBR models for enhanced accuracy and performance; 2) Grid-forming and Grid-following capabilities to deliver resilience services, including blackstart, voltage and frequency support, cold-load pick-up, power reserves, and three-phase load balancing across grid-connected and microgrid settings; 3) Machine learning-based forecasting tools and methods for generating synthetic data and topologies, creating diverse and realistic simulation environments for evaluating varied operational scenarios; 4) Advanced microgrid power and energy management algorithms for optimizing the integration and operation of PV, storage, and demand response resources within both feeder and community scales. The power grid data sets are provided by four utility companies in North Carolina and the New York Power Administration. Acting as industry advisors, our industry partners communicated stakeholder needs and regulatory standards to the research teams, aiding technology transfer by incorporating the developed methodologies into their daily operations. This collaboration ensures that the PARS platform, functioning as a power system digital twin, enhances our understanding of IBR dynamic behaviors and enables the development and evaluation of IBR control functions that match or exceed the capabilities of conventional synchronous generators.

14 SOLAR ENERGY↗

Scalable deep learning for watershed model calibration

Watershed models such as the Soil and Water Assessment Tool (SWAT) consist of high-dimensional physical and empirical parameters. These parameters often need to be estimated/calibrated through inverse modeling to produce reliable predictions on hydrological fluxes and states. Existing parameter estimation methods can be time consuming, inefficient, and computationally expensive for high-dimensional problems. In this paper, we present an accurate and robust method to calibrate the SWAT model (i.e., 20 parameters) using scalable deep learning (DL). We developed inverse models based on convolutional neural networks (CNN) to assimilate observed streamflow data and estimate the SWAT model parameters. Scalable hyperparameter tuning is performed using high-performance computing resources to identify the top 50 optimal neural network architectures. We used ensemble SWAT simulations to train, validate, and test the CNN models. We estimated the parameters of the SWAT model using observed streamflow data and assessed the impact of measurement errors on SWAT model calibration. We tested and validated the proposed scalable DL methodology on the American River Watershed, located in the Pacific Northwest-based Yakima River basin. Our results show that the CNN-based calibration is better than two popular parameter estimation methods (i.e., the generalized likelihood uncertainty estimation [GLUE] and the dynamically dimensioned search [DDS], which is a global optimization algorithm). For the set of parameters that are sensitive to the observations, our proposed method yields narrower ranges than the GLUE method but broader ranges than values produced using the DDS method within the sampling range even under high relative observational errors. The SWAT model calibration performance using the CNNs, GLUE, and DDS methods are compared using R 2 and a set of efficiency metrics, including Nash-Sutcliffe, logarithmic Nash-Sutcliffe, Kling-Gupta, modified Kling-Gupta, and non-parametric Kling-Gupta scores, computed on the observed and simulated watershed responses. The best CNN-based calibrated set has scores of 0.71, 0.75, 0.85, 0.85, 0.86, and 0.91. The best DDS-based calibrated set has scores of 0.62, 0.69, 0.8, 0.77, 0.79, and 0.82. The best GLUE-based calibrated set has scores of 0.56, 0.58, 0.71, 0.7, 0.71, and 0.8. The scores above show that the CNN-based calibration leads to more accurate low and high streamflow predictions than the GLUE and DDS sets. Our research demonstrates that the proposed method has high potential to improve our current practice in calibrating large-scale integrated hydrologic models.

54 ENVIRONMENTAL SCIENCES↗

Integrating multi-modal remote sensing, deep learning, and attention mechanisms for yield prediction in plant breeding experiments

In both plant breeding and crop management, interpretability plays a crucial role in instilling trust in AI-driven approaches and enabling the provision of actionable insights. The primary objective of this research is to explore and evaluate the potential contributions of deep learning network architectures that employ stacked LSTM for end-of-season maize grain yield prediction. A secondary aim is to expand the capabilities of these networks by adapting them to better accommodate and leverage the multi-modality properties of remote sensing data. In this study, a multi-modal deep learning architecture that assimilates inputs from heterogeneous data streams, including high-resolution hyperspectral imagery, LiDAR point clouds, and environmental data, is proposed to forecast maize crop yields. The architecture includes attention mechanisms that assign varying levels of importance to different modalities and temporal features that, reflect the dynamics of plant growth and environmental interactions. The interpretability of the attention weights is investigated in multi-modal networks that seek to both improve predictions and attribute crop yield outcomes to genetic and environmental variables. This approach also contributes to increased interpretability of the model's predictions. The temporal attention weight distributions highlighted relevant factors and critical growth stages that contribute to the predictions. The results of this study affirm that the attention weights are consistent with recognized biological growth stages, thereby substantiating the network's capability to learn biologically interpretable features. Accuracies of the model's predictions of yield ranged from 0.82-0.93 R 2 ref in this genetics-focused study, further highlighting the potential of attention-based models. Further, this research facilitates understanding of how multi-modality remote sensing aligns with the physiological stages of maize. The proposed architecture shows promise in improving predictions and offering interpretable insights into the factors affecting maize crop yields, while demonstrating the impact of data collection by different modalities through the growing season. By identifying relevant factors and critical growth stages, the model's attention weights provide valuable information that can be used in both plant breeding and crop management. The consistency of attention weights with biological growth stages reinforces the potential of deep learning networks in agricultural applications, particularly in leveraging remote sensing data for yield prediction. To the best of our knowledge, this is the first study that investigates the use of hyperspectral and LiDAR UAV time series data for explaining/interpreting plant growth stages within deep learning networks and forecasting plot-level maize grain yield using late fusion modalities with attention mechanisms.

59 BASIC BIOLOGICAL SCIENCES↗

Improving coastal water level estimation by merging nadir-only satellite altimetry data into a hydrodynamic model

Providing robust real time flood warnings is of paramount importance to coastal communities. Although state-of-the-art hydrodynamic models are capable of robustly predicting Coastal Water Levels (CWL), unresolved drivers affecting level fluctuations are often not represented by the model governing equations. This work evaluates a novel method to improve the performance of the ADvanced CIRCulation (ADCIRC) hydrodynamic model by assimilating observations from four nadir-only satellite altimetry missions against a set of National Oceanic and Atmospheric Administration (NOAA) gauge stations located across the entire U.S. East Coast. Two different types of simulations were performed – Open Loop (OL) and Data Assimilation (DA). Five different simulations were performed where four different satellite altimetry observations were assimilated individually and combined with two different scenarios – with and without considering the data quality flags. Results indicate that, despite their limited spatial coverage, merging nadir-only observations into ADCIRC from the newly launched Surface Water and Ocean Topography (SWOT)’s nadir altimeter can improve the model performance at 76% of the gauge locations, whereas Sentinel-6 improves 73% of the total locations, Jason-3 74%, and SARAL 21%. Furthermore, combining observations from SWOT-nadir, Jason-3, and Sentinel-6 can improve the ADCIRC performance at more than 80% of the gauge locations for 107-day simulation. Nadir-only satellite altimetry observations can be useful for improving the model performance even if flagged as “poor quality” near the coast. When the flagged data are disregarded, SWOT can improve ADCIRC at 78%, Sentinel-6 at 73%, Jason-3 at 53%, and SARAL at 21% of the gauge locations. The ability to improve the model simulations largely depends on the availability of a satellite overpass nearby. Therefore, model performance can be further enhanced if satellite observations are available during a storm surge event, stressing the importance of frequent satellite overpasses.

Aafnan Bhuiyan, Soelem↗