Search NASA⌕ Search

SEARCH · Search NASA

Results for “Data Assimilation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7
All sourcesNASA NTRSDOE OSTI
NASA NTRS2012

Multi-Scale Three-Dimensional Variational Data Assimilation System for Coastal Ocean Prediction

A multi-scale three-dimensional variational data assimilation system (MS-3DVAR) has been formulated and the associated software system has been developed for improving high-resolution coastal ocean prediction. This system helps improve coastal ocean prediction skill, and has been used in support of operational coastal ocean forecasting systems and field experiments. The system has been developed to improve the capability of data assimilation for assimilating, simultaneously and effectively, sparse vertical profiles and high-resolution remote sensing surface measurements into coastal ocean models, as well as constraining model biases. In this system, the cost function is decomposed into two separate units for the large- and small-scale components, respectively. As such, data assimilation is implemented sequentially from large to small scales, the background error covariance is constructed to be scale-dependent, and a scale-dependent dynamic balance is incorporated. This scheme then allows effective constraining large scales and model bias through assimilating sparse vertical profiles, and small scales through assimilating high-resolution surface measurements. This MS-3DVAR enhances the capability of the traditional 3DVAR for assimilating highly heterogeneously distributed observations, such as along-track satellite altimetry data, and particularly maximizing the extraction of information from limited numbers of vertical profile observations.

Li, Zhijin↗
NASA NTRS2017

Coupled Data Assimilation for Integrated Earth System Analysis and Prediction: Goals, Challenges, and Recommendations

The purpose of this report is to identify fundamental issues for coupled data assimilation (CDA), such as gaps in science and limitations in forecasting systems, in order to provide guidance to the World Meteorological Organization (WMO) on how to facilitate more rapid progress internationally. Coupled Earth system modeling provides the opportunity to extend skillful atmospheric forecasts beyond the traditional two-week barrier by extracting skill from low-frequency state components such as the land, ocean, and sea ice. More generally, coupled models are needed to support seamless prediction systems that span timescales from weather, subseasonal to seasonal (S2S), multiyear, and decadal. Therefore, initialization methods are needed for coupled Earth system models, either applied to each individual component (called Weakly Coupled Data Assimilation - WCDA) or applied the coupled Earth system model as a whole (called Strongly Coupled Data Assimilation - SCDA). Using CDA, in which model forecasts and potentially the state estimation are performed jointly, each model domain benefits from observations in other domains either directly using error covariance information known at the time of the analysis (SCDA), or indirectly through flux interactions at the model boundaries (WCDA). Because the non-atmospheric domains are generally under-observed compared to the atmosphere, CDA provides a significant advantage over single-domain analyses. Next, we provide a synopsis of goals, challenges, and recommendations to advance CDA: Goals: (a) Extend predictive skill beyond the current capability of NWP (e.g. as demonstrated by improving forecast skill scores), (b) produce physically consistent initial conditions for coupled numerical prediction systems and reanalyses (including consistent fluxes at the domain interfaces), (c) make best use of existing observations by allowing observations from each domain to influence and improve the full earth system analysis, (d) develop a robust observation-based identification and understanding of mechanisms that determine the variability of weather and climate, (e) identify critical weaknesses in coupled models and the earth observing system, (f) generate full-field estimates of unobserved or sparsely observed variables, (g) improve the estimation of the external forcings causing changes to climate, (h) transition successes from idealized CDA experiments to real-world applications. Challenges: (a) Modeling at the interfaces between interacting components of coupled Earth system models may be inadequate for estimating uncertainty or error covariances between domains, (b) current data assimilation methods may be insufficient to simultaneously analyze domains containing multiple spatiotemporal scales of interest, (c) there is no standardization of observation data or their delivery systems across domains, (d) the size and complexity of many large-scale coupled Earth system models makes it is difficult to accurately represent uncertainty due to model parameters and coupling parameters, (e) model errors lead to local biases that can transfer between the different Earth system components and lead to coupled model biases and long-term model drift, (e) information propagation across model components with different spatiotemporal scales is extremely complicated, and must be improved in current coupled modeling frameworks, (h) there is insufficient knowledge on how to represent evolving errors in non-atmospheric model components (e.g. as sea ice, land and ocean) on the timescales of NWP.

CDA↗
NASA NTRS2005

Data Assimilation Technology Transfer from Planetary Exploration to Terrestrial Applications

Data assimilation can be a valuable tool for discovery and exploration. Planetary missions--principally polar orbiting spacecraft--are now capable of returning enough information to constrain global dynamical models. However, such missions operate under a number of severe constraints: there is no ground truth to calibrate and validate either the models or the data: and there are limited computational resources available, particularly onboard the spacecraft, for the near real-time processing that is required for aerobraking and other semi-autonomous maneuvers. A modified data assimilation approach, in which the prime analysis variable is the observed quantity (i.e., infrared radiances), has been found to be effective in deriving global meteorology from Mars Global Surveyor Thermal Emission Spectrometer data. It may also be useful in a number of terrestrial applications (e.g. aerosol assimilation).

Houben, Howard↗
NASA NTRS2001

Global Gridded Data from the Goddard Earth Observing System Data Assimilation System (GEOS-DAS)

The Goddard Earth Observing System Data Assimilation System (GEOS-DAS) timeseries is a globally gridded atmospheric data set for use in climate research. This near real-time data set is produced by the Data Assimilation Office (DAO) at the NASA Goddard Space Flight Center in direct support of the operational EOS instrument product generation from the Terra (12/1999 launch), Aqua (05/2002 launch) and Aura (01/2004 launch) spacecrafts. The data is archived in the EOS Core System (ECS) at the Goddard Earth Sciences Data and Information Services Center/Distributed Active Archive Center (GES DISC DAAC). The data is only a selection of the products available from the GEOS-DAS. The data is organized chronologically in timeseries format to facilitate the computation of statistics. GEOS-DAS data will be available for the time period January 1, 2000, through present.

Source record↗
NASA NTRS2000

Short-Term Retrospective Land Data Assimilation Schemes

Subsurface moisture and temperature and snow/ice stores exhibit persistence on various time scales that has important implications for the extended prediction of climatic and hydrologic extremes. Hence, to improve their specification of the land surface, many numerical weather prediction (NWP) centers have incorporated complex land surface schemes in their forecast models. However, because land storages are integrated states, errors in NWP forcing accumulates in these stores, which leads to incorrect surface water and energy partitioning. This has motivated the development of Land Data Assimilation Schemes (LDAS) that can be used to constrain NWP surface storages. An LDAS is an uncoupled land surface scheme that is forced primarily by observations, and is therefore less affected by NWP forcing biases. The implementation of an LDAS also provides the opportunity to correct the model's trajectory using remotely-sensed observations of soil temperature, soil moisture, and snow using data assimilation methods. The inclusion of data assimilation in LDAS will greatly increase its predictive capacity, as well as provide high-quality land surface assimilated data.

Houser, P. R.↗
NASA NTRS2018

Air Quality Modeling Using the NASA GEOS-5 Multispecies Data Assimilation System

The NASA Goddard Earth Observing System (GEOS) data assimilation system (DAS) has been expanded to include chemically reactive tropospheric trace gases including ozone (O3), nitrogen dioxide (NO2), and carbon monoxide (CO). This system combines model analyses from the GEOS-5 model with detailed atmospheric chemistry and observations from MLS (O3), OMI (O3 and NO2), and MOPITT (CO). We show results from a variety of assimilation test experiments, highlighting the improvements in the representation of model species concentrations by up to 50% compared to an assimilation-free control experiment. Taking into account the rapid chemical cycling of NO2 when applying the assimilation increments greatly improves assimilation skills for NO2 and provides large benefits for model concentrations near the surface. Analysis of the geospatial distribution of the assimilation increments suggest that the free-running model overestimates biomass burning emissions but underestimates lightning NOx emissions by 5-20%. We discuss the capability of the chemical data assimilation system to improve atmospheric composition forecasts through improved initial value and boundary condition inputs, particularly during air pollution events. We find that the current assimilation system meaningfully improves short-term forecasts (1-3 day). For longer-term forecasts more emphasis on updating the emissions instead of initial concentration fields is needed.

Keller, Christoph A.↗
NASA NTRS2019

Synthesis of Ocean Observations Using Data Assimilation for Operational, Real-Time and Reanalysis Systems: A More Complete Picture of the State of the Ocean

Ocean data assimilation is increasingly recognized as crucial for the accuracy of realtime ocean prediction systems and historical re-analyses. The current status of ocean data assimilation in support of the operational demands of analysis, forecasting and reanalysis is reviewed, focusing on methods currently adopted in operational and realtime prediction systems. Significant challenges associated with the most commonly employed approaches are identified and discussed. Overarching issues faced by ocean data assimilation are also addressed, and important future directions in response to scientific advances, evolving and forthcoming ocean observing systems and the needs of stakeholders and downstream applications are discussed.

modeling↗
NASA NTRS2019

Evolving HPC and Application Design Toward a Coupled Data Assimilation System at NASA Suitable for Emerging Exascale Platforms

The prediction capabilities of global models have continuously evolved from the traditional medium-range global weather prediction application to span scales in support of hourly prediction of convective scale storms to seasonal Earth system prediction. This evolution has increased the demands on the system infrastructure design and workflow to achieve the required performance on modern high-performance computing (HPC) platforms. The planned evolution of the Goddard Earth Observing System (GEOS) modeling and assimilation system will stress the capabilities of conventional HPC overwhelming the available compute cycles at the NASA Center for Climate Simulation (NCCS) at the NASA Goddard Space Flight Center in the coming 5-10 years. This has led to the re-design of key elements of the assimilation and modeling systems to achieve significant gains in performance on anticipated Exacale platforms. The transition of the assimilation system to the Joint Effort for Data assimilation Integration (JEDI) framework has positioned GEOS to exploit new efficient algorithms for data assimilation (DA) in a fully-coupled Earth system context. The suitability of the GEOS model to leverage a domain specific language (DSL) approach and artificial intelligence (AI) is being explored to accelerate computational performance and data exchange efficiency of the coupled Earth system model. The storage and processing of large data volumes produced by these advance systems is being redesigned with a data-centric cloud-based approach. We will highlight the recent efforts in these areas and emphasize the demand for further development and re-design to achieve the science objectives in support of NASA's Earth system modeling and assimilation missions.

Putman, Bill↗
NASA NTRS2019

Diurnal Cycles in SST: Coupled Data Assimilation and Future Observational Requirements

Most operational centers are developing coupled (atmosphere-ocean) data assimilation systems as an alternative to uncoupled counterparts (atmosphere- or ocean-only). The Sea Surface Temperature (SST) is one of the key variables that tightly connects the atmosphere and ocean states and also air-sea fluxes. However, current prototype coupled data assimilation systems rely on external (L4) gridded SST or along-track (L3 or L2) SST retrievals as observed data or relaxation field. But in reality, SST are measurements are available from sparse in-situ network of ships, moorings, and buoys; all of them combined together are far less than those from satellites. However, satellites do not directly measure temperature, and inferring SST from satellite measured radiances requires a radiative transfer model, its calibration and also bias correction.The NASA Global Modeling and Assimilation Office (GMAO) is developing a coupled data assimilation system which assimilates SST directly from the raw observations, i.e., satellite radiances and in-situ observations. The methodology to directly assimilate radiances for SST became operational in Jan, 2017 in the GMAO's near-real time Weather Analysis and Prediction System. There were many modifications to the GMAO system in order to implement SST assimilation, most of which generally improved the predictability of the system. In order to maintain and further improve this system, we advocate for the availability of a microwave satellite radiometer in future beyond the currently operational GPM- GMI and AMSR-2 missions. For improved modeling of the near-surface temperature, salinity and mixing processes, we suggest adding more than one temperature sensor and salinity sensors to the drifting buoy network.

Akella, Santha↗
NASA NTRS2009

Multi-Scale Hydrometeorological Modeling, Land Data Assimilation and Parameter Estimation with the Land Information System

The Land Information System (LIS; http://lis.gsfc.nasa.gov; Kumar et al., 2006; Peters- Lidard et al.,2007) is a flexible land surface modeling framework that has been developed with the goal of integrating satellite- and ground-based observational data products and advanced land surface modeling techniques to produce optimal fields of land surface states and fluxes. As such, LIS represents a step towards the next generation land component of an integrated Earth system model. In recognition of LIS object-oriented software design, use and impact in the land surface and hydrometeorological modeling community, the LIS software was selected ase co-winner of NASA's 2005 Software of the Year award. LIS facilitates the integration of observations from Earth-observing systems and predictions and forecasts from Earth System and Earth science models into the decision-making processes of partnering agency and national organizations. Due to its flexible software design, LIS can serve both as a Problem Solving Environment (PSE) for hydrologic research to enable accurate global water and energy cycle predictions, and as a Decision Support System (DSS) to generate useful information for application areas including disaster management, water resources management, agricultural management, numerical weather prediction, air quality and military mobility assessment. LIS has evolved from two earlier efforts North American Land Data Assimilation System (NLDAS; Mitchell et al. 2004) and Global Land Data Assimilation System (GLDAS; Rodell al. 2004) that focused primarily on improving numerical weather prediction skills by improving the characterization of the land surface conditions. Both of GLDAS and NLDAS now use specific configurations of the LIS software in their current implementations. In addition, LIS was recently transitioned into operations at the US Air Force Weather Agency (AFWA) to ultimately replace their Agricultural Meteorology (AGRMET) system, and is also used routinely by NOAA's National Centers for Environmental Prediction (NCEP)/Environmental Modeling Center (EMC) for their land data assimilation systems to support weather and climate modeling. LIS not only consolidates the capabilities of these two systems, but also enables a much larger variety of configurations with respect to horizontal spatial resolution, input datasets and choice of land surface model through "plugins,". As described in Kumar et al., 2007, and demonstrated in Case et al., 2008, and Santanello et al., 2009, LIS has been coupled to the Weather Research and Forecasting (WRF) model to support studies of land-atmosphere coupling the enabling ensembles of land surface states to be tested against multiple representations of the atmospheric boundary layer. LIS has also been demonstrated for parameter estimation as described in Peters-Lidard et al. (2008) and Santanello et al. (2007), who showed that the use of sequential remotely sensed soil moisture products can be used to derive soil hydraulic and texture properties given a sufficient dynamic range in the soil moisture retrievals and accurate precipitation inputs. LIS has also recently been demonstrated for multi-model data assimilation (Kumar et al., 2008) using an Ensemble Kalman Filter for sequential assimilation of soil moisture, snow, and temperature. Ongoing work has demonstrated the value of bias correction as part of the filter, and also that of joint calibration and assimilation. Examples and case studies demonstrating the capabilities and impacts of LIS for hydrometeoroogical modeling, assimilation and parameter estimation will be presented as advancements towards the next generation of integrated observation and modeling systems.

Peters-Lidard, Christa D.↗
NASA NTRS2003

High-Frequency Planetary Waves in the Polar Middle Atmosphere as seen in a data Assimilation System

This study examines the winter southern hemisphere vortex of 1998 using four times daily output from a data assimilation system to focus on the polar 2-day, wave number 2 component of the 4-day wave. The data assimilation system products are from a test version of the finite volume data assimilation system (fvDAS) being developed at Goddard Space Flight Center (GSFC) and include an ozone assimilation system. Results show that the polar 2-day wave dominates during July 1998 at 70 degrees. The period of the quasi 2-day wave is somewhat shorter than 2 days (about 1.7 days) during July 1998 with an average perturbation temperature amplitude for the month of over 2.5 K. The 2-day wave propagates more slowly than the zonal mean zonal wind, consistent with Rossby wave theory, and has EP flux divergence regions associated with regions of negative horizontal potential vorticity gradients, as expected from linear instability theory. Results for the assimilation-produced ozone mixing ratio show that the 2-day wave represents a major source of ozone variation in this region. The ozone wave in the assimilation system is in good agreement with the wave seen in the POAM (Polar Ozone and Aerosol Measurement) ozone observations for the same time period. Some differences with linear instability theory are noted as well as spectral peaks in the ozone field, not seen in the temperature field, that may be a consequence of advection.

Coy, L.↗
NASA NTRS1999

I/O Parallelization for the Goddard Earth Observing System Data Assimilation System (GEOS DAS)

The National Aeronautics and Space Administration (NASA) Data Assimilation Office (DAO) at the Goddard Space Flight Center (GSFC) has developed the GEOS DAS, a data assimilation system that provides production support for NASA missions and will support NASA's Earth Observing System (EOS) in the coming years. The DAO's support of the EOS project along with the requirement of producing long-term reanalysis datasets with an unvarying system levy a large I/O burden on the future system. The DAO has been involved in prototyping parallel implementations of the GEOS DAS for a number of years and is now converting the production version from shared-memory parallelism to distributed-memory parallelism using the portable Message-Passing Interface (MPI). If the MPI-based GEOS DAS is to meet these production requirements, we must make I/O from the parallel system efficient. We have designed a scheme that allows efficient I/O processing while retaining portability, reducing the need for post-processing, and producing data formats that are required by our users, both internal and external. The first phase of the GEOS DAS Parallel I/O System (GPIOS) will expand upon the common method of gathering global data to a Single PE for output. Instead of using a PE also tasked with primary computation, a number of PEs will be dedicated to I/O and its related tasks. This allows the data transformations and formatting required prior to output to take place asynchronously with respect to the GEOS DAS assimilation cycle, improving performance and generating output data sets in a format convenient for our users. I/O PEs can be added as needed to handle larger data volumes or to meet user file specifications. We will show I/O performance results from a prototype MPI GCM integrated with GPIOS. Phase two of GPIOS development will examine ways of integrating new software technologies to further improve performance and build scalability into the system. The maturing of MPI-IO implementations and other supporting libraries such as parallel HDF should provide performance gains while retaining portability.

Lucchesi, R.↗
NASA NTRS2001

Advances in Land Data Assimilation Systems

Assimilation of remotely sensed land surface observations into regional to global scale numerical models have the potential to significantly advance our ability, to assess, understand, and predict surface water, energy, and carbon cycles. This session seeks to assess the state-of-the-art in data assimilation methods for integrating land surface remote sensing and modeling, with a focus on practical applications and techniques. Assimilated land surface variables of interest include (but are not limited to, soil moisture, surface temperature, snowpack, streamflow, vegetation dynamics, and carbon storage. Contributions describing the development of practical land surface data assimilation methods, multivariate land surface data assimilation strategies, evaluation of the required accuracy and resolution of remote sensing observations, the effects of scale, process complexity, and uncertainty on data assimilation, and the optimal treatment of model and observation errors are encouraged.

Houser, Paul R.↗
NASA NTRS2022

Perspective on Satellite-Based Land Data Assimilation to Estimate Water Cycle Components in an Era of Advanced Data Availability and Model Sophistication

The beginning of the 21st century is marked by a rapid growth of land surface satellite data and model sophistication. This offers new opportunities to estimate multiple components of the water cycle via satellite-based land data assimilation (DA) across multiple scales. By resolving more processes in land surface models and by coupling the land, the atmosphere, and other Earth system compartments, the observed information can be propagated to constrain additional unobserved variables. Furthermore, access to more satellite observations enables the direct constraint of more and more components of the water cycle that are of interest to end users. However, the finer level of detail in models and data is also often accompanied by an increase in dimensions, with more state variables, parameters, or boundary conditions to estimate, and more observations to assimilate. This requires advanced DA methods and efficient solutions. One solution is to target specific observations for assimilation based on a sensitivity study or coupling strength analysis, because not all observations are equally effective in improving subsequent forecasts of hydrological variables, weather, agricultural production, or hazards through DA. This paper offers a perspective on current and future land DA development, and suggestions to optimally exploit advances in observing and modeling systems.

Data Assimilation↗
NASA NTRS2000

The GEOS Ozone Data Assimilation System: Specification of Error Statistics

A global three-dimensional ozone data assimilation system has been developed at the Data Assimilation Office of the NASA/Goddard Space Flight Center. The Total Ozone Mapping Spectrometer (TOMS) total ozone and the Solar Backscatter Ultraviolet (SBUV) or (SBUV/2) partial ozone profile observations are assimilated. The assimilation, into an off-line ozone transport model, is done using the global Physical-space Statistical Analysis Scheme (PSAS). This system became operational in December 1999. A detailed description of the statistical analysis scheme, and in particular, the forecast and observation error covariance models is given. A new global anisotropic horizontal forecast error correlation model accounts for a varying distribution of observations with latitude. Correlations are largest in the zonal direction in the tropics where data is sparse. Forecast error variance model is proportional to the ozone field. The forecast error covariance parameters were determined by maximum likelihood estimation. The error covariance models are validated using x squared statistics. The analyzed ozone fields in the winter 1992 are validated against independent observations from ozone sondes and HALOE. There is better than 10% agreement between mean Halogen Occultation Experiment (HALOE) and analysis fields between 70 and 0.2 hPa. The global root-mean-square (RMS) difference between TOMS observed and forecast values is less than 4%. The global RMS difference between SBUV observed and analyzed ozone between 50 and 3 hPa is less than 15%.

Stajner, Ivanka↗
DOE OSTI2024

A Scalable Real-Time Data Assimilation Framework for Predicting Turbulent Atmosphere Dynamics

AI-based foundation models like FourCastNet, GraphCast are revolutionizing weather and climate predictions but are not yet ready for operational use. Their limitation lies in the absence of a data assimilation system to incorporate real-time Earth system observations, crucial for accurately forecasting events like tropical cyclones. To overcome these obstacles, we introduce a generic real-time data assimilation framework and demonstrate its end-to-end performance on the Frontier supercomputer. This framework comprises two primary modules: an ensemble score filter (EnSF), which significantly outperforms the state-of-the-art data assimilation method, and a vision transformer-based surrogate capable of real-time adaptation through the integration of observational data. We demonstrate both the strong and weak scaling of our framework up to 1024 GPUs on the Exascale supercomputer, Frontier. Our results not only illustrate the framework's exceptional scalability on high-performance computing systems, but also demonstrate the importance of supercomputers in real-time data assimilation for weather and climate predictions.

Lu, Dan↗
DOE OSTI2025

Data Assimilation for Robust UQ Within Agent-Based Simulation on HPC Systems

Agent-based simulation provides a powerful tool for in silico system modeling. However, these simulations do not provide built-in methods for uncertainty quantification (UQ). Within these types of models a typical approach to UQ is to run multiple realizations of the model then compute aggregate statistics. This approach is limited due to the compute time required for a solution. When faced with an emerging biothreat, public health decisions need to be made quickly and solutions for integrating near real-time data with analytic tools are needed. We propose an integrated Bayesian UQ framework for agent-based models based on sequential Monte Carlo sampling. Given streaming or static data about the evolution of an emerging pathogen this Bayesian framework provides a distribution over the parameters governing the spread of a disease through a population. These estimates of the spread of a disease may be provided to public health agencies seeking to abate the spread. By coupling agent-based simulations with Bayesian modeling in a data assimilation, our proposed framework provides a powerful tool for modeling dynamical systems in silico. We propose a method which reduces model error and provides a range of realistic possible outcomes. Moreover, our method addresses two primary limitations of ABMs: the lack of UQ and an inability to assimilate data. Our proposed framework combines the flexibility of an agent-based model with UQ provided by the Bayesian paradigm in a workflow which scales well to HPC systems. We provide algorithmic details and results on a simulated outbreak with both static and streaming data.

Spannaus, Adam [ORNL] (ORCID:0000000225213657)↗
NASA NTRS2000

The DAO Retrospective Data Assimilation System

The fixed-lag Kalman smoother of Cohn et al. (1994), or a version of a more computationally feasible approximation of it developed by Todling et al. (1998), is under implementation at the Data Assimilation Office (DAO) to build a retrospective data assimilation system (RDAS). The initial version of the RDAS uses the physical-space statistical analysis system and a modification of the incremental analysis update (IAU) procedure of Bloom et al. (1996); a follow up version of the RDAS Nill require the use of the adjoint of the DAO general circulation model (developed by Y. Yang and M Navon). The retrospective procedure is designed to produce improved analyses as well as improved assimilated fields consequently providing an improved climate representation through data assimilation.

Todling, Richardo↗