Search NASA⌕ Search

SEARCH · Search NASA

Results for “data challenges”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16

Intelligent Systems: Terrestrial Observation and Prediction Using Remote Sensing Data

NASA has made science and technology investments to better utilize its large space-borne remote sensing data holdings of the Earth. With the launch of Terra, NASA created a data-rich environment where the challenge is to fully utilize the data collected from EOS however, despite unprecedented amounts of observed data, there is a need for increasing the frequency, resolution, and diversity of observations. Current terrestrial models that use remote sensing data were constructed in a relatively data and compute limited era and do not take full advantage of on-line learning methods and assimilation techniques that can exploit these data. NASA has invested in visualization, data mining and knowledge discovery methods which have facilitated data exploitation, but these methods are insufficient for improving Earth science models that have extensive background knowledge nor do these methods refine understanding of complex processes. Investing in interdisciplinary teams that include computational scientists can lead to new models and systems for online operation and analysis of data that can autonomously improve in prediction skill over time.

Coughlan, Joseph C.↗

Transforming Science Data for GIS: How to Find and Use NASA Earth Observation Data Without Being a Rocket Scientist

NASAs Earth Observing System Data Information System (EOSDIS) manages Earth Observation satellites and the Distributed Active Archive Centers (DAACs), where the data is stored and processed. The challenge is that Earth Observation data is complicated. There is plenty of data available, however, the science teams have had a top-down approach: define what it is you are trying to study -select a set of satellite(s) and sensor(s), and drill down for the data.Our alternative is to take a bottom-up approach using eight environmental fields of interest as defined by the Group on Earth Observations (GEO) called Societal Benefit Areas (SBAs): Disaster Resilience (DR) Public Health Surveillance (PHS) Energy and Mineral Resource Management (EMRM) Water Resources Management (WRM) Infrastructure and Transport Management (ITM) Sustainable Urban Development (SUD) Food Security and Sustainable Agriculture (FSSA) Biodiversity and Ecosystems Sustainability (BES).

DAAC↗

Giovanni - The Bridge Between Data and Science

This article describes new features in the Geospatial Interactive Online Visualization ANd aNalysis Infrastructure (Giovanni), a user-friendly online tool that enables visualization, analysis, and assessment of NASA Earth science data sets without downloading data and software. Since the satellite era began, data collected from Earth-observing satellites have been widely used in research and applications; however, using satellite-based data sets can still be a challenge to many. To facilitate data access and evaluation, as well as scientific exploration and discovery, the NASA Goddard Earth Sciences (GES) Data and Information Services Center (DISC) has developed Giovanni for a wide range of users around the world. This article describes the latest capabilities of Giovanni with examples, and discusses future plans for this innovative system.

GPM↗

Serving NASA GES DISC Multi-Spatiotemporal Earth Science Data to the GIS community

NASA Earth Science (ES) data is essential to a wide range of GIS research and applications. However, for many GIS users, searching, accessing, using and analyzing NASA ES data can be of a great challenge- ranging from the sheer data volumes, types of science parameters, and to the complexity of data encoding formats. As one of the twelve NASA Science Mission Directorate (SMD) Data Centers, Goddard Earth Sciences (GES) Data and Information Services Center (DISC) archives and distributes petabytes of ES parameters covering atmosphere, land, and ocean fields. Most data are multidimensional and multi-spatiotemporal in nature and are encoded in different science data formats (e.g, HDF, HDF-EOS, netCDF, GRIB, binary), which usually contain multiple variables and different metadata information. By far, GES DISC has been developing a number of services and online tools to help GIS users to easily explore our data products. In this presentation, we will describe our ArcGIS-based data accessing and visualization services and portals, which allow users directly exploring the multi-spatiotemporal ES data in ArcGIS clients without having to pre-download/import the data. The ArcGIS services are also compliant with the Open Geospatial Consortium (OGC) Web Coverage Service (WCS) and Web Map Service (WMS) protocols and can be accessed by any other WCS/WMS clients to get customized GES DISC EO data on-the-fly from such services.

Wei, Jennifer↗

An Evaluation of Remotely Sensed and In-Situ Data Sufficiency for SGMA-Scale Groundwater Studies in the Central Valley, California

California’s Central Valley aquifer is a critical freshwater resource for the state, providing drinking water to 6.5 million residents and irrigation water for more than half of the nation’s produce. Increasing demands have led to a steady decline of aquifer water levels, leading to irreversible compaction and land subsidence. The Sustainable Groundwater Management Act of California (SGMA), instituted in 2014, requires high-priority regions to establish sustainability plans by 2020-2022 that mitigate groundwater depletion and land subsidence. Many regions within the Central Valley lack groundwater monitoring wells or continuous well data, rendering in-situ monitoring challenging. When combined with other data, NASA’s Gravity Recovery and Climate Experiment (GRACE) and GRACE Follow On (GRACE-FO) missions provide valuable information about groundwater storage changes at a sub-basin scale. Interferometric Surface Aperture Radar (InSAR) measurements can map land subsidence, and Global Positioning System (GPS) can be used to estimate crustal uplift. Yet, all of these measurements have differences in resolution, coverage, discretization, and record length. Here we assess the various datasets that are potentially useful for Central Valley sub-basin groundwater monitoring and provide an analysis of gaps and other issues in regard to their suitability for SGMA-related analysis. Finally, we offer next steps and recommendations on data treatment and integration.

Kyra H Kim↗

Analyzing Electric Field Morphology Through Data-Model Comparisons of the GEM IM/S Assessment Challenge Events

The storm-time inner magnetospheric electric field morphology and dynamics are assessed by comparing numerical modeling results of the plasmasphere and ring current with many in situ and remote sensing data sets. Two magnetic storms are analyzed, April 22,2001 and October 21-23,2001, which are the events selected for the Geospace Environment Modeling (GEM) Inner Magnetosphere/Storms (IM/S) Assessment Challenge (IMSAC). The IMSAC seeks to quantify the accuracy of inner magnetospheric models as well as synthesize our understanding of this region. For each storm, the ring current-atmosphere interaction model (RAM) and the dynamic global core plasma model (DGCPM) were run together with various settings for the large-scale convection electric field and the nightside ionospheric conductance. DGCPM plasmaspheric parameters were compared with IMAGE-EUV plasmapause extractions and LANL-MPA plume locations and velocities. RAM parameters were compared with Dst*, LANL-MPA fluxes and moments, IMAGE-MENA images, and IMAGE-HENA images. Both qualitative and quantitative comparisons were made to determine the electric field morphology that allows the model results to best fit the plasma data at various times during these events. The simulations with self-consistent electric fields were, in general, better than those with prescribed field choices. This indicates that the time-dependent modulation of the inner magnetospheric electric fields by the nightside ionosphere is quite significant for accurate determination of these fields (and their effects). It was determined that a shielded Volland-Stern field description driven by the 3-hour Kp index yields accurate results much of the time, but can be quite inconsistent. The modified Mcllwain field description clearly lagged in overall accuracy compared to the other fields, but matched some data sets (like Dst*) quite well. The rankings between the simulations varied depending on the storm and the individual data sets, indicating that each field description did well for some place, time, and energy range during the events, as well as doing less well in other places, times, and energies. Several unresolved issues regarding the storm-time inner magnetospheric electric field are discussed.

Liemohn, Michael W.↗

Quantifying Interannual Variability of the UTLS Ozone Using Assimilation of Satellite Data

An accurate representation of spatial and temporal variability of the Upper Troposphere Lower Stratosphere (UTLS) ozone is essential for understanding both the tropospheric ozone budget and ozone s contribution to radiative forcing. The complex, dynamically driven structure of trace gas fields in the UTLS presents a challenge to data-based and modelling studies. Small features are not fully resolved in data from limb-sounding instruments such as the Microwave Limb Sounder on EOS-Aura (the EOS-MLS), but are captured in assimilation of those data as vertical structure is added from the assimilated meteorology. This will be demonstrated using a multi-year assimilation of EOS-MLS observations in the Goddard Earth Observing System, Version 5 (GEOS-5) data assimilation system. The results demonstrate the realism of the seasonal and year to year variability of laminar structures in the mid-latitudinal ozone field between years 2005-2007, for which independent validation data are available from the HIRDLS instrument. The analysis is done in the context of the underlying large scale dynamics. The lifetimes of most research instruments are too short for them to be used throughout the duration of long-term (at least 3 decades) reanalyses. For example, the EOS-MLS instrument has operated since mid-2004 until present. By contrast, Solar Backscatter Ultra Violet (SBUV) measurements provide continuous data since late 1978, but their vertical resolution is insufficient to represent the profile shape in the UTLS. Assimilation of these SBUV/2 observations in the GEOS-5 data assimilation system has hitherto not captured a realistic ozone structure in the UTLS, even though transport studies using GEOS-5 wind fields do show such structures. We show that careful construction of the background error covariance structure in GEOS-5 can lead to more realistic UTLS ozone fields when assimilating SBUV/2 observations. The reasoning behind this will be discussed, emphasizing the need to retain the sharp gradient of ozone concentrations across the tropopause. We analyze the UTLS ozone distributions in multi-year SBUV/2 assimilation experiments, comparing the results against the independent HIRDLSdataset and, for a longer period, with the MLS assimilation and discuss the consequences for tropospheric ozone and radiative forcing.

Wargan, K.↗

Solar Thermal Upper Stage Liquid Hydrogen Pressure Control Testing and Analytical Modeling

The demonstration of a unique liquid hydrogen (LH2) storage and feed system concept for solar thermal upper stage was cooperatively accomplished by a Boeing/NASA Marshall Space Flight Center team. The strategy was to balance thermodynamic venting with the engine thrusting timeline during a representative 30-day mission, thereby, assuring no vent losses. Using a 2 cubic m (71 cubic ft) LH2 tank, proof-of-concept testing consisted of an engineering checkout followed by a 30-day mission simulation. The data were used to anchor a combination of standard analyses and computational fluid dynamics (CFD) modeling. Dependence on orbital testing has been incrementally reduced as CFD codes, combined with standard modeling, continue to be challenged with test data such as this.

Olsen, A. D.↗

Software Engineering Support of the Third Round of Scientific Grand Challenge Investigations: An Earth Modeling System Software Framework Strawman Design that Integrates Cactus and UCLA/UCB Distributed Data Broker

One of the most significant challenges in large-scale climate modeling, as well as in high-performance computing in other scientific fields, is that of effectively integrating many software models from multiple contributors. A software framework facilitates the integration task. both in the development and runtime stages of the simulation. Effective software frameworks reduce the programming burden for the investigators, freeing them to focus more on the science and less on the parallel communication implementation, while maintaining high performance across numerous supercomputer and workstation architectures. This document proposes a strawman framework design for the climate community based on the integration of Cactus, from the relativistic physics community, and UCLA/UCB Distributed Data Broker (DDB) from the climate community. This design is the result of an extensive survey of climate models and frameworks in the climate community as well as frameworks from many other scientific communities. The design addresses fundamental development and runtime needs using Cactus, a framework with interfaces for FORTRAN and C-based languages, and high-performance model communication needs using DDB. This document also specifically explores object-oriented design issues in the context of climate modeling as well as climate modeling issues in terms of object-oriented design.

Talbot, Bryan↗

Development of an expert data reduction assistant

We propose the development of an expert system tool for the management and reduction of complex data sets. The proposed work is an extension of a successful prototype system for the calibration of CCD images developed by Dr. Johnston in 1987. The reduction of complex multi-parameter data sets presents severe challenges to a scientist. Not only must a particular data analysis system be mastered, (e.g. IRAF/SDAS/MIDAS), large amounts of data can require many days of tedious work and supervision by the scientist for even the most straightforward reductions. The proposed Expert Data Reduction Assistant will help the scientist overcome these obstacles by developing a reduction plan based on the data at hand and producing a script for the reduction of the data in a target common language.

Miller, Glenn E.↗

Development of an expert data reduction assistant

We propose the development of an expert system tool for the management and reduction of complex datasets. the proposed work is an extension of a successful prototype system for the calibration of CCD (charge coupled device) images developed by Dr. Johnston in 1987. (ref.: Proceedings of the Goddard Conference on Space Applications of Artificial Intelligence). The reduction of complex multi-parameter data sets presents severe challenges to a scientist. Not only must a particular data analysis system be mastered, (e.g. IRAF/SDAS/MIDAS), large amounts of data can require many days of tedious work and supervision by the scientist for even the most straightforward reductions. The proposed Expert Data Reduction Assistant will help the scientist overcome these obstacles by developing a reduction plan based on the data at hand and producing a script for the reduction of the data in a target common language.

Miller, Glenn E.↗

Climatespark: an In-Memory Distributed Computing Framework for Big Climate Data Analytics

The unprecedented growth of climate data creates new opportunities for climate studies, and yet big climate data pose a grand challenge to climatologists to efficiently manage and analyze big data. The complexity of climate data content and analytical algorithms increases the difficulty of implementing algorithms on high performance computing systems. This paper proposes an in-memory, distributed computing framework, ClimateSpark, to facilitate complex big data analytics and time-consuming computational tasks. Chunking data structure improves parallel I/O efficiency, while a spatiotemporal index is built for the chunks to avoid unnecessary data reading and preprocessing. An integrated, multi-dimensional, array-based data model (ClimateRDD) and ETL operations are developed to address big climate data variety by integrating the processing components of the climate data lifecycle. ClimateSpark utilizes Spark SQL and Apache Zeppelin to develop a web portal to facilitate the interaction among climatologists, climate data, analytic operations and computing resources (e.g., using SQL query and Scala/Python notebook). Experimental results show that ClimateSpark conducts different spatiotemporal data queries/analytics with high efficiency and data locality. ClimateSpark is easily adaptable to other big multiple- dimensional, array-based datasets in various geoscience domains.

Hu, Fei↗

The Last Orbit: Planning Cassini's Plummet into Saturn

Cassini’s final orbit around Saturn will culminate in a dramatic ending as the spacecraft plunges into the ringed planet’s atmosphere, never to escape or be heard from again. The last hours of the mission prior to the final loss of signal have some of the most unique and valuable science to date. Cassini will take a unique trajectory to dive deep into the atmosphere on its approach to final disposal and no spacecraft, Cassini included, has entered these depths of Saturn’s atmosphere. The science community has placed heavy emphasis onthis once-in-a-lifetime opportunity to inspect these deeper regions of Saturn’s atmosphere. The Cassini project specifically aims to collect the very last bits of data during the final plunge to get samples of the deepest regions before the spacecraft is lost forever. The desire to collect the final bits of data presents several challenges. Cassini’s Mission Planning (MP) team has developed an End of Mission (EOM) scenario to tackle these demands. The EOM scenario outlines the framework for the entire last orbit of the mission and details thestrategy for data collection and transmission. Attaining near real-time transmission is key for the acquisition of the very last bits of data. The Cassini spacecraft will use a new mode of operations to successfully achieve this real-time transmission. In addition to this primary investigation and planning for telecommunications, key risks have been studied within the realm of the last orbit. Ultimately, this paper shows how the Cassini Project plans to ensurethe return of every last bit of data before the spacecraft is consumed by Saturn forever.

Bittner, Molly E.↗

Wavenumber Domain Focusing of Squinted SAR Data with a Curved Orbit Geometry

Synthetic Aperture Radar systems provide raw data that need focusing to achieve full-resolution imaging. Current SAR applications, including interferometry, require accurate, phase-preserving, and precisely co-registered coherent images over large ground swaths with the highest achievable resolution. In addition to these challenges, stripmap SAR data may be acquired with an off-broadside (squinted) geometry, either by design or through platform motion. The precise batch focusing of these large aperture and wide bandwidth data sets is known to require a 2D frequency processing approach. The standard wave domain focusing algorithm, however, is only exact for data acquired on a rectilinear trajectory. We investigate a generalization of the standard omega-k focusing formulation that allows curved data acquisition tracks. The new formulation can be used in conjunction with a known extension for conical, squinted imaging grids. The approximations necessary to allow the generalized geometry are analyzed to determine the range of applicability of the proposed algorithm. The theory is validated using data simulated with parameters similar to the UAVSAR L-band SAR system.

curved orbit geometry↗

Coupled Data Assimilation for Integrated Earth System Analysis and Prediction: Goals, Challenges, and Recommendations

The purpose of this report is to identify fundamental issues for coupled data assimilation (CDA), such as gaps in science and limitations in forecasting systems, in order to provide guidance to the World Meteorological Organization (WMO) on how to facilitate more rapid progress internationally. Coupled Earth system modeling provides the opportunity to extend skillful atmospheric forecasts beyond the traditional two-week barrier by extracting skill from low-frequency state components such as the land, ocean, and sea ice. More generally, coupled models are needed to support seamless prediction systems that span timescales from weather, subseasonal to seasonal (S2S), multiyear, and decadal. Therefore, initialization methods are needed for coupled Earth system models, either applied to each individual component (called Weakly Coupled Data Assimilation - WCDA) or applied the coupled Earth system model as a whole (called Strongly Coupled Data Assimilation - SCDA). Using CDA, in which model forecasts and potentially the state estimation are performed jointly, each model domain benefits from observations in other domains either directly using error covariance information known at the time of the analysis (SCDA), or indirectly through flux interactions at the model boundaries (WCDA). Because the non-atmospheric domains are generally under-observed compared to the atmosphere, CDA provides a significant advantage over single-domain analyses. Next, we provide a synopsis of goals, challenges, and recommendations to advance CDA: Goals: (a) Extend predictive skill beyond the current capability of NWP (e.g. as demonstrated by improving forecast skill scores), (b) produce physically consistent initial conditions for coupled numerical prediction systems and reanalyses (including consistent fluxes at the domain interfaces), (c) make best use of existing observations by allowing observations from each domain to influence and improve the full earth system analysis, (d) develop a robust observation-based identification and understanding of mechanisms that determine the variability of weather and climate, (e) identify critical weaknesses in coupled models and the earth observing system, (f) generate full-field estimates of unobserved or sparsely observed variables, (g) improve the estimation of the external forcings causing changes to climate, (h) transition successes from idealized CDA experiments to real-world applications. Challenges: (a) Modeling at the interfaces between interacting components of coupled Earth system models may be inadequate for estimating uncertainty or error covariances between domains, (b) current data assimilation methods may be insufficient to simultaneously analyze domains containing multiple spatiotemporal scales of interest, (c) there is no standardization of observation data or their delivery systems across domains, (d) the size and complexity of many large-scale coupled Earth system models makes it is difficult to accurately represent uncertainty due to model parameters and coupling parameters, (e) model errors lead to local biases that can transfer between the different Earth system components and lead to coupled model biases and long-term model drift, (e) information propagation across model components with different spatiotemporal scales is extremely complicated, and must be improved in current coupled modeling frameworks, (h) there is insufficient knowledge on how to represent evolving errors in non-atmospheric model components (e.g. as sea ice, land and ocean) on the timescales of NWP.

CDA↗

Build-Up Approach to Updating the Mock Quiet Spike Beam Model

When a new aircraft is designed or a modification is done to an existing aircraft, the aeroelastic properties of the aircraft should be examined to ensure the aircraft is flight worthy. Evaluating the aeroelastic properties of a new or modified aircraft can include performing a variety of analyses, such as modal and flutter analyses. In order to produce accurate results from these analyses, it is imperative to work with finite element models (FEM) that have been validated by or correlated to ground vibration test (GVT) data, Updating an analytical model using measured data is a challenge in the area of structural dynamics. The analytical model update process encompasses a series of optimizations that match analytical frequencies and mode shapes to the measured modal characteristics of structure. In the past, the method used to update a model to test data was "trial and error." This is an inefficient method - running a modal analysis, comparing the analytical results to the GVT data, manually modifying one or more structural parameters (mass, CG, inertia, area, etc.), rerunning the analysis, and comparing the new analytical modal characteristics to the GVT modal data. If the match is close enough (close enough defined by analyst's updating requirements), then the updating process is completed. If the match does not meet updating-requirements, then the parameters are changed again and the process is repeated. Clearly, this manual optimization process is highly inefficient for large FEM's and/or a large number of structural parameters. NASA Dryden Flight Research Center (DFRC) has developed, in-house, a Mode Matching Code that automates the above-mentioned optimization process, DFRC's in-house Mode Matching Code reads mode shapes and frequencies acquired from GVT to create the target model. It also reads the current analytical model, as we11 as the design variables and their upper and lower limits. It performs a modal analysis on this model and modifies it to create an updated model that has similar mode shapes and frequencies as those of the target model. The Mode Matching Code output frequencies and modal assurance criteria (MAC) values that allow for the quantified comparison of the updated model versus the target model. A recent application of this code is the F453 supersonic flight testing platform, NASA DFRC possesses a modified F-15B that is used as a test bed aircraft for supersonic flight experiments. Traditionally, the finite element model of the test article is generated. A GVT is done on the test article ta validate and update its FEM. This FEM is then mated to the F-15B model, which was correlated to GVT data in fall of 2004, A GVT is conducted with the test article mated to the aircraft, and this mated F-15B/ test article FEM is correlated to this final GVT.

Herrera, Claudia Y.↗

Challenger STS-17 (41-G) post-flight best estimate trajectory products: Development and summary results

Results from the STS-17 (41-G) post-flight products are presented. Operational Instrumentation recorder gaps, coupled with the limited tracking coverage available for this high inclination entry profile, necessitated selection of an anchor epoch for reconstruction corresponding to an unusually low altitude of h approx. 297 kft. The final inertial trajectory obtained, BT17N26/UN=169750N, is discussed in Section I, i.e., relative to the problems encountered with the OI and ACIP recorded data on this Challenger flight. Atmospheric selection, again in view of the ground track displacement from the remote meteorological sites, constituted a major problem area as discussed in Section II. The LAIRS file provided by Langley was adopted, with NOAA data utilized over the lowermost approx. 7 kft. As discussed in Section II, the Extended BET, ST17BET/UN=274885C, suggests a limited upper altitude (H approx. 230 kft) for which meaningful flight extraction can be expected. This is further demonstrated, though not considered a limitation, in Section III wherein summary results from the AEROBET (NJ0333 with NJ0346 as duplicate) are presented. GTFILEs were generated only for the selected IMU (IMU2) and the Rate Gyro Assembly/Accelerometer Assembly data due to the loss of ACIP data. Appendices attached present inputs for the generation of the post-flight products (Appendix A), final residual plots (Appendix B), a two second spaced listing of the relevant parameters from the Extended BET (Appendix C), and an archival section (Appendix D) devoting input (source) and output files and/or physical reels.

Kelly, G. M.↗