Search NASA⌕ Search

SEARCH · Search NASA

Results for “data challenges”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 523 records · Page 29

Exploring our Changing Planet through NASA’s Earth Information Center and Novel Methods for Earth Science Communication

In June 2023, NASA unveiled the Earth Information Center (EIC), an interagency initiative which invites the global community to explore how our planet is changing through interactive installations, captivating visualizations, and novel storytelling. Existing in both physical and virtual space, the EIC serves as a gateway to actionable information collected through an expanding fleet of Earth observing satellites and sensors. The EIC features data driven visualizations, near real-time information, immersive experiences, and curated stories that highlight the applications of publicly available data to address environmental challenges across nine thematic areas: agriculture, biodiversity, disasters, greenhouse gases, air quality, sea level rise, sustainable energy, water resources, and wildfires. Designed by an interdisciplinary team, EIC exhibits are developed to reach a wide base of end-users across multiple learning modalities. During the first year of operation, the inaugural location of the EIC at NASA Headquarters in Washington, DC, welcomed an estimated 24,000 visitors, hosted over 145 tours for domestic and international organizations, supported NASA’s Earth Day 2024 programming, and led six STEM programs for diverse student communities. With lessons learned from the first year of being open to the public and a variety of novel science communication tools in development, the EIC is expanding the mission’s reach by collaborating with museums and visitor centers. Through these collaborations, we aim to inform a broader demographic about the unprecedented changes observed in Earth’s climate and inspire communities to learn more about their one and only home, planet Earth.

Nicole Ramberg-Pihl↗

Evaluating Cloud Computing in the Proposed NASA DESDynI Ground Data System

The proposed NASA Deformation, Ecosystem Structure and Dynamics of Ice (DESDynI) mission would be a first-of-breed endeavor that would fundamentally change the paradigm by which Earth Science data systems at NASA are built. DESDynI is evaluating a distributed architecture where expert science nodes around the country all engage in some form of mission processing and data archiving. This is compared to the traditional NASA Earth Science missions where the science processing is typically centralized. What's more, DESDynI is poised to profoundly increase the amount of data collection and processing well into the 5 terabyte/day and tens of thousands of job range, both of which comprise a tremendous challenge to DESDynI's proposed distributed data system architecture. In this paper, we report on a set of architectural trade studies and benchmarks meant to inform the DESDynI mission and the broader community of the impacts of these unprecedented requirements. In particular, we evaluate the benefits of cloud computing and its integration with our existing NASA ground data system software called Apache Object Oriented Data Technology (OODT). The preliminary conclusions of our study suggest that the use of the cloud and OODT together synergistically form an effective, efficient and extensible combination that could meet the challenges of NASA science missions requiring DESDynI-like data collection and processing volumes at reduced costs.

Benchmark↗

High-Capacity Communications from Martian Distances

High capacity communications from Martian distances, required for the envisioned human exploration and desirable for data-intensive science missions, is challenging. NASA s Deep Space Network currently requires large antennas to close RF telemetry links operating at kilobit-per-second data rates. To accommodate higher rate communications, NASA is considering means to achieve greater effective aperture at its ground stations. This report, focusing on the return link from Mars to Earth, demonstrates that without excessive research and development expenditure, operational Mars-to-Earth RF communications systems can achieve data rates up to 1 Gbps by 2020 using technology that today is at technology readiness level (TRL) 4-5. Advanced technology to achieve the needed increase in spacecraft power and transmit aperture is feasible at an only moderate increase in spacecraft mass and technology risk. In addition, both power-efficient, near-capacity coding and modulation and greater aperture from the DSN array will be required. In accord with these results and conclusions, investment in the following technologies is recommended:(1) lightweight (1 kg/sq m density) spacecraft antenna systems; (2) a Ka-band receive ground array consisting of relatively small (10-15 m) antennas; (3) coding and modulation technology that reduces spacecraft power by at least 3 dB; and (4) efficient generation of kilowatt-level spacecraft RF power.

Williams, W. Dan↗

Upgrading the 14x22 Data Acquisition System (DAS)

The 14-by 22-Foot Subsonic Tunnel recently completed development and installation of a new Data Acquisition System for use in the tunnel and in the Rotor Test Cell (RTC). Planning and development of this new system has been ongoing for several years, and installation was performed over this past year. This effort also required an upgrade of the facility infrastructure to support the upgraded power and cooling requirements. This presentation summarizes the new data acquisition system, improved capabilities, challenges of installation, and proposed future enhancements to the system.

wind tunnel↗

Automatic Incorporation of Flaws into Cad and FEA Models Based On Measured NDE Data

Automatic incorporation of non-destructive evaluation (NDE) data into CAD and finite element (FE) models for structural analysis is essential for accurate residual-life and strength analyses of composite structures. Currently, two significant but independent challenges exist for incorporating NDE data in such analyses: interpretation of the NDE signals to locate and characterize the structural defects and the incorporation of that information into structural analysis tools. The first challenge will be addressed through linear inversion of calculated synthetic responses generated by a simulation engine to evaluate flaw size, location, and other characteristics. The second challenge will be addressed by building on prior and parallel defect modeling efforts to integrate suitable flaw models into the CAD/finite-element representation of a specimen. Ultrasonic NDE information is usually represented using C-Scans of time-of-flight or intensity information. Other modalities such as thermography and computed tomography (CT) could also be used to characterize the structure. This information will first be projected into material coordinates and then aligned with the specimen’s finite element mesh. The NDE data can then be incorporated by inserting flaw geometry into the CAD and FE analysis model and automatic modification of local material properties and boundary conditions. This process will enable the use of structural analysis tools even for practical modalities such as ultrasound and thermography which may not directly give accurate-enough geometric information to fully define the flaw. The full flaw characteristics will be inferred using prior expert and modeling knowledge to categorize flaw signatures. Outputs for this project will include demonstrated methods for creating structural analysis geometric models that incorporate flaw characterization information; these models can then be used directly in popular commercial FEA software. In addition, the primary deliverable for the project will include a software that will be able to automatically incorporate different kinds of flaws into an existing FE models. The models will be generated in standard file formats to enable direct import into the analysis software.

Adarsh Krishnamurthy↗

Sensor Data Distribution With Robustness and Reliability: Toward Distributed Components Model

In planetary surface exploration mission, sensor data distribution is required in many aspects, for example, in navigation, scheduling, planning, monitoring, diagnostics, and automation of the field tasks. The challenge is to distribute such data in the robust and reliable way so that we can minimize the errors caused by miscalculations, and misjudgments that based on the error data input in the mission. The ad-hoc wireless network on planetary surface is not constantly connected because of the nature of the rough terrain and lack of permanent establishments on the surface. There are some disconnected moments that the computation nodes will re-associate with different repeaters or access points until connections are reestablished. Such a nature requires our sensor data distribution software robust and reliable with ability to tolerant disconnected moments. This paper presents a distributed components model as a framework to accomplish such tasks. The software is written in Java and utilized the available Java Message Services schema and the Boss implementation. The results of field experimentations show that the model is very effective in completing the tasks.

Alena, Richard L.↗

Updates of Moderate Resolution Imaging Spectroradiometer On-Orbit Calibration Uncertainty Assessments

The Moderate Resolution Imaging Spectroradiometer (MODIS) instruments have successfully operated for more than 18 and 16 years, respectively, on-board the NASA’s Earth Observing System Terra and Aqua spacecraft. Both Terra and Aqua MODIS have significantly contributed to the advance of global Earth remote sensing applications with a broad range of science products that have been continuously produced since the beginning of each mission and freely distributed to users worldwide. MODIS collects data in 20 reflective solar bands (RSB) and 16 thermal emissive bands (TEB), covering wavelengths from 0.41 to 14.4 μm. Its level 1B (L1B) data products, which provide the input for the MODIS high-level science products, include the top of the atmosphere reflectance factors for the RSB, radiances for both the RSB and TEB, and associated uncertainty indices (UI) at a pixel-by-pixel level. This paper provides a brief review of MODIS L1B calibration algorithms, including a number of improvements made in recent years. It presents an update of sensor calibration uncertainty assessments with a focus on several new contributors resulting from on-orbit changes in sensor characteristics, approaches developed to address these changes, and the impact due to on-orbit changes on the L1B data quality. Also discussed are remaining challenges and potential improvements to be made to continuously maintain sensor calibration and data quality, particularly those related to the quality of MODIS L1B uncertainty.

Spectroradiometer↗

MERRA-2 Data and Analytic Services at NASA GES DISC for Climate Extremes Study

NASA's climate reanalysis datasets from the Modern Era Retrospective-analysis for Research and Applications, Version 2 (MERRA-2) contains numerous long-term atmosphere, land, and ocean data products from 1980-present. MERRA-2 datasets, such as precipitation, soil moisture, and temperature, have been used widely to study extreme events. The native archived MERRA-2 data files are day-file (hourly time interval) and month-file, containing up to 125 parameters in one file. Due to the large number of data files and volumes, it is challenging for users, especially the applications research community, to handle the original hourly data files for long time periods to analyze extreme events. In this presentation, we review MERRA-2 data for studies of extreme conditions, and demonstrate analytic services at the NASA Goddard Earth Sciences Data and Information Services Center (GES DISC). One of the current operational services, 'subsetter', allows users to download only specific data of interest, i.e. data selected by parameter, region, and time period. New services are under development that will provide more 'on-the-fly' statistical calculations when downloading data; improve efficiency when accessing long time-series data. We will provide additional "How-to" resources that include step-by-step instructions on data access and usage. We have tested restructuring of day-files in an optimized data cube, which has significantly improved system performance for accessing long time-series. Overall performance is associated with cube size and structure, data compression method, and how the data are accessed. The optimized data cube structure will enable better online analytic services for statistical analysis and extreme events mining. To demonstrate the service, we use an extreme drought associated with the anomalous 2016 monsoon over southern Asia. This prototype time-series service may be augmented in the cloud infrastructure in the future.

data access↗

Assimilated Hydrological Data at NASA GES DISC with Examples of Extreme Events

Extreme weather and climate events, such as heavy rainfall, heatwave, floods and droughts, and strong wind, can have devastating impacts on society. NASA and NOAA, based on independent analyses, recently announced that global surface temperatures in 2018 are the fourth warmest since 1880, behind only those of 2016, 2017, and 2015 (nasa.gov). Also in 2018, the United States experienced 14 billion-dollar disasters, ranking as the fourth highest total number of such events, behind only the years 2017, 2011, and 2016 (climate.gov). Many research studies have focused on acquiring observational and modeling data, to reveal linkages between increasing extreme events, global water and energy cycle, and global climate change. However, draw conclusions is still a challenge. NASA Goddard Earth Sciences Data and Information Services Center is one of twelve NASA Earth Observing System (EOS) data centers that process, archive, document, and distribute data from Earth science missions and related projects. The GES DISC hosts a wide range of remotely-sensed and model data and provides reliable and robust data access and services to users worldwide. This presentation provides a few examples of extreme event study that use Land Surface Model (LSM) assimilated, quality-controlled, and spatially and temporally consistent, hydrological data from the GES DISC. Also provided is a summary table for the hydrological data holdings, along with discussions of recent updates to data and data services.

Rui, Hualan↗

Assessment of ProgPy - An Open-Source Condition Monitoring and Diagnostics Tool

Traditional maintenance programs, such as corrective and preventive strategies, may lead to high costs and operational inefficiencies. Condition Monitoring and Diagnostics (CM&D) aims to improve these maintenance strategies by enabling timely insights into equipment health and performance. However, implementation of CM&D can be challenging without a robust framework that manages data efficiently, supports interoperability and simplifies integration. To address these challenges ProgPy, an open-source Python-based prognostics tool developed by NASA Ames Research Center, offers a structured solution for broader Prognostics and Health Management (PHM) applications. Ongoing research is assessing the feasibility of implementing ProgPy as a Condition Monitoring and Diagnostics (CM&D) solution by comparing its framework to the guidelines for open CM&D systems recommended in the ISO 13374-2 standard. This evaluation aims to highlight ProgPy’s strengths and identify opportunities for improvement, thereby, contributing to its advancement as an effective tool for Prognostics and Health Management (PHM). This paper presents the results of an initial assessment of the ProgPy toolbox through a gearbox case study using open-source datasets.

Condition-Monitoring, Diagnostics, Failure, Gearbo↗

Monitoring Strategies for REDD+: Integrating Field, Airborne, and Satellite Observations of Amazon Forests

Large-scale tropical forest monitoring efforts in support of REDD+ (Reducing Emissions from Deforestation and forest Degradation plus enhancing forest carbon stocks) confront a range of challenges. REDD+ activities typically have short reporting time scales, diverse data needs, and low tolerance for uncertainties. Meeting these challenges will require innovative use of remote sensing data, including integrating data at different spatial and temporal resolutions. The global scientific community is engaged in developing, evaluating, and applying new methods for regional to global scale forest monitoring. Pilot REDD+ activities are underway across the tropics with support from a range of national and international groups, including SilvaCarbon, an interagency effort to coordinate US expertise on forest monitoring and resource management. Early actions on REDD+ have exposed some of the inherent tradeoffs that arise from the use of incomplete or inaccurate data to quantify forest area changes and related carbon emissions. Here, we summarize recent advances in forest monitoring to identify and target the main sources of uncertainty in estimates of forest area changes, aboveground carbon stocks, and Amazon forest carbon emissions.

Morton, Douglas↗

Global Change Data Center: Mission, Organization, Major Activities, and 2001 Highlights

Rapid efficient access to Earth sciences data is fundamental to the Nation's efforts to understand the effects of global environmental changes and their implications for public policy. It becomes a bigger challenge in the future when data volumes increase further and missions with constellations of satellites start to appear. Demands on data storage, data access, network throughput, processing power, and database and information management are increased by orders of magnitude, while budgets remain constant and even shrink. The Global Change Data Center's (GCDC) mission is to provide systems, data products, and information management services to maximize the availability and utility of NASA's Earth science data. The specific objectives are (1) support Earth science missions be developing and operating systems to generate, archive, and distribute data products and information; (2) develop innovative information systems for processing, archiving, accessing, visualizing, and communicating Earth science data; and (3) develop value-added products and services to promote broader utilization of NASA Earth Sciences Enterprise (ESE) data and information. The ultimate product of GCDC activities is access to data and information to support research, education, and public policy.

Wharton, Stephen W.↗

A Whale of a Tale: Creating Spacecraft Telemetry Data Analysis Products for the Deep Impact Mission

This paper describes some of the challenges and lessons learned from the Deep Impact (DI) Mission Ground Data System's (GDS) telemetry data processing and product generation tool, nicknamed 'Whale.' One of the challenges of any mission is to analyze testbed and operational telemetry data. Methods to retrieve this data to date have required spacecraft subsystem members to become experts in the use of a myriad of query and plot tools. As budgets shrink, and the GDS teams grow smaller, more of the burden to understand these tools falls on the users. The user base also varies from novice to expert, and requiring them to become GDS tool experts in addition to spacecraft domain experts is an undue burden. The "Whale" approach is to process all of the data for a given spacecraft test, and provide each subsystem with plots and data products 'automagically.'.

Deep Impact↗

SPoRT: Transitioning NASA and NOAA Experimental Data to the Operational Weather Community

Established in 2002 to demonstrate the weather and forecasting application of real-time EOS measurements, the NASA Short-term Prediction Research and Transition (SPoRT) program has grown to be an end-to-end research to operations activity focused on the use of advanced NASA modeling and data assimilation approaches, nowcasting techniques, and unique high-resolution multispectral data from EOS satellites to improve short-term weather forecasts on a regional and local scale. With the ever-broadening application of real-time high resolution satellite data from current EOS, Suomi NPP, and planned JPSS and GOES-R sensors to weather forecast problems, significant challenges arise in the acquisition, delivery, and integration of the new capabilities into the decision making process of the operational weather community. For polar orbiting sensors such as MODIS, AIRS, VIIRS, and CRiS, the use of direct broadcast ground stations is key to the real-time delivery of the data and derived products in a timely fashion. With the ABI on the geostationary GOES-R satellite, the data volumes will likely increase by a factor of 5-10 from current data streams. However, the high data volume and limited bandwidth of end user facilities presents a formidable obstacle to timely access to the data. This challenge can be addressed through the use of subsetting techniques, innovative web services, and the judicious selection of data formats. Many of these approaches have been implemented by SPoRT for the delivery of real-time products to NWS forecast offices and other weather entities. Once available in decision support systems like AWIPS II, these new data and products must be integrated into existing and new displays that allow for the integration of the data with existing operational products in these systems. SPoRT is leading the way in demonstrating this enhanced capability. This paper will highlight the ways SPoRT is overcoming many of the challenges presented by the enormous data volumes of current and future satellite systems to get unique high quality research data into the operational weather environment.

Jedlovec, Gary J.↗

Update of the Development of a Low Cost Data Acquisition System for the Space Shuttle Solid Rocket Booster Program

The space shuttle solid rocket boosters (SRBs) experience a severe environment during their brief flight. During the last few years several SRB's have sustained noticeable structural damage. The environmental characteristics (vibration, structure, and thermal) encountered by the SRB's during ascent, descent and water impact are in most cases unknown. A developmental flight instrumentation (DFI) system collected data from the SRBs' first four flights in the early 1980's, and after the first three flights during the shuttle return-to-flight phase after the Challenger accident. However, the DFI data collected are of low fidelity and do not correlate well with cases of observed structural damage. The DFI system was evaluated for reuse, but the cost to fly it was prohibitive. The space shuttle is presently scheduled to fly until 2030. To support the shuttle flight schedule, avionics on the SRB's will be upgraded. The environments on the different sections of the SRB will need to be defined more completely to properly qualify the avionics for multiple flights. The DFI data previously gathered do not provide enough information to properly qualify the avionics. Marshall Space Flight Center's (MSFC) SRB Project Office requested the Science and Engineering (S&E) Directorate to develop a stand-alone data acquisition system that could collect data from any area of the booster. In answer to this requirement, S&E developed the Enhanced Data Acquisition System (EDAS). To minimize development time and cost, the development team used state-of-the-art commercial off the shelf (COTS) equipment. The first two flights of this system occurred on shuttle mission STS-91 in June 1998 and STS-95 in October 1998. Twenty-one measurements were successfully recorded on the STS-91 right hand booster, providing new accelerometer, strain, temperature, and heating rate data to analysts. Twenty-four measurements were successfully recorded on the STS-95 left hand booster, providing data from the booster and the external tank. This paper summarizes the effort to develop, test, qualify and fly the EDAS to meet SRB flight and data collection requirements.

Crawford, Kevin↗

Using a Commerical off the Shelf Data Acquisition System for the Space Shuttle Solid Rocket Booster Program

The space shuttle solid rocket boosters (SRBs) experience a severe environment during their brief flight. During the last few years several SRB's have sustained noticeable structural damage. The environmental characteristics (vibration, structure, and thermal) encountered by the SRB's during ascent, descent and water impact are in most cases unknown. A developmental flight instrumentation (DFI) system collected data from the SRBs' first four flights in the early 1980's, and after the first three flights during the shuttle return-to-flight phase after the Challenger accident. However, the DFI data collected are of low fidelity and do not correlate well with cases of observed structural damage. The DFI system was evaluated for reuse, but the cost to fly it was prohibitive. The space shuttle is presently scheduled to fly until 2030. To support the shuttle flight schedule, avionics on the SRB's will be upgraded. The environments on the different sections of the SRB will need to be defined more completely to properly qualify the avionics for multiple flights. The DFI data previously gathered do not provide enough information to properly qualify the avionics. Marshall Space Flight Center's (MSFC) SRB Project Office requested the Science and Engineering (S&E) Directorate to develop a stand-alone data acquisition system that could collect data from any area of the booster. In answer to this requirement, S&E developed the Enhanced Data Acquisition System (EDAS). To minimize development time and cost, the development team used state-of-the-art commercial off the shelf (COTS) equipment. The first two flights of this system occurred on shuttle mission STS-91 in June 1998 and STS-95 in October 1998. Twenty-one measurements were successfully recorded on the STS-91 right hand booster, providing new accelerometer, strain, temperature, and heating rate data to analysts. Twenty-four measurements were successfully recorded on the STS-95 left hand booster, providing data from the booster and the external tank. This paper summarizes the effort to develop, test, qualify and fly the EDAS to meet SRB flight and data collection requirements.

Crawford, Kevin↗

Using Fuzzy Clustering for Real-time Space Flight Safety

To ensure space flight safety, it is necessary to monitor myriad sensor readings on the ground and in flight. Since a space shuttle has many sensors, monitoring data and drawing conclusions from information contained within the data in real time is challenging. The nature of the information can be critical to the success of the mission and safety of the crew and therefore, must be processed with minimal data-processing time. Data analysis algorithms could be used to synthesize sensor readings and compare data associated with normal operation with the data obtained that contain fault patterns to draw conclusions. Detecting abnormal operation during early stages in the transition from safe to unsafe operation requires a large amount of historical data that can be categorized into different classes (non-risk, risk). Even though the 40 years of shuttle flight program has accumulated volumes of historical data, these data don t comprehensively represent all possible fault patterns since fault patterns are usually unknown before the fault occurs. This paper presents a method that uses a similarity measure between fuzzy clusters to detect possible faults in real time. A clustering technique based on a fuzzy equivalence relation is used to characterize temporal data. Data collected during an initial time period are separated into clusters. These clusters are characterized by their centroids. Clusters formed during subsequent time periods are either merged with an existing cluster or added to the cluster list. The resulting list of cluster centroids, called a cluster group, characterizes the behavior of a particular set of temporal data. The degree to which new clusters formed in a subsequent time period are similar to the cluster group is characterized by a similarity measure, q. This method is applied to downlink data from Columbia flights. The results show that this technique can detect an unexpected fault that has not been present in the training data set.

Lee, Charles↗