Search NASA⌕ Search

SEARCH · Search NASA

Results for “cloud computing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16
All sourcesNASA NTRSDOE OSTI
NASA NTRS2017

Trade Study: Storing NASA HDF5/netCDF-4 Data in the Amazon Cloud and Retrieving Data Via Hyrax Server Data Server

This study explored three candidate architectures with different types of objects and access paths for serving NASA Earth Science HDF5 data via Hyrax running on Amazon Web Services (AWS). We studied the cost and performance for each architecture using several representative Use-Cases. The objectives of the study were: Conduct a trade study to identify one or more high performance integrated solutions for storing and retrieving NASA HDF5 and netCDF4 data in a cloud (web object store) environment. The target environment is Amazon Web Services (AWS) Simple Storage Service (S3). Conduct needed level of software development to properly evaluate solutions in the trade study and to obtain required benchmarking metrics for input into government decision of potential follow-on prototyping. Develop a cloud cost model for the preferred data storage solution (or solutions) that accounts for different granulation and aggregation schemes as well as cost and performance trades.We will describe the three architectures and the use cases along with performance results and recommendations for further work.

AWS cost↗
NASA NTRS2017

NASA's EOSDIS Cumulus: Ingesting, Archiving, Managing, and Distributing Earth Science Data from the Commercial Cloud

NASA's Earth Observing System Data and Information System (EOSDIS) has been working towards a vision of a cloud-based, highly-flexible, ingest, archive, management, and distribution system for its ever-growing and evolving data holdings. This system, Cumulus, is emerging from its prototyping stages and is poised to make a huge impact on how NASA manages and disseminates its Earth science data. This talk will outline the motivation for this work, present the achievements and hurdles of the past 18 months and will chart a course for the future expansion of the Cumulus expansion. We will explore on not just the technical, but also the socio-technical challenges that we face in evolving a system of this magnitude into the cloud and how we are rising to meet those challenges through open collaboration and intentional stakeholder engagement.

Earth Scienc↗
NASA NTRS2018

Advanced Analytics and Big Earth Data

NASA's Earth Science Data Systems process, archive and distribute petabytes of Earth Observation data to a variety of end users. These end users will face dramatically increased data size in the near future, bringing about new challenges and opportunities in analyzing those data. One area of particular ferment currently is Machine Learning. Many Machine Learning methods are black boxes, limiting direct insight into the data's properties. However, they can be used for a variety of data enhancement purposes, such as parameter retrieval, data fusion and image classification and segmentation. The Earth Observing System Data and Information System is also evolving to host large data volumes in the cloud, enabling data proximal analysis. As part of this effort, an Analytics framework is being developed to support and enhance user analysis of the data. By using standards based services in the framework, diverse user communities can be served, while also allowing inter-system collaboration in the analysis process.

Cloud Computing↗
NASA NTRS2018

Accessing Data Stored in Amazon S3 Using the Hyrax OPeNDAP Server

For three years we have been investigating data storage and retrieval in the Amazon Cloud, striving to optimize both storage structures and (cache-enhanced retrieval processes. These optimizations are hidden from data users, who simply employ the Data Access Protocol (DAP), a popular, Web-based Application Programmer Interface (API) developed by OPeNDAP. We present our collected findings and their realization in the Hyrax data server. Specific techniques include caching data on spinning disk; accessing sharded data in place; optimizing the organizational structures for data within the flat key-value space of Simple Storage Service (S3); and employing an API extension that permits simultaneous operations on many datasets in a single request.

Data access↗
NASA NTRSDate not supplied

TPSAS-NF1676L-33992-DND

The CERES Science Team integrates and fuses observations from 6 CERES instruments aboard the Terra, Aqua, S-NPP, and NOAA-20 missions with data from more than 20 other unique data sources. Following the November 2017 launch of CERES Flight Model 6 (FM6) onboard NOAA20, CERES has now amassed over 80 instrument-years of valuable Earth radiation budget data. The rapidly growing volume of CERES data coupled with the introduction of new data products alongside improvements to existing science algorithms fosters the requirement for faster, more flexible, and scalable data production and orchestration. New virtualized, cloud-centric compute hardware hosted by the NASA Langley Research Center’s (LaRC) Atmospheric Sciences Data Center (ASDC) provides an ideal environment for these ever-increasing data production demands for CERES. This poster discusses updates to the implementation of the CERES Data Management Team’s (DMT) CERES AuTomAted job Loading sYSTem (CATALYST), a custom data processing workflow engine for CERES, to use on-demand computing resources to perform automated CERES data production processing in a Linux-based container environment. Linux containers provide CERES the flexibility to build multiple production environments in containers tailored for specific workloads and allow effortless provisioning of resources based on the CERES Science Team’s data production requirements.

Thomas N. Hillyer↗
NASA NTRSDate not supplied

NASA Cloud Data Access

Explore the source record for details and available documents.

Cloud Computing↗
NASA NTRSDate not supplied

Towards a Cloud-Based Flight Management System

This paper summarizes the results of an initial concept exploration into the Cloud Flight Management System, or Cloud FMS, idea. Cloud FMS is a concept in which part of the aircraft’s FMS is on the aircraft itself, while another part resides in a ground-based cloud environment. This paper is limited to understanding whether this idea can be practically implemented within the current constraints of air-ground network throughput, availability, reliability, and latency. Simulation and live flight tests were conducted to study this concept, and specific findings that further fine-tune the Cloud FMS concept are provided.

Flight Management System, Cloud Computing, Urban A↗
NASA NTRSDate not supplied

NASA Briefing to Unidata

The NASA report to Unidata for October, 2021 covers several topics of mutual interest to Unidata. These include plans for hosting NASA data in the cloud, data analysis-in-place, and NASA plans for Open Source Science. Major collaborations with other organizations are also discussed.

NetCDF↗
NASA NTRS2022

Satellite-derived Cyanobacteria Frequency and Magnitude in Headwaters & Near-dam Reservoir Surface Waters of the Southern U.S.

Reservoirs are dominant features of the modern hydrologic landscape and provide vital services. However, the unique morphology of reservoirs can create suitable conditions for excessive algae growth and associated cyanobacteria blooms in shallow in-flow reservoir locations by providing warm water environments with relatively high nutrient inputs, deposition, and nutrient storage. Cyanobacteria harmful algal blooms (cyanoHAB) are costly water management issues and bloom recurrence is associated with economic costs and negative impacts to human, animal, and environmental health. As cyanoHAB occurrence varies substantially within different regions of a water body, understanding in-lake cyanoHAB spatial dynamics is essential to guide reservoir monitoring and mitigate potential public exposure to cyanotoxins. Cloud-based computational processing power and high temporal frequency of satellites enables advanced pixel-based spatial analysis of cyanoHAB frequency and quantitative assessment of reservoir headwater in-flows compared to near-dam surface waters of individual reservoirs. Additionally, extensive spatial coverage of satellite imagery allows for evaluation of spatial trends across many dozens of reservoir sites. Surface water cyanobacteria concentrations for sixty reservoirs in the southern U.S. were estimated using 300 m resolution European Space Agency (ESA) Ocean and Land Colour Instrument (OLCI) satellite sensor for a five year period (May 2016–April 2021). Of the reservoirs studied, spatial analysis of OLCI data revealed 98% had more frequent cyanoHAB occurrence above the concentration of >100,000 cells/mL in headwaters compared to near-dam surface waters (P < 0.001). Headwaters exhibited greater seasonal variability with more frequent and higher magnitude cyanoHABs occurring mid-summer to fall. Examination of reservoirs identified extremely high concentration cyanobacteria events (>1,000,000 cells/mL) occurring in 70% of headwater locations while only 30% of near-dam locations exceeded this threshold. Wilcoxon signed-rank tests of cyanoHAB magnitudes using paired-observations (dates with observations in both a reservoir's headwater and near-dam locations) confirmed significantly higher concentrations in headwater versus near-dam locations (p < 0.001).

Amber R Ignatius↗
NASA NTRS2022

Satellite-derived cyanobacteria frequency and magnitude in headwaters & near-dam reservoir surface waters of the Southern U.S.

Reservoirs are dominant features of the modern hydrologic landscape and provide vital services. However, the unique morphology of reservoirs can create suitable conditions for excessive algae growth and associated cyanobacteria blooms in shallow in-flow reservoir locations by providing warm water environments with relatively high nutrient inputs, deposition, and nutrient storage. Cyanobacteria harmful algal blooms (cyanoHAB) are costly water management issues and bloom recurrence is associated with economic costs and negative impacts to human, animal, and environmental health. As cyanoHAB occurrence varies substantially within different regions of a water body, understanding in-lake cyanoHAB spatial dynamics is essential to guide reservoir monitoring and mitigate potential public exposure to cyanotoxins. Cloud-based computational processing power and high temporal frequency of satellites enables advanced pixel-based spatial analysis of cyanoHAB frequency and quantitative assessment of reservoir headwater in-flows compared to near-dam surface waters of individual reservoirs. Additionally, extensive spatial coverage of satellite imagery allows for evaluation of spatial trends across many dozens of reservoir sites. Surface water cyanobacteria concentrations for sixty reservoirs in the southern U.S. were estimated using 300m resolution European Space Agency (ESA) Ocean and Land Colour Instrument (OLCI) satellite sensor for a five year period (May 2016–April 2021). Of the reservoirs studied, spatial analysis of OLCI data revealed 98% had more frequent cyanoHAB occurrence above the concentration of >100,000 cells/mL in headwaters compared to near-dam surface waters (P < 0.001). Headwaters exhibited greater seasonal variability with more frequent and higher magnitude cyanoHABs occurring mid-summer to fall. Examination of reservoirs identified extremely high concentration cyanobacteria events (>1,000,000 cells/mL) occurring in 70% of headwater locations while only 30% of near-dam locations exceeded this threshold. Wilcoxon signed-rank tests of cyanoHAB magnitudes using paired-observations (dates with observations in both a reservoir's headwater and near-dam locations) confirmed significantly higher concentrations in headwater versus near-dam locations (p < 0.001).

cyanobacteria↗
NASA NTRSDate not supplied

The Machine Learning Showroom: Presentation to OCIO Data Science Summit

Artificial Intelligence/Machine Learning (AI/ML) has become an indispensable tool for descriptive, predictive and prescriptive analytics. Demand for AI/ML models at NASA is outpacing Data Scientist staff. The AI/ML Showroom is an effort to empower NASA professionals to evaluate AI/ML solutions for their problems in a scalable self-help manner, relying on coding examples, reference use cases, digital assistant guides, jam sessions, video training, and pre-configured cloud resources.

machine learning↗
NASA NTRSDate not supplied

A Paradigm Shift in Monitoring Earth from Space

This presentation will focus on the new paradigm the Golden age of Earth observations (e.g. high temporal, spatial and spectral resolution Earth observations) represent for natural resources management, and ultimately societal benefit. And what to expect for the upcoming satellite Missions that NASA is planning to launch, such as NISAR and SBG.

NISAR↗
NASA NTRSDate not supplied

NASA Space Communications and Navigation Approach to Cloud Capability Implementation

The integration of cloud services and capabilities across government and commercial sectors has continued to increase over the last several years. Cloud architectures provide on-demand process, storage, and transfer of data as a service without the need to purchase expensive hardware, infrastructure, and their associated maintenance costs. Most cloud environments charge the user for only the resources they use, making cloud implementations highly scalable and easily adjustable to the user’s changing demands.

cloud computing↗
NASA NTRSDate not supplied

Atlas: Navigating NASA’s Knowledge Universe with AI-Powered Natural Language Queries

NASA has a vast archive of engineering guidelines, standards, and best practices collected over decades. This encompasses a breadth of topics from rocketry and engineering standards to risk management and space-related health issues. This wealth of information, while invaluable to NASA engineers, staff, and the public, is too extensive for any individual to fully comprehend. To address this challenge, we have developed Atlas, a tool within NASA's Mission Cloud Platform that enables users to query these diverse sources effectively. Atlas allows users to ask natural language questions and receive answers grounded in factual information from source documents. The tool provides responses with direct quotations and links to original documents, ensuring transparency and accuracy. It can address a wide range of queries, from specific technical details like safe distances for rocket launches from lightning to broader topics such as crew health requirements for long-duration space missions, corrosion protection in low Earth orbit, and NASA's agreements with various entities. In developing Atlas, we encountered and overcame several technical challenges. Large Language Models often struggle with consistently providing accurate information, especially for highly specialized topics. We implemented strategies to prevent hallucinations and ensure the reliability of responses, even for complex questions on topics ranging from NASA Mission Classes to intricate rocket science concepts. Additionally, we addressed the challenges of delivering quick responses while maintaining cost-effectiveness. Our presentation will detail the innovative approaches we employed to optimize performance and efficiency, making Atlas a powerful and practical tool for accessing NASA's extensive knowledge base.

Artificial Intelligence↗