Search NASASearch

SEARCH · Search NASA

Results for “cloud storage”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

Understanding Uncertainty of Snow Radiative Transfer Modeling Within a Mixed Deciduous and Evergreen Forest

Satellite-based passive microwave observations provide the best available continuous observational estimates of global snow water storage due to their broad geographic footprint and low sensitivity to clouds and precipitation. However, these observations are subject to substantial uncertainty due to the complex radiative properties of snow and from interference in forested areas. Physical radiative transfer models can be leveraged to improve the fidelity of these observations and as a data-assimilation tool. In this article, the Dense Media Radiative Transfer model with Multiple Layers (DMRT-ML) is used to simulate snow brightness temperatures from data collected from snow pits excavated during a two-day-long field study performed a temperate forest in the Northeast United States. The simulations are evaluated against surface-based radiometer observations collected at the snow pits. The DMRT-ML is configured with varying complexity to determine the snowpack characteristics most essential toward simulating brightness temperature within a temperate forest with complicated snow stratigraphy. In general, the single-layer configurations were not sufficiently complex to accurately simulate snow brightness temperature without significant tuning. The most accurate simulation was a two-layer configuration with a prescribed ice layer separating the snow layers. This simulation had a root-mean-square error <;15 K for the 37-GHz frequency. More complicated snowpack stratigraphy configurations did not substantively improve the results over the two-layer model configuration. The DMRT-ML was also used to examine differences between redundant datasets of density and grain size. It was determined that similar snow data collection and radiative transfer model configuration techniques are critical to ensure cross-study comparability.

Theodore Letcher

High Performance Access to Archival Data Stored in HDF4 and HDF5 on Cloud Object Stores Without Reformatting the Files

Cloud computing offers numerous advantages for users of extensive Earth science data collections. These benefits encompass direct online access to data files and granules from any location, scalable access supporting parallel computing workflows, and flexible computing tools enabling innovative experimentation with processing techniques. However, older archival file formats designed for distinct computing systems hinder efficient access to decade-long time-series data when compared to data stored in modern cloud-optimized formats like Web Object Stores (WOS), exemplified by Amazon Web Services’ Simple Storage Service (S3). We describe DMR++ (Dataset Metadata Response plus plus), a technology facilitating efficient access to HDF5 (Hierarchical Data Format, version 5) and HDF4 files stored on WOS systems without requiring data reformatting. DMR++ achieves performance comparable to technologies like Zarr while preserving the original file structure, a substantial benefit considering the vast quantity of archival files held by organizations such as NASA. Moreover, DMR++ typically outperforms cloud-optimized versions of HDF5. Essentially an XML (Extensible Markup Language) document usually stored alongside the described data, DMR++ can also be generated on-the-fly but is generally created during data staging to the WOS. Archival files that use HDF4/5 often store large arrays of numerical data. The data in these files is often compressed, typically reducing their size by a factor of four or more. To achieve efficient access to portions of those arrays, they are 'chunked' into smaller sub-arrays, each individually compressed. The chunk size is a compromise, where spinning disks can efficiently access data in smaller chunks while S3 favors larger chunks. A simple optimization of aggregating smaller chunks that are stored adjacently, transferring them in a single access and then individually decompressing them will improve performance. NASA data pose an additional challenge: special Application Programmer Interface (API) libraries are often needed to compute some variables. These libraries are incompatible with WOS environments. Our solution involves storing computed values in the DMR++ document or a companion file, making them accessible like other variables and eliminating the need for specialized APIs. We outline specific optimizations for both satellite grid and swath data stored in HDF4-EOS2 (Earth Observing System).

James Gallagher

Processing NASA Earth Science Data on Nebula Cloud

Three applications were successfully migrated to Nebula, including S4PM, AIRS L1/L2 algorithms, and Giovanni MAPSS. Nebula has some advantages compared with local machines (e.g. performance, cost, scalability, bundling, etc.). Nebula still faces some challenges (e.g. stability, object storage, networking, etc.). Migrating applications to Nebula is feasible but time consuming. Lessons learned from our Nebula experience will benefit future Cloud Computing efforts at GES DISC.

Chen, Aijun

Huygens Probe Relay Data Subsystem Anomaly and Recovery

European Space Agency Mission is designed to study the atmosphere and surface of Saturn's largest satellite, Titan carried by the Cassini spacecraft which provides: a) Power for support equipment; b) S-band antenna system; and c) Data storage and playback. Instruments/investigations include: 1) Aerosol Collector Pyrolyzer (ACP). Study of clouds and aerosols in the Titan atmosphere. 2) Descent Imager and Spectral Radiometer (DISR). Aerosol and cloud optical properties and spectroscopy measurements of Titan's atmosphere and surface. 3) Doppler Wind Experiment (DWE). Study of winds from their effect on the Probe during Titan descent. 4) Gas Chromatograph and Mass Spectrometer (GCMS). Chemical composition of gases and aerosols in Titan's atmosphere. 5) Huygens Atmospheric Structure Instrument (HASI). In-situ study of Titan atmospheric physical and electrical properties. 6) Surface Science Package (SSP). Physical properties of Titan's surface and related atmospheric properties.

Huygens

Atmosphere-biosphere exchange of CO2 and O3 in the Central Amazon Forest

An eddy correlation measurement of O3 deposition and CO2 exchange at a level 10 m above the canopy of the Amazon forest, conducted as part of the NASA/INPE ABLE2b mission during the wet season of 1987, is presented. It was found that the ecosystem exchange of CO2 undergoes a well-defined diurnal variation driven by the input of solar radiation. A curvilinear relationship was found between solar irradiance and uptake of CO2, with net CO2 uptake at a given solar irradiance equal to rates observed over forests in other climate zones. The carbon balance of the system appeared sensitive to cloud cover on the time scale of the experiment, suggesting that global carbon storage might be affected by changes in insolation associated with tropical climate fluctuations. The forest was found to be an efficient sink for O3 during the day, and evidence indicates that the Amazon forests could be a significant sink for global ozone during the nine-month wet period and that deforestation could dramatically alter O3 budgets.

Fan, Song-Miao

Cloud-Based Orchestration of a Model-Based Power and Data Analysis Toolchain

The proposed Europa Mission concept contains many engineering and scientific instruments that consume varying amounts of power and produce varying amounts of data throughout the mission. System-level power and data usage must be well understood and analyzed to verify design requirements. Numerous cross-disciplinary tools and analysis models are used to simulate the system-level spacecraft power and data behavior. This paper addresses the problem of orchestrating a consistent set of models, tools, and data in a unified analysis toolchain when ownership is distributed among numerous domain experts. An analysis and simulation environment was developed as a way to manage the complexity of the power and data analysis toolchain and to reduce the simulation turnaround time. A system model data repository is used as the trusted store of high-level inputs and results while other remote servers are used for archival of larger data sets and for analysis tool execution. Simulation data passes through numerous domain-specific analysis tools and end-to-end simulation execution is enabled through a web-based tool. The use of a cloud-based service facilitates coordination among distributed developers and enables scalable computation and storage needs, and ensures a consistent execution environment. Configuration management is emphasized to maintain traceability between current and historical simulation runs and their corresponding versions of models, tools and data.

Post, Ethan

Designing the User Experience for Earth Observation Data Services in the Cloud

NASA's Earth Observation (EO) inventory is projected to grow by an order of magnitude over the next 5-6 years. The current mode for working with EO data of downloading the data to a local machine (laptop, desktop or server) will be difficult to sustain for these upcoming volumes. Therefore, NASA is in the process of developing a capability to host large volume data in commercial cloud, with an eye toward encouraging data analysis in the cloud. However, in order for the user community to take advantage of this new mode of data interaction, the user experience must be redesigned. Cloud-hosted data brings new challenges, such as managing the costs of data egress and working with data in Web Object Storage instead of a Posix filesystem. However, it also brings new opportunities. Scaling data transformation processes may permit more synchronous data services with near-immediate response vs. cumbersome ordering systems with latencies of hours or days. Data co-location in the cloud can facilitate data integration and fusion. Highly scalable filesystems and databases in the cloud support data reorganization to facilitate analysis at scale. In the course of NASA's reimagining of the User Experience for EO data usage relies on end user input gathered through surveys, workshops and meetings (such as this). At the same time, we have embarked on a course of pedagogy and capacity building to help the user community evolve to cloud-based analysis.

Lynnes, Christopher

Lessons Learned for Responsible Use of Cloud in the Cirrus Project, Following the CrowdStrike Outage Event

A disruption in CrowdStrike’s Falcon cybersecurity platform on July 19th, 2024, caused worldwide chaos. This event highlights the imperative need for cloud security measures for networks that are critically reliant on cloud technology. This incident negatively impacted air travel, government networks, and critical infrastructure sectors such as hospitals and financial institutions. While no electric utilities had a physical impact, and few had an IT impact, there were issues created by loss of cloud services, and other interrelated industries. For utilities and energy distribution organizations, understanding and mitigating these risks is essential. The Cirrus tool offers a strategic solution engineered to weave cloud integration seamlessly into the fabric of operational management, thereby enhancing resilience and streamlining efficiency in the face of digital challenges.

25 ENERGY STORAGE

The evolution of organic mantles on interstellar grains

By laboratory simulation of the chemical processes on dust grains it was investigated how solid organic materials can be produced in the interstellar medium. The ice mantles that accrete on grains in molecular clouds, consisting primarily of H2O, CO, H2CO, NH3, and O2, are irradiated by the internal UV field, resulting in the storage of radicals upon photodissociation of the original molecules. Transient heating events lead to the production of oxygen-rich organic species by recombination reactions. The experiments indicated that in this way the observed amount of organic material can be produced if a grain passes a few times through a molecular cloud during its life. After the destruction of the cloud the grains enter a more diffuse medium. Here they are subjected to the interstellar UV field as well as to collisions with atomic hydrogen. Experiments show that the intense photoprocessing results in the removal of small species like H2O and NH3 as well as in carbonization of the organic molecules. Contrary to this, the atomic H flux will maintain a certain hydrogen level in the mantle. These processes likely convert the original, oxygen-rich organics into an unsaturated hydrocarbon type material such as that observed towards IRS 7 and in Comet Halley grains.

Schutte, Willem A.

Validation of Photovoltaic Modeling Tool Solargraf Against Measured Data

Solargraf is a cloud-based 3D design tool by Enphase Energy that allows users to design solar and storage systems with a variety of elements. Through a Cooperative Research and Development Agreement (CRADA), Enphase Energy collaborated with the National Renewable Energy Laboratory (NREL) to validate Solargraf's 3D design simulation against measured PV system performance. This study follows the same methodology of similar validation studies completed at NREL. The predicted performance results from simulations in both Solargraf and NREL's System Advisor Model (SAM) tool were compared with measured data to evaluate performance predictions.

14 SOLAR ENERGY

Thermal buffering of receivers for parabolic dish solar thermal power plants

A parabolic dish solar thermal power plant comprises a field of parabolic dish power modules where each module is composed of a two-axis tracking parabolic dish concentrator which reflects sunlight (insolation) into the aperture of a cavity receiver at the focal point of the dish. The heat generated by the solar flux entering the receiver is removed by a heat transfer fluid. In the dish power module, this heat is used to drive a small heat engine/generator assembly which is directly connected to the cavity receiver at the focal point. A computer analysis is performed to assess the thermal buffering characteristics of receivers containing sensible and latent heat thermal energy storage. Parametric variations of the thermal inertia of the integrated receiver-buffer storage systems coupled with different fluid flow rate control strategies are carried out to delineate the effect of buffer storage, the transient response of the receiver-storage systems and corresponding fluid outlet temperature. It is concluded that addition of phase change buffer storage will substantially improve system operational characteristics during periods of rapidly fluctuating insolation due to cloud passage.

Manvi, R.

Propulsion Research at the Propulsion Research Center of the NASA Marshall Space Flight Center

The Propulsion Research Center of the NASA Marshall Space Flight Center is engaged in research activities aimed at providing the bases for fundamental advancement of a range of space propulsion technologies. There are four broad research themes. Advanced chemical propulsion studies focus on the detailed chemistry and transport processes for high-pressure combustion, and on the understanding and control of combustion stability. New high-energy propellant research ranges from theoretical prediction of new propellant properties through experimental characterization propellant performance, material interactions, aging properties, and ignition behavior. Another research area involves advanced nuclear electric propulsion with new robust and lightweight materials and with designs for advanced fuels. Nuclear electric propulsion systems are characterized using simulated nuclear systems, where the non-nuclear power source has the form and power input of a nuclear reactor. This permits detailed testing of nuclear propulsion systems in a non-nuclear environment. In-space propulsion research is focused primarily on high power plasma thruster work. New methods for achieving higher thrust in these devices are being studied theoretically and experimentally. Solar thermal propulsion research is also underway for in-space applications. The fourth of these research areas is advanced energetics. Specific research here includes the containment of ion clouds for extended periods. This is aimed at proving the concept of antimatter trapping and storage for use ultimately in propulsion applications. Another activity in this involves research into lightweight magnetic technology for space propulsion applications.

Blevins, John

Geonex: A NASA-NOAA Collaboration for Producing Land Surface Products from Geostationary Sensors Using Cloud Computing

The latest generation of geostationary satellites carry sensors such as the Advanced Baseline Imager (GOES-16/17) and the Advanced Himawari Imager (Himawari-8/9) that closely mimic the spatial and spectral characteristics of MODIS and VIIRS, useful for monitoring land surface conditions. The NASA Earth Exchange (NEX) team at Ames Research Center has embarked on a collaborative effort among scientists from NASA and NOAA exploring the feasibility of producing operational land surface products similar to those from MODIS/VIIRS. The team built a processing pipeline called GEONEX that is capable of converting raw geostationary data into routine products of Fires, surface reflectances, vegetation indices, LAI/FPAR, ET and GPP/NPP using algorithms adapted from both NASA/EOS and NOAA/GOES-R programs. The GEONEX pipeline has been deployed on Amazon Web Services cloud platform and it currently leverages near-realtime geostationary data hosted in AWS public datasets under a NOAA-AWS agreement.Initial analyses of various products from ABI/AHI sensors suggest that they are comparable to those from MODIS in representing the spatio-temporal dynamics of land conditions. Cloud computing offers a variety of options for deploying the GEONEX pipeline including choice CPUs, storage media, and automation. We estimate the cost of deploying GEONEX to be $400 - 750 a month for processing data (every 30 minutes) and producing products over the conterminous US. For products such as Fire, latency can be as little as 10 minutes from the time of data acquisition.

Geostationary

Benchmark Comparison of Cloud Analytics Methods Applied to Earth Observations

Earth Observation data are a vital resource for studying long term changes, but the large data volumes can be challenging to analyze. Time series analysis in particular is hampered by the typical thin-time-slice file organization. We examine several potential solutions inspired in large part by the data-parallel methods that have arisen with cloud computing. These solutions include various combinations of data re-organization, spatial indexing, distributed storage and pre-computation that we term "Analytics Optimized Data Stores" (AODS). We find that even simple solutions (such as a data cube) produce more than an order of magnitude improvement; the best provide two to three orders of magnitude improvement. The most performant solutions have tradeoffs in terms of generality or storage footprint, but may nonetheless be useful components in data analytics frameworks where performance is critical.

parallel processing (computers)

A Concept of Operations for Earth Science Data Archive and Distribution in the Cloud

Science data systems can enable more comprehensive Earth system research by evolving to take advantage of advances in commercial computer technology services. Since their inception twenty five years ago, NASA's Earth Observing System Data and Information System (EOSDIS) Distributed Active Archive Centers (DAACs) have periodically evolved to utilize new technology and expand research using the exponential growth and diversity of Earth observations. Recently, with the advent of a maturing commercial compute services industry and upcoming high data volume missions such as the Surface Water and Ocean Topography (SWOT) mission and the NASA-Indian Space Research Organization Synthetic Aperture Radar (NISAR) mission, options were explored and a decision made to utilize commercial compute and storage services. This paper presents an overview of the concept of operations under development for the DAACs in the Cloud. We highlight the goals and expected advantages of utilizing Cloud services. We outline EOSDIS operations tenets and driving principles. A high-level view of EOSDIS system of systems target architecture serves as context for describing principle interactions. Concepts for key DAAC system and EOSDIS enterprise functions characterize automated end-to-end operations but mark nominal check and recovery points. Concepts are presented for managing Cloud resources, including organizational roles and responsibilities of the NASA project and DAAC personnel. Scenarios we use to further distinguish between what the system will do and what configuration and controls operators will have. Examples include interactions with data providers and data consumers with both in-cloud and on-premise facilities.

Moses, John F.

New Era, New Opportunity, Is GES DISC Ready for Big Data Challenge?

The new era of Big Data has opened doors for many new opportunities, as well as new challenges, for both Earth science research/application and data communities. As one of the twelve NASA data centers - Goddard Earth Sciences Data and Information Services Center (GES DISC), one of our great challenges has been how to help research/application community efficiently (quickly and properly) accessing, visualizing and analyzing the massive and diverse data in natural hazard research, management, or even prediction. GES DISC has archived over 2000 TB data on premises and distributed over 23,000 TB of data since 2010. Our data has been widely used in every phase of natural hazard management and research, i.e. long term risk assessment and reduction, forecasting and predicting, monitoring and detection, early warning, damage assessment and response. The big data challenge is not just about data storage, but also about data discoverability and accessibility, and even more, about data migration/mirroring in the cloud. This paper is going to demonstrate GES DISC’s efforts and approaches of evolving our overall Web services and powerful Giovanni (Geospatial Interactive Online Visualization ANd aNalysis Infrastructure) tool into further improving data discoverability and accessibility. Prototype works will also be presented.

Li, A.

Monitoring River Basin Development and Variation in Water Resources in Transboundary Imjin River in North and South Korea Using Remote Sensing

This paper presents methods of monitoring river basin development and water variability for the transboundary river in North and South Korea. River basin development, such as dams and water infrastructure in transboundary rivers, can be a potential factor of tensions between upstream and downstream countries since dams constructed upstream can adversely affect downstream riparians. However, because most of the information related to North Korea has been limited to the public, the information about dams constructed and their locations were inaccurate in many previous studies. In addition, water resources in transboundary rivers can be exploited as a political tool. Specifically, due to the unexpected water release from the Hwanggang Dam, upstream of the transboundary Imjin River in North and South Korea, six South Koreans died on 6 September 2009. The Imjin River can be used as a political tool by North Korea, and seven events were reported as water conflicts in the Imjin River from 2001 to 2016. In this paper, firstly, we have updated the information about the dams constructed over the Imjin River in North Korea using multi-temporal images with a high spatial resolution (15-30 cm) obtained from Google Earth. Secondly, we analyzed inter- and intra-water variability over the Hwanggang Reservoir using open-source images obtained from the Global Surface Water Explorer. We found a considerable change in water surface variability before and after 2008, which might result from the construction of the Hwanggang Dam. Thirdly, in order to further investigate intra-annual water variability, we present a method monitoring water storage changes of the Hwanggang Reservoir using the area-elevation curve (AEC), which was derived from multi-sensor Synthetic Aperture Radar (SAR) images (Sentinel-1A and -1B) and the Shuttle Radar Topography Mission (SRTM) Digital Elevation Model (DEM). Since many previous studies for estimating water storage change have depended on satellite altimetry dataset and optical images for deriving AEC, the method adopted in this study is the only application for such inaccessible areas since no altimetry ground track exists for the Hwanggang Reservoir and because clouds can block the study area for wet seasons. Moreover, this study has newly proven that unexpected water release can occur in dry seasons because the water storage in the Hwanggang Reservoir can be high enough to conduct a release that can be used as a geopolitical tool. Using our method, potential risks can be mitigated, not in response to a water release, but based on pre-event water storage changes in the Hwanggang Reservoir.

Kim, Donghwan

Multidimensional Data Aggregation in the Cloud with Application to Geostationary Satellite-based Air Quality Monitoring

Scientists use satellite data for studying Earth's systems, and the remote sensing data that these satellites collect are typically separated into files of a size small enough for efficient network transfer and storage. However, researchers usually prefer to analyze the data based on real-world dimensions like time, space, or elevation. To help with this, NASA's Atmospheric Science Data Center (ASDC) developed a new cloud-based tool that combines these smaller data chunks into larger, more useful datasets. The tool works on Network Common Data Form (netCDF4) and some HDF5 formatted files, and it is available as a service in NASA's Earthdata Cloud. In this presentation, we showcase this service using data from the Tropospheric Emissions: Monitoring of Pollution (TEMPO) instrument. By combining TEMPO's continuous observations over time, we create longer and more informative analysis-ready time series to facilitate the study of air quality patterns. Insights gained will provide a more comprehensive understanding of pollution sources, transport patterns, and their effects on the environment and human health.

Daniel Kaufman