Search NASA⌕ Search

SEARCH · Search NASA

Results for “cloud computing, data cloud”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 649 records · Page 36
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

A scalable, open-source implementation of a large-scale mechanistic model for single cell proliferation and death signaling

Mechanistic models of how single cells respond to different perturbations can help integrate disparate big data sets or predict response to varied drug combinations. However, the construction and simulation of such models have proved challenging. Here, we developed a python-based model creation and simulation pipeline that converts a few structured text files into an SBML standard and is high-performance- and cloud-computing ready. We applied this pipeline to our large-scale, mechanistic pan-cancer signaling model (named SPARCED) and demonstrate it by adding an IFNγ pathway submodel. We then investigated whether a putative crosstalk mechanism could be consistent with experimental observations from the LINCS MCF10A Data Cube that IFNγ acts as an anti-proliferative factor. The analyses suggested this observation can be explained by IFNγ-induced SOCS1 sequestering activated EGF receptors. This work forms a foundational recipe for increased mechanistic model-based data integration on a single-cell level, an important building block for clinically-predictive mechanistic models.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2022

Automated compatibility checking of prefabricated components using 3D as-built models and BIM

There have been recent efforts to use reality capture technologies to perform remote quality control in construction. However, there is a lack of research efforts in detecting construction incompatibilities in modular construction using reality capture technologies. The construction incompatibilities in modular construction often cause reworks and delays in the project schedule. To address this issue, this paper presents a general compatibility analysis method that propose scanning the modules in manufacturing plant and construction site, and check module-to-module compatibility remotely, prior to the shipment and installation. This study provides three sample module-to-module compatibility scenarios to validate the proposed compatibility analysis. The case study results show that the compatibility analysis method was able to identify the compatibility issues with high accuracy. Lastly, the compatibility analysis method was validated in terms of accuracy and time performance in six scenarios that was defined on the modules.

42 ENGINEERING↗
NASA NTRS1986

Comparative accuracy of selected multiple scattering approximations

Doubling method computational results which have yielded plane albedo, total transmission and fractional absorption for plane-parallel atmospheres composed of cloud droplets are presently compared with data obtained with selected radiative transfer approximations. The relative and absolute accuracies of asymptotic theory for thick layers and delta-Eddington, Meador-Weaver (1980) and Coakley-Chylek (1975) approximations are compared as a function of optical thickness, solar zenith angle, and single scattering albedo. The delta-Eddington approximation is the most accurate for conservative scattering when the solar zenith angle is small, while Meador-Weaver is the most accurate for nonconservative scattering.

King, M. D.↗
NASA NTRS1988

The profile algorithm for microwave delay estimation from water vapor radiometer data

A new algorithm has been developed for the estimation of tropospheric microwave path delays from water vapor radiometer (WVR) data, which does not require site and weather dependent empirical parameters to produce accuracy better than 0.3 cm of delay. Instead of taking the conventional linear approach, the new algorithm first uses the observables with an emission model to determine an approximate form of the vertical water vapor distribution, which is then explicitly integrated to estimate wet path delays in a second step. The intrinsic accuracy of this algorithm, excluding uncertainties caused by the radiometers and the emission model, has been examined for two channel WVR data using path delays and corresponding simulated observables computed from archived radiosonde data. It is found that annual rms errors for a wide range of sites average 0.18 cm in the absence of clouds, 0.22 cm in cloudy weather, and 0.19 cm overall. In clear weather, the new algorithm's accuracy is comparable to the best that can be obtained from conventional linear algorithms, while in cloudy weather it offers a 35 percent improvement.

Robinson, Steven E.↗
NASA NTRS1997

Remote Sensing of Aircraft Contrails Using a Field Portable Digital Array Scanned Interferometer

With a Digital Array Scanned Interferometer (DASI), we have obtained proof-of-concept observations with which we demonstrate DASI capabilities for the determination of contrail properties. These include the measurement of the cloud and soot microphysical parameters, as well, the abundances of specific pollutant species such as SO(sub x) or NO(sub x). From high quality hyperspectral data and using radiative transfer methods and atmospheric chemistry analysis in the data reduction and interpretation, powerful inferences concerning cloud formation, evolution and dissipation can be made. Under this sub-topic, we will integrate DASI with computer controlled scanning of the field-of-view to direct the sensor towards contrails and exhaust plumes for tracking the emitting vehicles. The optimum DASI wavelength sensitivity range for sensing contrails is 0.35 - 2.5 micron. DASI deploys on the ground or from aircraft to observe contrails in the vicinity. This enables rapid, accurate measurement of the temporal, spatial, and chemical evolution of contrails (or other plumes or exhaust sources) with a low cost, efficient sensor.

Smith, William Hayden↗
NASA NTRS2007

Suborbital Telepresence and Over-the-Horizon Networking

A viewgraph presentation describing the suborbital telepresence project utilizing in-flight network computing is shown. The topics include: 1) Motivation; 2) Suborbital Telepresence and Global Test Range; 3) Tropical Composition, Cloud, and Climate Coupling Experiment (TC4); 4) Data Sets for TC4 Real-time Monitoring; 5) TC-4 Notional Architecture; 6) An Application Integration View; 7) Telepresence: Architectural Framework; and 8) Disruption Tolerant Networks.

Freudinger, Lawrence C.↗
NASA NTRS2015

An Empirical Non-TNT Approach to Launch Vehicle Explosion Modeling

In an effort to increase crew survivability from catastrophic explosions of Launch Vehicles (LV), a study was conducted to determine the best method for predicting LV explosion environments in the near field. After reviewing such methods as TNT equivalence, Vapor Cloud Explosion (VCE) theory, and Computational Fluid Dynamics (CFD), it was determined that the best approach for this study was to assemble all available empirical data from full scale launch vehicle explosion tests and accidents. Approximately 25 accidents or full-scale tests were found that had some amount of measured blast wave, thermal, or fragment explosion environment characteristics. Blast wave overpressure was found to be much lower in the near field than predicted by most TNT equivalence methods. Additionally, fragments tended to be larger, fewer, and slower than expected if the driving force was from a high explosive type event. In light of these discoveries, a simple model for cryogenic rocket explosions is presented. Predictions from this model encompass all known applicable full scale launch vehicle explosion data. Finally, a brief description of on-going analysis and testing to further refine the launch vehicle explosion environment is discussed.

Blackwood, James M.↗
NASA NTRS2021

Modeling the Radiative Effect on Microphysics in Cirrus Clouds against Satellite Observations

The radiative effect on microphysics 23 (REM) plays an important role in the dew/frost formation near the surface. How REM impacts cirrus clouds is investigated in this paper, using bin microphysical model simulations and coincident data of the CloudSat and Global Precipitation Measurement (GPM) satellites. REM affects ice crystal spectrum with two types: radiative cooling and warming. Radiative cooling, as predicted by the bin model simulations, favors the formation of horizontally oriented ice crystals (HOICs), but radiative warming does not. Hence, a test of REM can be transformed to a test of HOICs, because HOICs can be measured by the microwave polarization observations of the GPM Microwave Imager (GMI) at 166 GHz. To analyze the GMI data for their HOIC distribution, clouds are sorted into four groups with different optical depth and altitude, based on the radiative cooling/warming ratio (or eta) computed with satellite-retrieved ice water content. Their HOIC distributions (e.g., the mid-level thick clouds have more HOICs than the high-level ones) agree well with those predicted by the bin model simulations. The general agreement between the GMI observations and bin model simulations suggests that REM is common in cirrus clouds and impacts cirrus clouds significantly.

microphysics↗
NASA NTRS2021

Modeling the Radiative Effect on Microphysics in Cirrus Clouds Against Satellite Observations

The radiative effect on microphysics (REM) plays an important role in the dew/frost formation near the surface. How REM impacts cirrus clouds is investigated in this study, using bin microphysical model simulations and coincident data of the CloudSat and Global Precipitation Measurement (GPM) satellites. REM affects ice crystal spectrum with two types: radiative cooling and warming. Radiative cooling, as predicted by the bin-model simulations, favors the formation of horizontally oriented ice crystals (HOICs), but radiative warming does not. Hence, a test of REM can be transformed to a test of HOICs, because HOICs can be measured by the microwave polarization observations of the GPM Microwave Imager (GMI) at 166 GHz. To analyze the GMI data for their HOIC distribution, clouds are sorted into four groups with different optical depth and altitude, based on the radiative cooling/warming ratio (or eta) computed with satellite-retrieved ice water content. Their HOIC distributions (e.g., the midlevel thick clouds have more HOICs than the high-level ones) agree well with those predicted by the bin-model simulations. The general agreement between the GMI observations and bin-model simulations suggests that REM is common in cirrus clouds and impacts cirrus clouds significantly.

clouds↗
DOE OSTI2022

The Geothermal Data Repository: Ten Years of Supporting the Geothermal Industry with Open Access to Geothermal Data

The Department of Energy's (DOE) Geothermal Data Repository (GDR) is celebrating its tenth anniversary! Over the last decade it has grown from the simple idea of storing public data in a centralized location to a valuable tool at the center of the US geothermal scientific community and an integral part of the DOE Geothermal Technologies Office (DOE GTO) project management strategy. Researchers funded by the DOE GTO have contributed over 1,300 data submissions to the GDR. These data have been used to further advancements in geothermal science, economic analysis, exploration, research, development, and operational efficiency. The adoption of open data methodologies and a data management strategy that prioritizes universal open access and standardized, interoperable data have further increased the value of GDR data, making them available across a distributed network of data sharing partners and improving their utility to other industries and related fields, including material science and space exploration. Incorporating feedback from users has been critical to the GDR's success, allowing it to grow over the years to meet the evolving needs of the geothermal community. This paper will explore some of many changes that occurred throughout the GDRs tenure and the lessons learned along the way, as well as highlight some of the new features and recent improvements that been implemented to support innovation, reduce duplication of effort, and advance the geothermal industry as a whole.

access↗
DOE OSTI2017

Redundancy Does Not Imply Fault Tolerance: Analysis of Distributed Storage Reactions to File-System Faults

In this paper, we analyze how modern distributed storage systems behave in the presence of file-system faults such as data corruption and read and write errors. We characterize eight popular distributed storage systems and uncover numerous problems related to file-system fault tolerance. We find that modern distributed systems do not consistently use redundancy to recover from file-system faults: a single file-system fault can cause catastrophic outcomes such as data loss, corruption, and unavailability. We also find that the above outcomes arise due to fundamental problems in file-system fault handling that are common across many systems. Finally, our results have implications for the design of next-generation fault-tolerant distributed and cloud storage systems.

97 MATHEMATICS AND COMPUTING↗
NASA NTRSDate not supplied

Earth Science Data Processing With Nextflow

Earth science data processing tasks present many challenges. These tasks often process large input datasets and require scores of CPU-hours to generate results. All but the simplest tasks will be decomposed into a series of computational or data manipulation steps, also known as a scientific workflow. In order to reduce the burden of orchestrating and running the dependent processing steps, a workflow execution engine is required. This poster describes the lessons learned by the CLARREO Pathfinder (CPF) team while developing multiple scientific workflows and utilizing the open-source Nextflow engine to execute them in a cloud computing environment. The Nextflow engine is designed with the following stated goals: first, the engine does not dictate how individual steps in the task are implemented (i.e. it is language and interface agnostic); second, the engine supports easy configuration and modularity at the workflow level so that others can easily execute our workflows to reproduce results; lastly, the engine eases development by transparently scaling execution from local to remote environments. Nextflow was developed for the bioinformatics domain but is a good fit for other scientific workflows where the overall task is well-described by a dataflow diagram. The CPF team has developed Nextflow pipelines (i.e. scientific workflows) to simulate CLARREO radiance, generate large look-up tables for inter-calibration algorithms, and generate L4 intercalibration data products. These pipelines consume from single-digits to hundreds of thousands of CPU-hours. In the development and evolution of these pipelines we have discovered many design patterns, pitfalls, and solutions to common problems. Our goal is to demonstrate important aspects of how to design, implement, run, and ultimately share Nextflow pipelines in the domain of Earth science.

Aron D Bartle↗
DOE OSTI2019

Earth System Grid Federation (ESGF) Compute Challenge

This Open Geospatial Consortium (OGC) Engineering Report (ER) describes the advancement of an Execution Management System (EMS) to support Web Processing Service (WPS) climate processes deployed on the Earth System Grid Federation (ESGF). The report introduces climate data, processes and applications into Common Workflow Language (CWL) workflows with the intent of advancing: application packaging, deployment and execution in clouds; interoperability of services in federated cyberinfrastructures; and geospatial workflows towards standardization. Work presented in this report is a direct continuation of the Earth Observation & Clouds (EOC) thread of Testbed-14. This report is expected to be of relevance to Testbed-15, both to the Earth Observation Process and Application Discovery (EOPAD) task and the Machine Learning task. This engineering report will describe: relevant work conducted in OGC Testbed-14; ESGF and its compute challenge; adaptations of existing climate processes into workflows; interoperability experiments with ESGF endpoints conforming to a common API.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2015

Improving public communication through environmental data transparency at Los Alamos National Laboratory - 15306

The Los Alamos National Laboratory (LANL) environmental data span a wide range of media, including air, soil, sediment, water, foodstuff, and biota as well as over 1000 analytes and time periods extending over 4 decades, resulting in over 14 million records to manage and analyze. At a time of budget cuts and rapid social and technological change, the public, regulatory and compliance agencies, and stakeholders demand accelerated data delivery and efficiency, information sharing, and transparency in the dissemination and handling of samples collected in and around LANL. Meeting these requirements, while constraining the associated costs can be challenging; however, LANL has achieved this by adopting a cloud-based database called the Environmental Information Management (EIM) system and its public database counterpart, IntellusNM (Intellus) (www.intellusnm.com). To be consistent with federal initiatives to move government computing into cloud-based services, LANL chose to partner with an existing cloud-based vendor, Locus Technologies, to implement a software-as-a-service model. As an additional cost-saving measure, local regulatory and compliance agencies collaborated with LANL to incorporate their data into EIM and Intellus database. By adopting a single platform cloud-based solution to replace 12 different pre-existing environmental data systems, LANL has streamlined environmental data processes, resulting in over $15 million cost savings through 2015. EIM, LANL's internal cloud database, provides a cradle-to-grave process for data handling. EIM supports LANL's entire data process from detailed sample planning, mobile data collection using iOS mobile devices, to automated bottle labeling, generation of chain of custody, analytical lab electronic data deliverable upload, auto data validation, sample tracking, and custom regulatory and compliance reports. EIM has functionality to assess data in various ways such as the ability to design new formatted reports, a free-form structured query language tool of the entire database, exceedance reports, calculation engine, charting, trends, and statistics. EIM also has interactive geographic information system layers and analyte concentration color contour mapping capabilities. Additionally, and of greater importance to LANL, EIM supports the ability for third-party landowners to review data before release to the public, thus ensuring transparency and confidence in LANL's stewardship of human health and the environment. Intellus, the database counterpart of EIM, is the publicly available view of the entire LANL database and requires no data feeds or transformations. Intellus allows user-friendly access to LANL's environmental data as it is collected, providing the public, scientists, remediation teams, regulators, and stakeholders within hours of receipt. Full transparency in giving the public access to environmental data information provides LANL's overall solution to environmental data management for the public. By making the data easy to obtain, search, and query for interested stakeholders, the system enables confidence in LANL's stewardship of the environment. Working together identifies key topics of improvements, develop strategies and help support innovation and substantial advances within LANL's environmental data management system. (authors)

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2012

The Namibia Early Flood Warning System, A CEOS Pilot Project

Over the past year few years, an international collaboration has developed a pilot project under the auspices of Committee on Earth Observation Satellite (CEOS) Disasters team. The overall team consists of civilian satellite agencies. For this pilot effort, the development team consists of NASA, Canadian Space Agency, Univ. of Maryland, Univ. of Colorado, Univ. of Oklahoma, Ukraine Space Research Institute and Joint Research Center(JRC) for European Commission. This development team collaborates with regional , national and international agencies to deliver end-to-end disaster coverage. In particular, the team in collaborating on this effort with the Namibia Department of Hydrology to begin in Namibia . However, the ultimate goal is to expand the functionality to provide early warning over the South Africa region. The initial collaboration was initiated by United Nations Office of Outer Space Affairs and CEOS Working Group for Information Systems and Services (WGISS). The initial driver was to demonstrate international interoperability using various space agency sensors and models along with regional in-situ ground sensors. In 2010, the team created a preliminary semi-manual system to demonstrate moving and combining key data streams and delivering the data to the Namibia Department of Hydrology during their flood season which typically is January through April. In this pilot, a variety of moderate resolution and high resolution satellite flood imagery was rapidly delivered and used in conjunction with flood predictive models in Namibia. This was collected in conjunction with ground measurements and was used to examine how to create a customized flood early warning system. During the first year, the team made use of SensorWeb technology to gather various sensor data which was used to monitor flood waves traveling down basins originating in Angola, but eventually flooding villages in Namibia. The team made use of standardized interfaces such as those articulated under the Open Cloud Consortium (OGC) Sensor Web Enablement (SWE) set of web services was good [1][2]. However, it was discovered that in order to make a system like this functional, there were many performance issues. Data sets were large and located in a variety of location behind firewalls and had to be accessed across open networks, so security was an issue. Furthermore, the network access acted as bottleneck to transfer map products to where they are needed. Finally, during disasters, many users and computer processes act in parallel and thus it was very easy to overload the single string of computers stitched together in a virtual system that was initially developed. To address some of these performance issues, the team partnered with the Open Cloud Consortium (OCC) who supplied a Computation Cloud located at the University of Illinois at Chicago and some manpower to administer this Cloud. The Flood SensorWeb [3] system was interfaced to the Cloud to provide a high performance user interface and product development engine. Figure 1 shows the functional diagram of the Flood SensorWeb. Figure 2 shows some of the functionality of the Computation Cloud that was integrated. A significant portion of the original system was ported to the Cloud and during the past year, technical issues were resolved which included web access to the Cloud, security over the open Internet, beginning experiments on how to handle surge capacity by using the virtual machines in the cloud in parallel, using tiling techniques to render large data sets as layers on map, interfaces to allow user to customize the data processing/product chain and other performance enhancing techniques. The conclusion reached from the effort and this presentation is that defining the interoperability standards in a small fraction of the work. For example, once open web service standards were defined, many users could not make use of the standards due to security restrictions. Furthermore, once an interoperable sysm is functional, then a surge of users can render a system unusable, especially in the disaster domain.

Mandl, Daniel↗
NASA NTRS1979

Seasat scanning multichannel microwave radiometer - Results of the Gulf of Alaska workshop

Scanning multichannel microwave radiometer results obtained by the Gulf of Alaska Seasat Experiment Workshop are reported. The Seasat SMMR provided data from five channels operating at 6.6, 10.7, 18, 21, and 37 GHz at vertical and horizontal polarizations. Two preliminary algorithms were used to retrieve geophysical parameters from the data: the Wentz algorithm (Bierman et al., 1978) based on a theoretically derived function for computing brightness temperatures and the Wilheit algorithm, based on statistical relationships between brightness temperatures and the geophysical parameters obtained from an ensemble of realistic sea-surface temperature values, wind speeds, atmospheric temperature profiles, water vapor profiles and cloud models. In spite of the immaturity of the data-processing algorithms, results are encouraging. For open ocean, rain-free cells of high-quality surface truth wind determinations display standard deviations of 3 m/sec about a bias of 1.5 m/sec. The sea-surface temperature exhibits a standard deviation of about 1.5 deg C about a bias of 3 to 5 deg C under a variety of meteorological conditions.

Lipes, R. G.↗
NASA NTRS1992

Automatic AVHRR image navigation software

This is the final report describing the work done on the project entitled Automatic AVHRR Image Navigation Software funded through NASA-Washington, award NAGW-3224, Account 153-7529. At the onset of this project, we had developed image navigation software capable of producing geo-registered images from AVHRR data. The registrations were highly accurate but required a priori knowledge of the spacecraft's axes alignment deviations, commonly known as attitude. The three angles needed to describe the attitude are called roll, pitch, and yaw, and are the components of the deviations in the along scan, along track and about center directions. The inclusion of the attitude corrections in the navigation software results in highly accurate georegistrations, however, the computation of the angles is very tedious and involves human interpretation for several steps. The technique also requires easily identifiable ground features which may not be available due to cloud cover or for ocean data. The current project was motivated by the need for a navigation system which was automatic and did not require human intervention or ground control points. The first step in creating such a system must be the ability to parameterize the spacecraft's attitude. The immediate goal of this project was to study the attitude fluctuations and determine if they displayed any systematic behavior which could be modeled or parameterized. We chose a period in 1991-1992 to study the attitude of the NOAA 11 spacecraft using data from the Tiros receiving station at the Colorado Center for Astrodynamic Research (CCAR) at the University of Colorado.

Baldwin, Dan↗
DOE OSTI2014

Analyzing reliability of virtual machine instances with dynamic pricing in the public cloud

This study presents reliability analysis of virtual machine instances in public cloud environments in the face of dynamic pricing. Different from traditional fixed pricing, dynamic pricing allows price to dynamically fluctuate over arbitrary period of time according to external factors such as supply and demand, excess capacity, etc. This pricing option introduces a new type of fault: virtual machine instances may be unexpectedly terminated due to conflicts in the original bid price and the current offered price. This new class of fault under dynamic pricing may be more dominant than traditional faults in cloud computing environments, where resource availability associated with traditional faults is often above 99.9%. To address and understand this new type of fault, we translated two classic reliability metrics, mean time between failures and availability, to the Amazon Web Services spot market using historical price data. We also validated our findings by submitting actual bids in the spot market. We found that overall, our historical analysis and experimental validation lined up well. Based upon these experimental results, we also provided suggestions and techniques to maximize overall reliability of virtual machine instances under dynamic pricing.

Cloud computing↗