SEARCH · Search NASA

Results for “cloud computing, data cloud”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 703 records · Page 39

All sources NASA NTRS DOE OSTI

NASA NTRS2014

Computational Aerodynamic Analysis of Three-Dimensional Ice Shapes on a NACA 23012 Airfoil

The present study identifies a process for performing computational fluid dynamic calculations of the flow over full three-dimensional (3D) representations of complex ice shapes deposited on aircraft surfaces. Rime and glaze icing geometries formed on a NACA23012 airfoil were obtained during testing in the NASA Glenn Research Centers Icing Research Tunnel (IRT). The ice shape geometries were scanned as a cloud of data points using a 3D laser scanner. The data point clouds were meshed using Geomagic software to create highly accurate models of the ice surface. The surface data was imported into Pointwise grid generation software to create the CFD surface and volume grids. It was determined that generating grids in Pointwise for complex 3D icing geometries was possible using various techniques that depended on the ice shape. Computations of the flow fields over these ice shapes were performed using the NASA National Combustion Code (NCC). Results for a rime ice shape for angle of attack conditions ranging from 0 to 10 degrees and for freestream Mach numbers of 0.10 and 0.18 are presented. For validation of the computational results, comparisons were made to test results from rapid-prototype models of the selected ice accretion shapes, obtained from a separate study in a subsonic wind tunnel at the University of Illinois at Urbana-Champaign. The computational and experimental results were compared for values of pressure coefficient and lift. Initial results show fairly good agreement for rime ice accretion simulations across the range of conditions examined. The glaze ice results are promising but require some further examination.

Aerodynamics↗

NASA NTRS2018

The Harmonized Landsat and Sentinel-2 Surface Reflectance Data Set

The Harmonized Landsat and Sentinel-2 (HLS) project is a NASA initiative aiming to produce a VirtualConstellation (VC) of surface reflectance (SR) data acquired by the Operational Land Imager (OLI) and MultiSpectral Instrument (MSI) aboard Landsat 8 and Sentinel-2 remote sensing satellites, respectively. The HLS products are based on a set of algorithms to obtain seamless products from both sensors (OLI and MSI): atmospheric correction, cloud and cloud-shadow masking, spatial co-registration and common gridding, bidirectional reflectance distribution function normalization and spectral bandpass adjustment. Three products are derivedfrom the HLS processing chain: (i) S10: full resolution MSI SR at 10 m, 20 m and 60 m spatial resolutions; (ii)S30: a 30 m MSI Nadir BRDF (Bidirectional Reflectance Distribution Function)-Adjusted Reflectance (NBAR);(iii) L30: a 30 m OLI NBAR. All three products are processed for every Level-1 input products from Landsat 8/OLI (L1T) and Sentinel-2/MSI (L1C). As of version 1.3, the HLS data set covers 10.35 million km2 and spans from first Landsat 8 data (2013); Sentinel-2 data spans from October 2015. The L30 and S30 show a good consistency with coarse spatial resolution products, in particular MODIS Collection 6 MCD09CMG products (overall deviations do not exceed 11%) that are used as a reference for quality assurance. The spatial co-registration of the HLS is improved compared to original Landsat 8 L1T and Sentinel 2A L1C products, for which misregistration issues between multi-temporal data are known. In particular, the resulting computed circular errors at 90% for the HLS product are 6.2 m and 18.8 m, for S10 and L30 products, respectively. The main known issue of the current data set remains the Sentinel-2 cloud mask with many cloud detection omissions. The cross-comparison with MODIS was used to flag products with most evident non-detected clouds. A time series outlier filtering approach is suggested to detect remaining clouds. Finally, several time series are presented to highlight the high potential of the HLS data set for crop monitoring.

Landsat Sentinel-2↗

NASA NTRS2004

GMS-based"Future Time" Rainfall Data Assimilation for Mesoscale Weather Prediction over Korean Peninsula and Future Prospects with GPM Satellite Measurements

This study examines the use of satellite-derived nowcasted (short-term forecasted) rainfall over 3-hour time periods to gain an equivalent time increment in initializing a nonhydrostatic mesoscale model used for predicting convective rainfall events over the Korean peninsula. Infrared (IR) window measurements from the Japanese Geostationary Meteorological Satellite (GMS) are used to specify latent heating for a spinup period of the model - but in future time -- thus initializing in advance of actual time in the framework of a prediction scenario. The main scientific objective of the study is to investigate the strengths and weaknesses of this approach insofar as data assimilation, in which the nowcasted assimilation data are derived independently of the prognostic model itself. Although there have been various recent improvements in formulating the dynamics, thermodynamics, and microphysics of mesoscale models, as well as computer advances which allow the use of high resolution cloud-resolving grids and explicit latent heating over regional domains, spinup remains at the forefront of unresolved mesoscale modeling problems. In general, non-realistic spinup limits the skill in predicting the spatial-temporal distribution of convection and precipitation, primarily in the early hours of a. forecast, stemming from standard prognostic variables not representing the initial diabatic heating field produced by the ambient convection and cloud fields. The long-term goal of this research is to improve short-range (12-hour) quantitative precipitation forecasting (QPF) over the Korean peninsula through the use of innovative data assimilation methods based on geosynchronous satellite measurements. As a step in th~s direction, a non-standard data assimilation experiment in conjunction with GMS-retrieved nowcasted rainfall information introduced to the mesoscale model is conducted. The 3-hourly precipitation forecast information is assimilated through nudging the associated diabatic heating during the early stages of a forecast period. This procedure is expected to enhance details in the moisture field during model integration, and thus improve spinup performance, assuming the errors in the future time latent heating data ate less than intrinsic model background errors.

Smith, Eric A.↗

DOE OSTI2017

Spectral binning for energy production calculations and multijunction solar cell design

Currently, most solar cells are designed for and evaluated under standard spectra intended to represent typical spectral conditions. However, no single spectrum can capture the spectral variability needed for annual energy production (AEP) calculations, and this shortcoming becomes more significant for series-connected multijunction cells as the number of junctions increases. For this reason, AEP calculations are often performed on very detailed yearlong sets of data, but these pose 2 inherent challenges: (1) These data sets comprise thousands of data points, which appear as a scattered cloud of data when plotted against typical parameters and are hence cumbersome to classify and compare, and (2) large sets of spectra bring with them a corresponding increase in computation or measurement time. Here, we show how a large spectral set can be reduced to just a few 'proxy' spectra, which still retain the spectral variability information needed for AEP design and evaluation. The basic 'spectral binning' methods should be extensible to a variety of multijunction device architectures. In this study, as a demonstration, the AEP of a 4-junction device is computed for both a full set of spectra and a reduced proxy set, and the results show excellent agreement for as few as 3 proxy spectra. This enables much faster (and thereby more detailed) calculations and indoor measurements and provides a manageable way to parameterize a spectral set, essentially creating a 'spectral fingerprint,' which should facilitate the understanding and comparison of different sites.

14 SOLAR ENERGY↗

DOE OSTI2014

Machine Learning Toolkit for Extreme Scale

Support Vector Machines (SVM) is a popular machine learning technique, which has been applied to a wide range of domains such as science, finance, and social networks for supervised learning. MaTEx undertakes the challenge of designing a scalable parallel SVM training algorithm for large scale systems, which includes commodity multi-core machines, tightly connected supercomputers and cloud computing systems. Several techniques are proposed for improved speed and memory space usage including adaptive and aggressive elimination of samples for faster convergence , and sparse format representation of data samples. Several heuristics for earliest possible to lazy elimination of non-contributing samples are considered in MaTEx. In many cases, where an early sample elimination might result in a false positive, low overhead mechanisms for reconstruction of key data structures are proposed. The proposed algorithm and heuristics are implemented and evaluated on various publicly available datasets

Source record↗

DOE OSTI2025

Adaptive Computing (AC) [SWR-24-106]

The Adaptive Computing (AC) software stack supports goal-based computing, for which a simulation workload is created on the fly adapting to the results of calculations. Application-specific code defines an objective, which may be to solve an optimization problem or to train a surrogate model with minimal uncertainty. Then, the AC driver decides where in the design parameter space to run simulations to best achieve that objective. This process is iterative and online; as new data is returned from simulations, the AC driver chooses new simulations to run. The AC driver can strategically run simulations on distributed hardware resources (including high performance computing machines, cloud resources, and edge devices) to maximize throughput and obey resource constraints.

Griffin, Kevin [National Renewable Energy Laborato↗

DOE OSTI2026

Adaptive Computing (AC) (Open Source) [SWR-24-106]

The Adaptive Computing (AC) software stack supports goal-based computing, for which a simulation workload is created on the fly, adapting to the results of calculations. Application-specific code defines an objective, which may be to solve an optimization problem or to train a surrogate model with minimal uncertainty. Then, the AC driver decides where in the design parameter space to run simulations to best achieve that objective. This process is iterative and online; as new data is returned from simulations, the AC driver chooses new simulations to run. The AC driver can strategically run simulations on distributed hardware resources (including high performance computing machines, cloud resources, and edge devices) to maximize throughput and obey resource constraints.

Griffin, Kevin [National Laboratory of the Rockies↗

NASA NTRS1992

Image masking using polygon fills and morphological transformations

Polygon-fill operations and morphological transformations are effective computational tools for the land-masking and coastline-correction preprocessing operations often applied to AVHRR data prior to oceanographic applications. These masking operations, in conjunction with cloud-screening techniques, can be used on such other oceanographically significant remote-sensing data as those of the Coastal Zone Color Scanner, GOES, and Landsat. The sensitivity of the methods to regional variations in atmospheric conditions and land-ocean temperature gradients is assessed for tropical, midlatitude, and high latitude regions.

Simpson, James J.↗

NASA NTRS1994

Study of atmospheric parameters measurements using MM-wave radar in synergy with LITE-2

The Lidar In-Space Technology Experiment, (LITE), has been developed, designed, and built by NASA Langley Research Center, to be flown on the space shuttle 'Discovery' on September 9, 1994. Lidar, which stands for light detecting and ranging, is a radar system that uses short pulses of laser light instead of radio waves in the case of the common radar. This space-based lidar offers atmospheric measurements of stratospheric and tropospheric aerosols, the planetary boundary layer, cloud top heights, and atmospheric temperature and density in the 10-40 km altitude range. A study is being done on the use, advantages, and limitations of a millimeterwave radar to be utilized in synergy with the Lidar system, for the LITE-2 experiment to be flown on a future space shuttle mission. The lower atmospheric attenuation, compared to infrared and optical frequencies, permits the millimeter-wave signals to penetrate through the clouds and measure multi-layered clouds, cloud thickness, and cloud-base height. These measurements would provide a useful input to radiation computations used in the operational numerical weather prediction models, and for forecasting. High power levels, optimum modulation, data processing, and high antenna gain are used to increase the operating range, while space environment, radar tradeoffs, and power availability are considered. Preliminary, numerical calculations are made, using the specifications of an experimental system constructed at Georgia Tech. The noncoherent 94 GHz millimeter-wave radar system has a pulsed output with peak value of 1 kW. The backscatter cross section of the particles to be measured, that are present in the volume covered by the beam footprint, is also studied.

Andrawis, Madeleine Y.↗

NASA NTRS2014

Computational Aerodynamic Analysis of Three-Dimensional Ice Shapes on a NACA 23012 Airfoil

The present study identifies a process for performing computational fluid dynamic calculations of the flow over full three-dimensional (3D) representations of complex ice shapes deposited on aircraft surfaces. Rime and glaze icing geometries formed on a NACA23012 airfoil were obtained during testing in the NASA Glenn Research Center's Icing Research Tunnel (IRT). The ice shape geometries were scanned as a cloud of data points using a 3D laser scanner. The data point clouds were meshed using Geomagic software to create highly accurate models of the ice surface. The surface data was imported into Pointwise grid generation software to create the CFD surface and volume grids. It was determined that generating grids in Pointwise for complex 3D icing geometries was possible using various techniques that depended on the ice shape. Computations of the flow fields over these ice shapes were performed using the NASA National Combustion Code (NCC). Results for a rime ice shape for angle of attack conditions ranging from 0 to 10 degrees and for freestream Mach numbers of 0.10 and 0.18 are presented. For validation of the computational results, comparisons were made to test results from rapid-prototype models of the selected ice accretion shapes, obtained from a separate study in a subsonic wind tunnel at the University of Illinois at Urbana-Champaign. The computational and experimental results were compared for values of pressure coefficient and lift. Initial results show fairly good agreement for rime ice accretion simulations across the range of conditions examined. The glaze ice results are promising but require some further examination.

Aerodynamics↗

DOE OSTI2014

Machine Learning Toolkit for Extreme Scale

Source record↗

NASA NTRS1991

Global precipitation estimates from satellite - Using difference fields of outgoing long-wave radiation

Global precipitation estimates using satellite data are derived using difference fields of outgoing long-wave radiation (OLR). The difference fields consist of clear OLR minus cloudy OLR, which is a measure of long-wave cloud radiative forcing at the top of the earth-atmosphere system; and clear daytime OLR minus clear night-time OLR, which is a measure of the diurnal variation of surface heating. All geophysical parameters used to compute OLR are derived from an analysis of the HIRS2/MSU sounding data. The derived global precipitation estimates show good agreement with collocated raingage data over land.

Wu, Man-Li↗

NASA NTRS2016

GC31G-1182: Opennex, a Private-Public Partnership in Support of the National Climate Assessment

The NASA Earth Exchange (NEX) is a collaborative computing platform that has been developed with the objective of bringing scientists together with the software tools, massive global datasets, and supercomputing resources necessary to accelerate research in Earth systems science and global change. NEX is funded as an enabling tool for sustaining the national climate assessment. Over the past five years, researchers have used the NEX platform and produced a number of data sets highly relevant to the National Climate Assessment. These include high-resolution climate projections using different downscaling techniques and trends in historical climate from satellite data. To enable a broader community in exploiting the above datasets, the NEX team partnered with public cloud providers to create the OpenNEX platform. OpenNEX provides ready access to NEX data holdings on a number of public cloud platforms along with pertinent analysis tools and workflows in the form of Machine Images and Docker Containers, lectures and tutorials by experts. We will showcase some of the applications of OpenNEX data and tools by the community on Amazon Web Services, Google Cloud and the NEX Sandbox.

datasets↗

NASA NTRS2002

An Improved Retrieval of Tropospheric Nitrogen Dioxide from GOME

We present a retrieval of tropospheric nitrogen dioxide (NO2) columns from the Global Ozone Monitoring Experiment (GOME) satellite instrument that improves in several ways over previous retrievals, especially in the accounting of Rayleigh and cloud scattering. Slant columns, which are directly fitted without low-pass filtering or spectral smoothing, are corrected for an artificial offset likely induced by spectral structure on the diffuser plate of the GOME instrument. The stratospheric column is determined from NO2 columns over the remote Pacific Ocean to minimize contamination from tropospheric NO2. The air mass factor (AMF) used to convert slant columns to vertical columns is calculated from the integral of the relative vertical NO2 distribution from a global 3-D model of tropospheric chemistry driven by assimilated meteorological data (Global Earth Observing System (GEOS)-CHEM), weighted by altitude dependent scattering weights computed with a radiative transfer model (Linearized Discrete Ordinate Radiative Transfer), using local surface albedos determined from GOME observations at NO2 wavelengths. The AMF calculation accounts for cloud scattering using cloud fraction, cloud top pressure, and cloud optical thickness from a cloud retrieval algorithm (GOME Cloud Retrieval Algorithm). Over continental regions with high surface emissions, clouds decrease the AMT by 20- 30% relative to clear sky. GOME is almost twice as sensitive to tropospheric NO2 columns over ocean than over land. Comparison of the retrieved tropospheric NO2 columns for July 1996 with GEOS-CHEM values tests both the retrieval and the nitrogen oxide radical (NOx) emissions inventories used in GEOS-CHEM. Retrieved tropospheric NO2 columns over the United States, where NOx emissions are particularly well known, are within 18% of GEOS-CHEM columns and are strongly spatially correlated (r = 0.78, n = 288, p less than 0.005). Retrieved columns show more NO2 than GEOS-CHEM columns over the Transvaal region of South Africa and industrial regions of the northeast United States and Europe. They are lower over Houston, India, eastern Asia, and the biomass burning region of central Africa, possibly because of biases from absorbing aerosols.

Martin, Randall V.↗

NASA NTRS1983

User's guide for the Solar Backscattered Ultraviolet (SBUV) and the Total Ozone Mapping Spectrometer (TOMS) RUT-S and RUT-T data sets: October 31, 1978 to November 1, 1980

Raw data from the Solar Backscattered Ultrviolet/Total Ozone Mapping Spectrometer (SBUV/TOMS) Nimbus 7 operation are available on computer tape. These data are contained on two separate sets of RUTs (Raw Units Tapes) for SBUV and TOMS, labelled RUT-S and RUT-T respectively. The RUT-S and RUT-T tapes contain uncalibrated radiance and irradiance data, housekeeping data, wavelength and electronic calibration data, instrument field-of-view location and solar ephemeris information. These tapes also contain colocated cloud, terrain pressure and snow/ice thickness data, each derived from an independent source. The "RUT User's Guide" describes the SBUV and TOMS experiments, the instrument calibration and performance, operating schedules, and data coverage, and provides an assessment of RUT-S and -T data quality. It also provides detailed information on the data available on the computer tapes.

Fleig, A. J.↗

DOE OSTI2023

A Method for Projecting Cloud Shadows Onto a Central Receiver Field to Predict Receiver Damage

This work demonstrates methods of mapping high-spatial-resolution direct normal irradiance (DNI) data from satellites, Total Sky Imagers (TSIs), and analogous data sources onto a heliostat field for characterizing the spatial and temporal variation of the incident flux on a central receiver tower during cloud transient events. The mapping methods are incorporated into an optical software module that interfaces with CoPylot–SolarPILOT’s python API– to provide computationally efficient optical simulation of the heliostat field and the solar power tower. Eventually, this optical model will be incorporated into optimization models whereby a plant operator can understand the effects of cloud transient events on overall power production and receiver lifetime due to creep-fatigue damage and therefore make better informed decisions about receiver shutdown events. By more accurately modelling the effects of cloud events on receiver flux maps, this work may determine the magnitude and frequency of thermal cycling on receiver tubes and panels using actual or realistic cloud shapes instead of averaged DNI values–which may undercount the total cycle number. This work may also prevent unnecessary plant shutdowns due to overly precautionary control strategies and characterize the relative impact of various cloud types on receiver life. We plan to eventually integrate this methodology into the System Advisor Model (SAM) to improve performance model accuracy during periods of cloudiness. In this paper, we demonstrate generating DNI maps and mapping them to a solar field in CoPylot using 10 m resolution data from publicly available Sentinel-2 satellite data over the Crescent Dunes plant.

Mullin, Matthew↗

DOE OSTI2015

Laser scanner data processing and 3D modeling using a free and open source software

The laser scanning is a technology that allows in a short time to run the relief geometric objects with a high level of detail and completeness, based on the signal emitted by the laser and the corresponding return signal. When the incident laser radiation hits the object to detect, then the radiation is reflected. The purpose is to build a three-dimensional digital model that allows to reconstruct the reality of the object and to conduct studies regarding the design, restoration and/or conservation. When the laser scanner is equipped with a digital camera, the result of the measurement process is a set of points in XYZ coordinates showing a high density and accuracy with radiometric and RGB tones. In this case, the set of measured points is called “point cloud” and allows the reconstruction of the Digital Surface Model. Even the post-processing is usually performed by closed source software, which is characterized by Copyright restricting the free use, free and open source software can increase the performance by far. Indeed, this latter can be freely used providing the possibility to display and even custom the source code. The experience started at the Faculty of Engineering in Catania is aimed at finding a valuable free and open source tool, MeshLab (Italian Software for data processing), to be compared with a reference closed source software for data processing, i.e. RapidForm. In this work, we compare the results obtained with MeshLab and Rapidform through the planning of the survey and the acquisition of the point cloud of a morphologically complex statue.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

DOE OSTI2023

mzapy : An Open-Source Python Library Enabling Efficient Extraction and Processing of Ion Mobility Spectrometry-Mass Spectrometry Data in the MZA File Format

We have recently reported MZA, a new and simple mass spectrometry data structure based on the broadly supported HDF5 format and created to facilitate software development. While this format is inherently supportive of application development, the availability of a core library with standard mass spectrometry utilities greatly facilitates fast software development. Here, we present a Python library, mzapy, for efficient extraction and processing of mass spectrometry data in the MZA format. In addition to raw data extraction, mzapy contains supporting utilities enabling tasks including calibration, signal processing, peak finding, and generating plots. Being implemented in pure Python with minimal and largely standardized dependencies makes mzapy uniquely suited to application development in the multi-omics domain. The free and open source mzapy is built with extensibility in mind, and future development will support cloud computing and artificial intelligence/machine learning applications. The software source code is freely available at https://github.com/PNNL-m-q/mzapy.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗