Search NASA⌕ Search

SEARCH · Search NASA

Results for “cloud computing, data cloud”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 955 records · Page 53
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Optimizing cloud motion estimation on the edge with phase correlation and optical flow

Abstract. Phase correlation (PC) is a well-known method for estimating cloud motion vectors (CMVs) from infrared and visible spectrum images. Commonly, phase shift is computed in the small blocks of the images using the fast Fourier transform. In this study, we investigate the performance and the stability of the blockwise PC method by changing the block size, the frame interval, and combinations of red, green, and blue (RGB) channels from the total sky imager (TSI) at the United States Atmospheric Radiation Measurement user facility's Southern Great Plains site. We find that shorter frame intervals, followed by larger block sizes, are responsible for stable estimates of the CMV, as suggested by the higher autocorrelations. The choice of RGB channels has a limited effect on the quality of CMVs, and the red and the grayscale images are marginally more reliable than the other combinations during rapidly evolving low-level clouds. The stability of CMVs was tested at different image resolutions with an implementation of the optimized algorithm on the Sage cyberinfrastructure test bed. We find that doubling the frame rate outperforms quadrupling the image resolution in achieving CMV stability. The correlations of CMVs with the wind data are significant in the range of 0.38–0.59 with a 95 % confidence interval, despite the uncertainties and limitations of both datasets. A comparison of the PC method with constructed data and the optical flow method suggests that the post-processing of the vector field has a significant effect on the quality of the CMV. The raindrop-contaminated images can be identified by the rotation of the TSI mirror in the motion field. The results of this study are critical to optimizing algorithms for edge-computing sensor systems.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2018

Under canopy light detection and ranging–based autonomous navigation

This study describes a light detection and ranging (LiDAR)–based autonomous navigation system for an ultralightweight ground robot in agricultural fields. The system is designed for reliable navigation under cluttered canopies using only a 2D Hokuyo UTM–30LX LiDAR sensor as the single source for perception. Its purpose is to ensure that the robot can navigate through rows of crops without damaging the plants in narrow row–based and high–leaf–cover semistructured crop plantations, such as corn ( Zea mays ) and sorghum ( Sorghum bicolor ). The key contribution of our work is a LiDAR–based navigation algorithm capable of rejecting outlying measurements in the point cloud due to plants in adjacent rows, low–hanging leaf cover or weeds. The algorithm addresses this challenge using a set of heuristics that are designed to filter out outlying measurements in a computationally efficient manner, and linear least squares are applied to estimate within–row distance using the filtered data. Moreover, a crucial step is the estimate validation, which is achieved through a heuristic that grades and validates the fitted row–lines based on current and previous information. The proposed LiDAR–based perception subsystem has been extensively tested in production/breeding corn and sorghum fields. In such variety of highly cluttered real field environments, the robot logged more than 6 km of autonomous run in straight rows. These results demonstrate highly promising advances to LiDAR–based navigation in realistic field environments for small under–canopy robots.

42 ENGINEERING↗
NASA NTRS1982

Simulation studies of the physical and chemical processes occurring in the stratospheric clouds of the Mount St. Helens eruptions of May and June 1980

The large and diverse set of observational data collected in the high-altitude clouds of May 18, May 25, and June 13, 1980 was organized and analyzed for trends which reveal the processes at work. The data were used to guide and constrain model simulations of the volcanic eruptions. A comprehensive one-dimensional model of stratospheric sulfate aerosols, sulfur precursor gases, and volcanic ash and dust particles is utilized which accounts for homogeneous and heterogeneous chemistry in the clouds, aerosol nucleation and growth, and cloud expansion. Computational results are given for the time histories of the gaseous species concentrations, sulfate aerosol size dispersions, and ash burdens in the eruption clouds. The long-term buildup of stratospheric aerosols in the Northern Hemisphere and the persistent effects of injected chlorine and water vapor on ozone are discussed. It is concluded that SO2, water vapor, and ash are the most important substances injected by the volcano into the stratosphere, with respect to both the widespread effects on composition and the impact on climate. It is found that the volcano probably had little influence on the climate ( 0.05 K global surface cooling) or on stratospheric ozone ( 0.2 percent maximum hemispherical reduction).

Turco, R. P.↗
NASA NTRS1985

Cloud motion derived winds: Their accuracy, coverage, and suggestions for future improvement

Nature has provided us with a natural and easily visible method of tracing atmospheric motion through the measurement of cloud velocities. This source of wind information has been available from geosynchronous satellites since the launch of the ATS-1 Spin Scan camera. This sensor provided adequate spatial and temporal resolution views of individual cloud systems that could represent the wind with useful accuracy. During the last decade, cloud motion derived winds have become part of the operational system as they are routinely provided to the National Meteorological Center as input to the global numerical models. The principal limitations of cloud motion winds are that they (1) can be measured within the limits that cloud motions can represent the wind only where trackable clouds exist, (2) require knowledge of the cloud height, (3) require high spatial and temporal resolution geosynchronous satellite systems with high attitude determination accuracy, and (4) need sophisticated interactive computer systems for the calculation of high resolution fields. These limitations are examined and suggestions are made for how this product could be improved. Also, uses of the data for mesoscale purposes are discussed.

Shenk, William E.↗
NASA NTRS2019

Cloud Giovanni: Reining in Costs and Improving Performance with Analytical Data Stores Using Scalable Serverless Architecture

Giovanni is the Geospatial Interactive Online Visualization ANd aNalysis Infrastructure developed at NASA GES DISC which provides a simple and intuitive way to visualize, analyze, and access vast amounts of Earth science data. It receives large number of user requests each day for a variety of analysis and visualization services, which leads to the big data challenge of serving gradually increasing large data volumes with diverse statistical algorithms. We hereby propose a multi-dimensional accumulation method which provides fast and cost-efficient cloud analysis for diverse services including both area averaging and time averaging. This method involves the weighted volume integration over multiple variable dimensions (time and space), and is implemented in AWS using Athena providing serverless and highly scalable data analysis. Compared to the standard method, this approach dramatically reduced the computational time by order of magnitude with a minimal AWS cost incurred. For example, for a benchmark of 10-year area averaging over the 1x1 degree daily variable, the computational time was reduced from minutes to seconds, and the Athena cost is only $5 for 100,000 requests.

Zhang, Hailiang↗
NASA NTRS1977

Thunderstorm-associated cloud motions as computed from 5-minute SMS pictures

The five-minute rapid-scan imagery from the Synchronous Meteorological Satellite is employed to study cloud motions associated with the Omaha tornado of May 6, 1975. Cloud-motion vectors derived from automated and man-machine interactive systems provide an account of the mesoscale phenomena. In addition to the geostationary satellite data, aerial photography obtained during a cloud-truth mission is used in the severe storm investigation. For tracking overland cumuli with short half-lives, a three-minute scan interval appears necessary for the satellite imagery.

Tecson, J. J.↗
NASA NTRS1997

Microphysical Retrievals Over Stratiform Rain Using Measurements from an Airborne Dual-Wavelength Radar-Radiometer

The need to understand the complementarity of the radar and radiometer is important not only to the Tropical Rain Measuring Mission (TRMM) program but to a growing number of multi-instrumented airborne experiment that combine single or dual-frequency radars with multichannel radiometers. The method of analysis used in this study begins with the derivation of dual-wavelength radar equations for the estimation of a two-parameter drop size distribution (DSD). Defining a "storm model" as the set of parameters that characterize snow density, cloud water, water vapor, and features of the melting layer, then to each storm model there will usually correspond a set of range-profiled drop size distributions that are approximate solutions of the radar equations. To test these solutions, a radiative transfer model is used to compute the brightness temperatures for the radiometric frequencies of interest. A storm model or class of storm models is considered optimum if it provides the best reproduction of the radar and radiometer measurements. Tests of the method are made for stratiform rain using simulated storm models as well as measured airborne data. Preliminary results show that the best correspondence between the measured and estimated radar profiles usually can be obtained by using a moderate snow density (0.1-0.2 g/cu cm), the Maxwell-Garnett mixing formula for partially melted hydrometeors (water matrix with snow inclusions), and low to moderate values of the integrated cloud liquid water (less than 1 kg/sq m). The storm-model parameters that yield the best reproductions of the measured radar reflectivity factors also provide brightness temperatures at 10 GHz that agree well with the measurements. On the other hand, the correspondence between the measured and modeled values usually worsens in going to the higher frequency channels at 19 and 34 GHz. In searching for possible reasons for the discrepancies, It is found that changes in the DSD parameter Mu, the radar constants, or the path-integrated attenuation can affect the high frequency channels significantly. In particular, parameters that cause only modest increases in the median mass diameter of the snow, and which have a minor effect on the radar returns or the low frequency brightness temperature, can produce a strong cooling of the 34 GHz brightness temperature.

Meneghini, Robert↗
DOE OSTI2025

Fostering Geothermal Machine Learning Success: Elevating Big Data Accessibility and Automated Data Standardization in the Geothermal Data Repository

The Department of Energy's (DOE's) Geothermal Data Repository (GDR) has implemented improvements to both its data lakes and its data standards and automated data pipelines. The GDR data lakes have reduced storage and compute-related barriers to using large geothermal datasets, enabling these large datasets to be accessed by anyone with a modern computer and internet access. More recently, the GDR has been working to further reduce barriers through streamlining the data intake process, educating users on the process and requirements, and helping users access data from the data lakes. These improvements have augmented the quantity of datasets the GDR is able to accept into its data lakes and have enabled users who are new to cloud tools to access these datasets more easily, overall increasing the accessibility of big geothermal data for use in machine learning and other projects. In addition, the GDR now has built-in data standards and pipelines for drilling data, geospatial data, and distributed acoustic sensing (DAS) data. These standardization efforts aim to enhance the real-world applicability of geothermal machine learning outcomes by improving the quality of training data. Specifically, through standardizing high-value datasets, the GDR is reducing project-specific data curation requirements, thus allowing more time for actual research. By automating this process, the burden of standardization is lifted from the user, ultimately increasing the availability of standardized data. This paper provides an update on recent improvements made to the GDR's data lakes and automated data pipelines, including: (1) streamlining the data lake intake process, (2) better educating users on the process and requirements through a new data lakes page, (3) adding data lake direct access links to GDR data lake submission pages, (4) implementing a DAS data pipeline to convert DAS data uploaded in SEG-Y format to a standardized hierarchical data format v5 (HDF5), (5) extending this pipeline to encompass data in the GDR data lake, (6) adding metadata requirements for geospatial data, (7) making user interface/user experience (UX) enhancements to the data pipelines' documentation pages, and (8) improving the GDR's data standards and pipelines pages to better guide users in ensuring that their data is standardized by the GDR's automated data pipelines. 2024 Geothermal Resources Council. All rights reserved.

accessibility↗
DOE OSTI2017

Impact of Multiple Scattering on Longwave Radiative Transfer Involving Clouds

Abstract General circulation models (GCMs) are extensively used to estimate the influence of clouds on the global energy budget and other aspects of climate. Because radiative transfer computations involved in GCMs are costly, it is typical to consider only absorption but not scattering by clouds in longwave (LW) spectral bands. In this study, the flux and heating rate biases due to neglecting the scattering of LW radiation by clouds are quantified by using advanced cloud optical property models, and satellite data from Cloud‐Aerosol Lidar and Infrared Pathfinder Satellite Observation (CALIPSO), CloudSat, Clouds and the Earth's Radiant Energy System (CERES), and Moderate Resolution Imaging Spectrometer (MODIS) merged products (CCCM). From the products, information about the atmosphere and clouds (microphysical and buck optical properties, and top and base heights) is used to simulate fluxes and heating rates. One‐year global simulations for 2010 show that the LW scattering decreases top‐of‐atmosphere (TOA) upward flux and increases surface downward flux by 2.6 and 1.2 W/m 2 , respectively, or approximately 10% and 5% of the TOA and surface LW cloud radiative effect, respectively. Regional TOA upward flux biases are as much as 5% of global averaged outgoing longwave radiation (OLR). LW scattering causes approximately 0.018 K/d cooling at the tropopause and about 0.028 K/d heating at the surface. Furthermore, over 40% of the total OLR bias for ice clouds is observed in 350–500 cm −1 . Overall, the radiative effects associated with neglecting LW scattering are comparable to the counterpart due to doubling atmospheric CO 2 under clear‐sky conditions.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Synthesizing realistic sand assemblies with denoising diffusion in latent space

Abstract The shapes and morphological features of grains in sand assemblies have far‐reaching implications in many engineering applications, such as geotechnical engineering, computer animations, petroleum engineering, and concentrated solar power. Yet, our understanding of the influence of grain geometries on macroscopic response is often only qualitative, due to the limited availability of high‐quality 3D grain geometry data. In this paper, we introduce a denoising diffusion algorithm that uses a set of point clouds collected from the surface of individual sand grains to generate grains in the latent space. By employing a point cloud autoencoder, the three‐dimensional point cloud structures of sand grains are first encoded into a lower‐dimensional latent space. A generative denoising diffusion probabilistic model is trained to produce synthetic sand that maximizes the log‐likelihood of the generated samples belonging to the original data distribution measured by a Kullback‐Leibler divergence. Numerical experiments suggest that the proposed method is capable of generating realistic grains with morphology, shapes and sizes consistent with the training data inferred from an F50 sand database. We then use a rigid contact dynamic simulator to pour the synthetic sand in a confined volume to form granular assemblies in a static equilibrium state with targeted distribution properties. To ensure third‐party validation, 50,000 synthetic sand grains and the 1542 real synchrotron microcomputed tomography (SMT) scans of the F50 sand, as well as the granular assemblies composed of synthetic sand grains are made available in an open‐source repository.

Vlassis, Nikolaos N.↗
DOE OSTI2024

IoT-Based Comfort Control and Fault Diagnostics System for Energy-Efficient Homes

This project studies an Internet of Things (IoT)-based comfort control and fault diagnostics system (referred as iComfort in this report) for energy-efficient homes. The system delivers an occupant-comfort-oriented thermal environment adaptive to fault scenarios and achieves HVAC energy savings in a cost-effective and straightforward way. This smart iComfort home system consists of the following key features. 1) Cost-effectiveness and scalability of the entire hardware and software system: The system includes low-cost temperature, humidity, and airflow sensors, and a Raspberry Pi-based local hub that interfaces with the cloud and IoT-enabled devices. The cost is low, not only for sensors, but also the costs associated with sensor installation, system setup and commissioning, data communication and storage, and data analytics (e.g., the development of automated fault detection and diagnosis (AFDD), as well as adaptive control strategies that are both computationally efficient and practical to implement). 2) Energy performance and user satisfaction: The system delivers user satisfaction and energy savings. This includes a) ease of use, b) optimal occupant thermal comfort, and c) accurate system feedback (e.g., low false alarm of AFDD strategies). 3) Favorable demonstrated prototype performance: The prototype tested at the Pacific Northwest National Laboratory (PNNL) Lab Homes demonstrates the accuracy of fault detections and diagnoses and shows thermal comfort improvement and energy savings through adaptive and optimal HVAC operations.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2024

GlideinBenchmark: collecting resource information to optimize provisioning

Choosing the right resource can speedup jobs completion, better utilize the available hardware and visibly reduce costs, especially when renting computers on the cloud. This was demonstrated in earlier studies on HEPCloud. But the benchmarking of the resources proved to be a laborious and time-consuming process. This paper presents GlideinBenchmark, a new Web application leveraging the pilot infrastructure of GlideinWMS to benchmark resources, and shows how to use the data collected and published by GlideinBenchmark to automate the optimal selection of resources. An experiment can select the benchmark or the set of benchmarks that most closely evaluate the performance of its workflows. With GlideinBenchmark and the help of the GldieinWMS Factory it controls the benchmark execution. Finally, a scheduler like HEPCloud’s Decision Engine can use the results to optimize resource provisioning.

Mambelli, Marco↗
NASA NTRS1999

Sensitivity Analysis of Aerosol Retrieval Algorithms Using Two-Channel Satellite Radiance Data

We discuss the methodology of interpreting channel 1 and 2 AVHRR radiance data to retrieve tropospheric aerosol properties over the ocean and describe a detailed analysis of the sensitivity of monthly average retrievals to the assumed aerosol models. We use real AVHRR data and accurate numerical techniques for computing single and multiple scattering and spectral absorption of light in the vertically inhomogeneous atmosphere-ocean system. Our analysis shows that two-channel algorithms can provide significantly more accurate retrievals of the aerosol optical thickness than one-channel algorithms and that imperfect cloud screening is the largest source of errors in the retrieved optical thickness. Both underestimating and overestimating aerosol absorption as well as strong variability of the aerosol refractive index may lead to regional and/or seasonal biases in optical thickness retrievals. The Angstrom exponent appears to be the most invariant aerosol size characteristic and should be retrieved along with optical thickness as the second aerosol parameter.

Geogdzhayev, Igor V.↗
NASA NTRS2000

Lidar Measurements of Relative Humidity and Ice Supersaturation in the Upper Troposphere

We compute upper tropospheric relative humidity profiles using water vapor profiles measured by an airborne DIAL and a ground-based Raman lidar. LASE water vapor and MTP temperature profiles acquired from the NASA DC-8 aircraft during the recent Pacific Exploratory Mission Tropics B (PEM Tropics B) field mission in the tropical Pacific and the SAGE-III Ozone Loss and Validation Experiment (SOLVE) in the Arctic as well as water vapor profiles derived from the ground-based DOE ARM Southern Great Plains (SGP) CART Raman lidar are used. Comparisons of the lidar water vapor measurements with available in situ measurements show reasonable agreement for water vapor mixing ratios above 0.05 g/kg. Relative humidity frequency distributions computed using LASE data indicate that ice supersaturation occurred about 5-11% of the time when temperatures were below -35 C. While a higher frequency of ice supersaturation was observed during SOLVE, higher peak values of relative humidity were observed during PEM Tropics B. The relative humidity fields associated with cirrus clouds are also examined.

Ferrare, Richard A.↗
NASA NTRS2006

Lifetimes and Oscillator Strengths for Ultraviolet Transitions in P II, Cl II and Cl III

Oscillator strengths for transitions in P II, Cl II and Cl III are derived from lifetimes and branching factions measured with beam-foil techniques. The focus is on the multiplets with a prominent interstellar line at 1153 A in P II which is seen in spectra of hot stars, and the lines at 1071 A in Cl II and 1011 A in Cl III whose lines are seen in spectra of diffuse interstellar clouds and the Io torus acquired with the Far Ultraviolet Spectroscopic Explorer. These data represent the first complete set of experimental f-values for the lines in the multiplets. Our results for P II (lambda)1153 agree well with Curtis semi-empirical predictions, as well as the large scale computations by Hibbert and by Tayal. The data for Cl II (lambda)1071 also agree very well with the most recent theoretical effort and with Morton s newest recommendations. For Cl III, however, our f-values are significantly larger than those given by Morton; instead, they are more consistent with recent large-scale theoretical calculations. Extensive tests provide confirmation that LS coupling rules apply to the transitions for the multiplets in Cl II and Cl III.

Cheng, S.↗
NASA NTRS2013

Lightning NOx Statistics Derived by NASA Lightning Nitrogen Oxides Model (LNOM) Data Analyses

What is the LNOM? The NASA Marshall Space Flight Center (MSFC) Lightning Nitrogen Oxides Model (LNOM) [Koshak et al., 2009, 2010, 2011; Koshak and Peterson 2011, 2013] analyzes VHF Lightning Mapping Array (LMA) and National Lightning Detection Network(TradeMark) (NLDN) data to estimate the lightning nitrogen oxides (LNOx) produced by individual flashes. Figure 1 provides an overview of LNOM functionality. Benefits of LNOM: (1) Does away with unrealistic "vertical stick" lightning channel models for estimating LNOx; (2) Uses ground-based VHF data that maps out the true channel in space and time to < 100 m accuracy; (3) Therefore, true channel segment height (ambient air density) is used to compute LNOx; (4) True channel length is used! (typically tens of kilometers since channel has many branches and "wiggles"); (5) Distinction between ground and cloud flashes are made; (6) For ground flashes, actual peak current from NLDN used to compute NOx from lightning return stroke; (7) NOx computed for several other lightning discharge processes (based on Cooray et al., 2009 theory): (a) Hot core of stepped leaders and dart leaders, (b) Corona sheath of stepped leader, (c) K-change, (d) Continuing Currents, and (e) M-components; and (8) LNOM statistics (see later) can be used to parameterize LNOx production for regional air quality models (like CMAQ), and for global chemical transport models (like GEOS-Chem).

Koshak, William↗
NASA NTRS1973

Monitor weather conditions for cloud seeding control

The author has identified the following significant results. The near real-time DCS platform data transfer to the time-share compare is a working reality. Six stations are now being automatically monitored and displayed with a system delay of 3 to 8 hours from time of data transmission to time of data accessibility on the computer. The DCS platform system has proven itself a valuable tool for near real-time monitoring of mountain precipitation. Data from Wolf Creek Pass were an important input in making the decision when to suspend seeding operations to avoid exceeding suspension criteria in that area. The DCS platforms, as deployed in this investigation, have proven themselves to be reliable weather resistant systems for winter mountain environments in the southern Colorado mountains.

Kahan, A. M.↗
DOE OSTI2023

A Sparse Distributed Gigascale Resolution Material Point Method

In this paper, we present a four-layer distributed simulation system and its adaptation to the Material Point Method (MPM). The system is built upon a performance portable C++ programming model targeting major High-Performance-Computing (HPC) platforms. A key ingredient of our system is a hierarchical block-tile-cell sparse grid data structure that is distributable to an arbitrary number of Message Passing Interface (MPI) ranks. We additionally propose strategies for efficient dynamic load balance optimization to maximize the efficiency of MPI tasks. Our simulation pipeline can easily switch among backend programming models, including OpenMP and CUDA, and can be effortlessly dispatched onto supercomputers and the cloud. Finally, we construct benchmark experiments and ablation studies on supercomputers and consumer workstations in a local network to evaluate the scalability and load balancing criteria. We demonstrate massively parallel, highly scalable, and gigascale resolution MPM simulations of up to 1.01 billion particles for less than 323.25 seconds per frame with 8 OpenSSH-connected workstations.

97 MATHEMATICS AND COMPUTING↗