Search NASA⌕ Search

SEARCH · Search NASA

Results for “cloud computing, data cloud”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,333 records · Page 74

The Landsat thematic mapper World Data Base

A World Data Base of potential thematic mapper (TM) scenes was developed to aid in acquisition planning. The World Data Base contains geopolitical, geographic and economic regions along with a format that enables users to find the satellite day, sun angle and cloud cover probability for any month of the year. Scenes that have been acquired by TM and have an average cloud cover of 30 percent of less from July 1982 when TM was launched until the Landsat system was taken over by NOAA in September 1984 are also in the World Data Base. Processed data are referenced in maps and data bases at EROS Data Center; however, a large number of acquistions have never been processed and therefore are not accessible. The World Data Base enables the rapid location of scenes and areas with the least effort making it invaluable in TM scheduling. Users of TM data can use the World Data Base to determine if scenes of interest have been acquired, the acquisition date, and if scenes have been processed to computer-compatible tape (CCT). These uses of the World Data Base make it a valuable tool in the acquisition and location of TM scenes.

Ludwig, R. W.↗

Forecasting Lightning at Kennedy Space Center/Cape Canaveral Air Force Station, Florida

The Applied Meteorology Unit (AMU) developed a set of statistical forecast equations that provide a probability of lightning occurrence on Kennedy Space Center (KSC) I Cape Canaveral Air Force Station (CCAFS) for the day during the warm season (May September). The 45th Weather Squadron (45 WS) forecasters at CCAFS in Florida include a probability of lightning occurrence in their daily 24-hour and weekly planning forecasts, which are briefed at 1100 UTC (0700 EDT). This information is used for general scheduling of operations at CCAFS and KSC. Forecasters at the Spaceflight Meteorology Group also make thunderstorm forecasts for the KSC/CCAFS area during Shuttle flight operations. Much of the current lightning probability forecast at both groups is based on a subjective analysis of model and observational data. The objective tool currently available is the Neumann-Pfeffer Thunderstorm Index (NPTI, Neumann 1971), developed specifically for the KSCICCAFS area over 30 years ago. However, recent studies have shown that 1-day persistence provides a better forecast than the NPTI, indicating that the NPTI needed to be upgraded or replaced. Because they require a tool that provides a reliable estimate of the daily thunderstorm probability forecast, the 45 WS forecasters requested that the AMU develop a new lightning probability forecast tool using recent data and more sophisticated techniques now possible through more computing power than that available over 30 years ago. The equation development incorporated results from two research projects that investigated causes of lightning occurrence near KSCICCAFS and over the Florida peninsula. One proved that logistic regression outperformed the linear regression method used in NPTI, even when the same predictors were used. The other study found relationships between large scale flow regimes and spatial lightning distributions over Florida. Lightning, probabilities based on these flow regimes were used as candidate predictors in the equation development. Fifteen years (1 989-2003) of warm season data were used to develop the forecast equations. The data sources included a local network of cloud-to-ground lightning sensors called the Cloud-to-Ground Lightning Surveillance System (CGLSS), 1200 UTC Florida synoptic soundings, and the 1000 UTC CCAFS sounding. Data from CGLSS were used to determine lightning occurrence for each day. The 1200 UTC soundings were used to calculate the synoptic-scale flow regimes and the 1000 UTC soundings were used to calculate local stability parameters, which were used as candidate predictors of lightning occurrence. Five logistic regression forecast equations were created through careful selection and elimination of the candidate predictors. The resulting equations contain five to six predictors each. Results from four performance tests indicated that the equations showed an increase in skill over several standard forecasting methods, good reliability, an ability to distinguish between non-lightning and lightning days, and good accuracy measures and skill scores. Given the overall good performance the 45 WS requested that the equations be transitioned to operations and added to the current set of tools used to determine the daily lightning probability of occurrence.

Lambert, Winfred↗

Geometric GNNs for charged particle tracking at GlueX

Nuclear physics experiments are aimed at uncovering the fundamental building blocks of matter. The experiments involve high-energy collisions that produce complex events with many particle trajectories. Tracking charged particles resulting from collisions in the presence of a strong magnetic field is critical to enable the reconstruction of particle trajectories and precise determination of interactions. It is traditionally achieved through combinatorial approaches that scale worse than linearly as the number of hits grows. Since particle hit data naturally form a point cloud and can be structured as graphs, graph neural networks (GNNs) emerge as an intuitive and effective choice for this task. In this study, we evaluate the GNN model for track finding on the data from the GlueX experiment at Jefferson Lab. We use simulation data to train the model and test on both simulation and real GlueX measurements. We demonstrate that GNN-based track finding outperforms the currently used traditional method at GlueX in terms of segment-based efficiency at a fixed purity while providing faster inferences. We show that the GNN model can achieve significant speedup by processing multiple events in batches, which exploits the parallel computation capability of graphical processing units (GPUs). Finally, we compare the GNN implementation on GPU and field-programmable gate array and describe the trade-off.

batched GNN pipeline↗

Geophysical Retrievals in an Artificial Intelligence (AI) Framework for Illuminating Processes Controlling Water Cycle

Focal Area(s): This white paper responds to Focal Area #3: Insight gleaned from complex data (both observed and simulated) using AI, big data analytics, and other advanced methods, including explainable AI and physics- or knowledge-guided AI. Science Challenge: This white paper addresses the water-cycle and data-model integration grand challenge. It leverages data from the Atmospheric Radiation Measurement (ARM) Climate Research Facility, and Next-Generation Ecosystem Experiment (NGEE), and Science Focus Area (SFA). The white paper focuses on controlling cloud, precipitation, and radiative properties as observed and simulated by the Earth System Models (ESM). The described framework can be readily applied to any other ensemble of instruments, including satellites and other ground-based networks.

54 ENVIRONMENTAL SCIENCES↗

Introduction to Engage: NASA Training Session

Welcome to Engage! Engage is a capacity expansion modeling tool supported by the National Renewable Energy Laboratory and based on the Calliope open-source capacity expansion model developed by the ETH Zurich University, maintained at the TU Delft University. Engage is an accessible (free, open-access, web-hosted) and flexible web-based energy system planning application for rapid multiple-energy-form energy system scenario exploration. Its cloud-based, collaborator-sharable data model, intuitive interface and visualization capabilities facilitate collaboration and communication among teams, with experts, and among diverse stakeholder groups exploring energy system implications from district to national-scale models. This training session was presented to the National Aeronautics and Space Administration (NASA) to help them understand how capacity expansion modeling can help them develop single site/distribution analysis of energy to regional airports.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Cirrus microphysics observations made during FIRE 2: Small particles, high concentrations, and probe comparisons

Aircraft observations of cirrus cloud microphysics were made near Coffeyville, Kansas during Nov. and Dec. 1991. Cloud microphysics measurements were made using both a PMS 2DC probe and an ice particle replicator, both were mounted on the UND Citation aircraft. Intercomparison is made of the size, area, and ice mass spectra determined from these probes. The PMS 2DC undercounts particles for D less than 70 microns and the replicator oversizes particles for D greater than 150 microns, at least when column rosettes are encountered. High concentrations of particles with D less than 50 microns are noted in selected portions of the 22 Nov. 91 replicator data set. Relations between the maximum dimension of a crystal and its shadow area (known as area dimensional relationships) are computed from the PMS data. Area and mass dimensional relationships are used to give a simple analytical expression for computing the wavelength dependent absorption coefficient averaged over a size bin. Calculations based upon the replicator data show that crystals with D less than 50 microns contribute significantly to the solar extinction and infrared absorption coefficients during some time intervals.

Arnott, W. P.↗

Temperature Trends in the TOVS Pathfinder Path A Data Set

TOVS (Tiros Operational Vertical Sounder) is the suite of infra-red and microwave sounding instruments, including HIRS-2 and MSU, that have flown on the NOAA Polar orbiting operational satellites TIROS-N, NOAA 6-14 from November 1978 to the present day. Data has been analyzed for the entire time period using a consistent methodology to produce twice daily per satellite global fields of surface skin temperature, atmospheric temperature-moisture profile, cloud top pressure, and fractional cloud cover, OLR and clear sky OLR, and precipitation. All parameters were found to depend on the orbit time of observation which differed as a function of time both because of differing initial satellite orbits and orbit drift. This must be accounted for before one can attempt to find trends in the data. Methodology to account for orbit drift will be shown. Trends will then be shown, over the 21 year period 1979-1999, for surface skin temperature and atmospheric temperature profile. There has been global warming near the surface which falls off rapidly with height. Trends will also be shown for values of MSU2R and MSU4 which are computed from the soundings. These will be compared to trends of MSU2R and MSU4 observed by Spencer and Christy. There is generally good agreement between Spencer and Christy MSU2R trends and those computed from the TOVS Pathfinder data set, with the largest differences over the tropics.

Susskind, J.↗

Using Docker Containers to Extend Reproducibility Architecture for the NASA Earth Exchange (NEX)

NASA Earth Exchange (NEX) is a data, supercomputing and knowledge collaboratory that houses NASA satellite, climate and ancillary data where a focused community can come together to address large-scale challenges in Earth sciences. As NEX has been growing into a petabyte-size platform for analysis, experiments and data production, it has been increasingly important to enable users to easily retrace their steps, identify what datasets were produced by which process chains, and give them ability to readily reproduce their results. This can be a tedious and difficult task even for a small project, but is almost impossible on large processing pipelines. We have developed an initial reproducibility and knowledge capture solution for the NEX, however, if users want to move the code to another system, whether it is their home institution cluster, laptop or the cloud, they have to find, build and install all the required dependencies that would run their code. This can be a very tedious and tricky process and is a big impediment to moving code to data and reproducibility outside the original system. The NEX team has tried to assist users who wanted to move their code into OpenNEX on Amazon cloud by creating custom virtual machines with all the software and dependencies installed, but this, while solving some of the issues, creates a new bottleneck that requires the NEX team to be involved with any new request, updates to virtual machines and general maintenance support. In this presentation, we will describe a solution that integrates NEX and Docker to bridge the gap in code-to-data migration. The core of the solution is saemi-automatic conversion of science codes, tools and services that are already tracked and described in the NEX provenance system, to Docker - an open-source Linux container software. Docker is available on most computer platforms, easy to install and capable of seamlessly creating and/or executing any application packaged in the appropriate format. We believe this is an important step towards seamless process deployment in heterogeneous environments that will enhance community access to NASA data and tools in a scalable way, promote software reuse, and improve reproducibility of scientific results.

earth exchange↗

TPSAS-NF1676L-29978-DND

Energy within an atmospheric column changes due to absorption of shortwave irradiance, emission of longwave irradiance, enthalpy released by precipitation, convergence of dry static and kinetic energy flux, and surface sensible heat flux. When satellite derived irradiance, precipitation, and surface sensible heat flux data products, as well as tendency and horizontal advection of dry static and kinetic energy fluxes from reanalysis are used to compute the atmospheric energy balance, energy fluxes does not balance exactly, resulting in an energy balance residual. A study by Kato et al. (2016) shows that large residuals exist over tropical oceans. In this study, we examine how the energy balance residual changes with time. If the energy balance residual for a given region is constant every year, this implies that annual anomalies of energy flux components balance over the region. If, however, the energy balance residual changes with time, an analysis of the dependence on atmospheric or cloud properties may provide information to understand the reason for the residual. A preliminary result indicates that significant interannual variabilities in energy balance residual exist when annual energy balance residuals over the entire ocean is examined. Temporal variability of regional energy budget residual and covariability of the energy budget residual with the multivariate ENSO index and the occurrence of specific cloud types will further be investigated.

Seiji Kato↗

Using Lunar Observations to Validate Pointing Accuracy and Geolocation, Detector Sensitivity Stability and Static Point Response of the CERES Instruments

Validation of in-orbit instrument performance is a function of stability in both instrument and calibration source. This paper describes a method using lunar observations scanning near full moon by the Clouds and Earth Radiant Energy System (CERES) instruments. The Moon offers an external source whose signal variance is predictable and non-degrading. From 2006 to present, these in-orbit observations have become standardized and compiled for the Flight Models -1 and -2 aboard the Terra satellite, for Flight Models-3 and -4 aboard the Aqua satellite, and beginning 2012, for Flight Model-5 aboard Suomi-NPP. Instrument performance measurements studied are detector sensitivity stability, pointing accuracy and static detector point response function. This validation method also shows trends per CERES data channel of 0.8% per decade or less for Flight Models 1-4. Using instrument gimbal data and computed lunar position, the pointing error of each detector telescope, the accuracy and consistency of the alignment between the detectors can be determined. The maximum pointing error was 0.2 Deg. in azimuth and 0.17 Deg. in elevation which corresponds to an error in geolocation near nadir of 2.09 km. With the exception of one detector, all instruments were found to have consistent detector alignment from 2006 to present. All alignment error was within 0.1o with most detector telescopes showing a consistent alignment offset of less than 0.02 Deg.

Daniels, Janet L.↗

Numerical Analysis of Coolant Flow and Heat Transfer in ITER Diagnostic First Wall

We performed numerical simulations of the ITER Diagnostic First Wall (DFW) using ANSYS workbench. During operation DFW will include solid main body as well as liquid coolant. Thus thermal and hydraulic analysis of the DFW was performed using conjugated heat transfer approach, in which heat transfer was resolved in both solid and liquid parts, and simultaneously fluid dynamics analysis was performed only in the liquid part. This approach includes interface between solid and liquid part of the systemAnalysis was performed using ANSYS CFX software. CFX software allows solution of heat transfer equations in solid and liquid part, and solution of the flow equations in the liquid part. Coolant flow in the DFW was assumed turbulent and was resolved using Reynolds averaged Navier-Stokes equations with Shear Stress Transport turbulence model. Meshing was performed using CFX method available within ANSYS. The data cloud for thermal loading consisting of volumetric heating and surface heating was imported into CFX Volumetric heating source was generated using Attila software. Surface heating was obtained using radiation heat transfer analysis. Our results allowed us to identify areas of excessive heating. Proposals for cooling channel relocation were made. Additional suggestions were made to improve hydraulic performance of the cooling system.

42 ENGINEERING↗

Enabling a Decentralized Smart Grid Using Autonomous Edge Control Devices

As a large number of distributed devices are connected to the modern smart grid, the traditional centralized connectivity models fail to provide economic value. These models have relied on sending data to the cloud for processing and receiving commands to exert control actions, resulting in an ‘on-demand system’ with high bandwidth, low latency and an overload of data on the cloud. For realizing a decentralized system, there is a strong need to embed intelligence at the ‘edge of the network’. These intelligent devices, capable of sensing, local data processing and exerting control actions, report only actionable information to the cloud, acting as an edge control node. The system can then function autonomously, without constant cloud inputs, tolerating longer delays in communication, making the overall system ultra-low cost. The Global Asset Monitoring, Management and Analytics (GAMMA) Platform is a novel ultralow- cost, secure platform that operates through a Bluetooth based delay tolerant network. It relies on so-called ‘data mules’ to bridge the last mile connectivity gap in an inherently secure way. Due to this model, the platform requires no in-country certifications, does not rely on a dedicated backhaul technology and is immune to technology migration. This architecture also addresses some gaps identified in traditional IoT-based solutions in remote areas and sparse connectivity. A functional unit of the edge computing node has been built, taking into account various constraints like costs, customizations, data storage, cybersecurity and power management. Here, the platform has been built, deployed and has demonstrated distributed smart grid applications like power quality sensing, automated metering infrastructure and utility asset monitoring.

42 ENGINEERING↗

Differential Power Processing for Ultra-Efficient Data Storage

Here this paper presents the hardware, software, and power codesign of an ultra-efficient data storage server with differential power processing (DPP). DPP can reduce the power conversion stress, improve the efficiency, and enhance the functionality of modular power electronics systems. The power inputs of a large number of hard disk drives (HDDs) were connected in series and supported by a multiport ac-coupled differential power processing (MAC-DPP) converter through a multiwinding transformer. Methods for controlling the multi-input multi-output power flow in the multiwinding transformer while avoiding core saturation were investigated. A ten-port MAC-DPP prototype with 700-W/in 3 power density was built to support a 450-W HDD storage system with ten series-stacked voltage domains. The prototype was tested on a 50-HDD server testbench, and the overall system loss is below 1 W (99.77% system efficiency). The server was able to maintain high-speed reading and writing operation of all 50 HDDs against the worst hot-swapping scenarios. A variety of hardware/software configurations and many cloud storage techniques were tested on the fully functioning server. Experimental results show that the energy efficiency of large-scale information systems (CPU/GPU clusters, memory banks, HDD arrays, etc.) can be greatly improved by software, hardware, and power codesign.

42 ENGINEERING↗

Differentially Private Distributed Sensing

The growth of the Internet of Things (IoT) creates the possibility of decentralized systems of sensing and actuation, potentially on a global scale. IoT devices connected to cloud networks can offer Sensing and Actuation as a Service (SAaaS) enabling networks of sensors to grow to a global scale. But extremely large sensor networks can violate privacy, especially in the case where IoT devices are mobile and connected directly to the behaviors of people. The thesis of this paper is that by adapting differential privacy (adding statistically appropriate noise to query results) to groups of geographically distributed sensors privacy could be maintained without ever sending all values up to a central curator and without compromising the overall accuracy of the data collected. This paper outlines such a scheme and performs an analysis of differential privacy techniques adapted to edge computing in a simulated sensor network where ground truth is known. The positive and negative outcomes of employing differential privacy in distributed networks of devices are discussed and a brief research agenda is presented.

Differential Privacy↗

The role of global cloud climatologies in validating numerical models

Reliable estimates of the components of the surface radiation budget are important in studies of ocean-atmosphere interaction, land-atmosphere interaction, ocean circulation and in the validation of radiation schemes used in climate models. The methods currently under consideration must necessarily make certain assumptions regarding both the presence of clouds and their vertical extent. Because of the uncertainties in assumed cloudiness, all these methods involve perhaps unacceptable uncertainties. Here, a theoretical framework that avoids the explicit computation of cloud fraction and the location of cloud base in estimating the surface longwave radiation is presented. Estimates of the global surface downward fluxes and the oceanic surface net upward fluxes were made for four months (April, July, October and January) in 1985 to 1986. These estimates are based on a relationship between cloud radiative forcing at the top of the atmosphere and the surface obtained from a general circulation model. The radiation code is the version used in the UCLA/GLA general circulation model (GCM). The longwave cloud radiative forcing at the top of the atmosphere as obtained from Earth Radiation Budget Experiment (ERBE) measurements is used to compute the forcing at the surface by means of the GCM-derived relationship. This, along with clear-sky fluxes from the computations, yield maps of the downward longwave fluxes and net upward longwave fluxes at the surface. The calculated results are discussed and analyzed. The results are consistent with current meteorological knowledge and explainable on the basis of previous theoretical and observational works; therefore, it can be concluded that this method is applicable as one of the ways to obtain the surface longwave radiation fields from currently available satellite data.

HARSHVARDHAN↗

Airborne Sunphotometer, Airborne in-situ, Space-borne, and Ground-Based Measurements of Troposoheric Aerosol in Ace-2

We report on clear-sky column closure experiments performed in the Canary Islands during the second Aerosol Characterization Experiment (ACE-2) in June/July 1997. We present results obtained by combining airborne sunphotometer and in-situ aerosol measurements taken aboard the Pelican aircraft, space-borne NOAA/AVHRR data and ground-based lidars A wide range of aerosol types was encountered throughout the ACE-2 area, including background Atlantic marine, European pollution-derived, and African mineral dust. During !he two days discussed here, vertical profiles flown in cloud free air masses revealed three distinctly different layers: a marine boundary layer (MBL) with varying pollution levels, an elevated dust layer, and a very clean layer between the MBL and the dust layer. We found that the presence of the elevated dust layer removes the good agreement between satellite and sunphotometer AOD usually found in the absence of the dust layer. Using size-resolved composition information we have computed optical properties of the ambient aerosol from the in-situ measurements and subsequently compared those to the sunphotometer results. In the dust, the agreement in layer aerosol optical depth (380-1060 nm) is 3-8%. In the MBL there is tendency for the in-situ results to be slightly lower than the sunphotometer measurements (10-17% at 525 nm), but these differences are within the combined error bars of the measurements and computations.

Schmid, Beat↗

Physical Processes Governing Atmospheric Trace Constituents Measured from an Aircraft on PEM-Tropics

Before the mission, the PI (principal investigator) was instrumental in securing real-time use of the new 51-level ECMWF (European Centre for Medium Range Weather Forecasts) meteorological data. During the mission, he provided flight planning and execution guidance as meteorologist for the P-3B. Mr. Yong Zhu computed and plotted meteorological forecast maps using the ECMWF data and transmitted them to the field from MIT (Massachusetts Institute of Technology). Dr. John Cho was in the field for the Christmas Island portion to extract data from the on-site NOAA (National Oceanic and Atmospheric Administration) radars for local wind profiles that were used at the flight planning meetings. When the power supply for the VHF radar failed, he assisted the NOAA engineer in its repair. After the mission, Mr. Zhu produced meteorological data memos, which were made available to the PEM (Pacific Exploratory Mission)-Tropics B science team on request. An undergraduate student, Ms. Danielle Morse, wrote memos annotating the cloud conditions seen on the aircraft external monitor video tapes. Dr. Cho and the PI circulated a memo regarding the status (and associated problems) of the meteorological measurement systems on the DC-8 and P-3B to the relevant people on the science team. Several papers by members of our project were completed and accepted by JGR (Journal of Geophysical Research) for the first special section on PEM-Tropics B. These papers included coverage of the following topics: 1) examination of boundary layer data; 2) water vapor transport; 3) tropospheric trace constituent layers; 4) summarizations of the meteorological background and events during PEM-Tropics B; 5) concomitant lidar measurements of ozone, water vapor, and aerosol.

Newell, Reginald E.↗

FPGA Coprocessor Design for an Onboard Multi-Angle Spectro-Polarimetric Imager

A multi-angle spectro-polarimetric imager (MSPI) is an advanced camera system currently under development at JPL for possible future consideration on a satellite-based Aerosol-Cloud-Environ - ment (ACE) interaction study. The light in the optical system is subjected to a complex modulation designed to make the overall system robust against many instrumental artifacts that have plagued such measurements in the past. This scheme involves two photoelastic modulators that are beating in a carefully selected pattern against each other. In order to properly sample this modulation pattern, each of the proposed nine cameras in the system needs to read out its imager array about 1,000 times per second. The onboard processing required to compress this data involves least-squares fits (LSFs) of Bessel functions to data from every pixel in realtime, thus requiring an onboard computing system with advanced data processing capabilities in excess of those commonly available for space flight. As a potential solution to meet the MSPI onboard processing requirements, an LSF algorithm was developed on the Xilinx Virtex-4FX60 field programmable gate array (FPGA). In addition to configurable hardware capability, this FPGA includes Power -PC405 microprocessors, which together enable a combination hardware/ software processing system. A laboratory demonstration was carried out based on a hardware/ software co-designed processing architecture that includes hardware-based data collection and least-squares fitting (computationally), and softwarebased transcendental function computation (algorithmically complex) on the FPGA. Initial results showed that these calculations can be handled using a combination of the Virtex- 4TM Power-PC core and the hardware fabric.

Pingree, Paula J.↗