Search NASA⌕ Search

SEARCH · Search NASA

Results for “cloud platform”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12

Secure Collaborative Environment for Seamless Sharing of Scientific Knowledge

In a secure collaborative environment, tera-bytes of data generated from powerful scientific instruments are used to train secure machine learning (ML) models on exascale computing systems, which are then securely shared with internal or external collaborators as cloud-based services. Devising such a secure platform is necessary for seamless scientific knowledge sharing without compromising individual, or institute-level, intellectual property and privacy details. By enabling new computing opportunities with sensitive data, we envision a secure collaborative environment that will play a significant role in accelerating scientific discovery. Several recent technological advancements have made it possible to realize these capabilities. In this paper, we present our efforts at ORNL toward developing a secure computation platform. We present a use case where scientific data generated from complex instruments, like those at the Spallation Neutron Source (SNS), are used to train a differential privacy enabled deep learning (DL) network on Summit, which is then hosted as a secure multi-party computation (MPC) service on ORNL’s Compute and Data Environment for Science (CADES) cloud computing platform for third-party inference. In this feasibility study, we discuss the challenges involved, elaborate on leveraged technologies, analyze relevant performance results and present the future vision of our work to establish secure collaboration capabilities within and outside of ORNL.

Yoginath, Srikanth↗

NASA’s Atmospheric Science Data Center’s Approach to a Cloud-Based Model of Ingest, Archival, and Distribution of TEMPO Data: Methods, Challenges, and Best Practices

The National Aeronautics and Space Administration's (NASA) Atmospheric Science Data Center (ASDC) at NASA Langley Research Center in Hampton, VA provides atmospheric science data products and services to the science community, including enhanced search and subsetting capabilities for numerous datasets. The ASDC is the official Distributed Active Archive Center (DAAC) of record for the upcoming Tropospheric Emissions: Monitoring of Pollution (TEMPO) instrument. TEMPO will be situated on a geostationary satellite positioned at a longitude near the center of the conterminous United States and focused on North America, making hourly swaths of its field of regard from east to west. ASDC’s data products are currently hosted locally and services (e.g., spatial and temporal subsetting) are managed on premises. The ASDC is planning to provide TEMPO data and services in the cloud through the Earthdata Search platform. This presentation will discuss the ASDC’s approach to a cloud-based model of ingest, archival, and distribution of TEMPO data. Methods, challenges, best practices, lessons learned, and future plans will be discussed.

Iman Nasif↗

Application of Direct Simulation Monte Carlo to Satellite Contamination Studies

A novel method is presented to estimate contaminant levels around spacecraft and satellites of arbitrarily complex geometry. The method uses a three-dimensional direct simulation Monte Carlo algorithm to characterize the contaminant cloud surrounding the space platform, and a computer-assisted design preprocessor to define the space-platform geometry. The method is applied to the Upper Atmosphere Research Satellite to estimate the contaminant flux incident on the optics of the halogen occultation experiment (HALOE) telescope. Results are presented in terms of contaminant cloud structure, molecular velocity distribution at HALOE aperture, and code performance.

Rault, Didier F. G.↗

Detection of Outliers in LiDAR Data Acquired by Multiple Platforms over Sorghum and Maize

High-resolution point cloud data acquired with a laser scanner from any platform contain random noise and outliers. Therefore, outlier detection in LiDAR data is often necessary prior to analysis. Applications in agriculture are particularly challenging, as there is typically no prior knowledge of the statistical distribution of points, plant complexity, and local point densities, which are crop-dependent. The goals of this study were first to investigate approaches to minimize the impact of outliers on LiDAR acquired over agricultural row crops, and specifically for sorghum and maize breeding experiments, by an unmanned aerial vehicle (UAV) and a wheel-based ground platform; second, to evaluate the impact of existing outliers in the datasets on leaf area index (LAI) prediction using LiDAR data. Two methods were investigated to detect and remove the outliers from the plant datasets. The first was based on surface fitting to noisy point cloud data via normal and curvature estimation in a local neighborhood. The second utilized the PointCleanNet deep learning framework. Both methods were applied to individual plants and field-based datasets. To evaluate the method, an F-score was calculated for synthetic data in the controlled conditions, and LAI, the variable being predicted, was computed both before and after outlier removal for both scenarios. Results indicate that the deep learning method for outlier detection is more robust than the geometric approach to changes in point densities, level of noise, and shapes. The prediction of LAI was also improved for the wheel-based vehicle data based on the coefficient of determination (R2) and the root mean squared error (RMSE) of the residuals before and after the removal of outliers.

36 MATERIALS SCIENCE↗

Future energy infrastructure, energy platform and energy storage

Today fossil energy dominates energy consumption across the world. There has been an increasing momentum to reduce fossil energy consumption and increase renewable energy utilization to more than 70%. Such high penetrations of distributed renewable resources bring large uncertainty and complexity that cannot be easily handled by the current infrastructure. For the last two decades, telecommunication industry has gone through a similar transition from centralized to distributed systems, and more recently to platform approaches, which become the corner stone of today’s vibrant platform economy. Based on telecommunication history, we believe that a platform-based approach, called the energy platform, is a viable solution for addressing the renewable energy challenges. The energy platform consists of an array of computational algorithms, sensing and control technologies for key industry, energy generators and users to jointly manage and control the complex energy infrastructure. It includes the following key components: (1) the hardware and software to generate, store, control and transmit electricity/data (the energy cloud), (2) the digital platforms and tools for key energy producers, digital, service and communication industry to share the assets, participate in and manage the complex infrastructure, and for customers to participate in energy transactions, (3) the transaction platform for new service and business models. Additionally, the energy platform requires breakthroughs in large scale energy storage and many other areas including efficient power electronics, sensors and controls, new mathematical and computational tools, and deep integration of energy technologies and information sciences to control and stabilize such complex chaotic systems.

25 ENERGY STORAGE↗

Cloud Effects on Radiative Heating Rate Profiles over Darwin using ARM and A-train Radar/Lidar Observations

Observations of clouds from the ground-based U.S. Department of Energy Atmospheric Radiation Measurement program (ARM) and satellite-based A-train are used to compute cloud radiative forcing profiles over the ARM Darwin, Australia site. Cloud properties are obtained from both radar (the ARM Millimeter Cloud Radar (MMCR) and the CloudSat satellite in the A-train) and lidar (the ARM Micropulse lidar (MPL) and the Cloud-Aerosol Lidar and Infrared Pathfinder Satellite Observation (CALIPSO) satellite in the A-train) observations. Cloud microphysical properties are taken from combined radar and lidar retrievals for ice clouds and radar only or lidar only retrievals for liquid clouds. Large, statistically significant differences of up to 1.43 K/day exist between the mean ARM and A-train net cloud radiative forcing profiles. The majority of the difference in cloud radiative forcing profiles is shown to be due to a large difference in the cloud fraction above 12 km. Above this altitude the A-train cloud fraction is significantly larger because more clouds are detected by CALIPSO than by the ground-based MPL. It is shown that the MPL is unable to observe as many high clouds as CALIPSO due to being more frequently attenuated and a poorer sensitivity even in otherwise clear-sky conditions. After accounting for cloud fraction differences and instrument sampling differences due to viewing platform we determined that differences in cloud radiative forcing due to the retrieved ice cloud properties is relatively small. This study demonstrates that A-train observations are better suited for the calculation cloud radiative forcing profiles. In addition, we find that it is necessary to supplement CloudSat with CALIPSO observations to obtain accurate cloud radiative forcing profiles since a large portion of clouds at Darwin are detected by CALIPSO only.

A-train↗

Portability for GPU-accelerated molecular docking applications for cloud and HPC: can portable compiler directives provide performance across all platforms?

High-throughput structure-based screening of drug-like molecules has become a common tool in biomedical research. Recently, acceleration with graphics processing units (GPUs) has provided a large performance boost for molecular docking programs. Both cloud and high-performance computing (HPC) resources have been used for large screens with molecular docking programs; while NVIDIA GPUs have dominated cloud and HPC resources, new vendors such as AMD and Intel are now entering the field, creating the problem of software portability across different GPUs. Ideally, software productivity could be maximized with portable programming models that are able to maintain high performance across architectures. While in many cases compiler directives have been used as an easy way to offload parallel regions of a CPU-based program to a GPU accelerator, they may also be an attractive programming model for providing portability across different GPU vendors, in which case the porting process may proceed in the reverse direction: from low-level, architecture-specific code to higher-level directive-based abstractions. MiniMDock is a new mini-application (miniapp) designed to capture the essential computational kernels found in molecular docking calculations, such as are used in phar-maceutical drug discovery efforts, in order to test different solutions for porting across GPU architectures. Here we extend MiniMDock to GPU offloading with OpenMP directives, and compare to performance of kernels using CUDA and HIP on NVIDIA and AMD GPUs, respectively, as well as across different compilers, exploring performance bottlenecks. We document this reverse-porting process, from highly optimized device code to a higher-level version using directives, compare code structure, and describe barriers that were overcome in this effort.

Thavappiragasam, Mathialakan↗

Cloud Based Analytical Framework for Synchrophasor Data Analysis

The paper presents initial results from the development of a cloud-based, Big Data analysis platform for power systems. The computational pipeline uses the Apache Spark framework running in an OpenStack cloud infrastructure. A real-world phasor measurement unit (PMU) dataset has been used to carry out the analysis. Actual examples of power system events detection using synchrophasor data are presented. It has been shown that applications of the cloud based computing environment and the Apache Spark framework enable a significant increase in the computational efficiency of large-scale PMU data analysis.

PMU, Machine Learning, Big Data, SPARK, Event Dete↗

Example MODIS Global Cloud Optical and Microphysical Properties: Comparisons between Terra and Aqua

MODIS observations from the NASA EOS Terra spacecraft (launched in December 1999, 1030 local time equatorial crossing) have provided a unique data set of Earth observations. With the launch of the NASA Aqua spacecraft in May 2002 (1330 local time), two MODIS daytime (sunlit) and nighttime observations are now available in a 24 hour period, allowing for some measure of diurnal variability. We report on an initial analysis of several operational global (Level-3) cloud products from the two platforms. The MODIS atmosphere Level-3 products, which include clear-sky and aerosol products in addition to cloud products, are available as three separate files providing daily, eight-day, and monthly aggregations; each temporal aggregation is spatially aggregated to a 1 degree grid. The files contain approximately 600 statisitical datasets (from simple means and standard deviations to 1 - and 2-dimensional histograms). Operational cloud products include detection (cloud fraction), cloud-top properties, and daytimeonly cloud optical thickness and particle effective radius for both water and ice clouds. We will compare example global Terra and Aqua cloud fraction, optical thickness, and effective radius aggregations.

Hubanks, P. A.↗

Tomographic retrieval of cloud liquid water fields from a single scanning microwave radiometer aboard a moving platform – Part 1: Field trial results from the Wakasa Bay experiment

Tomographic methods offer great potential for retrieving three-dimensional spatial distributions of cloud liquid water from radiometric observations by passive microwave sensors. Fixed tomographic systems require multiple radiometers, while mobile systems can use just a single radiometer. Part 1 (this paper) examines the results from a limited cloud tomography trial with a single-radiometer airborne system carried out as part of the 2003 AMSR-E validation campaign over Wakasa Bay of the Sea of Japan. During this trial, the Polarimetric Scanning Radiometer (PSR) and Microwave Imaging Radiometer (MIR) aboard the NASA P-3 research aircraft provided a useful dataset for testing the cloud tomography method over a system of low-level clouds. We do tomographic retrievals with a constrained inversion algorithm using three configurations: PSR, MIR, and combined PSR and MIR data. The liquid water paths from the PSR retrieval are consistent with those from the MIR retrieval. The retrieved cloud field based on the combined data appears to be physically plausible and consistent with the cloud image obtained by a cloud radar. We find that some vertically-uniform clouds appear at high altitudes in the retrieved field where the radar shows clear sky. This is likely due to the sub-optimal data collection strategy. This sets the stage for Part 2 of this study that aims to define optimal data collection strategies using observation system simulation experiments.

54 ENVIRONMENTAL SCIENCES↗

Visualization and 3D Mesh Generation for ASSEMBLERS Range of Motion

In an effort to create a base and foundation for ASSEMBLERS with an informed layout, data representing the range of motion of varying heights of Stewart platforms were analyzed. 3D shapes were generated first to be approximately representative of these data in the form of rotationally symmetric shells, making use of 2D alpha shapes to create a border that did not account for asymmetry inherent in the true range of motion. Further work was performed to generate mesh files more fully representative of reach, creating 3D alpha shapes based directly on point clouds generated from uniformly random platform positions. These shapes were initially not representative of the entire range of motion of a platform stack due to the low likelihood of the most extreme positions being added to a given point cloud but were more representative of the asymmetry inherent in the possible positions of a Stewart platform as they no longer relied on a single 2D contour. The same algorithm for generating 3D alpha shapes was then applied to point clouds designed to represent extreme positions, generating larger smooth shells with six clear planes of symmetry. All shells were converted to STLs to aid in further modeling of range of motion for base layouts and in visualizing reachable area for varying stack heights, successfully creating closed shells representative of typical and extreme positions for platform stacks of varying heights.

Jonah DeGuire Vanke↗

Quantum Computing and Visualization Research Challenges and Opportunities

Here, quantum computing (QC) has experienced rapid growth in recent years with the advent of robust programming environments, readily accessible software simulators and cloud-based QC hardware platforms, and growing interest in learning how to design useful methods that leverage this emerging technology for practical applications. From the perspective of the field of visualization, this article examines research challenges and opportunities along the path from initial feasibility to practical use of QC platforms applied to meaningful problems.

Data visualization↗

TAS::89 0927::TAS RECOVERY - The Lean Green Energy Controller Machine

Achieving efficiency improvements and providing demand-response programs have been identified as key elements of our national energy initiative. The residential market is the largest, yet most difficult, segment to engage in efforts to meet these objectives. This project developed Energy Management System that engages the consumer and enables Smart Grid services, applications, and business processes to address this need. Our innovative solution provides smart controller providing dynamic optimization of energy consumption for the residential energy consumer. Our solution extends the technical platform to include a cloud based Internet of Things (IoT) aggregation of data sensors and actuators the go beyond energy management and extend to life style services provided through compelling mobile and console based user experiences.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

A Dynamic Landsat Derived Normalized Difference Vegetation Index (NDVI) Product for the Conterminous United States

Satellite derived vegetation indices (VIs) are broadly used in ecological research, ecosystem modeling, and land surface monitoring. The Normalized Difference Vegetation Index (NDVI), perhaps the most utilized VI, has countless applications across ecology, forestry, agriculture, wildlife, biodiversity, and other disciplines. Calculating satellite derived NDVI is not always straight-forward, however, as satellite remote sensing datasets are inherently noisy due to cloud and atmospheric contamination, data processing failures, and instrument malfunction. Readily available NDVI products that account for these complexities are generally at coarse resolution; high resolution NDVI datasets are not conveniently accessible and developing them often presents numerous technical and methodological challenges. Here, we address this deficiency by producing a Landsat derived, high resolution (30 m), long-term (30+ years) NDVI dataset for the conterminous United States. We use Google Earth Engine, a planetary-scale cloud-based geospatial analysis platform, for processing the Landsat data and distributing the final dataset. We use a climatology driven approach to fill missing data and validate the dataset with established remote sensing products at multiple scales. We provide access to the composites through a simple web application, allowing users to customize key parameters appropriate for their application, question, and region of interest.

42 ENGINEERING↗

Development of eye-safe lidar for aerosol measurements

Research is summarized on the development of an eye safe Raman conversion system to carry out lidar measurements of aerosol and clouds from an airborne platform. Radiation is produced at the first Stokes wavelength of 1.54 micron in the eye safe infrared, when methane is used as the Raman-active medium, the pump source being a Nd:YAG laser at 1.064 micron. Results are presented for an experimental study of the dependence of the 1.54 micron first Stokes radiation on the focusing geometry, methane gas pressure, and pump energy. The specific new technique developed for optimizing the first Stokes generation involves retroreflecting the backward-generated first Stokes light back into the Raman cell as a seed Stokes beam which is then amplified in the temporal tail of the pump beam. Almost 20 percent conversion to 1.54 micron is obtained. Complete, assembled hardware for the Raman conversion system was delivered to the Goddard Space Flight Center for a successful GLOBE flight (1989) to measure aerosol backscatter around the Pacific basin.

Singh, Upendra N.↗

Analysis of measurements for solid state laser remote lidar system

The merits of using lidar systems for remote measurements of various atmospheric processes such as wind, turbulence, moisture, and aerosol concentration are widely recognized. Although the lidar technology has progressed considerably over the past two decades, significant research particularly in the area of solid state lidars remains to be conducted in order to fully exploit this technology. The work performed by the UAH (University of Alabama in Huntsville) personnel under this Delivery Order concentrated on analyses of measurements required in support of solid state laser remote sensing lidar systems which are to be designed, deployed, and used to measure atmospheric processes and constituents. UAH personnel has studied and recommended to NASA/MSFC the requirements of the optical systems needed to characterize the detection devices suitable for solid state wavelengths and to evaluate various heterodyne detection schemes. The 2-micron solid state laser technology was investigated and several preliminary laser designs were developed and their performance for remote sensing of atmospheric winds and clouds from a spaceborne platform were specified. In addition to the laser source and the detector, the other critical technologies necessary for global wind measurements by a spaceborne solid state coherent lidar systems were identified to be developed and demonstrated. As part of this work, an analysis was performed to determine the atmospheric wind velocity estimation accuracy using the line-of-sight measurements of a scanning coherent lidar. Under this delivery order, a computer database of materials related to the theory, development, testing, and operation of lidar systems was developed to serve as a source of information for lidar research and development.

Amzajerdian, Farzin↗

Nominal 30-M Cropland Extent Map of Continental Africa by Integrating Pixel-Based and Object-Based Algorithms Using Sentinel-2 and Landsat-8 Data on Google Earth Engine

A satellite-derived cropland extent map at high spatial resolution (30-m or better) is a must for food and water security analysis. Precise and accurate global cropland extent maps, indicating cropland and non-cropland areas, is a starting point to develop high-level products such as crop watering methods (irrigated or rainfed), cropping intensities (e.g., single, double, or continuous cropping), crop types, cropland fallows, as well as assessment of cropland productivity (productivity per unit of land), and crop water productivity (productivity per unit of water). Uncertainties associated with the cropland extent map have cascading effects on all higher-level cropland products. However, precise and accurate cropland extent maps at high spatial resolution over large areas (e.g., continents or the globe) are challenging to produce due to the small-holder dominant agricultural systems like those found in most of Africa and Asia. Cloud-based Geospatial computing platforms and multi-date, multi-sensor satellite image inventories on Google Earth Engine offer opportunities for mapping croplands with precision and accuracy over large areas that satisfy the requirements of broad range of applications. Such maps are expected to provide highly significant improvements compared to existing products, which tend to be coarser in resolution, and often fail to capture fragmented small-holder farms especially in regions with high dynamic change within and across years. To overcome these limitations, in this research we present an approach for cropland extent mapping at high spatial resolution (30-m or better) using the 10-day, 10 to 20-m, Sentinel-2 data in combination with 16-day, 30-m, Landsat-8 data on Google Earth Engine (GEE). First, nominal 30-m resolution satellite imagery composites were created from 36,924 scenes of Sentinel-2 and Landsat-8 images for the entire African continent in 2015-2016. These composites were generated using a median-mosaic of five bands (blue, green, red, near-infrared, NDVI) during each of the two periods (period 1: January-June 2016 and period 2: July-December 2015) plus a 30-m slope layer derived from the Shuttle Radar Topographic Mission (SRTM) elevation dataset. Second, we selected Cropland/Non-cropland training samples (sample size 9791) from various sources in GEE to create pixel-based classifications. As supervised classification algorithm, Random Forest (RF) was used as the primary classifier because of its efficiency, and when over-fitting issues of RF happened due to the noise of input training data, Support Vector Machine (SVM) was applied to compensate for such defects in specific areas. Third, the Recursive Hierarchical Segmentation (RHSeg) algorithm was employed to generate an object-oriented segmentation layer based on spectral and spatial properties from the same input data. This layer was merged with the pixel-based classification to improve segmentation accuracy. Accuracies of the merged 30-m crop extent product were computed using an error matrix approach in which 1754 independent validation samples were used. In addition, a comparison was performed with other available cropland maps as well as with LULC maps to show spatial similarity. Finally, the cropland area results derived from the map were compared with UN FAO statistics. The independent accuracy assessment showed a weighted overall accuracy of 94, with a producers accuracy of 85.9 (or omission error of 14.1), and users accuracy of 68.5 (commission error of 31.5) for the cropland class. The total net cropland area (TNCA) of Africa was estimated as 313 Mha for the nominal year 2015.

Cropland mapping; cropland areas; 30-m; Landsat-8;↗

Consistency of Global Modis Aerosol Optical Depths over Ocean on Terra and Aqua Ceres SSF Datasets

Aerosol retrievals over ocean from the Moderate Resolution Imaging Spectroradiometer (MODIS) onboard Terra and Aqua platforms are available from the Clouds and the Earth's Radiant Energy System (CERES) Single Scanner Footprint (SSF) datasets generated at NASA Langley Research Center (LaRC). Two aerosol products are reported side-by-side. The primary M product is generated by sub-setting and remapping the multi-spectral (0.47-2.1 micrometer) MODIS produced oceanic aerosol (MOD04/MYD04 for Terra/Aqua) onto CERES footprints. M*D04 processing uses cloud screening and aerosol algorithms developed by the MODIS science team. The secondary AVHRR-like A product is generated in only two MODIS bands 1 and 6 (on Aqua, bands 1 and 7). The A processing uses the CERES cloud screening algorithm, and NOAA/NESDIS glint identification, and single-channel aerosol retrieval algorithms. The M and A products have been documented elsewhere and preliminarily compared using 2 weeks of global Terra CERES SSF Edition 1A data in which the M product was based on MOD04 collection 3. In this study, the comparisons between the M and A aerosol optical depths (AOD) in MODIS band 1 (0.64 micrometers), tau(sub 1M) and tau(sub 1A) are re-examined using 9 days of global CERES SSF Terra Edition 2A and Aqua Edition 1B data from 13 - 21 October 2002, and extended to include cross-platform comparisons. The M and A products on the new CERES SSF release are generated using the same aerosol algorithms as before, but with different preprocessing and sampling procedures, lending themselves to a simple sensitivity check to non-aerosol factors. Both tau(sub 1M) and tau(sub 1A) generally compare well across platforms. However, the M product shows some differences, which increase with ambient cloud amount and towards the solar side of the orbit. Three types of comparisons conducted in this study - cross-platform, cross-product, and cross-release confirm the previously made observation that the major area for improvement in the current aerosol processing lies in a more formalized and standardized sampling (and most importantly, cloud screening) whereas optimization of the aerosol algorithm is deemed to be an important yet less critical element.

Ignatov, Alexander↗