ROCSTAR MULTIPHYSICS MODERNIZATION, ENHANCEMENT AND CLOUD INTERFACE DEVELOPMENT
Explore the source record for details and available documents.
42 ENGINEERING↗
SEARCH · Search NASA
Results for “CLOUD COMPUTING”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Predictive Analytics-based U.S. Inland Waterways Voyage Planning Analysis Tool (VPAT)
Explore the source record for details and available documents.
54 ENVIRONMENTAL SCIENCES↗
Performance Enhancement of a Computational Persistent Homology Package
In recent years, persistent homology has become an attractive method for data analysis. It captures topological features, such as connected components, holes, voids, etc., from a point cloud by finding out when these features appear and disappear in the filtration sequence. In this project, we focus on improving the performance of Eirene, a fancy computational persistent homology package. Eirene is a 5000-line opensource software implemented by using the dynamic programming language Julia. We use the Julia profiling tools to identify the performance bottlenecks and develop different methods to manage the bottlenecks, including the parallelization of some time-consuming functions on the multicore/manycore hardware. The empirical results show that the performance can be greatly improved.
Profiling↗
THE SPITZER SURVEY OF INTERSTELLAR CLOUDS IN THE GOULD BELT. III. A MULTI-WAVELENGTH VIEW OF CORONA AUSTRALIS
We present Spitzer Space Telescope IRAC and MIPS observations of a 0.85 deg{sup 2} field including the Corona Australis (CrA) star-forming region. At a distance of 130 pc, CrA is one of the closest regions known to be actively forming stars, particularly within its embedded association, the Coronet. Using the Spitzer data, we identify 51 young stellar objects (YSOs) in CrA which include sources in the well-studied Coronet cluster as well as sources distributed throughout the molecular cloud. Twelve of the YSOs discussed are new candidates, one of which is located in the Coronet. Known YSOs retrieved from the literature are also added to the list, and a total of 116 candidate YSOs in CrA are compiled. Based on these YSO candidates, the star formation rate is computed to be 12 M{sub sun} Myr{sup -1}, similar to that of the Lupus clouds. A clustering analysis was also performed, finding that the main cluster core, consisting of 68 members, is elongated (having an aspect ratio of 2.36), with a circular radius of 0.59 pc and mean surface density of 150 pc{sup -2}. In addition, we analyze outflows and jets in CrA by means of new CO and H{sub 2} data. We present 1.3 mm interferometric continuum observations made with the Submillimeter Array (SMA) covering R CrA, IRS 5, IRS 7, and IRAS 18595-3712 (IRAS 32). We also present multi-epoch H{sub 2} maps and detect jets and outflows, study their proper motions, and identify exciting sources. The Spitzer and ISAAC/VLT observations of IRAS 32 show a bipolar precessing jet, which drives a CO(2-1) outflow detected in the SMA observations. There is also clear evidence for a parsec-scale precessing outflow, which is east-west oriented and originates in the SMA 2 region and likely driven by SMA 2 or IRS 7A.
79 ASTRONOMY AND ASTROPHYSICS↗
Approaches of comparison for clear-sky radiative fluxes from general circulation models with Earth Radiation Budget Experiment data
In order to compare the clear-sky greenhouse effect and cloud-radiative forcing from general circulation models with Earth Radiation Budget Experiments (ERBE) data, it is necessary to calculate the general circulation model (GCM) clear-sky radiative fluxes in a way consistent with ERBE. This study discusses problems associated with the available methods for clear-sky radiative flux computations in GCMs and proposes a new approach, which uses a statistical relationship between the grid cloud cover and the availability of ERBE clear-sky measurement, established from ERBE pixel data, to sample the model radiative fluxes. Calculations with version 2 of the National Center for Atmospheric Research (NCAR) Community Climate Model using observed sea surface temperature (SST) show good agreement of clear-sky sampling from the proposed method with ERBE sampling. It is also shown that large improvements are achieved in the spatial variability of the model clear-sky radiative fluxes over ocean, with reference to ERBE, by using the new clear-sky sampling method.
Zhang, M. H.↗
Distributed Resources for the Earth System Grid Advanced Management (DREAM)
The DREAM project was funded more than 3 years ago to design and implement a next-generation ESGF (Earth System Grid Federation) architecture which would be suitable for managing and accessing data and services resources on a distributed and scalable environment. In particular, the project intended to focus on the computing and visualization capabilities of the stack, which at the time were rather primitive. At the beginning, the team had the general notion that a better ESGF architecture could be built by modularizing each component, and redefining its interaction with other components by defining and exposing a well defined API. Although this was still the high level principle that guided the work, the DREAM project was able to accomplish its goals by leveraging new practices in IT that started just about 3 or 4 years ago: the advent of containerization technologies (specifically, Docker), the development of frameworks to manage containers at scale (Docker Swarm and Kubernetes), and their application to the commercial Cloud. Thanks to these new technologies, DREAM was able to improve the ESGF architecture (including its computing and visualization services) to a level of deployability and scalability beyond the original expectations. Overall, during its three-year lifespan, DREAM has undertaken innovative research work and prototyping: many of its solutions (the new containerized architecture, the Visus visualization engine, the Solr Cloud based search service) were handed over to the ESGF collaboration, which will make them operational and use them as their future software basis.
42 ENGINEERING↗
A Module for Assimilating Hyperspectral Infrared Retrieved Profiles into the Gridpoint Statistical Interpolation System for Unique Forecasting Applications
Hyperspectral infrared sounder radiance data are assimilated into operational modeling systems however the process is computationally expensive and only approximately 1% of available data are assimilated due to data thinning as well as the fact that radiances are restricted to cloud-free fields of view. In contrast, the number of hyperspectral infrared profiles assimilated is much higher since the retrieved profiles can be assimilated in some partly cloudy scenes due to profile coupling other data, such as microwave or neural networks, as first guesses to the retrieval process. As the operational data assimilation community attempts to assimilate cloud-affected radiances, it is possible that the use of retrieved profiles might offer an alternative methodology that is less complex and more computationally efficient to solve this problem. The NASA Short-term Prediction Research and Transition (SPoRT) Center has assimilated hyperspectral infrared retrieved profiles into Weather Research and Forecasting Model (WRF) simulations using the Gridpoint Statistical Interpolation (GSI) System. Early research at SPoRT demonstrated improved initial conditions when assimilating Atmospheric Infrared Sounder (AIRS) thermodynamic profiles into WRF (using WRF-Var and assigning more appropriate error weighting to the profiles) to improve regional analysis and heavy precipitation forecasts. Successful early work has led to more recent research utilizing WRF and GSI for applications including the assimilation of AIRS profiles to improve WRF forecasts of atmospheric rivers and assimilation of AIRS, Cross-track Infrared and Microwave Sounding Suite (CrIMSS), and Infrared Atmospheric Sounding Interferometer (IASI) profiles to improve model representation of tropopause folds and associated non-convective wind events. Although more hyperspectral infrared retrieved profiles can be assimilated into model forecasts, one disadvantage is the retrieved profiles have traditionally been assigned the same error values as the rawinsonde observations when assimilated with GSI. Typically, satellitederived profile errors are larger and more difficult to quantify than traditional rawinsonde observations (especially in the boundary layer), so it is important to appropriately assign observation errors within GSI to eliminate potential spurious innovations and analysis increments that can sometimes arise when using retrieved profiles. The goal of this study is to describe modifications to the GSI source code to more appropriately assimilate hyperspectral infrared retrieved profiles and outline preliminary results that show the differences between a model simulation that assimilated the profiles as rawinsonde observations and one that assimilated the profiles in a module with the appropriate error values.
Berndt, Emily↗
The Hardware of Smaller Clusters
Chris Saunders and three technologists are in high demand from Sandia's deep learning teams, and they're kept busy by building new clusters of computer nodes for researchers who need the power of supercomputing on a smaller scale. Sandia researchers working on Laboratory Directed Research & Development (LDRD) projects, or innovative ideas for solutions on short timeframes, formulate new ideas on old themes and frequently rely on smaller cluster machines to help solve problems before introducing their code to larger HPC resources. These research teams need an agile hardware and software environment where nascent ideas can be tested and cultivated on a smaller scale. Saunders and his team at Sandia's Science and Engineering Computing Environments are successfully enabling this research by creating pipelines for emerging code—from Cloud, to containers, to virtual machines—that build the right environment quickly to help teams solve their problems in a matter of days rather than months. While the larger HPC sources are available, it's these smaller clusters that can rapidly build a foundation for teams to build on for later development on larger systems.
97 MATHEMATICS AND COMPUTING↗
SORA: Scalable Overlap-graph Reduction Algorithms for Genome Assembly using Apache Spark in the Cloud
The advent of high-throughput DNA sequencing techniques has permitted very high quality de novo assemblies of genomes, but raise an issue of requiring large amounts of computer memory to resolve the large genome graphs generated by most overlap graph de novo assemblers. To address these limitations, we present a novel algorithmic approach; Scalable Overlap-graph Reduction Algorithms (SORA). SORA adapts string graph reduction algorithms for the genome assembly using a distributed computing platform. To efficiently compute coverage for enormous paths in the graphs, SORA uses Apache Spark which is a cluster-based engine designed on top of Hadoop to handle very large datasets in the cloud. The experimental results show that SORA can process a nearly one billion edge graph in a distributed cloud cluster as well as smaller graphs on a local cluster with a short turnaround time. Moreover, our algorithms scale almost linearly with increasing numbers of virtual instances in the cloud. SORA is freely available for download at https://github.com/BioHPC/SORA/.
Paul, Alexander↗
Radiative Heating Profiles over Ascension Island during the 2016 and 2017 Biomass Burning Seasons
Marine boundary layer clouds, including the transition from stratocumulus to cumulus, are poorly represented in numerical weather prediction and general circulation models. In many cases, the complex physical relationships between cloud morphology and the environmental conditions in which marine boundary layer clouds exist are not well understood. Such uncertainties arise in the presence of biomass burning carbonaceous aerosol, as is the case over the southeast Atlantic Ocean, where it is likely that the absorbing and heating properties of these aerosols modify the microphysical composition and macrophysical arrangement of marine stratocumulus and trade cumulus. The deployment of the Atmospheric Radiation Measurement Mobile Facility #1 (AMF1) in support of LASIC (Layered Atlantic Smoke Interactions with Clouds) provided a unique opportunity to observe thermodynamic, cloud and aerosol properties during two consecutive biomass burning seasons from July through October of 2016 and 2017 over Ascension Island (7.96 S, 14.35 W). These observations in conjunction with radiation transfer modeling were used to assess the impact of biomass burning carbonaceous aerosol plumes as they passed over the site.Thermodynamic profiles were generated using a combination of radiosonde data and thermodynamic profilers to provide high temporal resolution profiles of quantities that are important for cloud development, such as CAPE and CIN. Coincident Ka-band radar and lidar profiles were used to characterize the cloud and sub-cloud structure. The resulting thermodynamic and cloud profiles are used as input forcing for the Rapid Radiative Transfer Model (RRTM) to compute radiative heating profiles over the observation site. Idealized experiments using RRTM, with and without aerosols present, are used to assess the impacts of the absorbing aerosol on the heating rate profiles.
Cumulus↗
Efficient Parallel Discrete Event Simulation on Cloud/Virtual Machine Platforms
Cloud and Virtual machine (VM) technologies present new challenges with respect to performance and monetary cost in executing parallel discrete event simulation (PDES) applications. Due to the introduction of overall cost as a metric, the traditional use of the highest-end computing configuration is no longer the most obvious choice. Moreover, the unique runtime dynamics and configuration choices of Cloud and VM platforms introduce new design considerations and runtime characteristics specific to PDES over Cloud/VMs. Here, an empirical study is presented to guide an understanding of the dynamics, trends, and trade-offs in executing PDES on Cloud/VM platforms. Performance and cost measures obtained from multiple PDES applications executed on the Amazon EC2 Cloud and on a high-end VM host machine reveal new, counterintuitive VM--PDES dynamics and guidelines. One of the critical aspects uncovered is the fundamental mismatch in hypervisor scheduler policies designed for general cloud workloads versus the virtual time ordering needed for PDES workloads. This insight is supported by experimental data revealing the gross deterioration in PDES performance traceable to VM scheduling policy. To overcome this fundamental problem, the design and implementation of a new deadlock-free scheduler algorithm are presented, optimized specifically for PDES applications on VMs. The scalability of our scheduler has been tested up to 128 VMs multiplexed on 32 cores, showing significant improvement in the runtime relative to the default Cloud/VM scheduler. The observations, algorithmic design, and results are timely for emerging cloud/VM-based installations, highlighting the need for PDES-specific support in high performance discrete event simulations on Cloud/VM platforms.
97 MATHEMATICS AND COMPUTING↗
Scalability Testing Approach for Internet of Things for Manufacturing SQL and NoSQL Database Latency and Throughput
The proliferation of low-cost sensors and industrial data solutions has continued to push the frontier of manufacturing technology. Machine learning and other advanced statistical techniques stand to provide tremendous advantages in production capabilities, optimization, monitoring, and efficiency. The tremendous volume of data gathered continues to grow, and the methods for storing the data are critical underpinnings for advancing manufacturing technology. This work aims to investigate the ramifications and design tradeoffs within a decoupled architecture of two prominent database management systems (DBMS): sql and NoSQL. A representative comparison is carried out with Amazon Web Services (AWS) DynamoDB and AWS Aurora MySQL. The technologies and accompanying design constraints are investigated, and a side-by-side comparison is carried out through high-fidelity industrial data simulated load tests using metrics from a major US manufacturer. The results support the use of simulated client load testing for comparing the latency of database management systems as a system scales up from the prototype stage into production. As a result of complex query support, MySQL is favored for higher-order insights, while NoSQL can reduce system latency for known access patterns at the expense of integrated query flexibility. Here, by reviewing this work, a manufacturer can observe that the use of high-fidelity load testing can reveal tradeoffs in IoTfM write/ingestion performance in terms of latency that are not observable through prototype-scale testing of commercially available cloud DB solutions.
AWS↗
Interstellar clouds containing optically thin H2
The theory of Black and Delgarno that the relative populations of the excited rotational levels of H2 can be understood in terms of cascading following absorption in the Lyman and Werner bands is employed to infer the gas densities and radiation fields within diffuse interstellar clouds containing H2 that is optically thin in those bands. The procedure is described for computing the populations of the different rotation levels, the relative distribution among the different rotation levels of newly formed H2 is determined on the basis of five simplified models, and the rate of H2 formation is estimated. The results are applied to delta Ori, two components of iota Ori, the second components of rho Leo and zeta Ori, tau Sco, gamma Vel, and zeta Pup. The inferred parameters are summarized for each cloud.
Jura, M.↗
Summertime Post-Cold-Frontal Marine Stratocumulus Transition Processes over the Eastern North Atlantic
Abstract Marine boundary layer (MBL) cloud morphology associated with two summertime cold fronts over the eastern North Atlantic (ENA) is investigated using high-resolution simulations from the Weather Research and Forecasting (WRF) Model and observations from the Atmospheric Radiation Measurement (ARM) ENA Climate Research Facility. Lagrangian trajectories are used to study the evolution of post-cold-frontal MBL clouds from solid stratocumulus to broken cumulus. Clouds within specified domains in the vicinity of transitions are classified according to their degree of decoupling, and cloud-base and cloud-top breakup processes are evaluated. The Lagrangian derivative of the surface latent heat flux is found to be strongly correlated with that of the cloud fraction at cloud base in the simulations. Cloud-top entrainment instability (CTEI) is shown to operate only in the decoupled MBL. A new indicator of inversion strength at cloud top that employs the vertical gradients of equivalent potential temperature and saturation equivalent potential temperature, which can be computed directly from soundings, is proposed as an alternative to CTEI. Overall, results suggest that the deepening–warming hypothesis suggested by Bretherton and Wyant explains many of the characteristics of the summertime postfrontal MBL evolution of cloud structure over the ENA, thereby widening the phase space over which the hypothesis may be applied. A subset of the deepening–warming hypothesis involving warming initially dominating over moistening is proposed. It is postulated that changes in climate change–induced modifications in cold-frontal structure over the ENA may be accompanied by coincident changes in the location and timing of MBL cloud transitions in the post-cold-frontal environment.
54 ENVIRONMENTAL SCIENCES↗
EPiC-GAN: Equivariant point cloud generation for particle jets
With the vast data-collecting capabilities of current and future high-energy collider experiments, there is an increasing demand for computationally efficient simulations. Generative machine learning models enable fast event generation, yet so far these approaches are largely constrained to fixed data structures and rigid detector geometries. In this paper, we introduce EPiC-GAN - equivariant point cloud generative adversarial network - which can produce point clouds of variable multiplicity. This flexible framework is based on deep sets and is well suited for simulating sprays of particles called jets. The generator and discriminator utilize multiple EPiC layers with an interpretable global latent vector. Crucially, the EPiC layers do not rely on pairwise information sharing between particles, which leads to a significant speed-up over graph- and transformer-based approaches with more complex relation diagrams. We demonstrate that EPiC-GAN scales well to large particle multiplicities and achieves high generation fidelity on benchmark jet generation tasks.
Buhmann, Erik↗
Quantum Computing [Slides]
Introduction: At the last CHEP we heard a talk about Quantum Computing from a hardware perspective.; Jim is a software algorithm person and he will concentrate more on that.; 20 months is a long time in Quantum Information Science, QIS; The Josephson Junction technology we heard about then has evolved as predicted and we now have “mid-range” devices available on the cloud.
97 MATHEMATICS AND COMPUTING↗
Determination of Thunderstorm Anvil Ice Contents and Other Cloud Properties from Satellite Observations of Lightning
The lightning frequency model developed by Baker, Christian and Latham (1995) has been refined and extended, in an effort to provide a more realistic framework from which to examine computationally the relationships that might exist between lightning frequency f (which is now being routinely measured from satellites, using NASA/MSFC devices) and a variety of cloud physical parameters, including precipitation rate, updraught speed and non-precipitating ice content. The charging mechanism incorporated into the model is the non-inductive ice-ice mechanism - involving rebounding collisions between ice crystals and growing graupel pellets - which has achieved significant field, laboratory and modelling support in recent years. Model results indicate the existence of a simple relationship between lightning frequency f and the upward flux of ice crystals into the thunderstorm anvil. It follows that, for a particular situation, one can assign a specific mass of non-precipitating ice to an individual lightning stroke. Therefore it is possible - using satellite measurements of global lightning - to estimate the atmospheric loading of ice crystals in thunderstorm anvils: a parameter of climatological importance. One can also estimate the ice crystal loading associated with more localized storm systems. Early results from this work will be presented, together with further work on the relationships between f and other thundercloud parameters.
Blyth, Alan M.↗
Determination of Thunderstorm Anvil Ice Contents and Other Cloud Properties from Satellite Observations of Lightning
The lightning frequency model developed by Baker, Christian and Latham (1995) has been refined and extended, in an effort to provide a more realistic framework from which to examine computationally the relationships that might exist between lightning frequency f (which is now being routinely measured from satellites, using NASA/MSFC devices) and a variety of cloud physical parameters, including precipitation rate, updraught speed and non-precipitating ice content. Model results indicate the existence of a simple relationship between lightning frequency f and the upward flux of ice crystals into the thunderstorm anvil. It follows that, for a particular situation, one can assign a specific mass of non-precipitating ice to an individual lightning stroke. Therefore it may prove possible - using satellite measurements of global lightning - to estimate the atmospheric loading of ice crystals in thunderstorm anvils: a parameter of climatological importance. Early results from this work are presented, together with further studies of the relationships between f and other thundercloud parameters.
Blyth, Alan M.↗