Search NASA⌕ Search

SEARCH · Search NASA

Results for “Cloud system”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Comparison of aircraft measurements during GoAmazon2014/5 and ACRIDICON-CHUVA

The indirect effect of atmospheric aerosol particles on the Earth's radiation balance remains one of the most uncertain components affecting climate change throughout the industrial period. The large uncertainty is partly due to the incomplete understanding of aerosol–cloud interactions. One objective of the GoAmazon2014/5 and the ACRIDICON (Aerosol, Cloud, Precipitation, and Radiation Interactions and Dynamics of Convective Cloud Systems)-CHUVA (Cloud Processes of the Main Precipitation Systems in Brazil) projects was to understand the influence of emissions from the tropical megacity of Manaus (Brazil) on the surrounding atmospheric environment of the rainforest and to investigate its role in the life cycle of convective clouds. During one of the intensive observation periods (IOPs) in the dry season from 1 September to 10 October 2014, comprehensive measurements of trace gases and aerosol properties were carried out at several ground sites. In a coordinated way, the advanced suites of sophisticated in situ instruments were deployed aboard both the US Department of Energy Gulfstream-1 (G1) aircraft and the German High Altitude and Long-Range Research Aircraft (HALO) during three coordinated flights on 9 and 21 September and 1 October. Here, we report on the comparison of measurements collected by the two aircraft during these three flights. Such comparisons are challenging but essential for assessing the data quality from the individual platforms and quantifying their uncertainty sources. Similar instruments mounted on the G1 and HALO collected vertical profile measurements of aerosol particle number concentrations and size distribution, cloud condensation nuclei concentrations, ozone and carbon monoxide mixing ratios, cloud droplet size distributions, and downward solar irradiance. We find that the above measurements from the two aircraft agreed within the measurement uncertainties. The relative fraction of the aerosol chemical composition measured by instruments on HALO agreed with the corresponding G1 data, although the total mass loadings only have a good agreement at high altitudes. Furthermore, possible causes of the discrepancies between measurements on the G1 and HALO are examined in this paper. Based on these results, criteria for meaningful aircraft measurement comparisons are discussed.

47 OTHER INSTRUMENTATION↗
DOE OSTI2026

Prognostic simulations of mixed-phase clouds with model AC-1D v1.0: the impact of aerosol types and freezing parameterizations on ice crystal budgets

Mixed-phase clouds at high latitudes contribute to the uncertainty in predicting cloud feedbacks and climate sensitivity, mainly due to the complexity of microphysical processes that influence the partitioning between the supercooled liquid and ice phases, and hence, cloud radiative effects on regional scales. Particularly in Arctic mixed-phase clouds, the activation of ice-nucleating particles (INPs) from various aerosol populations remains a leading source of uncertainty. We developed an aerosol-cloud one-dimensional (AC-1D) model, which provides a novel framework to prognostically treat INP and ice crystal budgets while explicitly accounting for polydisperse and multicomponent aerosol that activate INPs following different freezing parameterizations. The AC-1D model is informed by large-eddy simulations to probe the impact of INP representation on predicted ice crystal number concentrations (N i ) and ice crystal budgets in mixed-phase Arctic stratus. We apply three immersion freezing (IMF) parameterizations, two time-independent (singular) and one time-dependent (classical nucleation theory), to predict the evolution of the INP reservoir and resulting ice crystal budget from polydisperse mineral dust, organic (humic-like substances), and sea spray aerosol particle size distributions. Our analysis focuses on how variations in aerosol number concentration and cloud system parameters such as cloud cooling rate, cloud-top entrainment rate, and ice crystal fall speed influence the INP reservoir and ice crystal budgets. Furthermore, this study investigates the competitive ice nucleation dynamics in mixed aerosol environments and provides a process-level quantification of the INP budget terms, which directly controls ice crystal budgets. For all studied case scenarios, the aerosol types and associated particle size distributions significantly impact INP and N i , and the choice between a time-dependent and a singular freezing description yields orders-of-magnitude differences in the predicted INP and N i over the 10 h simulation time, reflecting typical cloud lifetimes. Our results show that the influence of cloud cooling, INP entrainment, and sedimentation varies significantly depending on the chosen freezing parameterization. These findings underscore the critical need for robust IMF parameterizations and precise cloud system observations to enhance the accuracy of models in predicting mixed-phase cloud structure and evolution.

Arctic clouds↗
DOE OSTI2023

The June 2012 North American Derecho: A Testbed for Evaluating Regional and Global Climate Modeling Systems at Cloud‐Resolving Scales

Abstract In this paper, we introduce a testbed for evaluating and comparing climate modeling systems at cloud resolving scales using hindcasts of the June 2012 North American derecho. To demonstrate its utility for model intercomparison, the testbed is applied to two models: the regionally‐refined Simple Cloud‐Resolving E3SM Atmosphere Model (SCREAM) at 6.5, 3.25 and 1.625 km grid spacing and the Weather Research and Forecasting (WRF) model with 3.2 and 1.6 km grid spacing. We find the simulation results to be highly sensitive to the initial conditions (ICs), initialization time, and model configurations, with ICs from the Rapid Refresh producing the best simulation. Significant improvement is identified in both models as horizontal grid spacing is refined. While a propagation delay of approximately 2 hr is found in both models, SCREAM at 1.625 km simulates the observed bow echo structure of the derecho well and predicts strong surface gusts that exceed 30 m/s. In comparison, WRF has difficulty producing surface wind over 25 m/s, with wind gusts in WRF 42%–46% lower than in SCREAM. However, WRF has a lower bias in simulating cloud top temperature and extent, but overestimates precipitation intensity. Both models reproduce the observed outgoing longwave radiation spatial patterns well (Pearson correlation >0.88), but, compared with NEXRAD observations, simulate generally larger areas of composite radar reflectivity >40 dBZ and underestimate the precipitating area by ∼47%.

2012 North American derecho↗
DOE OSTI2022

Quantum Computing in the Cloud: Analyzing job and machine characteristics

As the popularity of quantum computing continues to grow, quantum machine access over the cloud is critical to both academic and industry researchers across the globe. And as cloud quantum computing demands increase exponentially, the analysis of resource consumption and execution characteristics are key to efficient management of jobs and resources at both the vendor-end as well as the client-end. While the analysis of resource consumption and management are popular in the classical HPC domain, it is severely lacking for more nascent technology like quantum computing. This paper is a first-of-its-kind academic study, analyzing various trends in job execution and resources consumption / utilization on quantum cloud systems. We focus on IBM Furthermore, quantum systems and analyze characteristics over a two year period, encompassing over 6000 jobs which contain over 600,000 quantum circuit executions and correspond to almost 10 billion “shots” or trials over 20+ quantum machines. Specifically, we analyze trends focused on, but not limited to, execution times on quantum machines, queuing/waiting times in the cloud, circuit compilation times, machine utilization, as well as the impact of job and machine characteristics on all of these trends. Furthermore, our analysis identifies several similarities and differences with classical HPC cloud systems. Based on our insights, we make recommendations and contributions to improve the management of resources and jobs on future quantum cloud systems.

42 ENGINEERING↗
DOE OSTI2023

OPEN leaf : an open‐source cloud‐based phenotyping system for tracking dynamic changes at leaf‐specific resolution in Arabidopsis

SUMMARY The first draft of the Arabidopsis genome was released more than 20 years ago and despite intensive molecular research, more than 30% of Arabidopsis genes remained uncharacterized or without an assigned function. This is in part due to gene redundancy within gene families or the essential nature of genes, where their deletion results in lethality (i.e., thedark genome). High‐throughput plant phenotyping (HTPP) offers an automated and unbiased approach to characterize subtle or transient phenotypes resulting from gene redundancy or inducible gene silencing; however, access to commercial HTPP platforms remains limited. Here we describe the design and implementation ofOPEN leaf, an open‐source phenotyping system with cloud connectivity and remote bilateral communication to facilitate data collection, sharing and processing.OPEN leaf, coupled with our SMART imaging processing pipeline was able to consistently document and quantify dynamic changes at the whole rosette level and leaf‐specific resolution when plants experienced changes in nutrient availability. Our data also demonstrate that VIS sensors remain underutilized and can be used in high‐throughput screens to identify and characterize previously unidentified phenotypes in a leaf‐specific time‐dependent manner. Moreover, the modular and open‐source design ofOPEN leafallows seamless integration of additional sensors based on users and experimental needs.

Plant Sciences↗
DOE OSTI2024

Linear Time-Invariant Models of a Large Cumulus Ensemble

Abstract Methods in system identification are used to obtain linear time-invariant state-space models that describe how horizontal averages of temperature and humidity of a large cumulus ensemble evolve with time under small forcing. The cumulus ensemble studied here is simulated with cloud-system-resolving models in radiative–convective equilibrium. The identified models extend steady-state linear response functions used in past studies and provide accurate descriptions of the transfer function, the noise model, and the behavior of cumulus convection when coupled with two-dimensional gravity waves. A novel procedure is developed to convert the state-space models into an interpretable form, which is used to elucidate and quantify memory in cumulus convection. The linear problem studied here serves as a useful reference point for more general efforts to obtain data-driven and interpretable parameterizations of cumulus convection.

Meteorology & Atmospheric Sciences↗
DOE OSTI2023

Ice Cryo-Encapsulation Balloon (Project ICEBall) Field Campaign Report

The Ice Cryo-Encapsulation Balloon (ICEBall) field campaign was designed to sample the ice crystals that compose high-altitude cirrus with a passive device. The campaign made use of a new instrument, ICEBall, which is a balloon-borne ice crystal sampling system. The ice crystal sounding system is capable of measuring ice crystal concentration, temperature, atmospheric pressure, ice crystal habit, aerosol particle morphology, and residual composition. The 3-kg instrument is carried upwards at 5 m s-1 by a high-altitude balloon. The instrument can be cut down from the balloon at any altitude up to 20 km, and the apparatus returns to the surface by parachute. Basic measurements such as temperature and pressure are recorded onboard, and high-frequency Global Positioning System (GPS) records altitude and latitude/longitude. Ice crystal concentrations are measured through the use of a high-resolution video camera mounted on the device. Ice crystals are collected through an open aperture leading to insulated collection chambers cooled with dry ice. Upon exiting the top of the cloud system, the chamber aperture is closed, and the ~1 mm3 sample cell is magnetically sealed and isolated at -78 °C, ensuring that ice particles do not sublimate or grow after collection. Once the crystals are returned to the surface, they are double-sealed and immersed at liquid nitrogen temperature in “dry-cryo shippers” before being transported back to the laboratory. Dr. Magee’s laboratory at The College of New Jersey contains a cryo-stage scanning electron microscope (SEM), which was used to interrogate the crystals and aerosol particles. The main purpose of this pilot field campaign was to provide an unprecedented level of detail on the crystal habits and ice surface complexity in mid-latitude cirrus, which may help resolve issues associated with habit identification and classification in cirrus. The ICEBall campaign was originally scheduled to run from March 28 to April 18 of 2021 at the U.S. Department of Energy Atmospheric Radiation Measurement (ARM) Southern Great Plains observatory. The COVID-19 pandemic intervened and caused us to shift the dates of the experiment to October 16-November 6 of 2021. This period is also climatologically favorable for cirrus. The approximately six-month gap between our original field campaign dates and the actual dates afforded us the opportunity to build two new ICEBall payload instruments. These instruments were tested during an August 2021 trip to The College of New Jersey. During this field testing phase, we decided to launch the ICEBall payload upstream from the ARM SGP site with the goal of landing in the vicinity of the site. Our goal was to sample the ice crystals before the cirrus were advected over the remote-sensing instruments at the SGP site. The team assembled for the field campaign consisted of the Principle Investigator (PI) and Co-Principle Investigator (Co-PI) (Drs. Harrington and Magee), The Pennsylvania State University research scientist Dr. Alfred Moyle, and two graduate students (Ms. Marley Majetic and Gwenore Pokrifka). The team operated out of a house rented in Enid, Oklahoma. We successfully sampled seven cirrus cloud systems during the three-week field campaign (October 21, 23-26, 31, and November 1). This was a much higher success rate than either of the PIs anticipated (our goal was closer to sampling three or four cases). The balloon was typically launched from oil pads or farm fields northwest of Enid and the payload was typically retrieved somewhat north of the SGP site. We never landed directly at the SGP site, and so did not need regular access to the SGP facilities. Our greatest concern going into the field campaign was the longer-term storage of crystals in the -196°C cryo dry-shipper dewars and the subsequent transport across the country. We had tested storage and transport prior to the field campaign, but we had never stored crystals for a few weeks nor had we transported the dewars over long distances. To our great relief, the storage and transport worked flawlessly and we were able to image a large number of crystals from six of the seven cases. Working with the staff at the ARM SGP office was excellent. They not only helped us find the sources we needed for helium, liquid nitrogen, and other materials, but also helped with contacts within the Federal Aviation Administration (FAA) and Vance Air Force Base. One goal of our field project was to tie the in situ measurements of ice crystal habits to the radar signatures derived from the Ka-band ARM Zenith-pointing Radar (KAZR). Unfortunately KAZR was down for the duration of our experiment. However, the Ka-band Scanning ARM Cloud Radar (KASACR) was put into vertically pointing mode during the ICEBall campaign and those data, along with Doppler lidar measurements, have proved very useful.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

National Technology & Engineering Solutions of Sandia, LLC Technical Assistance With Energy Cloud (Final CTAP Report)

Sandia provided technical assistance to Energy Cloud to support the assessment of Energy Cloud’s technology for air filtration of the SARS-CoV-2 virus. The Energy Cloud system was developed to filter the SARS-CoV-2 virus from commercial HVAC systems, ducts, and enclosed rooms without generating ozone. The project included a 3-week experimental series with aerosolized SARS-CoV-2 virus at the University of Southern California’s biosafety level 3 (BSL-3) laboratory. USC provided the facility as well as experimentally derived measurements and assessment of the Energy Cloud system efficacy for SARSCoV-2 filtration from air handling systems.

42 ENGINEERING↗
DOE OSTI2026

Mesoscale Organization in Cumulus-Coupled Stratocumulus

Marine cloud systems cover a substantial portion of the world’s oceans. Most of these clouds form relatively close to the ocean surface, typically within one to two kilometers, a region referred to by meteorologists as the marine boundary layer. They are composed predominantly of liquid water, although ice particles can occur in mid- and high-latitude marine clouds during winter. In satellite imagery, these clouds appear bright against the darker ocean surface below, reflecting a large fraction of incoming sunlight back into space that would otherwise warm the ocean. Because marine boundary layer clouds cover such an extensive area of the ocean, they exert a significant influence on Earth’s overall transfer of solar energy absorbed by the surface and thermal energy emitted to space, a balance known as the planetary radiation budget. Marine boundary layer clouds are typically thin, and their formation and dissipation depend on a delicate balance between processes acting at the ocean surface below and the warm, dry air above. They are notoriously difficult to simulate accurately in weather forecast models, which often produce too few marine low clouds in midlatitudes and clouds in tropical regions that are excessively bright, meaning they reflect too much solar radiation. The marine boundary layer is frequently characterized by widespread overcast cloud cover that often transitions from a continuous, single-layer deck to more broken cloud fields toward the tropics. These transitions typically proceed through an intermediate stage in which shallow, broken clouds form beneath the overlying stratiform cloud deck. Once broken clouds develop below the overcast, they frequently self-organize into cloud clusters known as marine boundary layer convective complexes (MBLCCs), although the mechanisms governing the formation and organization of MBLCCs remain poorly understood. Accurately representing these transitions in long-range weather forecast models is essential because they influence the properties of air masses advected over the continental United States and Europe, and they become increasingly important for forecasts on seasonal and longer timescales. We employed two complementary approaches to investigate the processes controlling MBLCCs and their impact on marine cloud cover. Long-term observations from the U.S. Department of Energy’s Eastern North Atlantic (ENA) Observatory provided a unique dataset that allowed us to characterize fundamental properties of MBLCCs, including their typical size and frequency of occurrence. These observations were combined with high-resolution numerical simulations performed on supercomputers to examine the evolution of MBLCCs during cold-air outbreaks over the ENA region.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Mind-the-gap - Part III: Doppler velocity measurements from space

Convective motions and hydrometeors microphysical properties are highly sought-after parameters for evaluating atmospheric numerical models. With most of the Earth's surface covered by water, space-borne Doppler radars are ideal for acquiring such measurements at a global scale. While these systems have proven to be useful tools for retrieving cloud microphysical and dynamical properties from the ground, their adequacy, and specific requirements for spaceborne operation still need to be evaluated. Comprehensive forward simulations enable us to assess the advantages and drawbacks of six different Doppler radar architectures currently planned or under consideration by space agencies for the study of cloud dynamics. Radar performance is examined against state-of-the-art numerical model simulations of well-characterized shallow and deep, continental, and oceanic convective cases. Mean Doppler velocity (MDV) measurements collected at multiple frequencies (13, 35 and 94 GHz) provide complementary information in deep convective cloud systems. The high penetration capability of the 13-GHz radar enables to obtain a complete, albeit horizontally under-sampled, view of deep convective storms. The smaller instantaneous field of view (IFOV) of the 35-GHz radar captures more precise information about the location and size of convective updrafts above 5-8 km height of most systems which was determined is the portion of storms where the mass flux peak is typically located. Finally, the lower mean Doppler velocity uncertainty of displaced phase center antenna (DPCA) radars makes them an ideal system for studying microphysics in shallow convection and frontal systems, as well as ice and mixed-phase clouds. It is demonstrated that a 94-GHz DCPA system can achieve retrieval errors as low as 0.05-0.15 mm for raindrop volume-weighted mean diameter and 25% for rime fraction (for a -10 dBZ echo).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Cloud Droplet Measurement System for the ARM Tethered Balloon System (TBS) Field Campaign Report

The Mesa Photonics' cloud droplet measurement system (CDMS) performs in situ measurement of droplet size distribution and droplet number density in clouds. These characteristics are important cloud microphysical properties that are critical input parameters for atmospheric models and are also useful for proper calibration and validation of performance of other atmospheric measurement instrumentation. This small campaign was the first project (out of two) that involved integration of the CDMS into the U.S. Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) user facility’s tethered balloon system (TBS) and its initial testing at the ARM Southern Great Plains (SGP) atmospheric observatory. The follow-up campaign (AFC07016) involved testing of the CDMS under relevant conditions at the third ARM Mobile Facility (AMF3) at Oliktok Point, Alaska and making in situ measurements in clouds. The goal of this small field campaign was to deploy the CDMS on the ARM TBS, demonstrate its integrity and compatibility with the TBS, and test the wireless telecommunication system in preparation for subsequent in-cloud measurements at ARM’s North Slope of Alaska (NSA) observatory at Utqiagvik (formerly Barrow). The specific technical objectives included: (1) Integration of the Mesa Photonics' CDMS into the ARM TBS, (2) testing of the wireless telecommunication system of the CDMS, (3) evaluating the data acquisition software and image processing algorithms especially under high-background-illumination conditions, and (4) testing the ruggedness of the instrument's optical alignment and other performance characteristics. All objectives have been successfully met. The mounting hardware was designed and built mostly at Sandia National Laboratories (SNL), which allowed reliable mounting of the CDMS on the TBS and co-locating the CDMS with other instruments. The field tests were performed by the principal investigator (PI) in collaboration with the TBS operational crew led by D. Dexheimer. The field testing demonstrated good compatibility of the CDMS with the TBS. During the TBS flights, the crew did not experience any operational issues with the CDMS. The instrument demonstrated reliable operational characteristics, including sufficient battery life and good thermal management. The wireless telecommunication system has been successfully tested at TBS flight altitudes of up to 1000 m. During all flights, the CDMS raw data were wirelessly transmitted to the ground station and processed in real time. The ruggedness of the instrument's optical alignment was evaluated by performing calibration of the CDMS (using Mesa Photonics' fixed-size monodisperse droplet generator) before and after the campaign. The calibration was stable within the instrument's measurement precision. In summary, the campaign demonstrated good compatibility of the Mesa Photonics' CDMS with the ARM TBS. The flight tests confirmed the mechanical integrity of the CDMS and stability of its optical layout, as well as reliability of the wireless telecommunication system. Successful completion of this campaign provided a solid basis for the next campaign (AFC07016, November 2020), that involved testing of the CDMS during in-cloud TBS flights at AMF3 at Oliktok Point.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Earth System Model Aerosol–Cloud Diagnostics (ESMAC Diags) package, version 2: assessing aerosols, clouds, and aerosol–cloud interactions via field campaign and long-term observations

Abstract. Poor representations of aerosols, clouds, and aerosol–cloud interactions (ACIs) in Earth system models (ESMs) have long been the largest uncertainties in predicting global climate change. Huge efforts have been made to improve the representation of these processes in ESMs, and the key to these efforts is the evaluation of ESM simulations with observations. Most well-established ESM diagnostics packages focus on the climatological features; however, they lack process-level understanding and representations of aerosols, clouds, and ACIs. In this study, we developed the Earth System Model Aerosol–Cloud Diagnostics (ESMAC Diags) package to facilitate the routine evaluation of aerosols, clouds, and ACIs simulated the Energy Exascale Earth System Model (E3SM) from the US Department of Energy (DOE). This paper documents its version 2 functionality (ESMAC Diags v2), which has substantial updates compared with version 1 (Tang et al., 2022a). The simulated aerosol and cloud properties have been extensively compared with in situ and remote-sensing measurements from aircraft, ship, surface, and satellite platforms in ESMAC Diags v2. It currently includes six field campaigns and two permanent sites covering four geographical regions: the eastern North Atlantic, the central US, the northeastern Pacific, and the Southern Ocean. These regions produce frequent liquid- or mixed-phase clouds, with extensive measurements available from the DOE Atmospheric Radiation Measurement user facility and other agencies. ESMAC Diags v2 generates various types of single-variable and multivariable diagnostics, including percentiles, histograms, joint histograms, and heatmaps, to evaluate the model representation of aerosols, clouds, and ACIs. Select examples highlighting the capabilities of ESMAC Diags are shown using E3SM version 2 (E3SMv2). In general, E3SMv2 can reasonably reproduce many observed aerosol and cloud properties, with biases in some variables such as aerosol particle and cloud droplet sizes and number concentrations. The coupling of aerosol and cloud number concentrations may be too strong in E3SMv2, possibly indicating a bias in processes that control aerosol activation. Furthermore, the liquid water path response to a perturbed cloud droplet number concentration behaves differently in E3SMv2 and observations, which warrants further study to improve the cloud microphysics parameterizations in E3SMv2.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Assessing Raindrop Breakup Parameterizations Using Disdrometer Observations

In this work, an intercomparison of raindrop mean diameter frequency distribution (RDFD) is performed for numerical simulations of precipitating cloud systems using an array of models and microphysics schemes. This includes results from the Regional Atmospheric Modeling System (RAMS) double-moment microphysics, the Hebrew University Cloud Model bin microphysics (HUCM) interfaced to the RAMS parent model, and the Weather Research and Forecasting (WRF) Model with the Thompson, Morrison, double-moment 6-class (WDM6), and National Severe Storms Laboratory (NSSL) double-moment schemes. Simulations are examined with respect to the raindrop size distribution (DSD) volume-number mean diameter (D m ) and intercept parameter (N w ). When compared to a suite of disdrometer observations, the RDFD resulting from each microphysics scheme exhibits varying degrees of mean drop size constraints and peaks in the frequency distribution of D m . A more detailed investigation of the peaked RDFD from the RAMS simulations suggests that the parameterization of raindrop collisional breakup can impose strong limitations on the evolution of simulated drop growth. As such, a summary and comparison of the drop breakup parameterizations among the aforementioned microphysics schemes is presented. While some drop breakup parameterizations are adjusted toward the observations by modifying the threshold diameter for the onset of breakup, this study explores the use of a modified maximum breakup efficiency. This method permits the parameterization to retain its threshold breakup diameter, while limiting the strength of drop breakup and permitting a broader range of drop sizes. As a result, the simulated mean drop sizes are in better agreement with observations.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Execute BEE workflows on private cloud infrastructure-2.3.6.01 - LANL ATDM ST / STNS01-22 Milestone Completion Documentation (BEE-FY21 P6-2) [Slides]

This work involves the creation of the Cloud Launcher, a new subcomponent of BEE, and the extension of the BEETaskManager to run on Cloud systems. BEE will be able to interact with the Google Compute Engine and OpenStack cloud APIs to set up simple Cloud clusters for launching HPC job scripts. BEE will use existing functionality to launch jobs that previously could only be launched on HPC systems. The BEETaskManager will handle launching tasks on the Cloud cluster.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

AutoCheck: Automatically Identifying Variables for Checkpointing by Data Dependency Analysis

Checkpoint/Restart (C/R) has been widely deployed in numerous HPC systems, Clouds, and industrial data centers, which are typically operated by system engineers. Nevertheless, there is no existing approach that helps system engineers without domain expertise and domain scientists without system fault tolerance knowledge identify those critical variables accounted for correct application execution restoration in a failure for C/R. To address this problem, we propose an analytical model and a tool (AutoCheck) that can automatically identify critical variables to checkpoint for C/R. AutoCheck relies on first, analytically tracking and optimizing data dependency between variables and other application execution state, and second, a set of heuristics that identify critical variables for checkpointing from the refined data dependency graph (DDG). AutoCheck allows programmers to pinpoint critical variables to checkpoint quickly within a few minutes. We evaluate AutoCheck on 13 representative HPC benchmarks, demonstrating that AutoCheck can efficiently identify correct critical variables to checkpoint.

HPC↗
DOE OSTI2026

Drop clustering and drop size correlations from holographic imagery suggest cloud droplet spectral broadening via entrainment-mixing

The question of how droplets rapidly grow large enough to initiate collision-coalescence has persisted for decades. Many theories explaining the production of sufficiently large drops (i.e., those in the “bottleneck” size range; ∼ 25–50 µm diameters) involve drop clustering on millimeter scales. A novel method is introduced to evaluate drop clustering trends particle-by-particle (i.e., the number/proximity of neighboring drops for given droplets; defined as drop clustering fields) which are diagnosed relative to drops within their shared drop environments – in contrast to previous studies which diagnose drop clustering of defined sample volumes, or in terms of absolute length scales. Specifically, this study evaluates the statistical likelihood that drops of a given size are associated with either a significant number of neighboring drops, or are significantly isolated from neighboring drops. Observations are acquired from the HOLODEC during the Cloud System Evolution in the Trades campaign, which sampled subtropical marine clouds. The HOLODEC measures drop size distributions and the 3D spatial coordinates of droplets. Results show drops within the bottleneck size range (diameters of ∼ 25–50 µm) are most likely to be significantly isolated from neighboring drops. This “isolated large drop trend” is primarily observed at subsaturated conditions, suggesting entrainment is the contributing factor. Holograms associated with this trend are more likely to have broader drop size distributions, larger maximum drop sizes and overly regions where precipitation reaches the lowest altitudes from the sampled cloud, suggesting entrainment-mixing drop size distribution broadening is a relevant precipitation-initiation mechanism.

D'Alessandro, John J. [Univ. of Washington, Seattl↗
DOE OSTI2020

AI-Science for Performance Optimization and Diagnosis of Science Instrument Federations

Next generation of science workflows are expected to be executed over complex federations composed of supercomputers, science instruments, storage systems and networks, with new additions of the edge and cloud systems and services. The sheer complexity of these multi-domain federations makes it hard to manage them and optimize their performance, as small impedance mismatches (that can dynamically develop between systems) could drastically degrade the entire federation performance. Recent proliferation of Software Defined Everything (SDX) technologies combined with containerization frameworks provide custom instruments that can monitor and collect critical measurements at various levels to support diagnoses and performance optimization; but their data too enormous for human operators and analysts to process and generate decisions. Machine Learning (ML) methods that extract critical parameters, relationships and trends from the data offer general solutions. Artificial Intelligence (AI) and ML methods must be custom-developed for these problems based on solid, rigorous foundations, since black-box approaches are often ineffective and unsound.We propose to develop comprehensive AI-Science for the performance of science federations to (i) monitor and control storage, networks, experiments, and computing systems across multiple domains via softwarization layers, at speeds and scales orders of magnitude superior to current practice, (ii) optimally realize and orchestrate complex workflows with high performance by using dynamic state and performance estimation methods, and (iii) aggregate measurements across sites and time to develop infrastructure-level profiles, optimizations and diagnoses using AI-Science based on foundational principles from ML, game theory, and information fusion areas.

Rao, Nageswara↗