Search NASA⌕ Search

SEARCH · Search NASA

Results for “Amazon”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 829 records · Page 46

materialsCloudCompute

materialsCloudCompute (mCC) is a software package for running easily parallelizable materials science theoretical computations on Amazon Web Services (AWS) infrastructure. mCC provides tools to partition out computational problem into smaller subproblems which can be run in parallel, and ensure that each of those subproblems completes successfully. It utilizes the following AWS services: EC2, S3, and RDS. It operates by launch a managing EC2 instance, which can launch worker instances that perform the calculations. The Managing instance tracks the subproblems and ensures that the Worker instances continue to operation, killing and relaunching them if they fail.

Forbes, David↗

s3-browser

Web application that interacts with the Amazon AWS S3 REST API to allow users to manage files and buckets without having to use the aws command line application.

Chu, Vincent↗

Learning Universal Authorship Representations

This code contains all the utilities required to reproduce the results of our EMNLP 2021 paper "Learning Universal Authorship Representations". It contains the utilities required for download the datasets, training our model, and performing all evaluations necessary for reproducing the results in the paper. Here's the abstract of our work: Determining whether two documents were composed by the same author, also known as authorship verification, has traditionally been tackled using statistical methods. Recently, authorship representations learned using neural networks have been found to outperform alternatives, particularly in large-scale settings involving hundreds of thousands of authors. But do such representations learned in a particular domain transfer to other domains? Or are these representations inherently entangled with domain-specific features? To study these questions, we conduct the first large-scale study of cross-domain transfer for authorship verification considering zero-shot transfers involving three disparate domains: Amazon reviews, fanfiction short stories, and Reddit comments. We find that although a surprising degree of transfer is possible between certain do- mains, it is not so successful between others. We examine properties of these domains that influence generalization and propose simple but effective methods to improve transfer.

Rivera Soto, RafaelA↗

Azure Data Tools (FKA: OEDI (Open Energy Data Initiative) Data Access Tools) [SWR-23-92]

The Open Energy Data Initiative (OEDI) provides a number of tools to enable the use of the open data published through this initiative. The source is largely written in Python, including Jupyter notebooks. The Open Energy Data Initiative (OEDI) is a partnership between the National Renewable Energy Laboratory (NREL), the U.S. Department of Energy (DOE), Amazon, Microsoft, and Google to provide universal access to big data in the cloud. At the heart of OEDI is a centralized repository of high-value energy research datasets aggregated from DOE Program Offices, National Laboratories and other collaborators.

Jonathan, Weers↗

Addressing the Complexity of the Earth System

This paper highlights the role of the Earth-system biosphere and illustrates the complex: biosphere-atmosphere interactions in the Amazon Basin, changes in nitrogen cycling, ocean chemistry, and land use. It introduces three important requirements for accelerating the development and use of Earth system information. The first requirement is to develop Earth system analysis and prediction models that account for multi-scale physical, chemical and biological processes, including their interactions in the coupled atmosphere-ocean-land-ice system. The development of these models requires partnerships between academia, national research centers, and operational prediction facilities, and builds upon accomplishments in weather and climate predictions. They will highlight the regional aspects of global change, and include modules for water system, agriculture, forestry, energy, air quality, health, etc. The second requirement is to model the interactions between humans and the weather-climate-biogeochemical system. The third requirement is to introduce novel methodologies to account for societal drivers, impacts and feedbacks. This is a challenging endeavor requiring creative solutions and some compromising because human behavior cannot be fully represented within the framework of present-day physical prediction systems.

54 ENVIRONMENTAL SCIENCES↗

Exploring Surface Biophysical-Climate Sensitivity to Tropical Deforestation Rates Using a GCM: A Feasibility Study

Deforestation perturbs both biophysical and carbon feedbacks on climate. However, biophysical feedbacks operate at temporally immediate and spatially focused scales and thus may be sensitive to the rate of deforestation rather than just to total forest-cover loss. Explored here is a method for simulating annual tropical deforestation in the fully coupled Community Climate System Model, version 3.0 (CCSM3) with the Dynamic Global Vegetation Model (DGVM) for testing biosphere climate sensitivity to “preservation pathways.” Two deforestation curves were simulated—a 10% deforestation curve with a 10% preservation target (DFC10-PT10) versus a 1% deforestation curve with a 10% preservation target (DFC1-PT10). During active deforestation, albedo, net radiation, latent heat flux, and climate variables were compared for time dependence and sensitivity to tropical tree cover across the tropical band and the Amazon basin, central African, and Southeast Asian regions. The results demonstrated the feasibility of modeling incremental deforestation and detecting both transient and long-term impacts, although a warm/dry bias in CCSM3–DGVM and the absence of carbon feedbacks preclude definitive conclusions on the magnitude of sensitivities. The deforestation rates produced characteristic trends in biophysical variables with DFC10-PT10 resulting in rapid increase/decrease during the initial 10–30 years before leveling off, whereas DFC1-PT10 exhibits gradual changes. The rate had little effect on biophysical and climate sensitivities when averaged over tropical land but produced significant differences at a regional level. Over the long term, the rates produced dissimilar vegetation distributions, despite having the same preservation target in both cases. Overall, these results indicate that the question of rates is one worth further analysis.

54 ENVIRONMENTAL SCIENCES↗

Pronounced Impact of Salinity on Rapidly Intensifying Tropical Cyclones

We show the importance of salinity for rapidly intensifying Atlantic tropical cyclones and demonstrate the potential for improved prediction of rapid intensification through the inclusion of salinity. Tropical Cyclone (TC) rapid intensification (RI) is difficult to predict and poses a formidable threat to coastal populations. A warm upper ocean is well-known to favor RI, but the role of ocean salinity is less clear. This study shows a strong inverse relationship between salinity and TC RI in the eastern Caribbean and western tropical Atlantic due to near-surface freshening from the Amazon-Orinoco River system. In this region, rapidly intensifying TCs induce a much stronger surface enthalpy flux compared to more weakly intensifying storms, in part due to a reduction in SST cooling caused by salinity stratification. This reduction has a noticeable positive impact on TCs undergoing RI, but the impact of salinity on more weakly intensifying storms is insignificant. These statistical results are confirmed through experiments with an ocean mixed layer model, which show that the salinity-induced reduction in SST cold wakes increases significantly as the storm’s intensification rate increases. Currently, operational statistical-dynamical RI models do not use salinity as a predictor. Through experiments with a statistical RI prediction scheme, it is found that the inclusion of surface salinity significantly improves the RI detection skill, offering promise for improved operational RI prediction. Satellite surface salinity may be valuable for this purpose, given its global coverage and availability in near real-time.

Balaguru, Karthik↗

Tropical Convective Transition Statistics and Causality in the Water Vapor–Precipitation Relation

Abstract Previous work by various authors has pointed to the role of lower-free-tropospheric humidity in affecting the onset of deep convection in the tropics. Empirical relationships between column water vapor (CWV) and precipitation have been inferred to result from these effects. Evidence from previous work has included deep convective conditional instability calculations for entraining plumes, in which the lower-free-tropospheric environment affects the onset of deep convection due to the differential impact on buoyancy of turbulent entrainment of dry versus moist air. The relationship between deep convection and water vapor is, however, a two-way interaction because convection also moistens the free troposphere. The present study adds an additional line of evidence toward fully establishing the causality of the precipitation–water vapor relationship. Parameter perturbation experiments using the coupled Community Earth System Model (CESM) with high-time-resolution output are analyzed for a set of statistics for the transition to deep convection, coordinated with observational diagnostics for the Green Ocean Amazon (GOAmazon) campaign and tropical western Pacific Atmospheric Radiation Measurement (ARM) sites. For low values of entrainment in the deep convective scheme, these statistics are radically altered and the observed pickup of precipitation with CWV is no longer seen. In addition to helping cement the dominant direction of causality in the fast-time-scale precipitation–CWV relationship, the results point to impacts of entrainment on the climatology. Because at low entrainment convection can fire before tropospheric moistening, the climatological values of relative humidity are lower than observed. These findings can be consequential to biases in simulated climate and to projections of climate change.

54 ENVIRONMENTAL SCIENCES↗

How Do Environmental Conditions Influence Vertical Buoyancy Structure and Shallow-to-Deep Convection Transition across Different Climate Regimes?

Abstract We developed an entraining parcel approach that partitions parcel buoyancy into contributions from different processes (e.g., adiabatic cooling, condensation, freezing, and entrainment). Applying this method to research-quality radiosonde profiles provided by the Atmospheric Radiation Measurement (ARM) program at six sites, we evaluated how atmospheric thermodynamic conditions and entrainment influence various physical processes that determine the vertical buoyancy structure across different climate regimes as represented by these sites. The differences of morning buoyancy profiles between the deep convection (DC)/transition cases and shallow convection (SC)/nontransition cases were used to assess preconditions important for shallow-to-deep convection transition. Our results show that for continental sites such as the U.S. Southern Great Plains (SGP) and west-central Africa, surface conditions alone are enough to account for the buoyancy difference between DC and SC cases, although entrainment further enhances the buoyancy difference at SGP. For oceanic sites in the tropical west Pacific, humidity dilution in the lower to middle free troposphere (~1–6 km) and temperature mixing in the middle to upper troposphere (>4 km) have the most important influences on the buoyancy difference between DC and SC cases. For the humid central Amazon region, entrainment in both the boundary layer and the lower free troposphere (~0–4 km) have significant contributions to the buoyancy difference; the upper-tropospheric influence seems unimportant. In addition, the integral of the condensation term, which represents the parcel’s ability to transform available water vapor into heat through condensation, provides a better discrimination between DC and SC cases than the integral of buoyancy or the convective available potential energy (CAPE).

54 ENVIRONMENTAL SCIENCES↗

Deep Convective Organization, Moisture Vertical Structure, and Convective Transition Using Deep-Inflow Mixing

It is an open question whether an integrated measure of buoyancy can yield a strong relation to precipitation across tropical land and ocean, across the seasonal and diurnal cycles, and for varying degrees of convective organization. Building on previous work, entraining plume buoyancy calculations reveal that differences in convective onset as a function of column water vapor (CWV) over land and ocean, as well as seasonally and diurnally over land, are largely due to variability in the contribution of lower-tropospheric humidity to the total column moisture. Over land, the relationship between deep convection and lower-free-tropospheric moisture is robust across all seasons and times of day, whereas the relation to boundary layer moisture is robust for the daytime only. Using S-band radar, these transition statistics are examined separately for mesoscale and smaller-scale convection. The probability of observing mesoscale convective systems sharply increases as a function of lower-free-tropospheric humidity. The consistency of this with buoyancy-based parameterization is examined for several mixing formulations. Mixing corresponding to deep inflow of environmental air into a plume that grows with height, which incorporates nearly equal weighting of boundary layer and free-tropospheric air, yields buoyancies consistent with the observed onset of deep convection across the seasonal and diurnal cycles in the Amazon. Furthermore, it provides relationships that are as strong or stronger for mesoscale-organized convection as for smaller-scale convection.

54 ENVIRONMENTAL SCIENCES↗

Large-Eddy Simulations of Convection Initiation over Heterogeneous, Low Terrain

Abstract Large-eddy simulations are conducted to investigate and physically interpret the impacts of heterogeneous, low terrain on deep-convection initiation (CI). The simulations are based on a case of shallow-to-deep convective transition over the Amazon River basin, and use idealized terrains with varying levels of ruggedness. The terrain is designed by specifying its power-spectral shape in wavenumber space, inverting to physical space assuming random phases for all wave modes, and scaling the terrain to have a peak height of 200 m. For the case in question, these modest terrain fields expedite CI by up to 2–3 h, largely due to the impacts of the terrain on the size of, and subcloud support for, incipient cumuli. Terrain-induced circulations enhance subcloud kinetic energy on the mesoscale, which is realized as wider and longer-lived subcloud circulations. When the updraft branches of these circulations breach the level of free convection, they initiate wider and more persistent cumuli that subsequently undergo less entrainment-induced cloud dilution and detrainment-induced mass loss. As a result, the clouds become more vigorous and penetrate deeper into the troposphere. Larger-scale terrains are more effective than smaller-scale terrains in promoting CI because they induce larger enhancements in both the width and the persistence of subcloud updrafts.

54 ENVIRONMENTAL SCIENCES↗

Turbulent Kinetic Energy Budgets over Gentle Topography Covered by Forests

Large-eddy simulations of flow over a “horizontally” uniform model forest are used to investigate the effects of gentle topography on the turbulent kinetic energy (TKE) budget within the canopy roughness sublayer. Despite significant differences between simulations using idealized sinusoidal topography and real topography of the Amazon forest, results indicate that the effects of topography are located predominantly in the upper canopy and above, and are mostly caused by mean advection of TKE. The “horizontally” averaged TKE budget from idealized and real gentle topographies are almost identical to that for flat terrain, including a clear inertial layer above the roughness sublayer in which shear production is balanced by local dissipation. At topography crests, where observational towers are usually located, mean vertical advection of TKE can be as important as horizontal advection. Here, we propose the use on an approximate TKE balance equation to estimate mean advection from single tower measurements, and introduce a new advection index that can be used as a proxy to quantify the importance of the topography on the TKE budget.

54 ENVIRONMENTAL SCIENCES↗

Should We Conserve Entropy or Energy when Computing CAPE with Mixed-Phase Precipitation Physics?

Abstract The rapidly increasing resolution of global atmospheric reanalysis and climate model datasets necessitates finding methods for computing convective available potential energy (CAPE) both efficiently and accurately. To this end, this article compares two common methods for computing CAPE which conserve either energy or entropy. Inaccuracies in these computations arise from both physical and numerical errors. For instance, computing CAPE with entropy conserved results in physical errors from nonequilibrium phase transitions but minimizes numerical errors because solutions are analytic at each height. In contrast, computing CAPE with energy conserved avoids these physical errors, but accumulates numerical errors that are grid-resolution-dependent because the numerical integration of a differential equation is required. Analysis of CAPE computed with large databases of soundings from the tropical Amazon and midlatitude storm environments shows that physical errors from the entropy method are typically 1%–3% as large as CAPE, which is comparable to the numerical errors from conserving energy with grid spacing of 25 and 250 m using explicit first-order and second-order integration schemes, respectively. Errors in entropy-based CAPE calculations are also insensitive to vertical grid spacing, in contrast to energy-based calculations whose error strongly scales with the grid spacing. It is shown that entropy-based methods are advantageous when intercomparing datasets with differing vertical resolution because they produce accurate and reasonably fast results that are insensitive to grid resolution, whereas a second-order energy-based method is advantageous when analyzing data with a consistent vertical resolution because of its superior computational efficiency. Significance Statement Convective available potential energy (CAPE) is a measure of instability in the atmosphere that helps forecasters and researchers understand when and where thunderstorms will form. The purpose of this article is to identify the most efficient and accurate methods for computing CAPE. Two methods are considered here, one that relates to the entropy (a measure of thermodynamic disorder) of an air parcel and one that relates to the energy of an air parcel. Results indicate that the entropy method is most accurate and insensitive to the resolution of the data used for the calculation (which can vary considerably), whereas the energy method uses the least computation time.

Peters, John M.↗

Separating Dynamic and Thermodynamic Impacts of Climate Change on Daytime Convective Development over Land

Climate change affects the dynamics and thermodynamics of moist convection. Changes in the dynamics concern, for instance, an increase of convection strength due to increases of convective available potential energy (CAPE). Thermodynamics involve increases in water vapor that the warmer atmosphere can hold and convection can work with. Small-scale simulations are conducted to separate these two components for daytime development of unorganized convection over land. The simulations apply a novel modeling technique referred to as the piggybacking (or master–slave) approach and consider the global climate model (GCM)-predicted change of atmospheric temperature and moisture profiles in the Amazon region at the end of the century under a business-as-usual scenario. The simulations show that the dynamic impact dominates because changes in cloudiness and rainfall come from cloud dynamics considerations, such as the change in CAPE and convective inhibition (CIN) combined with the impact of environmental relative humidity (RH) on deep convection. The small RH reduction between the current and future climate significantly affects the mean surface rain accumulation as it changes from a small reduction to a small increase when the RH decrease is eliminated. The thermodynamic impact on cloudiness and precipitation is generally small, with the extreme rainfall intensifying much less than expected from an atmospheric moisture increase. These results are discussed in the context of previous studies concerning climate change–induced modifications of moist convection. Future research directions applying the piggybacking method are discussed.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Role of Equatorial Cold Tongue in Central Pacific Double-ITCZ Bias in the NCAR CESM1.2

Warm SST bias underlying the spurious southern ITCZ has long been recognized as one of the main causes for double-ITCZ bias in coupled GCMs in the central Pacific. This study demonstrates that the NCAR CESM1.2 can still simulate significant double-ITCZ bias even with cold SST bias in the southern ITCZ region, indicating that warm SST bias is not a necessary condition for double-ITCZ bias in the central Pacific. Further analyses suggest that the equatorial cold tongue (ECT) biases play important roles in the formation of double-ITCZ bias in the central Pacific. The severe cold SST biases in the ECT region in the central Pacific may enhance the SST gradient between the ECT and southern ITCZ region, strengthening the lower troposphere dynamical convergence and hence convection in the southern ITCZ region. The formation mechanism of excessive ECT bias is further investigated. It is shown that the cold SST biases in the ECT region can be largely attributed to the anomalous cooling tendency produced by the upper ocean zonal advection due to overly strong zonal currents. In the ECT region, the westward ocean surface zonal current is driven by the equatorial easterly surface winds. In this work, it is shown that convection bias simulated by the atmospheric model in the equatorial Amazon region may lead to easterly wind bias in the downwind side (west) of convection region. Finally, the mean Walker circulation transports these easterly wind momentum anomalies downward and westward to the surface, resulting in the overly strong surface easterly wind in the central equatorial Pacific.

54 ENVIRONMENTAL SCIENCES↗

Understanding the Roles of Convective Trigger Functions in the Diurnal Cycle of Precipitation in the NCAR CAM5

The wrong diurnal cycle of precipitation is a common weakness of current global climate models (GCMs). To improve the simulation of the diurnal cycle of precipitation and understand what physical processes control it, we test a convective trigger function described in Xie et al. (2019) with additional optimizations in the NCAR Community Atmosphere Model version 5 (CAM5). The revised trigger function consists of three modifications: 1) replacing the Convective Available Potential Energy (CAPE) trigger with a dynamic CAPE (dCAPE) trigger, 2) allowing convection to originate above the top of planetary boundary layer (i.e., the unrestricted air parcel launch level - ULL), and 3) optimizing the entrainment rate and threshold value of the dynamic CAPE generation rate for convection onset based on observations. Results from 1°-resolution simulations show that the revised trigger can alleviate the long-standing GCM problem of too early maximum precipitation during the day and missing the nocturnal precipitation peak that is observed in many regions, including the U.S. southern Great Plains (SGP). The revised trigger also improves the simulation of the propagation of precipitation systems downstream of the Rockies and the Amazon region. A further composite analysis over the SGP unravels the mechanisms through which the revised trigger affects convection. Additional sensitivity tests show that both the peak time and the amplitude of the diurnal cycle of precipitation are sensitive to the entrainment rate and dCAPE threshold values.

54 ENVIRONMENTAL SCIENCES↗

A hybrid computational strategy to address WGS variant analysis in >5000 samples

Abstract Background The decreasing costs of sequencing are driving the need for cost effective and real time variant calling of whole genome sequencing data. The scale of these projects are far beyond the capacity of typical computing resources available with most research labs. Other infrastructures like the cloud AWS environment and supercomputers also have limitations due to which large scale joint variant calling becomes infeasible, and infrastructure specific variant calling strategies either fail to scale up to large datasets or abandon joint calling strategies. Results We present a high throughput framework including multiple variant callers for single nucleotide variant (SNV) calling, which leverages hybrid computing infrastructure consisting of cloud AWS, supercomputers and local high performance computing infrastructures. We present a novel binning approach for large scale joint variant calling and imputation which can scale up to over 10,000 samples while producing SNV callsets with high sensitivity and specificity. As a proof of principle, we present results of analysis on Cohorts for Heart And Aging Research in Genomic Epidemiology (CHARGE) WGS freeze 3 dataset in which joint calling, imputation and phasing of over 5300 whole genome samples was produced in under 6 weeks using four state-of-the-art callers. The callers used were SNPTools, GATK-HaplotypeCaller, GATK-UnifiedGenotyper and GotCloud. We used Amazon AWS, a 4000-core in-house cluster at Baylor College of Medicine, IBM power PC Blue BioU at Rice and Rhea at Oak Ridge National Laboratory (ORNL) for the computation. AWS was used for joint calling of 180 TB of BAM files, and ORNL and Rice supercomputers were used for the imputation and phasing step. All other steps were carried out on the local compute cluster. The entire operation used 5.2 million core hours and only transferred a total of 6 TB of data across the platforms. Conclusions Even with increasing sizes of whole genome datasets, ensemble joint calling of SNVs for low coverage data can be accomplished in a scalable, cost effective and fast manner by using heterogeneous computing platforms without compromising on the quality of variants.

59 BASIC BIOLOGICAL SCIENCES↗

DECA: scalable XHMM exome copy-number variant calling with ADAM and Apache Spark

Abstract Background XHMM is a widely used tool for copy-number variant (CNV) discovery from whole exome sequencing data but can require hours to days to run for large cohorts. A more scalable implementation would reduce the need for specialized computational resources and enable increased exploration of the configuration parameter space to obtain the best possible results. Results DECA is a horizontally scalable implementation of the XHMM algorithm using the ADAM framework and Apache Spark that incorporates novel algorithmic optimizations to eliminate unneeded computation. DECA parallelizes XHMM on both multi-core shared memory computers and large shared-nothing Spark clusters. We performed CNV discovery from the read-depth matrix in 2535 exomes in 9.3 min on a 16-core workstation (35.3× speedup vs. XHMM), 12.7 min using 10 executor cores on a Spark cluster (18.8× speedup vs. XHMM), and 9.8 min using 32 executor cores on Amazon AWS’ Elastic MapReduce. We performed CNV discovery from the original BAM files in 292 min using 640 executor cores on a Spark cluster. Conclusions We describe DECA’s performance, our algorithmic and implementation enhancements to XHMM to obtain that performance, and our lessons learned porting a complex genome analysis application to ADAM and Spark. ADAM and Apache Spark are a performant and productive platform for implementing large-scale genome analyses, but efficiently utilizing large clusters can require algorithmic optimizations and careful attention to Spark’s configuration parameters.

Linderman, Michael D. (ORCID:0000000296437148)↗