Search NASA⌕ Search

SEARCH · Search NASA

Results for “Reproducibility”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,045 records · Page 58
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Monsoonal MCS Initiation, Rainfall, and Diurnal Gravity Waves over the Bay of Bengal: Observation and a Linear Model

Abstract Previous observational studies have indicated that mesoscale convective systems (MCSs) contribute the majority of precipitation over the Bay of Bengal (BoB) during the summer monsoon season, yet their initiation and propagation remain incompletely understood. To fill this knowledge gap, we conducted a comprehensive study using a combination of 20-yr satellite observations, MCS tracking, reanalysis data, and a theoretical linear model. Satellite observations reveal clear diurnal propagation signals of MCS initiation frequency and rainfall from the west coast of the BoB toward the central BoB, with the MCS rainfall propagating slightly slower than the MCS initiation frequency. Global reanalysis data indicate a strong association between the offshore-propagating MCS initiation frequency/rainfall and diurnal low-level wind perturbations, implying the potential role of gravity waves. To verify the hypothesis, we developed a 2D linear model that can be driven by realistic meteorological fields from reanalysis. The linear model realistically reproduces the characteristics of offshore-propagating diurnal wind perturbations. The wind perturbations, as well as the offshore propagation signals of MCS initiation frequency and rainfall, are associated with diurnal gravity waves emitted from the coastal regions, which in turn are caused by the diurnal land–sea thermal contrast. The ambient wind speed and vertical wind shear play crucial roles in modulating the timing, propagation, and amplitude of diurnal gravity waves. Using the linear model and satellite observations, we further show that the stronger monsoonal flows lead to faster offshore propagation of diurnal gravity waves, which subsequently control the offshore propagation signals of MCS initiation and rainfall. Significance Statement Rainfall over the Bay of Bengal (BoB) is primarily contributed by large and organized rainfall systems in the summer monsoon season. During this season, these systems are commonly observed over the east coast of India around midnight, the western BoB in the morning, and the central BoB in the afternoon. This eastward rainfall propagation is confirmed by observations, reanalysis data, and a theoretical model to have a strong association with atmospheric diurnal gravity waves. These waves are caused by land–sea thermal contrast and can trigger rainfall systems over the offshore regions. We also found that the diurnal gravity waves, as well as their triggered rainfall systems, can be greatly modulated by the large-scale monsoonal flows. All the above findings improve our understanding of diurnal rainfall cycle over the BoB and may contribute to the future improvement of rainfall forecast over the region.

Meteorology & Atmospheric Sciences↗
DOE OSTI2024

The Dual Nature of Entrainment-Mixing Signatures Revealed through Large-Eddy Simulations of a Convection-Cloud Chamber

Abstract Entrainment of subsaturated air into a cloud can influence its optical and microphysical properties in various ways, depending on the droplet evaporation and turbulent mixing time scales. Previous experiments in the Pi convection-cloud chamber have revealed that, given a fixed entrained air property, the mixing of entrained subsaturated air results in complete evaporation of some cloud droplets, with the rest remaining unchanged. This is a signature of inhomogeneous mixing. While comparing the results of entrainment with varying air properties, the mixing signature appears as if the subsaturated air is well mixed with the cloud to evenly reduce the droplets’ size. In other words, taken together, the experiments appear to have the signature of homogeneous mixing. To explore these results in a greater depth, we conduct large-eddy simulations combined with a bin microphysics scheme. Our results reproduce the similar signatures of inhomogeneous and homogeneous mixing, implying that LES can resolve the inhomogeneous mixing when the grid spacing is smaller than the entrained air parcel. Additionally, we observe that increasing the aerosol injection rate enhances the signature of inhomogeneous mixing, while coarser grid spacing diminishes it. Finally, the change in wall fluxes in response to various entrained air properties confirms that the homogeneous signature seen in the analysis of an ensemble of simulations is the result of various equilibrium states. This further strengthens the suggestion that the homogeneous mixing signature found in aircraft observations near the cloud top may result from combining entrainment events of different intensities, possibly caused by various-sized eddies. Significance Statement Large-eddy simulation and size-resolved microphysics can resolve time scales for turbulent mixing and evaporation and, therefore, are well suited for reproducing, extending, and interpreting the entrainment experiment in the Pi convection-cloud chamber. Our simulation results confirm (i) the inhomogeneous mixing signature for an individual entrainment event and (ii) the appearance of homogeneous mixing in an ensemble of entrainment episodes. Furthermore, we demonstrate that the inhomogeneous mixing signature is more pronounced in a polluted cloud, but coarser grid spacing in simulations may compromise the accuracy of this signature. Last, the homogeneous mixing signature results from various equilibrium states established for different entrainment intensities and adjusted wall fluxes, which are challenging to measure experimentally but can be easily analyzed in the simulations.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2017

A Conceptual Model for the Response of Tropical Rainfall to Orbital Variations

Tropical rainfall to first order responds to variations in Earth’s orbit through shifts of the intertropical convergence zone (ITCZ) and changes in zonally averaged rainfall intensity. Here, a conceptual model is developed that represents both processes and their response to orbital insolation variations. The model predicts the seasonal evolution of tropical rainfall between 30°S and 30°N. Insolation variations impact seasonal rainfall in two different ways: thermodynamically, leading to variations in rainfall intensity through modulation of the water vapor content of the atmosphere; and dynamically, leading to shifts of the ITCZ through modulation of the global atmospheric energy budget. Thermodynamic and dynamic effects act together to shape the annual-mean response of tropical rainfall to changes in Earth’s orbit. The model successfully reproduces changes in annual-mean rainfall inferred from paleo-proxies across several glacial–interglacial cycles. It illuminates how orbital precession and variations of Earth’s obliquity affect tropical rainfall in distinct ways near the equator and farther away from it, with spectral signatures of precession and obliquity variations that shift with latitude. It also provides explanations for the observed different phasings of rainfall minima and maxima near the equator and away from it. For example, the model reproduces a phase shift of ~10 ka between rainfall records from caves in northern Borneo (4°N) and from China (approximately 30°N). Finally, the model suggests that such phase shifts arise through a different weighting of ITCZ shifts and variations in rainfall intensity, thus providing insight into the mechanisms that drive tropical rainfall changes on orbital time scales.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2018

Human Contribution to the Increasing Summer Precipitation in Central Asia from 1961 to 2013

We report that the ecosystem and societal development over arid Central Asia, the core connecting region of the Silk Road Economic Belt, are highly sensitive to climate change. The results derived from multiobservational datasets show that summer precipitation over Central Asia has significantly increased by 20.78% from 1961 to 2013. It remains unclear whether anthropogenic forcing has contributed to the summer wetting trend or not. In this study, the corresponding physical processes and contributions of anthropogenic forcing are investigated by comparing reanalysis and experiments of the Community Atmosphere Model, version 5.1 (CAM5.1), from the CLIVAR Climate of the Twentieth Century Plus (C20C+) Project. The observed wetting trend is well reproduced in the simulation driven by all radiative forcings (CAM5-All), but poorly reproduced in the simulation with natural forcings only (CAM5-Nat), confirming the important role of human contribution in the observed wetting trend. Moisture budget analysis shows that the observed wetting trend is dominated by the increasing vertical moisture advection term and results from enhanced vertical motion over nearly all of Central Asia. The observed contributions of moisture budget components to the wetting trend are only captured by CAM5-All experiments. The dynamic contribution is determined by the warm advection anomalies in association with a human-induced meridional uneven warm pattern. Finally, human-induced warming increases the specific humidity over all of Central Asia, increasing (decreasing) the precipitation over the climatological ascent (descent) region in eastern (western) Central Asia.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

The impacts of horizontal resolution on the seasonally-dependent biases of the northeastern Pacific ITCZ in coupled climate models.

Double-ITCZ has puzzled climate model community for more than two decades. Here, we found that over the eastern Pacific, precipitation and sea surface temperature (SST) biases in the NCAR CESM1 are seasonally-dependent, with positive (negative) precipitation/SST biases during boreal summer/fall (winter/spring), although the easterly wind bias persists around the year. This seasonally-dependent bias of precipitation/SST is found to be caused by the failure of the model to reproduce the climatological seasonal wind reversal of North American monsoon. During winter/spring, the climatological easterly wind dominates, so the stronger wind speed in the model enhances the evaporation and lowers the SST. It is opposite when the climatological wind turns to westerly during summer/fall. The easterly wind bias also occurs in the atmospheric model when the observation SST is prescribed, suggesting it is of atmospheric origin. Further, the easterly wind bias is mainly evident in the lower troposphere and quite independent of time, implying the effect of complex and narrow-ranged Central American topography, which is not depicted well in the coarse model resolution. When the model resolution is doubled, both SST and precipitation are improved with the reduced easterly wind bias. During boreal spring, when ITCZ bias is most significant, the northern and southern ITCZ can be improved by 29% and 18.8% respectively in the higher resolution. Finally, we suggest that these seasonally-dependent biases over the eastern Pacific are quite universal among 37 CMIP5 coupled models, and the ongoing CMIP6 project will provide a valuable opportunity to examine whether the bias can be reduced by increasing model resolution.

Song, Fengfei↗
DOE OSTI2021

Are 100 Ensemble Members Enough to Capture the Remote Atmospheric Response to +2°C Arctic Sea Ice Loss?

This study presents results from the Polar Amplification Multimodel Intercomparison Project (PAMIP) single-year time-slice experiments that aim to isolate the atmospheric response to Arctic sea ice loss at global warming levels of +2°C. Using two general circulation models (GCMs), the ensemble size is increased up to 300 ensemble members, beyond the recommended 100 members. After partitioning the response in groups of 100 ensemble members, the reproducibility of the results is evaluated, with a focus on the response of the midlatitude jet streams in the North Atlantic and North Pacific. Both atmosphere-only and coupled ocean–atmosphere PAMIP experiments are analyzed. Substantial differences in the midlatitude response are found among the different experiment subsets, suggesting that 100-member ensembles are still significantly influenced by internal variability, which can mislead conclusions. Despite an overall stronger response, the coupled ocean–atmosphere runs exhibit greater spread due to additional ENSO-related internal variability when the ocean is interactive. The lack of consistency in the response is true for anomalies that are statistically significant according to Student’s t and false discovery rate tests. This is problematic for the multimodel assessment of the response, as some of the spread may be attributed to different model sensitivities whereas it is due to internal variability. Here, we propose a method to overcome this consistency issue that allows for more robust conclusions when only 100 ensemble members are used.

58 GEOSCIENCES↗
DOE OSTI2022

Intercomparison of Dynamically and Statistically Downscaled Climate Change Projections over the Midwest and Great Lakes Region

Downscaling of global climate model (GCMs) simulations is a key element of regional-to-local-scale climate change projections that can inform impact assessments, long-term planning, and resource management in different sectors. Here, we conduct an intercomparison between statistically and dynamically downscaled GCMs simulations using the hybrid delta (HD) and the Weather Research and Forecast (WRF) Model, respectively, over the Midwest and Great Lakes region to 1) validate their performance in reproducing extreme daily precipitation (P) and daily maximum temperature (T max ) for summer and winter and 2) evaluate projections of extremes in the future. Our results show the HD statistical downscaling approach, which includes large-scale bias correction of GCM inputs, can reproduce observed extreme P and T max reasonably well for both summer and winter. However, raw historical WRF simulations show significant bias in both extreme P and T max for both seasons. Interestingly, the convection-permitting WRF simulation at 4-km grid spacing does not produce better results for seasonal extremes than the WRF simulation at 12 km using a parameterized convection scheme. Despite a broad similarity for winter extreme P projections, the projected changes in the future summer storms are quite different between downscaling methods; WRF simulations show substantial increases in summer extreme precipitation, while the changes projected by the HD approach exhibit moderate decreases overall. The WRF simulations at 4 km also show a pronounced decoupling effect between seasonal totals and extreme daily P for summer, which suggests that there could be more intense summer extremes at two different time scales, with more severe individual convective storms combined with longer summer droughts at the end of the twenty-first century.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

The 1996 Mid-Atlantic Winter Flood: Exploring Climate Risk through a Storyline Approach

Abstract This article explores the application of thermodynamic perturbations to a historical midlatitude, wintertime, rain-on-snow flood event to evaluate how similar events may evolve under different climate forcings. In particular, we generate a hindcast of the 1996 Mid-Atlantic flood using an ensemble of 14-km variable-resolution simulations completed with the U.S. Department of Energy’s global Energy Exascale Earth System Model (E3SM). We show that the event is skillfully reproduced over the Susquehanna River Basin (SRB) by E3SM when benchmarked against in situ observational data and high-resolution reanalyses. In addition, we perform five counterfactual experiments to simulate the flood under preindustrial conditions and four different levels of warming as projected by the Community Earth System Model Large Ensemble. We find a nonlinear response in simulated surface runoff and streamflow as a function of atmospheric warming. This is attributed to changing contributions of liquid water input from a shallower initial snowpack (decreased snowmelt), increased surface temperatures and rainfall rates, and increased soil water storage. Flooding associated with this event peaks from around +1 to +2 K of global average surface warming and decreases with additional warming beyond this. There are noticeable timing shifts in peak runoff and streamflow associated with changes in the flashiness of the event. This work highlights the utility of using storyline approaches for communicating climate risk and demonstrates the potential nonlinearities associated with hydrologic extremes in areas that experience ephemeral snowpack, such as the SRB.

Meteorology & Atmospheric Sciences↗
DOE OSTI2019

Surface-Enhanced Raman Scattering (SERS) Studies of Disc-on-Pillar (DOP) Arrays: Contrasting Enhancement Factor with Analytical Performance

The use of nanomachining methods capable of reproducible construction of nano-arrayed devices have revolutionized the field of plasmonic sensing by the introduction of a diversity of rationally engineered designs. Significant strides have been made to fabricate plasmonic platforms with tailored interparticle gaps to improve their performance for surface-enhanced Raman scattering (SERS) applications. Over time, a dichotomy has emerged in the implementation of SERS for analytical applications, the construction of substrates, optimization of interparticle spacing as a means to optimize electromagnetic field enhancement at the localized surface plasmon level, and the substrate sensitivity over extended areas to achieve quantitative performance. Here, we assessed the enhancement factor of plasmonic Ag/SiO 2 /Si disc-on-pillar (DOP) arrays of variable pitch with its analytical performance for quantitative applications. Experimental data were compared with those from finite-difference time-domain (FDTD) simulations used in the optimization of the array dimensions. A self-assembled monolayer (SAM) of benzenethiol rendered highly reproducible signals (RSD ~4–10%) and SERS substrate enhancement factor (SSEF) values in the orders of 10 6 –10 8 for all pitches. Furthermore, spectra corresponding to rhodamine 6G (R6G) and 4-aminobenzoic acid demonstrated the advantages of using the more densely packed DOP arrays with a 160 nm pitch (gap= 40 nm) for quantitation in spite of the strongest SSEF was attained for a pitch of 520 nm corresponding to a 400 nm gap.

36 MATERIALS SCIENCE↗
DOE OSTI2026

When does global attention help: a unified empirical study on atomistic graph learning

Graph neural networks (GNNs) are widely used as surrogates for costly experiments and first-principles simulations to study the behavior of compounds at atomistic scale, and their architectural complexity is constantly increasing to enable the modeling of complex physics. While most recent GNNs combine more traditional message passing neural networks (MPNNs) layers to model short-range interactions with more advanced graph transformers (GTs) with global attention mechanisms to model long-range interactions, it is still unclear when global attention mechanisms provide real benefits over well-tuned MPNN layers due to inconsistent implementations, features, or hyperparameter tuning. We introduce the first unified, reproducible benchmarking framework–built on HydraGNN–that enables seamless switching among four controlled model classes: MPNN, MPNN with chemistry/topology encoders, GPS-style hybrids of MPNN with global attention, and fully fused localglobal models with encoders. Using seven diverse open-source datasets for benchmarking across regression and classification tasks, we systematically isolate the contributions of message passing, global attention, and encoder-based feature augmentation. Our study shows that encoder-augmented MPNNs form a robust baseline, while fused localglobal models yield the clearest benefits for properties governed by long-range interaction effects. We further quantify the accuracycompute trade-offs of attention, reporting its overhead in memory. Together, these results establish the first controlled evaluation of global attention in atomistic graph learning and provide a reproducible testbed for future model development.

Equivariant graph neural networks↗
DOE OSTI2022

HT-SIP: a semi-automated stable isotope probing pipeline identifies cross-kingdom interactions in the hyphosphere of arbuscular mycorrhizal fungi

Abstract Background Linking the identity of wild microbes with their ecophysiological traits and environmental functions is a key ambition for microbial ecologists. Of many techniques that strive for this goal, Stable-isotope probing—SIP—remains among the most comprehensive for studying whole microbial communities in situ. In DNA-SIP, actively growing microorganisms that take up an isotopically heavy substrate build heavier DNA, which can be partitioned by density into multiple fractions and sequenced. However, SIP is relatively low throughput and requires significant hands-on labor. We designed and tested a semi-automated, high-throughput SIP (HT-SIP) pipeline to support well-replicated, temporally resolved amplicon and metagenomics experiments. We applied this pipeline to a soil microhabitat with significant ecological importance—the hyphosphere zone surrounding arbuscular mycorrhizal fungal (AMF) hyphae. AMF form symbiotic relationships with most plant species and play key roles in terrestrial nutrient and carbon cycling. Results Our HT-SIP pipeline for fractionation, cleanup, and nucleic acid quantification of density gradients requires one-sixth of the hands-on labor compared to manual SIP and allows 16 samples to be processed simultaneously. Automated density fractionation increased the reproducibility of SIP gradients compared to manual fractionation, and we show adding a non-ionic detergent to the gradient buffer improved SIP DNA recovery. We applied HT-SIP to 13 C-AMF hyphosphere DNA from a 13 CO 2 plant labeling study and created metagenome-assembled genomes (MAGs) using high-resolution SIP metagenomics (14 metagenomes per gradient). SIP confirmed the AMF Rhizophagus intraradices and associated MAGs were highly enriched (10–33 atom% 13 C), even though the soils’ overall enrichment was low (1.8 atom% 13 C). We assembled 212 13 C-hyphosphere MAGs; the hyphosphere taxa that assimilated the most AMF-derived 13 C were from the phyla Myxococcota, Fibrobacterota, Verrucomicrobiota, and the ammonia-oxidizing archaeon genus Nitrososphaera . Conclusions Our semi-automated HT-SIP approach decreases operator time and improves reproducibility by targeting the most labor-intensive steps of SIP—fraction collection and cleanup. We illustrate this approach in a unique and understudied soil microhabitat—generating MAGs of actively growing microbes living in the AMF hyphosphere (without plant roots). The MAGs’ phylogenetic composition and gene content suggest predation, decomposition, and ammonia oxidation may be key processes in hyphosphere nutrient cycling.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2026

The need for standardization and improved open (meta)data practices in metaproteomics

Metaproteomics enables functional insight into microbial communities by identifying and quantifying proteins in complex samples. Yet, heterogeneous analytical workflows and the lack of standardization across experimental and bioinformatics stages hinder reproducibility and comparability, limiting integration with other omics data. We here present a community-developed reporting checklist tailored to the specific needs of metaproteomics. We also outline current efforts to enable structured and interoperable metadata capture, drawing on standards from proteomics and microbiome research wherever possible. By promoting transparent reporting and advancing metadata practices, our recommendations aim to align metaproteomics more closely with FAIR principles and support reproducible and interoperable research practices.

Armengaud, Jean [Universite Paris-Saclay, France]↗
DOE OSTI2024

ExaCA grain structure predictions for laser powder bed fusion processing

This dataset contains simulated cross-sections of laser powder bed fusion grain structures produced using the microstructure model ExaCA, in turn using time-temperature history data produced using the heat transport model AdditiveFOAM. These predictions show the grain structure using various permutations of hatch spacing and nucleation density. Also contained in the dataset are the input files necessary to reproduce the results. AdditiveFOAM (https://github.com/ORNL/AdditiveFOAM) and ExaCA (https://github.com/LLNL/ExaCA), both open source software, are required to reproduce the results in this dataset using the given input files. This DOI was updated 12/09/2025.

36 MATERIALS SCIENCE↗
DOE OSTI2025

SCALE Non-LWR Models for NRC Volume 3

This dataset contains input and result files of computational simulations with the SCALE code system. The simulations cover radionuclide inventory and reactivity analyses of various advanced reactors. Users wanting to reproduce results from this dataset are required to obtain a license to the SCALE code system for which details on the distribution can be found here: https://www.ornl.gov/scale/releases

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2025

SCALE Non-LWR Models for NRC Volume 5

This dataset contains input and result files of computational simulations with the SCALE code system. The simulations cover radionuclide inventory generation, criticality calculations, and dose rate/shielding analyses of various advanced reactors. Users wanting to reproduce results from this dataset are required to obtain a license to the SCALE code system for which details on the distribution can be found here: https://www.ornl.gov/scale/releases

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2026

SCALE HTR-PROTEUS Benchmark Model

This dataset contains input and result files of computational simulations of HTR-PROTEUS benchmark with the latest version of SCALE code system. The simulations cover criticality control rod worth calculations as well as sensitivity analysis and uncertainty quantification. Users wanting to reproduce results from this dataset are required to obtain a license to the SCALE code system for which details on the distribution can be found here: https://www.ornl.gov/scale/releases

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2025

Impact of increased smoothing by spectral dispersion bandwidth on stimulated Brillouin scattering in laser driven Hohlraums

Experiments were conducted at the National Ignition Facility (NIF) to investigate the impact of increased smoothing by spectral dispersion (SSD) bandwidth on the production of stimulated Brillouin scattering (SBS) within an indirect-drive inertial confinement fusion (ICF) Hohlraum. This was done in a subscale gold Hohlraum driven by 192 laser beams depositing 1.1 MJ of energy. The laser bandwidth was increased from 45 to 118 GHz (before frequency tripling) on the 30° and 50° cones, where backscatter could be measured using the Full Aperture Backscatter Station (FABS). It was expected that this 2.6-fold increase in bandwidth would suppress SBS generated within the Hohlraum plasma and lower the backscattered SBS energy on the 50° cones by over a factor of four. Experimental results, however, show that this SSD change only reduced the 50° cone SBS during the main capsule drive by -18±31% and -4.5±7.8% over the entire pulse. This is small compared to expected shot-to-shot SBS reproducibility (∼30%), such that the result can be considered within normal performance fluctuations. New 3D parallel paraxial code (pF3D) simulations, accounting for beam refractive intensification reproduce this result, suggesting that closer to 300 GHz of bandwidth would have been required to mitigate SBS to the expected level. Delivering such a high bandwidth is not feasible at NIF when operating at high peak power and would potentially prevent NIF’s ability to use cross-beam energy transfer (CBET) for implosion symmetry tuning.

Physics↗
DOE OSTI2026

A standardized workflow for kinetic metabolic model curation and dissemination

Kinetic metabolic models provide invaluable insights into cellular metabolism, supporting applications in synthetic biology, metabolic engineering, and systems biology. However, reproducibility and utility of these models hinge on clear and rigorous documentation, standardized annotation, and accessible visualization. This paper presents a workflow for building, annotating, visualizing, and sharing kinetic metabolic models. Our method integrates community standards and open-source tools to ensure reproducibility, interoperability, and user accessibility. This procedure enables researchers to produce reusable and well-documented kinetic models, advancing their role as powerful tools in metabolic research.

Cook, Margaret [Univ. of Washington, Seattle, WA (↗