Search NASA⌕ Search

SEARCH · Search NASA

Results for “Reproducibility”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 451 records · Page 25
All sourcesNASA NTRSDOE OSTI
DOE OSTI2026

Galaxy Size and Rotation Curve Diversity in ΛCDM with Baryons

The observed rotation curves of dwarf galaxies exhibit significant diversity at fixed halo mass, challenging galaxy formation within the cold dark matter (CDM) model. Previous cosmological galaxy formation simulations with baryonic physics fail to reproduce the full diversity of rotation curves, suggesting that there is a flaw in baryonic feedback models, observational bias, or that an alternative to CDM must be invoked. In this work, we use the Marvelous Massive Dwarf zoom-in simulations, a suite of high-resolution dwarf simulations with M 200 ∼ 10 10 –10 11 M ⊙ and M * ∼ 10 7 –10 9 M ⊙ , designed to target the mass range where the galaxy rotation curve diversity is maximized, i.e., between and 100 km s −1 . We add to this a set of low-mass galaxies from the Marvel Dwarf Zoom Volumes to extend the galaxy mass range to lower values. Our fiducial star formation and feedback models produce simulated dwarfs with a broader range of rotation curve shapes, similar to observations. These simulations both create dark matter cores via baryonic feedback, reproducing the slower-rising rotation curves, while also allowing for compact galaxies and steeply rising rotation curves. Our simulated dwarfs also reproduce the observed size–M * relation, including scatter, producing both extended and compact dwarfs for the first time in simulated field dwarfs. However, the slowly rising and high baryon mass fraction, as well as the steeply rising and low baryon mass fraction, remain missing. We explore star formation and feedback models and conclude that previous simulations may have had feedback that was too strong to produce compact dwarfs.

Cruz, Akaxia [Flatiron Institute, New York, NY (Un↗
DOE OSTI2022

Interpreting machine learning prediction of fire emissions and comparison with FireMIP process-based models

Annual burned areas in the United States have increased 2-fold during the past decades. With more large fires resulting in more emissions of fine particulate matter, an accurate prediction of fire emissions is critical for quantifying the impacts of fires on air quality, human health, and climate. This study aims to construct a machine learning (ML) model with game-theory interpretation to predict monthly fire emissions over the contiguous US (CONUS) and to understand the controlling factors of fire emissions. The optimized ML model is used to diagnose the process-based models in the Fire Modeling Intercomparison Project (FireMIP) to inform future development. Results show promising performance for the ML model, Community Land Model (CLM), and Joint UK Land Environment Simulator-Interactive Fire And Emission Algorithm For Natural Environments (JULES-INFERNO) in reproducing the spatial distributions, seasonality, and interannual variability of fire emissions over the CONUS. Regional analysis shows that only the ML model and CLM simulate the realistic interannual variability of fire emissions for most of the subregions (r >0.95 for ML and r =0.14~0.70 for CLM), except for Mediterranean California, where all the models perform poorly (r =0.74 for ML and r <0.30 for the FireMIP models). Regarding seasonality, most models capture the peak emission in July over the western US. However, all models except for the ML model fail to reproduce the bimodal peaks in July and October over Mediterranean California, which may be explained by the smaller wind speeds of the atmospheric forcing data during Santa Ana wind events and limitations in model parameterizations for capturing the effects of Santa Ana winds on fire activity. Furthermore, most models struggle to capture the spring peak in emissions in the southeastern US, probably due to underrepresentation of human effects and the influences of winter dryness on fires in the models. As for extreme events, both the ML model and CLM successfully reproduce the frequency map of extreme emission occurrence but overestimate the number of months with extremely large fire emissions. Comparing the fire PM 2.5 emissions from the ML model with process-based fire models highlights their strengths and uncertainties for regional analysis and prediction and provides useful insights into future directions for model improvements.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

rSHUD v2.0: advancing the Simulator for Hydrologic Unstructured Domains and unstructured hydrological modeling in the R environment

Abstract. Hydrological modeling is a crucial component in hydrology research, particularly for projecting future scenarios. However, achieving reproducibility and automation in distributed hydrological modeling research for modeling, simulation, and analysis is challenging. This paper introduces rSHUD v2.0, an innovative, open-source toolkit developed in the R environment to enhance the deployment and analysis of the Simulator for Hydrologic Unstructured Domains (SHUD). The SHUD is an integrated surface–subsurface hydrological model that employs a finite-volume method to simulate hydrological processes at various scales. The rSHUD toolkit includes pre- and post-processing tools, facilitating reproducibility and automation in hydrological modeling. The utility of rSHUD is demonstrated through case studies of the Shale Hills Critical Zone Observatory in the USA and the Waerma watershed in China. The rSHUD toolkit's ability to quickly and automatically deploy models while ensuring reproducibility has facilitated the implementation of the Global Hydrological Data Cloud (https://ghdc.ac.cn, last access: 1 September 2023), a platform for automatic data processing and model deployment. This work represents a significant advancement in hydrological modeling, with implications for future scenario projections and spatial analysis.

Shu, Lele (ORCID:0000000269034466)↗
DOE OSTI2025

Evaluating an Earth system model from a water manager perspective

Abstract. The large spatial scale of global Earth system models (ESMs) is often cited as an obstacle to using the output by water resource managers in localized decisions. Recent advances in computing have improved the fidelity of hydrological responses in ESMs through increased connectivity between model components. However, the models are seldom evaluated for their ability to reproduce metrics that are important for and resonate with practitioners or that allow practitioners to situate higher-resolution model outputs within a cascade of uncertainty stemming from different models and scenarios. We draw on the combined experience of the author team and water manager workshop participants to identify salient water management metrics and evaluate whether they are credibly reproduced over the conterminous USA by the Community Earth System Model v2 (CESM2) Large Ensemble. We find that, while the exact values may not match the observations, aspects such as interannual variability can be reproduced by CESM2 for the mean wet day precipitation and length of dry spells. CESM2 also captures the proportion of total annual precipitation that derives from the heaviest rain days in watersheds that are not snow-dominated. Aggregating the 7 d mean daily runoff to two-digit Hydrological Unit Code (HUC2) watersheds also shows that rain-dominated regions capture the timing and interannual variability of annual maximum and minimum flows. We conclude that there is potential for far greater use of large-ensemble ESMs, such as CESM2, in long-range water management decisions to supplement high-resolution regional projections.

Tye, Mari R. (ORCID:0000000324911020)↗
DOE OSTI2021

Evaluation of idealized large-eddy simulations performed with the Weather Research and Forecasting model using turbulence measurements from a 250 m meteorological mast

Abstract. We investigate the ability of the Weather Research and Forecasting model to perform large-eddy simulation of canonical flows. This is achieved through comparison of the simulation outputs with measurements from sonic anemometers on a 250 m meteorological mast located at Østerild, in northern Denmark. Østerild is on a flat and rough area, and for the predominant wind directions, the atmospheric flow can be considered to be close to homogeneous. The idealized simulated flows aim at representing atmospheric boundary layer turbulence under unstable, neutral, and stable stability conditions at the surface, which are statistically significant conditions observed at Østerild. We found that the resolved fields from the simulations appear to have the characteristics of the three stability regimes. Vertical profiles of observed mean wind speeds and direction are well reproduced by the simulations, with the largest differences under near-neutral conditions, where the effect of the subgrid-scale model is evident on the vertical wind shear close to the surface. Vertical profiles of observed eddy fluxes are also well reproduced by the simulations, with the largest differences for the three velocity component variances under stable stability conditions, although nearly always within the observed variability. With regards to turbulent kinetic energy, we find good agreement between observations and simulations at all vertical levels. Simulated and observed velocity spectra match very well and show very similar behavior with height and with atmospheric stability within the low-frequency interval; at the effective resolution, the simulated spectra show the typical drop-off of finite differences. Our findings demonstrate that these idealized simulations reproduce the characteristics of atmospheric stability regimes often observed at a high turbulent and flat site within a direction sector, where the air flows over nearly homogeneous land.

17 WIND ENERGY↗
DOE OSTI2021

[Re] Drivers of evapotranspiration from boreal wildfires

Computational reproducibility is a difficult challenge across science. I attempted to use R 3.6.1 to reproduce linear model fits, done originally using v2.6.0 for a 2009 paper on the drivers of large-scale forest evapotranspiration after wildfire. Model outputs were largely identical, aside from minor formatting changes, except for one–out of 12 total– regression in which the median residual value changed very slightly (in the sixth decimal place). I suggest that this essentially successful reproducibility is due to the relative simplicity of the script, its use of only base R functions, and R’s historically conservative approach to breaking changes.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Data for Grogan et al. "Bringing Hydrologic Realism to Water Markets"

This data set provides model output and post-processing files required to reproduce the results, tables, and figures in the paper "Bringing Hydrologic Realism to Water Markets" by Grogan et al. (in review). Other input data used in this study includes: Lisk, M., Grogan, D., Zuidema, S., Caccese, R., Peklak, D., Zheng, J., Fisher-Vanden, K., Lammers, R., Olmstead, S., & Fowler, L. (2023). Harmonized Database of Western U.S. Water Rights (HarDWR) (Version v1) [Data set]. MSD-LIVE Data Repository. https://doi.org/10.57931/2205619 Two models were used in this study: (1) The University of New Hampshire Water Balance Model WBM, and (2) a Water Market Model. Market model code and model output post-processing code that make use of these data can be found here Model output files are: 1. WBM output files: scenario[x]_wbm_output.zip Where [x] is one of 1, 2, 2a, 3, and 3a Each zipped directory contains 7 gridded NetCDF files, each reporting the 10-year annual average value of a given variable, in units of average mm/day: File Name: wbm_indUseGross_yc.nc; Description: Water withdrawals by industry (part of the urban sector) File Name: wbm_domUseGross_yc.nc; Description: Water withdrawals by the domestic sector (part of the urban sector) File Name: wbm_irrigationGross_yc.nc; Description: Water withdrawals for agriculture File Name: wbm_irrigationExtra_yc.nc; Description: Water withdrawals from unsustainable groundwater for agriculture File Name: wbm_indUseEvap_yc.nc; Description: Consumptive water use by industry File Name: wbm_domUseEvap_yc.nc; Description: Consumptive water use by the domestic sector File Name: wbm_irrigationNet_yc.nc; Description: Consumptive water use by agriculture The file full_cell_area.nc gives the area of each grid cell in km2, which is used for converting water depth to water volume. 2. Water market model output & post processing output Folder: marketTrdSummaries/ Description: Files in this folder are used as input to code 1_WelfareCalculation_actual_trades.R. They summarize historical water right trade transactions in each state. File Name: welfare_gain_by_state_sector.csv; Description: Welfare gains by state and sector, as shown in Figure 3F. Used in code Figure3.R and produced (as a .xlsx file) by code 2_DemandCurves_simulated_trades.R File Name: welfare_data_actual.rdata; Description: welfare gains by WMA from actual historical trades, as shown in Figure 3A. This data is the output of code 1_WelfareCalculation_actual_trades.R File Name: welfare_summary_simulated.xlsx; Description: Welfare gains by state as simulated by the market model in Scenario 1. Produced by code 2_DemandCurves_simulated_trades.R, and used in code 4_WelfareCalculation.R. File Name: welfare_summary_cutoffs.xlsx; Description: Welfare gains by state as simulated by the market model in Scenario 2. Produced by code 3_DemandCurves_simulated_trades_cutoffs.R, and used in code 4_WelfareCalculation.R. File Name: welfare_summary_cutoffs_SGMS.xlsx; Description: Welfare gains by state as simulated by the market model in Scenario 2a. Produced by code 3_DemandCurves_simulated_trades_cutoffs.R, and used in code 4_WelfareCalculation.R. File Name: welfare_data_actual.rdata; Description: Spatial data, actual historical welfare gains by WMA as shown in Figure 3A. Produced by code 4_WelfareCalculation.R and used by code Figure3.R. File Name: welfare_data_simulated.rdata; Description: Spatial data, simulated Scenario 1 welfare gains by WMA as shown in Figure 3B. Produced by code 4_WelfareCalculation.R and used by code Figure3.R. File Name: welfare_data_simulated_cutoffs.rdata; Description: Spatial data, simulated Scenario 2 welfare gains by WMA. Produced by code 4_WelfareCalculation.R and used by code Figure3.R. File Name: welfare_data_simulated_cutoffs_SGMA.rdata; Description: Spatial data, simulated Scenario 2a welfare gains by WMA. Produced by code 4_WelfareCalculation.R and used by code Figure3.R. Additional files are provided for efficient reproduction of tables and figures. These include: File Name: wma_thresold_dates_Scenario2(a).csv; Description: Wet vs. paper right threshold dates for each WMA. Shown in Figure 2A,B. Produced and used by code calculate_thresolds_Figure2.R File Name: WWRTradeBounds (directory); Description: Trade boundary shapefile required to reproduce Figure 3A-D. Used in code Figure3.R File Name: welfare_region_totals.csv; Description: Welfare gains for the entire study region, as shown in Figure 3E. Used in code Figure3.R File Name: Welfare_gain_by_state_sector.csv; Description: Welfare gains by state and sector, as shown in Figure 3F. Used in code Figure3.R and produced (as a .xlsx file) by code 2_DemandCurves_simulated_trades.R File Name: WECC_MERIT_5min_v3b_mask.nc; Description: Gridded file that identified which land grid cells are in the WBM model domain, used for processing in code Figure4.py File Name: Table_1.csv; Description: All data in Table 1, reproducible from WBM output files using code table_1.R

Economics↗
NASA NTRS1972

Selection and use of TLDS for high precision NERVA shielding measurements

An experimental evaluation of thermoluminescent dosimeters was performed in order to select high precision dosimeters for a study whose purpose is to measure gamma streaming through the coolant passages of a simulated flight type internal NERVA reactor shield. Based on this study, the CaF2 chip TLDs are the most reproducible dosimeters with reproducibility generally within a few percent, but none of the TLDs tested met the reproducibility criterion of plus or minus 2%.

Woodsum, H. C.↗
NASA NTRS1972

A computer assisted teleoperator control station with tactile feedback

A computer-assisted teleoperator control system for making comparative performance evaluations is described. A local and a remote control station, each with decision-making capability, communicate with each other through a simulated time delay. Supervisory control at three increasingly automatic levels is possible. The highest level of programmed control is facilitated through the ARM language which was developed to permit easily readable program manuscripts to be written and assembled into programs of motions by novice programmers. Experimental results show the advantage of this form of supervisory control with both direct and delayed (3 sec) manipulation tasks. In addition, two systems to measure and reproduce force distributions have been designed. One system reproduces contact on the external surfaces of the remote hand using 21 airjet simulators. Another system reproduces the shape of the contact between object and jaws using 288 piezoelectric (bimorph) stimulators.

Hill, J. W.↗
NASA NTRS1973

Investigation of chemical vapor deposition of garnet films for bubble domain memories

The important process parameters and control required to grow reproducible device quality ferrimagnetic films by chemical vapor deposition (CVD) were studied. The investigation of the critical parameters in the CVD growth process led to the conclusion that the required reproducibility of film properties cannot be achieved with individually controlled separate metal halide sources. Therefore, the CVD growth effort was directed toward replacement of the halide sources with metallic sources with the ultimate goal being the reproducible growth of complex garnet compositions utilizing a single metal alloy source. The characterization of the YGdGaIG films showed that certain characteristics of this material, primarily the low domain wall energy and the large temperature sensitivity, severely limited its potential as a useful material for bubble domain devices. Consequently, at the time of the change from halide to metallic sources, the target film compositions were shifted to more useful materials such as YGdTmGaIG, YEuGaIG and YSmGaIG.

Besser, P. J.↗
NASA NTRS1976

Super high compression of line drawing data

Models which can be used to accurately represent the type of line drawings which occur in teleconferencing and transmission for remote classrooms and which permit considerable data compression were described. The objective was to encode these pictures in binary sequences of shortest length but such that the pictures can be reconstructed without loss of important structure. It was shown that exploitation of reasonably simple structure permits compressions in the range of 30-100 to 1. When dealing with highly stylized material such as electronic or logic circuit schematics, it is unnecessary to reproduce configurations exactly. Rather, the symbols and configurations must be understood and be reproduced, but one can use fixed font symbols for resistors, diodes, capacitors, etc. Compression of pictures of natural phenomena such as can be realized by taking a similar approach, or essentially zero error reproducibility can be achieved but at a lower level of compression.

Cooper, D. B.↗
NASA NTRS1977

Field-aligned currents and ionospheric electric fields

It is shown that the observed distribution of the ionospheric electric field can be deduced from an equation combining Ohm's law with the current continuity equation by using the 'observed' distribution of field-aligned currents as the boundary condition for two models of the ionosphere. The first model has one conductive annular ring representing the quiet-time auroral precipitation belt; the second has two conductive annular rings that simulate the discrete and diffuse auroral regions. An analysis is performed to determine how well the electric-field distribution can be reproduced. The results indicate that the first model reproduces the Sq(p)-type distribution, the second model reproduces reasonably well a substorm-type potential and ionospheric current patterns together with the Harang discontinuity, and that the distribution of field-aligned currents is the same for both models.

Yasuhara, F.↗
NASA NTRS1979

A comparison of limited-area energetic processes between observations and primitive equation model predictions

Energetic analyses of the NMC initial conditions and NMC six-layer primitive equation operational prediction model 12-hr forecast for a developing cyclone are presented. Consideration is given to the total kinetic energy, the energetics of the divergent and nondivergent flows and the baroclinic (vertical shear flow) and barotropic (vertical mean flow) components of the kinetic energy. It is found that the model initial conditions lose 10-15% of the kinetic energy at various levels compared to a limited-area multivariate statistical analysis of the observational data, leading to a decrease in the horizontal kinetic energy flux, a misrepresentation of the synoptic scale wave system in the 12-hr forecast. Similar results are obtained for the nondivergent flow, while the divergent flow energetics are not reproduced accurately by the model. The horizontal flux terms of the vertical mean and vertical shear energetics are also not found to be reproduced in the upper levels, although horizontal flux contributions to the baroclinic component are improved at middle and lower levels. Finally, vertical shear kinetic energy generation is found to be well represented in the model prediction, however kinetic energy conversion between vertical shear and mean flow is not reproduced in the lower layer.

Alpert, J. C.↗
NASA NTRS1982

Plasma-sprayed self-lubricating coatings

One of the most important criterion for acceptable commercial application of a multiple phase composition is uniformity and reproducibility. This means that the performance characteristics of the coat - e.g., its lubricating properties, bond strength to the substrate, and thermal properties - can be readily predicted to give a desired performance. The improvement of uniformity and reproducibility of the coats, the oxidation behavior at three temperature ranges, the effect of bond coat and the effect of preheat treatment as measured by adhesive strength tests, coating examination procedures, and physical property measurements were studied. The following modifications improved the uniformity and reproducibility: (1) changes and closer control in the particle size range of the raw materials used, (2) increasing the binder content from 3.2% to 4.1% (dried weight), and (3) analytical processing procedures using step by step checking to assure consistency.

Nakamura, H. H.↗
NASA NTRS1986

Shifts in shuttle SRM performance because of ammonium perchlorate crystal shape on missions 51-I/J and 61-A/B

The design of the Space Shuttle vehicle configuration requires that the SRMs produce thrust within tightly-controlled limits. These limits provide assurance that Shuttle ascent performance goals will be achieved within the vehicle flight load constraints. The SRM's will perform within these limits if overall SRM reproducibility is maintained. This report will initially describe the excellent performance reproducibility of the 24 SRMs during the first 12 flights STS-8 through STS-26 (Mission 51-F) using the HPM SRM. Secondly, this report will describe the transient phenomena which interrupted the reproducibility in the first 20 sec of flight for four flights (Missions 51-I/J and 61-A/B). The cause of this 20 sec phenomena is postulated to be a change in the crystal shape of the ammonium perchlorate used in the propellant. This shape change coincided with the performance shift on these four flights. The ballistic effect of the crystal shape change is manifested as a change to the generic HUMP or BARF curve of the Shuttle SRM thrust/pressure-time curve. As the crystal shape change was corrected by the vendor, the performance produced by the Shuttle SRM returned to normal.

Blackwell, D. L.↗
NASA NTRS1988

Radiosonde intercomparison

The largest amount of material ever collected from a radiosonde comparison was examined. Radiosondes from Australia, Finland, India, and the United States were involved. Data were received from 100 soundings, each of which was a simultaneous in situ test of four different instrument types. The simultaneous temperature comparison of participating operational radiosondes in daylight was about 1 C at the 100 hPa level and about 4 C at the 10 hPa level, while the corresponding comparison for geopotential was about 40 meters at 100 hPa and 100 meters at 10 hPa. Estimates of the reproducibility of standard level temperatures are given. The reproducibility obtained from the in situ comparisons is, in general, slightly better than corresponding results from monitoring measurements in a real-time mode at analysis centers. Conclusions from the intercomparison are many; the following call for particular attention: (1) fully automated radiosonde systems were able to reproduce geopotential measurements better than non-automated systems, mainly due to a decrease in observer mistakes; (2) observed temperature differences between radiosonde measurements were as large during the night as during the day; and (3) significant inconsistencies still exist between the night time and day time measurements, as well as significant bias errors in the pressure measurements of some radiosonde types.

Schmidlin, F. J.↗
NASA NTRS1989

Results of rocket measurements of D-region ionization over Thumba in MAP

Under MAP, two rockets were launched from Thumba (8.5 N, 76.8 E) around 1030 hrs Lt with identical payloads on 7 and 10 March 1986 for D region studies. Positive ion densities were measured by spherical probe and Gerdien condenser and electron densities were measured by Langmuir probe and propagation experiments. In both flights a valley in ionization height profile was noticed around 83 km. The density of ionization at this altitude was about 4 x 10(2) cu cm. A detailed positive ion-chemical scheme was used to reproduce the measured ionization height profiles. The density of NO needed to reproduce the valley in ionization at 83 km came around 5 x 10(5) cu cm. A photochemical treatment without diffusion process was found inadequate to explain this value of NO. Calculations showed that the value of vertical eddy diffusion needed to reproduce the value of NO was around 10(6)sq cm/s. Interestingly, the same value of eddy diffusion coefficient was obtained when derived in the manner described by Thrane and his coworkers using only the positive ion current data of spherical probes.

Chakrabarty, D. K.↗
NASA NTRS1989

Calculation of nonequilibrium hydrogen-air reactions with implicit flux vector splitting method

Two methods, fully- and loosely-coupled, are developed to incorporate nonequilibrium hydrogen-air chemistry into the fluid dynamic implicit flux vector splitting code (F3D). The new code (F3D/Chem) is validated against other existing codes for two cases: nozzle expansion, and shock-induced combustion around a blunt body. The shock-induced combustion case is compared also with an experimental data. The reaction rate constants are varied in an effort to reproduce the experimental data. The fully- and loosely-coupled methods are found to yield comparable results, but the computation time is shorter using the loosely-coupled method. The present method is found to reproduce results obtained using different existing codes. The experimental data was not reproduced with any selected rate coefficients set.

Lee, Seung-Ho↗