SEARCH · Search NASA

Results for “Reproducibility of Results”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

All sources NASA NTRS DOE OSTI

NASA NTRS2016

The Impacts of Dry Dynamic Cores on Asymmetric Hurricane Intensification

The fundamental pathways for tropical cyclone (TC) intensification are explored by considering axisymmetric and asymmetric impulsive thermal perturbations to balanced, TC-like vortices using the dynamic cores of three different nonlinear numerical models. Attempts at reproducing the results of previous work, which used the community WRF Model, revealed a discrepancy with the impacts of purely asymmetric thermal forcing. The current study finds that thermal asymmetries can have an important, largely positive role on the vortex intensification, whereas other studies find that asymmetric impacts are negligible. Analysis of the spectral energetics of each numerical model indicates that the vortex response to asymmetric thermal perturbations is significantly damped in WRF relative to the other models. Spectral kinetic energy budgets show that this anomalous damping is primarily due to the increased removal of kinetic energy from the vertical divergence of the vertical pressure flux, which is related to the flux of inertia-gravity wave energy. The increased kinetic energy in the other two models is shown to originate around the scales of the heating and propagate upscale with time from nonlinear effects. For very large thermal amplitudes (50 K), the anomalous removal of kinetic energy due to inertia-gravity wave activity is much smaller, resulting in good agreement between models. The results of this paper indicate that the numerical treatment of small-scale processes that project strongly onto inertia-gravity wave energy can lead to significant differences in asymmetric TC intensification. Sensitivity tests with different time integration schemes suggest that diffusion entering into the implicit solution procedure is partly responsible for the anomalous damping of energy.

Guimond, Stephen R.↗

NASA NTRS2019

Benchmarking CME Arrival Time and Impact: Progress on Metadata, Metrics, and Events

Accurate forecasting of the arrival time and subsequent geomagnetic impacts of coronal mass ejections (CMEs) at Earth is an important objective for space weather forecasting agencies. Recently, the CME Arrival and Impact working team has made significant progress toward defining communit yagreed metrics and validation methods to assess the current state of CME modeling capabilities. This will allow the community to quantify our current capabilities and track progress in models over time. First, it is crucial that the community focuses on the collection of the necessary metadata for transparency and reproducibility of results. Concerning CME arrival and impact we have identified six different metadata types: 3D CME measurement, model description, model input, CME (non)arrival observation, model output data, and metrics and validation methods. Second, the working team has also identified a validation time period, where all events within the following two periods will be considered: 1 January 2011 to 31 December 2012 and January 2015 to 31 December 2015. Those two periods amount to a total of about 100 hit events at Earth and a large amount of misses. Considering a time period will remove any bias in selecting events and the event set will represent a sample set that will not be biased by user selection. Lastly, we have defined the basic metrics and skill scores that the CME Arrival and Impact working team will focus on.

Verbeke, C.↗

NASA NTRS2018

A Standard Reference Model for Data Archives

An implementable Data Archive Architecture is being developed for trusted digital repositories based on the Reference Model for an Open Archival Information System (OAIS) – ISO 14721. A set of interoperable protocols and interface specifications are planned that will offer capabilities for accessing, merging, and re-using data, both within and across the operational boundaries of trustworthy digital repositories. The model will also provide support for the fundamental scientific need to verify the reproducibility of results. This standards development task is being performed by the Data Archive Interoperability (DAI) working group within the Consultative Committee for Space Data Systems (CCSDS). The architecture integrates concepts from the OAIS Reference Model, the ISO/IEC 11179 Metadata Registry (MDR) standard, the CCSDS Reference Architecture for Space Information Management (RASIM), the proposed draft recommended practice document, Information Preparation to Enable Long Term Use (IPELTU), and three decades of digital repository development for science research.

Ambacher, Bruce↗

NASA NTRS2023

NLSP: NASA Life Sciences Portal

NASA’s Life Sciences Ports (NLSP) serves the scientific community by providing curated data from space life science experiment. The Human Research Program (HRP) with the help of NLSP is currently transforming their life sciences data archive systems and processes to improve compliance with the FAIR principles. Some of these improvements will at the same time support the twin pillars of Open Science: transparency of methods and reproducibility of results. This video is a high level overview of the NLSP for existing and new users.

Life Sciences data↗

NASA NTRS2022

Transit Timing Variations for AU Microscopii b and c

We explore the transit timing variations (TTVs) of the young (22 Myr) nearby AU Mic planetary system. For AU Mic b, we introduce three Spitzer (4.5 μm) transits, five TESS transits, 11 LCO transits, one PEST transit, one Brierfield transit, and two transit timing measurements from Rossiter–McLaughlin observations; for AU Mic c, we introduce three TESS transits. We present two independent TTV analyses. First, we use EXOFASTv2 to jointly model the Spitzer and ground-based transits and obtain the midpoint transit times. We then construct an O − C diagram and model the TTVs with Exo-Striker. Second, we reproduce our results with an independent photodynamical analysis. We recover a TTV mass for AU Mic c of -10.8+2.22.3 M⊕. We compare the TTV-derived constraints to a recent radial velocity (RV) mass determination. We also observe excess TTVs that do not appear to be consistent with the dynamical interactions of b and c alone or due to spots or flares. Thus, we present a hypothetical nontransiting “middle-d” candidate exoplanet that is consistent with the observed TTVs and candidate RV signal and would establish the AU Mic system as a compact resonant multiplanet chain in a 4:6:9 period commensurability. These results demonstrate that the AU Mic planetary system is dynamically interacting, producing detectable TTVs, and the implied orbital dynamics may inform the formation mechanisms for this young system. We recommend future RV and TTV observations of AU Mic b and c to further constrain the masses and confirm the existence of possible additional planet(s).

Justin M Wittrock↗

NASA NTRSDate not supplied

Evaluating the Trustworthiness of Deep Neural Networks in Deployment – A Comparative Study (Replicability Study)

As deep neural networks (DNNs) are increasingly used in safety critical applications, there is a growing concern for their trustworthiness. Even highly trained, high-performant networks are not 100% accurate. However, it is very difficult to predict their behaviour during deployment without ground truth. In this paper, we provide a comparative and replicability study on recent approaches that have been proposed to evaluate the trustworthiness of DNNs. We find that it is very difficult to run and reproduce the results for these approaches on their replication packages, and it is even more difficult to run the tools on artifacts other than their own. Further, it is difficult to compare the effectiveness of the tools, due to lack of clearly defined evaluation metrics. Our results indicate that more effort is needed in our research community to obtain sound techniques for evaluating the trustworthiness of neural networks in safety-critical domains. To this end, we contribute an evaluation framework that incorporates the considered approaches and enables evaluation on common benchmarks, using common metrics. Using this framework, we run a comparative study of the three approaches.

Trustworthy AI↗

NASA NTRS1975

Reproducibility of liquid oxygen impact test results

Results for 12,000 impacts on a wide range of materials were studied to determine the reproducibility of the liquid oxygen impact test method. Standard deviations representing the overall variability of results were in close agreement with the expected values for a binomial process. This indicates that the major source of variability is due to the go - no go nature of the test method and that variations due to sampling and testing operations were not significant.

Gayle, J. B.↗

NASA NTRS2007

Anatomy of the Binary Black Hole Recoil: A Multipolar Analysis

We present a multipolar analysis of the recoil velocity computed in recent numerical simulations of binary black hole coalescence, for both unequal masses and non-zero, non-precessing spins. We show that multipole moments up to and including 1 = 4 are sufficient to accurately reproduce the final recoil velocity (= 98%) and that only a few dominant modes contribute significantly to it (2 95%). We describe how the relative amplitude, and more importantly, the relative phase, of these few modes control the way in which the recoil builds up throughout the inspiral, merger, and ring-down phases. We also find that the numerical results can be reproduced, to a high level of accuracy, by an effective Newtonian formula for the multipole moments obtained by replacing in the Newtonian formula the radial separation with an effective radius computed from the numerical data. Beyond the merger, the numerical results are reproduced by a superposition of three Kerr quasi-normal modes. Analytic formulae, obtained by expressing the multipole moments in terms of the fundamental QNMs of a Kerr BH, are able to explain the onset and amount of '.anti-kick" for each of the simulations. Lastly, we apply this multipolar analysis to understand the remarkable difference between the amplitudes of planar and non-planar kicks for equal-mass spinning black holes.

Schnittman, Jeremy↗

NASA NTRS1988

Acquisition system testing with superfluid helium

Minus one-g outflow tests were conducted with superfluid helium in conjunction with a thermomechanical pump setup in order to study the use of capillary acquisition systems for NASA's Superfluid Helium On-Orbit Transfer (SHOOT) flight experiment. Results show that both fine mesh screen and porous sponge systems are capable of supplying superfluid helium to the thermomechanical pump inlet against a one-g head up to 4 cm, fulfilling the SHOOT requirements. Sponge results were found to be reproducible, while the screen results were not.

Anderson, John E.↗

NASA NTRS1994

Issues on Reproducibility/Reliability of Magnetic NDE Methods

One of the critical elements related to the practicality of any NDE technique is its reproducibility under nominally the same inspection conditions. The results of certain test methodologies, however, are not always repeatable and understanding the origin of the irreproducibility is often as critical as obtaining reproducible results. One example is the characterization of residual stress in structural ferromagnets using the magnetoacoustic (MAC) method. Although it has not been widely publicized, the test results of this method are known to be time-dependent. Two distinct types of time dependencies have been observed during testing. The first type has a clearly definable relaxation time, while no such trend has been observed for the second. The purpose of the present study is to systematically investigate the time dependence of the second type, to find out the range and, if possible, the origin of the variation in the test results. For this, MAC curves were obtained under various stress levels and the tests were repeated over time. Particular attention was given to whether noise in the measuring device or a change in the laboratory environment could have been a contributing factor. The steel samples used for the study were cut from C- and U-class railroad wheels. The MAC behavior of these samples was reported previously. Each steel sample was first machined to be a cylindrical rod of 3.175 cm (1.25 in) in diameter and 26.67 cm (10.5 in) in length. The center portion of the samples were further machined to form a pair of flat and parallel surfaces for the launch and reflection of the ultrasonic pulses. Data acquisition involved two major elements; magnetic and acoustic measurements. Throughout the experiment the net magnetic induction, B, was measured by integrating the induction pickup coil output using an integrating fluxmeter. The acoustic measurements employed the phase-locked technique which will be described in the following.

Namkung, M.↗

NASA NTRS1993

Atomic oxygen interaction with spacecraft materials: Relationship between orbital and ground-based testing for materials certification

The effects of atomic oxygen on boron nitride (BN), silicon nitride (Si3N4), Intelsat 6 solar cell interconnects, organic polymers, and MoS2 and WS2 dry lubricant, were studied in Low Earth Orbit (LEO) flight experiments and in a ground based simulation facility. Both the inflight and ground based experiments employed in situ electrical resistance measurements to detect penetration of atomic oxygen through materials and Electron Spectroscopy for Chemical Analysis (ESCA) analysis to measure chemical composition changes. Results are given. The ground based results on the materials studied to date show good qualitative correlation with the LEO flight results, thus validating the simulation fidelity of the ground based facility in terms of reproducing LEO flight results. In addition it was demonstrated that ground based simulation is capable of performing more detailed experiments than orbital exposures can presently perform. This allows the development of a fundamental understanding of the mechanisms involved in the LEO environment degradation of materials.

Cross, Jon B.↗

NASA NTRS1974

Determination of rare-earth elements in Luna 16 regolith sample by chemical spectral method

An analysis was made of regolith from layer A of the Luna 16 sample for rare earth elements, by a chemical spectral method. Chemical and ion exchange concentrations were used to determine the content of 12 elements and Y at the level 0.001 to 0.0001 percent with 10 to 15 percent reproducibility of the emission determination. Results within the limits of reproducibility agree with data obtained by mass spectra, activation, and X-ray fluorescent methods.

Stroganova, N. S.↗

NASA NTRS1990

A comparison of ground-based and space flight data: Atomic oxygen reactions with boron nitride and silicon nitride

The effects of atomic oxygen on boron nitride (BN) and silicon nitride (Si3N4) have been studied in low Earth orbit (LEO) flight experiments and in a ground-based simulation facility at Los Alamos National Laboratory. Both the in-flight and ground-based experiments employed the materials coated over thin (approx 250 Angstrom) silver films whose electrical resistance was measured in situ to detect penetration of atomic oxygen through the BN and Si3N4 materials. In the presence of atomic oxygen, silver oxidizes to form silver oxide, which has a much higher electrical resistance than pure silver. Permeation of atomic oxygen through BN, as indicated by an increase in the electrical resistance of the silver underneath, was observed in both the in-flight and ground-based experiments. In contrast, no permeation of atomic oxygen through Si3N4 was observed in either the in-flight or ground-based experiments. The ground-based results show good qualitative correlation with the LEO flight results, thus validating the simulation fidelity of the ground-based facility in terms of reproducing LEO flight results.

Cross, J. B.↗

NASA NTRS1989

Calculation of nonequilibrium hydrogen-air reactions with implicit flux vector splitting method

Two methods, fully- and loosely-coupled, are developed to incorporate nonequilibrium hydrogen-air chemistry into the fluid dynamic implicit flux vector splitting code (F3D). The new code (F3D/Chem) is validated against other existing codes for two cases: nozzle expansion, and shock-induced combustion around a blunt body. The shock-induced combustion case is compared also with an experimental data. The reaction rate constants are varied in an effort to reproduce the experimental data. The fully- and loosely-coupled methods are found to yield comparable results, but the computation time is shorter using the loosely-coupled method. The present method is found to reproduce results obtained using different existing codes. The experimental data was not reproduced with any selected rate coefficients set.

Lee, Seung-Ho↗

NASA NTRS1977

Low-temperature rotational relaxation in gaseous H2 and D2

Various potentials have been used for generating scattering cross sections for rotational transitions in hydrogen isotope systems. Low-temperature rates were calculated and the relaxation times compared with the results of sound absorption experiments. It is seen that the existing potentials could still be improved since they do not exactly reproduce the experimental results.

Ramaswamy, R.↗

NASA NTRS1988

Full configuration-interaction benchmark calculations for AlH

Full CI and CASSCF/SOCI theoretical computations are presented for the X 1Sigma(+), A 1Pi, and C 1Sigma(+) states of AlH. The aim is to establish benchmark data to calibrate methods which describe valence-Rydberg transitions in other molecules. The results are presented in extensive tables and graphs and compared with published theoretical and experimental values, and the conditions under which CASSCF/SOCI calculations accurately reproduce the FCI results are defined.

Bauschlicher, Charles W., Jr.↗

NASA NTRS1992

A survey of the broadband shock associated noise prediction methods

Several different prediction methods to estimate the broadband shock associated noise of a supersonic jet are introduced and compared with experimental data at various test conditions. The nozzle geometries considered for comparison include a convergent and a convergent-divergent nozzle, both axisymmetric. Capabilities and limitations of prediction methods in incorporating the two nozzle geometries, flight effect, and temperature effect are discussed. Predicted noise field shows the best agreement for a convergent nozzle geometry under static conditions. Predicted results for nozzles in flight show larger discrepancies from data and more dependable flight data are required for further comparison. Qualitative effects of jet temperature, as observed in experiment, are reproduced in predicted results.

Kim, Chan M.↗

NASA NTRS1992

A survey of the broadband shock associated noise prediction methods

Kim, Chan M.↗