Search NASA⌕ Search

SEARCH · Search NASA

Results for “Reproducibility”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15

BioHackathon 2015: Semantics of data for life sciences and reproducible research

We report on the activities of the 2015 edition of the BioHackathon, an annual event that brings together researchers and developers from around the world to develop tools and technologies that promote the reusability of biological data. We discuss issues surrounding the representation, publication, integration, mining and reuse of biological data and metadata across a wide range of biomedical data types of relevance for the life sciences, including chemistry, genotypes and phenotypes, orthology and phylogeny, proteomics, genomics, glycomics, and metabolomics. We describe our progress to address ongoing challenges to the reusability and reproducibility of research results, and identify outstanding issues that continue to impede the progress of bioinformatics research. We share our perspective on the state of the art, continued challenges, and goals for future research and development for the life sciences Semantic Web.

97 MATHEMATICS AND COMPUTING↗

Improving the Reproducibility of the Radial Argon Concentration in Beryllium Shells

We used sputter coating of beryllium on spherical mandrels at Lawrence Livermore National Laboratory and at General Atomics to produce graded, copper doped beryllium shells. While these coatings have consistent microstructure and acceptable void content, different coaters produced different results with respect to argon implantation. Each individual system met the requirements for argon implantation, but the deviation from one system to another and from run to run exceeded the variability requirements as specified by the National Ignition Facility target design requirements. We redesigned the fixturing within one system to improve reproducibility. Furthermore, we reconfigured the coaters so that the vertical and lateral alignments of the shells under the gun varied <1 mm between systems. After this process, the systems were able to produce beryllium capsules with radial argon profiles that met specifications and were consistent from run to run and from system to system. During this process we gained insight into the beryllium coating process. Finally, the radial argon variation was shown to be dependent on sputter target thickness. We also found that the argon content in the shells was extremely dependent on the position of the shells with respect to the gun.

42 ENGINEERING↗

CrossCheck: Rapid, Reproducible, and Interpretable Model Evaluation

Evaluation beyond aggregate performance metrics, e.g. F1-score, is crucial to both establish an appropriate level of trust in machine learning models and identify future model improvements. In this paper we demonstrate CrossCheck, an interactive visualization tool for rapid crossmodel comparison and reproducible error analysis. We describe the tool and discuss design and implementation details. We then present three use cases (named entity recognition, reading comprehension, and clickbait detection) that show the benefits of using the tool for model evaluation. CrossCheck allows data scientists to make informed decisions to choose between multiple models, identify when the models are correct and for which examples, investigate whether the models are making the same mistakes as humans, evaluate models’ generalizability and highlight models’ limitations, strengths and weaknesses. Furthermore, CrossCheck is implemented as a Jupyter widget, which allows rapid and convenient integration into data scientists’ model development workflows.

Arendt, Dustin L.↗

Understanding Interactive and Reproducible Computing With Jupyter Tools at Facilities

Increasingly Jupyter tools are being adopted and incorporated into High Performance Computing (HPC) and scientific user facilities. Adopting Jupyter tools enables more interactive and reproducible computational work at facilities across data life cycles. As the volume, variety, and scope of data grow, scientists need to be able to analyze and share results in user friendly ways. Human-centered research highlights design challenges around computational notebooks, and our qualitative user study shifts focus to better characterize how Jupyter tools are being used in HPC and science user facilities today. We conducted twenty-nine interviews, and obtained 103 survey responses from NERSC Jupyter users, to better understand the increasing role of interactive computing tools in DOE sponsored scientific work. We examine a range of issues that emerge using and supporting Jupyter in HPC ecosystems, including: how Jupyter is being used by scientists in HPC and user facility ecosystems; how facilities are purposefully supporting Jupyter in their ecosystems; feedback NERSC users have about the facility’s deployment, and, discuss features NERSC indicated would be helpful. We offer a variety of takeaways for staff supporting Jupyter at facilities, Project Jupyter and related open source communities, and funding agencies supporting interactive computing work.

97 MATHEMATICS AND COMPUTING↗

Data for reproducing the figures of the paper Multimodal Super-Resolution: Discovering hidden physics and its application to fusion plasmas

This deposit contains the raw data for reproducing research results of the paper Multimodal Super-Resolution: Discovering hidden physics and its application to fusion plasmas. The main contribution of this work is to utilize machine learning techniques to reconstruct and enhance the resolution of a diagnostic measurement from other available diagnostics in a system. The proposed techniques is called Diag2Diag.

diag2diag↗

Collapsar R-process Yields Can Reproduce [Eu/Fe] Abundance Scatter in Metal-poor Stars

It is unclear if neutron star mergers can explain the observed r-process abundances of metal-poor stars. Collapsars, defined here as rotating massive stars whose collapse results in a rapidly accreting disk around a black hole that can launch jets, are a promising alternative. We find that we can produce a self-consistent model in which a population of collapsars with stochastic europium yields synthesizes all of the r-process material in metal-poor ([Fe/H] < - 2.5) stars. Our model reproduces the observed scatter and evolution of scatter of [Eu/Fe] abundances. We find that if collapsars are the dominant r-process site for metal-poor stars, r-process synthesis may be linked to supernovae that produce long γ-ray bursts. Our results also allow for the possibility that core-collapse supernovae beyond those that launch γ-ray bursts also produce r-process material (e.g., potentially a subset of Type Ic-BL supernovae). Furthermore, we identify collapsar jet properties (isotropic energy, engine luminosity, or engine time) that may trace r-process yield and verify that the amount of r-process yield produced per collapsar in our model ( ~ 0.07M⊙) is consistent with other independent estimates. In the future, achieving 0.05 dex precision on distribution scatter or a reliable selection function would further constrain our probe of r-process production. Our model would also hold for another prompt r-process site with a power-law yield, and work is needed to determine if, for example, fast-merging neutron stars can also explain abundance scatter.

Astronomy & Astrophysics↗

The Variable Infiltration Capacity model version 5 (VIC-5): infrastructure improvements for new applications and reproducibility

The Variable Infiltration Capacity (VIC) model is a macroscale semi-distributed hydrologic model. VIC development began in the early 1990s and the model has since been used extensively for basin- to global-scale applications that include hydrologic dataset construction, trend analysis of hydrologic fluxes and states, data evaluation and assimilation, forecasting, coupled climate modeling, and climate change impact assessment. Ongoing operational applications of the VIC model include the University of Washington's drought monitoring and forecasting systems and NASA's Land Data Assimilation System. This paper documents the development of VIC version 5 (VIC-5), which includes a major reconfiguration of the legacy VIC source code to support a wider range of modern hydrologic modeling applications. The VIC source code has been moved to a public GitHub repository to encourage participation by the broader user and developer communities. The reconfiguration has separated the core physics of the model from the driver source code, whereby the latter is responsible for memory allocation, preprocessing and post-processing, and input–output (I–O). VIC-5 includes four drivers that use the same core physics modules, but which allow for different methods for accessing this core to enable different model applications. Finally, VIC-5 is distributed with robust test infrastructure, components of which routinely run during development using cloud-hosted continuous integration. The work described here provides an example to the model development community for extending the life of a legacy model that is being used extensively. The development and release of VIC-5 represents a significant step forward for the VIC user community in terms of support for existing and new model applications, reproducibility, and scientific robustness.

42 ENGINEERING↗

How well are hazards associated with derechos reproduced in regional climate simulations?

Abstract. A 15-member ensemble of convection-permitting regional simulations of the fast-moving and destructive derecho of 29–30 June 2012 that impacted the northeastern urban corridor of the USA is presented. This event generated 1100 reports of damaging winds, generated significant wind gusts over an extensive area of up to 500 000 km2, caused several fatalities, and resulted in widespread loss of electrical power. Extreme events such as this are increasingly being used within pseudo-global-warming experiments to examine the sensitivity of historical, societally important events to global climate non-stationarity and how they may evolve as a result of changing thermodynamic and dynamic contexts. As such it is important to examine the fidelity with which such events are described in hindcast experiments. The regional simulations presented herein are performed using the Weather Research and Forecasting (WRF) model. The resulting ensemble is used to explore simulation fidelity relative to observations for wind gust magnitudes, spatial scales of convection (as is manifest in high composite reflectivity, cREF), and both rainfall and hail production as a function of model configuration (microphysics parameterization, lateral boundary conditions (LBCs), start date, use of nudging, compiler choice, damping, and number of vertical levels). We also examine the degree to which each ensemble member differs with respect to key mesoscale drivers of convective systems (e.g., convective available potential energy and vertical wind shear) and critical manifestations of deep convection, e.g., vertical velocities, cold-pool generation, and how those properties relate to the correct characterization of the associated atmospheric hazards (wind gusts and hail). Use of a double-moment, seven-class scheme with number concentrations for all species (including hail and graupel) results in the greatest fidelity of model-simulated wind gusts and convective structure to the observations of this event. All ensemble members, however, fail to capture the intensity of the event in terms of the spatial extent of convection and the production of high near-surface wind gusts. We further show very high sensitivity to the LBCs employed and specifically that simulation fidelity is higher for simulations nested within ERA-Interim compared to ERA5. Excess convective available potential energy (CAPE) in all ensemble members after the derecho passage leads to excess production of convective cells, wind gusts, cREF > 40 dBZ, and precipitation during a frontal passage on the subsequent day. This event proved very challenging to forecast in real time and to reproduce in the 15-member hindcast simulation ensemble presented here. Future work could examine if simulations with other initial and lateral boundary conditions can achieve greater fidelity.

Shepherd, Tristan (ORCID:0000000186276419)↗

Radiative properties of astrophysical matter : a quest to reproduce astrophysical conditions on earth.

Experiments in terrestrial laboratories can be used to evaluate the physical models that interpret astronomical observations. The properties of matter in astrophysical objects are essential components of these models, but terrestrial laboratories struggle to reproduce the extreme conditions that often exist. Megajoule-class DOE/NNSA facilities such as the National Ignition Facility and Z can create unprecedented amounts of matter at extreme conditions, providing new capabilities to test astrophysical models with high accuracy. Experiments at these large facilities are challenging, and access is very competitive. However, the cylindrically-symmetric Z source emits radiation in all directions, enabling multiple physics experiments to be driven with a single Z discharge. This helps ameliorate access limitations. This article describes research efforts under way at Sandia National Laboratories Z facility investigating radiation transport through stellar interior matter, population kinetics of atoms exposed to the intense radiation emitted by accretion powered objects, and spectral line formation in white dwarf (WD) photospheres. Opacity quantifies the absorption of radiation by matter and strongly influences stellar structure and evolution, since radiation dominates energy transport deep inside stars. Opacity models have become highly sophisticated, but laboratory tests at the conditions existing inside stars have not been possible - until now. Z research is presently focused on measuring iron absorption at conditions relevant to the base of the solar convection zone, where the electron temperature and density are 190 eV and 9 x 10{sup 22} e/cc, respectively. Creating these conditions in a sample that is sufficiently large, long-lived, and uniform is extraordinarily challenging. A source of radiation that streams through the relatively-large samples can produce volumetric heating and thus, uniform conditions, but to achieve high temperatures a strong source is required. Z dynamic hohlraums provide such a megajoule-class source. Initial Z experiments measured transmission through iron samples ionized to the same charge states that exist at the solar convection zone base. The resulting data made it possible to test challenging aspects of the opacity calculations such as the ionization balance and the completeness and accuracy of the atomic energy level description. However, the density was too low to provide a definitive test of the physics at the solar convection zone base. Recent experiments have reached higher densities, and opacity model tests for stellar interiors now appear within reach. Accretion powered objects, including active galactic nuclei, x-ray binaries, and black hole accretion disks, are the most luminous objects in the universe. Astrophysical models for these objects rely largely on comparing spectroscopic predictions with observations. A dilemma arises because the spectra originate from plasmas that are bathed in the enormous photon flux from the accretion disk and photoionization dominates the atomic ionization and energy level populations. Thus, constraining astrophysical models depends on accurate atomic models for photoionized plasmas. Unfortunately, to date the ionization in almost all laboratory experiments is collision-dominated and very few tests of photoionized plasma atomic kinetics exist. Megajoule class high-energy-density facilities can help because they generate higher x-ray fluence over larger spatial scales and longer times. Expanded iron foils and pre-filled neon gas cells have been used in experiments at Z to study photoionized atomic kinetics in two elements commonly observed in astrophysical objects. In these experiments, low density samples are exposed to a measured intense x-ray spectrum, emergent emission or absorption spectra are recorded, and the results are compared to predictions made with spectral synthesis codes used by astrophysicists. Initial experiments focused on testing models used to interpret spectra from the 'warm absorber,' a plasma observed in the vicinity of some active galactic nuclei. In future experiments, spectra from plasmas exposed to higher radiation intensities will be measured, possibly leading to improved understanding of the plasma in the immediate vicinity of the accretion disk. WDs are the oldest stars and can serve as cosmic clocks, since the universe must be at least as old as the objects within it. Astrophysicists determine WD ages using stellar models combined with effective temperature (T{sub eff}) and mass inferred from spectral observations of WD photospheres. Many line profiles in the observed spectra are dominated by Stark broadening, a process sensitive to the photosphere density and related to the total mass through the stellar model. Accurate Stark broadening theory is, therefore, critical to the precise determination of the WD properties and the inferred ages.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Exploitation of a Self-limiting Process for Reproducible Formation of Ultrathin Ni(1-x)Pt(x) Silicide Films

This letter reports on a process scheme to obtain highly reproducible Ni{sub 1-x}Pt{sub x} silicide films of 3-6 nm thickness formed on a Si(100) substrate. Such ultrathin silicide films are readily attained by sputter deposition of metal films, metal stripping in wet chemicals, and final silicidation by rapid thermal processing. This process sequence warrants an invariant amount of metal intermixed with Si in the substrate surface region independent of the initial metal thickness, thereby leading to a self-limiting formation of ultrathin silicide films. The crystallographic structure, thickness, uniformity, and morphological stability of the final silicide films depend sensitively on the initial Pt fraction.

36 MATERIALS SCIENCE↗

Method and infrastructure for cycle-reproducible simulation on large scale digital circuits on a coordinated set of field-programmable gate arrays (FPGAs)

A plurality of target field programmable gate arrays are interconnected in accordance with a connection topology and map portions of a target system. A control module is coupled to the plurality of target field programmable gate arrays. A balanced clock distribution network is configured to distribute a reference clock signal, and a balanced reset distribution network is coupled to the control module and configured to distribute a reset signal to the plurality of target field programmable gate arrays. The control module and the balanced reset distribution network are cooperatively configured to initiate and control a simulation of the target system with the plurality of target field programmable gate arrays. A plurality of local clock control state machines reside in the target field programmable gate arrays. The local clock state machines are configured to generate a set of synchronized free-running and stoppable clocks to maintain cycle-accurate and cycle-reproducible execution of the simulation of the target system. A method is also provided.

97 MATHEMATICS AND COMPUTING↗

Sustainability and Reproducibility via Containerized Computing

Recent developments in the commercial open source community have catalysed the use of Linux containers for scalable deployment of web-based applications to the cloud. Scientific software can be containerized with dependencies, configuration files, post-processing tools and even simulation results, referred to as containerized computing. This new approach promises to significantly improve sustainability, productivity and reproducibility. In this article, we present our experiences, technology, and future plans for open source containerization of software used to model particle and radiation beams. Vagrant is central to our approach, using Docker for cloud deployment and VirtualBox virtual machines for deployment to Mac OS and Windows computers. Our technology enables seamless switching between the desktop and the cloud to simplify simulation development and execution.

97 MATHEMATICS AND COMPUTING↗

Computing environments for reproducibility: Capturing the “Whole Tale”

The act of sharing scientific knowledge is rapidly evolving away from traditional articles and presentations to the delivery of executable objects that integrate the data and computational details (e.g., scripts and workflows) upon which the findings rely. This envisioned coupling of data and process is essential to advancing science but faces technical and institutional barriers. The Whole Tale project aims to address these barriers by connecting computational, data-intensive research efforts with the larger research process transforming the knowledge discovery and dissemination process into one where data products are united with research articles to create "living publications" or tales. The Whole Tale focuses on the full spectrum of science, empowering users in the long tail of science, and power users with demands for access to big data and compute resources. We report here on the design, architecture, and implementation of the Whole Tale environment.

97 MATHEMATICS AND COMPUTING↗

nmrrr : A Reproducible Workflow for Binning and Visualizing NMR Spectra From Environmental Samples

Nuclear magnetic resonance (NMR) spectroscopy is a useful tool for detection and identification of molecular structural information, with increasing applications in environmental sciences. NMR instrument outputs are however heterogeneous and require extensive post-processing, creating barriers to their use and application by non-specialists. Here, we report on a new open-source R package, nmrrr, that processes and visualizes spectral data obtained from one-dimensional solution-state and solid-state NMR experiments; the package also performs relevant calculations commonly applied in natural organic matter communities, such as computing the relative abundance of various functional groups. We document the package's installation, dependencies, and functions; and provide a standard workflow for processing NMR data. This package is currently available on CRAN and GitHub, and community contributions are welcome.

54 ENVIRONMENTAL SCIENCES↗