Search NASA⌕ Search

SEARCH · Search NASA

Results for “Reproducibility”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 775 records · Page 43

Neuromorphic intermediate representation: A unified instruction set for interoperable brain-inspired computing

Abstract Spiking neural networks and neuromorphic hardware platforms that simulate neuronal dynamics are getting wide attention and are being applied to many relevant problems using Machine Learning. Despite a well-established mathematical foundation for neural dynamics, there exists numerous software and hardware solutions and stacks whose variability makes it difficult to reproduce findings. Here, we establish a common reference frame for computations in digital neuromorphic systems, titled Neuromorphic Intermediate Representation (NIR). NIR defines a set of computational and composable model primitives as hybrid systems combining continuous-time dynamics and discrete events. By abstracting away assumptions around discretization and hardware constraints, NIR faithfully captures the computational model, while bridging differences between the evaluated implementation and the underlying mathematical formalism. NIR supports an unprecedented number of neuromorphic systems, which we demonstrate by reproducing three spiking neural network models of different complexity across 7 neuromorphic simulators and 4 digital hardware platforms. NIR decouples the development of neuromorphic hardware and software, enabling interoperability between platforms and improving accessibility to multiple neuromorphic technologies. We believe that NIR is a key next step in brain-inspired hardware-software co-evolution, enabling research towards the implementation of energy efficient computational principles of nervous systems. NIR is available atneuroir.org

Science & Technology - Other Topics↗

Revisiting the activity of two poly(vinyl chloride)- and polyethylene-degrading enzymes

Biocatalytic degradation of non-hydrolyzable plastics is a rapidly growing field of research, driven by the global accumulation of waste. Enzymes capable of cleaving the carbon-carbon bonds in synthetic polymers are highly sought-after as they may provide tools for environmentally friendly plastic recycling. Despite some reports of oxidative enzymes acting on non-hydrolyzable plastics, including polyethylene or poly(vinyl chloride), the notion that these materials are susceptible to efficient enzymatic degradation remains controversial, partly driven by a general lack of studies independently reproducing previous observations. Here, we attempt to replicate two recent studies reporting that deconstruction of polyethylene and poly(vinyl chloride) can be achieved using an insect hexamerin from Galleria mellonella (so-called “Ceres”) or a bacterial catalase-peroxidase from Klebsiella sp., respectively. Reproducing previously described experiments, we do not observe any activity on plastics using multiple reaction conditions and multiple substrate types. Digging deeper into the discrepancies between the previous data and our observations, we show how and why the original experimental results may have been misinterpreted.

36 MATERIALS SCIENCE↗

High-throughput methods leveraging robotics and computer vision for the development of therapeutic phage cocktails

We present the high-throughput automated screening techniques that are being used to develop bacteriophage-based therapeutic products currently under investigation in human clinical trials to combat urinary tract infections. By integrating modern liquid handling robotics, standardized phenotypic assays, and computer vision-based enumeration, we established a platform capable of reproducibly screening large collections of phages against clinically derived bacterial strain panels. This approach enabled systematic assessment of phage-bacteria interactions at scale, facilitating the identification and optimization of phage cocktails with broad in vitro activity. Although bacteriophage therapy has long been investigated as a strategy for treating bacterial infections, few frameworks exist for developing phage combinations in a reproducible and scalable manner. The methods outlined here address this gap and aim to support the broader development of therapeutic assets available to combat antibiotic resistance.

Penke, Taylor J. R. [Locus Biosciences, Morrisvill↗

Machine learning the Hubbard U parameter in DFT+U using Bayesian optimization

Abstract Within density functional theory (DFT), adding a Hubbard U correction can mitigate some of the deficiencies of local and semi-local exchange-correlation functionals, while maintaining computational efficiency. However, the accuracy of DFT+U largely depends on the chosen Hubbard U values. We propose an approach to determining the optimal U parameters for a given material by machine learning. The Bayesian optimization (BO) algorithm is used with an objective function formulated to reproduce the band structures produced by more accurate hybrid functionals. This approach is demonstrated for transition metal oxides, europium chalcogenides, and narrow-gap semiconductors. The band structures obtained using the BO U values are in agreement with hybrid functional results. Additionally, comparison to the linear response (LR) approach to determining U demonstrates that the BO method is superior.

Chemistry↗

A systematic approach to generating accurate neural network potentials: the case of carbon

Abstract Availability of affordable and widely applicable interatomic potentials is the key needed to unlock the riches of modern materials modeling. Artificial neural network-based approaches for generating potentials are promising; however, neural network training requires large amounts of data, sampled adequately from an often unknown potential energy surface. Here we propose a self-consistent approach that is based on crystal structure prediction formalism and is guided by unsupervised data analysis, to construct an accurate, inexpensive, and transferable artificial neural network potential. Using this approach, we construct an interatomic potential for carbon and demonstrate its ability to reproduce first principles results on elastic and vibrational properties for diamond, graphite, and graphene, as well as energy ordering and structural properties of a wide range of crystalline and amorphous phases.

Chemistry↗

JARVIS-Leaderboard: a large scale benchmark of materials design methods

Abstract Lack of rigorous reproducibility and validation are significant hurdles for scientific development across many fields. Materials science, in particular, encompasses a variety of experimental and theoretical approaches that require careful benchmarking. Leaderboard efforts have been developed previously to mitigate these issues. However, a comprehensive comparison and benchmarking on an integrated platform with multiple data modalities with perfect and defect materials data is still lacking. This work introduces JARVIS-Leaderboard, an open-source and community-driven platform that facilitates benchmarking and enhances reproducibility. The platform allows users to set up benchmarks with custom tasks and enables contributions in the form of dataset, code, and meta-data submissions. We cover the following materials design categories: Artificial Intelligence (AI), Electronic Structure (ES), Force-fields (FF), Quantum Computation (QC), and Experiments (EXP). For AI, we cover several types of input data, including atomic structures, atomistic images, spectra, and text. For ES, we consider multiple ES approaches, software packages, pseudopotentials, materials, and properties, comparing results to experiment. For FF, we compare multiple approaches for material property predictions. For QC, we benchmark Hamiltonian simulations using various quantum algorithms and circuits. Finally, for experiments, we use the inter-laboratory approach to establish benchmarks. There are 1281 contributions to 274 benchmarks using 152 methods with more than 8 million data points, and the leaderboard is continuously expanding. The JARVIS-Leaderboard is available at the website: https://pages.nist.gov/jarvis_leaderboard/

36 MATERIALS SCIENCE↗

Consensus statement for stability assessment and reporting for perovskite photovoltaics based on ISOS procedures

Improving the long-term stability of perovskite solar cells is critical to the deployment of this technology. Despite the great emphasis laid on stability-related investigations, publications lack consistency in experimental procedures and parameters reported. It is therefore challenging to reproduce and compare results and thereby develop a deep understanding of degradation mechanisms. Here, we report a consensus between researchers in the field on procedures for testing perovskite solar cell stability, which are based on the International Summit on Organic Photovoltaic Stability (ISOS) protocols. We propose additional procedures to account for properties specific to PSCs such as ion redistribution under electric fields, reversible degradation and to distinguish ambient-induced degradation from other stress factors. These protocols are not intended as a replacement of the existing qualification standards, but rather they aim to unify the stability assessment and to understand failure modes. Finally, we identify key procedural information which we suggest reporting in publications to improve reproducibility and enable large data set analysis.

14 SOLAR ENERGY↗

Bandgap tuning of two-dimensional materials by sphere diameter engineering

Developing a precise and reproducible bandgap tuning method that enables tailored design of materials is of crucial importance for optoelectronic devices. Towards this end, we report a sphere diameter engineering (SDE) technique to manipulate the bandgap of two-dimensional (2D) materials. A one-to-one correspondence with an ideal linear working curve is established between the bandgap of MoS 2 and the sphere diameter in a continuous range as large as 360 meV. Fully uniform bandgap tuning of all the as-grown MoS 2 crystals is realized due to the isotropic characteristic of the sphere. More intriguingly, both a decrease and an increase of the bandgap can be achieved by constructing a positive or negative curvature. By fusing individual spheres in the melted state, post-synthesis bandgap adjustment of the supported 2D materials can be realized. In conclusion, this SDE technique, showing good precision, uniformity and reproducibility with high efficiency, may further accelerate the potential applications of 2D materials.

36 MATERIALS SCIENCE↗

Attosecond pulse shaping using a seeded free-electron laser

Attosecond pulses are central to the investigation of valence- and core-electron dynamics on their natural timescales. The reproducible generation and characterization of attosecond waveforms has been demonstrated so far only through the process of high-order harmonic generation. Several methods for shaping attosecond waveforms have been proposed, including the use of metallic filters, multilayer mirrors and manipulation of the driving field. However, none of these approaches allows the flexible manipulation of the temporal characteristics of the attosecond waveforms, and they suffer from the low conversion efficiency of the high-order harmonic generation process. Free-electron lasers, by contrast, deliver femtosecond, extreme-ultraviolet and X-ray pulses with energies ranging from tens of microjoules to a few millijoules. Recent experiments have shown that they can generate subfemtosecond spikes, but with temporal characteristics that change shot-to-shot. In this paper we report reproducible generation of high-energy (microjoule level) attosecond waveforms using a seeded free-electron laser. We demonstrate amplitude and phase manipulation of the harmonic components of an attosecond pulse train in combination with an approach for its temporal reconstruction. The results presented here open the way to performing attosecond time-resolved experiments with free-electron lasers.

47 OTHER INSTRUMENTATION↗

EcoFAB: Advancing microbiome science through standardized fabricated ecosystems

The vital role microbiomes play in ecosystems and for human health is now apparent. Great progress has been made by using model systems to gain insight into host-microbe interactions, yet lack of standardized reproducible experimental systems and methods greatly limits microbiome science. Recent successes highlight the importance of developing these types of systems to deconstruct mechanisms mediating host-microbe interactions. Standardization of ‘fabricated ecosystems’ would enable detailed mechanistic interrogation and more effective knowledge transfer between researchers – analogous to the significant impact model organisms and cell systems have had in molecular and cell biology. To advance these efforts we advocate for strategies and overarching themes to enable communities of scientists to work together to develop standardized laboratory microbial consortia for studying host-associated microbiomes.

Zengler, Karsten↗

Cryo-EM model validation recommendations based on outcomes of the 2019 EMDataResource challenge

This paper describes outcomes of the 2019 Cryo-EM Model Challenge. The goals were to (1) assess the quality of models that can be produced from cryogenic electron microscopy (cryo-EM) maps using current modeling software, (2) evaluate reproducibility of modeling results from different software developers and users and (3) compare performance of current metrics used for model evaluation, particularly Fit-to-Map metrics, with focus on near-atomic resolution. Our findings demonstrate the relatively high accuracy and reproducibility of cryo-EM models derived by 13 participating teams from four benchmark maps, including three forming a resolution series (1.8 to 3.1 Å). The results permit specific recommendations to be made about validating near-atomic cryo-EM structures both in the context of individual experiments and structure data archives such as the Protein Data Bank. We recommend the adoption of multiple scoring parameters to provide full and objective annotation and assessment of the model, reflective of the observed cryo-EM map density.

59 BASIC BIOLOGICAL SCIENCES↗

National-scale remotely sensed lake trophic state from 1984 through 2020

Lake trophic state is a key ecosystem property that integrates a lake’s physical, chemical, and biological processes. Despite the importance of trophic state as a gauge of lake water quality, standardized and machine-readable observations are uncommon. Remote sensing presents an opportunity to detect and analyze lake trophic state with reproducible, robust methods across time and space. We used Landsat surface reflectance data to create the first compendium of annual lake trophic state for 55,662 lakes of at least 10 ha in area throughout the contiguous United States from 1984 through 2020. The dataset was constructed with FAIR data principles (Findable, Accessible, Interoperable, and Reproducible) in mind, where data are publicly available, relational keys from parent datasets are retained, and all data wrangling and modeling routines are scripted for future reuse. Together, this resource offers critical data to address basic and applied research questions about lake water quality at a suite of spatial and temporal scales.

54 ENVIRONMENTAL SCIENCES↗

Campanile Near-Field Probes Fabricated by Nanoimprint Lithography on the Facet of an Optical Fiber

One of the major challenges to the widespread adoption of plasmonic and nano-optical devices in real-life applications is the difficulty to mass-fabricate nano-optical antennas in parallel and reproducible fashion, and the capability to precisely place nanoantennas into devices with nanometer-scale precision. In this study, we present a solution to this challenge using the state-of-the-art ultraviolet nanoimprint lithography (UV-NIL) to fabricate functional optical transformers onto the core of an optical fiber in a single step, mimicking the 'campanile' near-field probes. Imprinted probes were fabricated using a custom-built imprinter tool with co-axial alignment capability with sub < 100 nm position accuracy, followed by a metallization step. Scanning electron micrographs confirm high imprint fidelity and precision with a thin residual layer to facilitate efficient optical coupling between the fiber and the imprinted optical transformer. The imprinted optical transformer probe was used in an actual NSOM measurement performing hyperspectral photoluminescence mapping of standard fluorescent beads. The calibration scans confirmed that imprinted probes enable sub-diffraction limited imaging with a spatial resolution consistent with the gap size. This novel nano-fabrication approach promises a low-cost, high-throughput, and reproducible manufacturing of advanced nano-optical devices.

36 MATERIALS SCIENCE↗

Connectivity-informed drainage network generation using deep convolution generative adversarial networks

Abstract Stochastic network modeling is often limited by high computational costs to generate a large number of networks enough for meaningful statistical evaluation. In this study, Deep Convolutional Generative Adversarial Networks (DCGANs) were applied to quickly reproduce drainage networks from the already generated network samples without repetitive long modeling of the stochastic network model, Gibb’s model. In particular, we developed a novel connectivity-informed method that converts the drainage network images to the directional information of flow on each node of the drainage network, and then transforms it into multiple binary layers where the connectivity constraints between nodes in the drainage network are stored. DCGANs trained with three different types of training samples were compared; (1) original drainage network images, (2) their corresponding directional information only, and (3) the connectivity-informed directional information. A comparison of generated images demonstrated that the novel connectivity-informed method outperformed the other two methods by training DCGANs more effectively and better reproducing accurate drainage networks due to its compact representation of the network complexity and connectivity. This work highlights that DCGANs can be applicable for high contrast images common in earth and material sciences where the network, fractures, and other high contrast features are important.

42 ENGINEERING↗

Synthetic antibacterial minerals: harnessing a natural geochemical reaction to combat antibiotic resistance

The overuse of antibiotics in clinical and livestock settings is accelerating the selection of multidrug resistant bacterial pathogens. Antibiotic resistant bacteria result in increased mortality and financial strain on the health care and livestock industry. The development of new antibiotics has stalled, and novel strategies are needed as we enter the age of antibiotic resistance. Certain naturally occurring clays have been shown to have antimicrobial properties and kill antibiotic resistant bacteria. Harnessing the activity of compounds within these clays that harbor antibiotic properties offers new therapeutic opportunities for fighting the potentially devastating effects of the post antibiotic era. However, natural samples are highly heterogenous and exhibit variable antibacterial effectiveness, therefore synthesizing minerals of high purity with reproducible antibacterial activity is needed. Here we describe for the first time synthetic smectite clay minerals and Fe-sulfide microspheres that reproduce the geochemical antibacterial properties observed in natural occurring clays. We show that these mineral formulations are effective at killing the ESKAPE pathogens ( Enterococcus sp., Staphylococcus aureus, Klebsiella pneumoniae, Acinetobacter sp., Pseudomonas aeruginosa and Enterobacter sp.) by maintaining Fe 2+ solubility and reactive oxygen species (ROS) production while buffering solution pH, unlike the application of metals alone. Our results represent the first step in utilizing a geochemical process to treat antibiotic resistant topical or gastrointestinal infections in the age of antibiotic resistance.

58 GEOSCIENCES↗

Single-shot X-ray absorption spectroscopy at X-ray free electron lasers

X-ray Absorption Spectroscopy (XAS) is a widely used X-ray diagnostic method for studying electronic and structural properties of matter. At first glance, the relatively narrow bandwidth and the highly fluctuating spectral structure of X-ray Free Electron Lasers (XFEL) sources seem to require accumulation over many shots to achieve high data quality. To date the best approach to implementing XAS at XFEL facilities has been using monochromators to scan the photon energy across the desired spectral range. While this is possible for easily reproducible samples such as liquids, it is incompatible with many important systems. Here, we demonstrate collection of single-shot XAS spectra over 10s of eV using an XFEL source, with error bars of only a few percent. We additionally show how to extend this technique over wider spectral ranges towards Extended X-ray Absorption Fine Structure measurements, by concatenating a few tens of single-shot measurements. Our results pave the way for future XAS studies at XFELs, in particular those in the femtosecond regime. This advance is envisioned to be especially important for many transient processes that can only be initiated at lower repetition rates, for difficult to reproduce excitation conditions, or for rare samples, such as those encountered in high-energy density physics.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Decadal predictability of North Atlantic blocking and the NAO

Can multi-annual variations in the frequency of North Atlantic atmospheric blocking and mid-latitude circulation regimes be skilfully predicted? Recent advances in seasonal forecasting have shown that mid-latitude climate variability does exhibit significant predictability. However, atmospheric predictability has generally been found to be quite limited on multi-annual timescales. New decadal prediction experiments from NCAR are found to exhibit remarkable skill in reproducing the observed multi-annual variations of wintertime blocking frequency over the North Atlantic and of the North Atlantic Oscillation (NAO) itself. This is partly due to the large ensemble size that allows the predictable component of the atmospheric variability to emerge from the background chaotic component. The predictable atmospheric anomalies represent a forced response to oceanic low-frequency variability that strongly resembles the Atlantic Multi-decadal Variability (AMV), correctly reproduced in the decadal hindcasts thanks to realistic ocean initialization and ocean dynamics. The occurrence of blocking in certain areas of the Euro-Atlantic domain determines the concurrent circulation regime and the phase of known teleconnections, such as the NAO, consequently affecting the stormtrack and the frequency and intensity of extreme weather events. Therefore, skilfully predicting the decadal fluctuations of blocking frequency and the NAO may be used in statistical predictions of near-term climate anomalies, and it provides a strong indication that impactful climate anomalies may also be predictable with improved dynamical models.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Full structural ensembles of intrinsically disordered proteins from unbiased molecular dynamics simulations

Abstract Molecular dynamics (MD) simulation is widely used to complement ensemble-averaged experiments of intrinsically disordered proteins (IDPs). However, MD often suffers from limitations of inaccuracy. Here, we show that enhancing the sampling using Hamiltonian replica-exchange MD (HREMD) led to unbiased and accurate ensembles, reproducing small-angle scattering and NMR chemical shift experiments, for three IDPs of varying sequence properties using two recently optimized force fields, indicating the general applicability of HREMD for IDPs. We further demonstrate that, unlike HREMD, standard MD can reproduce experimental NMR chemical shifts, but not small-angle scattering data, suggesting chemical shifts are insufficient for testing the validity of IDP ensembles. Surprisingly, we reveal that despite differences in their sequence, the inter-chain statistics of all three IDPs are similar for short contour lengths (< 10 residues). The results suggest that the major hurdle of generating an accurate unbiased ensemble for IDPs has now been largely overcome.

59 BASIC BIOLOGICAL SCIENCES↗