Sas-temper: Software for fitting small-angle scattering data that provides automated reproducibility characterization
Not Available
97 MATHEMATICS AND COMPUTING↗
SEARCH · Search NASA
Results for “Reproducibility characterization”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Development of characterized and reproducible syntactic foam of phenolic nylon for heat shields Final report, 1 Feb. - 31 Dec. 1965
Characterization and reproducibility of nylon phenolic resin syntactic foam for use in ablative heat shields of Scout vehicle nosecaps
ABLATING MATERIAL↗
Characterizing the Reproducibility of Noisy Quantum Circuits
The ability of a quantum computer to reproduce or replicate the results of a quantum circuit is a key concern for verifying and validating applications of quantum computing. Statistical variations in circuit outcomes that arise from ill-characterized fluctuations in device noise may lead to computational errors and irreproducible results. While device characterization offers a direct assessment of noise, an outstanding concern is how such metrics bound the reproducibility of a given quantum circuit. Here, we first directly assess the reproducibility of a noisy quantum circuit, in terms of the Hellinger distance between the computational results, and then we show that device characterization offers an analytic bound on the observed variability. We validate the method using an ensemble of single qubit test circuits, executed on a superconducting transmon processor with well-characterized readout and gate error rates. The resulting description for circuit reproducibility, in terms of a composite device parameter, is confirmed to define an upper bound on the observed Hellinger distance, across the variable test circuits. This predictive correlation between circuit outcomes and device characterization offers an efficient method for assessing the reproducibility of noisy quantum circuits.
97 MATHEMATICS AND COMPUTING↗
Recommendations for improving rigor and reproducibility in site specific characterization
Heterogeneous catalysis is driven by the interaction of reactant molecules and the catalyst surface. The locus of this interaction as well as the surrounding ensemble of atoms is referred to as the catalyst active site. Active site characterization attempts to distinguish active catalytic sites from inactive surface sites, to elucidate the structural and chemical nature of active sites, and to quantify active site concentration. Numerous techniques have been demonstrated to provide compositional and structural information about the active sites within a catalyst. However, each technique has its own limitations and experimental pitfalls that can lead to data misinterpretation or irreproducible results. Further, this work aims to provide an overview of the types of data that can be collected, to outline common experimental challenges and how to avoid them, and to assemble relevant references for the most used active site characterization techniques. More broadly, we aim to outline best practices for researchers to collect, interpret, and report active site characterization data in a way that provides the most benefit to the broader catalysis community. Increasing the rigor and reproducibility of active site characterization offers a strategy to better link properties with catalytic performance and to enable the community to develop consensus concerning these relationships.
37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
Perspective: Reproducible Coherence Characterization of Superconducting Quantum Devices
As the field of superconducting quantum computing approaches maturity, optimization of single-device performance is proving to be a promising avenue towards large-scale quantum computers. However, this optimization is possible only if performance metrics can be accurately compared among measurements, devices, and laboratories. Currently such comparisons are inaccurate or impossible due to understudied errors from a plethora of sources. In this Perspective, we outline the current state of error analysis for qubits and resonators in superconducting quantum circuits, and discuss what future investigations are required before superconducting quantum device optimization can be realized.
McRae, Corey H.↗
BiomeProbe [Abstract]
We propose the development and application of a microtiter plate-based chemical probe assay that can facilitate the rapid quantification of fecal microbiome-associated enzyme functional activities (“gut pharmacomicrobiomics”). Our initial proof-of-concept project with FedImpact is to show that one or more glucuronidase probes can be used for sensitive and reproducible characterization of fecal microbe glucuronidase activities. Glucuronidase enzymes are important for contributing to enterohepatic recycling of therapeutic drug compounds, resulting in impaired or prolonged drug activity. Importantly, the assay to be developed will permit facile ‘swapping’ of chemical probes to characterize different and multiple enzyme activities. Similarly, the assay is naïve to the biological sample to be analyzed.
59 BASIC BIOLOGICAL SCIENCES↗
Data From Experiments on Bubbling Fluidization of Zeolite in a Rectangular Bubbling Fluidized Bed
Fluidization experiments were conducted in a lab-scale rectangular bubbling fluidized bed with the objective of generating a high-quality dataset for model validation and artificial intelligence/machine learning (AI/ML) training. Zeolite was chosen as the bed material, and the fluidizing medium was air as supplied by a compressor. Three different flow rates at the inlet were chosen such that the particles were fluidized but not elutriated from the system. The test matrix involved randomization and replicates to provide uncertainty estimates as well as four different batches of zeolite as the bed material. The quantities of interest obtained from this study were statistics of differential pressures, interface heights, and particle velocities. Considering all the components of the elaborate test plan, the results obtained were consistent and reproducible. Characterization tests were performed to estimate particle properties including size, density, coefficient of friction, coefficient of restitution, and minimum fluidization velocity. In addition, the angle of repose from granular discharge experiments has been reported to account for rolling friction, though its effect on the overall process is expected to be negligible.
37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
Crystal Size Distributions from Porphyritic Olivine Chondrules: Insights into Formation Conditions
Most chondrules preserve, in their texture, a record of their precursor material and the nature and intensity of the nebular events in which they were formed. We have used crystal size distributions (CSDs) together with crystallization experiments to explore the textures of natural chondrules and their relationships to natural formation conditions. Many careful experimental studies have demonstrated fundamental relationships between the texture of a chondrule and its precursor material, melting intensity, and cooling rate. However, until recently most studies have focused on distinctions between textural types (e.g., barred, radial, porphyritic). Previous work has shown that CSDs provide precise, reproducible characterizations of chondrule-scale textures, and can be used together with crystallization experiments to estimate chondrule formation conditions. Here, we expand this study to investigate the link between texture and formation conditions for a range of natural porphyritic olivine (PO) chondrules.
Zieg, M. J.↗
Materials characterization: Can artificial intelligence be used to address reproducibility challenges?
Material characterization techniques are widely used to characterize the physical and chemical properties of materials at the nanoscale and, thus, play central roles in material scientific discoveries. However, the large and complex datasets generated by these techniques often require significant human effort to interpret and extract meaningful physicochemical insights. Artificial intelligence (AI) techniques such as machine learning (ML) have the potential to improve the efficiency and accuracy of surface analysis by automating data analysis and interpretation. In this perspective paper, we review the current role of AI in surface analysis and discuss its future potential to accelerate discoveries in surface science, materials science, and interface science. We highlight several applications where AI has already been used to analyze surface analysis data, including the identification of crystal structures from XRD data, analysis of XPS spectra for surface composition, and the interpretation of TEM and SEM images for particle morphology and size. We also discuss the challenges and opportunities associated with the integration of AI into surface analysis workflows. These include the need for large and diverse datasets for training ML models, the importance of feature selection and representation, and the potential for ML to enable new insights and discoveries by identifying patterns and relationships in complex datasets. Most importantly, AI analyzed data must not just find the best mathematical description of the data, but it must find the most physical and chemically meaningful results. In addition, the need for reproducibility in scientific research has become increasingly important in recent years. The advancement of AI, including both conventional and the increasing popular deep learning, is showing promise in addressing those challenges by enabling the execution and verification of scientific progress. By training models on large experimental datasets and providing automated analysis and data interpretation, AI can help to ensure that scientific results are reproducible and reliable. Although integration of knowledge and AI models must be considered for the transparency and interpretability of models, the incorporation of AI into the data collection and processing workflow will significantly enhance the efficiency and accuracy of various surface analysis techniques and deepen our understanding at an accelerated pace.
Materials Science↗
Automated ICRF heating surrogate modeling via machine learning
This work introduces automated machine learning workflows that address critical bottlenecks in surrogate model development for Ion Cyclotron Range of Frequencies (ICRF) heating applications. The automated framework includes data analysis tools that transform raw datasets into actionable insights in seconds, replacing weeks of manual exploratory effort and ensuring consistent, reproducible dataset characterization. By integrating advanced hyperparameter optimization (HPO) methods including Bayesian optimization via BoTorch and Tree-structured Parzen Estimators (TPE), the framework significantly reduces model development time from weeks to hours, decreasing computational cost and required expertise, while enabling high-accuracy surrogate models. Compared to traditional hyperparameter scanning (HPS) techniques such as methodical, randomized, and grid searches, HPO methods achieve superior convergence and predictive performance, even when compared to already well-tuned reference models. On NSTX High Harmonic Fast Wave (HHFW) heating datasets, both Random Forest Regressor (RFR) and neural network surrogates demonstrate improved accuracy, achieving R 2 values beyond 0.97 and 0.98, respectively. The results show that while HPO gains are modest for robust architectures like RFR, they become essential for more sensitive models such as neural networks, highlighting the trade-offs across optimization strategies. Through automated workflows that eliminate manual hyperparameter tuning and require minimal ML expertise, this work enables widespread adoption of high-fidelity surrogate models across the fusion community for real-time plasma control, uncertainty quantification, rapid experimental scenario development, and integrated system optimization.
Sanchez-Villar, Alvaro [Princeton Plasma Physics L↗
Characterizing the Superconducting-to-Normal Transition in Mo/Au Transition-Edge Sensor Bilayers
We are developing arrays of Mo/Au bilayer transition-edge sensors (TES's) for applications in future X-ray astronomy missions such as NASA's Constellation-X. The physical properties of the superconducting-to-normal transition in our TES bilayers, while often reproducible and characterized, are not well understood. The addition of normal metal features on top of the bilayer are found to change the shape and temperature of the transition, and they typically reduce the unexplained 'excess' noise. In order to understand and potentially optimize the properties of the transition, we have been studying the temperature, widths and current dependence of these transitions. We report on the characterization of devices both deposited on silicon substrates and suspended on thin silicon nitride membranes. This includes key device parameters such as the logarithmic resistance sensitivity with temperature alpha, and the logarithmic resistance sensitivity with current beta, of the phase-transition. We investigate alpha and beta as a function of current, both at fixed and varying bias points in the transition. Using Ginzburg-Landau theory for the current dependence of the superconducting transition temperature, we investigate the relationship between alpha and beta and compare our measured and theoretical estimates.
Smith, Stephen J.↗
Performance Characterization and Provenance of Distributed Task-based Workflows on HPC Platforms
Understanding performance and provenance of task-based workflows poses significant challenges, particularly in distributed configurations where resources are shared by multiple applications. Task-based workflow management systems further complicate performance predictability because of their dynamicity that subtly alters task execution order from run to run. In this paper we propose a layered characterization framework for performance and task provenance for Dask.distributed workflows running on high-performance computing (HPC) platforms. It collects data from jobs, the workflow management system, and the operating system to aid in understanding the performance of these workflows. Our approach encompasses three main contributions: first, an extension of Dask.distributed to capture high-fidelity task provenance using Mochi data services; second, the adaptation of the established HPC I/O characterization tool Darshan to gather high-fidelity I/O data, thereby enhancing the granularity of our analysis; and third, a framework to combine and process the collected data and provide helpful insights into performance characterization and reproducibility, alongside our lessons learned.
Dask↗
Computer Vision Pipeline for Image Analysis for Freeze‐Fracture Electron Microscopy: Rosette Cellulose Synthase Complexes Case
In materials science, plant biology, agriculture, and environmental research, the automated analysis of high-magnification, complex microscopy images, such as those generated by freeze-fracture electron microscopy (FF-TEM), remains a critical challenge that limits the scalability of data interpretation. We present a deep learning computer vision pipeline for high-throughput detection and morphological characterization analysis of cellulose synthase complexes (CSCs, or rosettes) in FF-TEM images. The pipeline integrates preprocessing, detection, human-in-the-loop verification, and semantic segmentation to quantify features such as rosette diameter and inter-lobe spacing. The approach was trained and tested on a curated dataset of high-resolution FF-TEM micrographs of Physcomitrium patens, expanded via strategic tiling and augmentation to over 650 images. We compare YOLOv8 and YOLOv9 architectures and demonstrate that YOLOv9 achieves superior performance in both localization accuracy (mAP50-95 = 0.854) and inference speed. The resulting distributions revealed biological variability consistent with prior manual studies, validating the approach for high-throughput applications. Our results show that the pipeline achieves human-expert level accuracy while dramatically reducing analysis time, enabling scalable, reproducible structural characterization of intramembrane protein complexes. The pipeline is broadly applicable to other domains requiring precise interpretation of complex microscopy data and establishes a foundation for future artificial intelligence (AI)-assisted workflows in biological imaging.
59 BASIC BIOLOGICAL SCIENCES↗
Rapid Open-Air Processing of Low-Cost Perovskite Solar Modules
We report an industrially relevant approach to both scalable and fast open-air perovskite photovoltaic (PV) module production. This work resolves some of the most formidable barriers to module-level scaling that the perovskite community has been facing. Key advances include scalable large-area spray deposition, new monolithic integration scribing techniques, advanced photoluminescence characterization, and reproducible high-throughput manufacturability. Our rapid spray processing techniques enabled the highest perovskite PV efficiency produced in open-air. Innovations in scribing techniques enabled the first single-source laser process to achieve perovskite module monolithic integration and technoeconomic analysis led to a comprehensive cost model for perovskite module manufacturing. We report significant progress in reducing perovskite manufacturing costs necessary to potentially compete with incumbent Si-based PV for utility-scale power generation.
cost modeling↗
Status of the MQXFB Nb 3 Sn Quadrupoles for the HL-LHC
Here, the cold powering test of the first two prototypes of the MQXFB quadrupoles (MQXFBP1, now disassembled, and MQXFBP2), the Nb 3 Sn inner triplet magnets to be installed in the HL-LHC, has validated many features of the design, such as field quality and quench protection, but has found performance limitations. In fact, both magnets showed a similar phenomenology, characterized by reproducible quenches in the straight part inner layer pole turn, with absence of training and limiting the performance at 93% (MQXFBP1) and 98% (MQXFBP2) of the nominal current at 1.9 K, required for HL-LHC operation at 7 TeV. Microstructural inspections of the quenching section of the limiting coil in MQXFBP1 have identified fractured Nb 3 Sn sub-elements in strands located at one specific position of the inner layer pole turn, allowing to determine the precise origin of the performance limitation. In this paper we outline the strategy that has been defined to address the possible sources of performance limitation, namely coil manufacturing, magnet assembly and integration in the cold mass.
72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
Vibration Isolation Technology (VIT) ATD Project
A fundamental advantage for performing material processing and fluid physics experiments in an orbital environment is the reduction in gravity driven phenomena. However, experience with manned spacecraft such as the Space Transportation System (STS) has demonstrated a dynamic acceleration environment far from being characterized as a 'microgravity' platform. Vibrations and transient disturbances from crew motions, thruster firings, rotating machinery etc. can have detrimental effects on many proposed microgravity science experiments. These same disturbances are also to be expected on the future space station. The Microgravity Science and Applications Division (MSAD) of the Office of Life and Microgravity Sciences and Applications (OLMSA), NASA Headquarters recognized the need for addressing this fundamental issue. As a result an Advanced Technology Development (ATD) project was initiated in the area of Vibration Isolation Technology (VIT) to develop methodologies for meeting future microgravity science needs. The objective of the Vibration Isolation Technology ATD project was to provide technology for the isolation of microgravity science experiments by developing methods to maintain a predictable, well defined, well characterized, and reproducible low-gravity environment, consistent with the needs of the microgravity science community. Included implicitly in this objective was the goal of advising the science community and hardware developers of the fundamental need to address the importance of maintaining, and how to maintain, a microgravity environment. This document will summarize the accomplishments of the VIT ATD which is now completed. There were three specific thrusts involved in the ATD effort. An analytical effort was performed at the Marshall Space Flight Center to define the sensitivity of selected experiments to residual and dynamic accelerations. This effort was redirected about half way through the ATD focusing specifically on the sensitivity of protein crystals to a realistic orbital environment. The other two thrusts of the ATD were performed at the Lewis Research Center. The first was to develop technology in the area of reactionless mechanisms and robotics to support the eventual development of robotics for servicing microgravity science experiments. This activity was completed in 1990. The second was to develop vibration isolation and damping technology providing protection for sensitive science experiments. In conjunction with the this activity, two workshops were held. The results of these were summarized and are included in this report.
Lubomski, Joseph F.↗
Software Suite to Support In-Flight Characterization of Remote Sensing Systems
A characterization software suite was developed to facilitate NASA's in-flight characterization of commercial remote sensing systems. Characterization of aerial and satellite systems requires knowledge of ground characteristics, or ground truth. This information is typically obtained with instruments taking measurements prior to or during a remote sensing system overpass. Acquired ground-truth data, which can consist of hundreds of measurements with different data formats, must be processed before it can be used in the characterization. Accurate in-flight characterization of remote sensing systems relies on multiple field data acquisitions that are efficiently processed, with minimal error. To address the need for timely, reproducible ground-truth data, a characterization software suite was developed to automate the data processing methods. The characterization software suite is engineering code, requiring some prior knowledge and expertise to run. The suite consists of component scripts for each of the three main in-flight characterization types: radiometric, geometric, and spatial. The component scripts for the radiometric characterization operate primarily by reading the raw data acquired by the field instruments, combining it with other applicable information, and then reducing it to a format that is appropriate for input into MODTRAN (MODerate resolution atmospheric TRANsmission), an Air Force Research Laboratory-developed radiative transport code used to predict at-sensor measurements. The geometric scripts operate by comparing identified target locations from the remote sensing image to known target locations, producing circular error statistics defined by the Federal Geographic Data Committee Standards. The spatial scripts analyze a target edge within the image, and produce estimates of Relative Edge Response and the value of the Modulation Transfer Function at the Nyquist frequency. The software suite enables rapid, efficient, automated processing of ground truth data, which has been used to provide reproducible characterizations on a number of commercial remote sensing systems. Overall, this characterization software suite improves the reliability of ground-truth data processing techniques that are required for remote sensing system in-flight characterizations.
Stanley, Thomas↗
Exploring the exact limits of the real-time equation-of-motion coupled cluster cumulant Green’s functions
In this paper, we analyze the properties of the recently proposed real-time equation-of-motion coupled-cluster (RT-EOM-CC) cumulant Green’s function approach [Rehr et al., J. Chem. Phys. 152, 174113 (2020)]. We specifically focus on identifying the limitations of the original time-dependent coupled cluster (TDCC) ansatz and propose an enhanced double TDCC ansatz, ensuring the exactness in the expansion limit. In addition, we introduce a practical cluster-analysis-based approach for characterizing the peaks in the computed spectral function from the RT-EOM-CC cumulant Green’s function approach, which is particularly useful for the assignments of satellite peaks when many-body effects dominate the spectra. Our preliminary numerical tests focus on reproducing, approximating, and characterizing the exact impurity Green’s function of the three-site and four-site single impurity Anderson models using the RT-EOM-CC cumulant Green’s function approach. The numerical tests allow us to have a direct comparison between the RT-EOM-CC cumulant Green’s function approach and other Green’s function approaches in the numerical exact limit.
37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗