Sas-temper: Software for fitting small-angle scattering data that provides automated reproducibility characterization
Not Available
97 MATHEMATICS AND COMPUTING↗
SEARCH · Search NASA
Results for “Reproducibility characterization”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Characterizing the Reproducibility of Noisy Quantum Circuits
The ability of a quantum computer to reproduce or replicate the results of a quantum circuit is a key concern for verifying and validating applications of quantum computing. Statistical variations in circuit outcomes that arise from ill-characterized fluctuations in device noise may lead to computational errors and irreproducible results. While device characterization offers a direct assessment of noise, an outstanding concern is how such metrics bound the reproducibility of a given quantum circuit. Here, we first directly assess the reproducibility of a noisy quantum circuit, in terms of the Hellinger distance between the computational results, and then we show that device characterization offers an analytic bound on the observed variability. We validate the method using an ensemble of single qubit test circuits, executed on a superconducting transmon processor with well-characterized readout and gate error rates. The resulting description for circuit reproducibility, in terms of a composite device parameter, is confirmed to define an upper bound on the observed Hellinger distance, across the variable test circuits. This predictive correlation between circuit outcomes and device characterization offers an efficient method for assessing the reproducibility of noisy quantum circuits.
97 MATHEMATICS AND COMPUTING↗
Recommendations for improving rigor and reproducibility in site specific characterization
Heterogeneous catalysis is driven by the interaction of reactant molecules and the catalyst surface. The locus of this interaction as well as the surrounding ensemble of atoms is referred to as the catalyst active site. Active site characterization attempts to distinguish active catalytic sites from inactive surface sites, to elucidate the structural and chemical nature of active sites, and to quantify active site concentration. Numerous techniques have been demonstrated to provide compositional and structural information about the active sites within a catalyst. However, each technique has its own limitations and experimental pitfalls that can lead to data misinterpretation or irreproducible results. Further, this work aims to provide an overview of the types of data that can be collected, to outline common experimental challenges and how to avoid them, and to assemble relevant references for the most used active site characterization techniques. More broadly, we aim to outline best practices for researchers to collect, interpret, and report active site characterization data in a way that provides the most benefit to the broader catalysis community. Increasing the rigor and reproducibility of active site characterization offers a strategy to better link properties with catalytic performance and to enable the community to develop consensus concerning these relationships.
37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
Perspective: Reproducible Coherence Characterization of Superconducting Quantum Devices
As the field of superconducting quantum computing approaches maturity, optimization of single-device performance is proving to be a promising avenue towards large-scale quantum computers. However, this optimization is possible only if performance metrics can be accurately compared among measurements, devices, and laboratories. Currently such comparisons are inaccurate or impossible due to understudied errors from a plethora of sources. In this Perspective, we outline the current state of error analysis for qubits and resonators in superconducting quantum circuits, and discuss what future investigations are required before superconducting quantum device optimization can be realized.
McRae, Corey H.↗
BiomeProbe [Abstract]
We propose the development and application of a microtiter plate-based chemical probe assay that can facilitate the rapid quantification of fecal microbiome-associated enzyme functional activities (“gut pharmacomicrobiomics”). Our initial proof-of-concept project with FedImpact is to show that one or more glucuronidase probes can be used for sensitive and reproducible characterization of fecal microbe glucuronidase activities. Glucuronidase enzymes are important for contributing to enterohepatic recycling of therapeutic drug compounds, resulting in impaired or prolonged drug activity. Importantly, the assay to be developed will permit facile ‘swapping’ of chemical probes to characterize different and multiple enzyme activities. Similarly, the assay is naïve to the biological sample to be analyzed.
59 BASIC BIOLOGICAL SCIENCES↗
Data From Experiments on Bubbling Fluidization of Zeolite in a Rectangular Bubbling Fluidized Bed
Fluidization experiments were conducted in a lab-scale rectangular bubbling fluidized bed with the objective of generating a high-quality dataset for model validation and artificial intelligence/machine learning (AI/ML) training. Zeolite was chosen as the bed material, and the fluidizing medium was air as supplied by a compressor. Three different flow rates at the inlet were chosen such that the particles were fluidized but not elutriated from the system. The test matrix involved randomization and replicates to provide uncertainty estimates as well as four different batches of zeolite as the bed material. The quantities of interest obtained from this study were statistics of differential pressures, interface heights, and particle velocities. Considering all the components of the elaborate test plan, the results obtained were consistent and reproducible. Characterization tests were performed to estimate particle properties including size, density, coefficient of friction, coefficient of restitution, and minimum fluidization velocity. In addition, the angle of repose from granular discharge experiments has been reported to account for rolling friction, though its effect on the overall process is expected to be negligible.
37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
Materials characterization: Can artificial intelligence be used to address reproducibility challenges?
Material characterization techniques are widely used to characterize the physical and chemical properties of materials at the nanoscale and, thus, play central roles in material scientific discoveries. However, the large and complex datasets generated by these techniques often require significant human effort to interpret and extract meaningful physicochemical insights. Artificial intelligence (AI) techniques such as machine learning (ML) have the potential to improve the efficiency and accuracy of surface analysis by automating data analysis and interpretation. In this perspective paper, we review the current role of AI in surface analysis and discuss its future potential to accelerate discoveries in surface science, materials science, and interface science. We highlight several applications where AI has already been used to analyze surface analysis data, including the identification of crystal structures from XRD data, analysis of XPS spectra for surface composition, and the interpretation of TEM and SEM images for particle morphology and size. We also discuss the challenges and opportunities associated with the integration of AI into surface analysis workflows. These include the need for large and diverse datasets for training ML models, the importance of feature selection and representation, and the potential for ML to enable new insights and discoveries by identifying patterns and relationships in complex datasets. Most importantly, AI analyzed data must not just find the best mathematical description of the data, but it must find the most physical and chemically meaningful results. In addition, the need for reproducibility in scientific research has become increasingly important in recent years. The advancement of AI, including both conventional and the increasing popular deep learning, is showing promise in addressing those challenges by enabling the execution and verification of scientific progress. By training models on large experimental datasets and providing automated analysis and data interpretation, AI can help to ensure that scientific results are reproducible and reliable. Although integration of knowledge and AI models must be considered for the transparency and interpretability of models, the incorporation of AI into the data collection and processing workflow will significantly enhance the efficiency and accuracy of various surface analysis techniques and deepen our understanding at an accelerated pace.
Materials Science↗
Automated ICRF heating surrogate modeling via machine learning
This work introduces automated machine learning workflows that address critical bottlenecks in surrogate model development for Ion Cyclotron Range of Frequencies (ICRF) heating applications. The automated framework includes data analysis tools that transform raw datasets into actionable insights in seconds, replacing weeks of manual exploratory effort and ensuring consistent, reproducible dataset characterization. By integrating advanced hyperparameter optimization (HPO) methods including Bayesian optimization via BoTorch and Tree-structured Parzen Estimators (TPE), the framework significantly reduces model development time from weeks to hours, decreasing computational cost and required expertise, while enabling high-accuracy surrogate models. Compared to traditional hyperparameter scanning (HPS) techniques such as methodical, randomized, and grid searches, HPO methods achieve superior convergence and predictive performance, even when compared to already well-tuned reference models. On NSTX High Harmonic Fast Wave (HHFW) heating datasets, both Random Forest Regressor (RFR) and neural network surrogates demonstrate improved accuracy, achieving R 2 values beyond 0.97 and 0.98, respectively. The results show that while HPO gains are modest for robust architectures like RFR, they become essential for more sensitive models such as neural networks, highlighting the trade-offs across optimization strategies. Through automated workflows that eliminate manual hyperparameter tuning and require minimal ML expertise, this work enables widespread adoption of high-fidelity surrogate models across the fusion community for real-time plasma control, uncertainty quantification, rapid experimental scenario development, and integrated system optimization.
Sanchez-Villar, Alvaro [Princeton Plasma Physics L↗
Performance Characterization and Provenance of Distributed Task-based Workflows on HPC Platforms
Understanding performance and provenance of task-based workflows poses significant challenges, particularly in distributed configurations where resources are shared by multiple applications. Task-based workflow management systems further complicate performance predictability because of their dynamicity that subtly alters task execution order from run to run. In this paper we propose a layered characterization framework for performance and task provenance for Dask.distributed workflows running on high-performance computing (HPC) platforms. It collects data from jobs, the workflow management system, and the operating system to aid in understanding the performance of these workflows. Our approach encompasses three main contributions: first, an extension of Dask.distributed to capture high-fidelity task provenance using Mochi data services; second, the adaptation of the established HPC I/O characterization tool Darshan to gather high-fidelity I/O data, thereby enhancing the granularity of our analysis; and third, a framework to combine and process the collected data and provide helpful insights into performance characterization and reproducibility, alongside our lessons learned.
Dask↗
Computer Vision Pipeline for Image Analysis for Freeze‐Fracture Electron Microscopy: Rosette Cellulose Synthase Complexes Case
In materials science, plant biology, agriculture, and environmental research, the automated analysis of high-magnification, complex microscopy images, such as those generated by freeze-fracture electron microscopy (FF-TEM), remains a critical challenge that limits the scalability of data interpretation. We present a deep learning computer vision pipeline for high-throughput detection and morphological characterization analysis of cellulose synthase complexes (CSCs, or rosettes) in FF-TEM images. The pipeline integrates preprocessing, detection, human-in-the-loop verification, and semantic segmentation to quantify features such as rosette diameter and inter-lobe spacing. The approach was trained and tested on a curated dataset of high-resolution FF-TEM micrographs of Physcomitrium patens, expanded via strategic tiling and augmentation to over 650 images. We compare YOLOv8 and YOLOv9 architectures and demonstrate that YOLOv9 achieves superior performance in both localization accuracy (mAP50-95 = 0.854) and inference speed. The resulting distributions revealed biological variability consistent with prior manual studies, validating the approach for high-throughput applications. Our results show that the pipeline achieves human-expert level accuracy while dramatically reducing analysis time, enabling scalable, reproducible structural characterization of intramembrane protein complexes. The pipeline is broadly applicable to other domains requiring precise interpretation of complex microscopy data and establishes a foundation for future artificial intelligence (AI)-assisted workflows in biological imaging.
59 BASIC BIOLOGICAL SCIENCES↗
Rapid Open-Air Processing of Low-Cost Perovskite Solar Modules
We report an industrially relevant approach to both scalable and fast open-air perovskite photovoltaic (PV) module production. This work resolves some of the most formidable barriers to module-level scaling that the perovskite community has been facing. Key advances include scalable large-area spray deposition, new monolithic integration scribing techniques, advanced photoluminescence characterization, and reproducible high-throughput manufacturability. Our rapid spray processing techniques enabled the highest perovskite PV efficiency produced in open-air. Innovations in scribing techniques enabled the first single-source laser process to achieve perovskite module monolithic integration and technoeconomic analysis led to a comprehensive cost model for perovskite module manufacturing. We report significant progress in reducing perovskite manufacturing costs necessary to potentially compete with incumbent Si-based PV for utility-scale power generation.
cost modeling↗
Status of the MQXFB Nb 3 Sn Quadrupoles for the HL-LHC
Here, the cold powering test of the first two prototypes of the MQXFB quadrupoles (MQXFBP1, now disassembled, and MQXFBP2), the Nb 3 Sn inner triplet magnets to be installed in the HL-LHC, has validated many features of the design, such as field quality and quench protection, but has found performance limitations. In fact, both magnets showed a similar phenomenology, characterized by reproducible quenches in the straight part inner layer pole turn, with absence of training and limiting the performance at 93% (MQXFBP1) and 98% (MQXFBP2) of the nominal current at 1.9 K, required for HL-LHC operation at 7 TeV. Microstructural inspections of the quenching section of the limiting coil in MQXFBP1 have identified fractured Nb 3 Sn sub-elements in strands located at one specific position of the inner layer pole turn, allowing to determine the precise origin of the performance limitation. In this paper we outline the strategy that has been defined to address the possible sources of performance limitation, namely coil manufacturing, magnet assembly and integration in the cold mass.
72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
Exploring the exact limits of the real-time equation-of-motion coupled cluster cumulant Green’s functions
In this paper, we analyze the properties of the recently proposed real-time equation-of-motion coupled-cluster (RT-EOM-CC) cumulant Green’s function approach [Rehr et al., J. Chem. Phys. 152, 174113 (2020)]. We specifically focus on identifying the limitations of the original time-dependent coupled cluster (TDCC) ansatz and propose an enhanced double TDCC ansatz, ensuring the exactness in the expansion limit. In addition, we introduce a practical cluster-analysis-based approach for characterizing the peaks in the computed spectral function from the RT-EOM-CC cumulant Green’s function approach, which is particularly useful for the assignments of satellite peaks when many-body effects dominate the spectra. Our preliminary numerical tests focus on reproducing, approximating, and characterizing the exact impurity Green’s function of the three-site and four-site single impurity Anderson models using the RT-EOM-CC cumulant Green’s function approach. The numerical tests allow us to have a direct comparison between the RT-EOM-CC cumulant Green’s function approach and other Green’s function approaches in the numerical exact limit.
37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
3-D Geological Modeling for Numerical Flow Simulation Studies of Gas Hydrate Reservoirs at the Kuparuk State 7-11-12 Pad in the Prudhoe Bay Unit on the Alaska North Slope
Accurate reservoir evaluation requires reliable three-dimensional (3-D) geological models. Here, this study conducted 3-D geological modeling for numerical flow simulation of the B1 sand gas hydrate reservoir at the Kuparuk State 7-11-12 pad, Prudhoe Bay Unit, Alaska North Slope. The model integrates well logs, core, and seismic data to address spatial heterogeneity in geological structures and reservoir properties. Two modeling types were performed: structural framework modeling and petrophysical property modeling. For structural framework modeling, seismic data and well log markers were used to reproduce subsurface structures characterized by a normal fault system. A volume-based modeling algorithm and stair-stepping grid were applied. The resulting 3-D model comprised 2,640,000 grid cells across 264 layers, including seven fault grids. For petrophysical property modeling, total porosity was initially modeled using sequential Gaussian simulation with collocated cokriging. To reproduce the upward coarsening of the B1 sand, upscaled log-derived total porosity and a three-dimensional (3-D) trend depicting total porosity variation were used as primary and secondary data, respectively. Gas hydrate saturation distribution was modeled similarly, with secondary data from estimated porosity distribution and seismic-derived acoustic impedance map enhancing accuracy. Results indicate higher gas hydrate saturation in the upper part of the B1 sand and areas with higher acoustic impedance. Intrinsic permeability was modeled from the total porosity and clay-bound water volume, and effective permeability was derived from the gas hydrate saturation and intrinsic permeability distributions based on the “Tokyo model”. Effective permeability distributions were influenced by the total porosity, gas hydrate saturation, and intrinsic permeability. Within the same layer, higher gas hydrate saturation leads to decreased effective permeability. In total, 100 sets of multiple scenarios were prepared, providing input data for dynamic flow simulations to evaluate the effects of lateral heterogeneity in reservoir properties and the hydraulic characteristics of faults on production behavior for preassessment before the long-term production test.
58 GEOSCIENCES↗
Frequency reproducibility of solid-state thorium-229 nuclear clocks
Solid-state thorium-229 ( 229 Th) nuclear clocks are set to provide new opportunities for precision metrology and fundamental physics. Taking advantage of inherent low sensitivity of a nuclear transition to its environment, orders of magnitude more emitters can be hosted in a solid-state crystal compared with current optical lattice atomic clocks. Furthermore, solid-state systems needing only simple thermal control are key to the development of field-deployable compact clocks. Here we explore and characterize the frequency reproducibility of the 229 Th:CaF 2 nuclear clock transition, a key performance metric for all clocks. We measure the transition linewidth and centre frequency as a function of the doping concentration, temperature and time. We report the concentration-dependent inhomogeneous linewidth of the nuclear transition, limited by the intrinsic host crystal properties. We determine an optimal working temperature for the 229 Th:CaF 2 nuclear clock at 196(5) K, at which the first-order thermal sensitivity vanishes. This would enable in situ temperature co-sensing using different quadrupole-split lines, reducing the temperature-induced systematic shift below the 10 −18 fractional frequency uncertainty level. At 195 K, the reproducibility of the nuclear transition frequency is 220 Hz (fractionally 1.1 × 10 −13 ) for two differently doped 229 Th:CaF 2 crystals over 7 months. Furthermore, these results form the foundation for understanding, controlling and harnessing the coherent nuclear excitation of 229 Th in solid-state hosts and for their applications in constraining temporal variations of fundamental constants.
Atomic and molecular physics↗
Variation in supercurrent connectivity and vortex pinning of state-of-the-art pulsed laser deposited RE Ba 2 Cu 3 O 7- x coated conductors
REBa 2 Cu 3 O 7-x (REBCO, RE: rare earth) coated conductors (CCs) suffer from great critical current I c differences between different manufacturers, I c variations within individual manufacturers, and often significant lengthwise fluctuations. The understanding of such variations is complicated by the lack of a direct correlation between I c and the critical current density J c . In fact, although J c is the fundamental property determined by the local vortex pinning landscape, I c is often limited by variable current blocking mechanisms. An important practical complexity is commercial practices of performing J c and I c evaluations based on I c at 77 K and self-field (sf), where connectivity variation dominates over vortex pinning variations. However, at higher fields and lower temperatures, vortex pinning becomes more complex and highly variable, making predictions of I c and J c at arbitrary temperature T, magnetic field H, and field orientation θ, quite uncertain. To address some aspects of this problem, we conducted detailed spool-to-spool performance characterization on recently manufactured REBCO CCs. Despite J c (77 K, sf) varies by only ∼11%, J c (77 K, 1 T) of its minimum and maximum (for H//ab-plane) show variations of ∼21% and ∼32%, respectively. This emphasizes the shortcoming in using J c (77 K, sf) as parameter for evaluating even the low field performance. An even more remarkable spool-to-spool J c variation of ∼68% was observed at 20 K and 15 T for H//ab-plane. To identify the origin of such lack of reproducibility we performed microstructural characterizations, which revealed, within the REBCO layer, large variation in the density of copper oxide (CuO x ) particles ranging from 0.1 to 2 μm in size. We believe that they play a decisive role in reducing the effective cross-section of the REBCO layer by not simply blocking current themselves, but also by nucleating off-axis REBCO grains, whose misoriented grain boundaries adversely impact REBCO grain-to-grain connectivity. The REBCO growth associated with high density CuO x particles also leads to the more disordered spatial arrangement of BaHfO 3 precipitate arrays, which, when self-aligning along the ab-planes, generate stronger pinning enhancing J c (H//ab) at all temperatures. In this way, we established that variations of both connectivity and vortex pinning are thus directly coupled. Our results also explain why the so-called ‘lift-factor’, typically defined by the ratio between I c (T, H) and I c (77 K, sf), frequently turns out to be unreliable.
36 MATERIALS SCIENCE↗
Molten Salt Corrosion Tests of Additively Manufactured Stainless Steel 316H
Molten salt reactors (MSRs) have drawn considerable interest due to their favorable safety features, high thermal efficiency, and compatibility with different fuel cycles. Yet, the success of MSRs hinges critically on the performance of structural materials to be used in these aggressive molten salt environments, where corrosion and material compatibility remain primary challenges to long-term reliability. Additively manufactured (AM) nuclear structural materials prompt the use of novel geometries and compositions to enhance material performance and reduce costs of constructing MSRs. The rapid solidification conditions inherent to AM processing impart distinctive microstructural features, including cellular sub-structures, dislocation densities, residual stress, and oxide inclusions, which can influence material performance in MSR components. While the mechanical properties of AM stainless steels have been widely studied, their corrosion behavior, particularly in molten salt environments, has received far less attention. Addressing these needs, the Advanced Materials and Manufacturing Technologies (AMMT) program provides a framework for systematically evaluating how unique microstructures produced by AM processes influence the performance of these materials in these demanding environments and for developing reproducible testing workflows that can support future code qualification efforts and standards development. Bridging this knowledge gap is essential for assessing the viability of AM alloys in MSRs and informing qualification strategies. A further challenge is the absence of standardized protocols for molten salt corrosion testing. Accordingly, this report provides an account of the corrosion evaluation of AM 316H stainless steel in NaCl 2 -MgCl 2 molten salt at 550 °C, with exposure times of 100 and 500 hours. It documents the experimental procedures implemented under the AMMT program, including salt preparation, exposure protocols, and post-test characterization methods, to establish reproducibility and transparency. Importantly, the study examines AM 316H samples in the as-fabricated condition, directly reflecting the surface state most relevant to engineering applications, and compares their behavior to machine-cut surfaces. Overall, preliminary evaluations have noted that surface conditions (e.g. morphology, contamination, etc.) have a noticeable impact on the corrosion resiliency. The impact of the corrosion is difficult to detect at 100h, unless, in the case of AM 316H, the specimen surface is decontaminated. After 500 h, as-fabricated surfaces of AM and wrought 316H display evidence of general versus preferential corrosion attack, respectively. Both AM and wrought 316H machine-cut surfaces exhibit a continuous Cr depletion zone, evident of general corrosion. While the estimated extent of corrosion appears within the same order of magnitude regardless of the surface condition, it is apparent that more predictable behavior is observed on machine-cut surfaces. Nonetheless, further investigation is necessary to fully elucidate the corrosion mechanism under these conditions.
36 - MATERIALS SCIENCE↗
A crystal plasticity model with an atomistically informed description of grain boundary sliding for improved predictions of deformation fields
Crystal plasticity (CP) is a powerful meso-scale technique for deformation modeling in polycrystalline materials. Crystal plasticity models typically do not include an explicit description of grain boundary (GB) sliding, which could lead to inaccurate predictions of strain distributions, especially in the vicinity of GBs. In the present study, a CP model is developed that includes GB sliding as an additional deformation mechanism and models the interaction between slip and GB sliding. Atomistic simulations are used to formulate the constitutive model for GB sliding and its interaction with incident slip. The deformation fields and structure of the GBs are obtained directly from experimental characterization and are faithfully reproduced as bicrystal systems for molecular dynamics simulations. The GBs are modeled as random-type (non-coincidence, asymmetrical) boundaries as observed from experimental data. The underlying atomistic-scale mechanism for pure sliding of random GBs was found to be analogous to fluid-flow. The interaction between incident slip and a sliding GB caused local increases in stress concentration, which further led to a momentary increase in the local sliding rate. The displacement profiles at the sliding GBs computed from the CP model with sliding accommodation are 38% more accurate than the baseline CP model as quantified by the mean squared error between the simulations and experiment. Here these results help improve the sophistication and accuracy of deformation modeling by including physics-based descriptions for GB sliding and its interaction with slip, eventually leading to more reliable predictions of micromechanical quantities.
36 MATERIALS SCIENCE↗