Search NASA⌕ Search

SEARCH · Search NASA

Results for “ERROR ANALYSIS”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 649 records · Page 36

GraphCH: A Deep Framework for Assessing Cyber-Human Aspects in Insider Threat Detection

Insider threat is one of the most damaging cyber attacks that could cause the loss of intellectual property and enterprise data security breaches. Action sequence data such as host logs are used to investigate such threats and develop anomaly-based AI detectors. However, insider threat actions are similar to legitimate user activities, causing AI detectors to fail and suffer from high false alarm rates. Therefore, user cyber activity logs are inadequate to fully unfold insider threats. In this study, we adopt human psychological principles of risk-taking and impulsiveness along with host data to assess the influence and usefulness of human behavioral aspects in insider threat detection. Here, we hypothesize that individuals' impulsive and risk-taking behavior correlates with cyberspace activities. To validate our hypothesis, we conducted an IRB-approved study recruiting 35 participants who work in a large U.S. university and collected their cyber and psychological data for 90 days. Host and human-behavioral data analysis and mapping indicate that impulsive and risk-taking users trigger more system errors causing (un)intentional insider threats and are susceptible to attackers' social engineering and cognitive hacking. Utilizing cyber-human aspects, we introduce a Cyber-Human Graph Neural Network (GNN) based framework GraphCH to identify abnormal user behaviors and detect insider threats.

97 MATHEMATICS AND COMPUTING↗

GridOPTICS/GridPACK

GridPACK is a software framework consisting of a set of modules designed to simplify the development of programs that model the power grid and run on parallel, high performance computing platforms. It also contains several fully developed applications, including powerflow, dynamic simulation, state estimation, Kalman filter analysis (dynamic state estimation), contingency analysis and real time path rating. These applications can be used either standalone or as components in more complicated workflows that combine several different types of application together. The framework modules are available as a combination of libraries and software templates and consist of components for setting up and distributing power grid networks, support for modeling the behavior of individual buses and branches in the network, converting the network models to the corresponding algebraic equations, and parallel routines for manipulating and solving large algebraic systems. The framework also contains a module for distributing tasks evenly amongst computing resources, even if individual tasks vary widely in their execution times. Additional modules support input and output, basic statistical analysis of contingency based calculations, distributed data structures, as well as basic profiling and error management.

Palmer, Bruce↗

Understanding Model Inadequacy in TRISO Nuclear Fuel Fission Products Release Models: Empirical and Mechanistic Approaches

The increasing use of tristructural isotropic (TRISO) particle fuel in both advanced and existing reactors necessitates a thorough evaluation of uncertainties and shortcomings in TRISO fission product release models. These inadequacies arise from the simplifications made in computational models compared to experimental data. Utilizing the BISON fuel performance code and experimental data from the Advanced Gas Reactor (AGR) program provides a unique chance to rigorously assess these inadequacies within a Bayesian uncertainty quantification (UQ) framework. This study contrasts the standard Bayesian framework with the Kennedy-O'Hagan (KOH) framework, which explicitly accounts for modeling inadequacies, in the context of UQ for TRISO silver release models. It examines both the traditional Arrhenius equation and a more advanced lower-length-scale (LLS)-informed model that incorporates microstructure information. The inverse UQ process applied to AGR-2 and AGR-3/4 datasets identified modeling inadequacy as the primary source of uncertainty, with experimental noise also being significant, while model parameter uncertainty was minimal. Both the Arrhenius and LLS-informed models showed similar levels of modeling inadequacy. For forward predictive UQ using the AGR-1 dataset, the KOH framework enhanced the accuracy and quality of quantified uncertainties by approximately 30% and 40%, respectively, compared to the standard Bayesian framework. This improvement was observed for both the Arrhenius and LLS-informed models. At the engineering scale, both models performed similarly, but the LLS-informed model outperformed the Arrhenius equation at the mesoscale. These findings underscore the importance of explicitly considering modeling inadequacy in the UQ process and highlight the need for ongoing refinement of physics-based models to address these shortcomings.

11 - NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Characterizing the Sample Selection for Supernova Cosmology

Type Ia supernovae (SNe Ia) are used as distance indicators to infer the cosmological parameters that specify the expansion history of the universe. Parameter inference depends on the criteria by which the analysis SN sample is selected. Only for the simplest selection criteria and population models can the likelihood be calculated analytically, otherwise it needs to be determined numerically, a process that inherently has error. Numerical errors in the likelihood lead to errors in parameter inference. This article presents toy examples where the distance modulus is inferred given a set of SNe at a single redshift. Parameter estimators and their uncertainties are calculated using Monte Carlo techniques. The relationship between the number of Monte Carlo realizations and numerical errors is presented. The procedure can be applied to more realistic models and used to determine the computational and data management requirements of the transient analysis pipeline.

79 ASTRONOMY AND ASTROPHYSICS↗

Cost-constrained adaptive simulations of transient spray combustion in a gas turbine combustor

Predictive high-fidelity simulations of turbulent spray combustion must capture the combined effects of complex chemistry, multiphase evaporating flow and spray-flame interactions to achieve physical accuracy. Finite-rate chemistry (FRC) combined with a realistic chemical mechanism is a combustion model well-suited for this purpose, but has a high computational cost due to the large number and stiffness of transported chemical species. In contrast, flamelet-based models achieve lower cost by transporting a small number of quantities of reduced stiffness, but assumptions regarding local flame topology, boundary conditions and inter-phase coupling limit their physical accuracy. Recently, the Pareto-efficient combustion (PEC) framework was developed to dynamically assign combustion models based on local cost and accuracy metrics in gas-phase reacting flows. In this work, we extend this PEC framework to spray combustion through the rigorous analysis of the multiphase coupling terms in the governing equations. The derivation shows that spray evaporation causes errors in the prediction of species mass fractions for flamelet-based models due to the sensitivity of the local thermo-chemical state to changes in composition caused by fuel vaporization across combustion regimes present in practical spray combustion devices. Sub-model assignment is formulated as a multiple-choice knapsack problem, where computational cost is directly controlled through the fraction of the domain assigned to the FRC sub-model. The extended PEC formulation is applied to the simulation of a realistic rich-quench-lean gas turbine combustor at steady-state conditions, as well as transient operation resulting in lean blow-out (LBO). Analysis of transient simulations during LBO demonstrates the extended PEC formulation’s capacity to dynamically adapt to changing conditions within the combustor. Transient combustor dynamics are shown to approach convergence with limited increases in computational cost, while retaining substantial computational cost reduction compared to monolithic FRC simulations. Through PEC simulations with increasing fractions of the domain assigned to FRC, monolithic flamelet simulations are shown to over-predict flame stability during LBO. Finally, the extended PEC formulation is thus shown to overcome deficiencies of monolithic models by controlling modeling error for multiphase combustion modeling.

33 ADVANCED PROPULSION SYSTEMS↗

A versatile machine learning workflow for high-throughput analysis of supported metal catalyst particles

Accurate and efficient characterization of nanoparticles (NPs), particularly regarding particle size distribution, is essential for advancing our understanding of their structure-property relationship and facilitating their design for various applications. In this study, we introduce a novel two-stage artificial intelligence (AI)-driven workflow for NP analysis that leverages prompt engineering techniques from state-of-the-art single-stage object detection and large-scale vision transformer (ViT) architectures. This methodology is applied to transmission electron microscopy (TEM) and scanning TEM (STEM) images of heterogeneous catalysts, enabling high-resolution, high-throughput analysis of particle size distributions for supported metal catalyst NPs. The model's performance in detecting and segmenting NPs is validated across diverse heterogeneous catalyst systems, including various metals (Ru, Cu, PtCo, and Pt), supports (silica (SiO 2 ), γ-alumina (γ-Al 2 O 3 ), and carbon black), and particle diameter size distributions with mean and standard deviations ranging from 1.6 ± 0.2 nm to 9.7 ± 4.6 nm. The proposed machine learning (ML) methodology achieved an average F1 overlap score of 0.91 ± 0.01 and demonstrated the ability to disentangle overlapping NPs anchored on catalytic support materials. The segmentation accuracy is further validated using the Hausdorff distance and robust Hausdorff distance metrics, with the 90th percent of the robust Hausdorff distance showing errors within 0.4 ± 0.1 nm to 1.4 ± 0.6 nm. In conclusion, our AI-assisted NP analysis workflow demonstrates robust generalization across diverse datasets and can be readily applied to similar NP segmentation tasks without requiring costly model retraining.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

An energy-modified quantum defect method for the analysis of Rydberg spectra: Application to 2-butyne

The high resolution Rydberg absorption spectrum of 2-butyne C 4 H 6 recorded previously at the SOLEIL synchrotron facility has been interpreted using multichannel quantum defect theory (MQDT). The calculations are based on the continuum scattering calculations of Xu et al., J. Chem. Phys. 136, 154303 (2012) and of Jacovella et al., J. Phys. Chem. A 119, 12339 (2015) pertaining to the dipole-allowed excited state symmetries in absorption from the ground state. In contrast to the traditional approach of calculating low-lying electronic states first and then attempting to extend the calculations to ever higher energy, here the analysis proceeds through the extension of these detailed calculations of the electronic continuum scattering down into the discrete region of the spectrum. The continuum reaction matrices and dipole transition moments are adapted to the discrete Rydberg region via the use of an energy-modified formulation of MQDT theory and associated energy dependences of the quantum defects. The analysis reproduces more than 40 Rydberg states from n ≈ 10 down to the 3 d and 4 s levels with an rms error of better than 20 cm −1 . Further, these belong to five Rydberg series with three different molecular symmetries. While the approach predicts many additional series, most of these are calculated and observed to carry only little oscillator strength. The analysis shows that the Rydberg spectrum is dominated by the excitation of an e″ symmetry electron of fδ and gπ type, in line with what previous studies of the above-threshold shape resonance of 2-butyne have shown. The present study is intended to serve as an example showing how first principles continuum calculations may be useful for the interpretation of highly bound discrete states in a range that poses problems for the standard ab initio techniques. The quantitative treatment of the dipole absorption cross sections is deferred to a future paper.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Leveraging Machine Learning Capabilities for the Characterization of Irradiated Uranium: A Case Study of Analysis Methods for Nuclear Safeguards and Nuclear Forensics

Nondestructively determining the initial enrichment of irradiated uranium is a complex and laborious multivariable problem due to the presence of fission products. This work demonstrates the capabilities of machine learning to analyze gamma-ray spectral data to determine initial enrichment without knowledge of the decay time of the sample. The approach developed is agnostic to the particular scenario and is applicable to a wide variety of applications in nuclear forensics and nuclear safeguards. We irradiated 5 mg uranium standard reference materials at discrete enrichment values ranging from 0.02% to 97% 235 U (weight percent) in UT Austin’s Nuclear Engineering Teaching Laboratory TRIGA Mark II 1.1 MW research reactor, allowed each to decay for 8 hours, and then measured each sample via gamma-ray spectrometry for 50 hours post-irradiation yielding 1,400 individual gamma-ray spectra discretized into 8,192 energy bins. We then trained decision trees models to analyze individual gamma-ray spectra and estimate the associated initial enrichment without knowledge of the time since end of irradiation. We evaluated the performance of the models with a reserved test set not used for training or calibrating the model. A decision tree model constructed with this procedure achieved a mean absolute error in initial enrichment determination of 2.3% (weight percent 235 U). Next, we implemented a principal component analysis pre-processing routine of the gamma-ray spectrometry data to reduce the dimensionality of the dataset from 8,192 channels in the spectrum to 10 principal components while retaining over 99% of the inherent variance in the data. Decision tree models constructed with these data demonstrated decreased mean absolute error in enrichment determination, reduced computational time, and decreased complexity. A single decision tree model constructed with this procedure achieved a mean absolute error in initial enrichment determination of 0.05% (weight percent 235 U). Furthermore, we analyzed these models with learning curves to ensure that overfitting did not occur. The capabilities provided by these models can be naturally extended to other application-focused measurements in the fields of nuclear safeguards, nuclear forensics, and nuclear non-proliferation.

Drescher, Adam↗

Evaluation of Amorphous Oxide Coatings for High-Voltage Li-Ion Battery Applications Using a First-Principles Framework

Cathode surface coatings are widely used industrially as a means to suppress degradation and improve electrochemical performance of lithium-ion batteries. However, developing an optimal coating is challenging, as different coating materials may enhance one aspect of performance while hindering another. Furthermore, to elucidate the fundamental thermodynamic and transport properties of amorphous cathode coating materials, here, we present a framework for calculating and analyzing the Li + and O 2- transport and the stability against delithiation in such materials. Our framework includes systematic workflows of ab-initio molecular dynamics calculations to obtain amorphous structures and diffusion trajectories coupled with an analysis of critical changes of the active-ion local environment during diffusion. Based on these data, we provide an estimate of room-temperature diffusivities, including statistical error bars, and the evaluation of the coating suitability in terms of its ability to facilitate Li + transport while blocking O 2- transport. Finally, we add the thermodynamic stability analysis of the coating chemistry within the operating voltage of common Li-ion cathodes. We apply this framework to two commonly used amorphous coating materials, Al 2 O 3 and ZnO. We find that (1) in general, a higher Li + content increases both Li + and O 2- diffusivities in both Al 2 O 3 and ZnO. Also, Li + and O 2- diffuse much faster in ZnO than in Al 2 O 3 . (2) However, neither Al 2 O 3 nor ZnO is expected to retain a significant concentration of Li + at high charge. (3) ZnO performs much more poorly in terms of O 2- blocking, and hence, Al 2 O 3 is preferred for high-voltage cathode applications. These results will help to quantitatively evaluate amorphous materials, such as metal oxides and fluorides, for different performance metrics and facilitate the development of optimal cathode coatings.

25 ENERGY STORAGE↗

Analysis of human performance differences between students and operators when using the Rancor Microworld simulator

Here, from within the umbrella of the Simplified Human Error Experimental Program (SHEEP) framework, this paper analyzes human performance differences between professional and student operators when using a simplified simulator (i.e., Rancor Microworld). This paper represents a crucial step in understanding the fidelity of the simplified simulators and student operators within the SHEEP study. This paper explores a randomized factorial experimental design that features two independent variables: participant type and event class. Six human performance measurements are considered in the experiment. The experiment is conducted using 20 professional reactor operators employed at actual nuclear power plants (NPPs), along with 20 trained students. The experimental data are analyzed via statistical analysis methods. Finally, this paper examines the differences in human performance between actual operators and students when using Rancor Microworld.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

How can a diverse set of integral and semi-integral measurements inform identification of discrepant nuclear data?

Nuclear data are used for a variety of applications, including criticality safety, reactor performance, and material safeguards. Despite the breadth of use-cases, the effective neutron multiplication factor, keff, of ICSBEP critical assemblies are primarily used for nuclear data validation; these are sensitive to specific energy regions and nuclides and are unable to uniquely constrain nuclear data. As a consequence, general-purpose nuclear data libraries, such as ENDF/B-VIII.0, may have deficiencies that, while not apparent in criticality applications, negatively impact other applications, such as non-destructive analysis of special nuclear material and neutron diagnosed subcritical experiments. Recent work by the Experiments Underpinned by Computational Learning for Improvements in Nuclear Data (EUCLID) project developed a machine learning tool, RAFIEKI, which uses random forests and the SHAP metric to determine which nuclear data contribute most to predicted bias between measured and simulated responses (e.g. keff). This paper contrasts RAFIEKI analysis applied to keff only against RAFIEKI analysis with keff paired with either LLNL pulsed sphere measurements or subcritical benchmarks. Two examples show that a) including pulsed sphere measurements substantially increases 9Be nuclear data importance to bias between 2 and 15 MeV, and b) including subcritical benchmarks has the potential for disentangling compensating errors between 240Pu (n,el) and (n,il) cross-sections between 0.1 and 10 MeV. These results show that RAFIEKI analysis applied to response sets that include, but go beyond, keff can aid nuclear data evaluators in identifying issues in nuclear data.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Field Measurement and Analysis of Frequency and RoCoF for Low-Inertia Power Systems

The frequency measurement and rate of change of frequency (RoCoF) calculations are important for active power, frequency control, and frequency-related protection in power system operations. With the rapid decrease in inertia under modern power systems, however, multiple power variations introduced by variable renewable energy bring large RoCoF and introduce oscillations in frequency measurements. To shed light on this issue, this article proposes a frequency measurement and RoCoF analysis technology, as well as the sensitivity analysis for the real low-inertia power grid. First, a real-world event in an island power grid is analyzed as an example, and an event numerical model is estimated considering four uncertainties, including event RoCoF, oscillation magnitude, oscillation frequency, and underfrequency load-shedding threshold. Then, a sensitivity analysis is performed using the Sobol indices method and quasi-Monte Carlo simulations to identify the dominant uncertainties based on the event model. Here, the dominant uncertainties are compared to provide a guideline for the frequency estimation algorithm selection under different event cases. This algorithm is compared with an enhanced zero-crossing algorithm and gives a 3.41% better RoCoF error rate. Finally, an experiment is conducted using universal grid analyzers to validate the simulation results and the theoretical analysis.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Towards Scaling Law Analysis For Spatiotemporal Weather Data

Compute-optimal scaling laws are relatively well studied for NLP and CV, where objectives are typically single-step and targets are comparatively homogeneous. Weather forecasting is harder to characterize in the same framework: autoregressive rollouts compound errors over long horizons, outputs couple many physical channels with disparate scales and predictability, and globally pooled test metrics can disagree sharply with per-channel, late-lead behavior implied by short-horizon training. We extend neural scaling analysis for autoregressive weather forecasting from single-step training loss to long rollouts and per-channel metrics. We quantify (1) how prediction error is distributed across channels and how its growth rate evolves with forecast horizon, (2) if power law scaling holds for test error, relative to rollout length when error is pooled globally, and (3) how that fit varies jointly with horizon and channel for parameter, data, and compute-based scaling axes. We find strong cross-channel and cross-horizon heterogeneity: pooled scaling can look favorable while many channels degrade at late leads. We discuss implications for weighted objectives, horizon-aware curricula, and resource allocation across outputs.

Kiefer Jr, Alexander [ORNL] (ORCID:000000025398874↗

An Experimental Investigation of Students’ Learning Effects When Using a Simplified Nuclear Simulator

Securing enough data has been a main challenge in human reliability analysis (HRA). Many researchers and institutes have made a lot of efforts for collecting HRA data to produce reasonable human error probabilities (HEPs) as well as reduce the uncertainty of HRA quantification. Representatively, U.S. Nuclear Regulatory Commission (U.S. NRC), Korea Atomic Energy Research Institute (KAERI) and Idaho National Laboratory (INL) have led lots of empirical research regarding the HRA data collection. The U.S. NRC and KAERI have mainly carried out full-scope simulator research collecting HRA data through experiments using full-scope simulators with actual operators. In contrast, INL has experimentally collected the data using simplified simulators and student operators. INL has proposed the Simplified Human Error Experimental Program (SHEEP) framework to complement full-scope data collection efforts by suggesting a way to infer full-scope data based on experimental data collected from students operating simplified simulators, specifically the Rancor Microworld Simulator (Rancor) and the Compact Nuclear Simulator (CNS). The aim of the SHEEP framework is to lower the entry point for collecting useful HRA data by securing large sample sizes at a reasonable amount of cost and labor while also guaranteeing a high degree of freedom when designing experiments. The authors’ previous research investigated whether data collected from the SHEEP framework could support a representative full-scope study. Besides, human performance differences between professional and student operators when using Rancor and CNS have been analyzed to understand the lack of fidelity of the simplified simulators and student operators within the SHEEP study. As a follow up research, this study experimentally investigates students’ learning effects and the performance trends over a certain period when using Rancor. This study aims to find out 1) how much training or education is required to collect HRA data from non-experts (i.e., students) when using Rancor and 2) how much differences there are in human performance measures between students and professional operators. In this study, a longitudinal experiment is developed. The four experiment trials with two weeks interval are carried out for sixteen undergraduate students majoring nuclear engineering at Chosun University. Totally four scenarios randomly selected from ten Rancor scenarios are used in each experiment trial. Four human performance measurements (i.e., workload, situation awareness, time and error) are considered in the experiment. Lastly, the trend of students’ performance is compared with operator data having been collected from the previous experiment.

99 GENERAL AND MISCELLANEOUS↗

A Standardized Analysis Process Using Digital Image Correlation to Calculate In Situ Cladding Strain from Modified Burst Tests for Fuel Performance Code Validation

Historical data collection on nuclear fuel cladding materials has focused on generating a statistically significant amount of data to assess the material and its failure behavior. Furthermore, data generated to support material model and failure criteria development were previously posttest evaluations, so a large number of tests was required to gain new understanding. A way to expedite this process is to develop techniques capable of generating large, high-fidelity data sets from a single test with lower uncertainty or quantified uncertainty. One such example of this approach is Oak Ridge National Laboratory’s use of modified burst tests (MBTs) to analyze the mechanical behavior and failure conditions of cladding during a simulated reactivity-initiated accident (RIA). Each test incorporates digital image correlation (DIC) analysis techniques that are used to assess the accumulated strain in situ, as well as eventual cladding failure. This work has been fruitful in defining strain-to-failure conditions for materials like silicon carbide (SiC) fiber–reinforced/SiC matrix composite tubes (SiC/SiC), iron-chromium-aluminum (FeCrAl) alloy tubes, and chromium-coated Zircaloy-4 tubes. However, there are numerous DIC software available, including open-source and proprietary software. The different DIC software use various algorithms to process images and calculate displacement values. Using these different software and algorithms can lead to varying results, and perhaps larger-than-expected uncertainties. In the present study, previously published MBT data encompassing a variety of test conditions were reanalyzed with two different DIC software to assess the variance in the calculated strain results. The data consisted of SiC/SiC, FeCrAl, and chromium-coated Zircaloy-4 tubes. Plots of the calculated strains during the transient revealed good agreement between the two DIC software. The average root-mean-square errors between the two software was 0.20% strain, which is slightly larger than a previously reported error value for these tests. In conclusion, this variance in results is low enough that this analysis method can be used for code validation.

Reactivity-initiated accident↗

Dark Energy Survey Year 3 Results: Galaxy mock catalogs for BAO analysis

The calibration and validation of scientific analysis in simulations is a fundamental tool to ensure unbiased and robust results in observational cosmology. In particular, mock galaxy catalogs are a crucial resource to achieve these goals in the measurement of baryon acoustic oscillation (BAO) in the clustering of galaxies. Here we present a set of 1952 galaxy mock catalogs designed to mimic the Dark Energy Survey Year 3 BAO sample over its full photometric redshift range 0.6 < zphoto < 1.1. The mocks are based upon 488 ICE-COLA fast N-body simulations of full-sky light cones and were created by populating halos with galaxies, using a hybrid halo occupation distribution – halo abundance matching model. This model has ten free parameters, which were determined, for the first time, using an automatic likelihood minimization procedure. We also introduced a novel technique to assign photometric redshift for simulated galaxies, following a two-dimensional probability distribution with VIMOS Public Extragalactic Redshift Survey data. The calibration was designed to match the observed abundance of galaxies as a function of photometric redshift, the distribution of photometric redshift errors, and the clustering amplitude on scales smaller than those used for BAO measurements. An exhaustive analysis was done to ensure that the mocks reproduce the input properties. Finally, mocks were tested by comparing the angular correlation function w(θ), angular power spectrum Cℓ, and projected clustering ξp(r⊥) to theoretical predictions and data. The impact of volume replication in the estimate of the covariance is also investigated. The success in accurately reproducing the photometric redshift uncertainties and the galaxy clustering as a function of redshift render this mock creation pipeline as a benchmark for future analyses of photometric galaxy surveys.Key words: catalogs / large-scale structure of Universe / galaxies: distances and redshifts / Galaxy: halo / methods: numerical

79 ASTRONOMY AND ASTROPHYSICS↗

Dark energy survey year 3 results: High-precision measurement and modeling of galaxy-galaxy lensing

We present and characterize the galaxy-galaxy lensing signal measured using the first three years of data from the Dark Energy Survey (DES Y3) covering 4132 deg 2 . These galaxy-galaxy measurements are used in the DES Y3 3 × 2 pt cosmological analysis, which combines weak lensing and galaxy clustering information. We use two lens samples: a magnitude-limited sample and the redmagic sample, which span the redshift range ∼ 0.2 – 1 with 10.7 and 2.6 M galaxies, respectively. For the source catalog, we use the metacalibration shape sample, consisting of ≃ 100 M galaxies separated into four tomographic bins. Our galaxy-galaxy lensing estimator is the mean tangential shear, for which we obtain a total SNR of ∼ 148 for maglim ( ∼ 120 for redmagic), and ∼ 67 ( ∼ 55 ) after applying the scale cuts of 6 Mpc / h . Thus we reach percent-level statistical precision, which requires that our modeling and systematic-error control be of comparable accuracy. The tangential shear model used in the 3 × 2 pt cosmological analysis includes lens magnification, a five-parameter intrinsic alignment model, marginalization over a point mass to remove information from small scales and a linear galaxy bias model validated with higher-order terms. We explore the impact of these choices on the tangential shear observable and study the significance of effects not included in our model, such as reduced shear, source magnification, and source clustering. We also test the robustness of our measurements to various observational and systematics effects, such as the impact of observing conditions, lens-source clustering, random-point subtraction, scale-dependent metacalibration responses, point spread function residuals, and B modes.

79 ASTRONOMY AND ASTROPHYSICS↗

Benchmarking machine learning strategies for phase-field problems

Abstract We present a comprehensive benchmarking framework for evaluating machine-learning approaches applied to phase-field problems. This framework focuses on four key analysis areas crucial for assessing the performance of such approaches in a systematic and structured way. Firstly, interpolation tasks are examined to identify trends in prediction accuracy and accumulation of error over simulation time. Secondly, extrapolation tasks are also evaluated according to the same metrics. Thirdly, the relationship between model performance and data requirements is investigated to understand the impact on predictions and robustness of these approaches. Finally, systematic errors are analyzed to identify specific events or inadvertent rare events triggering high errors. Quantitative metrics evaluating the local and global description of the microstructure evolution, along with other scalar metrics representative of phase-field problems, are used across these four analysis areas. This benchmarking framework provides a path to evaluate the effectiveness and limitations of machine-learning strategies applied to phase-field problems, ultimately facilitating their practical application.

36 MATERIALS SCIENCE↗