Search NASA⌕ Search

SEARCH · Search NASA

Results for “model structural error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 955 records · Page 53

LLM Generation of Online Courses from a Curated Set of Documents in the Nuclear Safeguards Domain

A multidisciplinary team at Argonne National Laboratory explores the application of advanced technologies to enhance knowledge transfer and retention within the nuclear safeguards domain. Specifically, it examines the feasibility of leveraging secure large language models (LLMs) to streamline the creation of e-learning modules for the U.S. National Nuclear Security Administration (NNSA) Office of International Nuclear Safeguards (NA-241). The initiative addresses the critical need for preserving institutional memory and accelerating skill development amidst the imminent retirement of senior professionals in the field in addition to supporting good knowledge management practices. The project integrates instructional design theory with cutting-edge AI technologies to transform curated document sets from the Safeguards Knowledge Repository (SKR) into modular online courses. By automating the generation of learning objectives and instructional content, the effort aims to reduce manual effort while maintaining high-quality educational outcomes. A limited measure of human supervision, however, ensures accuracy, relevance, and alignment with NNSA’s strategic priorities. Key findings highlight the potential of AI-assisted course generation to support safeguards professionals by creating structured, interactive learning experiences. The report underscores the importance of SME validation to address limitations in AI-generated content, such as terminology errors and gaps in coverage. Recommendations include adopting a structured workflow combining LLM acceleration with expert oversight to ensure accuracy, usability, and alignment with learner needs. This work demonstrates Argonne’s commitment to advancing national security and scientific excellence through innovative knowledge management solutions.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

A framework for measuring weak-lensing magnification using the Fundamental Plane

ABSTRACT Galaxy–galaxy lensing is an essential tool for probing dark matter haloes and constraining cosmological parameters. While galaxy–galaxy lensing measurements usually rely on shear, weak-lensing magnification contains additional constraining information. Using the Fundamental Plane (FP) of elliptical galaxies to anchor the size distribution of a background population is one method that has been proposed for performing a magnification measurement. We present a formalism for using the FP residuals of elliptical galaxies to jointly estimate the foreground mass and background redshift errors for a stacked lens scenario. The FP residuals include information about weak-lensing magnification κ, and therefore foreground mass, since to first order, non-zero κ affects galaxy size but not other FP properties. We also present a modular, extensible code that implements the formalism using emulated galaxy catalogues of a photometric galaxy survey. We find that combining FP information with observed number counts of the source galaxies constrains mass and photo-z error parameters significantly better than an estimator that includes number counts only. In particular, the constraint on the mass is 17.0 per cent if FP residuals are included, as opposed to 27.7 per cent when only number counts are included. The effective size noise for a foreground lens of mass $M_\mathrm{ H}=10^{14}\, \mathrm{M}_\odot$, with a conservative selection function in size and surface brightness applied to the source population, is σκ, eff = 0.250. We discuss the improvements to our FP model necessary to make this formalism a practical companion to shear analyses in weak-lensing surveys.

79 ASTRONOMY AND ASTROPHYSICS↗

EGS Collab Experiment 1: 3D Seismic Velocity Model and Updated Microseismic Catalog from Double-Difference Seismic Tomography

This package contains a 3D Seismic velocity model and an updated microseismic catalog obtained for a double-difference seismic tomography study. The 3D_seismic_velocity_model text file contains x (m), y(m), z(m), P-wave velocity (km/s), P-wave velocity quality indicator (1 for well-constrained; 0 for poorly constrained), S-wave velocity (km/s), and S-wave velocity quality indicator (1 for well-constrained; 0 for poorly constrained). The Updated_MEQ_catalog text file contains event origin time, x(m), y(m), z(m), error in x (m), error in y (m), error in z (m), and RMS misfit (millisecond). The 3D_seismic_P-wave_velocity_model animation file shows slices of the 3D P-wave velocity model. The 3D_seismic_S-wave_velocity_model animation file shows slices of the 3D S-wave velocity model. The Interactive_MEQ_location_comparison API file is an interactive visualization of the updated microseismic event locations and the original seismic catalog. The visualization allows users to view and compare the event locations by dragging, rotating, and zooming in. An updated version of 3D_seismic_velocity_model and associated animations were included, which were calculated with a more strict assumption for quality indicators.

15 GEOTHERMAL ENERGY↗

A Comparative Study of the Efficacy of Local/Global and Parametric/Nonparametric Machine Learning Methods for Establishing Structure–Property Linkages in High-Contrast 3D Elastic Composites

Reduced-order structure–property (S-P) linkages play a pivotal role in the tailored design of materials for advanced engineering components. There is a critical need to distill these from the simulation datasets aggregated using sophisticated, computationally expensive, physics-based numerical tools (e.g., finite element methods). The recent emergence of materials data science approaches has opened new avenues for addressing this challenge. In this paper, we critically compare the relative merits of the application of four distinct machine learning approaches for their efficacy in extracting microstructure-property linkages from the finite element simulation data aggregated on high-contrast elastic composites with different microstructures. The machine learning approaches selected for the study have included different combinations of local/global and parametric/nonparametric approaches. Furthermore, the nonparametric approaches selected for this study are based on Gaussian Process (GP) models that allow for a formal treatment of uncertainty quantification in the predicted values. The predictive performances of these different approaches have been compared against each other using rigorous cross-validation error metrics. Furthermore, their sensitivity to both the dataset size and dimensionality has been investigated.

36 MATERIALS SCIENCE↗

Noisy quantum trees: infinite protection without correction

We study quantum networks with tree structures, in which information propagates from a root to leaves. At each node in the network, the received qubit unitarily interacts with fresh ancilla qubits, after which each qubit is sent through a noisy channel to a different node in the next level. Therefore, as the tree depth grows, there is a competition between the irreversible effect of noise and the protection against such noise achieved by the delocalization of information. In the classical setting, where each node simply copies the input bit into multiple output bits, this model has been studied as the broadcasting or reconstruction problem on trees, which has broad applications. In this work, we study the quantum version of this problem. We consider a Clifford encoder at each node that encodes the input qubit in a stabilizer code, along with a single qubit Pauli noise channel at each edge. Such noisy quantum trees describe a scenario in which one has access to a stream of fresh (low-entropy) ancilla qubits, but cannot perform error correction. Therefore, they provide a different perspective on quantum fault tolerance. Furthermore, they provide a useful model for describing the effect of noise within the encoders of concatenated codes. We prove that above certain noise thresholds, which depend on the properties of the code such as its distance, as well as the properties of the encoder, information decays exponentially with the depth of the tree. On the other hand, by studying certain efficient decoders, we prove that for codes with distance d ≥ 2 and for sufficiently small (but non-zero) noise, classical information and entanglement propagate over a noisy tree with infinite depth. Indeed, we find that this remains true even for binary trees with certain 2-qubit encoders at each node, which encodes the received qubit in the binary repetition code with distance d = 1.

Quantum information↗

Synchronized multiartifact reduction with tomographic reconstruction (SMART-RECON): A statistical model based iterative image reconstruction method to eliminate limited-view artifacts and to mitigate the temporal-average artifacts in time-resolved CT

Purpose: In x-ray computed tomography (CT), a violation of the Tuy data sufficiency condition leads to limited-view artifacts. In some applications, it is desirable to use data corresponding to a narrow temporal window to reconstruct images with reduced temporal-average artifacts. However, the need to reduce temporal-average artifacts in practice may result in a violation of the Tuy condition and thus undesirable limited-view artifacts. In this paper, the authors present a new iterative reconstruction method, synchronized multiartifact reduction with tomographic reconstruction (SMART-RECON), to eliminate limited-view artifacts using data acquired within an ultranarrow temporal window that severely violates the Tuy condition. Methods: In time-resolved contrast enhanced CT acquisitions, image contrast dynamically changes during data acquisition. Each image reconstructed from data acquired in a given temporal window represents one time frame and can be denoted as an image vector. Conventionally, each individual time frame is reconstructed independently. In this paper, all image frames are grouped into a spatial–temporal image matrix and are reconstructed together. Rather than the spatial and/or temporal smoothing regularizers commonly used in iterative image reconstruction, the nuclear norm of the spatial–temporal image matrix is used in SMART-RECON to regularize the reconstruction of all image time frames. This regularizer exploits the low-dimensional structure of the spatial–temporal image matrix to mitigate limited-view artifacts when an ultranarrow temporal window is desired in some applications to reduce temporal-average artifacts. Both numerical simulations in two dimensional image slices with known ground truth and in vivo human subject data acquired in a contrast enhanced cone beam CT exam have been used to validate the proposed SMART-RECON algorithm and to demonstrate the initial performance of the algorithm. Reconstruction errors and temporal fidelity of the reconstructed images were quantified using the relative root mean square error (rRMSE) and the universal quality index (UQI) in numerical simulations. The performance of the SMART-RECON algorithm was compared with that of the prior image constrained compressed sensing (PICCS) reconstruction quantitatively in simulations and qualitatively in human subject exam. Results: In numerical simulations, the 240{sup ∘} short scan angular span was divided into four consecutive 60{sup ∘} angular subsectors. SMART-RECON enables four high temporal fidelity images without limited-view artifacts. The average rRMSE is 16% and UQIs are 0.96 and 0.95 for the two local regions of interest, respectively. In contrast, the corresponding average rRMSE and UQIs are 25%, 0.78, and 0.81, respectively, for the PICCS reconstruction. Note that only one filtered backprojection image can be reconstructed from the same data set with an average rRMSE and UQIs are 45%, 0.71, and 0.79, respectively, to benchmark reconstruction accuracies. For in vivo contrast enhanced cone beam CT data acquired from a short scan angular span of 200{sup ∘}, three 66{sup ∘} angular subsectors were used in SMART-RECON. The results demonstrated clear contrast difference in three SMART-RECON reconstructed image volumes without limited-view artifacts. In contrast, for the same angular sectors, PICCS cannot reconstruct images without limited-view artifacts and with clear contrast difference in three reconstructed image volumes. Conclusions: In time-resolved CT, the proposed SMART-RECON method provides a new method to eliminate limited-view artifacts using data acquired in an ultranarrow temporal window, which corresponds to approximately 60{sup ∘} angular subsectors.

60 APPLIED LIFE SCIENCES↗

Communication: Recovering the flat-plane condition in electronic structure theory at semi-local DFT cost

The flat-plane condition is the union of two exact constraints in electronic structure theory: (i) energetic piecewise linearity with fractional electron removal or addition and (ii) invariant energetics with change in electron spin in a half filled orbital. Semi-local density functional theory (DFT) fails to recover the flat plane, exhibiting convex fractional charge errors (FCE) and concave fractional spin errors (FSE) that are related to delocalization and static correlation errors. We previously showed that DFT+U eliminates FCE but now demonstrate that, like other widely employed corrections (i.e., Hartree-Fock exchange), it worsens FSE. To find an alternative strategy, we examine the shape of semi-local DFT deviations from the exact flat plane and we find this shape to be remarkably consistent across ions and molecules. We introduce the judiciously modified DFT (jmDFT) approach, wherein corrections are constructed from few-parameter, low-order functional forms that fit the shape of semi-local DFT errors. Here we select one such physically intuitive form and incorporate it self-consistently to correct semi-local DFT. We demonstrate on model systems that jmDFT represents the first easy-to-implement, no-overhead approach to recovering the flat plane from semi-local DFT.

74 ATOMIC AND MOLECULAR PHYSICS↗

The growth of density perturbations in the last ~10 billion years from tomographic large-scale structure data

In order to investigate the origin of the ongoing tension between the amplitude of matter fluctuations measured by weak lensing experiments at low redshifts and the value inferred from the cosmic microwave background anisotropies, we reconstruct the evolution of this amplitude from z ~ 2 using existing large-scale structure data. To do so, we decouple the linear growth of density inhomogeneities from the background expansion, and constrain its redshift dependence making use of a combination of 6 different data sets, including cosmic shear, galaxy clustering and CMB lensing. We analyze these data under a consistent harmonic-space angular power spectrum-based pipeline. We show that current data constrain the amplitude of fluctuations mostly in the range 0.2 < z < 0.7, where it is lower than predicted by . This difference is mostly driven by current cosmic shear data, although the growth histories reconstructed from different data combinations are consistent with each other, and we find no evidence of systematic deviations in any particular experiment. In spite of the tension with , the data are well-described by the model, albeit with a lower value of S 8 ≡ σ 8 (Ω m /0.3) 0.5 . As part of our analysis, we find constraints on this parameter of S 8 = 0.7781 ± 0.0094 (68% confidence level), reaching almost percent-level errors comparable with CMB measurements, and 3.4σ away from the value found by .

79 ASTRONOMY AND ASTROPHYSICS↗

Data-Driven Reduced-Order Modeling of Convective Heat Transfer in Porous Media

This work presents a data-driven Reduced-Order Model (ROM) for parametric convective heat transfer problems in porous media. The intrusive Proper Orthogonal Decomposition aided Reduced-Basis (POD-RB) technique is employed to reduce the porous medium formulation of the incompressible Reynolds-Averaged Navier–Stokes (RANS) equations coupled with heat transfer. Instead of resolving the exact flow configuration with high fidelity, the porous medium formulation solves a homogenized flow in which the fluid-structure interactions are captured via volumetric flow resistances with nonlinear, semi-empirical friction correlations. A supremizer approach is implemented for the stabilization of the reduced fluid dynamics equations. The reduced nonlinear flow resistances are treated using the Discrete Empirical Interpolation Method (DEIM), while the turbulent eddy viscosity and diffusivity are approximated by adopting a Radial Basis Function (RBF) interpolation-based approach. The proposed method is tested using a 2D numerical model of the Molten Salt Fast Reactor (MSFR), which involves the simulation of both clean and porous medium regions in the same domain. For the steady-state example, five model parameters are considered to be uncertain: the magnitude of the pumping force, the external coolant temperature, the heat transfer coefficient, the thermal expansion coefficient, and the Prandtl number. For transient scenarios, on the other hand, the coastdown-time of the pump is the only uncertain parameter. The results indicate that the POD-RB-ROMs are suitable for the reduction of similar problems. The relative L2 errors are below 3.34% for every field of interest for all cases analyzed, while the speedup factors vary between 54 (transient) and 40,000 (steady-state).

German, Péter (ORCID:0000000307285283)↗

Revealing EDL-driven reduction mechanisms in binary, ternary, and quaternary fluorinated electrolytes via an integrated MD–DFT–ML framework

Accurately predicting solid electrolyte interphase (SEI) formation requires explicitly resolving the electric double layer (EDL) structure, which deviates significantly from that of the bulk electrolyte. Although an established molecular dynamics (MD) and Density Functional Theory (DFT) framework can model SEI formation by evaluating reduction reactions of local clusters in the EDL, it suffers from a combinatorial computational bottleneck. To overcome this limitation, we introduce a machine-learning-accelerated simulation workflow (MD–DFT–ML), integrating a gradient-boosted regression model trained on EDL composition data to efficiently predict reduction potentials. We apply this framework to seven fluorinated electrolytes comprising fluorinated anions, a fluorinated ester solvent, two types of diluent (ion-solvating ester vs. non-solvating ether), and an FEC additive. The analysis shows that the EDL selectively accumulates cation-binding species; consequently, the non–cation-binding ether diluent rarely enters the EDL and makes minimal contributions to SEI formation. DFT calculations on statistically representative EDL clusters provide reduction potentials and fluorine-release pathways, while the ML model, which substantially reduces the DFT workload, predicts cluster reduction energies with a mean absolute error of 0.1 eV. The combined MD–DFT–ML approach also quantifies contributions from different sources to LiF formation in the SEI. This methodology establishes a generalizable route for multiscale modeling electrolyte and interphase design for next-generation electrochemical energy-storage systems.

DFT-MD-ML workflow↗

Challenges and perspectives for large-scale temperature reconstructions of the past two millennia

Knowledge of the temperature variability during the last one to two millennia is important for providing a perspective to present-day climate excursions, for assessing the sensitivity of the climate to different forcings, and for providing a test bed for climate models. Since systematic instrumental temperature records only extend back to the nineteenth century, such knowledge mainly relies on climate-sensitive proxy data. Here we critically assess some of the many challenges related to large-scale multiproxy temperature reconstructions. We begin with a review of available large-scale temperature reconstructions, focusing on the differences in low-frequency variability and the response to natural forcings such as major volcanic eruptions and changes in total solar irradiance. Then, we discuss different proxy selection strategies, review previously used reconstruction methods, and discuss their ability to reconstruct the amplitude of the low-frequency variability. To shed additional light on the challenges of large-scale reconstructions, we investigate the spatial and temporal correlation structures in the observed temperature field and discuss the implications of these correlation structures regarding the required number and positions of proxies. We demonstrate how the unavoidable uncertainty related to noisy proxies will show up as bias and variance in the reconstruction and that the partition between these forms of errors depends on the reconstruction method. Pseudo-proxy experiments are conducted to further discuss the influence of noise and the requirements regarding the geographical location and number of proxies necessary for reliably reconstructing the low-frequency variability. Finally, we conclude with recommendations for future large-scale temperature reconstructions.

54 ENVIRONMENTAL SCIENCES↗

Preliminary results of teleseismic double-difference relocation of earthquakes around Indonesian archipelago region

Indonesian archipelago region is located in active tectonic setting and high seismicity zone. During the last decade, Indonesian was experienced with destructive major earthquakes causing damage and victims. The information of precise earthquake location parameters are very important in partular for earthquake early warning to the society and for advance seismic studies. In this study, we attempted to improve hypocenter location compiled by BMKG for time periods of April, 2009 up to June, 2014 for about 22,000 earthquake events around Indonesian region. For the firts time, we applied teleseismic double-difference relocation algorithm (teletomoDD) to improve hypocenter region in Indonesia region combining regional and teleseismic stations. Hypocenter relocation was performed utilizing local, regional, and teleseismic P-wave arrival time data. Our relocation result show that travel-time RMS errors were greatly reduced compared to the BMKG catalog. Seismicity at shallower depth (less than 50 km) shows significantly improvement especially in depth, and refined shallow geological structures, e.g. trench and major strike slip faults. Clustered seismicity is also detected beneath volcanic region, and probably related volcano activities and also major faults nearby. In the Sunda arc region, seismicity at shallower depth centered at two major distributions parallel to the trench strike direction, i.e. around fore-arc and in mainland that related to major fault, e.g. the Sumatran fault, and volcanic fronts. Below Central Java region, relocated hypocenter result showed double seismic zone pattern. A seismic gap is detected around the Sunda-Banda transition zone where transition between oceanic subduction to continental crust collision of Australian plate occurs. In Eastern Indonesia region, shallow earthquakes are observed related to major strike slip faults, e.g. Sorong and Palu-Koro fault, volcanism, and shallow part of subduction and collision zones. We also compare our result in the Sunda Arc region with slab1.0 model and our relocated seismicity shows good agreement with the previous slab geometry. Horizontal position shift of relocated events are mostly perpendicular to the trench directions.

58 GEOSCIENCES↗

Molten Salt Reactor Experiment Simulation using Shift/Griffin

The Department of Energy (DOE)’s NEAMS focuses its efforts on the development of advanced modeling and simulation (M&S) tools for light-water reactors (LWRs) and non–LWRs (i.e., molten salt reactors, high-temperature gas reactors, microreactors, and fast reactors). In the previous fiscal year, the Multiphysics Applications Driver Technical Area funded molten salt reactor (MSR) M&S at Oak Ridge National Laboratory (ORNL) to generate multigroup macroscopic cross sections with Shift for a MSRE 2D lattice model in Griffin. In addition, Shift’s capability to calculate gamma dose rates from activated components in the primary exchangers in a molten salt breeder reactor was also demonstrated. In fiscal year 2023, ORNL generated multigroup macroscopic cross sections using Shift for a 3D MSRE core model. MSRE depletion calculations using Griffin were also demonstrated in this fiscal year. For the depletion calculation, one-group microscopic cross sections for the 3D MSRE core were generated using Shift, and the decay transmutation library from ORIGEN was converted to an ISOXML file, which is required as input in Griffin. Several Monte Carlo codes, such as OpenMC and Serpent, were also used to benchmark and supplement multigroup cross sections generated by Shift. Multigroup libraries were generated with 8 and 20 group structures, and the study found the 8-group structure to be more accurate when comparing Griffin results to continuous energy (CE) Monte Carlo results. The average flux from CE Shift calculations is up to ~6% higher than the CE Serpent calculations because of different values applied for the energy released per fission (κ values). The average flux in the fuel salt calculated by Griffin using cross sections generated with Shift agrees well with the reference CE Shift solution; the same is valid for the corresponding Serpent results. The maximum relative error is ~6% and ~2% compared to the CE Shift and Serpent reference solutions, respectively. Meanwhile, the average flux calculated by Griffin in the graphite moderator shows a higher difference in the thermal range when compared to both reference Monte Carlo solutions; this result suggests a need for improvement in cross section generation for the graphite moderator in the thermal range in both Monte Carlo codes. Griffin depletion calculations using cross sections from Shift and Serpent were performed and compared against ORIGEN calculations, and the nuclide densities calculated by Griffin were found to be generally in agreement with those of ORIGEN. Because a different approach was taken to calculate the energy released per fission ( κ values) in Shift and Serpent, a difference in nuclide densities from differences in the average flux was observed between Griffin using Serpent and Shift cross sections. Griffin calculations with Shift cross sections produced higher average flux in the salt than with Serpent cross sections, leading to higher consumption of 235 U and higher production of 135 Xe. For time-dependent depletion calculations, cross sections were generated with Serpent, and Griffin’s results using these cross sections were compared to CE Serpent depletion results, demonstrating good agreement. The average difference in keff between Serpent and Griffin as a function of burnup is about 155 pcm. Similarly, good agreement with small differences up to ~0.5% was also noticed in the nuclide density of 235 U and 135 Xe. More details regarding the methodologies invoked to generate the cross section to make code-to-code comparisons are discussed further in this report. User feedback on Griffin and Shift capabilities that will enhance these calculations is provided in this report for future consideration. The work performed this fiscal year can be extended further for multiphysics coupling of Griffin-Pronghorn/SAM with Mole to study precursor flow and salt chemistry.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Part-scale microstructure prediction for laser powder bed fusion Ti-6Al-4V using a hybrid mechanistic and machine learning model

Laser powder bed fusion (LPBF) Ti-6Al-4V is widely studied for use in structural applications in aerospace and medical industries, but mechanical anisotropy and microstructural inhomogeneity prohibits its wider adoption. Although successful microstructure prediction models have been developed, a remaining challenge is their limited integration across length/time scales and validation by experimental studies. Here, this work proposes a physics-augmented machine learning surrogate model to unite predictions of LPBF temperature, β phase morphology and texture, and α/α’ formation into a single framework that is calibrated and validated with experiments. First, a phase field (PF) model of the martensitic β→α’ transformation is developed and calibrated using data from in-situ synchrotron cyclic heating/cooling studies quantifying the variation of α phase fraction with time. In parallel, an established finite difference-Monte Carlo (FDMC) model predicts the part-scale temperature profile and β grain formation during solidification. A dataset is developed using LPBF cyclic temperature descriptors from the FDMC model as inputs and corresponding α/α’ phase fraction and width from the PF model as outputs. Five machine learning (ML) regression models are tested and optimized, having mean absolute error in testing ≤ 4 %, and the k-nearest neighbors (KNN) model is selected as the best performing. The KNN model is called at the nodal level during post-processing of the FDMC model to replace and downscale the response of the PF model. The combined agility and accuracy of the hybrid FDMC-ML model enables part-scale microstructure predictions that can be further used for property predictions to accelerate AM process optimization.

36 MATERIALS SCIENCE↗

Machine learning inversion from small-angle scattering for charged polymers

We develop Monte Carlo simulations for uniformly charged polymers and a machine learning algorithm to interpret the intra-polymer structure factor of the charged polymer system, which can be obtained from small-angle scattering experiments. The polymer is modeled as a chain of fixed-length bonds, where the connected bonds are subject to bending energy, and there is also a screened Coulomb potential for charge interaction between all joints. The bending energy is determined by the intrinsic bending stiffness, and the charge interaction depends on the interaction strength and screening length. All three contribute to the stiffness of the polymer chain and lead to longer and larger polymer conformations. The screening length also introduces a second length scale for the polymer besides the bending persistence length. To obtain the inverse mapping from the structure factor to these polymer conformation and energy-related parameters, we generate a large data set of structure factors by running simulations for a wide range of polymer energy parameters. We use principal component analysis to investigate the intra-polymer structure factors and determine the feasibility of the inversion using the nearest neighbor distance. We employ Gaussian process regression to achieve the inverse mapping and extract the characteristic parameters of polymers from the structure factor with low relative error.

36 MATERIALS SCIENCE↗

Dark Energy Survey Year 3 Results: Galaxy mock catalogs for BAO analysis

The calibration and validation of scientific analysis in simulations is a fundamental tool to ensure unbiased and robust results in observational cosmology. In particular, mock galaxy catalogs are a crucial resource to achieve these goals in the measurement of baryon acoustic oscillation (BAO) in the clustering of galaxies. Here we present a set of 1952 galaxy mock catalogs designed to mimic the Dark Energy Survey Year 3 BAO sample over its full photometric redshift range 0.6 < zphoto < 1.1. The mocks are based upon 488 ICE-COLA fast N-body simulations of full-sky light cones and were created by populating halos with galaxies, using a hybrid halo occupation distribution – halo abundance matching model. This model has ten free parameters, which were determined, for the first time, using an automatic likelihood minimization procedure. We also introduced a novel technique to assign photometric redshift for simulated galaxies, following a two-dimensional probability distribution with VIMOS Public Extragalactic Redshift Survey data. The calibration was designed to match the observed abundance of galaxies as a function of photometric redshift, the distribution of photometric redshift errors, and the clustering amplitude on scales smaller than those used for BAO measurements. An exhaustive analysis was done to ensure that the mocks reproduce the input properties. Finally, mocks were tested by comparing the angular correlation function w(θ), angular power spectrum Cℓ, and projected clustering ξp(r⊥) to theoretical predictions and data. The impact of volume replication in the estimate of the covariance is also investigated. The success in accurately reproducing the photometric redshift uncertainties and the galaxy clustering as a function of redshift render this mock creation pipeline as a benchmark for future analyses of photometric galaxy surveys.Key words: catalogs / large-scale structure of Universe / galaxies: distances and redshifts / Galaxy: halo / methods: numerical

79 ASTRONOMY AND ASTROPHYSICS↗

Structure classification and melting temperature prediction in octet AB solids via machine learning

Machine learning methods are being increasingly used in condensed matter physics and materials science to classify crystals structures and predict material properties. However, the reliability of these methods for a given problem, especially when large data sets are unavailable, has not been well studied. By addressing the tasks of classifying crystal structure and predicting melting temperatures of the octet subset of AB solids, we performed such a study and found potential problems with using machine learning methods on relatively small data sets. At the same time, however, we can reaffirm the potential power of such methods for these tasks. In particular, we uncovered an important new material feature, the excess Born effective charge, that significantly increased the accuracy of the predictions for the classification problem we defined. This discovery leads us to propose a new scale for the degree of ionicity and covalency in these solids. More specifically, we partitioned the crystal structures of a set of 75 octet solids into those that are ionic and covalent bonded and thus performed a binary classification task. We found that using the standard indices (r σ ,r π ), suggested by St. John and Bloch several decades ago, enabled an average success in classification of 92%. Using just r σ and the excess Born effective charge ΔZ A of the A atom enabled an average success of 97%, but we also found relatively large variations about these averages that were dependent on how certain machine learning methods were used and for which a standard deviation was not a proper measure of the degree of confidence we can place in either average. Instead, we calculated and report with 95 % confidence that the traditional classification pair predicts an accuracy in the interval [ 89%, 95%] and the accuracy of the new pair lies in the interval [96 %, 99%]. For melting temperature predictions, the size of our data set was 46. We estimate the root-mean-squared error of our resulting model to be 11% of the mean melting temperature of the data, but we note that if the accuracy of this predicted error is itself measured, our estimated fitting error itself has a root-mean-square error of 50%. In short, what we illustrate is that classification and regression predictions can vary significantly, depending on the details of how machine learning methods are applied to small data sets. This variation makes it important, if not essential, to average the predictions and compute confidence intervals about these averages to report results meaningfully. However, when properly used, these statistical methods can advance our understanding and improve predictions of material properties even for small data sets.

36 MATERIALS SCIENCE↗

Towards improved and more routine Earth system model evaluation in CMIP

The Coupled Model Intercomparison Project (CMIP) has successfully provided the climate community with a rich collection of simulation output from Earth system models (ESMs) that can be used to understand past climate changes and make projections and uncertainty estimates of the future. Confidence in ESMs can be gained because the models are based on physical principles and reproduce many important aspects of observed climate. More research is required to identify the processes that are most responsible for systematic biases and the magnitude and uncertainty of future projections so that more relevant performance tests can be developed. At the same time, there are many aspects of ESM evaluation that are well established and considered an essential part of systematic evaluation but have been implemented ad hoc with little community coordination. Given the diversity and complexity of ESM analysis, we argue that the CMIP community has reached a critical juncture at which many baseline aspects of model evaluation need to be performed much more efficiently and consistently. We provide a perspective and viewpoint on how a more systematic, open, and rapid performance assessment of the large and diverse number of models that will participate in current and future phases of CMIP can be achieved, and announce our intention to implement such a system for CMIP6. Accomplishing this could also free up valuable resources as many scientists are frequently "re-inventing the wheel" by re-writing analysis routines for well-established analysis methods. A more systematic approach for the community would be to develop and apply evaluation tools that are based on the latest scientific knowledge and observational reference, are well suited for routine use, and provide a wide range of diagnostics and performance metrics that comprehensively characterize model behaviour as soon as the output is published to the Earth System Grid Federation (ESGF). The CMIP infrastructure enforces data standards and conventions for model output and documentation accessible via the ESGF, additionally publishing observations (obs4MIPs) and reanalyses (ana4MIPs) for model intercomparison projects using the same data structure and organization as the ESM output. This largely facilitates routine evaluation of the ESMs, but to be able to process the data automatically alongside the ESGF, the infrastructure needs to be extended with processing capabilities at the ESGF data nodes where the evaluation tools can be executed on a routine basis. Efforts are already underway to develop community-based evaluation tools, and we encourage experts to provide additional diagnostic codes that would enhance this capability for CMIP. And, at the same time, we encourage the community to contribute observations and reanalyses for model evaluation to the obs4MIPs and ana4MIPs archives. The intention is to produce through the ESGF a widely accepted quasi-operational evaluation framework for CMIP6 that would routinely execute a series of standardized evaluation tasks. Over time, as this capability matures, we expect to produce an increasingly systematic characterization of models which, compared with early phases of CMIP, will more quickly and openly identify the strengths and weaknesses of the simulations. This will also reveal whether long-standing model errors remain evident in newer models and will assist modelling groups in improving their models. Finally, this framework will be designed to readily incorporate updates, including new observations and additional diagnostics and metrics as they become available from the research community.

54 ENVIRONMENTAL SCIENCES↗