Search NASA⌕ Search

SEARCH · Search NASA

Results for “interpretable machine learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 757 records · Page 42

Sim-to-real supervised domain adaptation for radioisotope identification

Machine learning has the potential to improve the speed and reliability of radioisotope identification using gamma spectroscopy. However, meticulously labeling an experimental dataset for training is often prohibitively expensive, while training models purely on synthetic data is risky due to the domain gap between simulated and experimental measurements. In this research, we demonstrate that supervised domain adaptation can substantially improve the performance of radioisotope identification models by transferring knowledge between synthetic and experimental data domains. We consider two domain adaptation scenarios: (1) a simulation-to-simulation adaptation, where we perform multi-label proportion estimation using simulated high-purity germanium detectors, and (2) a simulation-to-experimental adaptation, where we perform multi-class, single-label classification using measured spectra from handheld lanthanum bromide (LaBr) and sodium iodide (NaI) detectors. We begin by pretraining a spectral classifier on synthetic data using a custom transformer-based neural network. After subsequent fine-tuning on just 64 labeled experimental spectra, we achieve a test accuracy of 96% in the sim-to-real scenario with a LaBr detector, far surpassing a synthetic-only baseline model (75%) and a model trained from scratch (80%) on the same 64 spectra. Furthermore, we demonstrate that domain-adapted models learn more human-interpretable features than experiment-only baseline models. Overall, our results highlight the potential for supervised domain adaptation techniques to bridge the sim-to-real gap in radioisotope identification, enabling the development of accurate and explainable classifiers even in real-world scenarios where access to experimental data is limited.

Lalor, Peter W.↗

Bridging the Gap between the X-ray Absorption Spectroscopy and the Computational Catalysis Communities in Heterogeneous Catalysis: A Perspective on the Current and Future Research Directions

X-ray absorption spectroscopy (XAS) [extended X-ray absorption fine structure (EXAFS) and X-ray absorption near-edge structure (XANES)] is a key technique within the heterogeneous catalysis community to probe the structure and properties of the active site(s) for a diverse range of catalytic materials. Furthermore, the interpretation of the raw experimental data to derive an atomistic picture of the catalyst requires modeling and analysis; the EXAFS data are compared to a model, and a goodness of fit parameter is used to judge the best fit. This EXAFS modeling can often be nontrivial and time-consuming; overcoming or improving these limitations remains a central challenge for the community. Considering these limitations, this Perspective highlights how recent developments in analysis software, increased availability of reliable computational models, and application of data science tools can be used to improve the speed, accuracy, and reliability of EXAFS interpretation. In particular, we emphasize the advantages of combining theory and EXAFS as a unified technique that should be treated as a standard (when applicable) to identify catalytic sites and not two separate complementary methods. Building on the recent trends in the computational catalysis community, we also present a community-driven approach to adopt FAIR Guiding Principles for the collection, analysis, dissemination, and storage of XAS data. Written with both the experimental and theory audience in mind, we provide a unified roadmap to foster collaborations between the two communities.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Key Learnings from Hydraulic Fracturing Test Site - 2 (HFTS-2), Delaware Basin

Hydraulic fractures (HF) play a dominant role in oil and gas production from unconventional reservoirs, fracture characteristics, geometry, and extent are generally not well known and are typically inferred from various monitoring methods or subsurface models. The Hydraulic Fracturing Test Site-2 (HFTS-2) is a field-based research experiment performed in the Wolfcamp formation of the Permian (Delaware) Basin. HFTS-2, a unique joint industry program (JIP) that brings together government, academia, and industry, focused on field data acquisition and interpretation. The project has built a comprehensive HF research dataset that includes microseismic (MS), 1,500 ft of core, diagnostic formation injection tests (DFIT), fluid characterization, advanced logs, geochemistry, downhole gauges, varying completions, and permanent fiber optic (FO) cable in vertical and horizontal wells. These data were integrated and used to characterize HF geometry/dimensions and resulting depletion profiles, gain insights for completion design, and achieve a better understanding of parent well depletion effects on child well performance. The analysis and integration of the comprehensive HFTS-2 diagnostics dataset provide insights for optimal well placement and completions and improves understanding about the effects of parent well depletion. Furthermore, this dataset can be used to blind test and develop subsurface workflows for unconventional resources. Key learnings from HFTS-2 and the new technologies tested can easily be transferred to other unconventional plays.

58 GEOSCIENCES↗

Bayesian inference in band excitation scanning probe microscopy for optimal dynamic model selection in imaging

The universal tendency in scanning probe microscopy (SPM) over the last two decades is to transition from simple 2D imaging to complex detection and spectroscopic imaging modes. The emergence of complex SPM engines brings forth the challenge of reliable data interpretation, i.e., conversion from detected signals to descriptors specific to tip–surface interactions and subsequently to material’s properties. In this work, we implemented a Bayesian inference approach for the analysis of the image formation mechanisms in band excitation SPM. Compared to the point estimates in classical functional fit approaches, Bayesian inference allows for the incorporation of extant knowledge of materials and probe behavior in the form of corresponding prior distribution and return the information on the material functionality in the form of readily interpretable posterior distributions. We explore the nonlinear mechanical behaviors spatially in a classical ferroelectric material, PbTiO 3 . We observe the non-trivial evolution of the Duffing stiffness term and the nonlinearity of the sample surface, determine spatial clustering of the nonlinear response, and perform a Landau analysis on predicting the nonlinear coefficient, which indicates that ferroelectric behavior can be a cause of the observed results. These observations suggest that the spectrum of anomalous behaviors at the ferroelectric domain walls may be broader than previously believed and can extend to non-conventional mechanical properties in addition to static and microwave conductance.

36 MATERIALS SCIENCE↗

An artificial intelligence’s interpretation of complex high-resolution in situ transmission electron microscopy data

Complicated nano- and atomic-scale processes with sub-angstrom spatial resolution and millisecond time resolution visualized by in situ transmission electron microscopy (TEM) are often highly dynamical and time consuming to analyze and interpret. Here, we report how variational autoencoders (VAEs) can provide an artificial intelligence’s interpretation of high-resolution in situ TEM data by condensing and deconvoluting complicated atomic-scale dynamics into a latent space with reduced dimensionality. We designed a VAE model with high latent dimensions capable of deconvoluting information from complex high-resolution TEM data. We demonstrate how this model, with high latent dimensions trained on atomically resolved TEM images of lead sulfide (PbS) nanocrystals, is able to capture movements and perturbations of periodic lattices in both simulated and real in situ TEM data. Importantly, the VAE model shows the capability of detecting and deconvoluting dynamical nanoscale physical processes, such as the rotation of crystal lattices and intra-particle ripening during the annealing of semiconductor nanocrystals.

47 OTHER INSTRUMENTATION↗

Assessment of Condition Monitoring Methods and Technologies for Inservice Inspection and Testing of Nuclear Power Plant Components

This report was prepared for the U.S. Nuclear Regulatory Commission (NRC) to explore the application of advanced technologies toward meeting the current and future regulatory requirements for maintenance and condition monitoring of structures, systems, and components. The advanced technologies considered in this work are advanced sensors and instrumentation, data analytics, machine learning and artificial intelligence (ML/AI), physics-based models, and digital twins (DT). The interest in the application of advanced technologies for condition monitoring in nuclear power plants continues to grow, and current and future licensees are expected to implement advanced technologies as part of their inservice inspection (ISI) and inservice testing (IST) programs. This report delineates the outcomes of an exploratory investigation into the implementation of advanced condition monitoring technologies to address ISI and IST requirements. A thorough review was conducted of the existing regulatory requirements for ISI and IST, along with an analysis of associated industry practices. Additionally, a state-of-the-art assessment was performed on advanced condition monitoring technologies frequently employed in non-nuclear sectors. This research incorporated two nuclear-specific case studies to illustrate the application of these technologies within the current nuclear fleet. The report provides an exhaustive discussion on the technical challenges, considerations, and opportunities associated with the deployment of advanced condition monitoring technologies. The following are key considerations in the application of advanced technologies for the ISI and IST of nuclear power plant components: • Developing adequate verification and validation procedures to confirm the functional and non-functional requirements, • Developing technical capabilities to conduct real-time asset condition monitoring, • Establishing guidance and protocol for modeling and simulation tools to continuously meet regulatory requirements, • Addressing trustworthiness, explainability, and interpretability of ML/AI methods, • Evaluating maintenance activities to maintain an adequate safety margin and avoid undesirable conditions, • Establishing cybersecure condition monitoring programs associated with a computer-based software system, and • Establishing standardized evaluation metrics for advanced condition monitoring programs. Interest in the use of advanced technologies for condition monitoring in ISI and IST programs continues to grow, and the technology is expected to experience rapid and wide industry adoption in the near future. Adoption of advanced technologies for condition monitoring could have novel and unique impacts on regulatory activities associated with ISI and IST programs. The NRC is continuing to explore the regulatory aspects of advanced technologies as part of ISI and IST programs by pursuing additional research in this technical area.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗

Neural Posterior Estimation for Scalable and Accurate Inverse Parameter Inference in Li-Ion Batteries

Diagnosing the internal state of Li-ion batteries is critical for battery research, operation of real-world systems, and prognostic evaluation of remaining lifetime. By using physics-based models to perform probabilistic parameter estimation via Bayesian calibration, diagnostics can account for the uncertainty due to model fitness, data noise, and the observability of any given parameter. However, Bayesian calibration in Li-ion batteries using electrochemical data is computationally intensive even when using a fast surrogate in place of physics-based models, requiring many thousands of model evaluations. A fully amortized alternative is neural posterior estimation (NPE). NPE shifts the computational burden from the parameter estimation step to data generation and model training, reducing the parameter estimation time from minutes to milliseconds, enabling real-time applications. The present work shows that NPE can infer parameters equally or more accurately than Bayesian calibration, even if it leads to higher voltage reconstruction errors. We also demonstrate that the higher computational costs for data generation are tractable even in high-dimensional cases (ranging from 6 to 27 estimated parameters). The NPE method also offers several interpretability advantages over Bayesian calibration, such as local parameter sensitivity to specific regions of the voltage curve. The NPE method is demonstrated using an experimental fast charge dataset, with parameter estimates validated against measurements of loss of lithium inventory and loss of active material. The implementation is made available in a companion repository (https://github.com/NatLabRockies/BatFIT).

25 ENERGY STORAGE↗

Machine Intelligence-Centered System for Automated Characterization of Functional Materials and Interfaces

Classic design of experiment relies on a time-intensive workflow that requires planning, data interpretation, and hypothesis building by experienced researchers. Here, in this paper, we describe an integrated, machine-intelligent experimental system which enables simultaneous dynamic tests of electrical, optical, gravimetric, and viscoelastic properties of materials under a programmable dynamic environment. Specially designed software controls the experiment and performs on-the-fly extensive data analysis and dynamic modeling, real-time iterative feedback for dynamic control of experimental conditions, and rapid visualization of experimental results. The system operates with minimal human intervention and enables time-efficient characterization of complex dynamic multifunctional environmental responses of materials with simultaneous data processing and analytics. The system provides a viable platform for artificial intelligence (AI)-centered material characterization, which, when coupled with an AI-controlled synthesis system, could lead to accelerated discovery of multifunctional materials.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

A physics-informed and hierarchically regularized data-driven model for predicting fluid flow through porous media

This paper presents a new deep learning data-driven model for predicting structure dependent pore-fluid velocity fields in rock. The model is based on a Convolutional Auto-Encoder (CAE) artificial neural network capable of learning from image data generated by direct numerical simulations of fluid flow through pore-structures, such as by Lattice Boltzmann or molecular dynamics methods. The main novelty of the model in comparison to previous CAE-based data-driven approaches consists of three parts. The first is a methodology for decomposing the full-domain of the porous media into sub-regions, or “sub-domains”, in order to reduce the overall size of the CAE, batch process the sub-domains in parallel, and enable the CAE to learn local and generalizable nonlinear mappings of pore-fluid velocities. The second consists of embedding the finite difference solutions of the incompressible Navier-Stokes and continuity equations into convolutional layers prior to the CAE in order to provide the CAE with knowledge of fluid dynamics physics (PhyFlow). The third main novelty is that the training of the CAE is regularized with a hierarchical loss function that encourages the learning of fluid flow patterns (in a way similar to ranked modes in principal component analysis), ranking from most to least important. This is shown to increase the stability in learning, reduce over-fitting, and promote interpretability of the CAE neural network layers (HierCAE). The comprehensive new data-driven model, which we call the PhyFlow-HierCAE model, is shown to exhibit improved accuracy and generalizability of flow field predictions over conventional CAE models, attributable to the embedded physical knowledge and the hierarchical regularization, as well as realize orders of magnitude speed-ups in computation times as a surrogate for the direct numerical simulations. Examples of training and forward predictions on unseen pore-structures are provided and evaluated for data from Lattice Boltzmann and molecular dynamics simulations of pore-fluid flow. The model is shown to be a fast and accurate emulator (or “surrogate”) for predicting effective permeability of unseen pore-structures based on learning from relatively small direct numerical simulation datasets.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Mixture-of-Experts for Multi-Domain Defect Identification in Non-Destructive Inspection

Composite materials are widely used in aircraft structures because of their superior mechanical properties. However, their complex failure modes require sophisticated inspection methods to ensure structural integrity. Ultrasonic testing (UT) is a common non-destructive inspection (NDI) technique for aircraft composites that can detect internal and external defects with high resolution and accuracy. Despite their effectiveness, traditional UT methods rely on the manual interpretation of ultrasonic signals, which is time-consuming, labor-intensive, and subjective. Furthermore, processing such large-scale data, particularly across materials of varying thicknesses, significantly increases the computational demands of deep learning model optimization. To overcome these challenges, we propose an efficient sparse mixture-of-experts (MoE) model with a multi-level loss function and introduce four novel training objectives to improve computational efficiency and accuracy in identifying surface defects in composite aircraft materials. Here, we evaluated our approach on material with multiple thicknesses or domains comprising various defects. Our experimental results demonstrate higher accuracy and F1-Score, with only 10% training epochs compared to baseline MoE.

composite materials↗

From bulk to surface: Structure and dynamics of amorphous alumina from deep potential molecular dynamics

Understanding the atomic-scale structure and dynamics of amorphous oxide surfaces is essential for interpreting their chemical reactivity, mechanical stability, and interfacial behavior, yet direct experimental characterization remains challenging. We employ Deep Potential (DP) molecular dynamics to generate large-scale, ab initio -quality models of amorphous Al 2 O 3 bulk glasses and melt-quenched free surfaces, enabling a quantitative analysis of both structure and relaxation dynamics with statistical confidence inaccessible to direct ab initio simulation. The trained DP model reproduces experimental liquid and glass structure, captures the cooling-rate dependence of the bulk glass transition, and corrects systematic biases in the polyhedral populations predicted by widely used classical force fields. At the free surface, mass density recovers to bulk values over ~10 Å, while local coordination requires a slightly wider subsurface region to fully converge. The outermost layer is oxygen-enriched, exhibits altered polyhedral connectivity with contracted Al–O bonds, and hosts a broad population of under-coordinated motifs (notably AlO 3 and OAl 2 ) whose abundances are governed by glass stability. These under-coordinated surface motifs exhibit distinct vibrational signatures and occur as locally paired Lewis acid and Brønsted base sites consistent with bond-valence compensation, yet remain spatially dispersed rather than aggregating into extended clusters. Despite this pronounced structural heterogeneity, surface relaxation and the glass-transition temperature remain comparable to their bulk counterparts, suggesting that the disordered surface is kinetically stable once formed. Together, these results establish a molecular-level picture of amorphous alumina surfaces and demonstrate the capability of machine-learned potentials to resolve structure–property relationships in disordered oxide interfaces.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Deep learning uncertainty quantification for clinical text classification

Machine learning algorithms are expected to work side-by-side with humans in decision-making pipelines. Thus, the ability of classifiers to make reliable decisions is of paramount importance. Deep neural networks (DNNs) represent the state-of-the-art models to address real-world classification. Although the strength of activation in DNNs is often correlated with the network’s confidence, in-depth analyses are needed to establish whether they are well calibrated. In this paper, we demonstrate the use of DNN-based classification tools to benefit cancer registries by automating information extraction of disease at diagnosis and at surgery from electronic text pathology reports from the US National Cancer Institute (NCI) Surveillance, Epidemiology, and End Results (SEER) population-based cancer registries. In particular, we introduce multiple methods for selective classification to achieve a target level of accuracy on multiple classification tasks while minimizing the rejection amount—that is, the number of electronic pathology reports for which the model’s predictions are unreliable. We evaluate the proposed methods by comparing our approach with the current in-house deep learning-based abstaining classifier. Overall, all the proposed selective classification methods effectively allow for achieving the targeted level of accuracy or higher in a trade-off analysis aimed to minimize the rejection rate. On in-distribution validation and holdout test data, with all the proposed methods, we achieve on all tasks the required target level of accuracy with a lower rejection rate than the deep abstaining classifier (DAC). Interpreting the results for the out-of-distribution test data is more complex; nevertheless, in this case as well, the rejection rate from the best among the proposed methods achieving 97% accuracy or higher is lower than the rejection rate based on the DAC. We show that although both approaches can flag those samples that should be manually reviewed and labeled by human annotators, the newly proposed methods retain a larger fraction and do so without retraining—thus offering a reduced computational cost compared with the in-house deep learning-based abstaining classifier.

59 BASIC BIOLOGICAL SCIENCES↗

The suitability of differentiable, physics-informed machine learning hydrologic models for ungauged regions and climate change impact assessment

As a genre of physics-informed machine learning, differentiable process-based hydrologic models (abbreviated as δ or delta models) with regionalized deep-network-based parameterization pipelines were recently shown to provide daily streamflow prediction performance closely approaching that of state-of-the-art long short-term memory (LSTM) deep networks. Meanwhile, δ models provide a full suite of diagnostic physical variables and guaranteed mass conservation. Here, we ran experiments to test (1) their ability to extrapolate to regions far from streamflow gauges and (2) their ability to make credible predictions of long-term (decadal-scale) change trends. We evaluated the models based on daily hydrograph metrics (Nash–Sutcliffe model efficiency coefficient, etc.) and predicted decadal streamflow trends. For prediction in ungauged basins (PUB; randomly sampled ungauged basins representing spatial interpolation), δ models either approached or surpassed the performance of LSTM in daily hydrograph metrics, depending on the meteorological forcing data used. They presented a comparable trend performance to LSTM for annual mean flow and high flow but worse trends for low flow. For prediction in ungauged regions (PUR; regional holdout test representing spatial extrapolation in a highly data-sparse scenario), δ models surpassed LSTM in daily hydrograph metrics, and their advantages in mean and high flow trends became prominent. In addition, an untrained variable, evapotranspiration, retained good seasonality even for extrapolated cases. The δ models' deep-network-based parameterization pipeline produced parameter fields that maintain remarkably stable spatial patterns even in highly data-scarce scenarios, which explains their robustness. Combined with their interpretability and ability to assimilate multi-source observations, the δ models are strong candidates for regional and global-scale hydrologic simulations and climate change impact assessment.

54 ENVIRONMENTAL SCIENCES↗

Data-driven prediction of geometry- and toolpath sequence-dependent intra-layer process conditions variations in laser powder bed fusion

Geometrical features and toolpath sequence are two important factors that cause process condition variations, such as variations in the meltpool temperature or meltpool size, that might lead to undesired material properties in the laser powder bed fusion (LPBF) process. Due to the high dynamics and complex physics of the LPBF process, it is difficult to predict variations in process conditions with simulations alone. Advances in measurement technology and computational technologies open up new possibilities for smart manufacturing. In this paper, a data-driven method to predict intra-layer variations in the processing conditions that source from the toolpath sequence and part geometry is presented. The approach is demonstrated using two-color on-axis pyrometer measurements. Three demonstration cases are presented in which it is demonstrated (1) how the trained predictive model can be used as a filter to ease the interpretation of process variations and discover patterns related to toolpath and part geometry, and (2) how to generate predictions that can be used for feedforward control, i.e., for adjusting laser power or scanning speed along the toolpath using a meltpool temperature prediction model generated based on on-axis measurements. Results show that the developed prediction model is able to meaningfully predict process variations resulted from toolpath sequence and geometry. Predictions are aligned with the results from the related work of others and for the case of 180° laser path turnarounds in our high-speed X-ray imaging experiments. In conclusion, the potential issues related to the current maturity status of the process and measuring equipment that could in practice affect the performance of the proposed solutions are also discussed.

42 ENGINEERING↗

Coincident learning for beam-based rf station fault identification using phase information at the SLAC linac coherent light source

Anomalies in radio-frequency (rf) stations can result in unplanned downtime and performance degradation in linear accelerators such as SLAC’s Linac Coherent Light Source (LCLS). Detecting these anomalies is challenging due to the complexity of accelerator systems, high data volume, and scarcity of labeled fault data. Prior work identified faults using beam-based detection, combining rf amplitude and beam position monitor data. Due to the simplicity of the rf amplitude data, classical methods are sufficient to identify faults, but the recall is constrained by the low-frequency and asynchronous characteristics of the data. In this work, we leverage high-frequency, time-synchronous rf phase data to enhance anomaly detection in the LCLS accelerator. Due to the complexity of phase data, classical methods fail, and we instead train deep neural networks within the Coincident Anomaly Detection (CoAD) framework. We find that applying CoAD to phase data detects nearly 3 times as many anomalies as when applied to amplitude data, while achieving broader coverage across rf stations. Furthermore, the rich structure of phase data enables us to cluster anomalies into distinct physical categories. Through the integration of auxiliary system status bits, we link clusters to specific fault signatures, providing additional granularity for uncovering the root cause of faults. We also investigate interpretability via Shapley values, confirming that the learned models focus on the most informative regions of the data and providing insight for cases where the model makes mistakes. This work demonstrates that phase-based anomaly detection for rf stations improves both diagnostic coverage and root cause analysis in accelerator systems and that deep neural networks are essential for effective analysis.

Accelerator Physics (physics.acc-ph)↗

Using the optimal combined index weight ratio to improve the probability of anomaly detection in big area additive manufacturing

Big Area Additive Manufacturing (BAAM) of composites requires significant time, energy, and material, so it is critical to reduce production inefficiencies to make functional parts without multiple iterations. Statistical process control coupled with Principal Component Analysis (PCA) is a powerful technique that provides a quick, computationally inexpensive, and intuitive way for operators to detect defects that form in a manufacturing process without massive datasets. Recently, a combined index that is a weighted sum of the Hotelling's T 2 and squared residual error statistics has been proposed that can be monitored in one chart, improving interpretation accuracy and simplicity. However, the literature does not offer a formal method to optimise the weights. Here, we introduce two new approaches to the traditional weight selection approach using simulated and BAAM image data. Approach 1 uses a theoretically motivated optimum inspired by probabilistic principal component analysis. Approach 2 systematically varies the ratio of the weights to find the optimum. We show that approach 1 delivers optimal anomaly detection performance in select cases while approach 2 fares better in practice. Surprisingly, we also show that choosing a more complex PCA model has a minimal negative impact on anomaly detection performance compared to a more simplistic model.

3-dimensional printing↗

Jet classification using high-level features from anatomy of top jets

Recent advancements in deep learning models have significantly enhanced jet classification performance by analyzing low-level features (LLFs). However, this approach often leads to less interpretable models, emphasizing the need to understand the decision-making process and to identify the high-level features (HLFs) crucial for explaining jet classification. To address this, we consider the top jet tagging problems and introduce an analysis model (AM) that analyzes selected HLFs designed to capture important features of top jets. Our AM mainly consists of the following three modules: a relation network analyzing two-point energy correlations, mathematical morphology and Minkowski functionals for generalizing jet constituent multiplicities, and a recursive neural network analyzing subjet constituent multiplicity to enhance sensitivity to subjet color charges. We demonstrate that our AM achieves performance comparable to the Particle Transformer (ParT) while requiring fewer computational resources in a comparison of top jet tagging using jets simulated at the hadronic calorimeter angular resolution scale. Furthermore, as a more constrained architecture than ParT, the AM exhibits smaller training uncertainties because of the bias-variance tradeoff. We also compare the information content of AM and ParT by decorrelating the features already learned by AM. Lastly, we briefly comment on the results of AM with finer angular resolution inputs.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Statistical Learning for Nonlinear Model Reduction from Local Simulations of Stochastic and Particle- and Agent-Based Systems

Stochastic physical systems across the sciences that have very high-dimensional state spaces, with a large number of fast degrees of freedom that force direct simulators to proceed by integration steps that are orders of magnitude smaller than events of interests (e.g., particle collisions). Examples range from molecular motion to dynamics of large populations of cells. A grand challenge in the simulation and understanding of such systems is the systematic construction of accurate, interpretable, reduced models, enabling faster simulations, revealing fundamental properties of the dynamics, and predicting phenomena of interest that the original simulator could not reached with sufficient accuracy or within a given computational budget. In this projected we developed novel statistical estimation/machine learning techniques for analyzing and building empirical reduced models for important families of high-dimensional stochastic systems, in particular: - we developed techniques for estimating interaction kernels in interacting particle- and agent-based systems, which are ubiquitous in Physics, Biology and many other sciences, given observed trajectories of the system; - we developed techniques for nonlinear model reduction for high-dimensional stochastic systems that have a small number of unknown, nonlinear slow variables, and a large number of fast modes, that are possibly of large magnitude, given observed short trajectories of the system in the form of bursts of trajectories from different initial conditions; - we developed novel techniques for estimating linear dynamical systems on graphs when both the dynamics and the underlying graph are unknown, and we have a sparse set of space-time observations; - we considered the problem of estimating an unknown nonlinear observation function of a standard process (e.g. Brownian motion), so that we can recognized if an observed dynamics is "just" a nonlinear version of a known dynamics; we also developed benchmarks for learning algorithms aimed at learning and classifying diffusion processes.

97 MATHEMATICS AND COMPUTING↗