Search NASA⌕ Search

SEARCH · Search NASA

Results for “supervised learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 901 records · Page 50

Avian Activity Classification Using Recurrent Networks to Fuse Videos with Metadata on Imbalanced Datasets

Activity classification plays a crucial role in various real-life scenarios involving both humans and animals. There is an increasing need for precise activity classification focused on avian-solar interactions, as the usage of solar energy facilities, such as photovoltaic array power stations, has been observed to impact bird species richness, behavior, and activity. However, there has been no work to develop an automated system to monitor and classify these avian-solar interactions. All current methods rely on human observers, which is time and human resources costly and subject to errors related to searcher efficiency. With the recent success of Deep Learning models in activity classification problems, this paper develops a recurrent neural network-based model to automatically classify six avian activities around solar energy facilities. Our proposed model integrates critical feature engineering metadata with video frame data, enabling improved learning and more accurate activity classification. Furthermore, we address the challenge of data imbalance during training and demonstrate the efficacy of our model in detecting and classifying different activities within video tracks. Additionally, we analyze the saliency/backpropagation map of the trained proposed model and validate its decision-making rationale.

Avian activity classification; bidirectional LSTM;↗

Monitoring leaf phenology in moist tropical forests by applying a superpixel-based deep learning method to time-series images of tree canopies

Tropical leaf phenology-particularly its variability at the tree-crown scale-dominates the seasonality of carbon and water fluxes. However, given enormous species diversity, accurate means of monitoring leaf phenology in tropical forests is still lacking. Time series of the Green Chromatic Coordinate (GCC) metric derived from tower-based red-green-blue (RGB) phenocams have been widely used to monitor leaf phenology in temperate forests, but its application in the tropics remains problematic. To improve monitoring of tropical phenology, we explored the use of a deep learning model (i.e. superpixel-based Residual Networks 50, SP-ResNet50) to automatically differentiate leaves from non-leaves in phenocam images and to derive leaf fraction at the tree-crown scale. To evaluate our model, we used a year of data from six phenocams in two contrasting forests in Panama. Here, we first built a comprehensive library of leaf and non-leaf pixels across various acquisition times, exposure conditions and specific phenocams. We then divided this library into training and testing components. We evaluated the model at three levels: 1) superpixel level with a testing set, 2) crown level by comparing the model-derived leaf fractions with those derived using image-specific supervised classification, and 3) temporally using all daily images to assess the diurnal stability of the model-derived leaf fraction. Finally, we compared the model-derived leaf fraction phenology with leaf phenology derived from GCC. Our results show that: 1) the SP-ResNet50 model accurately differentiates leaves from non-leaves (overall accuracy of 93%) and is robust across all three levels of evaluations; 2) the model accurately quantifies leaf fraction phenology across tree-crowns and forest ecosystems; and 3) the combined use of leaf fraction and GCC helps infer the timing of leaf emergence, maturation and senescence, critical information for modeling photosynthetic seasonality of tropical forests. Collectively, this study offers an improved means for automated tropical phenology monitoring using phenocams.

54 ENVIRONMENTAL SCIENCES↗

Physics and chemistry from parsimonious representations: image analysis via invariant variational autoencoders

Electron, optical, and scanning probe microscopy methods are generating ever increasing volume of image data containing information on atomic and mesoscale structures and functionalities. This necessitates the development of the machine learning methods for discovery of physical and chemical phenomena from the data, such as manifestations of symmetry breaking phenomena in electron and scanning tunneling microscopy images, or variability of the nanoparticles. Variational autoencoders (VAEs) are emerging as a powerful paradigm for the unsupervised data analysis, allowing to disentangle the factors of variability and discover optimal parsimonious representation. Here, we summarize recent developments in VAEs, covering the basic principles and intuition behind the VAEs. The invariant VAEs are introduced as an approach to accommodate scale and translation invariances present in imaging data and separate known factors of variations from the ones to be discovered. We further describe the opportunities enabled by the control over VAE architecture, including conditional, semi-supervised, and joint VAEs. Several case studies of VAE applications for toy models and experimental datasets in Scanning Transmission Electron Microscopy are discussed, emphasizing the deep connection between VAE and basic physical principles. Python codes and datasets discussed in this article are available at https://github.com/saimani5/VAE-tutorials and can be used by researchers as an application guide when applying these to their own datasets.

36 MATERIALS SCIENCE↗

Synopsis of NREL's Automated Mobility District (AMD) Research Program and Associated Publications

An automated mobility district (AMD) envisions a system of integrated mobility options that serves major activity centers such as campuses, central business districts, and large medical facilities. The National Renewable Energy Laboratory (NREL) has been investigating the implementation prospects for fully automated passenger transport systems that are deployed to operate within dense urban settings. This document provides a synopsis of findings revealed over the last three phases of work, which have yielded insights into the creation and management of AMDs anticipated to use automated vehicle (AV) technology over the next decade. Phase I and Phase II tracked the deployment and lessons learned from 10 early-stage demonstrations of automated shuttle deployments, and their associated insights into the challenges for automated driving systems to achieve safe operations within district-scale deployments. Phase III began in-depth investigations of critical subsystem components, as automation, electrification, and on-demand service continue to converge within initial AMD operations. These directed studies focus on elements of electrification, curbfront/station management, the role of infrastructure sensing, and overall integration of AMD safety management in central, simultaneous coordination of multiple AMD fleets. Future research in AMDs includes systems engineering methodology (more frequently referred to as "digital twins") for planning, design, testing, and ongoing operation of AMDs; location (or co-location) of management functions; and human supervision and passenger communications for safety and security in unattended vehicles. The synopsis references the foundational research products (papers and presentations) that have been published through conference proceedings, journal articles, and NREL reports.

33 ADVANCED PROPULSION SYSTEMS↗

Improving in vitro Sertoli cell/gonocyte co-culture model for assessing male reproductive toxicity: Lessons learned from comparisons of cytotoxicity versus genomic responses to phthalates

Gonocytes exist in the neonatal testis and represent a transient population of male germ-line stem cells. It has been shown that stem cell self-renewal and progeny production is probably controlled by the neighboring differentiated cells and extracellular matrix (ECM) in vivo known as niches. Recently, we developed an in vitro three-dimensional (3D) Sertoli cell/gonocyte co-culture (SGC) model with ECM overlay, which creates an in vivo-like niche and supports germ-line stem cell functioning within a 3D environment. In this study, we applied morphological and cytotoxicity evaluations, as well as microarray-based gene expression to examine the effects of different phthalate esters (PE) on this model. Known in vivo male developmentally toxic PEs (DTPE) and developmentally non-toxic PEs (DNTPE) were evaluated. We observed that DTPE induced significantly greater dose-dependent morphological changes, a decrease in cell viability and an increase in cytotoxicity compared to those treated with DNTPE. Moreover, the gene expression was more greatly altered by DTPE than by DNTPE and non-supervised cluster analysis allowed the discrimination of DTPE from the DNTPE. Our systems-based GO-Quant analysis showed significant alterations in the gene pathways involved in cell cycle, phosphate transport and apoptosis regulation with DTPE but not with DNTPE treatment. Disruptions of steroidogenesis related-gene expression such as Star, Cyp19a1, Hsd17b8, and Nr4a3 were observed in the DTPE group, but not in the DNTPE group. In summary, our observation on cell viability, cytotoxicity, and microarray-based gene expression analysis induced by PEs demonstrate that our in vitro 3D-SGC system mimicked in vivo responses for PEs and suggests that the 3D-SGC system might be useful in identifying developmental reproductive toxicants.

60 APPLIED LIFE SCIENCES↗

Optimizing training trajectories in variational autoencoders via latent Bayesian optimization approach *

Unsupervised and semi-supervised ML methods such as variational autoencoders (VAE) have become widely adopted across multiple areas of physics, chemistry, and materials sciences due to their capability in disentangling representations and ability to find latent manifolds for classification and/or regression of complex experimental data. Like other ML problems, VAEs require hyperparameter tuning, e.g. balancing the Kullback–Leibler and reconstruction terms. However, the training process and resulting manifold topology and connectivity depend not only on hyperparameters, but also their evolution during training. Because of the inefficiency of exhaustive search in a high-dimensional hyperparameter space for the expensive-to-train models, here we have explored a latent Bayesian optimization (zBO) approach for the hyperparameter trajectory optimization for the unsupervised and semi-supervised ML and demonstrated for joint-VAE with rotational invariances. We have demonstrated an application of this method for finding joint discrete and continuous rotationally invariant representations for modified national institute of standards and technology database (MNIST) and experimental data of a plasmonic nanoparticles material system. The performance of the proposed approach has been discussed extensively, where it allows for any high dimensional hyperparameter trajectory optimization of other ML models.

42 ENGINEERING↗

Towards developing multiscale-multiphysics models and their surrogates for digital twins of metal additive manufacturing

Artificial intelligence (AI) embedded within digital models of manufacturing processes can be used to improve process productivity and product quality significantly. The application of such advanced capabilities particularly to highly digitalized processes such as metal additive manufacturing (AM) is likely to make those processes commercially more attractive. AI capabilities will reside within Digital Twins (DTs) which are living virtual replicas of the physical processes. DTs will be empowered to operate autonomously in a diagnostic control capacity to supervise processes and can be interrogated by the practitioner to inform the optimal processing route for any given product. The utility of the information gained from the DTs would depend on the quality of the digital models and, more importantly, their faster-solving surrogates which dwell within DTs for consultation during rapid decision-making. In this article, we point out the exceptional value of DTs in AM and focus on the need to create high-fidelity multiscale-multiphysics models for AM processes to feed the AI capabilities. We identify technical hurdles for their development, including those arising from the multiscale and multiphysics characteristics of the models, the difficulties in linking models of the subprocesses across scales and physics, and the scarcity of experimental data. We discuss the need for creating surrogate models using machine learning approaches for real-time problem-solving. We further identify non-technical barriers, such as the need for standardization and difficulties in collaborating across different types of institutions. We offer potential solutions for all these challenges, after reflecting on and researching discussions held at an international symposium on the subject in 2019. Here, we argue that a collaborative approach can not only help accelerate their development compared with disparate efforts, but also enhance the quality of the models by allowing modular development and linkages that account for interactions between the various sub-processes in AM. A high-level roadmap is suggested for starting such a collaboration.

36 MATERIALS SCIENCE↗

Forming a database to study reversed magnetic shear from the National Spherical Torus eXperiment using machine learning

Achieving a long-lived reversed magnetic shear (RMS) target plasma in the National Spherical Torus eXperiment Upgrade will require developing various sustainment scenarios. To help with the ongoing plasma control efforts, the development of a new analysis for the motional Stark effect (MSE) diagnostic using a machine learning algorithm, namely, MSE-ML, is described. MSE-ML will be used to identify patterns during RMS discharges, some of which suffer magnetohydrodynamic (MHD) events resulting in current redistribution and monotonic q-profiles. A database consisting of q and magnetic shear profiles is being constructed primarily based on the existing National Spherical Torus eXperiment data with equilibrium reconstructions constrained by the magnetic field pitch angle profile measured using the multi-channel MSE diagnostic. An unsupervised k-means clustering of the data is developed to study the RMS formation as a function of time. The initial clustering from the q-profiles shows significant differences in both amplitude and the duration of the RMS period. As a goal, the clustering results that detect and distinguish shots with substantial and sustained RMS are to be used as a preprocessing step in a supervised algorithm to identify the underlying conditions that lead to long-lasting improved confinement with RMS. Another aim of the MSE-ML study is to identify precursors of RMS-destroying MHD events in either derived data such as the q-profile or directly measured data such as the magnetic field pitch angle profile.

Uzun-Kaymak, I. U. (ORCID:0000000276251493)↗

Source-agnostic gravitational-wave detection with recurrent autoencoders

Abstract We present an application of anomaly detection techniques based on deep recurrent autoencoders (AEs) to the problem of detecting gravitational wave (GW) signals in laser interferometers. Trained on noise data, this class of algorithms could detect signals using an unsupervised strategy, i.e. without targeting a specific kind of source. We develop a custom architecture to analyze the data from two interferometers. We compare the obtained performance to that obtained with other AE architectures and with a convolutional classifier. The unsupervised nature of the proposed strategy comes with a cost in terms of accuracy, when compared to more traditional supervised techniques. On the other hand, there is a qualitative gain in generalizing the experimental sensitivity beyond the ensemble of pre-computed signal templates. The recurrent AE outperforms other AEs based on different architectures. The class of recurrent AEs presented in this paper could complement the search strategy employed for GW detection and extend the discovery reach of the ongoing detection campaigns.

47 OTHER INSTRUMENTATION↗

Collaborative Proposal: Improving Decadal Prediction of Arctic Climate Variability and Change Using a Regional Arctic System Model (RASM)

RASM is a multi-disciplinary project, which brings together researchers from six state universities, one military postgraduate school, and one DoE laboratory to address the core modeling objectives of the arctic research community articulated in the Arctic System Modeling report by Roberts et al. (2010b). This report advocates the construction of a regional downscaling tool to generate probabilistic decadal projections of Greenland ice sheet retreat, evolution of arctic sea ice cover, changes in land surface vegetation, and regional processes leading to arctic amplification. Unified coupled models such as RASM are ideal for this purpose because they simulate fine-scale physics, essential for the realistic representation of intra-annual variability, in addition to processes fundamental to long term climatic shifts (Hurrell et al. 2009). By using RASM with boundary conditions from a global model, we can generate many-member ensembles essential for understanding uncertainty in regional climate projections (Hawkins and Sutton 2009). This probabilistic approach is computationally prohibitive for high-resolution global models in the foreseeable future, and also for regional models interactively nested within global simulations. Yet it is fundamental for quantifying uncertainty in decadal forecasts to make them useful for decision makers (Doherty et al. 2009). For this reason, we have targeted development of ensemble generation techniques as a core project task (Task 4.5). Environmental impact assessment specialists need high-fidelity regional ensemble projections to improve the accuracy of their work (Challinor et al. 2009; Moss et al. 2010). This is especially true of the Arctic, where economic, social and national interests are rapidly reshaping the high north in step with regional climate change. During the next decade, considerable oil and gas discoveries are expected across many parts of the marine and terrestrial Arctic (Gautier et al. 2009), the economics of the Northern Sea Route will steadily improve (Arctic Council 2009), and sovereign claims over the Arctic Ocean will increasingly be subject to international negotiations (Proelss 2009). Issues such as these have led to an expanding demand for Arctic climate projections to aid national and commercial decisions. However, detailed information from existing models is lacking. RASM will enhance the existing Arctic system modeling capabilities and align them with the scientific and societal needs outlined above. The science involved in the development of RASM will be integrated with teaching and training at a few different levels. RASM PIs will supervise at least six postdoctoral and doctoral students with additional involvement of undergraduate research assistants. RASM postdoctoral fellows and graduate trainees will benefit from being a part of a large, collaborative, and multi-disciplinary research projects employing state-of-the-art modeling and computational tools. They will also have the opportunity to contribute to the UTEP-led education and outreach effort developed specifically for RASM. The UTEP team will use RASM as a platform for education and outreach. First, we will develop products for public dissemination, such as curriculum units, lesson plans and other materials (simulations, movies, and images) for use by students and teachers in high school and university classrooms. Second, we will facilitate bringing RASM PIs, postdocs, and graduate students into the classroom, through electronic mentorship and by contributing content via online lectures and presentations. Third, by the use of problem-based learning (PBL) approaches, we will provide real-world scenarios and problems enabling students to do research and develop position papers or presentations on topics related to RASM. (Problem-based learning is a student-centered, inquiry-based approach in which students work in teams to solve challenging, open-ended problems.) Fourth, we will develop teacher-training materials that will be developed into workshops (face-to-face or online) to help teachers understand how to use the materials we supply. Overall, we will provide a broad, and long-term RASM program for education and outreach. RASM education and outreach activities will target underrepresented populations - in particular, Hispanic students and teachers. For example, the UTEP student body is more than 70 percent Hispanic and 55 percent female, and the majority of students are the first in their families to attend college. Students from underrepresented groups will be given the chance to expand their understanding of the different scientific knowledge and processes associated with RASM. We will develop an eye-catching RASM website to include information about the project, model results and educational materials, and lists of RASM publications and presentations.

54 ENVIRONMENTAL SCIENCES↗

Neural network for 3D inertial confinement fusion shell reconstruction from single radiographs

In inertial confinement fusion (ICF), x-ray radiography is a critical diagnostic for measuring implosion dynamics, which contain rich three-dimensional (3D) information. Traditional methods for reconstructing 3D volumes from 2D radiographs, such as filtered backprojection, require radiographs from at least two different angles or lines of sight (LOS). In ICF experiments, the space for diagnostics is limited, and cameras that can operate on fast timescales are expensive to implement, limiting the number of projections that can be acquired. To improve the imaging quality as a result of this limitation, convolutional neural networks (CNNs) have recently been shown to be capable of producing 3D models from visible light images or medical x-ray images rendered by volumetric computed tomography. Here, we propose a CNN to reconstruct 3D ICF spherical shells from single radiographs. We also examine the sensitivity of the 3D reconstruction to different illumination models using preprocessing techniques such as pseudo-flatfielding. To resolve the issue of the lack of 3D supervision, we show that training the CNN utilizing synthetic radiographs produced by known simulation methods allows for reconstruction of experimental data as long as the experimental data are similar to the synthetic data. We also show that the CNN allows for 3D reconstruction of shells that possess low mode asymmetries. Further comparisons of the 3D reconstructions with direct multiple LOS measurements are justified.

3D Reconstruction↗

Anomaly Detection for Power System Generation Control based on Hierarchical DBSCAN

The generation level of a generator in power grid is under control of multiple control loops such as governor action, Automatic Generation Control (AGC), and manual control. These control loops are vulnerable to cyber attacks and could become potential targets for the malicious adversary. In this paper, we investigated the detection of abnormal generation controls induced by cyber attacks. One data-driven anomaly detection methodology is presented based on the behavior conformity of generation units located in the same balancing authority. A semi-supervised clustering algorithm with Hierarchical Density based Spatial Clustering of Application with Noise (HDBSCAN) is proposed for the detection model training. In our previous work, we obtained a synthetic dataset that covers scenarios including normal operation, generation control under ramp attack, switching attack, AGC integrity attacks, etc. and it is used to evaluate the proposed clustering algorithm. Experimental results show that the proposed algorithm provides better detection accuracy than K-means clustering and can distinguish not only between normal and abnormal generation controls but also among various anomaly scenarios.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Training courses on neutron detection systems on the ISIS research reactor: on-site and through internet training

Today, ISIS research reactor is an essential tool for Education and Training programs organized by the National Institute for Nuclear Science and Technology (INSTN) from CEA. In the field of nuclear instrumentation, the INSTN offers both, theoretical courses and training courses on the use of neutron detection systems taking advantage of the ISIS research reactor for the supply of a wide range of neutron fluxes. This paper describes the content of the training carried out on the use of neutron detectors and detection systems, on-site or remote. The ISIS reactor is a 700 kW open core pool type reactor. The facility is very flexible since neutron detectors can be inserted into the core or its vicinity, and be used at different levels of power according to the needs of the course. Neutron fluxes, typically ranging from 1 to 10{sup 12} n/cm{sup 2}.s, can be obtained for the characterisation of the neutron detectors and detection systems. For the monitoring of the neutron density at low level of power, the Instrumentation and Control (I and C) system of the reactor is equipped with two detection systems, named BN1 and BN2. Each way contains a fission chamber, type CFUL01, connected to an electronic system type SIREX.The system works in pulse mode and exhibits two outputs: the counting rate and the doubling time. For the high level of power, the I and C is equipped with two detection systems HN1 and HN2.Each way contain a boron ionization chamber (type CC52) connected to an electronics system type SIREX. The system works in current mode and has two outputs: the current and the doubling time. For each mode, the trainees can observe and measure the signal at the different stages of the electronic system, with an oscilloscope. They can understand the role of each component of the detection system: detector, cable and each electronic block. The limitation of the detection modes and their operating range can be established from the measured signal. The trainees can also modify the settings of the electronic system, such as the high voltage and the discrimination level in order to obtain all the characteristic curves of the detectors. These curves are used to define the right setting of the electronic system and to discuss the expected degradation of the detector signal resulting from the detector damage under the integrated neutron and gamma fluxes. Moreover, in addition to the study of the neutron detection systems itself, the integration of the measurements made by these detection systems in the logic of the safety system of the nuclear reactor is also addressed. Providing the trainees with an extensive overview of each part of the neutron monitoring instrumentation apply to a nuclear reactor, hands-on measurements on the ISIS reactor play a major role in ensuring a practical and comprehensive understanding of the neutron detection system and their integration in the safety system of nuclear reactors. It also gives a solid background for the follow up and the development of the neutron detection systems. In addition to on-reactor training, Internet Reactor Laboratory capability has been implemented on the ISIS reactor in 2014. For the Internet Reactor Laboratory an extensive video conference system has been implemented on ISIS reactor. The system includes 4 cameras and the transmission of the video signal given by the supervision system of the reactor which records and processes the data of the reactor. According to the pedagogic needs during the training courses, the lecturer on the ISIS reactor chooses to broadcast the relevant information at each stage of the course. For example, graph showing the histogram of the counting and current as a function of the time, or the electrical signal observed on the oscilloscope, can be broadcasted trough internet. By interacting through the video conference, the remote classroom is able to ask for changes in the reactor power or settings of the detection systems. They can also ask for the broadcast of some particular information. At the guest institution, the information is displayed in two parts or screens, as shown in the Figure 3. Concerning the interaction with - and the feedback from - the remote classroom, the camera of the video system in the remote classroom is used to ensure the contact between the trainees and the lecturer and reactor operators. Thus, the Internet Reactor Laboratory is complementary to the on reactor training courses. It allows distant learning, reducing the overall cost of the course when this is necessary. It can efficiently be used for the development of the human resources needed by the nuclear industry and the nuclear programs in countries without research reactors.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Multilevel Cybersecurity for Photovoltaic Systems

The motivation behind this project is to protect critical infrastructure in electric power generation pertaining to solar photovoltaic (PV) systems. This growing renewable energy resource is becoming a more vital part of the nation’s energy portfolio, particularly since it has achieved grid-parity to existing generation methods in terms of cost. It is thus vital that steps be taken to ensure the cybersecurity of these assets. The project goal was to devise a multilevel cybersecurity solution to address PV security gaps at the inverter and system levels, and field test the solution under the supervision and review of a US-based solar inverter manufacturer and PV installer/operator. A two-level cyberattack defense approach was formulated whereby the first level, the solar inverter level, hardens individual devices and achieves a deeply cyber-secure inverter. The inverter level security involves a multi-layer defense-in-depth approach for securing the inverter while also providing data for the system level algorithms. The second level, the system level, addresses intrusion detection and restoration involving an ensemble of inverters and relevant systems.

14 SOLAR ENERGY↗

A unified large language model–based framework for heterogeneous PV image diagnosis

With advances in imaging technologies, modern photovoltaic (PV) systems generate large volumes of heterogeneous image data, including visible, electroluminescence (EL), and infrared (IR) images. Existing PV image analysis models, particularly deep learning approaches, are typically task-specific and lack cross-modality generalization. To address this limitation, this paper proposes an open-source large language model (LLM)–based unified framework for heterogeneous PV image diagnostics. Through task-aware diagnostic prompting, the framework enables analysis of visible, EL, and IR images within a single pipeline, supporting both zero-shot and few-shot inference and binary and multiclass classification. It is compatible with state-of-the-art multimodal LLMs, including ChatGPT, Gemini, Claude, Qwen, and CLIP. The framework is evaluated on PV module condition classification (clean, soiling, snow, hail, and bird droppings) using visible images, cell crack detection using EL images, and hotspot detection using IR images. GPT-5.1 in few-shot mode achieves the best performance, with classification accuracy exceeding 97.3%. Open-source models such as Qwen and CLIP also deliver competitive results on visible images (around 90% accuracy), though their performance is more limited on EL and IR modalities. On the full ELPV dataset, the framework achieves 83.5% zero-shot accuracy, within 2.8% of the supervised CNN baseline, confirming scalability to larger benchmarks. Practical aspects such as reproducibility, response latency, and confidence estimation are systematically analyzed. The framework operates across PV image modalities without modality- or task-specific training, making it well suited as a rapid pre-screening tool to support downstream detailed diagnostics. A benchmark dataset of diverse labeled PV images is also released.

Li, Baojie↗

FM4NPP: A Scaling Foundation Model for Nuclear and Particle Physics

Large language models have revolutionized artificial intelligence by enabling large, generalizable models trained through self-supervision. This paradigm has inspired the development of scientific foundation models (FMs). However, applying this capability to experimental particle physics is challenging due to the sparse, spatially distributed nature of detector data, which differs dramatically from natural language. This work addresses if an FM for particle physics can scale and generalize across diverse tasks. We introduce a new dataset with more than 11 million particle collision events and a suite of downstream tasks and labeled data for evaluation. We propose a novel self-supervised training method for detector data and demonstrate its neural scalability with models that feature up to 188 million parameters. With frozen weights and task-specific adapters, this FM consistently outperforms baseline models across all downstream tasks. The performance also exhibits robust data-efficient adaptation. Further analysis reveals that the representations extracted by the FM are task-agnostic but can be specialized via a single linear mapping for different downstream tasks.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Snekmer: a scalable pipeline for protein sequence fingerprinting based on amino acid recoding

Abstract Motivation The vast expansion of sequence data generated from single organisms and microbiomes has precipitated the need for faster and more sensitive methods to assess evolutionary and functional relationships between proteins. Representing proteins as sets of short peptide sequences (kmers) has been used for rapid, accurate classification of proteins into functional categories; however, this approach employs an exact-match methodology and thus may be limited in terms of sensitivity and coverage. We have previously used similarity groupings, based on the chemical properties of amino acids, to form reduced character sets and recode proteins. This amino acid recoding (AAR) approach simplifies the construction of protein representations in the form of kmer vectors, which can link sequences with distant sequence similarity and provide accurate classification of problematic protein families. Results Here, we describe Snekmer, a software tool for recoding proteins into AAR kmer vectors and performing either (i) construction of supervised classification models trained on input protein families or (ii) clustering for de novo determination of protein families. We provide examples of the operation of the tool against a set of nitrogen cycling families originally collected using both standard hidden Markov models and a larger set of proteins from Uniprot and demonstrate that our method accurately differentiates these sequences in both operation modes. Availability and implementation Snekmer is written in Python using Snakemake. Code and data used in this article, along with tutorial notebooks, are available at http://github.com/PNNL-CompBio/Snekmer under an open-source BSD-3 license. Supplementary information Supplementary data are available at Bioinformatics Advances online.

59 BASIC BIOLOGICAL SCIENCES↗

Data-driven analysis of ultrasonic pressure tube inspection data - 220

Pressure tubes are critical components of the CANDU reactors and other pressurized heavy water type reactors, as they contain the nuclear fuel and the coolant. Manufacturing flaws, as well as defects developed during the in-service operation, can lead to coolant leakage and can potentially damage the reactor. The current inspection process of these flaws is based on manually analyzing ultrasonic data received from multiple probes during planned, statutory outages. Recent advances on ultrasonic inspection tools enable the provision of high resolution data of significantly large volumes. This is highlighting the need for an efficient autonomous signal analysis process. Typically, the automation of ultrasonic inspection data analysis is approached by knowledge-based or supervised data-driven methods. This work proposes an unsupervised data-driven framework that requires no explicit rules, nor individually labeled signals. The framework follows a two-stage clustering procedure that utilizes the DBSCAN density-based clustering algorithm and aims to provide decision support for the assessment of potential defects in a robust and consistent way. Nevertheless, verified defect dimensions are essential in order to assess the results and train the framework for unseen defects. Initial results of the implementation are presented and discussed, with the method showing promise as a means of assessing ultrasonic inspection data. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗