Search NASA⌕ Search

SEARCH · Search NASA

Results for “supervised training”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 397 records · Page 22
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Line Faults Classification Using Machine Learning on Three Phase Voltages Extracted from Large Dataset of PMU Measurements

An end-to-end supervised learning method is developed to classify transmission line faults in a twoyear field-recorded dataset that includes synchronized measurements of three-phase voltages recorded by 38 Phasor Measurement Units (PMU) sparsely located in in the US Western Grid interconnection. Statistical analysis is performed to extract features from this large dataset to train Support Vector Machine (SVM), Random Forest (RF), and eXtreme Gradient Boosting (XGBoost) classifiers initially. The training further leverages a simulated dataset from a synthetic grid with 12 PMUs to increase the number of faults of types infrequently seen in the field-recorded dataset. Training the classification models with the combined dataset resulted in a classification accuracy of 97.7%. This is a significant improvement over 89.7% to 92.5% accuracy obtained by relying on the field-recorded dataset alone.

47 OTHER INSTRUMENTATION↗
DOE OSTI2025

Delamination-informed lifecycle decisions: A dielectric and machine learning framework for composite sorting and recycling

Composite materials are widely used in aerospace, marine, and automotive sectors due to their high strength-to-weight ratio and durability. However, their long-term reliability can be compromised by damage accumulation. Specifically, delamination initiation serves as a precursor to structural failure, which is often difficult to detect during damage inspection. Identifying and sorting delamination initiation in samples not only increases operational safety while providing critical information for end-of-life decisions, which influences both the service life extension value and the efficiency of fiber extraction during recycling. This research addresses two challenges: (1) developing a nondestructive, ex-situ framework to sort composite materials based on damage severity, particularly delamination, and (2) understanding how damage in composites influences resin removal during pyrolysis. Both experimental work and finite element analysis were performed to predict critical stress levels that are associated with delamination onset. Based on these results, three loading levels 50 %, 75 %, and 90 % of maximum stress, were selected for controlled experiments, generating composite samples with varying extents of damage for machine learning model training. Microscopic imaging of these samples confirmed the damage progression from matrix cracking to delamination, validating the computational predictions. We explored supervised machine learning using dielectric measurements to classify damage states. Preliminary results show an artificial neural network can identify early delamination which is a potential precursor to failure, with 94.44 % accuracy on our dataset. A parallel investigation into the effect of damage severity on pyrolysis recycling showed that heavily delaminated samples required significantly less energy for comparable matrix removal than undamaged samples.

dielectric variables↗
DOE OSTI2024

Neptunyl and Uranyl Peroxide Chemistry in Molten Salts, Uranyl Structures from Nature, and Thermodynamic Studies Extending into the Transuranium Elements (Final Report)

This project was initially funded in 2007 and the current technical report is for 2019-2022. The specific objectives of this project (2019-2022) were: (1) Synthesis of actinide peroxide compounds in molten salt eutectics, (2) Studies of new uranyl minerals with fascinating structures and compositions, (3) Drop-solution calorimetric studies of actinide compounds extending into the transuranium elements, with an emphasis on the uranyl-sulfate system, (4) Continuation of studies of uranyl vanadate clusters synthesized using ionic liquids, (5) The training of Ph.D. graduate students in actinide chemistry, and to introduce undergraduate students to actinide research through providing research assistantships and supervision. The report lists 67 archival journal papers describing the work, of which 23 were since 2019. Highlights of the work are summarized for the period 2019-2022.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2023

Automated Quantification of Wind Turbine Blade Leading Edge Erosion from Field Images

Wind turbine blade leading edge erosion is a major source of power production loss and early detection benefits optimization of repair strategies. Two machine learning (ML) models are developed and evaluated for automated quantification of the areal extent, morphology and nature (deep, shallow) of damage from field images. The supervised ML model employs convolutional neural networks (CNN) and learns features (specific types of damage) present in an annotated set of training images. The unsupervised approach aggregates pixel intensity thresholding with calculation of pixel-by-pixel shadow ratio (PTS) to independently identify features within images. The models are developed and tested using a dataset of 140 field images. The images sample across a range of blade orientation, aspect ratio, lighting and resolution. Each model (CNN v PTS) is applied to quantify the percent area of the visible blade that is damaged and classifies the damage into deep or shallow using only the images as input. Both models successfully identify approximately 65% of total damage area in the independent images, and both perform better at quantifying deep damage. The CNN is more successful at identifying shallow damage and exhibits better performance when applied to the images after they are preprocessed to a common blade orientation.

Aird, Jeanie A.↗
DOE OSTI2026

Machine Learning for Multipactor Susceptibility Prediction in Planar RF Gaps

Multipactor discharge is a nonlinear electron avalanche that limits the performance of high-power radio-frequency (RF) and vacuum electronic devices. Predicting multipactor susceptibility traditionally relies on Monte Carlo or particle-in-cell (PIC) simulations, which become computationally expensive for large parametric studies. In this work, we present a supervised machine-learning (ML) framework for prediction of multipactor susceptibility in a two-surface planar geometry. The models are trained using high-fidelity PIC simulation generated susceptibility data and learn the relationship between operational parameters, geometry, and material-dependent secondary electron emission properties. The proposed approach enables rapid reconstruction of susceptibility charts while preserving the physical structure of multipactor growth regions.

43 PARTICLE ACCELERATORS↗
NASA NTRSDate not supplied

Application of Support Vector Regression to Derive Crater Depth/Diameter From Satellite Images

Through the study of impact crater shapes, one can draw important conclusions about the nature and evolution of planetary surfaces [e.g., 1-4].In particular, studying the depth (d) to diameter (D)ratio (d/D) of a population of impact craters, in combination with crater count statistics, can yield valuable insights regarding rates of erosion and burial[5]. Motivated by the great abundance of available planetary surface image data, the goal of this project is to develop an efficient way to estimate d/D from satellite images of impact craters for which stereo information is not available [6]. We set out to develop and train a machine learning algorithm to extract d/D from a dataset of synthetic impact crater images for which model d/D is known. The applications of machine learning to planetary science are numerous and diverse [7], including automatic planetary surface mapping [8] and the detection of impact craters [9]. Our algorithm makes use of Support Vector Regression (SVR), which is a type of Support Vector Machine (SVM) [10, 11].SVMs are a branch of supervised machine learning valued for their straightforward implementation and versatility in solving both classification and regression problems. In regression analysis, an SVR algorithm produces a hyperplane function to fit the training data points, as well as an ε-tube that surrounds the hyperplane. Tunable hyperparameters include the width of the ε-tube (ε) and the amount an algorithm is penalized for points which fall outside the ε-tube.

L R Chin↗
DOE OSTI2018

A Practical Approach to Sizing Neural Networks

Most approaches to machine learning experiments currently involve tedious hyperparameter tuning. This article first shows how to practically estimate the maximum size of a neural network given a training data set. We present four easily applicable rules to analytically determine the capacity of neural network architectures. The rules are derived based on MacKay’s information theoretic model of supervised machine learning [22]. This allows the comparison of the efficiency of different architectures independently of a task. Second, we introduce and experimentally validate a heuristic method to estimate the neural network capacity requirement for a given dataset and labeling. This allows an estimate of the required size of a neural network for a given problem. We conclude the article with a discussion on the consequences of sizing the network wrongly, which includes both increased computation effort for training as well as reduced generalization capability.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Self-Supervised T-GCN for Detection of Disturbance and Propagation in Power Grid

Urban power systems increasingly rely on dense sensing to monitor grid reliability, yet disturbance labels are scarce and events are rare. We present a self-supervised spatio-temporal method that detects, localizes, and characterizes grid frequency disturbances across urban areas using only unlabeled data. Our approach trains a tiny Temporal Graph Convolutional Network (T-GCN) to forecast per-site frequency residuals (deviation from 60 Hz). The sensor graph is constructed directly from signals using pre-event Pearson correlation with a cross-correlation lag penalty without geocoding. At inference, node-level anomalies are the model's forecast errors; region-level alarms arise from connected components of high-score nodes. We estimate disturbance propagation by computing per-node arrival times (first persistent exceedance), then fit a planar or time-of-arrival model to obtain direction, speed, and an epicenter proxy. With only three real events collected at decisecond resolution across U.S. cities, we evaluate the T-GCN and report time-to-detect, footprint size, and propagation consistency. We further show that short-window embeddings from the T-GCN's hidden states enable few-shot event-vs-background recognition via a simple prototypical classifier. Despite minimal data and no labels, our system yields fast, spatially coherent detection and interpretable propagation maps, offering a practical, lightweight pathway to city-scale grid resilience analytics.

Niu, Haoran [ORNL] (ORCID:0000000155228297)↗
DOE OSTI2020

SO(3)-invariance of informed-graph-based deep neural network for anisotropic elastoplastic materials

This work examines the frame-invariance (and the lack thereof) exhibited in simulated anisotropic elasto-plastic responses generated from supervised machine learning of classical multi-layer and informed-graph-based neural networks, and proposes different remedies to fix this drawback. The inherent hierarchical relations among physical quantities and state variables in an elasto-plasticity model are first represented as informed, directed graphs, where three variations of the graph are tested. While feed-forward neural networks are used to train path-independent constitutive relations (e.g., elasticity), recurrent neural networks are used to replicate responses that depends on the deformation history, i.e. or path dependent. In dealing with the objectivity deficiency, we use the spectral form to represent tensors and, subsequently, three metrics, the Euclidean distance between the Euler Angles, the distance from the identity matrix, and geodesic on the unit sphere in Lie algebra, can be employed to constitute objective functions for the supervised machine learning. In this, the aim is to minimize the measured distance between the true and the predicted 3D rotation entities. Following this, we conduct numerical experiments on how these metrics, which are theoretically equivalent, may lead to differences in the efficiency of the supervised machine learning as well as the accuracy and robustness of the resultant models. Neural network models trained with tensors represented in component form for a given Cartesian coordinate system are used as a benchmark. Our numerical tests show that, even given the same amount of information and data, the quality of the anisotropic elasto-plasticity model is highly sensitive to the way tensors are represented and measured. The results reveal that using a loss function based on geodesic on the unit sphere in Lie algebra together with an informed, directed graph yield significantly more accurate rotation prediction than the other tested approaches.

42 ENGINEERING↗
DOE OSTI2023

The LSST AGN Data Challenge: Selection Methods

Abstract Development of the Rubin Observatory Legacy Survey of Space and Time (LSST) includes a series of Data Challenges (DCs) arranged by various LSST Scientific Collaborations that are taking place during the project's preoperational phase. The AGN Science Collaboration Data Challenge (AGNSC-DC) is a partial prototype of the expected LSST data on active galactic nuclei (AGNs), aimed at validating machine learning approaches for AGN selection and characterization in large surveys like LSST. The AGNSC-DC took place in 2021, focusing on accuracy, robustness, and scalability. The training and the blinded data sets were constructed to mimic the future LSST release catalogs using the data from the Sloan Digital Sky Survey Stripe 82 region and the XMM-Newton Large Scale Structure Survey region. Data features were divided into astrometry, photometry, color, morphology, redshift, and class label with the addition of variability features and images. We present the results of four submitted solutions to DCs using both classical and machine learning methods. We systematically test the performance of supervised models (support vector machine, random forest, extreme gradient boosting, artificial neural network, convolutional neural network) and unsupervised ones (deep embedding clustering) when applied to the problem of classifying/clustering sources as stars, galaxies, or AGNs. We obtained classification accuracy of 97.5% for supervised models and clustering accuracy of 96.0% for unsupervised ones and 95.0% with a classic approach for a blinded data set. We find that variability features significantly improve the accuracy of the trained models, and correlation analysis among different bands enables a fast and inexpensive first-order selection of quasar candidates.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2024

Unsupervised multimodal fusion of in-process sensor data for advanced manufacturing process monitoring

Effective monitoring of manufacturing processes is crucial for maintaining product quality and operational efficiency. Modern manufacturing environments often generate vast amounts of complementary multimodal data, including visual imagery from various perspectives and resolutions, hyperspectral data, and machine health monitoring information such as actuator positions, accelerometer readings, and temperature measurements. However, fusing and interpreting this complex, high-dimensional data presents significant challenges, particularly when labeled datasets are unavailable or impractical to obtain. This paper presents a novel approach to multimodal sensor data fusion in manufacturing processes, inspired by the Contrastive Language-Image Pre-training (CLIP) model. We leverage contrastive learning techniques to correlate different data modalities without the need for labeled data, overcoming limitations of traditional supervised machine learning methods in manufacturing contexts. Our proposed method demonstrates the ability to handle and learn encoders for five distinct modalities: visual imagery, audio signals, laser position (x and y coordinates), and laser power measurements. By compressing these high-dimensional datasets into low-dimensional representational spaces, our approach facilitates downstream tasks such as process control, anomaly detection, and quality assurance. The unsupervised nature of our method makes it broadly applicable across various manufacturing domains, where large volumes of unlabeled sensor data are common. We evaluate the effectiveness of our approach through a series of experiments, demonstrating its potential to enhance process monitoring capabilities in advanced manufacturing systems. This research contributes to the field of smart manufacturing by providing a flexible, scalable framework for multimodal data fusion that can adapt to diverse manufacturing environments and sensor configurations. The proposed method paves the way for more robust, data-driven decision-making in complex manufacturing processes.

Contrastive Learning↗
DOE OSTI2024

Highly sensitive 2D X-ray absorption spectroscopy via physics informed machine learning

Abstract Improving the spatial and spectral resolution of 2D X-ray near-edge absorption structure (XANES) has been a decade-long pursuit to probe local chemical reactions at the nanoscale. However, the poor signal-to-noise ratio in the measured images poses significant challenges in quantitative analysis, especially when the element of interest is at a low concentration. In this work, we developed a post-imaging processing method using deep neural network to reliably improve the signal-to-noise ratio in the XANES images. The proposed neural network model could be trained to adapt to new datasets by incorporating the physical features inherent in the latent space of the XANES images and self-supervised to detect new features in the images and achieve self-consistency. Two examples are presented in this work to illustrate the model’s robustness in determining the valence states of Ni and Co in the LiNi x Mn y Co 1-x-y O 2 systems with high confidence.

36 MATERIALS SCIENCE↗
DOE OSTI2016

SU-CD-PinS Room/Hall E-01

Medical Physicists are frequently involved in shipping radioactive materials or supervising those who do. Current U.S. Department of Transportation Hazardous Material Regulations, 49 CFR Parts 171 - 185, require hazmat employees to have documented training specified in 49 CFR 172 Subpart H. A hazmat employee is defined as an individual who: (1) loads, unloads or handles hazardous material; (2) manufactures, tests, reconditions, repairs, modifies, marks or otherwise represents containers, drums or packagings as qualified for use in the transportation of hazardous materials; (3) prepares hazardous materials for transportation; (4) is responsible for safety of transporting hazardous materials; or (5) operates a vehicle used to transport hazardous materials. Recurrent training is required at least once every three years. (The IATA two-year training interval is not applicable and is generally misunderstood.) FAA has escalated inspection and enforcement. Facilities who ship radiopharmaceuticals to other laboratories, return radiopharmaceuticals or radioactive sources to suppliers, or otherwise ship radioactive materials have been cited for failure to provide and document the required training. The interrelationship of transportation regulations, 49 CFR, IATA, ICAO and other transportation regulations, which are frequently misunderstood, will be explained. The course will cover typical shipments by air and highway which are encountered in a medical institution. Items such as fissile materials, highway route controlled quantities, rail shipments, vessel shipments and such will be omitted; although specific questions may be addressed. A major objective of the course is to present the process of shipping radioactive material in a sequential and logical fashion. How radioactive materials for transportation purposes are defined by activity concentrations for exempt materials and activity limits for exempt consignments will be explained. Radioactive material shipments of excepted packages and Type A packages will be emphasized. The program is designed to meet the function specific DOT training requirements for shippers of medical radioactive materials. General awareness training and security awareness training can be obtained from two free DOT training CDs. Safety training and security awareness training is generally satisfied by the training required under the institution’s radioactive material license. For shippers of radioactive Yellow III labeled packages an in-depth written security plan and training are no longer required as of April 8, 2010. In general almost all shippers of medical radioactive material are now not required to have an in-depth security plan. Contents of general awareness training, security awareness training and in-depth security plans will be briefly outlined. It is the hazmat employer’s responsibility to ensure that each hazmat employee is properly trained. No third party can fulfill that requirement. It is the hazmat employer’s responsibility to determine the degree to which this course meets the employer’s requirements, including contents of the course and the examination. Participants will gain sufficient knowledge to prepare hazmat training programs for others in their institutions. A handout will be posted which should be printed out and brought to the course for reference during the presentation. The handout will also satisfy part of the training documentation required by DOT. A feature handout section is a composite table which provides A1, A2, RQ, Exempt Concentration, and Exempt Consignment values in a single table in both Becquerel and Curie units. Course attendance will be certified through the AAPM CEU documentation system. Learning Objectives: Understand the regulatory requirements for shipping radioactive materials. Understand the regulatory requirements for training of hazmat employees. Comprehend how to classify, package, mark, label, document, placard, and transport radioactive materials.

61 RADIATION PROTECTION AND DOSIMETRY↗
DOE OSTI2016

SU-G-PinS Room/Hall E-01

Medical Physicists are frequently involved in shipping radioactive materials or supervising those who do. Current U.S. Department of Transportation Hazardous Material Regulations, 49 CFR Parts 171 - 185, require hazmat employees to have documented training specified in 49 CFR 172 Subpart H. A hazmat employee is defined as an individual who: (1) loads, unloads or handles hazardous material; (2) manufactures, tests, reconditions, repairs, modifies, marks or otherwise represents containers, drums or packagings as qualified for use in the transportation of hazardous materials; (3) prepares hazardous materials for transportation; (4) is responsible for safety of transporting hazardous materials; or (5) operates a vehicle used to transport hazardous materials. Recurrent training is required at least once every three years. (The IATA two year training interval is not applicable and is generally misunderstood.) FAA has escalated inspection and enforcement. Facilities who ship radiopharmaceuticals to other laboratories, return radiopharmaceuticals or radioactive sources to suppliers, or otherwise ship radioactive materials have been cited for failure to provide and document the required training. The interrelationship of transportation regulations, 49 CFR, IATA, ICAO and other transportation regulations, which are frequently misunderstood, will be explained. The course will cover typical shipments by air and highway which are encountered in a medical institution. Items such as fissile materials, highway route controlled quantities, rail shipments, vessel shipments and such will be omitted; although specific questions may be addressed. A major objective of the course is to present the process of shipping radioactive material in a sequential and logical fashion. How radioactive materials for transportation purposes are defined by activity concentrations for exempt materials and activity limits for exempt consignments will be explained. Radioactive material shipments of excepted packages and Type A packages will be emphasized. The program is designed to meet the function specific DOT training requirements for shippers of medical radioactive materials. General awareness training and security awareness training can be obtained from two free DOT training CDs. Safety training and security awareness training is generally satisfied by the training required under the institution’s radioactive material license. For shippers of radioactive Yellow III labeled packages an in-depth written security plan and training are no longer required as of April 8, 2010. In general almost all shippers of medical radioactive material are now not required to have an in-depth security plan. Contents of general awareness training, security awareness training and in-depth security plans will be briefly outlined. It is the hazmat employer’s responsibility to ensure that each hazmat employee is properly trained. No third party can fulfill that requirement. It is the hazmat employer’s responsibility to determine the degree to which this course meets the employer’s requirements, including contents of the course and the examination. Participants will gain sufficient knowledge to prepare hazmat training programs for others in their institutions. A handout will be posted which should be printed out and brought to the course for reference during the presentation. The handout will also satisfy part of the training documentation required by DOT. A feature handout section is a composite table which provides A1, A2, RQ, Exempt Concentration, and Exempt Consignment values in a single table in both Becquerel and Curie units. Course attendance will be certified through the AAPM CEU documentation system. Learning Objectives: Understand the regulatory requirements for shipping radioactive materials. Understand the regulatory requirements for training of hazmat employees. Comprehend how to classify, package, mark, label, document, placard, and transport radioactive materials.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2022

Automated System-wide Event Detection and Classification Using Machine Learning on Synchrophasor Data

As the number of phasor measurement units (PMUs) deployed in a power system increases, and their data volume streamed to the control canter intensifies, operators are facing challenges related to the analysis of such data, which need to be observed and responded to as the measurements are displayed in the Control Room. Humans are generally unable to process such large amount of data efficiently and rapidly. There is an apparent need for automated ways to analyze the data, extract actionable information about occurrence of specific events, and characterize the events quickly and cost effectively. This paper discusses the use of machine learning (ML) to facilitate such tasks by providing automated, highly computationally efficient, and cost-effective ways of extracting actionable information from synchrophasor big data in real-time. We developed Big Data Smart (BDSmart) ML-based prototype tool for the Control Room use that automatically analyses data properties from synchrophasor system measurements taken across the three grid Interconnections in the USA (Western, Eastern and ERCOT). The data collected from several hundreds of PMUs located across the Interconnections over a period of two years have been made available for our extensive study. As a result, we were able to identify a number of big data properties that influence how ML methodology is applied to select, develop, train and test the data models that can eventually be used for the tool implementation. The resulting set of candidate algorithms spans unsupervised, supervised, semi-supervised and transfer-learning approaches. Many ML techniques, such as decision trees, multinomial logistic regression, feed-forward neural networks, K-nearest neighbor, multiclass support vector machine, and single and multi-channel convolutional neural networks, are implemented, and their performance is examined. We offer the results from testing the data models. The novelty of our study is in the approaches for bad data detection and mitigation, selection of a simplified feature for event detection, and data label improvements. As a result, we came up with a list of recommendations for the utilities on how to improve the PMU recording practices to cater to the future ML applications aimed at automating the analysis of synchrophasor data.

Synchrophasors, Machine Learning, System-wide Even↗
DOE OSTI2022

Seismic Waveform Inversion Capability on Resource-Constrained Edge Devices

Seismic full wave inversion (FWI) is a widely used non-linear seismic imaging method used to reconstruct subsurface velocity images, however it is time consuming, has high computational cost and depend heavily on human interaction. Recently, deep learning has accelerated it’s use in several data-driven techniques, however most deep learning techniques suffer from overfitting and stability issues. In this work, we propose an edge computing-based data-driven inversion technique based on supervised deep convolutional neural network to accurately reconstruct the subsurface velocities. Deep learning based data-driven technique depends mostly on bulk data training. In this work, we train our deep convolutional neural network (DCN) (UNet and InversionNet) on the raw seismic data and their corresponding velocity models during the training phase to learn the non-linear mapping between the seismic data and velocity models. The trained network is then used to estimate the velocity models from new input seismic data during the prediction phase. The prediction phase is performed on a resource-constrained edge device such as Raspberry Pi. Raspberry Pi provides real-time and on-device computational power to execute the inference process. In addition, we demonstrate robustness of our models to perform inversion in the presence on noise by performing both noise-aware and no-noise training and feeding the resulting trained models with noise at different signal-to-noise (SNR) ratio values. We make great efforts to achieve very feasible inference times on the Raspberry Pi for both models. Specifically, the inference times per prediction for UNet and InversionNet models on Raspberry Pi were 22 and 4 s respectively whilst inference times for both models on the GPU were 2 and 18 s which are very comparable. Finally, we have designed a user-friendly interactive graphical user interface (GUI) to automate the model execution and inversion process on the Raspberry Pi.

Manu, Daniel (ORCID:0000000154982677)↗
DOE OSTI2025

Is tokenization needed for masked particle modeling?

In this work, we significantly enhance masked particle modeling (MPM), a self-supervised learning scheme for constructing highly expressive representations of unordered sets relevant to developing foundation models for high-energy physics. In MPM, a model is trained to recover the missing elements of a set, a learning objective that requires no labels and can be applied directly to experimental data. We achieve significant performance improvements over previous work on MPM by addressing inefficiencies in the implementation and incorporating a more powerful decoder. We compare several pre-training tasks and introduce new reconstruction methods that utilize conditional generative models without data tokenization or discretization. We show that these new methods outperform the tokenized learning objective from the original MPM on a new test bed for foundation models for jets, which includes using a wide variety of downstream tasks relevant to jet physics, such as classification, secondary vertex finding, and track identification.

conditional generative models↗