SEARCH · Search NASA

Results for “successive training”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

All sources NASA NTRS DOE OSTI

DOE OSTI2021

DeepMerge – II. Building robust deep learning algorithms for merging galaxy identification across domains

In astronomy, neural networks are often trained on simulation data with the prospect of being used on telescope observations. Unfortunately, training a model on simulation data and then applying it to instrument data leads to a substantial and potentially even detrimental decrease in model accuracy on the new target dataset. Simulated and instrument data represent different data domains, and for an algorithm to work in both, domain-invariant learning is necessary. Here we employ domain adaptation techniques— Maximum Mean Discrepancy (MMD) as an additional transfer loss and Domain Adversarial Neural Networks (DANNs)— and demonstrate their viability to extract domain-invariant features within the astronomical context of classifying merging and non-merging galaxies. Additionally, we explore the use of Fisher loss and entropy minimization to enforce better in-domain class discriminability. We show that the addition of each domain adaptation technique improves the performance of a classifier when compared to conventional deep learning algorithms. We demonstrate this on two examples: between two Illustris-1 simulated datasets of distant merging galaxies, and between Illustris-1 simulated data of nearby merging galaxies and observed data from the Sloan Digital Sky Survey. The use of domain adaptation techniques in our experiments leads to an increase of target domain classification accuracy of up to ~20%. With further development, these techniques will allow astronomers to successfully implement neural network models trained on simulation data to efficiently detect and study astrophysical objects in current and future large-scale astronomical surveys.

galaxies: interactions↗

DOE OSTI2023

Modeling hadronization using machine learning

We present the first steps in the development of a new class of hadronization models utilizing machine learning techniques. We successfully implement, validate, and train a conditional sliced-Wasserstein autoencoder to replicate the Pythia generated kinematic distributions of first-hadron emissions, when the Lund string model of hadronization implemented in Pythia is restricted to the emissions of pions only. The trained models are then used to generate the full hadronization chains, with an IR cutoff energy imposed externally. The hadron multiplicities and cumulative kinematic distributions are shown to match the Pythia generated ones. We also discuss possible future generalizations of our results.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

DOE OSTI2025

Construction Methodology Transformation for the Benefit of Workforce Development

Construction is a key economic engine driving both national and global economies. While manual, onsite construction methods dominate the U.S. construction industry, a major shift towards offsite methods has been underway due to its efficiency, speed, and potential cost savings. The workforce necessary for offsite construction growth does not exist in its current form because of the focus on onsite methodologies and the lack of exposure to offsite building methods at all levels of a student’s learning journey. The growth of the U.S. construction industry and competitiveness in an increasingly global construction market over the coming decades can only be supported by a dramatic increase in the use of offsite methods, which requires ramping up workforce training for certain skillsets. The goal of Construction Methodology Transformation for the Benefit of Workforce Development was to understand the opportunities and barriers in both education and industry and to identify best practices for offering curriculum and training to educators, industry, and students that would support skills needed for careers in offsite construction. Our team proposed combining three offsite construction workforce development needs: content development, exposure and training, and job placement - under a single Platform model that would increase experience and career opportunities for students and help match them with potential industry members. Through our proposed solution we expected to see: developed offsite curriculum being utilized by educators and students; an increase in the identification of construction technology and offsite construction methods; an average increase in knowledge gain of at least 25% after participation in pilots; better equipped candidates who are prepared for jobs in offsite construction; and a beta workforce development platform that helps build more pathways for students looking for careers in offsite construction. The two pilots included almost 250 students and resulted in an average knowledge gain of 37 percent. Our research has identified areas of opportunity, for both education and industry to make collaborative training programs more efficient and successful. The chosen techniques for this program are extremely effective when both the school and factory have solid processes and cultures in place to accept students into training programs. This project serves as an important stepping stone to industrywide collaboration to move workforce development for offsite construction forward across the country. With continued collaboration programs like this can provide much needed early exposure and training in offsite construction and we can begin to fill important positions for the future of construction.

99 GENERAL AND MISCELLANEOUS↗

DOE OSTI2024

Scaling HPC Education

Throughout the cyberinfrastructure community there are a large range of resources available to train faculty and young scholars about successful utilization of computational resources for research. The challenge that the community faces is that training materials abound, but they can be difficult to find, and often have little information about the quality or relevance of offerings. Building on existing software technology, we propose to build a way for the community to better share and find training and education materials through a federated training repository. In this scenario, organizations and authors retain physical and legal ownership of their materials by sharing only catalog information, organizations can refine local portals to use the best and most appropriate materials from both local and remote sources, and learners can take advantage of materials that are reviewed and described more clearly. In this paper, we introduce the HPC ED pilot project, a federated training repository that is designed to allow resource providers, campus portals, schools, and other institutions to both incorporate training from multiple sources into their own familiar interfaces and to publish their local training materials.

community engagement↗

DOE OSTI2024

Investigation of candidates for reactor produced radioactive materials in support of radiological training exercises

Bromine-82, Potassium-42 and Copper-64 have been successfully adopted as radioactive surrogates for outdoor large area contamination training. The goal of this project was to discover new materials that could supplement potassium bromide (KBr) and copper pellets in radiological dispersal device (RDD) training events to reduce the down time of the training fields and to broaden the toolbox of the RDD surrogate training event program at Idaho National Laboratory. Of the ten different materials investigated, sodium nitrite, gallium metal, and gallium oxide presented the greatest promise as potential materials to replace potassium bromide in RDD training events.

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗

DOE OSTI2021

Predicting transcriptional responses to cold stress across plant species

Although genome-sequence assemblies are available for a growing number of plant species, gene-expression responses to stimuli have been cataloged for only a subset of these species. Many genes show altered transcription patterns in response to abiotic stresses. However, orthologous genes in related species often exhibit different responses to a given stress. Accordingly, data on the regulation of gene expression in one species are not reliable predictors of orthologous gene responses in a related species. Here, we trained a supervised classification model to identify genes that transcriptionally respond to cold stress. A model trained with only features calculated directly from genome assemblies exhibited only modest decreases in performance relative to models trained by using genomic, chromatin, and evolution/diversity features. Models trained with data from one species successfully predicted which genes would respond to cold stress in other related species. Cross-species predictions remained accurate when training was performed in cold-sensitive species and predictions were performed in cold-tolerant species and vice versa. Models trained with data on gene expression in multiple species provided at least equivalent performance to models trained and tested in a single species and outperformed single-species models in cross-species prediction. These results suggest that classifiers trained on stress data from well-studied species may suffice for predicting gene-expression patterns in related, less-studied species with sequenced genomes.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2025

Status of the Down-Blending of Irradiated IGR Graphite Fuel in Kazakhstan

Dry processing remains the primary solution for managing the down-blending of irradiated IGR HEU fuel. Several tasks have been initiated and completed to achieve this, including lab modernization, lab-scale and full-scale testing, designing and fabricating an in-paddle mixing drum, and commissioning both a down-blending system and a crushing and milling system. Additionally, a testing and training center was modernized, the equipment was successfully commissioned, and the IGR HEU fuel blocks were repackaged into daily containers. The training of operators and the construction of a new down-blending facility are tasks that will need to be completed in the near future. The progress in these areas continues to validate that the proposed method for down-blending irradiated HEU graphite fuel, followed by cementation of the down-blended material for permanent disposition, appears to be achievable.

12 - MGMT OF RADIOACTIVE AND NON-RADIOACTIVE WASTE↗

DOE OSTI2026

Demonstration of Control of Laser-Plasma Instabilities in the Laboratory Using STUD Pulses (Spike Trains of Uneven Duration and Delay)

The success of laser Driven Inertial Fusion Technology (LaDrIFT) hinges on controlling laser-plasma instabilities (LPI) for effective and non-deleterious energy coupling, together with the control of implosion hydrodynamic instabilities (IHI) for target integrity. Conventional approaches ignore LPI and focus on IHI. LPI control suggests the use of low intensities, short wavelengths, and thus the slow implosions of thinner shells, while IHI control calls for thicker shells, fast implosions and thus at higher laser intensities and ablation pressures. These contradicting requirements severely restrict LaDrIFT design space, flexibility and scalability. This program demonstrates, with theoretical designs and their preliminary experimental realizations, that STUD pulses (Spike Trains of Uneven Duration and Delay) can control LPI in high-energy-density (HED) laser-created plasmas and explore this physics for the first time with high repetition (rep) rate lasers.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

DOE OSTI2024

Tribute to Kenneth Sauer (1931–2022): a mentor, a role-model, and an inspiration to all in the field of photosynthesis

Abstract Kenneth (Ken) Sauer was a mainstay of research in photosynthesis at the University of California, Berkeley and the Lawrence Berkeley National Laboratory (LBNL) for more than 50 years. Ken will be remembered by his colleagues, and other workers in the field of photosynthesis as well, for his pioneering work that introduced the physical techniques whose application have enriched our understanding of the basic reactions of oxygenic photosynthesis. His laboratory was a training ground for many students and postdocs who went on to success in the field of photosynthesis and many others. Trained as a physical chemist, he always brought that quantitative approach to research questions and used several spectroscopic methods in his research. His broad scientific interests concerned the role of manganese in oxygen evolution, electronic properties of chlorophylls, energy transport in antenna complexes, and electron transport reactions. He was also an enthusiastic teacher, an enormously successful mentor who leaves behind a legion of scientists as his abiding legacy, a lover of music and the outdoors with many interests beyond science, and a dedicated family man with a great sense of humility. In this tribute, we summarize some aspects of Ken Sauer’s life and career, illustrated with selected research achievements, and describe his approach to research and life as we perceived it, which is complemented by reminiscences of several current researchers in photosynthesis and other fields. The supporting material includes Ken Sauers’s CV and publication list, as well as a list of the graduate students and postdocs he trained and of researchers that spent a sabbatical in his lab.

Plant Sciences↗

DOE OSTI2023

Subtleties in the trainability of quantum machine learning models

A new paradigm for data science has emerged, with quantum data, quantum models, and quantum computational devices. This field, called quantum machine learning (QML), aims to achieve a speedup over traditional machine learning for data analysis. However, its success usually hinges on efficiently training the parameters in quantum neural networks, and the field of QML is still lacking theoretical scaling results for their trainability. Some trainability results have been proven for a closely related field called variational quantum algorithms (VQAs). While both fields involve training a parametrized quantum circuit, there are crucial differences that make the results for one setting not readily applicable to the other. In this work, we bridge the two frameworks and show that gradient scaling results for VQAs can also be applied to study the gradient scaling of QML models. Our results indicate that features deemed detrimental for VQA trainability can also lead to issues such as barren plateaus in QML. Consequently, our work has implications for several QML proposals in the literature. In addition, we provide theoretical and numerical evidence that QML models exhibit further trainability issues not present in VQAs, arising from the use of a training dataset. We refer to these as dataset-induced barren plateaus. These results are most relevant when dealing with classical data, as here the choice of embedding scheme (i.e., the map between classical data and quantum states) can greatly affect the gradient scaling.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2024

Newton-Raphson AC Power Flow Convergence Based on Deep Learning Initialization and Homotopy Continuation

Power flow forms the basis of many power system studies. With the increased penetration of renewable energy, grid planners tend to perform multiple power flow simulations under various operating conditions and not just selected snapshots at peak or light load conditions. Getting a converged AC power flow (ACPF) case remains a significant challenge for grid planners especially in large power grid networks. This paper proposes a two-stage approach to improve Newton-Raphson ACPF convergence and was applied to a 6102 bus Electric Reliability Council of Texas (ERCOT) system. The first stage utilizes a deep learning-based initializer with data re-training. Here a deep neural network (DNN) initializer is developed to provide better initial voltage magnitude and angle guesses to aid in power flow convergence. This is because Newton-Raphson ACPF is quite sensitive to the initial conditions and bad initialization could lead to divergence. The DNN initializer includes a data re-training framework that improves the initializer's performance when faced with limited training data. The DNN initializer successfully solved 3,285 cases out of 3,899 non-converging dispatch and performed better than random forest and DC power flow initialization methods. ACPF cases not solved in this first stage are then passed through a hot-starting algorithm based on homotopy continuation with switched shunt control. The hot-starting algorithm successfully converged 416 cases out of the remaining 614 non-converging ACPF dispatch. In conclusion, the combined two-stage approach achieved a 94.9% success rate, by converging a total of 3,701 cases out of the initial 3,899 unsolved cases.

Deep learning↗

DOE OSTI2020

An Automatic Learning Framework for Smart Residential Communities

Predictability has been foundational to matching supply and demand in the day-to-day operation of the electric power system. Demand predictability is eroding because of the increased use of renewable energy resources and more sophisticated loads, such as electric vehicles and smart appliances. In this paper, an automatic software framework is described which can be used for load forecasting in smart communities. A time-varying clustering-based Markov chain approach is used to predict the energy consumption of residential buildings in a smart community. The training data is based on 1-minute meter data of occupied homes over one month. The data points are first clustered based on the energy consumption and the time of the day. Then, the original data is converted using the Centroids of the clusters. A time-varying Markov chain is subsequently trained to model the energy consumption behavior of residents for each home using the transformed data. The trained model is shown to successfully predict load in 5-minute intervals over a 24 hours period.

Zandi, Helia↗

DOE OSTI2021

Auto-Curation of Seismic Event Data for Signal Denoising

Denoising contaminated seismic signals for later processing is a fundamental problem in seismic signals analysis. Neural network approaches have shown success denoising local signals when trained on short-time Fourier transform spectrograms. One challenge of this approach is the onerous process of hand-labeling event signals for training. By leveraging the SCALODEEP seismic event detector, we develop an automated set of techniques for labeling event data. Despite region specific challenges, training the neural network denoiser on machine curated events shows comparable performance to the neural network trained on hand curated events. We showcase our technique with two experiments, one using Utah regional data and one using regional data from the Korean peninsula.

58 GEOSCIENCES↗

DOE OSTI2021

Evaluating Scalograms for Seismic Event Denoising

Denoising contaminated seismic signals for later processing is a fundamental problem in seismic signals analysis. The most straightforward denoising approach, using spectral filtering, is not effective when noise and seismic signal occupy the same frequency range. Neural network approaches have shown success denoising local signal when trained on short-time Fourier transform spectrograms (Zhu et al 2018; Tibi et al 2021). Scalograms, a wavelet-based transform, achieved ~15% better reconstruction as measured by dynamic time warping on a seismic waveform test set than spectrograms, suggesting their use as an alternative for denoising. We train a deep neural network on a scalogram dataset derived from waveforms recorded by the University of Utah Seismograph Stations network. We find that initial results are no better than a spectrogram approach, with additional overhead imposed by the significantly larger size of scalograms. A robust exploration of neural network hyperparameters and network architecture was not performed, which could be done in follow on work.

58 GEOSCIENCES↗

DOE OSTI2023

Shooter Alarm System Final Report FY23

Lawrence Livermore National Laboratory (LLNL) is developing a multiphysics sensor package for automatic live arms fire detection for use in schools, houses of worship, hospi tals, etc. The goal is to have a package the size of a common smoke or CO2 detector with a price point of $50 or less which may be deployed throughout the aforementioned facilities. The commercial device will detect live gun fire with low probability of false alarm and auto matically alert first responders. A prototype board with four accelerometers, two infrared (IR) and two microphones has been developed and deployed at two experiments at LLNL’s Small Firearms Training Facility (SFTF). The device successfully and consistently measured signals on the accelerometer and acoustic channels. IR responses were measured depending upon the environment and sound source.

42 ENGINEERING↗

DOE OSTI2023

Using Eye-Tracking to Quantify Reverse Engineering Expertise

Software reverse engineering (RE) requires analysts to closely read and make decisions about code. Little is known about what makes an analyst successful, making it difficult to train new analysts or design tools to augment existing ones. The goal of this project was to quantify the eye movement behaviors supporting RE and code comprehension more generally. We applied eye-tracking methods from the language comprehension literature to understand where analysts direct their attention over time when completing tasks (e.g., function identification, bug detection). Across three studies, we manipulated aspects of code hypothesized to impact comprehension (e.g., variable name meaningfulness, code complexity) and presentation methods (e.g., line-by-line, free viewing, gaze-contingent moving window) to understand effects on accuracy and gaze patterns. Results showed clear benefits of meaningful variable names, and effects of expertise on global and line-specific viewing patterns. Findings could inspire empirically-supported tool or analytic adaptations that help to reduce analyst workload.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2025

Shallow cumulus entrainment: observational retrieval, physical interpretation, and climate impacts (Final grant report)

This document constitutes a final technical report for DE-SC0020083, a research grant awarded by the US Department of Energy Office of Science, to Prof. Daniel Kirshbaum at McGill University. The original research proposal, entitled "Shallow cumulus entrainment: observational retrieval, physical interpretation, and climate impacts", defined four scientific objectives that synthesized ARM observations with turbulence-permitting large-eddy simulations (LES) to quantify and understand the process of cumulus entrainment, whereby a cumulus cloud ingests surrounding air through its lateral edges. These objectives included developing observational climatologies of cumulus bulk entrainment rate at two ARM observatories, physical interpretation of these findings using LES, quantification of the impacts of subcloud circulations on entrainment, and the climate impacts of flow-dependent entrainment variations. In the six years that have elapsed since the grant was awarded (three funded years and three no-cost annual extensions), all four of the objectives were successfully addressed. Four personnel were trained (one B.Sc., one M.Sc. to completion, five years of Ph.D. training, and 2.5 years of postdoctoral training), eight peer-reviewed articles were published in high-impact journals, and 20 presentations were delivered (three invited).

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2022

Evaluating cloud liquid detection against Cloudnet using cloud radar Doppler spectra in a pre-trained artificial neural network

Detection of liquid-containing cloud layers in thick mixed-phase clouds or multi-layer cloud situations from ground-based remote-sensing instruments still poses observational challenges, yet improvements are crucial since the existence of multi-layer liquid layers in mixed-phase cloud situations influences cloud radiative effects, cloud lifetime, and precipitation formation processes. Hydrometeor target classifications such as from Cloudnet that require a lidar signal for the classification of liquid are limited to the maximum height of lidar signal penetration and thus often lead to underestimations of liquid-containing cloud layers. Here we evaluate the Cloudnet liquid detection against the approach of Luke et al. (2010) which extracts morphological features in cloud-penetrating cloud radar Doppler spectra measurements in an artificial neural network (ANN) approach to classify liquid beyond full lidar signal attenuation based on the simulation of the two lidar parameters particle backscatter coefficient and particle depolarization ratio. We show that the ANN of Luke et al. (2010) which was trained under Arctic conditions can successfully be applied to observations at the mid-latitudes obtained during the 7-week-long ACCEPT field experiment in Cabauw, the Netherlands, in 2014. In a sensitivity study covering the whole duration of the ACCEPT campaign, different liquid-detection thresholds for ANN-predicted lidar variables are applied and evaluated against the Cloudnet target classification. Independent validation of the liquid mask from the standard Cloudnet target classification against the ANN-based technique is realized by comparisons to observations of microwave radiometer liquid-water path, ceilometer liquid-layer base altitude, and radiosonde relative humidity. In addition, a case-study comparison against the cloud feature mask detected by the space-borne lidar aboard the CALIPSO satellite is presented. Three conclusions were drawn from the investigation. First, it was found that the threshold selection criteria of liquid-related lidar backscatter and depolarization alone control the liquid detection considerably. Second, all threshold values used in the ANN framework were found to outperform the Cloudnet target classification for deep or multi-layer cloud situations where the lidar signal is fully attenuated within low liquid layers and the cloud radar is able to detect the microphysical fingerprint of liquid in higher cloud layers. Third, if lidar data are available, Cloudnet is at least as good as the ANN. The times when Cloudnet outperforms the ANN in liquid detections are often associated with situations where cloud dynamics smear the imprint of cloud microphysics on the radar Doppler spectra.

54 ENVIRONMENTAL SCIENCES↗