Search NASA⌕ Search

SEARCH · Search NASA

Results for “successive training”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Uncovering obscured phonon dynamics from powder inelastic neutron scattering using machine learning

The study of phonon dynamics is pivotal for understanding material properties, yet it faces challenges due to the irreversible information loss inherent in powder inelastic neutron scattering spectra and the limitations of traditional analysis methods. In this study, we present a machine learning framework designed to reveal obscured phonon dynamics from powder spectra. Using a variational autoencoder, we obtain a disentangled latent representation of spectra and successfully extract force constants for reconstructing phonon dispersions. Notably, our model demonstrates effective applicability to experimental data even when trained exclusively on physics-based simulations. The fine-tuning with experimental spectra further mitigates issues arising from domain shift. Analysis of latent space underscores the model’s versatility and generalizability, affirming its suitability for complex system applications. Furthermore, our framework’s two-stage design is promising for developing a universal pre-trained feature extractor. This approach has the potential to revolutionize neutron measurements of phonon dynamics, offering researchers a potent tool to decipher intricate spectra and gain valuable insights into the intrinsic physics of materials.

domain adaptation↗
DOE OSTI2022

Application of Manufacturing Quality Management Principles to PV System Installations

To help SETO/DOE achieve its goals, the IBTS team proposed a project addressing system reliability by improving installation standards and quality management. The proposed approach was designed to help achieve measurable reductions in installation defect density and improvements in the performance of PV systems by optimizing design and installation of residential and commercial PV systems. This approach addressed the soft costs associated with installations and quality management. The project demonstrated improved system reliability and reduced PV system installation costs. The software developed improved operations, decreased risk, and increased the overall value of PV systems across their lifecycle. The project used several data collection methods, including extensive industry surveys, face-to-face high-level interviews at industry conferences, stakeholder teleconferences, and in-depth interviews conducted by IBTS staff. Results from the research found the industry needs a uniform assessment method for national providers to be more efficient; the software should support both code officials and installers; most industry stakeholders would find value in a centralized software system that allows them to collect, report, and review information on in-process and completed solar installations; and mobile solutions that bridge existing knowledge gaps with inspectors and integrate with existing methodologies (such as permitting software) are of great value. The software solution developed is web-based, allowing for national access, and is built on a Google Firebase platform that can handle significant users and data. It can be used onsite or remotely, allowing for code compliance to continue despite ongoing pandemic related delays or shutdowns for local economies. The information provided by the software tool allows users to uniformly assess a system for compliance and use that aggregated data to identify training topics or create internal process designed to improving issues and reducing occurrence. This solution has multiple benefits in managing quality at time of use and promoting an increase in future safety and quality through education. Perhaps most importantly, this software increases public safety by ensuring compliance of installed systems and allows for local AHJs to remotely engage specialized and qualified solar specific expertise for oversite of the installation in their jurisdictions. Data analysis provides the quality feedback loop identifying the root cause of failure and drives installation practices to improve through training and education, resulting in systems with higher performance, greater reliability, and reduced operations and maintenance costs. With the successful completion of this project, the industry can expect reduced soft costs and increased performance and safety and will ultimately benefit from longer performing systems that cost less to operate.

14 SOLAR ENERGY↗
DOE OSTI2023

Searching for Parton Energy Loss in Quark-Gluon Plasma Droplets (Technical Report)

This technical report summarizes the main accomplishments of the research performed under the U.S. Department of Energy (DOE) Office of Science, Early Career Award (ECA), grant number DE-SC0018117, from 9/1/2017 to 8/31/2022, with Prof. Dennis Perepelitsa as the single PI. The grant proposal was to investigate the quark-gluon plasma (QGP) created in ultrarelativistic collisions of large nuclei with the ATLAS experiment at the Large Hadron Collider (LHC) and to prepare for this physics with the sPHENIX experiment at the Relativistic Heavy Ion Collider (RHIC). In particular, the focus was on QGP regions of different sizes and shapes, including the tradtional “large” collision systems such as Pb+Pb as well as small collision systems such as p+Pb, where there has been evidence of QGP “flow” but not yet the accompanying energy loss from hard-scattered partons traversing the QGP medium. Additionally, a particular tool was the use of photon+jet events, where the photon is unaffected by the QGP and thus serves as the “control” while the jet (the result of parton fragmentation) is the “probe” of the QGP. The research was successfully carried out, resulting in over ten publications of experimental measurements in peer-reviewed journals, and the significant training of junior scientists.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2025

Beyond Price Taker: Optimizing Integrated Energy Systems Considering Market/Grid Interactions

Integrated Energy Systems (IES) combine two or more processes to increase the efficiency, flexibility of operation, and the overall reliability. However, analyzing IESs in volatile electricity markets is challenging, since the volatility in electricity prices makes the conventional levelized cost-type analysis less realistic. This work presents two approaches to address the challenge: price-taker and a surrogates-based approach for incorporating market interactions. The price-taker approach formulates a multiperiod optimization problem that takes the time-varying electricity prices into account, and solves the optimization problem to determine the optimal operational schedule that maximizes the chosen economic metric. This approach is successfully applied to investigate the performance of flexible power and hydrogen co-production systems. The market surrogates approach trains a machine learning model to predict the market behavior as a function of the characteristics of the IES. The trained surrogate model is used to optimize the design and operation of the given IES in an electricity market. This approach is demonstrated on a case study involving a nuclear power plant retrofitted with a low-temperature electrolysis unit to co-produce power and hydrogen.

beyond price taker↗
DOE OSTI2022

Region-based convolutional neural network for wind turbine wake characterization from scanning lidars

A convolutional neural network is applied to lidar scan images from three experimental campaigns to identify and characterize wind turbine wakes. Initially developed as a proof-of-concept model and applied to a single data set in complex terrain, the model is now improved and generalized and applied to two other unique lidar data sets, one located near an escarpment and one located offshore. The model, initially developed using lidar scans collected in predominantly westerly flow, exhibits sensitivity to wind flow direction. The model is thus successfully generalized through implementing a standard rotation process to scan images before input into the convolutional neural network to ensure the flow is westerly. The sample size of lidar scans used to train the model is increased, and along with the generalization process, these changes to the model are shown to enhance accuracy and robustness when characterizing dissipating and asymmetric wakes. Applied to the offshore data set in which nearly 20 wind turbine wakes are included per scan, the improved model exhibits a 95% success rate in characterizing wakes and a 74% success rate in characterizing dissipating wake fragments. The improved model is shown to generalize well to the two new data sets, although an increase in wake characterization accuracy is offset by an increase in model sensitivity and false positive wake identifications.

17 WIND ENERGY↗
DOE OSTI2022

A phase transition for finding needles in nonlinear haystacks with LASSO artificial neural networks

To fit sparse linear associations, a LASSO sparsity inducing penalty with a single hyperparameter provably allows to recover the important features (needles) with high probability in certain regimes even if the sample size is smaller than the dimension of the input vector (haystack). More recently learners known as artificial neural networks (ANN) have shown great successes in many machine learning tasks, in particular fitting nonlinear associations. Small learning rate, stochastic gradient descent algorithm and large training set help to cope with the explosion in the number of parameters present in deep neural networks. Yet few ANN learners have been developed and studied to find needles in nonlinear haystacks. Driven by a single hyperparameter, our ANN learner, like for sparse linear associations, exhibits a phase transition in the probability of retrieving the needles, which we do not observe with other ANN learners. To select our penalty parameter, we generalize the universal threshold of Donoho and Johnstone (Biometrika 81(3):425–455, 1994) which is a better rule than the conservative (too many false detections) and expensive cross-validation. In the spirit of simulated annealing, we propose a warm-start sparsity inducing algorithm to solve the high-dimensional, non-convex and non-differentiable optimization problem. We perform simulated and real data Monte Carlo experiments to quantify the effectiveness of our approach.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

A robust synthetic data generation framework for machine learning in high-resolution transmission electron microscopy (HRTEM)

Machine learning techniques are attractive options for developing highly-accurate analysis tools for nanomaterials characterization, including high-resolution transmission electron microscopy (HRTEM). However, successfully implementing such machine learning tools can be difficult due to the challenges in procuring sufficiently large, high-quality training datasets from experiments. In this work, we introduce Construction Zone, a Python package for rapid generation of complex nanoscale atomic structures which enables fast, systematic sampling of realistic nanomaterial structures and can be used as a random structure generator for large, diverse synthetic datasets. Using Construction Zone, we develop an end-to-end machine learning workflow for training neural network models to analyze experimental atomic resolution HRTEM images on the task of nanoparticle image segmentation purely with simulated databases. Further, we study the data curation process to understand how various aspects of the curated simulated data—including simulation fidelity, the distribution of atomic structures, and the distribution of imaging conditions—affect model performance across three benchmark experimental HRTEM image datasets. Using our workflow, we are able to achieve state-of-the-art segmentation performance on these experimental benchmarks and, further, we discuss robust strategies for consistently achieving high performance with machine learning in experimental settings using purely synthetic data. Construction Zone and its documentation are available at https://github.com/lerandc/construction_zone.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Enhancing generative molecular design via uncertainty-guided fine-tuning of variational autoencoders

In recent years, deep generative models have been successfully applied to various molecular design tasks, particularly in the life and materials sciences. One critical challenge for pre-trained generative molecular design (GMD) models is to fine-tune them to be better suited for downstream design tasks that aim at optimizing specific molecular properties. However, redesigning and training an existing effective generative model from scratch for each new design task are impractical. Furthermore, the black-box nature of typical downstream tasks that involve property prediction makes it nontrivial to optimize the generative model in a task-specific manner. In this work, we propose an uncertainty-guided fine-tuning strategy that can effectively enhance a pre-trained variational autoencoder (VAE) for GMD through performance feedback in an active learning setting. The strategy begins by quantifying the model uncertainty of the generative model using an efficient active subspace-based UQ (uncertainty quantification) scheme. Next, the decoder diversity within the characterized model uncertainty class is explored to expand the viable space of molecular generation. The low-dimensionality of the active subspace makes this exploration tractable using a black-box optimization scheme, which in turn enables us to identify and leverage a diverse set of high-performing models to generate enhanced molecules. Empirical results across six target molecular properties using multiple VAE-based generative models demonstrate that our uncertainty-guided fine-tuning strategy consistently leads to improved models that outperform the original pre-trained models.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Surface Molecular Chemistry in Solar Fuel Research

Through this research, we aim to combine transition metal catalysts with light-absorbing semiconductors for use in efficient solar energy conversion. Upon receiving photogenerated electrons from the semiconductors, the transition metal catalysts could accelerate the reduction of carbon dioxide into energy-rich fuels. We have deposited cobalt complexes, including cobalt macrocycles and single cobalt catalysts, onto different semiconductors that demonstrated targeted activities in photochemical carbon dioxide reduction. The structures and catalytic mechanisms of the surface cobalt catalysts were investigated using advanced techniques, including X-ray absorption spectroscopy at DOE user facilities. Our research provides new strategies to enable effective coupling between molecularly defined catalytic sites with heterogeneous surfaces for converting solar energy into chemicals and fuels. Research results obtained through this project have been disseminated through journal publications and conference presentation. In addition, this project provided important interdisciplinary training opportunities for two postdoctoral scholars, four graduate researchers, and one high school student. It also allowed us to establish successful State-National Laboratory partnerships with Brookhaven National Lab and Argonne National Lab.

14 SOLAR ENERGY↗
DOE OSTI2022

2021 Consequence Management Hotline Drill After Action Report

In March 2021, a functional area drill was held at the Remote Sensing Laboratory–Nellis that focused on using CBRNResponder and the Digital Field Monitoring (DFM) tablets for sample hotline operations and the new paper Sample Control Forms (SCFs) for sample collection. Participants included staff trained and billeted as sample control specialists and Consequence Management Response Team (CMRT) field monitoring personnel. Teams were able to successfully gather and transfer samples to the sample control hotline staff through the manual process, though there were several noted areas for improvement. In July and October 2021, two additional functional area drills were held at Sandia National Laboratories that focused on field sample collection and custody transfer at the sample control hotline for the Consequence Management (CM) Radiological Assistance Program (RAP) program. The overarching goal of the drills was to evaluate the current CM process for sample collection, sample drop off, and sample control using the CBRNResponder mobile and web-based applications. The July 2021 drill had an additional focus to have a subset of samples analyzed by the local analytical laboratory, Radiation Protection Sample Diagnostics (RPSD) laboratory, to evaluate the Laboratory Access portal on CBRNResponder. All three drills were able to accomplish their objectives however, there were several issues noted (Observations: 25 Urgent, 29 Important, and 22 Improvement Opportunities). The observations were prioritized according to their impact on the mission as well as categorized to align with the programmatic functional area required to address the issue. This report provides additional detail on each observation for skillset/program leads and software developers to consider for future improvement or mandatory efforts.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗
DOE OSTI2023

QUOTAS: A New Research Platform for the Data-driven Discovery of Black Holes

We present QUOTAS, a novel research platform for the data-driven investigation of supermassive black hole (SMBH) populations. While SMBH data—observations and simulations—have grown in complexity and abundance, our computational environments and tools have not matured commensurately to exhaust opportunities for discovery. To explore the BH, host galaxy, and parent dark matter halo connection—in this pilot version—we assemble and colocate the high-redshift, z > 3 quasar population alongside simulated data at the same cosmic epochs. As a first demonstration of the utility of QUOTAS, we investigate correlations between observed Sloan Digital Sky Survey (SDSS) quasars and their hosts with those derived from simulations. Leveraging machine-learning algorithms (ML), to expand simulation volumes, we show that halo properties extracted from smaller dark-matter-only simulation boxes successfully replicate halo populations in larger boxes. Next, using the Illustris-TNG300 simulation that includes baryonic physics as the training set, we populate the larger LEGACY Expanse dark-matter-only box with quasars, and show that observed SDSS quasar occupation statistics are accurately replicated. First science results from QUOTAS comparing colocated observational and ML-trained simulated data at z3 are presented. QUOTAS demonstrates the power of ML, in analyzing and exploring large data sets, while also offering a unique opportunity to interrogate theoretical assumptions that underpin accretion and feedback models. QUOTAS and all related materials are publicly available at the Google Kaggle platform. (The full data set—observational data and simulation data—are available at: https://www.kaggle.com/ and the codes are available at:https://www.kaggle.com/datasets/quotasplatform/quotas)

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2024

Assessment of fine-tuned large language models for real-world chemistry and material science applications

The current generation of large language models (LLMs) has limited chemical knowledge. Recently, it has been shown that these LLMs can learn and predict chemical properties through fine-tuning. Using natural language to train machine learning models opens doors to a wider chemical audience, as field-specific featurization techniques can be omitted. In this work, we explore the potential and limitations of this approach. We studied the performance of fine-tuning three open-source LLMs (GPT-J-6B, Llama-3.1-8B, and Mistral-7B) for a range of different chemical questions. We benchmark their performances against “traditional” machine learning models and find that, in most cases, the fine-tuning approach is superior for a simple classification problem. Depending on the size of the dataset and the type of questions, we also successfully address more sophisticated problems. The most important conclusions of this work are that, for all datasets considered, their conversion into an LLM fine-tuning training set is straightforward and that fine-tuning with even relatively small datasets leads to predictive models. These results suggest that the systematic use of LLMs to guide experiments and simulations will be a powerful technique in any research study, significantly reducing unnecessary experiments or computations.

Van Herck, Joren↗
DOE OSTI2021

An initial exploration of Bayesian model calibration for estimating the composition of rocks and soils on Mars

The Mars Curiosity rover carries an instrument, ChemCam, designed to measure the composition of surface rocks and soil using laser-induced breakdown spectroscopy (LIBS). The measured spectra from this instrument must be analyzed to identify the component elements in the target sample, as well as their relative proportions. This process, which we call disaggregation, is complicated by so-called matrix effects, which describe nonlinear changes in the relative heights of emission lines as an unknown function of composition due to atomic interactions within the LIBS plasma. In this work, we explore the use of the plasma physics code ATOMIC, developed at Los Alamos National Laboratory, for the disaggregation task. ATOMIC has recently been used to model LIBS spectra and can robustly reproduce matrix effects from first principles. The ability of ATOMIC to predict LIBS spectra presents an exciting opportunity to perform disaggregation in a manner not yet tried in the LIBS community, namely via Bayesian model calibration. However, using it directly to solve our inverse problem is computationally intractable due to the large parameter space and the computation time required to produce a single output. Therefore, we also explore the use of emulators as a fast solution for this analysis. We discuss a proof of concept Gaussian process emulator for disaggregating two-element compounds of sodium and copper. The training and test datasets were simulated with ATOMIC using a Latin hypercube design. After testing the performance of the emulator, we successfully recover the composition of 25 test spectra with Bayesian model calibration.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Identifying quenched jets in heavy ion collisions with machine learning

Measurements of jet substructure in ultra-relativistic heavy ion collisions suggest that the jet showering process is modified by the interaction with the quark-gluon plasma. Modifications of the hard substructure of jets can be explored with modern data-driven techniques. In this study, a machine learning approach to the identification of quenched jets is designed. Jet showering processes are simulated with a jet quenching model JEWEL and a non-quenching model PYTHIA 8. Sequential substructure variables are extracted from the jet clustering history following an angular-ordered sequence and are used in the training of a neural network built on top of a long short-term memory network. We show that this approach successfully identifies the quenching effect in the presence of the large uncorrelated background of soft particles created in heavy-ion collisions.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2023

A Probabilistic Approach To Selecting Build Configurations in Package Managers

In the past decade software has grown significantly in complexity and scale. Likewise the number of dependencies for most software has increased with typical software packages depending on tens to hundreds of other packages. Such large numbers of dependencies place a significant burden on package managers to correctly maintain dependency lists and constraints between them. Due to this package managers have incorporated sophisticated tooling such as SAT solvers into their dependency management mechanisms. Despite these tools package managers still rely on many human annotated constraints for dependency and version selection. These are error-prone and require a significant amount of labor to constantly update and test. In this paper we propose a methodology to make use of historical build results in selecting the version for package dependencies. Our method utilizes the flexibility of the Spack package manager’s heavily parameterized package configurations to incorporate a machine learning model trained to predict the probability of build outcomes. This work is able to build and install packages with a 13% higher success rate than the default version selection mechanism in Spack.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Establishment of an Intertribal Technical Energy Providers Network (Final Technical Report)

The Midwest Tribal Energy Resources Association (MTERA) embarked on a 5-year (extended to 7-year) initiative aimed at advancing Tribal energy resilience and sustainability through intertribal collaboration. By bringing together Tribes in Minnesota, Wisconsin, and Michigan (EPA Region 5 Tribes), the project's scope encompassed organizational growth, governance and management formalization and enhancement, and the planning and deployment of energy-related services to Member Tribes. MTERA strategically pursued four key objectives to fulfill its mission: 1. Clearinghouse Development: Creation of a centralized hub offering valuable information, education, and outreach for Tribal communities and their neighbors. 2. Policy Liaison: Serving as a vital link between federal and state agencies to contribute to the formulation of inclusive energy policies that ensure both Tribal and regional energy success. 3. Energy Planning and Research: Providing essential support for energy planning, researching financing opportunities, and exploring effective procurement strategies. 4. Training Support: Facilitating training and apprenticeship initiatives to empower the Tribal workforce and enhance community capabilities.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2024

Best practices: Organizational execution

This article, the fourth and final installment in the DOE–IDEA series, focuses on organizational execution and how strong management practices, teamwork, and preparedness contribute to successful district energy systems. It highlights case studies from Ashley Energy and Cornell University to illustrate effective operational strategies. Ashley Energy demonstrates the importance of emergency preparedness and rapid response. After a major flood disrupted its plant, the organization restored service in under 72 hours by relying on pre-established plans, vendor relationships, and trained staff. The case emphasizes proactive contingency planning, understanding insurance processes, and empowering skilled personnel to improvise during crises. Cornell University’s example highlights the role of collaboration and transparency in long-term success. Its district energy system benefits from strong data sharing, real-time energy monitoring, and active involvement of faculty and students in system planning and innovation. This culture of teamwork and data-driven decision-making supports sustainability goals and continuous system improvement. Overall, the article shows that effective organizational execution—through preparedness, collaboration, and data transparency—is essential for maintaining reliable, efficient, and sustainable district energy systems.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗
DOE OSTI2021

DOE Award No.: DE-FE0023919 Phase 4 Scientific/Technical Report

This is the Phase 4 Report for the ‘Deepwater Methane Hydrate Characterization and Scientific Assessment or Genesis of Methane Hydrates in the Gulf of Mexico (GOM2)’ research project (DOE Award No. DE-FE0023919). The report summarizes activities from October 1, 2019 to September 30, 2020. The project is led by the University of Texas at Austin (UT). The project objective is to gain insight into the nature, formation, occurrence and physical properties of methane hydrate-bearing sediments for the purpose of methane hydrate resource appraisal through the planning and execution of drilling, coring, logging, testing and analytical activities that assess the geologic occurrence, regional context, and characteristics of marine methane hydrate deposits in the Gulf of Mexico outer continental shelf (OCS). We published a dedicated American Association of Petroleum Geologists Bulletin volume describing initial results from the UT-GOM2-1 expedition in Sept. 2020. This is part 1 of a multi-volume commitment by AAPG to this project. We further confirmed that the natural gas in hydrate at GC-955 was formed by primary microbial processes (>76.1 %). The in-situ effective permeability hydrate-bearing sandy silts at the GC-955 reservoir ranges from 0.1 md (1.0×10-16 m2) to 2.4 md (2.4×10-15m2) in cores with 83% to 93% hydrate saturation. The intrinsic permeability (the single phase permeability) is estimated from reconstituted samples to be ~12 md (1.2×10-14 m2) to ~41 md (4.1×10-14 m2). We used observation and models to interpret that the core degradation that is found in pressure cores is due to dissociation of the methane hydrate in the outer circumference of the core and dissolution of that methane into the fresh pore water that the core is stored with. We are designing approaches to minimize this core loss in the future. We spent an enormous amount of effort to further improve the ability of the pressure coring tool (the PCTB) to pressure seal correctly. We completed upgrading the upper section of the PCTB to address poor pressure. We successful tested the modifications at Geotek’s test facility in Salt Lake City (Bench Test II). We completed a Land Test of the PCTB at the Schlumberger Cameron Test and Training Facility (CTTF). The tool did not seal in 6 out of 7 tests and we clearly demonstrated that cuttings were wedging in the ball valve assembly, keeping the ball valve from sealing. We reproduced the failure mechanism observed during the land test at Salt Lake City and confirmed the sensitivity of the ball valve assembly to grit. Geotek designed and tested 9 modifications to address this issue and the PCTB is now 100% successfully sealing in the presence of grit. Our science expedition is scheduled for spring 2022 and we are fully focused on preparing for this. UT and Ohio State completed a Shallow Hazard Assessment report for each proposed UT-GOM2-2 drilling location, pursuant to 30 CFR 250.214(f) and 250.244 (f). The Shallow Hazard Reports will accompany the UT-GOM2-2 Exploration Plan that is submitted to BOEM, and completes the geological and geophysical analysis for UT-GOM2-2 permitting efforts. We updated the UT-GOM2-2 Operations Plan (Version 1). We completed the UT-GOM2-2 Science and Sample Distribution Plan (Version 1). We evaluated the scope, budget, and schedule that would result from using a commercial vessel. We developed detailed drilling schedule, mud volume, and resource estimates. We developed a vessel specification document and a well plan, and sent these documents to prospective vessel contractors.

03 NATURAL GAS↗