Search NASA⌕ Search

SEARCH · Search NASA

Results for “Automated tools”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 721 records · Page 40
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Automated pipeline framework for processing of large-scale building energy time series data

Commercial buildings account for one third of the total electricity consumption in the United States and a significant amount of this energy is wasted. Therefore, there is a need for “virtual” energy audits, to identify energy inefficiencies and their associated savings opportunities using methods that can be non-intrusive and automated for application to large populations of buildings. Here we demonstrate virtual energy audits applied to large populations of buildings’ time-series smart-meter data using a systematic approach and a fully automated Building Energy Analytics (BEA) Pipeline that unifies, cleans, stores and analyzes building energy datasets in a non-relational data warehouse for efficient insights and results. This BEA pipeline is based on a custom compute job scheduler for a high performance computing cluster to enable parallel processing of Slurm jobs. Within the analytics pipeline, we introduced a data qualification tool that enhances data quality by fixing common errors, while also detecting abnormalities in a building’s daily operation using hierarchical clustering. We analyze the HVAC scheduling of a population of 816 buildings, using this analytics pipeline, as part of a cross-sectional study. With our approach, this sample of 816 buildings is improved in data quality and is efficiently analyzed in 34 minutes, which is 85 times faster than the time taken by a sequential processing. The analytical results for the HVAC operational hours of these buildings show that among 10 building use types, food sales buildings with 17.75 hours of daily HVAC cooling operation are decent targets for HVAC savings. Overall, this analytics pipeline enables the identification of statistically significant results from population based studies of large numbers of building energy time-series datasets with robust results. These types of BEA studies can explore numerous factors impacting building energy efficiency and virtual building energy audits. This approach enables a new generation of data-driven buildings energy analysis at scale.

36 MATERIALS SCIENCE↗
DOE OSTI2026

Best practices in software development for robust and reproducible geoscientific models based on insights from the Global Carbon Budget's dynamic vegetation models

Computational models play an increasingly vital role in scientific research by enabling the numerical simulation of complex processes. Such models are also fundamental in geosciences. For instance, they offer critical insights into the impacts of global change on the Earth system today and in the future. Beyond their value as research tools, models are also software products and should therefore adhere to certain established software engineering standards. However, scientists are rarely trained as software developers, which can lead to potential deficiencies in software quality like unreadable, inefficient, or erroneous code. The complexity of models, coupled with their integration into broader workflows, also often makes it challenging to reproduce results, evaluate processes, and build upon them. In this paper, we review the state and current practices of the development processes of the state-of-the-art land surface models used by the Global Carbon Budget. We combine the experience of modelers from the respective research groups with the expertise of software engineers from tech companies to outline key principles and tools for improving software quality in research. We explore four main areas: (1) model testing and validation, (2) scientific, technical, and user documentation, (3) version control, continuous integration, and code review, and (4) the portability and reproducibility of workflows. Our review reveals that while modeling communities are incorporating many best practices, significant room for improvement remains in areas such as automated testing, automated documentation, and reproducibility. Therefore, we here identify and promote essential software engineering practices, including numerous examples of practices from within the community that can serve as guidelines for other models and could help streamline processes across the entire community. We conclude with an open-source example implementation of these principles, demonstrating portable and reproducible data flows, a continuous integration setup, and web-based visualizations. This example may serve as a practical resource for model developers, users, and all scientists engaged in scientific programming.

Gregor, Konstantin [Technical Univ. of Munich (Ger↗
DOE OSTI2021

Energy Management Information Systems Technical Resources Report

Guide supports federal facility staff in understanding, designing, procuring, and implementing Energy Management Information Systems (EMIS) as a valuable component of their portfolio-level energy and water planning and management strategies. As a broad and rapidly evolving family of tools that monitor, analyze, and control building energy use and system performance, EMIS tools present significant opportunities for federal sector energy savings and improved operational performance. EMIS are at the forefront of transforming energy management best practices by providing building owners and operators with well-organized building performance and energy consumption data, enabling a host of analytic capabilities. These capabilities include portfolio-wide energy benchmarking, data visualization, and key performance indicator tracking; automated fault detection and diagnostics (AFDD); artificial intelligence for predictive analytics and control; automated measurement and verification of energy conservation measures; and supervisory control enabling automated system optimization and demand management.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2025

Toward Drilling the Perfect Geothermal Well: An International Research Coordination Network for Geothermal Drilling Optimization Supported by Deep Machine Learning and Cloud Based Data Aggregation

The EDGE project, supported by the U.S. Department of Energy Geothermal Technologies Office under award DE-EE0008793, established a data-driven framework for improving the efficiency, cost-effectiveness, and reliability of geothermal well drilling. The project focused on developing scalable data infrastructure, advanced machine learning and probabilistic models, and integrated analytics tools to support continuous drilling optimization. A central objective was to reduce geothermal drilling costs by up to seventy percent while minimizing the risk of well failure through predictive diagnostics and adaptive planning. Over the project period, a comprehensive data repository was designed and deployed, incorporating records from over one hundred geothermal wells across varied geological settings. This repository supported both structured and unstructured data and adhered to FAIR data principles, enabling provenance tracking, quality control, and standardized metadata. The project introduced automated ingestion pipelines and a cloud-hosted platform that facilitated access to raw, processed, and derived datasets. This infrastructure served as the foundation for model development and analysis. Machine learning workflows were developed to predict key drilling metrics including rate of penetration, non-productive time, and total drilling costs. Self-organizing maps and dimensionality reduction methods were used to uncover operational patterns and outliers, while supervised learning algorithms such as random forests and deep neural networks were applied to forecast performance outcomes. The models were validated on heterogeneous datasets from both U.S. and Icelandic fields, demonstrating variable but significant predictive accuracy. The results indicated that finer temporal resolution, inclusion of lithological data, and consistency in operational annotations could substantially improve model performance. The project also implemented process mining techniques to reconstruct state-transition models from drilling event logs. These models enabled the identification of deviations from optimal workflows and provided insights into recurring failure modes. Analysis of non-productive time highlighted the impact of equipment failures, geological challenges, and human factors, offering opportunities for targeted mitigation strategies. The EDGE Dashboard was developed as a web-based expert system integrating data visualization, model outputs, and user-driven queries. It provided an accessible interface for operators to explore historical data, evaluate predicted outcomes, and compare drilling scenarios. Initial feedback from project partners suggested that the dashboard could serve as a foundation for more advanced advisory and optimization tools. Overall, the EDGE project demonstrated the feasibility and value of applying modern data science techniques to geothermal drilling. It delivered a set of interoperable tools and models that can support more efficient, lower-risk well development. The findings point toward a viable path for transitioning from advisory analytics to semi-autonomous drilling systems, contingent on continued collaboration, expanded datasets, and field validation. The project results have immediate relevance for drilling operations, data management practices, and future geothermal R&D efforts aimed at achieving reliable, cost-competitive geothermal energy at scale.

15 GEOTHERMAL ENERGY↗
DOE OSTI2026

Automated, reliable, and efficient continental-scale replication of 7.3 petabytes of computational simulation data: A case study

We report on our experiences replicating 7.3 petabytes (PB) of Earth System Grid Federation (ESGF) computational simulation data from Lawrence Livermore National Laboratory (LLNL) in California to Argonne National Laboratory (ANL) in Illinois and Oak Ridge National Laboratory (ORNL) in Tennessee—a task motivated by a need for increased reliability, capacity, and performance. This task presented significant challenges: the need to move 29 million files twice under time pressure from aging storage hardware; a source file system bottleneck limiting throughput to 1.5 GB/s; frequent site maintenance windows; and the need for complete reliability at scale. We addressed these challenges using a simple replication tool that invoked Globus to transfer large bundles of files while tracking progress in a database, dynamically rerouting transfers to work around maintenance periods and file system limitations. Under the covers, Globus organized transfers to make efficient use of the high-speed Energy Sciences network (ESnet) and the data transfer nodes deployed at participating sites, and also addressed security, integrity checking, and recovery from a variety of transient failures. This success demonstrates the considerable benefits that can accrue from the adoption of performant data replication infrastructure. The replication tool is available at https://github.com/esgf2-us/data-replication-tools.

Globus↗
DOE OSTI2026

Machine Learning–Based Condition Monitoring of a Circulating Water System of a Canadian Nuclear Plant

With the need to maintain long-term reliable energy using nuclear power plants, there is an underlying demand to ensure that the maintenance of plant components and systems is also done in an efficient and cost-effective manner. One way to achieve this is by moving from time-based maintenance to condition-based maintenance. The research presented in this paper focuses on applying statistical and machine-learning-based methods to capture anomalies within data for fault detection to further develop into condition monitoring. This paper focuses on system data for a circulating water system (CWS) of a pressurized heavy-water reactor for detecting anomalies. The different methodologies used for detecting and capturing anomalies in the CWS data are matrix profile, density-based spatial clustering of applications with noise (DBSCAN), and support vector machines (SVMs). Matrix profile and DBSCAN are used to distinguish between normal data and anomalous data. This paper presents a hybrid method using DBSCAN and SVM when a portion of the data is used for DBSCAN to generate clusters. This portion of data is then used to train the SVM along with the clusters generated by DBSCAN as output. SVM is then tested on unseen data as a predictive tool, which can work in real time to categorize data points as either normal or anomalous. This paper presents results that show the high accuracies of DBSCAN and SVM in capturing anomalies within the data for a CWS for fault detection. Thus, the maintenance plan would be focused on component condition rather than a time-based schedule by switching to an automated system to identify and predict faults within a CWS.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2021

Scalable Yet Rigorous Floating-Point Error Analysis

Automated techniques for rigorous floating-point round-off error analysis are a prerequisite to placing important activities in HPC such as precision allocation, verification and code optimization on a formal footing. Yet existing techniques cannot provide tight bounds for expressions beyond a few dozen operators; barely enough for HPC. In this work, we offer an approach embedded in a new tool called SATIRE that scales error analysis by four orders of magnitude compared to today’s best-of-class tools. We explain how three key ideas underlying SATIRE help it attain such scale: path strength reduction, bound optimization and abstraction. SATIRE provides tight bounds and rigorous guarantees on significantly larger expressions with well over a hundred thousand operators, covering important examples including FFT, matrix multiplication and PDE stencils.

Das, Arnab↗
DOE OSTI2024

Development of an Optimal Variable-Pitch Controller for Floating Axial-Flow Marine Hydrokinetic Turbines: Preprint

This article discusses the development of an optimal variable-pitch controller for floating, axial-flow marine turbines. Recently, OpenFAST, an open-source wind turbine modeling tool, has been extended to model marine turbines. A controller is necessary to simulate marine turbines for different load cases using OpenFAST, which greatly impacts the performance of the energy system. Previous studies have designed controllers using a linearized model of the marine turbine, which can be timeconsuming and require the expertise of a control engineer. In this study, we use an automated approach that uses generic models of the marine turbine to identify the controller gains, which can expedite the process of designing a controller. Using an optimizer to identify the control system parameters can additionally improve the controller's performance. The optimal controller tuned using such an approach results in a 20% reduction in the towerbase damage equivalent loading and better tracking of the rated generator speed and power.

closed-loop control↗
DOE OSTI2022

Estimating snow cover from high-resolution satellite imagery by thresholding blue wavelengths

We report the extent and duration of snow cover, a critical component of the hydrologic cycle and the global climate system, is expected to shift dramatically under climate change. Therefore, developing high-resolution assessments of snow cover change is crucial for estimating the impact of changing snow cover on watershed and ecosystems processes in cold regions. Remote sensing tools provide a powerful method for mapping snow-covered area (SCA) across a landscape. The most common method for estimating SCA utilizes the normalized difference snow index (NDSI), which relies on spectral measurements in the shortwave-infrared wavelengths (SWIR). NDSI can effectively estimate catchment- to regional-scale SCA, but it cannot be used to assess fine-scale SCA because of current limitations on the spatial resolution of satellite-derived SWIR measurements. Here, we map SCA using a threshold of blue wavelengths and high-resolution satellite imagery. The thresholding method, which we call the Blue Snow Threshold algorithm (BST), has previously been used with digital camera imagery. We refine and automate the algorithm for use with cloud-free high-resolution satellite imagery and find that the BST can be used to assess fine-scale SCA. For validation, we compared BST-derived estimates of SCA to a) airborne lidar surveys, b) Landsat fractional SCA, and c) snow disappearance dates from Snow Telemetry (SNOTEL) stations. When compared to airborne lidar surveys of SCA, the BST predicted SCA had a range of F-scores between 0.81 and 0.94 in four study areas in California and Colorado. We also found general agreement between SCA and snow disappearance at multiple SNOTEL sites across the western United States. Given the relatively recent availability of high-resolution satellite imagery with spectral measurements in the visible wavelengths but lacking in SWIR, the BST offers a reliable and easy-to-apply tool for examining fine-scale snow-related processes.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

An end-to-end workflow for executing a classically bootstrapped variational quantum algorithm on an academic quantum computer

Academic quantum computing platforms often face unique challenges in executing quantum workloads due to fragmented software environments and limited engineering support. Unlike commercial ecosystems, academic devices typically evolve without full-stack integration in mind, making it difficult to run complex applications—such as variational quantum algorithms (VQA)—reliably and efficiently. Issues such as incompatible software layers and lack of automated job management significantly increase the overhead of theory-experiment collaboration. To address these challenges, we develop a modular, end-to-end workflow that decouples application-layer code from low-level hardware control, automates circuit submission and result collection, and supports fine-grained circuit-level job scheduling and recovery. The architecture employs a dual-end application programming interface (API) design, enabling robust operation across unstable or resource-constrained hardware backends. For practical use, the framework is lightweight and user-friendly, allowing rapid prototyping of full-stack workflows using basic Python tools. We validate this workflow on a high-fidelity trapped-ion quantum computer by demonstrating a variational quantum eigensolver (VQE) experiment with a classically bootstrapped ansatz initialization technique. The system successfully executed over 60,000 circuits across multiple molecular test cases with minimal human intervention, highlighting the framework’s effectiveness in enabling reproducible, resilient quantum experimentation in academic settings.

Clifford↗
DOE OSTI2020

Precise mapping of new group I introns in tRNA genes

Bacterial tRNA have been found interrupted at various positions in the anticodon loop by group I introns, in four types. The primary bioinformatic tool for group I intron discovery is a covariance model that can identify conserved features in the catalytic core and can sometimes identify the typical uridine residue at the -1 position, preceding the 5-prime splice site, but cannot identify the typical guanidine residue at the omega position, preceding the 3-prime splice site, to achieve precise mapping. One approach to complete the automation of group I intron mapping is to focus instead on the exons, which is enabled by the regularity of tRNAs. We develop a software module, within a larger package (tFind) aimed at mapping bacterial tRNA and tmRNA genes precisely, that expands this list of four known classes of intron-interrupted tRNAs to 21 cases. A new covariance model for these introns is presented. The wobble base pair formed by the -1 uridine is considered a determinant of the 5-prime splice site, yet one reasonably large new type bears a cytidine nucleotide at that position.

Williams, Kelly P.↗
DOE OSTI2024

Complete Demonstration of a Prototype Version of FORCE User Interface and Conduct Analyst Survey Collecting Feedback on Interface Features and Usability

In 2024 the US Department of Energy (DOE) Office of Nuclear Energy (NE) Integrated Energy System (IES) program continued to develop the Framework for Optimization of Resources and Economics (FORCE) analysis ecosystem into a more traditional toolset with simplified software installation, automated workflows, and interactive results visualization. The DOE-NE Nuclear Energy Advanced Modeling and Simulation (NEAMS) Workbench continued to be leveraged for user input, application workflow and runtime environment, and interactive results visualization capabilities. This report documents the demonstration of a FORCE User Interface (UI) prototype and the results of a survey of analysts’ using the Holistic Energy Resource Optimization Network (HERON) tool in FORCE with the prototype UI.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Natural Charge-Transfer Analysis: Eliminating Spurious Charge-Transfer States in Time-Dependent Density Functional Theory via Diabatization, with Application to Projection-Based Embedding

For many types of vertical excitation energies, linear-response time-dependent density functional theory (LR-TDDFT) offers a useful degree of accuracy combined with unrivaled computational efficiency, although charge-transfer excitation energies are often systematically and dramatically underestimated, especially for large systems and those that contain explicit solvent. As a result, low energy electronic spectra of solution-phase chromophores often contain tens to hundreds of spurious charge-transfer states, making LR-TDDFT needlessly expensive in bulk solution. More nefariously, intensity borrowing by the low-energy charge-transfer states can affect intensities of the valence excitations even if those excitation energies are accurate. At higher excitation energies, it is difficult to distinguish spurious CT states from genuine charge-transfer-to-solvent (CTTS) excitations. In this work, we introduce an automated diabatization scheme that enables fast and effective screening of the CTTS acceptor space in bulk solution. Our procedure introduces the concept of “natural charge-transfer orbitals”, which provide a means to isolate characteristic pairs of orbitals that are most likely to participate in a CTTS excitation. The projection of these orbitals onto solvent-centered virtual orbitals provides a criterion for defining the most important solvent molecules in a given excitation. We apply this method to analyze an ab initio molecular dynamics (MD) trajectory of I-(aq) and report the lowest-energy CTTS band in the absorption spectrum. Our results are in excellent agreement with experimental measurements for bulk I-(aq), and only one-third of the water molecules in the I-(H2O)96 simulation cell need to be described with LR-TDDFT in order to obtain excitation energies that are converged to < 0.1 eV. The tools introduced herein will improve the accuracy, efficiency, and usability of LR-TDDFT in solution-phase environments

Carter-Fenk, Kevin D.↗
DOE OSTI2021

Automated CT registration, segmentation, and quantification (AutoCT) v1.0

Processing and analyzing brain imaging is crucial in both scientific development and clinical field. In this software package, we build a pipeline that integrates automatic registration, segmentation, and quantitative analysis for subjects' CT scans. Leveraging diffeomorphic transformations, we enable optimized forward and inverse mappings between an image and the reference. Furthermore, we extract localized features from deformation field based on an online template process, which advances statistical learning downstream. The created templates, atlas as well as our methods provide the brain imaging community tools for AI implementations.

Essiari, Abdelilah↗
DOE OSTI2021

Automated CT registration, segmentation, and quantification (AutoCT) v1.1

Processing and analyzing brain imaging is crucial in both scientific development and clinical field. In this software package, we build a pipeline that integrates automatic registration, segmentation, and quantitative analysis for subjects' CT scans. Leveraging diffeomorphic transofrmations, we enable optimized forward and inverse mappings between an image and the reference. Furthermore, we extract localized features from deformation field based on an online template process, which advances statistical learning downstream. The created templates, atlas as well as our methods provide the brain imaging community tools for AI implementations

Bai, Zhe↗
DOE OSTI2024

Development of an Optimal Variable-Pitch Controller for Floating Axial-Flow Marine Hydrokinetic Turbines

This article discusses the development of an optimal variable-pitch controller for floating, axial-flow marine turbines. Recently, OpenFAST, an open-source wind turbine modeling tool, has been extended to model marine turbines. A controller is necessary to simulate marine turbines for different load cases using OpenFAST, which greatly impacts the performance of the energy system. Previous studies have designed controllers using a linearized model of the marine turbine, which can be time-consuming and require the expertise of a control engineer. In this study, we use an automated approach that uses generic models of the marine turbine to identify the controller gains, which can expedite the process of designing a controller. Using an optimizer to identify the control system parameters can additionally improve the controller's performance. The optimal controller tuned using such an approach results in a 20% reduction in the tower-base damage equivalent loading and better tracking of the rated generator speed and power.

axial flow↗
DOE OSTI2024

Residential HVAC Fault Data Collection Plan – Refrigerant Undercharge and Overcharge Faults

Heating, ventilation, and air-conditioning (HVAC) systems can develop faults due to poor installation practices or gradual wear and tear, leading to decreased HVAC system’s efficiency, compromised thermal comfort, and shortened equipment lifespan (EERE, 2018). Automated fault detection and diagnosis (AFDD) technologies offer a solution by identifying energy-wasting HVAC faults, such as inadequate indoor airflow and incorrect refrigerant charge, and guiding technicians to enhance system efficiency. In the realm of residential HVAC, AFDD can be implemented through various fault detection and diagnosis capabilities, sensor configurations, and target applications. These technologies typically fall into three categories: smart diagnostic tools, original equipment manufacturer (OEM)-embedded tools, and add-on tools. Smart diagnostic tools employ temporarily installed sensors to directly measure HVAC system characteristics, while OEM-embedded tools utilize factory-installed sensors to identify faults or assess system performance. However, both these types of AFDD technologies are often only accessible for high-end HVAC equipment or require additional sensor installation by qualified technicians, resulting in high investment costs and limited applicability for low-income residential buildings. On the other hand, add-on tools rely solely on data from smart thermostats and meters to detect faults by continuously analyzing equipment runtime or energy usage. As smart thermostat and meter costs decrease and their prevalence increases, these tools can be readily deployed in low-income residential buildings. However, they possess limited capabilities as they rely solely on basic trend analysis. Enhancing such tools with advanced machine learning algorithms can significantly improve their effectiveness.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2025

Data-Enabled Fusion Technology (Final Scientific/Technical Report)

Advancing Scientific Understanding in Fusion Energy and Machine Learning This research represented a significant step forward in machine learning (ML) applications for fusion energy experiments. The project integrated advanced data-driven modeling, optimization techniques, and artificial intelligence to enhance the predictive capabilities and operational efficiency of plasma-based fusion systems. Specifically, tasks focused on ML-enhanced diagnostics, operator guidance tools, and predictive modeling helped improve the ability to interpret complex fusion experiments. Key areas of advancement included: 1) data-driven plasma control, i.e., using ML algorithms to optimize experimental conditions and classify plasma behaviors based on historical data; 2) spectroscopy and diagnostics, i.e., applying AI models to extract previously inaccessible insights from experimental spectroscopy data; and 3) configuration mapping and operator guidance, i.e., developing a predictive framework to assist scientists in identifying the most effective experimental parameters, reducing reliance on manual adjustments. By refining these ML-driven techniques, the project contributed to the broader scientific community’s understanding of plasma dynamics and fusion energy viability. Technical Effectiveness and Economic Feasibility The methods investigated demonstrated high technical effectiveness, as reflected in milestones assessing the predictive accuracy, performance, and optimization of fusion configurations. The development of an Operator Guidance Tool (OGT), for example, led to more precise control of plasma conditions by learning from experimental data and offering real-time adjustments. From an economic standpoint, DeFT provided: 1) the ability to reduce trial-and-error experimentation, which lowered operational costs; 2) improved data interpretation methods, which enabled more efficient resource allocation in large-scale fusion research projects; and 3) the automation of key diagnostic tasks, which reduced manual labor and human error, increasing overall efficiency. 13 The final assessments of predictive models and optimization strategies demonstrated that these approaches were scalable and could be implemented across multiple fusion energy research programs. Public Benefit and Societal Impact This project contributed directly to the broader goal of achieving sustainable and commercially viable fusion energy, which had profound implications for clean energy production and climate change mitigation. The integration of AI-driven solutions into fusion research: 1) sped up scientific discovery, accelerating progress towards achieving energy breakthroughs; 2) reduced the cost of experimentation, making fusion research more accessible; and 3) provided a framework for future AI applications in high-energy physics, benefiting adjacent fields like space exploration, material science, and renewable energy. Additionally, by fostering collaborations between AI researchers and plasma physicists, this project promoted interdisciplinary innovation that could lead to broader applications beyond fusion research.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗