Search NASA⌕ Search

SEARCH · Search NASA

Results for “Continual Learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15

Network Anomaly Detection in Distributed Edge Computing Infrastructure

As networks continue to grow in complexity and scale, detecting anomalies has become increasingly challenging, particularly in diverse and geographically dispersed environments. Traditional approaches often struggle with managing the computational burden associated with analyzing large-scale network traffic to identify anomalies. This paper introduces a distributed edge computing framework that integrates federated learning with Apache Spark and Kubernetes to address these challenges. We hypothesize that our approach, which enables collaborative model training across distributed nodes, significantly enhances the detection accuracy of network anomalies across different network types. We show that by leveraging distributed computing and containerization technologies, our framework not only improves scalability and fault tolerance but also achieves superior detection performance compared to state-of-the-art methods. Extensive experiments on the UNSW-NB15 and ROAD datasets validate the effectiveness of our approach, demonstrating statistically significant improvements in detection accuracy and training efficiency over baseline models, as confirmed by MannWhitney U and Kolmogorov-Smirnov tests (p<0.05).

Marfo, William [University of Texas at El Paso,Dep↗

Late-Stage Research Development and Demonstration Sub-activities Updates – FY24 Q3

Oak Ridge National Laboratory (ORNL), in collaboration with the Pacific Northwest National Laboratory (PNNL), the National Renewable Energy Laboratory (NREL), the Lawrence Berkeley National Laboratory (LBNL), and the Hummingbird Firm (a specialized consulting firm focused on promoting diversity, equity, and inclusion considerations), has initiated a national initiative known as the Heat Pump (HP) and Heat Pump Water Heater (HPWH) Field Validation Partnership. This effort involves active participation from numerous critical entities involved in research and market transformation within the field. The ORNL team is responsible for leading Late-Stage Research Development and Demonstration (LSRDD) among the four different topics. The overall outcomes of this project will be: (1) A structured Field Validation Partnership between DOE, the national labs, research, implementation, and market transformation organizations. This will result in unique way to coordinate field validation plans and collect relevant data from around the country into the HP and HPWH Field Validation Database. (2) The Field Validation Partnership will result in a continuous stream of information between DOE and the major industry players in the space of HPs and HPWHs. If desired, DOE could use this information to inform roadmaps related to HP and HPWH market adoption and research going forward. (3) The structure of this Partnership provides a mechanism for sharing lessons learned directly between Late-Stage RD&D, Building Integration Barriers, Regional Market and Policy and Workforce Development efforts. The result will be training content that is well-reviewed by the Partnership which will lead to a workforce that meets the industry’s quality and workforce supply demands. (4) The structure of this Partnership also provides an opportunity for regions to share lessons learned on policy and market transformation with each other through the Market and Policy core Committee. This report includes an update in Late-Stage Research Development and Demonstration.

99 GENERAL AND MISCELLANEOUS↗

High-Temperature Aquifer Thermal Energy Storage (HT-ATES) Projects in Germany and the Netherlands—Review and Lessons Learned

Aquifer thermal energy storage (ATES) is a concept that can help to address heating and cooling needs through the use of the subsurface as a seasonal thermal energy storage (STES) system. Over 2800 ATES systems have been deployed with storage temperatures typically below 25 °C and only a few with higher temperatures (>40 °C), which would increase the energy density and utility of the stored thermal fluids. Until now, only a few high-temperature aquifer thermal energy storage (HT-ATES) projects have been initiated and are still in operation. These HT-ATES projects have encountered a range of technical and non-technical challenges. This study reviews ten such projects: four in Germany and six in the Netherlands. The non-technical issues include public acceptance, a lack of regulatory framework for these systems, managing overlapping uses of the subsurface, managing changes with the providers and off-takers of thermal energy, and obtaining financing to implement these projects. Common technical issues include geological factors such as incomplete characterization of the subsurface and reservoir heterogeneity; geochemical issues such as mineral scaling, corrosion, and biofouling; lower than expected thermal recovery; and issues with system design and reliability. This review highlights benefits and challenges faced by HT-ATES projects with the goal to use the lessons learned to improve the siting, design, development, and operation of such systems. Recommendations include improved initial subsurface site characterization, use of coupled process models to optimize system design and predict system performance, cascaded uses of stored thermal energy to better utilize the stored heat, monitoring networks to provide feedback on system performance, and expanded system scale to allow for continued operation even when maintenance of some system components is required. Techno-economic modeling and risk analysis could be used to optimize such HT-ATES project design and identify key factors that will affect sustained economic viability. In addition, design flexibility is important for these systems to allow for changing conditions regarding the supply and demand of thermal energy. Adopting these findings should improve the performance and reduce the risks for future HT-ATES projects worldwide.

15 - GEOTHERMAL ENERGY↗

Lyapunov-Based Iterative Learning of Regions of Attraction for Autonomous Systems

This paper proposes a novel algorithm for estimating the region of attraction of equilibrium points for nonlinear discrete-time autonomous systems. The method iteratively expands an initial estimate of the region of attraction by constructing unions of sublevel sets of learned functions parametrized as neural networks. Unlike conventional techniques that rely on a single global Lyapunov function, the proposed approach provides a collection of local Lyapunov-like functions, enabling richer representations and potentially larger region of attraction estimates. These functions are trained using sampled state-space data, and their Lipschitz continuity ensures that desirable properties extend beyond the training samples. The devised strategy is tested via numerical simulations, demonstrating the effectiveness of the proposed approach.

97 MATHEMATICS AND COMPUTING↗

Distributed Stochastic Optimization of a Neural Representation Network for Time-Space Tomography Reconstruction

4D time-space reconstruction of dynamic events or deforming objects using X-ray computed tomography (CT) is an important inverse problem in non-destructive evaluation. Conventional back-projection based reconstruction methods assume that the object remains static for the duration of several tens or hundreds of X-ray projection measurement images (reconstruction of consecutive limited-angle CT scans). However, this is an unrealistic assumption for many in-situ experiments that causes spurious artifacts and inaccurate morphological reconstructions of the object. To solve this problem, we propose to perform a 4D time-space reconstruction using a distributed implicit neural representation (DINR) network that is trained using a novel distributed stochastic training algorithm. Our DINR network learns to reconstruct the object at its output by iterative optimization of its network parameters such that the measured projection images best match the output of the CT forward measurement model. Here, we use a forward measurement model that is a function of the DINR outputs at a sparsely sampled set of continuous valued 4D object coordinates. Unlike previous neural representation architectures that forward and back propagate through dense voxel grids that sample the object's entire time-space coordinates, we only propagate through the DINR at a small subset of object coordinates in each iteration resulting in an order-of-magnitude reduction in memory and compute for training. DINR leverages distributed computation across several compute nodes and GPUs to produce high-fidelity 4D time-space reconstructions. We use both simulated parallel-beam and experimental cone-beam X-ray CT datasets to demonstrate the superior performance of our approach.

36 MATERIALS SCIENCE↗

Lyapunov-Based Iterative Learning of the Region of Attraction for Autonomous Systems

This presentation introduces a novel algorithm for estimating the region of attraction of equilibrium points for nonlinear discrete-time autonomous systems. The method iteratively expands an initial estimate of the region of attraction by constructing unions of sublevel sets of learned functions parametrized as neural networks. Unlike conventional techniques that rely on a single global Lyapunov function, the proposed approach provides a collection of local Lyapunov-like functions, enabling richer representations and potentially larger region of attraction estimates. These functions are trained using sampled state-space data, and their Lipschitz continuity ensures that desirable properties extend beyond the training samples. The devised strategy is tested via numerical simulations, demonstrating the effectiveness of the proposed approach.

97 MATHEMATICS AND COMPUTING↗

Detector Related Uncertainties in ICARUS Continued

This paper explores the challenges in neutrino detection and emphasizes the importance of understanding the ICARUS neutrino detector. It delves into the use of cosmic rays to bridge the gap between experimental and theoretical data, offering insights into the behavior of different components of neutrino detectors. This procedure sheds light on the intricate aspects of cosmic ray detection in ICARUS, contributing to an increased understanding of how this detector's uncertainties operate. More can be learned about neutrino physics in future experiments through this understanding.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Detector Related Uncertainties in ICARUS Continued

This paper explores the challenges in neutrino detection and emphasizes the importance of understanding the ICARUS neutrino detector. It delves into the use of cosmic rays to bridge the gap between experimental and theoretical data, offering insights into the behavior of different components of neutrino detectors. This procedure sheds light on the intricate aspects of cosmic ray detection in ICARUS, contributing to an increased understanding of how this detector's uncertainties operate. More can be learned about neutrino physics in future experiments through this understanding.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

The ABCs of On-Demand Transit (ODT)

On-demand mobility - also referred to as on-demand transit (ODT) - is a form of public mobility that is flexible with respect to where and when service is provided, and ODT deployments have increased significantly in recent years. Transit agencies are becoming increasingly interested in ODT, and due to differing definitions and various service design and business model options, it can be difficult to learn about the emerging industry. This work provides an overview of the definitions of ODT, recent trends internationally and in the U.S., ODT's benefits and challenges (particularly compared to fixed-route transit), three primary service design options, system costs and funding considerations, and a metrics framework for evaluating ODT systems to ensure continued successful performance. Identified benefits include increased service areas, short ride and wait times, increased user flexibility, potential to reduce energy consumption and emissions through shared trips and smaller, right-sized vehicles, increased safety and comfort through door-to-door service, and rich data streams including granular spatio-temporal data that can be analyzed to continuously improve the service. Challenges include scaling ODT service up as small increases in ridership require additional supply to keep service quality high, serving peak times including keeping low wait times, the lack of fixed schedule being challenging for commuters, integrating ODT services with nearby transit systems, and equity for riders without smartphones who cannot track the vehicle in a mobile app. Finally, an overview of seven ODT case studies (in Texas, Missouri, New York, and Ontario, Canada) performed by NREL and related analysis of travel time, energy and emissions, costs, and equity are presented. Initial key findings include: ODT can be cost- and energy-effective compared to fixed-route transit, ODT serves more people than other transit options, and ODT system deployments can be followed by rapid growth.

24 POWER TRANSMISSION AND DISTRIBUTION↗

AI Benchmark Democratization and Carpentry

Benchmarks are a cornerstone of modern machine learning, enabling reproducibility, comparison, and scientific progress. However, AI benchmarks are increasingly complex, requiring dynamic, AI-focused workflows. Rapid evolution in model architectures, scale, datasets, and deployment contexts makes evaluation a moving target. Large language models often memorize static benchmarks, causing a gap between benchmark results and real-world performance. Beyond traditional static benchmarks, continuous adaptive benchmarking frameworks are needed to align scientific assessment with deployment risks. This calls for skills and education in AI Benchmark Carpentry. From our experience with MLCommons, educational initiatives, and programs like the DOE's Trillion Parameter Consortium, key barriers include high resource demands, limited access to specialized hardware, lack of benchmark design expertise, and uncertainty in relating results to application domains. Current benchmarks often emphasize peak performance on top-tier hardware, offering limited guidance for diverse, real-world scenarios. Benchmarking must become dynamic, incorporating evolving models, updated data, and heterogeneous platforms while maintaining transparency, reproducibility, and interpretability. Democratization requires both technical innovation and systematic education across levels, building sustained expertise in benchmark design and use. Benchmarks should support application-relevant comparisons, enabling informed, context-sensitive decisions. Dynamic, inclusive benchmarking will ensure evaluation keeps pace with AI evolution and supports responsible, reproducible, and accessible AI deployment. Community efforts can provide a foundation for AI Benchmark Carpentry.

von Laszewski, Gregor [Virginia U.]↗

Creating a Training Dataset for Semantic Segmentation of Canal Networks for Irrigation Modernization

Canal infrastructure has provided critical irrigation water to the western United States for over a century. To continue providing vital water resources to the semi-arid West, irrigation systems must undergo maintenance and modernization. Many canal companies are resource-constrained, and because funding opportunities often require detailed knowledge of existing infrastructure, they can struggle to secure financial capital. We address this problem by creating training data for a semantic segmentation deep learning model to map canal networks throughout the western United States. To create a diverse and robust training dataset, we labelled 1-m NAIP imagery with the locations of no canals, wet canals, and dry/vegetated canals. Since creating these datasets is time consuming, we first developed a preprocessing methodology to identify canals within our four study areas. We used NAIP imagery and provided canal centerline data to buffer, standardize, and cluster the imagery, automating the labeling process as much as possible. However, this still required manual cleaning and manual classification of canal type. Challenges arose when canals were interrupted (e.g., road culverts or piped sections) or when nearby features shared similar characteristics (e.g., irrigated fields, trees, and shadows). Combining automated preprocessing with manual refinement produced four detailed canal masks to be used in the semantic segmentation model developed by Richard Tapia.

13 - HYDRO ENERGY↗

Continuous integration data-driven platform of industrial-scale subsurface storage for real-time analytics

This project helped address the growing need for efficient and scalable models to support geological carbon and energy storage, which are crucial for achieving net-zero emissions. Traditionally accurate high-fidelity numerical models have been used to simulate relevant storage processes under a handful of processes, however such models are computationally demanding, making uncertainty quantification impractical. Consequently, we first developed a machine learning framework, based on Graph Neural Operators (GNOs), to improving the accuracy of model predictions for a fixed computational budget. We then developed an Ensemble of Improved Neural Operators (ENO), which uses bagging and Monte Carlo dropout techniques, to further improve prediction accuracy. Lastly, we developed the way to explain progressive transfer learning methods to reduce the amount of training data and computational cost of training (i.e., reduce trainable parameters) when using our models for multiple storage sites. Our numerical investigation, which used real-world case studies, demonstrated that our framework can significantly improve the safety and efficiency of geological storage operations, with potential applications in other domains such as geothermal reservoirs and climate modeling.

54 ENVIRONMENTAL SCIENCES↗

Converged Computing: A Best of Both Worlds of High-Performance Computing and Cloud

Collaboration between Cloud and High Performance Computing (HPC) communities has accelerated in the last half decade. A common goal to run batch workloads combined with a desire for reproducibility, automation, and optimization has led to successful projects that range from container technologies to workload management and security. This span of current and future work defines a novel “Converged Computing” paradigm that aims to combine the best of both worlds, both from a technological and cultural standpoint. Furthermore, in this Special Issue, we review common themes in the space, showcasing current work and encouraging a continued effort toward innovative ideas that will enable the next generations of scientific discovery.

97 MATHEMATICS AND COMPUTING↗

Ab Initio-Based Bond Order Potential for Arsenene Polymorphs Developed via Hierarchical Reinforcement Learning

Arsenene, a less-explored two-dimensional material, holds the potential for applications in wearable electronics, memory devices, and quantum systems. This study introduces a bond-order potential model with Tersoff formalism, the ML-Tersoff, which leverages multireward hierarchical reinforcement learning (RL), trained on an ab initio data set. This data set covers a spectrum of properties for arsenene polymorphs, enhancing our understanding of its mechanical and thermal behaviors without the complexities of traditional models requiring multiple parameter sets. Our RL strategy utilizes decision trees coupled with a hierarchical reward strategy to accelerate convergence in high-dimensional continuous search spaces. Unlike the Stillinger-Weber approach, which demands separate formalisms for buckled and puckered forms, the ML-Tersoff model concurrently captures multiple properties of the two polymorphs by effectively representing the local environment, thereby avoiding the need for different atomic types. Here, we apply the ML model to understand the mechanical and thermal properties of the arsenene polymorphs and nanostructures. We observe an inverse relationship between the critical strain and temperature in arsenene. Thermal conductivity calculations in nanosheets show good agreement with ab initio data, reflecting a decrease in thermal conductivity attributable to increased anharmonic effects at higher temperatures. We also apply the model to predict the thermal behavior of arsenene nanotubes.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

7 Innovations in high-rate composite manufacturing: integrating additive manufacturing with compression molding process

Advanced composites play a pivotal role in modern engineering, offering exceptional strength-to-weight ratios and tailored properties, essential for various industries. High-rate composite manufacturing techniques have rapid production capabilities, which are essential for meeting the demands of industries requiring cost-saving, efficiency, and quick turnaround times. This chapter explores the Additive Manufacturing- Compression Molding (AM-CM) system developed by Oak Ridge National Laboratory (ORNL) for advanced composites manufacturing. The AM-CM system integrates additive manufacturing with compression molding, facilitating the production of polymer composite parts with superior mechanical properties and meticulously controlled microstructures. This innovative system not only ensures precise material deposition but also operates as a fast composite manufacturing process, enhancing productivity and performance, which are needed attributes across industrial applications. Through comprehensive mechanical testing and microstructural analysis, AM-CM promotes remarkable fiber alignment and reduced porosity in composite parts compared to alternative thermoplastic high-rate composite manufacturing methods. Furthermore, AM-CM enables overmolding reinforcement using continuous carbon fiber and supports selective reinforcement through customizable toolpaths. It also facilitates the production of hybrid materials to achieve tailored mechanical properties. Future advancements in AM-CM technology aim to enhance process efficiency, broaden material versatility, and improve part performance. This involves exploring novel materials, advancing process monitoring, implementing automation technologies, and integrating artificial intelligence (AI) and machine learning (ML) for predictive modeling and real-time optimization in composite manufacturing. These developments will establish the AM-CM system as a transformative technology in composite manufacturing, driving innovation across industries.

Hassen, Ahmed [ORNL] (ORCID:0000000328521222)↗

Nuclear safety Enhanced: A Deep dive into current and future RAVEN applications

As the horizon of nuclear energy expands with the advent of small modular reactors, IV generation reactors, and fusion reactors, there is a growing perspective that the licensing process could benefit from a more comprehensive approach. Moving beyond traditional deterministic and PRA analysis might pave the way for a novel safety analysis paradigm propelled by the increasing computational power at our disposal. This paper explores different methodologies that can improve the outcomes of nuclear safety analysis. These range from uncertainty quantification techniques, aimed at enhancing the precision of safety margins, to deploying dynamic event trees by driving system code simulations, capturing the potential evolutions of severe accidents. These methodologies introduce innovative dimensions to safety analysis, considering the consequences of postulated events and the dynamics of accident sequences. However, they also bring forth challenges, especially in managing the complexity and sheer volume of potential scenarios. The paper touches upon some strategies to counter these challenges, emphasizing the importance of adaptability and continuous evolution in the face of emerging nuclear safety concerns. Additionally, the paper sheds light on the need for advanced tools to apply these methodologies. Among these tools is RAVEN, an open-source software designed for parametric and probabilistic analyses. Its core components, including distribution, sampler, and reduced order model, enable various applications, from risk assessment and mitigation to dynamic learning and plant control logic simulations.

97 - MATHEMATICS AND COMPUTING↗

Neuromorphic intermediate representation: A unified instruction set for interoperable brain-inspired computing

Abstract Spiking neural networks and neuromorphic hardware platforms that simulate neuronal dynamics are getting wide attention and are being applied to many relevant problems using Machine Learning. Despite a well-established mathematical foundation for neural dynamics, there exists numerous software and hardware solutions and stacks whose variability makes it difficult to reproduce findings. Here, we establish a common reference frame for computations in digital neuromorphic systems, titled Neuromorphic Intermediate Representation (NIR). NIR defines a set of computational and composable model primitives as hybrid systems combining continuous-time dynamics and discrete events. By abstracting away assumptions around discretization and hardware constraints, NIR faithfully captures the computational model, while bridging differences between the evaluated implementation and the underlying mathematical formalism. NIR supports an unprecedented number of neuromorphic systems, which we demonstrate by reproducing three spiking neural network models of different complexity across 7 neuromorphic simulators and 4 digital hardware platforms. NIR decouples the development of neuromorphic hardware and software, enabling interoperability between platforms and improving accessibility to multiple neuromorphic technologies. We believe that NIR is a key next step in brain-inspired hardware-software co-evolution, enabling research towards the implementation of energy efficient computational principles of nervous systems. NIR is available atneuroir.org

Science & Technology - Other Topics↗

Insights and Impacts of Credentials: Energy Auditor, Quality Control Inspector, and Certification Updates

Join this session to learn about recent and upcoming Home Energy Professional credential and resource updates from the National Renewable Laboratory (NREL) in support of the U.S. Department of Energy's Weatherization Assistance Program (WAP). NREL staff will provide an in-depth overview of improvements to the EA and QCI certification schemes. Be prepared to provide feedback and share new ideas in pursuit of continuous improvement within WAP. These certifications are critical to ensuring the highest standards of quality, safety, and efficiency within the Weatherization Assistance Program, helping to elevate the skills of professionals and drive the program's overall success.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗