SEARCH · Search NASA
Results for “Game engine”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
A workflow for segmenting soil and plant X-ray computed tomography images with deep learning in Google’s Colaboratory
X-ray micro-computed tomography (X-ray μCT) has enabled the characterization of the properties and processes that take place in plants and soils at the micron scale. Despite the widespread use of this advanced technique, major limitations in both hardware and software limit the speed and accuracy of image processing and data analysis. Recent advances in machine learning, specifically the application of convolutional neural networks to image analysis, have enabled rapid and accurate segmentation of image data. Yet, challenges remain in applying convolutional neural networks to the analysis of environmentally and agriculturally relevant images. Specifically, there is a disconnect between the computer scientists and engineers, who build these AI/ML tools, and the potential end users in agricultural research, who may be unsure of how to apply these tools in their work. Additionally, the computing resources required for training and applying deep learning models are unique, more common to computer gaming systems or graphics design work, than to traditional computational systems. To navigate these challenges, we developed a modular workflow for applying convolutional neural networks to X-ray μCT images, using low-cost resources in Google’s Colaboratory web application. Here we present the results of the workflow, illustrating how parameters can be optimized to achieve best results using example scans from walnut leaves, almond flower buds, and a soil aggregate. We expect that this framework will accelerate the adoption and use of emerging deep learning techniques within the plant and soil sciences.
Recent Advances in Precision Clock Synchronization Protocols for Power Grid Control Systems
With the advent of a new Precision Time Protocol specification, new opportunities abound for clock synchronization possibilities within power grid control systems. The third iteration of the Institute of Electrical and Electronics Engineers Standard 1588 specification provides several new features specifically aimed at complex, wide-area deployments in which situational awareness and control require precise time agreement. This paper describes the challenges faced by existing technology, introduces the new time distribution specification, and provides examples to explain how it represents a game-changing innovation.
STOCHASTIC OPTIMAL POWER FLOW FOR REAL-TIME MANAGEMENT OF DISTRIBUTED RENEWABLE GENERATION AND DEMAND RESPONSE (Final Report)
To meet the grand challenge of a sustainable energy future, there has been a surge of interest in renewable energy. Today, the uncertainty associated with renewable resources is handled by using operating reserves. The high penetration of renewable resources, however, introduces difficult-to-control dynamics and challenges for power system operation. Decision support tools are necessary at the bulk system operational level to recognize and efficiently utilize renewable resources and distributed demand response products in concert with traditional grid resources. It is envisaged that responsive load can potentially have very significant cost advantages over either spinning or non-spinning ramping reserve. Critical decisions are made during hour(s)-ahead and real-time power system operation regarding the commitment and dispatch of generators to ensure power delivery is both reliable and economic. These decisions are typically made by a security constrained optimal flow, which determines future generator commitments, dispatches, and ensures adequate reserves are available in the event of a contingency (unexpected outage) or if future system conditions deviate from forecasts. However, security has been always based on a pre-specified subset of contingency constraints whose enforcement does not guarantee security under all possible future possibilities while also giving little or no weight to the likelihood of each contingent event or the severity of its consequences. Existing tools, which are based exclusively on deterministic optimization models, do not yield optimal operational decisions to address these new challenges, in terms of both reliability and cost-effectiveness. This project has focused on developing a stochastic optimal power flow (SOPF) framework, which integrates renewable resource uncertainty, load uncertainty, distributed storage (DS), demand response (DR) products, in a holistic manner to address the uncertainty associated with ever-increasing renewable resources, along with the inclusion of distributed demand response products in future power systems. A proof-of-concept problem was created using the Pennsylvania-Jersey-Maryland (PJM) power system network. Synthetic wind generation was added to the system to simulate 50% wind penetration. A 1-hour test of SOPF operation indicated more than 6% operational cost savings. The project continued by adding the Midwestern Independent System Operator (MISO) as a partner, with focus shifting from SOPF to Stochastic Look-Ahead Unit Commitment (SLAC). Unlike PJM, MISO is faced with significant renewable energy resources within its footprint and is challenged with substantial uncertainty in its operations. The SLAC distinguishes itself from existing tools that operators use. At best, today’s tools solve two to three cases independently, where one or two system parameters, such as forecasted load level (e.g., a low, base, and high forecast), are varied and the resulting scenarios are analyzed independently. The stochastic-based optimization of SLAC leverages statistical information from an ensemble of potential operational scenarios and their respective likelihood. The SLAC output can be translated into valuable information to the operator such as suggested commitments, optimal scheduling and dispatch of resources, reserve requirements at both locational and zonal resolutions, ramping availability and requirements, availability of demand response including operational guidance concerning the near-term and real-time coordination between distributed energy resources, and utilization of distributed storage resources. The developed SOPF/SLAC tool, a stand-alone tool compatible with existing EMSs, will provide system operators with unprecedented visibility, flexibility and predictability to these resources and operational guidance concerning the real-time coordination between DERs and DR/DS products. The game changing and practical impact of this disruptive technology will be dramatic and will usher in a new era in the electric power industry, wherein green energy concepts are fully embraced, and electric power costs are lowered throughout the nation.
Sequential Training ToolKit - STTK
Sequential Training ToolKit, or STTK, is a software toolkit plugin for the Unity development platform that enables software developers to easily develop structured Sequential Training applications for gaming and extended reality (XR) environments. STTK is architected to easily import the toolkit as a plugin for the Unity platform and then interact with the graphical user interface (GUI) for drag-and-drop functionality. STTK also includes easy add-on plugins for Prefabs and auto-builds a State Machine. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525. SAND2021-3059 O
MSD CoP Webinar: "Generative agents: A new frontier for representing human actors and their behavior in MSD models"
Context: This webinar was hosted by the MultiSector Dynamics Community of Practice (MSD CoP; https://multisectordynamics.org). Talk #1: Behavioral Generative Agents for Energy Operations Presenter: Dr. Cong Chen (Thayer School of Engineering, Dartmouth College) Abstract: Accurately modeling consumer behavior in energy operations remains challenging due to inherent uncertainties, behavioral complexities, and limited empirical data. This talk introduces a novel approach leveraging generative agents--artificial agents powered by large language models--to realistically simulate customer decision-making in dynamic energy operations. Talk #2: Simulating multiple human perspectives in socio-ecological systems using large language models Presenter: Dr. Yongchao Zeng (Institute of Meteorology and Climate Research, Atmospheric Environmental Research (IMK-IFU) of the Karlsruhe Institute of Technology in Germany) Abstract: Understanding socio-ecological systems requires insights from diverse stakeholder perspectives. This talk describes a novel simulation system called HoPeS (Human-oriented Perspective Shifting). HoPeS enables model users to not only explore simulated socio-ecological systems (SESs) from a third-person observer's perspective but also take any of the simulated stakeholder roles, like playing an RPG game. By shifting multiple perspectives, model users can reflect and integrate the situated knowledge learned through the participatory simulation, approximating a more holistic and less biased understanding of SESs. Moderators: Jim Yoon (MSD CoP Human Systems Modeling Working Group Co-Chair); Stefano Galelli (MSD CoP Using AI to Enhance MSD Research Working Group Co-Chair); Patrick M. Reed (MSD CoP Facilitation Team) This webinar was held on: November 13th, 2025 from 12-1 PM EST.
Modular Subsurface Sensors and Integrated Software for Advanced Subsurface Characterization and Monitoring using Unoccupied Vehicles
The advent and subsequent proliferation of autonomous airborne, waterborne, and groundbased vehicles (i.e., “drones”) promises to broadly transform the geosciences and associated industries, including fossil energy exploration and development, mineral resource exploration and development, water-resource management, and environmental remediation. For geophysical characterization and monitoring, the prospect of programming highly repeatable and low-cost drone missions for subsurface imaging will allow for deployments in hazardous and previously inaccessible areas. Coupled with autonomous workflows for data processing, management, and visualization, drone-based geophysical characterization and monitoring will enable unprecedented, real-time insight into diverse subsurface properties and processes of scientific and engineering importance. Toward this end, the objectives of this Lab Directed Research and Development (LDRD) project were to develop new (1) instrumentation for dronebased electromagnetic induction (EMI) geophysical imaging, including separated transmitter and receivers and associated electronics, (2) software for real-time data telemetry, processing, management, and visualization. Although EMI has been previously deployed using unoccupied aerial systems (UASs), these applications failed to capitalize on the game-changing capabilities of drone platforms. Whereas drone-based data acquisition allows for collection of rich, three-dimensional (3D) multi-offset/multi-angle configurations between transmitters and receivers, past efforts have relied on conventional instrumentation that was designed for ground-based data collection with the transmitter and a single receiver housed in the same unit; nor did these previous applications demonstrate real-time delivery of results to support rapid management decisions in the field. In this 1-year project, we (1) designed and constructed new lightweight independent transmitter and receiver antenna platforms that communicate with a laptop computer; (2) developed software to control data acquisition, manage/transfer data, and visualize data as its collected; and (3) demonstrated the operation of the new hardware and software systems in a ground-based field test. Our work entails major technological advances for EMI and established a foundation on which to build a new drone-based, real-time geophysical EMI imaging capability to support diverse challenges facing the nation.
Sudoku Online Testing Framework v.0.2
The Sudoku Online Testing Framework provides a configurable basis for testing user interactions to solve visualization-related problems with sudoku puzzles and games. It consists of a server, a client, and test code. The python server implements sudoku puzzle logic and board selection functions. The JavaScript client implements a graphical user interface (GUI) front-end to display the puzzles and facilitate interactions with users. Within the GUI, logical rules may be selected. Cells may be selected to “pivot” on to make a board for each possible value in the cell. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525. SAND2021-6409 O
Development and Integration of Predictive Models for Manufacturing and Structural Performance of Carbon Fiber Composites in Automotive Applications (Final Report)
The goal of this project is to develop integrated, state-of-the-art, computational modeling tools based on an integrated computational materials engineering (ICME) methodology that are critically needed to enable structural carbon fiber (CF) applications in automobiles. These tools are designed to predict the manufacturing and structural performance of CF composites, including stochastic effects. During the first phase of the project, the manufacturing and structural performance tools, including a stochastic driver, were developed, calibrated, and validated against coupon and component level test results. For this project, from the manufacturing side, the development efforts were focused on high-pressure resin transfer molding (HP-RTM), a potentially game-changing manufacturing technology that is capable of reaching the 3-5-minute cycle time that is necessary for volume manufacturing of composites. On the structural performance side, the crashworthiness of CF structures was studied. Accordingly, computational tools were developed and validated. The resulting differences between the numerical predictions and the experimental results in the first phase of the project were required to be less than 15%. During the second phase of the project, the manufacturing and performance tools were integrated by mapping the manufacturing outcomes (e.g., fiber angles, residual stresses, degree of cure, and defects) into the structural models. Also, using the tools developed in this project, an automotive assembly currently manufactured in steel (2016 GM Malibu) was redesigned to be manufactured using advanced CF composites with the objective of comparing the performance of the CF assembly with the developed ICME model predictions. The weight, performance and cost of the CF assembly were compared with the baseline steel assembly as well. The CF underbody design was shown to be 30% lighter than the corresponding steel design. The CF underbody assembly withstood the side pole impact with less than half the intrusion for the steel assembly. Excellent correlations within 10% for both peak impact load and intrusion were observed between the numerical predictions and experimental results. Based on the cost models developed in the project, the cost increase per Kg saved was determined to be $22. The project team has prepared a total of 28 publications in various journals and conferences and broadly communicated the project results for the benefit of the composite industry. The project team has also prepared a total of 10 patent applications that were submitted to the US Patent and Trademark office.
Challenges and Opportunities in Deep Reinforcement Learning With Graph Neural Networks: A Comprehensive Review of Algorithms and Applications
Deep reinforcement learning (DRL) has empowered a variety of artificial intelligence fields, including pattern recognition, robotics, recommendation-systems, and gaming. Similarly, graph neural networks (GNN) have also demonstrated their superior performance in supervised learning for graph-structured data. In recent times, the fusion of GNN with DRL for graph-structured environments has attracted a lot of attention. Here, this paper provides a comprehensive review of these hybrid works. These works can be classified into two categories: (1) algorithmic enhancement, where DRL and GNN complement each other for better utility; (2) application-specific enhancement, where DRL and GNN support each other. This fusion effectively addresses various complex problems in engineering and life sciences. Based on the review, we further analyze the applicability and benefits of fusing these two domains, especially in terms of increasing generalizability and reducing computational complexity. Finally, the key challenges in integrating DRL and GNN, and potential future research directions are highlighted, which will be of interest to the broader machine learning community.
Perspectives on Potential Advanced Construction Technologies for Nuclear Energy
Advanced reactor technologies have attracted considerable financial support, catalyzing innovation in the nuclear energy landscape. These next generation reactors are designed with enhanced passive safety systems and the potential for cost reductions. As these advanced reactors approach technological maturity, their commercial success also requires focused examination and essential support. Economic assessments in the nuclear energy sector often emphasize construction costs and the risk of scheduling delays as primary contributors to deployment expenditures. Traditionally, vital elements of nuclear energy deployment including civil/structural engineering, design sophistication and automation have been either undervalued or postponed in the development cycles. Additionally, the nuclear industry’s collective experience in nuclear project execution has diminished over the past several decades due to the infrequency of new plant constructions. Hence, the National Reactor Innovation Center’s (NRIC) Advanced Construction Technology Initiative (ACTI) aims to reduce cost overruns and schedule slippages that have plagued the construction of nuclear power plant projects. With this initiative, NRIC is facilitating the development of advanced nuclear plant construction technologies and approaches through partnerships that would provide game-changing benefits to the construction of advanced nuclear power plants.
ADVANCED CONSTRUCTION TECHNOLOGY INITIATIVE (ACTI)
Advanced reactor technologies have attracted considerable financial support, catalyzing innovation in the nuclear energy landscape. These next generation reactors are designed with enhanced passive safety systems and the potential for cost reductions. As these advanced reactors approach technological maturity, their commercial success also requires focused examination and essential support. Economic assessments in the nuclear energy sector often emphasize construction costs and the risk of scheduling delays as primary contributors to deployment expenditures. Traditionally, vital elements of nuclear energy deployment including civil/structural engineering, design sophistication and automation have been either undervalued or postponed in the development cycles. Additionally, the nuclear industry’s collective experience in nuclear project execution has diminished over the past several decades due to the infrequency of new plant constructions. Hence, The National Reactor Innovation Center’s (NRIC) Advanced Construction Technology Initiative (ACTI) program aims to reduce cost overruns and schedule slippages that have plagued the construction of nuclear power plant projects. With this initiative, NRIC is facilitating the development of advanced nuclear plant construction technologies and approaches through partnerships that would provide game-changing benefits to the construction of advanced nuclear power plants.
Economic analysis of precious metal recovery from electronic waste through gas-assisted microflow extraction
The recycling of end-of-life (EoL) electronic products is motivated by the enormous investment of resources in their creation and the environmental concerns associated with electronic waste (e-waste). Hydrometallurgical methods that utilize conventional leaching and solvent extraction are often applied to extract target materials from e-waste; however, these techniques have significant technical and economic limitations when extracting high-value, low concentration metals from complex waste streams. This study proposes and evaluates a novel process based on gas-assisted microflow extraction (GAME) that efficiently recovers precious metals from waste printed circuit boards (WPCBs). Further, an economic analysis is conducted to verify the economic feasibility of the GAME-based process at an industrial scale. The economic outputs are further investigated to identify the most cost-effective production strategies, particularly with respect to the plant feedstock rate. It is envisioned that this study may establish a paradigm for making economically-informed decisions for sustainable technologies.
A Cooperative Game Theory-based Approach to Under-frequency Load Shedding Control
This paper proposes a cooperative game theory-based under-frequency load shedding (UFLS) approach for frequency stability and control in power systems. UFLS is a crucial factor for frequency stability and control especially in power grids with high penetration of renewable energy sources and restructured power systems. Conventional UFLS methods, most of which are off-line, usually shed fixed amounts of predetermined loads based on a predetermined schedule which can lead to over or under curtailment of load. This paper presents a co-operative game theory-based two-stage strategy to effectively and precisely determine locations and amounts of loads to be shed for UFLS control. In the first stage, the total amount of loads to be shed, also referred to as deficit in generation or the disturbance power, is computed using the initial rate of change of frequency (ROCOF) referred to the equivalent inertial center. In the second stage, the Shapley value, one of the solution concepts of cooperative game theory, is used to determine load shedding amounts and locations. The proposed method is implemented on the reduced 9-bus 3-machine Western Electricity Coordinating Council (WECC) system and simulated on Real-time Digital Simulators (RTDS). The results show that the proposed UFLS approach can effectively return the system to normal state after disturbances.
graphenv: a Python library for reinforcement learning on graph search spaces
Many important and challenging problems in combinatorial optimization (CO) can be expressed as graph search problems, in which graph vertices represent full or partial solutions and edges represent decisions that connect them. Graph structure not only introduces strong relational inductive biases for learning (Battaglia et al., 2018) - in this context, by providing a way to explicitly model the value of transitioning (along edges) between one search state (vertex) and the next - but lends itself to problems both with and without clearly defined algebraic structure. For example, classic CO problems on graphs such as the Traveling Salesman Problem (TSP) can be expressed as either pure graph search or integer programs. Other problems, however, such as molecular optimization, do no have concise algebraic formulations and yet are readily implemented as a graph search (V. et al., 2022; Zhou et al., 2019). Such "model-free" problems constitute a large fraction of modern reinforcement learning (RL) research owing to the fact that it is often much easier to write a forward simulation that expresses all of the state transitions and rewards, than to write down the precise mathematical expression of the full optimization problem. In the case of molecular optimization, for example, one can use domain knowledge alongside existing software libraries to model the effect of adding a single bond or atom to an existing but incomplete molecule, and let the RL algorithm build a model of how good a given decision is by "experiencing" the simulated environment many times through. In contrast, a model-based mathematical formulation that fully expresses all the chemical and physical constraints is intractable. In recent years, RL has emerged as an effective paradigm for optimizing searches over graphs and led to state-of-the-art heuristics for games like Go and chess, as well as for classical CO problems such as the TSP. This combination of graph search and RL, while powerful, requires non-trivial software to execute, especially when combining advanced state representations such as Graph Neural Networks (GNN) with scalable RL algorithms.
Reinforcement learning for bluff body active flow control in experiments and simulations
Significance Reinforcement learning (RL) has been applied effectively in games and robotic manipulation. We demonstrate the effectiveness of RL in experimental fluid mechanics by applying it to reduce the drag of circular cylinders in turbulent flow, a canonical fluid–structure interaction problem. Although physics agnostic, RL managed to reduce the drag by 30 % or reach another specified optimum point very quickly. Following this discovery, we used high-fidelity simulations to probe the underlying physical mechanisms so that the discovered control techniques can be generalized to other similar flow problems. More broadly, RL-guided active control can lead to efficient exploration of additional flow-control strategies in experimental fluid mechanics, potentially paving the way for accelerating scientific discovery and different designs in flow-related engineering problems.
Interference Moral Hazard in Large Multihop Networks
Cooperation between network nodes is critical for supporting services in ad hoc networks. Cooperation, however, is an idealized assumption that may not always be present. This assumption can fail because of moral hazard, a scenario in part caused by misaligned incentives between the requesting node and supporting node. In this paper, we characterize a moral hazard that perversely incentivizes nodes to increase their routing payments by transmitting interference into the multi-hop network. We refer to this as the interference moral hazard (IMH) problem which is inherent to strategyproof mechanisms with low overpayments. We investigate IMH as a non-cooperative game played by network nodes on a random graph. For large networks, we show that IMH can be solved in the network design space. Finally, we provide sufficient conditions on the network distribution that guarantee an equilibrium path with interference-free play. This is achieved by 1) lower-bounding the number of nodes and 2) bounding the network density slightly above the 2-connectedness threshold and below a proposed upper-bound. Simulations suggest that density plays a fundamental role in IMH.
Quantum model learning agent: characterisation of quantum systems through machine learning
Accurate models of real quantum systems are important for investigating their behaviour, yet are difficult to distil empirically. Here, we report an algorithm—the quantum model learning agent (QMLA)—to reverse engineer Hamiltonian descriptions of a target system. We test the performance of QMLA on a number of simulated experiments, demonstrating several mechanisms for the design of candidate Hamiltonian models and simultaneously entertaining numerous hypotheses about the nature of the physical interactions governing the system under study. QMLA is shown to identify the true model in the majority of instances, when provided with limited a priori information, and control of the experimental setup. Our protocol can explore Ising, Heisenberg and Hubbard families of models in parallel, reliably identifying the family which best describes the system dynamics. We demonstrate QMLA operating on large model spaces by incorporating a genetic algorithm to formulate new hypothetical models. The selection of models whose features propagate to the next generation is based upon an objective function inspired by the Elo rating scheme, typically used to rate competitors in games such as chess and football. In all instances, our protocol finds models that exhibit F 1 score ≥ 0.88 when compared with the true model, and it precisely identifies the true model in 72% of cases, whilst exploring a space of over 250 000 potential models. By testing which interactions actually occur in the target system, QMLA is a viable tool for both the exploration of fundamental physics and the characterisation and calibration of quantum devices.