Search NASA⌕ Search

SEARCH · Search NASA

Results for “Real-time operating system”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
NASA NTRS1991

SHARP: Automated monitoring of spacecraft health and status

Briefly discussed here are the spacecraft and ground systems monitoring process at the Jet Propulsion Laboratory (JPL). Some of the difficulties associated with the existing technology used in mission operations are highlighted. A new automated system based on artificial intelligence technology is described which seeks to overcome many of these limitations. The system, called the Spacecraft Health Automated Reasoning Prototype (SHARP), is designed to automate health and status analysis for multi-mission spacecraft and ground data systems operations. The system has proved to be effective for detecting and analyzing potential spacecraft and ground systems problems by performing real-time analysis of spacecraft and ground data systems engineering telemetry. Telecommunications link analysis of the Voyager 2 spacecraft was the initial focus for evaluation of the system in real-time operations during the Voyager spacecraft encounter with Neptune in August 1989.

Atkinson, David J.↗
NASA NTRS2009

General Purpose Data-Driven System Monitoring for Space Operations

Modern space propulsion and exploration system designs are becoming increasingly sophisticated and complex. Determining the health state of these systems using traditional methods is becoming more difficult as the number of sensors and component interactions grows. Data-driven monitoring techniques have been developed to address these issues by analyzing system operations data to automatically characterize normal system behavior. The Inductive Monitoring System (IMS) is a data-driven system health monitoring software tool that has been successfully applied to several aerospace applications. IMS uses a data mining technique called clustering to analyze archived system data and characterize normal interactions between parameters. This characterization, or model, of nominal operation is stored in a knowledge base that can be used for real-time system monitoring or for analysis of archived events. Ongoing and developing IMS space operations applications include International Space Station flight control, satellite vehicle system health management, launch vehicle ground operations, and fleet supportability. As a common thread of discussion this paper will employ the evolution of the IMS data-driven technique as related to several Integrated Systems Health Management (ISHM) elements. Thematically, the projects listed will be used as case studies. The maturation of IMS via projects where it has been deployed, or is currently being integrated to aid in fault detection will be described. The paper will also explain how IMS can be used to complement a suite of other ISHM tools, providing initial fault detection support for diagnosis and recovery.

Satellites↗
NASA NTRS2012

General Purpose Data-Driven System Monitoring for Space Operations

Modern space propulsion and exploration system designs are becoming increasingly sophisticated and complex. Determining the health state of these systems using traditional methods is becoming more difficult as the number of sensors and component interactions grows. Data-driven monitoring techniques have been developed to address these issues by analyzing system operations data to automatically characterize normal system behavior. The Inductive Monitoring System (IMS) is a data-driven system health monitoring software tool that has been successfully applied to several aerospace applications. IMS uses a data mining technique called clustering to analyze archived system data and characterize normal interactions between parameters. This characterization, or model, of nominal operation is stored in a knowledge base that can be used for real-time system monitoring or for analysis of archived events. Ongoing and developing IMS space operations applications include International Space Station flight control, spacecraft vehicle system health management, launch vehicle ground operations, and fleet supportability. As a common thread of discussion this paper will employ the evolution of the IMS data-driven technique as related to several Integrated Systems Health Management (ISHM) elements. Thematically, the projects listed will be used as case studies. The maturation of IMS via projects where it has been deployed or is currently being integrated to aid in fault detection will be described. The paper will also explain how IMS can be used to complement a suite of other ISHM tools, providing initial fault detection support for diagnosis and recovery

Space Propulsion↗
DOE OSTI2026

Deep Learning enabled spectral energy conversion for in situ exposure measurements

A detector-specific deep learning (DL) approach is presented for spectra-to-exposure conversion using large-format sodium iodide (NaI(Tl)) detectors deployed for in situ environmental radiation measurements in emergency response scenarios. Accurate determination of exposure from NaI spectra is challenging due to poor energy resolution, partial energy absorption, and the strong sensitivity of traditionally deployed analytical conversion methods to calibrated source geometry and pre-deployment assumptions. Here, to address these limitations, a multi-layer perceptron model was trained on a hybrid in situ /Monte Carlo dataset constructed to span a broad range of photon energies, spatial extents, and realistic deployment variability, representative of general in situ emergency response conditions. The DL model was evaluated against commonly fielded analytical approaches under matched simulation conditions, including a single-factor method, a G-function method, and a modeled pressurized ion chamber (PIC) baseline. This study was intentionally computational in scope to enable controlled, like-for-like comparisons between conversion techniques while minimizing confounding real-world variability. Comparison to the modeled PIC provides contextual benchmarking and is not intended as a field inter-comparison with deployed instruments. Across the evaluated 20 keV to 3 MeV energy range, the DL approach consistently exhibited higher accuracy and reduced variance relative to the analytical methods against a deterministically calculated exposure. This may indicate improved robustness to spectral complexity without reliance on source-, geometric-, or spectral region-specific optimization. While results do not represent real-world validation, the presented work demonstrates that deep learning may effectively learn the nonlinear detector response-to-exposure relationship for asymmetric NaI(Tl) detectors and offers a promising pathway for improving in situ exposure estimation using spectroscopic systems already integrated into initial real-time emergency response operations.

61 RADIATION PROTECTION AND DOSIMETRY↗
NASA NTRSDate not supplied

Plume Impingement Software Module for Real-Time Proximity Operations

Successfully executing proximity operations in space, such as docking or in-orbit servicing, requires sophisticated spacecraft design that accounts for induced environments. As a chaser vehicle’s attitude control thrusters fire, they create rarefied plumes that can impact the target vehicle, with the potential to overload components, exceed thermal limits, and spin the target vehicle out of control. High-fidelity simulations of the thruster plume impingement environment require the direct simulation Monte Carlo (DSMC) method, but DSMC is too computationally expensive to simulate proximity operations that involve thousands of thruster firings. For this analysis to be tractable, engineering models of the plume flowfield and impingement events are used to simulate these trajectories [1]. Currently, on-orbit plume impingement environments are modeled through an inefficient open-loop analysis cycle where the vehicle’s flight controller and plume impingement teams iterate on the trajectories until they pass the target vehicle’s plume requirements. As complex on-orbit missions evolve and become more frequent, lengthy design cycles will become operational bottlenecks. To address this gap, this work develops an advanced plume impingement module capable of operating at real-time scale that can be integrated with existing mission planning tools and onboard flight systems. The plume module leverages state-of-the-art plume simulation techniques [2] to deliver fast, physics-based impingement predictions in a software architecture that can be tailored to diverse proximity operations scenarios. A prototype of this plume impingement module is built to demonstrate the feasibility of real-time performance. This prototype completes plume impingement calculations in microseconds per target geometry mesh point. The software serves as a foundational capability for plume-aware trajectory design, operational risk assessment, and future autonomous decision-making systems.

Plume Impingement↗
NASA NTRSDate not supplied

Biocybernetic Closed-Loop System for Mitigating Hazardous States of Awareness

The past century of passenger flight has seen continuous improvement in aviation safety by the aerospace industry. However, while commercial aviation accident rates have continued to decline, human error-related incident and accident rates remain remarkably constant across all types of aviation (Shappell, et al., 2007). Unfortunately, this level of human error is unacceptable when considering projections for increased traffic volume (FAA, 2009), and is likely to yield more incidents and accidents unless a more complete understanding of operator error is achieved and remediations are implemented. One area of interest highlighted by researchers is Hazardous States of Awareness (HSAs) that can result from deficiencies in the design and inappropriate use of human-machine interfaces. Identifying and mitigating HSAs is critical for reducing operator errors. One promising approach uses psychophysiological measures which enable automated systems to adapt to the operator?s state and modify modes of operation to support optimal human performance (Scerbo, 2007). This paper will survey previous research and describe future directions for the application of psychophysiological measures of operators derived from cortical and autonomic assessment to perform real-time adaptive modulation of human-automation task mode mixes. The authors will present a summary of previous work done at NASA LaRC and Old Dominion University using a Psychophysiologically Adaptive System (PAS) in which the level of automation of the NASA Multi-Attribute Task Battery was modulated based on Engagement Indices derived from the users? electroencephalogram (Pope, Bogart, & Bartolome, 1995; for review see, Scerbo, Freeman, & Mikulka, 2003). Future theoretical and methodological directions for this type of closed-loop research will be discussed. Specifically, the capacity for this type of PAS to maintain effective operator state and to enable validation of candidate physiological indices will be described. Consideration will also be given to critical system characteristics (e.g., engagement indices, methods for invoking changes among system states, individual differences among users, etc.) that have been or still need to be studied. The potential of the PAS approach for interactive system design and prototyping will also be described. Examples of adaptive automation flight deck concepts in recent experiments will be highlighted and discussed.

Chad L Stephens↗
NASA NTRS2026

Proactive Wildfire Management: A Remote Sensing and Multimodal CNN-MLP Architecture for Ignition Risk Forecasting

As the frequency and intensity of wildfires increase, with fire seasons now starting earlier and ending later than they have over the past decades, current monitoring systems, such as lookout towers and satellites, are hindered by cloud cover, low-resolution imagery, and static data gaps that fail to track vegetation moisture levels fast enough to catch rapid pre-ignition changes. This report proposes a Machine Learning-enabled Wildfire Ignition Prediction framework that combines satellite monitoring with dynamic and high-resolution remote sensing from Unmanned Aerial Vehicle (UAV) swarms. The method would use multispectral and thermal data from the Landsat program to create a baseline for vegetation health, calculating a two-band Enhanced Vegetation Index (EVI2) and the moisture content of the vegetation. These inputs will later be fused with microscale UAV weather data, including thermal hotspots found through thick canopies, hyperspectral chemical signatures of pre-visual combustion, and local weather streams. The multispectral satellite, multispectral Light Detection and Ranging (LiDAR), and thermal data would then be processed through a Convolutional Neural Network (CNN), alongside a Multilayer Perceptron (MLP) for the micro-weather telemetry. The outputs of these networks would be fused into a single feature representation and passed through a final prediction network to generate real-time ignition risk scores and hotspot alerts. Model performance would be assessed using standard classification metrics, including a Receiver Operating Characteristic - Area Under the Curve (ROC AUC) and F1 score. This system would allow first responders to identify high-risk zones and intervene before ignition occurs, improving emergency response time compared to current approaches.

machine learning↗
DOE OSTI2026

EXERGETIC: De-Risking Next-Generation Resilient Geothermal Hybrids via At-Scale Evaluation Using Virtual Emulation Digital Twin Environment for Efficient Operation

The DOE-GTO-funded project, award number 5.1.2.12, entitled "EXERGETIC - De-risking Next Generation Resilient Geothermal Hybrids via at-Scale Evaluation Using a Virtual Emulation Digital Twin Environment for Efficient Operation," advances the solution to these challenges by developing and validating a geothermal co-emulation environment implemented at the National Laboratory of the Rockies (NLR)'s Advanced Research on Integrated Energy Systems (ARIES) platform. This framework enables the de-risking of next-generation geothermal and geothermal hybrid systems through high-fidelity modeling, real-time digital emulation, advanced control strategies, and techno-economic assessment. The project focused on geothermal hybrid configurations that integrate geothermal power plants with concentrated solar power and underground thermal energy storage, enabling enhanced efficiency, flexibility, and grid support capabilities. The main goal of this project was the development of a geothermal digital co-emulation environment to demonstrate the technical and economic value of geothermal hybrid systems and their contribution to grid stability and flexibility. The EXERGETIC framework combined physics-based models, controls, and real assets at ARIES, including digital real-time simulators (DRTS), a 20-MW-scale controllable grid interface (CGI), and a 2-MW conventional generator. Detailed transient models were developed for the key subsystems of a hybrid geothermal plant, including parabolic trough solar collectors, reservoir thermal energy storage (RTES), and a binary Organic Rankine Cycle (ORC) power plant. The ORC model explicitly captured thermal inertia and off-design operation and integrated control strategies to dynamically respond to electric load profiles. The models were validated against published experimental and numerical studies, demonstrating strong agreement and confirming the accuracy and robustness of the modeling approach. The resulting digital twin represents geothermal-solar-storage systems at multiple scales (1 MW to 100 MW) and enables realistic emulation of grid-connected operation. The control architecture allows the geothermal resource to provide stable baseload generation, while solar and stored thermal energy supply flexible, dispatchable support during periods of high demand or variable grid conditions. A key contribution of the EXERGETIC project is the demonstration that geothermal hybrid systems can be designed to be active grid assets rather than passive baseload generators. Using the ARIES platform, the digital twin was evaluated under multiple grid scenarios, including load following, voltage support at the distribution level, and frequency response at the transmission level. Results show that hybrid geothermal systems can respond effectively to dynamic grid conditions, providing inertia-like behavior, primary frequency support, and voltage regulation through coordinated control. In addition to the performance and grid services capability analysis of geothermal and hybrid geothermal systems, the EXERGETIC project also focused on scalability and techno-economic analysis of geothermal hybrid plants. In particular, for the scalability analysis, machine-learning (ML)-based surrogate models were trained using data generated from the geothermal digital twin under different grid-connected scenarios and plant capacities. These ML models demonstrated strong interpolation and extrapolation capabilities across plant sizes, accurately reproducing both steady-state and transient responses with very low errors. Regarding the techno-economic analysis, plant performance results were integrated with cost models for hybrid geothermal systems, and the levelized cost of electricity (LCOE) was used as the main economic metric to evaluate system performance across a range of system capacities, solar shares, solar multiples, and storage durations. Results indicate that economies of scale significantly reduce geothermal LCOE as plant capacity increases, with large-scale systems (25-100 MW) achieving substantially lower costs than small plants. Hybridization with solar thermal energy and storage further improves economic performance by increasing capacity utilization and enabling flexible dispatch. In addition, thermal storage plays a critical role in reducing LCOE by maximizing geothermal, solar, and stored energy resources. In summary, the results from this project demonstrate that geothermal hybrid systems represent a promising alternative for increasing the energy conversion efficiency of geothermal technologies, contributing to the preservation of geothermal resources, and supporting the transition of geothermal plants from traditional baseload resources into flexible, resilient, and cost-competitive energy conversion technologies.

15 GEOTHERMAL ENERGY↗
NASA NTRSDate not supplied

Subscale Hardware-In-The-Loop Results for Hybrid Electric Turbofan Controls Use Cases

NASA is investigating hybrid electric turbine engine systems for commercial transport aircraft due to the potentially significant improvements hybrid electric technology offers in performance, fuel consumption, and operational and design flexibility. Recently, the technology has been tested at full scale in partnership with industry and advanced to Technology Readiness Level 4. This presentation will focus on a recent subscale hardware-in-the-loop test of an open source turbofan engine model developed by NASA. The Advanced Geared Turbofan 30,000 lbf – electrified (AGTF30-e) engine is used as a reference model to demonstrate control system design and use cases for an example mild hybrid electric system with no large-scale energy storage. This model is run in real-time in NASA’s Hybrid Propulsion Emulation Rig (HyPER) and is used to drive an emulation of the turbomachinery system using subscale electric machines. This dynamic scaled shaft emulation interacts with a subscale (<100 kW) hybrid system consisting of electric machines, motor controllers, and a programmable electronic load. Specific use cases demonstrated include the use of Turbine Electrified Energy Management to improve operation during transients, megawatt-scale power extraction from the AGTF30-e, and power transfer between engine spools. Results related to the effectiveness of hybrid systems are qualitatively compared to results from industry testing.

Hybrid↗
NASA NTRS1990

A laboratory breadboard system for dual-arm teleoperation

The computing architecture of a novel dual-arm teleoperation system is described. The novelty of this system is that: (1) the master arm is not a replica of the slave arm; it is unspecific to any manipulator and can be used for the control of various robot arms with software modifications; and (2) the force feedback to the general purpose master arm is derived from force-torque sensor data originating from the slave hand. The computing architecture of this breadboard system is a fully synchronized pipeline with unique methods for data handling, communication and mathematical transformations. The computing system is modular, thus inherently extendable. The local control loops at both sites operate at 100 Hz rate, and the end-to-end bilateral (force-reflecting) control loop operates at 200 Hz rate, each loop without interpolation. This provides high-fidelity control. This end-to-end system elevates teleoperation to a new level of capabilities via the use of sensors, microprocessors, novel electronics, and real-time graphics displays. A description is given of a graphic simulation system connected to the dual-arm teleoperation breadboard system. High-fidelity graphic simulation of a telerobot (called Phantom Robot) is used for preview and predictive displays for planning and for real-time control under several seconds communication time delay conditions. High fidelity graphic simulation is obtained by using appropriate calibration techniques.

Bejczy, A. K.↗
NASA NTRS1991

The real-time control of planetary rovers through behavior modification

It is not yet clear of what type, and how much, intelligence is needed for a planetary rover to function semi-autonomously on a planetary surface. Current designs assume an advanced AI system that maintains a detailed map of its journeys and the surroundings, and that carefully calculates and tests every move in advance. To achieve these abilities, and because of the limitations of space-qualified electronics, the supporting rover is quite sizable, massing a large fraction of a ton, and requiring technology advances in everything from power to ground operations. An alternative approach is to use a behavior driven control scheme. Recent research has shown that many complex tasks may be achieved by programming a robot with a set of behaviors and activation or deactivating a subset of those behaviors as required by the specific situation in which the robot finds itself. Behavior control requires much less computation than is required by tradition AI planning techniques. The reduced computation requirements allows the entire rover to be scaled down as appropriate (only down-link communications and payload do not scale under these circumstances). The missions that can be handled by the real-time control and operation of a set of small, semi-autonomous, interacting, behavior-controlled planetary rovers are discussed.

Miller, David P.↗
DOE OSTI2026

A review of United States energy-only generator interconnection service policy and considerations for reform

Grid interconnection has emerged as a significant obstacle to the development of new electricity resources. There is growing interest in energy-only interconnection, which is an interconnection service option meant to allow the interconnection of new generators without ensuring their energy deliverability during all hours through the transmission system to customers. This approach potentially avoids upfront congestion-related transmission upgrades but could increase curtailment risk. Interest in energy-only interconnection is shaped by incomplete understanding of how interconnection policy functions in different jurisdictions, a knowledge gap that makes it difficult to determine how energy-only interconnection might be better used or re-designed. In this paper, we provide a regulatory review of energy-only interconnection in U.S. interconnection policy and practice, identifying jurisdictions in which rules are close to -or farther from-the theoretical concept of energy-only interconnection service. We find substantial jurisdictional differences in how energy-only interconnection is implemented, driven by differences in resource adequacy frameworks, real-time transmission operations, and state-level procurement practices. U.S. regulators have preferred local jurisdictional flexibility over federal prescription of interconnection study methods and procedures, which also contributes to differences among regions. Such findings raise fundamental questions about whether competition policies in electricity markets should extend beyond spot energy markets and into more prescriptive guidelines around interconnection rules and market entry. This paper sheds light on tensions that energy-only interconnection raises in allowing generators to access the transmission system on an as available basis and discusses how controlling thresholds for congestion-related network upgrades may be a barrier to electricity market entry.

Gorman, Will↗
DOE OSTI2026

Technoeconomic Opportunity Analysis for Local Power Generation in Falls City, Nebraska

Falls City is a small community in Nebraska interested in understanding how energy from local energy systems could support the community's economic development planning. To address the current community needs and address the future energy demand technical assistance conducted through the Communities Local Energy Action Program (Communities LEAP) assessed the technical and economic opportunities of adding energy technologies to Falls City's municipally owned and operated electric utility system. The modeling performed considered the technical and economic feasibility of technologies using the System Advisor Model (SAM). The modeling explored three technology configurations using multiple years of historical weather and wholesale cost data (2015-2022 & a typical meteorological year), and two different wholesale escalation rates (0.3% and 2.5%). Wholesale energy prices were based on the Southwest Power Pool's (SPP) real-time energy market and the annual escalation rates of these rates based on historical SPP wholesale and national retail electricity price trends. Results from the modeling showed that at current CAPEX costs and SPP wholesale electricity costs no technology combination averaged across the scenarios run provide a positive net present value (NPV). External financial support, changes in market conditions, and additional revenue streams would help create more economically favorable projects. As conditions change re-evaluation may be necessary.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2027

Market participation strategy of hybrid energy resources: A New York ISO case study

Drawing on existing market designs with independent resource participation in electricity markets, this study analyzes participation models for hybrid resources combining renewable generation and storage. Two models are considered: in the first, the components operate independently, with the Independent System Operator (ISO) managing the storage state of charge (SoC); in the second, the hybrid resource acts as an integrated unit, submitting offers as a “black box” and managing its SoC internally. Using a production cost model for the zonal New York Bulk Power System, we evaluate trade-offs in system reliability, market efficiency, and asset profitability. Our results provide several key insights for policymakers, showing that the ISO-managed granular model enhances social welfare through explicit SoC management, while the simpler integrated model is more computationally efficient, but may cause more real-time violations and lower overall profits.

Bansal, Rajni Kant↗
DOE OSTI2025

Next-Generation Energy Technologies for Connected and Automated On-Road Vehicles (NEXTCAR) - Predictive Data-Driven Vehicle Dynamics and Powertrain Control: from ECU to the Cloud (Final Scientific/Technical Report)

This project developed and demonstrated a predictive, data-driven vehicle control system designed to improve energy efficiency and driving performance. The team created intelligent self-driving car technology that optimizes fuel and electricity use by proactively planning vehicle actions. By combining Level 4 autonomous driving capabilities with vehicle-to-everything (V2X) connectivity, the system enables vehicles to adjust speed and change lanes in response to traffic signals, surrounding vehicles, and road conditions, reducing unnecessary stops and delays. In testing, the system improved vehicle fuel economy by more than 30% and reduced travel time by approximately 10%, compared to a conventional adaptive cruise control baseline. These results demonstrate the technical effectiveness of using predictive, V2X-enabled strategies, such as traffic light timing and surrounding traffic awareness, to inform real-time vehicle powertrain control and driving behavior. Additionally, a supporting cloud platform was developed to provide dispatch and route recommendations as well as to log vehicle data, demonstrating the economic feasibility of this approach at the fleet level. By optimizing dispatching and routing operations, this technology enables electric fleet operators to use their vehicles more efficiently and reduce reliance on diesel backups, lowering both operating costs and energy consumption. Overall, this project’s technology advances the future of clean, energy-efficient transportation, enabling vehicles and fleets to reduce energy waste, cut costs, and lower emissions through intelligent automation and connectivity.

33 ADVANCED PROPULSION SYSTEMS↗
NASA NTRS2026

The Future of in-Situ Sequencing-Based Microbial Monitoring: Development of a Shelf-Stable Method for Artemis and Beyond

Microbial monitoring onboard the International Space Station (ISS) is essential for assessing the efficiency of the Environmental Control and Life Support Systems (ECLSS) and providing insight into potential risk to both crew and spacecraft. Historically, this monitoring required the need to culture organisms onboard, return these cultures to Earth, and then complete the identifications, a process that would take months. Over the past decade, and through numerous payloads, advances in molecular biology have enabled in-flight microbial identifications using nanopore sequencing. The swab-to-sequencer method resulting from these efforts was transitioned from research to operations for microbial monitoring under the Crew Health Care Systems (CHeCS) BioMole. Collectively, these accomplishments have propelled the swab-to-sequencer method to be selected as the Microbial Surface Monitor (MSM) for Gateway, as well as a payload on Artemis IV. However, the lack of cold stowage availability for Artemis requires modifications to the entire method due to the thermal instability of the reagents required for sample preparation. To achieve this, new development, optimization, and validations were undertaken. Key considerations included enzyme concentration, buffer compatibility, and equal or enhanced sensitivity and specificity. At each step, thorough side-by-side comparisons with the current ISS method were performed. The development of a robust shelf-stable method will ensure continued sequencing-based microbial monitoring for Artemis and beyond, providing data in near real-time, enhancing risk response time, and yielding clear insight into the microbiome of spacecraft.

Christian G Mena↗
NASA NTRSDate not supplied

Enabling Interoperability in Earth System Digital Twins (ESDT): Integrating Observations, Models, and AI for Actionable Insights Through NASA'S Intelligent Systems Technology Program

NASA’s Intelligent Systems Technology Program (IST) is driving a paradigm shift in Earth science through the development of Earth System Digital Twins (ESDT). These integrated information systems create a dynamic "digital replica" of the Earth by harmonizing continuous, multi-source observations with high-fidelity models and state-of-the-art artificial intelligence (AI) that enable “What now?”, “What next?”, and “What if?” scenario building. These scenarios are reflected in NASA IST’s series of ESDTs, from the Coastal Zone Digital Twin that integrates complex data on the current state of the Chesapeake Bay to the Terrestrial Environmental Rapid-Replication and Assimilation Hydrometeorological (TerraHydro) AI-based ESDT that forecasts water movement across Earth’s surface, to the Agriculture Land Information System (AgLIS) which can be used to assess optimal planting dates and crop yield estimates. By bridging the gap between vast data archives and actionable insights, these projects enable a system-of-systems approach to understanding complex, interacting Earth processes. This poster will highlight recent innovations and future directions from NASA’s ESDT initiatives: Continuous Data Assimilation & Multi-Source Fusion. A core requirement of the ESDT work is the transition from static models to dynamic "living" replicas. This involves creating frameworks for the continual assimilation of near-real-time data from uncoordinated, heterogeneous sources, including satellite observations and airborne assets, and ground-based Internet of Things (IoT) sensors. These systems link design, operational status, and environmental data, ensuring the digital twin accurately reflects the current state of the physical Earth system. High-Fidelity Hybrid Modeling & Computational Acceleration to enable interactive "what-if" explorations, programs are moving beyond traditional, slow physical solvers by developing fast surrogate machine learning models and Deep Generative Models (DGMs). These hybrid approaches use neural networks to emulate complex physics, such as cloud feedback or ocean dynamics, at a fraction of the original computing cost, often leveraging advanced hardware like Graphics Processing Units (GPUs) to achieve the necessary scale. Federated Ecosystems & Interoperable Frameworks rather than building isolated tools, NASA IST is moving toward federated ESDTs and reusable analytic collaborative frameworks. This theme focuses on interoperability standards and common ontologies that allow specialized digital twins to interact and share data. This system-of-systems architecture supports multi-discipline investigations, such as analyzing how upstream watershed changes impact downstream urban flooding or how wildfire emissions affect regional air quality. By leveraging these advancements, ESDTs empower researchers and decision-makers to conduct real-time analysis and run complex hypothetical scenarios, ultimately improving our understanding of Earth’s evolving systems and informing critical real-world applications.

Earth System↗
DOE OSTI2026

Toward an AI-Powered Software Pipeline for Real-Time Tracking and Analysis of Wildfire and Smoke

Real-time tracking of wildfires and smoke is crucial for effective response, minimizing damage, protecting lives, and efficiently managing resources during fire emergencies. We develop a web-based AI-powered pipeline that detects wildfires in aerial video and estimates deployment-relevant behavior metrics, including cumulative burned area, burned-area growth rate, fire spread direction, and smoke dispersion. The system combines a YOLO-based detector with YCbCr-based fire segmentation, HSV-based smoke segmentation, Farneback optical flow, and centroid-based spatiotemporal tracking. Using ground sampling distance (GSD), pixel-level fire masks are converted to physical burned-area measurements by correlating fire pixel counts with camera altitude and tilt angle. We benchmark YOLO variants and non-YOLO baselines (GoogLeNet, CNN, DBN, Autoencoder, U-Net, and AlexNet) on the IEEE FLAME dataset and a newly created aerial frame dataset, Wildfire-DB. Cross-dataset evaluation uses a strict threshold-transfer protocol: decision thresholds are selected on FLAME validation and transferred unchanged to Wildfire-DB to quantify generalization under domain shift. YOLOv6 achieves the strongest cross-dataset frame-level fire detection on Wildfire-DB (ROC-AUC 0.8200, PR-AUC 0.8044, and transferred-threshold F1 0.7596). For tracking-oriented deployment requiring oriented localization, YOLO11-OBB provides the most reliable cross-dataset behavior among OBB-capable models while remaining computationally feasible. To analyze the feasibility of UAV deployment, we further measure inference efficiency using synchronized GPU and CPU power logs on a fixed workload of 1569 frames. YOLO-family models process the video in 5.73–12.47 seconds with net energy of 1247.28–1775.39 J, substantially lower latency and energy than heavier classification and reconstruction baselines. Overall, model optimality depends on operational objectives: YOLOv6 is best for cross-dataset detection robustness, whereas YOL...

Color segmentation↗