Search NASA⌕ Search

SEARCH · Search NASA

Results for “Real”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 361 records · Page 20
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Towards automated and real-time multi-object detection of anguilliform fishes from sonar data using YOLOv8 deep learning algorithm

Eels (Anguilla spp.), including American eels (Anguilla rostrata), European eels (Anguilla anguilla), and Japanese eels (Anguilla japonica), are species of critical management and regulatory concern due to their vulnerability to various stressors during downstream migrations. Accurate and efficient detection of migrating eels can improve our understanding of fish behaviors and fish-hydraulic structure interactions, thereby facilitating the design, operation, and optimization of more effective downstream passage facilities from both biological and economic perspectives. However, a real-time, automated framework for detecting migrating eels in real-world applications is currently lacking. Leveraging imaging sonar as a reliable technology for fish passage monitoring, field data are acquired using imaging sonar and then converted to single sonar frames/images for subsequent analysis. In this study, a framework based on the You Only Look Once Version 8 (YOLOv8)-based convolutional neural network is proposed for multi-object detection of eels and non-eel fish using the sonar images after image subtraction and additional wavelet denoising. The results from both training and testing phases demonstrate that the framework's ability can successfully detect both eels and non-eel fish in preprocessed sonar images, achieving F1-scores and mAP@0.50 exceeding 0.84. Additionally, the incorporation of wavelet denoising during preprocessing slightly improve detection performance. Furthermore, the transferability of this framework from eel to lamprey detection is demonstrated to be feasible given the similar morphological characteristics of these two species. Overall, the proposed framework achieves accurate and efficient detection of migrating eels, providing reliable and real-time information that can help conserve vulnerable eel and eel-like populations.

Deep learning↗
DOE OSTI2020

Real-time gas cooling of flowing liquid lithium limiter for the EAST

A novel continuously flowing liquid lithium limiter (FLiLi) which employs an in-vessel electro-magnetic pump to drive liquid Li flowing on the surface of limiter has been successfully designed and tested in the experimental advanced superconducting tokamak (EAST) device in 2014. In order to better control the surface temperature, an upgraded design and the real-time gas cooling were performed in 2016. Two kinds of cooling gas, helium (He) and argon (Ar) were tested on the FLiLi system prior to the experiment. It was found that the cooling rates of He and Ar at 2.5 MPa are 34.2 °C/min, 10.2 °C/min or 31.7 °C/kL and 28.1 °C/kL, respectively. The cooling performance of He is more effective than Ar. Experimental results show that the real-time He cooling could effectively contain the FLiLi surface temperature increase and prevent the strong passive evaporation of lithium during plasma discharges. Limiter heat flux up to 0.2 MW/m2 was removed during ohmic discharge with 2.5 MPa He gas. Finally, Because of the upgraded design and real-time gas cooling, the surface of FLiLi was not damaged by heat flux after entire plasma discharge.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2021

MPC-based double-layer real-time conditional cSelf-restoration for interconnected microgrids

In this report, we propose a novel model predictive control(MPC)-based real-time conditional self-restoration energy management system (CSR-EMS) for interconnected microgrids (IMGs) integrated with renewable energy sources (RESs) and energy storage systems (ESSs). Superior to the existing IMG self-restoration methods, the “conditionality” of the proposed CSR-EMS can economically realize self-restoration and grid-assisted restoration during energy deficiency or faults, in both islanded and grid-connected modes. Cost minimization is implemented as the objective function to judge in real-time which restoration mode is economically preferred. The proposed CSR-EMS comprises two layers–the lower layer operates locally to eliminate electricity fluctuations created by RESs and ensure economic effectiveness within an MG, whereas the upper layer oversees the real-time operational status of the IMG system and determines power exchange among microgrids (MGs) during abnormalities. In detail, when a microgrid inside the IMG system experiences an energy deficiency, the CSR-EMS, on an MPC basis, intelligently optimizes power production from each dispatchable distributed generator (DG), ESS, power imported from the main grid, and power exchange among the IMGs to maintain the demand–supply balance, while considering system recovery cost, state of charge (SoC) of ESSs and operation modes of the IMGs (i.e., grid-connected or islanded mode). Simulation results and comparisons with existing IMG self-healing EMSs demonstrate the economic efficacy of the proposed CSR-EMS strategy during normal and abnormal operations, which can be used as an energy control framework for modern power systems with multiple interconnected microgrids.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2026

Goal-oriented real-time Bayesian inference for linear autonomous dynamical systems with application to digital twins for tsunami early warning

We present a goal-oriented framework for constructing digital twins with the following properties: (1) they employ discretizations of high-fidelity partial differential equation (PDE) models governed by autonomous dynamical systems, leading to large-scale forward problems; (2) they solve a linear inverse problem to assimilate observational data to infer uncertain model components followed by a forward prediction of the evolving dynamics; and (3) the entire end-to-end, data-to-inference-to-prediction computation is carried out without approximation and in real time through a Bayesian framework that rigorously accounts for uncertainties. Several challenges must be overcome to realize this framework, including the large scale of the forward problem, the high dimensionality of the parameter space, and for a class of problems including those we target, the slow decay of the singular values of the parameter-to-observable map. Here we introduce a methodology to overcome these challenges by exploiting the autonomous structure of the forward model to decompose the solution of the inverse problem into a one-time-only offline phase in which the PDE model is solved a limited number of times (equal to the number of sensors), and an online phase that maps well onto GPUs and computes the parameter inference and prediction of quantities of interest in real time, given observational data. Our ultimate goal is to apply this framework to construct digital twins for subduction zones, including Cascadia, to provide early warning for tsunamis generated by megathrust earthquakes. To this end, we demonstrate how our methodology can be used to employ seafloor pressure observations, along with the coupled acoustic–gravity wave equations, to infer the earthquake-induced spatiotemporal seafloor motion (discretized with $\mathscr{O}$ (10 9 ) parameters) and forward predict the tsunami propagation. We present results of an end-to-end inference, prediction, and uncertainty quantification for a representative test problem with $\mathscr{O}$ (10 8 ) inversion parameters for which goal-oriented Bayesian inference is accomplished exactly and in real time, that is, in a matter of seconds.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Forecasting Multi-Step-Ahead Street-Scale Nuisance Flooding using a seq2seq LSTM Surrogate Model for Real-Time Application in a Coastal-Urban City

In coastal-urban cities facing an elevated risk of nuisance flooding (by rain and tide) due to increased heavy rainfall, sea level rise, urbanization, and aging drainage systems, real-time flood forecasting at the street-scale can provide useful information to transportation decision-makers. Physics-Based Models (PBMs) that offer high accuracy come with high computational runtimes and costs that limit their application for real-time flood forecasting. To address this challenge, Machine Learning (ML) surrogate models trained from PBMs have been proposed to provide street-scale flood forecasts. Previous related studies have focused on using Long Short-Term Memory (LSTM) architectures to model hourly flood depth on streets. While LSTM models can capture input sequences effectively, they fall short in accurately preserving output sequences, limiting their suitability for multi-step-ahead forecasts. The seq2seq LSTM architecture offers a key advantage here by capturing the full sequence of input–output, making it potentially more suitable for multi-step-ahead flood forecasts compared to traditional LSTM models. However, seq2seq LSTM has not been tested for street-scale flood forecasting, particularly for rapidly fluctuating nuisance flooding events which require special attention to its temporal sequences. Hence, in this study, we applied the seq2seq LSTM model to explore multi-step-ahead street-scale nuisance flooding and compared its results to the traditional LSTM model as a benchmark model. LSTM and seq2seq LSTM surrogate models were applied to 22 flood-prone streets in Norfolk, Virginia, as a case study with a 4-hr (short-term) and 8-hr (long-term) lead time. The models were trained with environmental (rainfall and tide) and topographic (elevation, Topographic Wetness Index, and Depth-To-Water) features along with PBM-derived water depths for different storm events. The results demonstrated satisfactory performance of both LSTM and seq2seq LSTM surrogate models throughout the forecast period compared to the PBM. However, the seq2seq LSTM showed lower Mean Absolute Error (MAE)/ Root Mean Square Error (RMSE) and higher Nash–Sutcliffe Efficiency (NSE)/ correlation than the LSTM across most lead times, particularly for long-term forecasting due to its supremacy in handling both input–output sequences together, which is missing in the traditional LSTM. For example, in the long-term, the average RMSE ranges were 0.0268–0.0373 m for LSTM and 0.0226–0.0319 m for seq2seq LSTM, while in the short-term, they were 0.0263–0.0293 m and 0.0261–0.0283 m, respectively. Additionally, while both models exhibited similar performance in distinguishing flooded and non-flooded streets for flood depth ≥ 0.1 m, the seq2seq LSTM model demonstrated superior performance for higher flood depths (such as ≥ 0.2 m and ≥ 0.3 m). Once trained, inference took only 0.09 to 0.11 s (short-term) and 0.30 to 0.35 s (long-term) per storm event for the 22 streets, making the application highly suitable for real-time decision-making during nuisance flood events.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Flow field design for zero-gap microbial electrolysis cells using synthetic and real wastewater

Increasing performance in microbial electrolysis cells (MECs) requires the development of optimized reactor configurations with minimal internal resistance and capable to operate with real wastewater. Here, the impact of two different flow fields (serpentine and circular) was examined in zero-gap MECs with synthetic and real wastewaters. The serpentine flow field enabled a uniform distribution of the electrolyte in the anode chamber, resulting in larger current densities at lower flow rates compared to the circular flow field. Electrochemical tests using synthetic media with high buffer capacity revealed more stable and higher performance with the serpentine flow field compared to the circular flow path, producing larger current density (23.7 ± 0.8 A/m 2 vs 21.9 ± 5.6 A/m 2 ), hydrogen production rate (75.8 ± 4.1 L/L-d vs 54.3 ± 2.4 L/L-d), cathodic coulombic efficiency (>91 % vs >50 %), and an overall lower internal resistance (12.5 ± 0.5 mΩm 2 vs 14.8 ± 3.7 mΩm 2 ). Continuous operation for over 30 days with real wastewater indicated higher tolerance of the MECs with serpentine flow field toward media with large concentration of suspended solids, producing a current density of 5.4 ± 1.1 A/m 2 and a hydrogen production rate of 22.2 ± 6.2 L/L-d. Furthermore, the results presented here underscore the importance of reactor design and architecture in optimizing MEC performance for hydrogen production from liquid wastes.

flow path↗
DOE OSTI2026

Sim-to-real supervised domain adaptation for radioisotope identification

Machine learning has the potential to improve the speed and reliability of radioisotope identification using gamma spectroscopy. However, meticulously labeling an experimental dataset for training is often prohibitively expensive, while training models purely on synthetic data is risky due to the domain gap between simulated and experimental measurements. In this research, we demonstrate that supervised domain adaptation can substantially improve the performance of radioisotope identification models by transferring knowledge between synthetic and experimental data domains. We consider two domain adaptation scenarios: (1) a simulation-to-simulation adaptation, where we perform multi-label proportion estimation using simulated high-purity germanium detectors, and (2) a simulation-to-experimental adaptation, where we perform multi-class, single-label classification using measured spectra from handheld lanthanum bromide (LaBr) and sodium iodide (NaI) detectors. We begin by pretraining a spectral classifier on synthetic data using a custom transformer-based neural network. After subsequent fine-tuning on just 64 labeled experimental spectra, we achieve a test accuracy of 96% in the sim-to-real scenario with a LaBr detector, far surpassing a synthetic-only baseline model (75%) and a model trained from scratch (80%) on the same 64 spectra. Furthermore, we demonstrate that domain-adapted models learn more human-interpretable features than experiment-only baseline models. Overall, our results highlight the potential for supervised domain adaptation techniques to bridge the sim-to-real gap in radioisotope identification, enabling the development of accurate and explainable classifiers even in real-world scenarios where access to experimental data is limited.

Lalor, Peter W.↗
DOE OSTI2024

Robust cooperative control strategy for a platoon of connected and autonomous vehicles against sensor errors and control errors simultaneously in a real-world driving environment

In a real-world driving environment, a platoon of connected and autonomous vehicles (CAVs) is subject to many internal and external disturbances, resulting in uncertain vehicle dynamics. In general, the disturbances can be categorized into two types: disturbances due to vehicle sensor errors (e.g., GPS error) and disturbances due to vehicle control errors (e.g., actuator delay). In the literature, many control strategies have been proposed to improve the robustness of the CAV platoon against uncertain vehicle dynamics induced by these disturbances. However, most of these strategies only consider one type of disturbance and cannot tackle both types of disturbances simultaneously. Furthermore, they are designed to maximize the benefits of each vehicle in the platoon independently, which can deteriorate the performance of the platoon. Here, to address these problems, this study proposes a robust cooperative control (RCC) strategy to maneuver the vehicles in the platoon cooperatively to counteract the impacts of both types of disturbances. The RCC strategy is developed based on a minimax problem, where the maximization subproblem seeks to find the worst inputs for the uncertainty terms in the vehicle dynamics equation to minimize the platoon performance, while the minimization subproblem seeks to find the optimal control decisions for all subsequent vehicles to maximize the platoon performance in the worst case. To solve the minimax problem, this study proposes a globally convergent solution algorithm. It can solve the minimax problem very efficiently to enable real time deployment of the RCC strategy. Numerical application indicates that compared to the existing methods, the RCC strategy can dramatically improve the robustness of the CAV platoon against the uncertain vehicle dynamics induced by both vehicle state detection errors and vehicle control errors. Therefore, it can maneuver the CAV platoon safely and efficiently in a real-world driving environment.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2021

Improving the performance of first- and last-mile mobility services through transit coordination, real-time demand prediction, advanced reservations, and trip prioritization

Socio-demographic trends and recent economic development patterns have resulted in travel behavior changes that call for more flexible and accessible public transit options. Because flexible transit services vary in scope, size, and service type, new data-informed methods are useful to optimize services based on the specific needs of local communities and riders. In this study, real-world demand and vehicle trajectory data were used to evaluate and optimize system performance for an existing first-mile–last-mile (FMLM) service in Robinson Township, PA. A general FMLM model for arbitrary demand and service supply was then developed to quantify system performance—both travel time costs and day-to-day reliability—for various operational polices considering spatio-temporal demand variation and transportation network dynamics. Heuristics were used for optimal real-time vehicle routing in sizable real-world networks accommodating various service types and scopes. In this case study, total user costs were reduced by 18.6% when rides were coordinated with mainline fixed-route transit. Predictive routing strategies were shown to marginally improve system performance under sparse and variable spatio-temporal demand. The case study also highlights potentially large travel time and user reliability improvements—reductions of 51% and 53.8%, respectively—when trip requests were made in advance of their desired pickup time. Finally, we show that travel time reliability can be improved for time-inflexible trips with trip prioritization without increasing total user costs. These results were stable to changes in demand density.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2024

Monitoring SEIRAS on a Graphitic Electrode for Surface-Sensitive Electrochemistry: Real-Time Electrografting

The ubiquity of graphitic materials in electrochemistry makes it highly desirable to probe their interfacial behavior under electrochemical control. Probing the dynamics of molecules at the electrode/electrolyte interface is possible through spectroelectrochemical approaches involving surface-enhanced infrared absorption spectroscopy (SEIRAS). Usually, this technique can only be done on plasmonic metals such as gold or carbon nanoribbons, but a more convenient substrate for carbon electrochemical studies is needed. Here, we expanded the scope of SEIRAS by introducing a robust hybrid graphene-on-gold substrate, where we monitored electrografting processes occurring at the graphene/electrolyte interface. These electrodes consist of graphene deposited onto a roughened gold-sputtered internal reflection element (IRE) for attenuated total reflectance (ATR) SEIRAS. The capabilities of the graphene-gold IRE were demonstrated by successfully monitoring the electrografting of 4-amino-2,2,6,6-tetramethyl-1-piperidine N -oxyl (4-amino-TEMPO) and 4-nitrobenzene diazonium (4-NBD) in real time. These grafts were characterized using cyclic voltammetry and ATR-SEIRAS, clearly showing the 1520 and 1350 cm –1 NO 2 stretches for 4-NBD and the 1240 cm –1 C–C, C–C–H, and N–Ȯ stretch for 4-amino-TEMPO. Successful grafts on graphene did not show the SEIRAS effect, while grafting on gold was not stable for TEMPO and had poorer resolution than on graphene-gold for 4-NBD, highlighting the uniqueness of our approach. The graphene-gold IRE is proficient at resolving the spectral responses of redox transformations, unambiguously demonstrating the real-time detection of surface processes on a graphitic electrode. This work provides ample future directions for real-time spectroelectrochemical investigations of carbon electrodes used for sensing, energy storage, electrocatalysis, and environmental applications.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Stimulated Raman Scattering Microscopy: Real-Time In-Situ Physical and Chemical Characterization of Reverse Osmosis Desalination Membrane Scaling

We introduce a stimulated Raman scattering (SRS) methodology designed for rapid, real-time, and in situ monitoring of RO membrane scaling adapted for bench-scale desalination flow cells. The methodology can provide new insights into membrane scaling dynamics by offering time-resolved reflection imaging of inorganic crystal growth, coupled with chemical identification from Raman spectral data. These capabilities allow for direct local measurement of the membrane surface area covered by different scalants as well as an approximation of the scalant volume using three-dimensional, integrated Raman intensity. The 2D and 3D SRS results obtained from CaSO 4 scaling experiments are compared to and are in reasonable agreement with those provided by confocal microscopy. The real-time physical and chemical characterization capabilities presented here could be extended to study combinations of inorganic, organic, and biological fouling. Overall, the SRS methodology represents an advancement in real-time sensing of membrane fouling that offers the potential for improved operation, lower cost, and more resilient RO membrane systems for sustainable water management.

42 ENGINEERING↗
DOE OSTI2021

Breaking Down the Computational Barriers to Real-Time Urban Flood Forecasting

Flooding impacts are on the rise globally, and concentrated in urban areas. Currently, there are no operational systems to forecast flooding at spatial resolutions that can facilitate emergency preparedness and response actions mitigating flood impacts. We present a framework for real-time flood modeling and uncertainty quantification that combines the physics of fluid motion with advances in probabilistic methods. The framework overcomes the prohibitive computational demands of high-fidelity modeling in real-time by using a probabilistic learning method relying on surrogate models that are trained prior to a flood event. This shifts the overwhelming burden of computation to the trivial problem of data storage, and enables forecasting of both flood hazard and its uncertainty at scales that are vital for time-critical decision-making before and during extreme events. The framework has the potential to improve flood prediction and analysis and can be extended to other hazard assessments requiring intense high-fidelity computations in real-time.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Insights Into Seismicity Associated With Flexibly Operating Enhanced Geothermal System From Real‐Time Distributed Acoustic Sensing

Enhanced Geothermal Systems (EGS) have the capacity to broaden the accessible resource pool for geothermal power generation. Traditionally viewed as a “baseload” resource, their flexible operation might also enable dispatchable load‐following generation and long‐term energy storage, aligning them with the evolving landscape of decarbonized electricity systems. However, increasing permeability and extracting energy during EGS operations can induce microseismic events; for many prior EGS efforts, some associated seismicity has been observed. While energetically beneficial, the flexibility of EGS operations prompts our inquiry into whether new types of operations will yield previously unseen seismicity patterns. We demonstrate the use of distributed acoustic sensing (DAS) with real‐time edge computing to monitor seismicity during a pilot test of a cyclically operated EGS facility at the Blue Mountain geothermal field. Our focus lies in uncovering seismicity insights from the real‐time microseismic catalog, particularly during load‐following dispatchability tests simulating flexible EGS operation. Here, we find that variations in pore pressure consistently correlate with seismicity, and that controlling pressure cycles during flexible operations appears to constrain microseismic activity during subsequent cycles. The spatio‐temporal evolution of microseismic clouds recorded during cyclic injection cycles fits diffusive models over our available observation period. Additionally, seismicity elevation lags behind pore pressure increases, likely due to pressure diffusion to the fracture system boundary. Through real‐time monitoring, we offer novel insights into seismicity associated with flexibly operating EGS. Our findings suggest that leveraging DAS and edge computing can inform EGS operations and help mitigate induced seismicity.

Chamarczuk, Michal [Rice Univ., Houston, TX (Unite↗
DOE OSTI2024

Learning nonlinear operators in latent spaces for real-time predictions of complex dynamics in physical systems

Abstract Predicting complex dynamics in physical applications governed by partial differential equations in real-time is nearly impossible with traditional numerical simulations due to high computational cost. Neural operators offer a solution by approximating mappings between infinite-dimensional Banach spaces, yet their performance degrades with system size and complexity. We propose an approach for learning neural operators in latent spaces, facilitating real-time predictions for highly nonlinear and multiscale systems on high-dimensional domains. Our method utilizes the deep operator network architecture on a low-dimensional latent space to efficiently approximate underlying operators. Demonstrations on material fracture, fluid flow prediction, and climate modeling highlight superior prediction accuracy and computational efficiency compared to existing methods. Notably, our approach enables approximating large-scale atmospheric flows with millions of degrees, enhancing weather and climate forecasts. Here we show that the proposed approach enables real-time predictions that can facilitate decision-making for a wide range of applications in science and engineering.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Hardware-accelerated inference for real-time gravitational-wave astronomy

The field of transient astronomy has seen a revolution with the first gravitational-wave detections and the arrival of multi-messenger observations they enabled. Transformed by the first detection of binary black hole and binary neutron star mergers, computational demands in gravitational-wave astronomy are expected to grow by at least a factor of two over the next five years as the global network of kilometer-scale interferometers are brought to design sensitivity. With the increase in detector sensitivity, real-time delivery of gravitational-wave alerts will become increasingly important as an enabler of multi-messenger followup. In this work, we report a novel implementation and deployment of deep learning inference for real-time gravitational-wave data denoising and astrophysical source identification. This is accomplished using a generic Inference-as-a-Service model that is capable of adapting to the future needs of gravitational-wave data analysis. Overall, our implementation allows seamless incorporation of hardware accelerators and also enables the use of commercial or private (dedicated) as-a-service computing. Based on our results, we propose a paradigm shift in low-latency and offline computing in gravitational-wave astronomy. Such a shift can address key challenges in peak-usage, scalability and reliability, and provide a data analysis platform particularly optimized for deep learning applications. The achieved sub-millisecond scale latency will also be relevant for any machine learning-based real-time control systems that may be invoked in the operation of near-future and next generation ground-based laser interferometers, as well as the front-end collection, distribution and processing of data from such instruments.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2020

MFRED, 10 second interval real and reactive power for groups of 390 US apartments of varying size and vintage

Abstract Building electricity is a major component of global energy use and its environmental impacts. Detailed data on residential electricity use have many interrelated research applications, from energy conservation to non-intrusive load monitoring, energy storage, integration of renewables, and electric vs. fossil-based heating. The dataset presented here, Multifamily Residential Electricity Dataset (MFRED), contains the electricity use of 390 apartments, ranging from studios to four-bedroom units. All apartments are located in the Northeastern United States (IECC-climate-zone 4 A), but differ in their heating/cooling system and construction year (early to late 20 th century). To adhere to privacy guidelines, data were averaged across 15 apartments each, based on annual electricity use. MFRED includes real and reactive power, at 10-second resolution, for January to December 2019 (246 million data points). The annual average real power per apartment is 343 W (3.27 W/m 2 of floor area), with strong variation between seasons and apartment size. Considering its large number of apartments, high time resolution, real and reactive power, and 12-month duration, MFRED is currently unique for the multifamily-sector.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Online real-time learning of dynamical systems from noisy streaming data

Abstract Recent advancements in sensing and communication facilitate obtaining high-frequency real-time data from various physical systems like power networks, climate systems, biological networks, etc. However, since the data are recorded by physical sensors, it is natural that the obtained data is corrupted by measurement noise. In this paper, we present a novel algorithm for online real-time learning of dynamical systems from noisy time-series data, which employs the Robust Koopman operator framework to mitigate the effect of measurement noise. The proposed algorithm has three main advantages: (a) it allows for online real-time monitoring of a dynamical system; (b) it obtains a linear representation of the underlying dynamical system, thus enabling the user to use linear systems theory for analysis and control of the system; (c) it is computationally fast and less intensive than the popular extended dynamic mode decomposition (EDMD) algorithm. We illustrate the efficiency of the proposed algorithm by applying it to identify the Van der Pol oscillator, the chaotic attractor of the Henon map, the IEEE 68 bus system, and a ring network of Van der Pol oscillators.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Coupling a recurrent neural network to SPAD TCSPC systems for real-time fluorescence lifetime imaging

Fluorescence lifetime imaging (FLI) has been receiving increased attention in recent years as a powerful diagnostic technique in biological and medical research. However, existing FLI systems often suffer from a tradeoff between processing speed, accuracy, and robustness. Inspired by the concept of Edge Artificial Intelligence (Edge AI), we propose a robust approach that enables fast FLI with no degradation of accuracy. This approach couples a recurrent neural network (RNN), which is trained to estimate the fluorescence lifetime directly from raw timestamps without building histograms, to SPAD TCSPC systems, thereby drastically reducing transfer data volumes and hardware resource utilization, and enabling real-time FLI acquisition. We train two variants of the RNN on a synthetic dataset and compare the results to those obtained using center-of-mass method (CMM) and least squares fitting (LS fitting). Results demonstrate that two RNN variants, gated recurrent unit (GRU) and long short-term memory (LSTM), are comparable to CMM and LS fitting in terms of accuracy, while outperforming them in the presence of background noise by a large margin. To explore the ultimate limits of the approach, we derive the Cramer-Rao lower bound of the measurement, showing that RNN yields lifetime estimations with near-optimal precision. To demonstrate real-time operation, we build a FLI microscope based on an existing SPAD TCSPC system comprising a 32 x 32 SPAD sensor named Piccolo. Four quantized GRU cores, capable of processing up to 4 million photons per second, are deployed on the Xilinx Kintex-7 FPGA that controls the Piccolo. Powered by the GRU, the FLI setup can retrieve real-time fluorescence lifetime images at up to 10 frames per second. The proposed FLI system is promising and ideally suited for biomedical applications, including biological imaging, biomedical diagnostics, and fluorescence-assisted surgery, etc.

47 OTHER INSTRUMENTATION↗