SEARCH · Search NASA

Results for “data filter mathematical model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

85 records · Page 5

All sources NASA NTRS DOE OSTI

DOE OSTI2025

Benchmark Tracking System for Performance Monitoring

Benchmarking is essential for high-performance software development, particularly for monitoring performance across code iterations. This project focused on enhancing the benchmarking process for Lamellar, an asynchronous runtime for High-Performance Computing (HPC) systems developed at Pacific Northwest National Laboratory. Prior to this work, benchmark results were difficult to track and compare across code versions, presenting significant challenges in identifying performance regressions and long-term trends. The primary objective was to establish a systematic, reproducible approach for measuring performance and detecting regressions following code commits. Our methodology involved three key components: standardizing benchmark outputs, implementing data versioning, and developing analysis tools. We standardized the benchmark output format to JSON Line records containing specific fields (execution time, hardware specifications, and environmental variables). To address data management challenges, we evaluated several options and eventually chose a git repository dedicated to benchmark data. We developed a suite of Python tools that processed benchmark results, enriched them with metadata, and facilitated search in the repository. The resulting system enables more efficient filtering and comparison of performance metrics across commit histories, hardware configurations, and benchmark variants through a unified query interface. Our implementation reduces computational overhead by first checking for existing results through configuration matching before initiating new benchmark runs, thereby conserving resources. The system has been validated by Lamellar developers. It organizes results by benchmark type and build configurations for efficient retrieval. Future developments include a planned Large Language Model interface for predicting benchmark performance, incorporating the criterion package for statistical analysis, which will enable automated detection of statistically significant performance changes, and integration with continuous integration pipelines. Despite these enhancements being reserved for future work, this project has successfully provided the Lamellar development team with a framework for maintaining consistent performance standards and identifying optimization opportunities across workloads and hardware environments.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2026

Robustness of the Ensemble Score Filter to the Type of Assimilated Observation Networks

Recent advances in data assimilation (DA) have focused on developing more flexible approaches that can better accommodate nonlinearities in models and observations. However, it remains unclear how the performance of these advanced methods depends on the observation network characteristics. In this study, we present initial experiments with the surface quasi‐geostrophic model, in which we compare a recently developed ensemble filter using score‐based diffusion models with the standard Local Ensemble Transform Kalman Filter (LETKF). Our results show that the analysis solutions respond differently to the number, spatial distribution, and nonlinear fraction of assimilated observations. We also find notable changes in the multiscale characteristics of the analysis errors. Given that standard DA techniques will eventually be replaced by more advanced methods, we hope this study sets the ground for future efforts to reassess the value of Earth observing systems in the context of newly emerging algorithms.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2025

Performance evaluation of automated data-driven feature extraction and selection methods for practical and scalable building energy consumption prediction models

Here, this study quantifies the impact of automated feature engineering methods (feature extraction and selection) on the quality and accuracy of machine learning models that predict building energy consumption. The case study compares model performance for three main scenarios: baseline (no feature extraction and selection), feature extraction only, and feature extraction combined with feature selection (filter and/or wrapper methods) for fully trained machine learning models for 200 metered/sub-metered energy measurements across 118 real buildings. For consistency, the same machine learning model architecture (a black box deep learning neural network with probabilistic forecast output) was used for all scenarios. Based on results, all feature engineering methods provided noticeable prediction accuracy improvements (e.g., 29%-68% median prediction improvement) compared to baseline scenarios. However, in this application, feature selection methods provide little practical value due to their limited performance gains and high computational cost. Smarter algorithm development supported by better computational environments will be needed before feature selection methods can reliably and efficiently improve predictive model performance.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2025

Natural Hazard Forecast Alert Grid Risk System

Weather events cause most power outages. Often, we even get notifications on our phones to take cover or be prepared for an imminent event. If electric grid utilities had a similar warning that also included probable scenarios and the equipment involved, they could prepare and minimize the effects. Idaho National Laboratory had a project with the U.S. Department of Energy’s Cybersecurity, Energy Security, and Emergency Response program to develop a grid alert application that receives messages from the existing emergency alert system, filters and determines components possibly affected by the emergency event, calculates probable scenarios using MASTERRI (Modeling And Simulation for Targeted Reliability and Resilience Improvement). For high-risk events, the application can then send alert links to subscribed electric distribution utility operations staff to allow them to see and evaluate the scenarios and the impact in a web based interactive map tool. This proof of concept application used data from utilities and organizations, such as the international regulatory body North American Electric Reliability Corporation, which have complied historical failure data of elements that comprise the U.S. electric grid. Nominal failure rates are obtained from this data. To make this tool possible, estimated failure rates were calculated for different component types given the alert type, severity, and location. Historic weather-related grid element failures were correlated with historic weather events from the Integrated Public Alert & Warning System. These correlated events and failures are used along with Bayesian updates from the historical norms to provide a modified failure rate for grid elements in the alert areas and calculate probable scenarios. Working with an industry collaborator, actual grid models and data were used for demonstration cases. This report outlines the work performed for this project.

24 - POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2025

A Model Based Approach to Extract Health Information from Textual Data

In current nuclear power plants (NPPs) a large amount of condition-based data is being generated and stored to assess and monitor component health and performance. The format of this data can be either numeric (e.g., pump vibration data) or textual (e.g., condition report which assess component health). While assessing component health from numeric data can be performed with a large variety of methods, the extraction of information from textual data still remains a challenge. Natural language processing (NLP) methods are starting to be deployed in current NPPs mainly to filter out incident reports (IRs) that are not safety related by employing supervised machine learning methods. However, these methods do not really provide the quantitative information that might be contained in IRs. This paper presents an approach to extract information from textual data (e.g., from IRs, maintenance reports) that is based on NLP data analytics methods coupled with model-based system engineer (MBSE) models. NLP methods are employed to perform syntactic and semantic analyses. Syntactic analysis analyzes the grammatical structure of a sentence; such analysis includes: part of speech (POS) tagging (i.e., identification of grammatic elements of each string - e.g., nouns, verbs), named entity recognition (i.e., identification of text entities - e.g., names, dates, events), and relation extraction (e.g., coreference resolution). On the other hand, semantic analysis is designed to analyze the logic structure of a sentence. Through a specific set of rules, our methods can identify whether a sentence contains health information of a component (e.g., degraded performance, anomaly behavior) or the causal relationship between two events (i.e., a cause-effect pair). An innovative element of our approach is that semantic analysis relies on MBSE models to identify links between textual elements. MBSE are diagrams designed to represent system and component dependencies (from both a form and functional point of view). In our approach, MBSE models emulate system engineer knowledge about component/system architecture. This paper presents in detail how the integration of NLP methods and MBSE models is performed. Few analysis examples focusing on centrifugal pumps are presented.

97 - MATHEMATICS AND COMPUTING↗

DOE OSTI2024

PV Performance Modeling and Stakeholder Engagement (Final Technical Report)

This core capability project’s objective is to increase the value of photovoltaic (PV) performance models by improving their functionality, demonstrating, and quantifying their validity, and offering a wide range of stakeholder engagement opportunities. In FY22-24, we developed new and improved modeling algorithms and functions to represent PV performance more accurately in a variety of environments and conditions. The “Model parameter toolkit” was developed and includes functions to translate between different module temperature models, incidence angle modifier models, and single-diode models. A new modeling capability named “PV Atlas” was also developed leveraging Sandia’s High Performance Computing resources. This capability allows us to investigate several questions and provide climate-specific best practices and geographic data files; all these are hosted on an interactive website on Sandia’s GitHub and can be used for training, system optimization, or to provide best practices for uncertainty reduction. For model validation, we published high-quality PV performance, and weather data; these data are well documented, filtered, and processed for quality and include examples on how to run PV simulations. We also developed well documented, standardized methods for validating PV models and ran independent model validation and 2 blind modeling intercomparisons engaging with 49 organizations from 17 countries. We co-led and contributed to a growing, well documented and maintained suite of open-source functions for PV modeling (i.e., the pvlib-python) and we outreached to the PV modeling stakeholders via the PVPMC workshops and web resources. In addition, this project supported US representation and leadership for the International Energy Agency (IEA) PVPS Task 13; specifically, members of our team led and supported 3 subtasks on: 1) Best practices for the optimization of bifacial photovoltaic tracking, 2) Extreme weather events and their multiple impact on PV power plants: Risks, failure mechanisms and mitigation strategies, and 3) Best practice guidelines for the use of economic and technical Key Performance Indicators (KPIs). This project resulted in the publications of 14 peer reviewed journal papers, 37 conference presentations, 6 SAND reports, 5 public datasets and 6 new webpages on the PVPMC website. It supported the release of 13 pvlib-python versions where 28 enhancements were from this PV Performance Modeling project. We co-organized 5 PVPMC workshops in FY22-24 with the participation of 214 unique institutions and around 700 participants. The PVPMC website was redesigned, and its reliability was improved; it receives over 50,000 visitors/year from 202 unique countries.

14 SOLAR ENERGY↗

DOE OSTI2025

Preserving nonlinear constraints in variational flow filtering data assimilation

Data assimilation aims to estimate the states of a dynamical system by optimally combining sparse and noisy observations of the physical system with uncertain forecasts produced by a computational model. The states of many dynamical systems of interest obey nonlinear physical constraints, and the corresponding dynamics is confined to a certain sub-manifold of the state space. Standard data assimilation techniques applied to such systems yield posterior states lying outside the manifold, violating the physical constraints. This work focuses on particle flow filters which use stochastic differential equations to evolve state samples from a prior distribution to samples from an observation-informed posterior distribution. The variational Fokker-Planck (VFP)—a generic particle flow filtering framework—is extended to incorporate non-linear, equality state constraints in the analysis. To this end, two algorithmic approaches that modify the VFP stochastic differential equation are discussed: (i) VFPSTAB, to inexactly preserve constraints with the addition of a stabilizing drift term, and (ii) VFPDAE, to exactly preserve constraints by treating the VFP dynamics as a stochastic differential-algebraic equation (SDAE). Additionally, an implicit-explicit time integrator is developed to evolve the VFPDAE dynamics. The strength of the proposed approach for constraint preservation in data assimilation is demonstrated on three test problems: the double pendulum, Korteweg-de-Vries, and the incompressible Navier-Stokes equations.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2024

Data-driven closure modeling for hypersonic turbulent flows

The Reynolds-averaged Navier–Stokes (RANS) equations remain a workhorse technology for simulating compressible fluid flows of practical interest. Due to model-form errors, however, RANS models can yield erroneous predictions that preclude their use on mission-critical problems. This report summarizes work performed from FY22-FY24 focused on improving RANS models for hypersonic flows using data-driven modeling and scientific machine learning. In this work we: 1. Investigate the current capabilities of RANS models in Sandia’s parallel aerodynamics and re-entry code (SPARC) for hypersonic flows with a focus on shock boundary layer interactions (SBLIs), 2. Assess several established corrections that exist in the literature aimed at improving predictions for SBLIs, 3. Develop improved models for the Reynolds stress tensor using tensor-basis neural networks, 4. Develop a neural-network-based variable turbulent Prandtl number model to reduce errors in wall heating in SBLIs. 5. Begin future investigations including employing the LIFE framework to improve wall heating predictions in SBLIs as well as the ensemble Kalman filter. We find that current RANS models in SPARC are deficient for complex SBLI flows. In particular, no current model jointly predicts wall heat flux, wall shear stress, and wall pressure with reasonable accuracy. Existing corrections help, but do not alleviate this issue altogether. The development of improved models for the Reynolds stress tensor via tensor-basis neural networks results in more predictive RANS models across a suite of low-speed and high-speed cases. For hypersonic boundary layers, the inclusion of the wall-normal Reynolds stress via TBNNs has an appreciable impact on the wall-normal momentum balance and wall quantities. However, we find that improvements to the Reynolds stress tensor do not address the over-prediction in wall heat flux in SBLIs. We find that a neural-network-based variable turbulent Prandtl number model systematically and substantially improves wall heating predictions for a range of SBLI cases.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2025

Interacting dark sector within ETHOS: Cosmological constraints from SPT cluster abundance with DES and HST weak lensing data

We use galaxy cluster abundance measurements from the South Pole Telescope enhanced by multicomponent matched filter confirmation and complemented with mass information obtained using weak-lensing data from Dark Energy Survey Year 3 (DES Y3) and targeted Hubble Space Telescope observations for probing deviations from the cold dark matter paradigm. Concretely, we consider a class of dark sector models featuring interactions between dark matter (DM) and a dark radiation (DR) component within the framework of the effective theory of structure formation (ETHOS). We focus on scenarios that lead to power suppression over a wide range of scales, and thus can be tested with data sensitive to large scales, as realized, for example, for DM–DR interactions following from an unbroken non-Abelian 𝑆⁢𝑈⁡(𝑁) gauge theory (interaction rate with power-law index 𝑛 = 0 within the ETHOS parametrization). Cluster abundance measurements are mostly sensitive to the amount of DR interacting with DM, parametrized by the ratio of DR temperature to the cosmic microwave background (CMB) temperature, 𝜉 DR = 𝑇 DR /𝑇 CMB . We find an upper limit 𝜉 DR < 17% at 95% credibility. When the cluster data are combined with Planck 2018 CMB data along with baryon acoustic oscillation (BAO) measurements we find 𝜉 DR < 10%, corresponding to a limit on the abundance of interacting DR that is around 3 times tighter than that from CMB + BAO data alone. We also discuss the complementarity of weak lensing informed cluster abundance studies with probes sensitive to smaller scales, explore the impact on our analysis of massive neutrinos, and comment on a slight preference for the presence of a nonzero interacting DR abundance, which enables a physical solution to the 𝑆 8 tension.

79 ASTRONOMY AND ASTROPHYSICS↗

NASA NTRS1996

A matched filter method for ground-based sub-noise detection of terrestrial extrasolar planets in eclipsing binaries: application to CM Draconis

The photometric detection of extrasolar planets by transits in eclipsing binary systems can be significantly improved by cross-correlating the observational light curves with synthetic models of possible planetary transit features, essentially a matched filter approach. We demonstrate the utility and application of this transit detection algorithm for ground-based detections of terrestrial-sized (Earth-to-Neptune radii) extrasolar planets in the dwarf M-star eclipsing binary system CM Draconis. Preliminary photometric observational data of this system demonstrate that the observational noise is well characterized as white and Gaussian at the observational time steps required for precision photometric measurements. Depending on planet formation scenarios, terrestrial-sized planets may form quite close to this low-luminosity system. We demonstrate, for example, that planets as small as 1.4 Earth radii with periods on the order of a few months in the CM Draconis system could be detected at the 99.9% confidence level in less than a year using 1-m class telescopes from the ground. This result contradicts commonly held assumptions limiting present ground-based efforts to, at best, detections of gas giant planets after several years of observation. This method can be readily extended to a number of other larger star systems with the utilization of larger telescopes and longer observing times. Its extension to spacecraft observations should also allow the determination of the presence of terrestrial-sized planets in nearly 100 other known eclipsing binary systems.

NASA Discipline Number 52-10↗

DOE OSTI2026

Ensemble Kalman filter for data assimilation coupled with low-resolution computations techniques applied in fluid dynamics

This paper presents an innovative Reduced-order model (ROM) for merging experimental and simulation data using data assimilation (DA) to estimate the "True" state of a fluid dynamics system, leading to more accurate predictions. Our methodology introduces a novel approach by implementing the ensemble Kalman filter (EnKF) within a reduced-dimensional framework, grounded in a robust theoretical foundation and applied to fluid dynamics. To address the substantial computational demands of DA, the proposed ROM employs low-resolution (LR) techniques to drastically reduce computational costs. This innovative approach involves downsampling datasets for DA computations, followed by an advanced reconstruction technique based on low-cost singular value decomposition (lcSVD). The lcSVD method, a key innovation in this paper, has never been applied to DA before and offers a highly efficient way to enhance resolution with minimal computational resources. Our results demonstrate significant reductions in both computation time and RAM usage through these LR techniques without compromising the accuracy of the estimations. For instance, in a turbulent test case, for a data compression rate of 15.9, the LR approach can achieve a speed-up of 13.7 and a RAM compression of 90.9% while maintaining a low relative root mean square error (RRMSE) of 2.6%, compared to 0.8% in the high-resolution (HR) reference. Furthermore, we highlight the effectiveness of the EnKF in estimating and predicting the state of fluid flow systems based on limited observations and given low-fidelity numerical data. This paper highlights the potential of the proposed DA method in fluid dynamics applications, particularly for improving computational efficiency in CFD and related fields. Its ability to balance accuracy with low computational and memory costs makes it especially suitable for large-scale and real-time applications, such as environmental monitoring or engineering design. This method will be incorporated into ModelFLOWs-app.

Data Assimilation↗

DOE OSTI2026

SuperLab 2.0 Showcase: Connecting Five Labs to Tackle Grid Complexity and Unlock Unique Grid Asset Potential

SuperLab 2.0 (5-Lab Demo) is a collaborative, national-scale experiment showcasing the coordination of geographically distributed energy assets in real time. The demonstration integrates 25 physical and digital assets, spanning wind, PV, batteries, electrolyzers, DC fast chargers, microgrid controllers, building automation systems, small modular reactor (SMR), control centers, and gas turbines, across five DOE national laboratories-NLR, INL, NETL, LBNL, and SNL. These assets are unified using Energy Sciences Network (ESnet), a low-latency, high-performance U.S. Department of Energy's (DOE) network, and controlled via a centralized energy controller hosted at NLR's ARIES facility. The demonstration validates the ability to stress-test hybrid energy systems under dynamic scenarios to de-risk advanced control strategies for greater resilience and flexibility. SuperLab 2.0 (5-Lab Demo) showcased a major advancement in federated national laboratory collaboration, enabling real-time, cross-laboratory experimentation to coordinate geographically dispersed distributed energy resources (DERs) using various communication protocols and networks. SuperLab 2.0 (5-Lab Demo) built on previous demonstrations conducted between NLR-PNNL and NLR-INL connecting diverse assets including distant protection devices, a SMR simulator, and a high temperature electrolyzer (HTE). Previous demos were based on a single connection between two labs with minimal coordination challenges. The 5-Lab demo with a centralized controller, distributed testbeds across different geographical locations, and use of protocols-based communication represents a scenario closer to real-world grid operations that coordinate resources across a region to meet system needs. This experiment studied how local DER controllers interact with a centralized energy controller during normal and abnormal events to maintain reliability. The SuperLab team across the five labs implemented a notional power system model equivalent of transmission and distribution lines, represented by the data networks interconnecting the labs. Each lab continuously exchanged local parameters (such as P and Q) from its Hardware-In-Loop (CHIL) and Power Hardware-In-Loop (PHIL) assets through centralized energy controller at NLR, enabling real-time interaction and coordination across sites. By leveraging ESnet as the communication backbone, the team successfully operated the distributed assets as a unified power system, with each bus represented by a different laboratory. This setup mirrors how assets interact in real-world power systems across dispersed locations with various protocols and latencies. At each lab site, assets were operated using their own local controllers which were coordinated through an overarching operation and control layer of centralized energy controller, equivalent to how an energy management system (EMS) orchestrates assets across a regional or national grid. SuperLab's federated connectivity utilized a Digital Real-Time Simulators (DRTS)-type gateway to connect Controller Hardware-In-Loop (CHIL) and PHIL assets between labs. To enable this federated connection through ESnet, a deterministic network was established where latency variations were consistent. This consistency allowed the development of digital filters for the power system assets across CHIL and PHIL interfaces to avoid unstable and unreliable grid conditions. This report provides an overview of the cross-laboratory configuration and offers insights into interconnecting geographically distributed research assets to test them as if they were co-located. This experiment represents a step toward linking nine DOE national laboratories, enabling nation-wide simulations that can address utility-driven challenges with grid resilience, flexibility, and modernization.

24 POWER TRANSMISSION AND DISTRIBUTION↗

NASA NTRS1999

The Effects of Partial Mechanical Loading and Ibandronate on Skeletal Tissues in the Adult Rat Hindquarter Suspension Model for Microgravity

We report initial data from a suspended rat model that quantitatively relates chronic partial weightbearing to bone loss. Chronic partial weightbearing is our simulation of the effect of limited artificial gravity aboard spacecraft or reduced planetary gravity. Preliminary analysis of bone by PQCT, histomorphometry, mechanical testing and biochemistry suggest that chronic exposure to half of Earth gravity is insufficient to prevent severe bone loss. The effect of episodic full weightbearing activity (Earth Gravity) on rats otherwise at 50% weightbearing was also explored. This has similarity to treatment by an Earth G-rated centrifuge on a spacecraft that normally maintained artificial gravity at half of Earth G. Our preliminary evidence, using the above techniques to analyze bone, indicate that 2 hours daily of full weightbearing was insufficient to prevent the bone loss observed in 50% weightbearing animals. The effectiveness of partial weightbearing and episodic full weightbearing as potential countermeasures to bone loss in spaceflight was compared with treatment by ibandronate. Ibandronate, a long-acting potent bisphosphonate proved more effective in preventing bone loss and associated functionality based upon structure than our first efforts at mechanical countermeasures. The effectiveness of ibandronate was notable by each of the testing methods we used to study bone from gross structure and strength to tissue and biochemistry. These results appear to be independent of generalized systemic stress imposed by the suspension paradigm. Preliminary evidence does not suggest that blood levels of vitamin D were affected by our countermeasures. Despite the modest theraputic benefit of mechanical countermeasures of partial weightbearing and episodic full weightbearing, we know that some appropriate mechanical signal maintains bone mass in Earth gravity. Moreover, the only mechanism that correctly assigns bone mass and strength to oppose regionally specific force applied to bone is mechanical, a process based upon bone strain. Substantial evidence indicates that the specifics of dynamic loading i.e. time-varying forces are critical. Bone strain history is a predictor of the effect that mechanical conditions have on bone structure mass and strength. Using servo-controlled force plates on suspended rats with implanted strain gauges we manipulated impact forces of ambulation in the frequency (Fourier) domain. Our results indicate that high frequency components of impact forces are particularly potent in producing bone strain independent of the magnitude of the peak force or peak energy applied to the leg. Because a servo-system responds to forces produced by the rat's own muscle activity during ambulation, the direction of ground-reaction loads act on bone through the rat's own musculature. This is in distinction to passive vibration of the floor where forces reach bone through the natural filters of soft tissue and joints. Passive vibration may also be effective, but it may or may not increase bone in the appropriate architectural pattern to oppose the forces of normal ambulatory activity. Effectiveness of high frequency mechanical stimulation in producing regional (muscle directed) bone response will be limited by 1. the sensitivity of bone to a particular range of frequencies and 2. the inertia of the muscles, limiting their response to external forces by increasing tension along insertions. We have begun mathematical modeling of normal ambulatory activity. Effectiveness of high frequency mechanical stimulation in producing regional (muscle directed) bone response will be limited by 1. the sensitivity of bone to a particular range of frequencies and 2. the inertia of the muscles, limiting their response to external forces by increasing tension along insertions. We have begun mathematical modeling of the rat forelimb as a transfer function between impact force and bone strain to predict optimal dynamic loading conditions for this system. We plan additional studies of mechanical counter-measures that incorporate improved dynamic loading, features relevant to anticipated evaluation of artificial gravity, exercise regimens and exposure to Martian gravity, The combination of mechanical countermeasures with ibandronate will also be investigated for signs of synergy.

Schultheis, Lester W.↗