Search NASA⌕ Search

SEARCH · Search NASA

Results for “Filtering algorithms”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,513 records · Page 84
All sourcesNASA NTRSDOE OSTI
NASA NTRS2001

Demonstration of Imaging Fourier Transform Spectrometer (FTS) Performance for Planetary and Geostationary Earth Observing

The combination of massively parallel spatial sampling and accurate spectral radiometry offered by imaging FTS makes it extremely attractive for earth and planetary remote sensing. We constructed a breadboard instrument to help assess the potential for planetary applications of small imaging FTS instruments in the 1 - 5 micrometer range. The results also support definition of the NASA Geostationary Imaging FTS (GIFTS) instrument that will make key meteorological and climate observations from geostationary earth orbit. The Planetary Imaging FTS (PIFTS) breadboard is based on a custom miniaturized Bomen interferometer that uses corner cube reflectors, a wishbone pivoting voice-coil delay scan mechanism, and a laser diode metrology system. The interferometer optical output is measured by a commercial infrared camera procured from Santa Barbara Focalplane. It uses an InSb 128x128 detector array that covers the entire FOV of the instrument when coupled with a 25 mm focal length commercial camera lens. With appropriate lenses and cold filters the instrument can be used from the visible to 5 micrometers. The delay scan is continuous, but slow, covering the maximum range of +/- 0.4 cm in 37.56 sec at a rate of 500 image frames per second. Image exposures are timed to be centered around predicted zero crossings. The design allows for prediction algorithms that account for the most recent fringe rate so that timing jitter produced by scan speed variations can be minimized. Response to a fixed source is linear with exposure time nearly to the point of saturation. Linearity with respect to input variations was demonstrated to within 0.16% using a 3-point blackbody calibration. Imaging of external complex scenes was carried out at low and high spectral resolution. These require full complex calibration to remove background contributions that vary dramatically over the instrument FOV. Testing is continuing to demonstrate the precise radiometric accuracy and noise characteristics.

Revercomb, Henry E.↗
NASA NTRS2012

Improved Cloud and Snow Screening in MAIAC Aerosol Retrievals Using Spectral and Spatial Analysis

An improved cloud/snow screening technique in the Multi-Angle Implementation of Atmospheric Correction (MAIAC) algorithm is described. It is implemented as part of MAIAC aerosol retrievals based on analysis of spectral residuals and spatial variability. Comparisons with AERONET aerosol observations and a large-scale MODIS data analysis show strong suppression of aerosol optical thickness outliers due to unresolved clouds and snow. At the same time, the developed filter does not reduce the aerosol retrieval capability at high 1 km resolution in strongly inhomogeneous environments, such as near centers of the active fires. Despite significant improvement, the optical depth outliers in high spatial resolution data are and will remain the problem to be addressed by the application-dependent specialized filtering techniques.

Lyapustin, A.↗
DOE OSTI2021

Feasibility of DEIM for retrieving the initial field via dimensionality reduction

When parameter estimation is solved in a high-dimensional space, the dimensionality reduction strategy becomes the primary consideration for alleviating the tremendous computational cost. Here, the discrete empirical interpolation method (DEIM) is explored to retrieve the initial condition (IC) by combining the polynomial chaos (PC) based ensemble Kalman filter (i.e. PC-EnKF), where a non-intrusive PC expansion is considered as a surrogate model in place of the forward model in the prediction step of the ensemble Kalman filter, resulting in fewer forward model integrations but with a comparable accuracy as Monte Carlo-based approaches. The DEIM acts as a hyper-reduction tool to provide the low-dimensional input for the high-dimensional initial field, which can be reconstructed using the information on the sparse interpolation grid points that is adaptively obtained through PC-EnKF data assimilation method. Thus an innovative framework to reconstruct the IC is developed. The detailed procedure at each assimilation iteration includes: the determination of the spatial interpolation points, the estimation of the initial values on the interpolation locations using the optimal observations, and the reconstruction of IC in the full space. The current study uses the reconstruction field of initial conditions of the Navier-Stokes equations as an example to illustrate the efficacy of our method. The experimental results demonstrate the proposed algorithm achieves a satisfactory reconstruction for the initial field. The proposed method helps to extend the applicable area of DEIM in solving inverse problems.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2024

Multiple aspects maintenance ontology-based intelligent maintenance optimization framework for safety-critical systems

Abstract Maintenance optimization is a process for improving the efficiency of maintenance strategies and activities, considering various aspects of the target system and components, such as the probabilities of system failures and the cost of repair and replacement of a failed component. The improvement of maintenance optimization algorithms generally requires information from various data sources. For example, it may require the system risk information derived from risk analysis tools or the residual lifetime of a component from fault prognosis tools. The requirements of data acquisition (DAQ) and aggregation pose new challenges for maintenance management systems (MMSs) that implement and use these maintenance optimization algorithms. This paper proposes a multiple aspects maintenance ontology-based framework to facilitate DAQ from MMSs, online monitoring systems, fault detection and discrimination tools, risk assessment tools, decision-making tools, and component identification tools, and accelerate the implementation and verification of contemporary maintenance optimization models and algorithms. The proposed framework consists of a multi-aspect maintenance ontology with critical information for maintenance optimization and application interfaces for collecting information from various data sources, such as fault prognosis tools, online monitoring tools, risk assessment tools, and decision-making algorithms. In addition, this paper proposes a heuristic method for integrating concepts and properties from other existing ontologies into the proposed framework when the existing ontology is not fully compatible with the ontology under construction. Finally, the paper verifies the proposed ontology framework using a feedwater system designed for nuclear power plants with valves and filters as the components under maintenance.

Diao, Xiaoxu (ORCID:0000000346726352)↗
NASA NTRS1980

Source detection for the infrared astronomical satellite

A recursive algorithm is described which detects and characterizes point sources and extended sources in the data obtained from the Infrared Astronomical Satellite (IRAS) in the presence of non-stationary noise. The analysis of tests using simulated data indicates that the performance of the point source detector is very close to that expected from a matched filter with stationary gaussian noise. The false alarm rate of the extended source detector tends to be higher than expected at a given SNR.

Aumann, H. H.↗
NASA NTRSDate not supplied

Using the Diurnal Variability in GeoNEX TOA Reflectances for Earth Monitoring

Observations from the third-generation geostationary satellite instruments (GOES 16/17 ABI, Himawari 8/9 AHI, and etc.) have spatial resolution and spectral band configurations comparable to flagship LEO sensors (e.g., MODIS/VIIRS). More importantly, these data are acquired at very high temporal resolution, faithfully recording the variations of the full disk of Earth at every 5-10 minutes. They thus provide unique information about Earth’s atmosphere and surface. In order to explore the unique information content of geostationary data, this study systematically analyzes the diurnal variability in the GeoNEX L1G TOA reflectance products and compares them to simulated results by state-of-the-art radiative transfer codes. Our results show that • The smoothness of the TOA reflectance diurnal cycle provides a convenient and reliable way to identify stable atmospheric conditions and filter out passing clouds/shadows. • The diurnal variability of the blue band (0.47µm) reflectance is regulated mainly by atmospheric optical conditions over a majority of land cover types. As such, the diurnal variability of the blue band data allows us to retrieve AOD without invoking the use of spectral band ratios (SRC) as in previous algorithms. • In comparison, the diurnal variability of the short-wave infrared band (2.2µm) BRFs is mainly regulated by surface reflectance and the sun-target-satellite geometry. This information allows us to test and, if suitable, retrieve surface BRDF parameters. • Spectral band ratios, especially those between the 2.2µm and 0.47µm bands, are not constant but vary by locations and sun-target-satellite geometries. Our analysis clearly demonstrates that the information provided in high-frequent geostationary observations is unique and complementary to LEO sensors. Therefore, a synergy of GEO and LEO (and other) sensors has the great potential to improve existing remote sensing models and algorithms for better Earth monitoring.

Diurnal Variability↗
NASA NTRSDate not supplied

Lidar-Based Safe Site Relative Navigation

There has been a renewed focus in exploration of the lunar surface and maximizing scientific potential of such missions is made possible in part by minimizing the time required to set up operations; that is, reducing transit time on the surface by increasing the landing precision with respect to the intended target. Established SPLICE project precision landing requirements necessitate a navigation filter architecture and underlying models developed specifically with these needs in mind. To date, test flights to characterize SPLICE GNC system performance have not provided a means to divert from the a priori selected landing site due to hazardous conditions. With the inclusion of a new sensor, the HDL, coupled with safe landing site selection algorithms, GNC can divert from the originally planned trajectory and navigate relative to the new targeted landing site. This work presents a novel hazard relative measurement model and covariance transformation methodology that enable the navigation system to inform a safe-site relative guidance profile to meet project precision landing goals.

Navigation↗
DOE OSTI2025

Travelling wave‐based fault detection and location in a real low‐voltage DC microgrid

Abstract This paper discusses a device‐level implementation of a travelling wave (TW) protection device (PD) designed for a real low‐voltage DC microgrid. The TWPD fault detection and location algorithm is executed on a commercial digital signal processor (DSP) board, involving signal sampling at 1 MHz via the DSP board's analog‐to‐digital converter (ADC). The analogue input card measures positive pole, negative pole and pole‐to‐pole voltages at the TWPD location. Upon a successful fault detection using a second‐order high‐pass filter, the voltage data is normalised and multi‐resolution analysis (MRA) is performed on a 128‐sample buffer around the TW arrival time. MRA employs the discrete wavelet transform (DWT) to capture high‐frequency voltage patterns, and then the Parseval's energy theorem quantifies these TW characteristics by computing the energy of reconstructed wavelet coefficients. These energy values per decomposed frequency band are the basis for training a random forest classifier that predicts fault location and type. The TWPD is fully implemented and connected to a real DC microgrid in Albuquerque, NM, USA, for validation, and results are shown for field tests verifying the performance under faults.

Paruthiyil, Sajay Krishnan [Department of Electric↗
DOE OSTI2020

Multitask Recommender Systems for Cancer Drug Response

The problem we are currently trying to address is that there are many types of cancer drugs and many types of cancers and there is not always experimental data for a specific cancer type and cancer drug interaction. While there is a large possible set of feasible drug and cancer combinations, testing each pair is not realistic due to the high monetary cost of cell-based assays. Thus, this leaves researchers with a difficult choice of what drugs they should test on specific cancer types. This issue is known as the cold-start problem. Our focus is on developing recommender systems capable of addressing the cold-start problem as it relates to interaction between cancer types and cancer drugs. One of the most effective ways to address the cold-start problem is through large data analysis, however due to the cost prohibitive nature of cancer research the largest available data set size is the Genomics of Drug Sensitivity in Cancer with 494,973 genomic associations. To achieve optimal model performance on the cold-start problem, it is advantageous to employ multitask algorithms that are capable of transferring information between cancer datasets. The aim of this report is to draw from adaptations and state of the art developments in both algorithms for recommender systems and multitask learning to model the interaction between cancer cell lines and cancer drugs. Cancer cell lines are defined by the US National Cancer Institute as "cancer cells that keep dividing and growing over time, under certain conditions in a laboratory". This paper will focus on evaluating the performance of Neural Collaborative Filtering and Gaussian Processes, as well as their multitask adaptations, on cancer datasets from CCLE, NCI60, GDSC and CTRP. These methods will be evaluated on model performance in regression prediction but also in interpretability.

60 APPLIED LIFE SCIENCES↗
NASA NTRS1989

Per-point and per-field contextual classification of multipolarization and multiple incidence angle aircraft L-band radar data

Multipolarized aircraft L-band radar data are classified using two different image classification algorithms: (1) a per-point classifier, and (2) a contextual, or per-field, classifier. Due to the distinct variations in radar backscatter as a function of incidence angle, the data are stratified into three incidence-angle groupings, and training and test data are defined for each stratum. A low-pass digital mean filter with varied window size (i.e., 3x3, 5x5, and 7x7 pixels) is applied to the data prior to the classification. A predominately forested area in northern Florida was the study site. The results obtained by using these image classifiers are then presented and discussed.

Hoffer, Roger M.↗
NASA NTRS1991

A new technique for enlargement and reconstruction of digital sensor imagery

A new image enlargement and reconstruction routine, the digital image enlarging balanced reconstruction algorithm (DIEBRA), is described. Using a highly modified form of 'balanced' two-dimensional polynomial interpolation, this program enlarges digital imagery, creating synthetic high spatial resolution images. Statistical analysis shows the DIEBRA-generated imagery to be significantly closer to true high spatial resolution imagery at all frequencies than imagery generated by a cubic convolutional reconstruction filter.

Rhea, W. Joseph↗
NASA NTRS1992

More rain compensation results

To reduce the impact of rain-induced attenuation in the 20/30 GHz band, the attenuation at a specified signal frequency must be estimated and extrapolated forward in time on the basis of a noisy beacon measurement. Several studies have used model based procedures for solving this problem in statistical inference. Perhaps the most widely used model-based paradigm leads to the Kalman filter and its lineal variants. In this formulation, the dynamic features of the attenuation are represented by a state process (x(sub t)). The observation process (y(sub t)) is derived from beacon measurements. Some ideas relating to the signal processing problems related to uplink power control are presented. It is shown that some easily implemented algorithms hold promise for use in estimating rain induced fades. The algorithms were applied to actual data generated at the Virginia Polytechnic Institute and State University (VPI) test facility. Because only one such event was studied, it is not clear that the algorithms will have the same effectiveness when a wide range of events are studied.

Sworder, D. D.↗
NASA NTRS2008

Annular and Total Solar Eclipses of 2010

While most NASA eclipse bulletins cover a single eclipse, this publication presents predictions for two solar eclipses during 2010. This has required a different organization of the material into the following sections. Section 1 -- Eclipse Predictions: The section consists of a general discussion about the eclipse path maps, Besselian elements, shadow contacts, eclipse path tables, local circumstances tables, and the lunar limb profile. Section 2 -- Annular Solar Eclipse of 2010 Ja n 15: The section covers predictions and weather prospects for the annular eclipse. Section 3 -- Total Solar Eclipse of 2010 Jul 11: The se ction covers predictions and weather prospects for the total eclipse. Section 4 -- Observing Eclipses: The section provides information on eye safety, solar filters, eclipse photography, and making contact timings from the path limits. Section 5 -- Eclipse Resources: The final section contains a number of resources including information on the IAU Working Group on Eclipses, the Solar Eclipse Mailing List, the NASA eclipse bulletins on the Internet, Web sites for the two 2010 eclipses, and a summary identifying the algorithms, ephemerides, and paramete rs used in the eclipse predictions.

Espenak, Fred↗
DOE OSTI2023

Fast b -tagging at the high-level trigger of the ATLAS experiment in LHC Run 3

The ATLAS experiment relies on real-time hadronic jet reconstruction and b-tagging to record fully hadronic events containing b-jets. These algorithms require track reconstruction, which is computationally expensive and could overwhelm the high-level-trigger farm, even at the reduced event rate that passes the ATLAS first stage hardware-based trigger. In LHC Run 3, ATLAS has mitigated these computational demands by introducing a fast neural-network-based b-tagger, which acts as a low-precision filter using input from hadronic jets and tracks. It runs after a hardware trigger and before the remaining high-level-trigger reconstruction. This design relies on the negligible cost of neural-network inference as compared to track reconstruction, and the cost reduction from limiting tracking to specific regions of the detector. In the case of Standard Model HH → bb̅bb̅, a key signature relying on b-jet triggers, the filter lowers the input rate to the remaining high-level trigger by a factor of five at the small cost of reducing the overall signal efficiency by roughly 2%.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2025

Nonlinear Ensemble Filtering with Diffusion Models: Application to the Surface Quasigeostrophic Dynamics

The intersection between classical data assimilation methods and novel machine learning techniques has attracted significant interest in recent years. Here, we explore another promising solution in which diffusion models are used to formulate a robust nonlinear ensemble filter for sequential data assimilation. Unlike standard machine learning methods, the proposed ensemble score filter (EnSF) is completely training free and can efficiently generate a set of analysis ensemble members. Here, in this study, we apply the EnSF to a surface quasigeostrophic model and compare its performance against the popular local ensemble transform Kalman filter (LETKF), which makes Gaussian assumptions in the analysis step. Numerical tests demonstrate that EnSF maintains stable performance in the absence of localization and for a variety of experimental settings. We find that while LETKF maintains optimal performance in the case of linear observations of the entire state and a perfect model, EnSF shows improvements over LETKF when nonlinear observations are assimilated and the system is subject to unexpected model errors. A spectral decomposition of the analysis results in this nonlinear observation regime shows that the largest improvements over LETKF occur at large scales (small wavenumbers), where LETKF lacks sufficient ensemble spread. Overall, this initial application of EnSF to a geophysical model of intermediate complexity motivates further development of the algorithm for more realistic problems.

Artificial intelligence↗
DOE OSTI2022

Oak Ridge National Laboratory Pilot Demonstration of an Attestation and Anomaly Detection Framework using Distributed Ledger Technology for Power Grid Infrastructure

This report summarizes the design and pilot demonstration of a framework called Grid Guard that was created to provide increased data and device trustworthiness to electric grid devices by leveraging distributed ledger technology (DLT), specifically blockchain. Grid Guard contains a combination of core cryptographic methods such as the secure hash algorithm (SHA), and asymmetric cryptography, private permissioned blockchain, baselining configuration data, consensus algorithm (Raft) and the Hyperledger Fabric (HLF) framework. The system implements a low energy, fast, and robust enhancement to system trustworthiness within and across electric grid systems such as substations, control centers and metering infrastructures. Blockchain is a distributed database structured that provides a practically unalterable (immutable) timeline of stored transactions. By relying on hashing and the Raft consensus algorithm, if an entity tries to illegitimately alter a record at one instance of the database the other ledger nodes are not altered. They work to cross-reference each other and easily locate any incorrectly added data and remove it. The bulk raw data is stored in an off-chain storage (outside of the blockchain ledger) and a hash of this baseline data is stored in the Blockchain ledger via hashing windows of time-series and configuration data, after aggregation and filtering. The bulk off-chain data repository is then considered to be trust-anchored using the hashes stored in the blockchain. To secure the electric grid testbed devices and data, device configuration baselines were compared to those baselines that had been previously stored in the ledger. Statistical baselines for device configurations, network communication patterns, and high-speed sensor data are calculated and then stored off-chain and hashes stored in the ledger. Measurements such as three-phase voltage and current, frequency, breaker status, protection scheme settings, network configuration settings (and other device configuration artifacts) and network traffic features (packet interarrival times) are compared every minute or other selected time windows. During phase 1 of the Grid Guard DLT project different DLT technologies were studies, and an assessment was performed on DLT technology vulnerabilities, uses, and key characteristics. DLT consensus protocols were studies (e.g., RAFT, named after Reliable, Replicated, Redundant, And Fault-Tolerant). Also, cryptography, public, private and permissioned or permissionless systems were assessed. Grid Guard implements a permissioned private DLT. Consensus algorithm selection and choice of DLT implementation depended heavily on the use-case. For this use-case, parameters were selected to measure performance and existing tools for assessment. Benchmarking was performed theoretically and practically. During phase 2 hashed transactions/blocks were inserted into the ledger every second. During phase 2 of the Grid Guard DLT project, a prototype framework was developed and demonstrated for attestation of critical substation devices and data using precision timing systems that use PTP and IRIG-B protocols) on a testbed of operational devices that emulated a distribution substation, control center, and power metering infrastructure using real Operational Technology (OT). The testbed includes OT devices such as protective relays, human machine interfaces (HMI), and power meters. To determine when to collect and compare system and network baselines, an initial examination of an anomaly detection capability to identify malicious manipulation of data streams was conducted. The resulting anomaly detection was demonstrated in a set of experiments and leveraged to trigger device artifact attestation checks. Attestation checks occur against device configuration baselines when compared with the immutable blockchain-stored baselines, which provided a cryptographically supported means by which to store baselines. The electrical substation-grid testbed was created to test the Grid Guard framework. The testbed emulates the operations of a portion of a power grid and SCADA systems as closely as possible. The testbed integrates real protocols, mainly IEC 61850 standard protocols, such as the Sampled Value (SV) and the GOOSE protocols. The testbed also supports DNP3 and other layer 2 and layer 3 protocols such as Telnet, SSH, SFTP/FTP and other proprietary protocols needed to connect to industrial control system equipment. The testbed emulates real power conditions using the OpalRT hardware-in-the-loop (HIL) device which can create fault situations that cannot be easily tested on real systems. The electrical substation-grid testbed was created using real measurement, communication, and protection devices that electrical utilities commonly use.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2020

Finite spatial-grid effects in energy-conserving particle-in-cell algorithms

Finite-grid (or aliasing) instabilities are pervasive in particle-in-cell (PIC) plasma simulation algorithms, and force the modeler to resolve the smallest (Debye) length scale in the problem regardless of dynamical relevance. These instabilities originate in the aliasing of interpolation errors between mesh quantities and particles (which live in the space–time continuum). Recently, strictly energy-conserving PIC (EC-PIC) algorithms have been developed that promise enhanced robustness against aliasing instabilities. In this study, we confirm by analysis that EC-PIC is stable against aliasing instabilities for stationary plasmas. For drifting plasmas, we demonstrate by analysis and numerical experiments that, while EC-PIC algorithms are not free from these instabilities in principle, they feature a benign stability threshold for finite-temperature plasmas that make them usable in practice for a large class of problems (featuring ambipolarity and realistic ion-electron mass ratios) without the need to consider the size of the Debye length. We also demonstrate that this threshold is absent for the popular momentum-conserving PIC algorithms, which are therefore unstable for both drifting and stationary plasmas beyond a threshold in cell size compared to Debye length. Finite-grid (or aliasing) instabilities are pervasive in particle-in-cell (PIC) plasma simulation algorithms, and force the modeler to resolve the smallest (Debye) length scale in the problem regardless of dynamical relevance. These instabilities originate in the aliasing of interpolation errors between mesh quantities and particles (which live in the space–time continuum). Recently, strictly energy-conserving PIC (EC-PIC) algorithms have been developed that promise enhanced robustness against aliasing instabilities. In this study, we confirm by analysis that EC-PIC is stable against aliasing instabilities for stationary plasmas. For drifting plasmas, we demonstrate by analysis and numerical experiments that, while EC-PIC algorithms are not free from these instabilities in principle, they feature a benign stability threshold for finite-temperature plasmas that make them usable in practice for a large class of problems (featuring ambipolarity and realistic ion-electron mass ratios) without the need to consider the size of the Debye length. Finally, we also demonstrate that this threshold is absent for the popular momentum-conserving PIC algorithms, which are therefore unstable for both drifting and stationary plasmas beyond a threshold in cell size compared to Debye length.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

NREL ASSIST Rhode Island / Thermodynamic retrievals TROPoe

This dataset contains daily files with thermodynamic profiles retrieved with the optimal estimation physical retrieval TROPoe (Turner and Löhnert 2014; Turner and Blumberg 2019; Turner and Löhnert 2021). The profiles are retrieved every 10 minutes from instantaneous observations from the NREL ASSIST-II (SN 11) infrared spectrometer. Observations are noise-filtered but not averaged in time to minimize errors due to non-uniform clouds. Additional input data in TROPoe are cloud base height from a collocated NREL Upgraded Galion lidar #1212-60 and temperature, RH, and pressure from collocated PNNL met station. The lidar beta is used to estimate the cloud base height through a modified algorithm by Newsom et al., 2019 used at ARM SGP. The full pipeline for running the retrieval is available at https://github.com/StefanoWind/TROPoe_processor. In addition to these temporally resolved input data, TROPoe requires an a priori dataset (prior) which provides mean climatological estimates of thermodynamic profiles and specifies how temperature and humidity covary with height as an input (for details see e.g. Djalalova et al. 2022). The prior is a key component of the retrieval and provides a constraint on the ill-posed inversion problem. A monthly prior was computed from operational radiosonde launches at Upton, NY.

17 WIND ENERGY↗