SEARCH · Search NASA

Results for “data reduction algorithms”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16

All sources NASA NTRS DOE OSTI

NASA NTRS2012

Designing Fault-Injection Experiments for the Reliability of Embedded Systems

This paper considers the long-standing problem of conducting fault-injections experiments to establish the ultra-reliability of embedded systems. There have been extensive efforts in fault injection, and this paper offers a partial summary of the efforts, but these previous efforts have focused on realism and efficiency. Fault injections have been used to examine diagnostics and to test algorithms, but the literature does not contain any framework that says how to conduct fault-injection experiments to establish ultra-reliability. A solution to this problem integrates field-data, arguments-from-design, and fault-injection into a seamless whole. The solution in this paper is to derive a model reduction theorem for a class of semi-Markov models suitable for describing ultra-reliable embedded systems. The derivation shows that a tight upper bound on the probability of system failure can be obtained using only the means of system-recovery times, thus reducing the experimental effort to estimating a reasonable number of easily-observed parameters. The paper includes an example of a system subject to both permanent and transient faults. There is a discussion of integrating fault-injection with field-data and arguments-from-design.

White, Allan L.↗

DOE OSTI2024

Sparsified time-dependent Fourier neural operators for fusion simulations

This paper presents a sparsified Fourier neural operator for coupled time-dependent partial differential equations (ST-FNO) as an efficient machine learning surrogate for fluid and particle-based fusion codes such as NIMROD (Non-Ideal Magnetohydrodynamics with Rotation - Open Discussion) and GTC (Gyrokinetic Toroidal Code). ST-FNO leverages the structures in the governing equations and utilizes neural operators to represent Green's function-like numerical operators in the corresponding numerical solvers. Once trained, ST-FNO can rapidly and accurately predict dynamics in fusion devices compared with first-principle numerical algorithms. In general, ST-FNO represents an efficient and accurate machine learning surrogate for numerical simulators for multi-variable nonlinear time-dependent partial differential equations, with the proposed architectures and loss functions. The efficacy of ST-FNO has been demonstrated using quiescent H-mode simulation data from NIMROD and kink-mode simulation data from GTC. The ST-FNO H-mode results show orders of magnitude reduction in memory and central processing unit usage in comparison with the numerical solvers in NIMROD when computing fields over a selected poloidal plane. The ST-FNO kink-mode results achieve a factor of 2 reduction in the number of parameters compared to baseline FNO models without accuracy loss.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

NASA NTRS1993

Effect of marine stratocumulus in TOMS ozone

The algorithm used to correct total O3 from the total ozone mapping spectrometer (TOMS) for cloud effects is based on the measured reflectivity, a climatological cloud top height, and an assumed tropospheric O3 column amount below clouds. In regions of persistent subtropical marine stratocumulus it is assumed that this introduces a positive error into total O3 because these clouds are lower than the assumed mean cloud height used in the algorithm. This appears to be confirmed by high correlation between Nimbus 7 TOMS total O3 and reflectivity data for typical regimes of persistent stratus, as identified by the international satellite cloud climatology project (ISCCP) observations. The TOMS total O3 overestimate has been computed using Nimbus 7/solar backscattered ultraviolet total O3 derived using temperature humidity infrared radiometer (THIR) data for years 1979-1984. A functional relationship between the THIR/non-THIR total O3 difference and reflectivity is used with TOMS reflectivity to modify Nimbus 7 TOMS O3 data for selected regions and periods. The correction diminishes or eliminates a number of apparent O3 maxima, with reductions of up to 20 Dobson units (DU) in total O3 on daily maps and approximately 5 DU on monthly mean O3 maps. Significant correlation between corrected TOMS O3 and reflectivity data remains because low-altitude O3 is retrieved more efficiently over a high-albedo surface. It is also possible that dynamical influences leading to stratocumulus formation bring O3-enriched air into the area. These results imply that although good arguments can be made for the use of TOMS total O3 as a proxy for tropospheric O3 in the tropics, caution must be exercised in the use of daily and even monthly O3 maps in the vicinity of clouds. Further research into the TOMS algorithm in cloudy regions is required to derive reliable estimates of tropospheric O3.

Thompson, A. M.↗

NASA NTRS1981

An algorithm to generate input data from meteorological and space shuttle observations to validate a CH4-CO model

Objective procedures to analyze data from meteorological and space shuttle observations to validate a three dimensional model were investigated. The transport and chemistry of carbon monoxide and methane in the troposphere were studied. Four aspects were examined: (1) detailed evaluation of the variational calculus procedure, with the equation of continuity as a strong constraint, for adjustment of global tropospheric wind fields; (2) reduction of the National Meteorological Center (NMC) data tapes for data input to the OSTA-1/MAPS Experiment; (3) interpolation of the NMC Data for input to the CH4-CO model; and (4) temporal and spatial interpolation procedures of the CO measurements from the OSTA-1/MAPS Experiment to generate usable contours of the data.

Peters, L. K.↗

NASA NTRS1979

A navigation algorithm for single channel low-cost GPS receiver

A sequential navigation algorithm for a navigator using the Global Positioning System satellites is developed and tested for both noise-free and noisy system models. Data from a six-hour flight from California to Hawaii (C5A aircraft) simulates a true user to test the accuracy of the user's position for a sequential navigation system. For error reduction in the user's position in the sequential navigation system (considering 100 m as a maximum average error tolerated by any low-cost GPS user) an analysis of error sources in the sequential system has led to the use of range-ephemeris rate to translate ranges to a common point in time and to use velocity aiding at the time of a satellite disappearance. To reduce the user's position and velocity errors in a noisy navigation system an 'alpha-beta' two-pole filter is implemented whose optimum alpha is obtained experimentally. A user's position error of 73 m at noise range error of 30.48 (1sigma) is achieved.

Parsiani, H.↗

NASA NTRS2022

Ten Years of VIIRS On-Orbit Geolocation Calibration and Performance

The first innovative Visible Infrared Imaging Radiometer Suite (VIIRS) sensor aboard the Suomi National Polar-orbiting Partnership (SNPP) satellite has been in operation for 10 years since its launch on 28 October 2011. The second VIIRS sensor aboard the first Join Polar Satellite System (JPSS-1) satellite has been in operation for 4 years since its launch on 18 November 2017, which became NOAA-20. Well-geolocated and radiometrically calibrated Level-1 sensor data records (SDRs) from VIIRS are crucial to numerical weather prediction (NWP) and Level-2+ environmental data record (EDR) algorithms and products. The high quality of Level-2+ EDRs is a requirement for the continuity of NASA Earth science data records (ESDRs) and climate data records (CDRs), one of the two objectives of the SNPP mission and one of the three elements in the JPSS mission objective. The other objective of the SNPP mission is risk reduction for the follow-on JPSS missions. This paper summarizes the on-orbit geolocation calibration and validation (Cal/Val) activities for both VIIRS sensors onboard SNPP and NOAA-20 in the past 10 years. These activities include nominal geolocation Cal/Val activities, risk reduction activities, and improvements for the on-orbit VIIRS sensor operations. After these activities, sub-pixel geolocation accuracy is achieved. Nadir equivalent geolocation uncertainty is generally within 75 m (1-σ), or 20% imagery band pixels, in either the along-scan or along-track direction for both SNPP and NOAA-20 VIIRS sensors. The worst 16-day measured geolocation errors (radial, 3-σ) are 280 m and 267 m, respectively, in the latest SNPP and NOAA-20 VIIRS data collections, which are better than the required accuracy of 375 m (radial, 3-σ). The risk reduction activities also improved VIIRS builds for JPSS-3 and JPSS-4 satellites, and provide lessons learned for other VIIRS-like sensor builds.

VIIRS↗

NASA NTRS1987

Speckle noise reduction of 1-look SAR imagery

Speckle noise is inherent to synthetic aperture radar (SAR) imagery. Since the degradation of the image due to this noise results in uncertainties in the interpretation of the scene and in a loss of apparent resolution, it is desirable to filter the image to reduce this noise. In this paper, an adaptive algorithm based on the calculation of the local statistics around a pixel is applied to 1-look SAR imagery. The filter adapts to the nonstationarity of the image statistics since the size of the blocks is very small compared to that of the image. The performance of the filter is measured in terms of the equivalent number of looks (ENL) of the filtered image and the resulting resolution degradation. The results are compared to those obtained from different techniques applied to similar data. The local adaptive filter (LAF) significantly increases the ENL of the final image. The associated loss of resolution is also lower than that for other commonly used speckle reduction techniques.

Nathan, Krishna S.↗

DOE OSTI2024

A Distributed Model Identification Algorithm for Multi-Agent Systems: Preprint

In this study, we investigate agent-based approach for system model identification with emphasis on power distribution system applications. Departing from conventional practices of relying on historical data for offline model identification, we adopt online update approach utilizing real-time data by employing the latest data points for gradient computation. This methodology offers advantages including a large reduction in the communication network's bandwidth requirements by minimizing the data exchanged at each iteration and enabling the model to adapt in real-time to disturbances. Furthermore, we extend our model identification process from linear frameworks to more complex non-linear convex models. This extension is validated through numerical studies demonstrating improved control performance for a synthetic IEEE test case.

data-driven control↗

NASA NTRS1985

Antenna pointing of large flexible telecommunications spacecraft

Attitude control problems for large flexible telecommunications spacecraft were investigated. A typical S/C configuration is described and modeled by modal data derived from a finite element analysis. The effect of structural flexibility on radio-frequency sensor is analyzed. Model reduction using modal gain considerations is applied. Two control concepts are investigated: separate central body and antenna pointing control using direct feedback laws, centralized control using modal observer and optimal control. Performances of each concept and the algorithm implementation are assessed.

Govin, B.↗

NASA NTRS2020

Cloud-top pressure retrieval with DSCOVR EPIC oxygen A- and B-band observations

An analytic transfer inverse model for Earth Polychromatic Imaging Camera (EPIC) observations is proposed to retrieve the cloud-top pressure (CTP) with the consideration of in-cloud photon penetration. In this model, an analytic equation was developed to represent the reflection at the top of the atmosphere from above cloud, in cloud, and below cloud. The coefficients of this analytic equation can be derived from a series of EPIC simulations under different atmospheric conditions using a nonlinear regression algorithm. With estimated cloud pressure thickness, the CTP can be retrieved from EPIC observation data by solving the analytic equation. To simulate the EPIC measurements, a program package using the double-k approach was developed. Compared to line-by-line calculation, this approach can calculate high-accuracy results with a 100-fold computation time reduction. During the retrieval processes, two kinds of retrieval results, i.e., baseline CTP and retrieved CTP, are provided. The baseline CTP is derived without considering in-cloud photon penetration, and the retrieved CTP is derived by solving the analytic equation, taking into consideration in-cloud and below-cloud interactions. The retrieved CTPs for the oxygen A and B bands are smaller than their related baseline CTP. At the same time, both baseline CTP and retrieved CTP at the oxygen B band are larger than those at the oxygen A band. Compared to the difference in baseline CTP between the B band and A band, the difference in retrieved CTP between these two bands is generally reduced. Out of around 10 000 cases, in retrieved CTP between the A and B bands we found an average bias of 93 mb with a standard deviation of 81 mb. The cloud layer top pressure from Cloud–Aerosol Lidar and Infrared Pathfinder Satellite Observations (CALIPSO) measurements is used for validation. Under single-layer cloud situations, the retrieved CTPs for the oxygen A band agree well with the CTPs from CALIPSO, the mean difference of which within 5 mb in the case study. Under multiple-layer cloud situations, the CTPs derived from EPIC measurements may be larger than the CTPs of high-level thin clouds due to the effect of photon penetration.

DSCOVR↗

DOE OSTI2024

Online randomized interpolative decomposition with a posteriori error estimator for temporal PDE data reduction

Traditional low-rank approximation is a powerful tool for compressing large data matrices that arise in simulations of partial differential equations (PDEs), but suffers from high computational cost and requires several passes over the PDE data. The compressed data may also lack interpretability thus making it difficult to identify feature patterns from the original data. Here, to address these issues, we present an online randomized algorithm to compute the interpolative decomposition (ID) of large-scale data matrices in situ. Compared to previous randomized IDs that used the QR decomposition to determine the column basis, we adopt a streaming ridge leverage score-based column subset selection algorithm that dynamically selects proper basis columns from the data and thus avoids an extra pass over the data to compute the coefficient matrix of the ID. In particular, we adopt a single-pass error estimator based on the non-adaptive Hutch++ algorithm to provide real-time error approximation for determining the best coefficients. As a result, our approach only needs a single pass over the original data and thus is suitable for large and high-dimensional matrices stored outside of core memory or generated in PDE simulations. A strategy to improve the accuracy of the reconstructed data gradient, when desired, within the ID framework is also presented. We provide numerical experiments on turbulent channel flow and ignition simulations, and on the NSTX Gas Puff Image dataset, comparing our algorithm with the offline ID algorithm to demonstrate its utility in real-world applications.

Column subset selection↗

DOE OSTI2025

Smart Meter Data: A Gateway for Reducing Solar Soft Costs with Model-Free Hosting Capacity Maps

Public-facing solar hosting capacity (HC) maps, which show the maximum amount of solar energy that can be installed at a location without adverse effects, have proven to be a key driver of solar soft cost reductions through a variety of pathways (e.g., streamlining interconnection, siting, and customer acquisition processes). However, current methods for generating HC maps require detailed grid models and time-consuming simulations that limit both their accuracy and scalability—today, only a handful out of almost 2,000 utilities provide these maps. This project developed and validated data-driven algorithms for calculating solar HC using data from AMI without the need of detailed grid models or simulations. The algorithms were validated on utility datasets and incorporated as an application into NRECA’s Open Modeling Framework (OMF.coop) for the over 260 coops and vendors throughout the US to use. The OMF is free and open-source for everyone.

14 SOLAR ENERGY↗

NASA NTRS2015

Use of a Closed-Loop Tracking Algorithm for Orientation Bias Determination of an S-Band Ground Station

The Space Communications and Navigation (SCaN) Testbed project completed installation and checkout testing of a new S-Band ground station at the NASA Glenn Research Center in Cleveland, Ohio in 2015. As with all ground stations, a key alignment process must be conducted to obtain offset angles in azimuth (AZ) and elevation (EL). In telescopes with AZ-EL gimbals, this is normally done with a two-star alignment process, where telescope-based pointing vectors are derived from catalogued locations with the AZ-EL bias angles derived from the pointing vector difference. For an antenna, the process is complicated without an optical asset. For the present study, the solution was to utilize the gimbal control algorithms closed-loop tracking capability to acquire the peak received power signal automatically from two distinct NASA Tracking and Data Relay Satellite (TDRS) spacecraft, without a human making the pointing adjustments. Briefly, the TDRS satellite acts as a simulated optical source and the alignment process proceeds exactly the same way as a one-star alignment. The data reduction process, which will be discussed in the paper, results in two bias angles which are retained for future pointing determination. Finally, the paper compares the test results and provides lessons learned from the activity.

ground station↗

NASA NTRS2015

Use of a Closed-Loop Tracking Algorithm for Orientation Bias Determination of an S-Band Ground Station

reflector antenna↗

DOE OSTI2025

Lossy Compression: An Online Multi-Stage Technology for High-Fidelity Synchro- Waveform Measurements

Effective real-time monitoring and analysis of distributed grids necessitate the use of synchro-waveform measurements, which capture almost all high-frequency disturbances and transient phenomena. However, due to limitations in high-speed measurements and network bandwidth, it is challenging to transfer all high-fidelity synchro-waveforms losslessly and successfully. To cope with these challenges, a hybrid-based online multi-stage compression algorithm is proposed to significantly improve the compression efficiency for synchro-waveform measurements. Initially, the multiple discrete Wavelet transformation is deployed to deconstruct the waveform components. The delta encoding is further developed to decrease the magnitude. In conjunction with the Lempel-Ziv-Markov chain, the hybrid compression algorithm is implemented to achieve real-time compression for the synchro-waveform measurements. Moreover, an innovative error index that synergizes the time and frequency domain error and correlation is formulated to evaluate the waveform distortion. By integrating compression ratio, suitable parameters can be optimally selected. Finally, the simulation, laboratory experiments, as well as field tests across a spectrum of sampling frequencies and time intervals are conducted to substantiate the efficacy of the proposed method. Here, the outcomes demonstrated that a compression ratio of approximately 15.5 and 17.83 can be reached for 0.5 s and 1 s data under both offline and online scenarios, which equates to a substantial 93.5% to 94.39% reduction in data storage requirements.

High-fidelity synchro-waveform measurements↗

DOE OSTI2024

Quantifying air quality co-benefits to industrial decarbonization: the local Air Emissions Tracking Atlas

Many decarbonization technologies have the added co-benefit of reducing short-lived climate pollutants, such as particulate matter (PM), nitrogen oxides (NO x ), and sulfur dioxide (SO 2 ), creating a unique opportunity for identifying strategies that promote both climate change solutions and opportunities for air quality improvement. However, stakeholders and decision-makers may struggle to quantify how these co-benefits will impact public health for the communities most affected by industrial air pollution. To address this problem, the LOCal Air Emissions Tracking Atlas (LOCAETA) fills a data availability and analysis gap by providing estimated air quality benefits from industrial decarbonization options, such as carbon capture and storage (CCS). These co-benefits are calculated using an algorithm that connects disparate datasets that separately report greenhouse gas emissions and other pollutants at U.S. industrial facilities. Version 1.0 of LOCAETA displays the estimated primary PM 2.5 emission reduction co-benefits from additional pretreatment equipment for CCS on industrial and power facilities across the state of Louisiana, as well as the potential for VOC and NH 3 generation. The emission reductions are presented in the tool alongside facility pollutant emissions information and relevant air quality, environmental, demographic, and public health datasets, such as air toxics cancer risk, satellite and in situ pollutant measurements, and population vulnerability metrics. LOCAETA enables regulators, policymakers, environmental justice communities, and industrial and commercial users to compare and contrast quantifiable public health benefits due to air quality impacts from various climate change mitigation strategies using a free and publicly-available tool. Additional pollutant reductions can be calculated using the same methodology and will be available in future versions of the tool.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

NASA NTRS1987

Extension and applications of flux-vector splitting to unsteady calculations on dynamic meshes

The Van Leer method of flux-vector splitting for the Euler equations is extended for use on moving meshes and all the properties of the original splittings are maintained. The solution is advanced in time with an implicit, approximately factored algorithm. The use of multiple grids to reduce the computer time is investigated. A substantial reduction in computer time to resolve a pitching cycle is easily obtained with virtually no loss in accuracy. A subiterative procedure to eliminate factorization and linearization errors so that larger time steps can be used is also investigated. Subsequent computations show good agreement with experimental data for transonic and supersonic airfoils and wings undergoing forced pitching oscillation.

Anderson, W. Kyle↗

NASA NTRS2020

150 Shades of Green: Using the Full Spectrum of Remote Sensing Reflectance to Elucidate Color Shifts in the Ocean

This article proposes a simple and intuitive classification system by which to define full spectral remote sensing reflectance (Rrs(λ)) data with a quantitative output that enables a more manageable handling of spectral information for aquatic science applications. The weighted harmonic mean of the Rrs(λ) wavelengths outputs an Apparent Visible Wavelength (in units of nanometers), representing a one-dimensional geophysical metric of color that is inherently correlated to spectral shape. This dimensionality reduction of spectral information combined with the output along a continuum of wavelength values offers a robust and user-friendly means to describe and analyze spectral Rrs(λ) in terms of spatial and temporal trends and variability. The uncertainty in the algorithm's estimation of spectral shape is demonstrated on a global scale, in addition to the utility of the algorithm to discern spectral-spatial-temporal trends in the ocean, on a per-pixel basis for the entire 22 year continuous ocean color (SeaWiFS and MODIS-Aqua) time-series. This technique can be applied to datasets of varying multi- and hyper-spectral resolutions, providing continuity between heritage and future satellite sensors, and further enabling an effective means of elucidating similarities or differences in complex spectral signatures within the constraints of two dimensions. This straightforward means of conceptualizing multi-dimensional variability can help maximize the potential of the spectral information embedded in remote sensing data.

ocean color↗