Search NASA⌕ Search

SEARCH · Search NASA

Results for “data reduction algorithms”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 415 records · Page 23
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Frozen Freedom: Unleashing Grocery Store Demand Flexibility: Preprint

Grocery stores consumed approximately 3% of total electricity used by commercial buildings in the U.S. in 2018 (EIA 2018), representing a unique end-use load profile characterized by the critical use of refrigerated display cases. Exploring demand response (DR) scenarios in grocery stores presents an opportunity to enhance the efficiency and sustainability of surrounding communities. In addition, recent studies demonstrate that implementing control algorithms considering demand flexibility strategies can lead to load and peak reductions in standalone refrigerated display cases. Because small business grocery stores operate on thin margins, the energy bill cost savings DR might provide could make a positive difference toward continued operations. Still, uncertainty remains about the extent of demand flexibility potential controls could provide when coupling refrigeration with whole building operation. To enhance economic viability and grid stability, it is essential to quantify the load flexibility capability of grocery stores. Advanced controls can optimize energy consumption by responding to load shedding, shifting, and DR events, as well as daily Time-of-Use (TOU) rates without compromising food safety. Using both quantitative data and interviews with community-based organizations, we developed a full-size store model and two small store models with controlled refrigerated cases, HVAC, and lighting systems based on actual grocery store properties. Through simulations, we have assessed load flexibility strategies with varied DR events. The results highlight potential for energy and peak reduction with advanced or basic controls. However, interviews and data indicate that more support is needed to make DR strategies consistently accessible to small grocery stores.

demand flexibility↗
NASA NTRS2019

GOES-17 Advanced Baseline Imager Performance Recovery Summary

The 17th Geostationary Operational Environmental Satellite (GOES-17) was launched on 1 March 2018. The Advanced Baseline Imager (ABI) is the primary instrument on the GOES-R series for weather and environmental monitoring. The GOES-17 ABI (flight model 2) experienced a degradation in its thermal system that limits ABI's ability to shed solar heat load. This limitation resulted in significant reduction in performance after initial turn on with only 3 of 16 spectral channels expected to be available for much of the year. A combined government/vendor team was tasked with optimizing the operation of ABI to recapture as much performance as possible. By modifying the operational configuration and sensor parameters, the team was able to regain over 97% imaging capability.This was accomplished by taking advantage of the considerably flexible nature of ABI's design to adapt its configuration to the new reality and improve capabilities for many of ABI's subsystems. The significant differences in operational configuration, sensor parameter optimization, and algorithm optimization will be discussed as well as their impact on performance and data availability.

Advanced Baseline Imager↗
DOE OSTI2025

Randomized Preconditioned Solvers for Strong Constraint 4D-Var Data Assimilation

The Strong Constraint 4D Variational (SC-4DVAR) data assimilation method is widely used in climate and weather applications. SC-4DVAR involves solving a minimization problem to compute the maximum a posteriori estimate, which we tackle using the Gauss-Newton method. The computation of the descent direction is expensive since it involves the solution of a large-scale and potentially ill-conditioned linear system, solved using the preconditioned conjugate gradient (PCG) method. Here, to address this cost, we efficiently construct scalable preconditioners using three different randomization techniques, which all rely on a certain low-rank structure involving the Gauss-Newton Hessian. The proposed techniques come with theoretical guarantees on the condition number, and at the same time, are amenable to parallelization. We also develop an adaptive approach to estimate the sketch size and choose between the reuse or recomputation of the preconditioner. We demonstrate the performance and effectiveness of our methodology on two representative model problems—the Burgers and barotropic vorticity equation—showing a drastic reduction in both the number of PCG iterations and the number of Gauss-Newton Hessian products after including the preconditioner construction cost.

Gauss-Newton↗
DOE OSTI2025

A Digital Twin Framework Utilizing Machine Learning for Robust Predictive Maintenance: Enhancing Tire Health Monitoring

We introduce a novel digital twin (DT) framework for the predictive maintenance of long-term physical systems. Using monitoring tire health as an application, we show how the DT framework can be used to enhance automotive safety and efficiency, and how the technical challenges can be overcome using a three-step approach. First, to manage the data complexity over a long operation span, we employ data reduction techniques to concisely represent physical tires using historical performance and usage data. Relying on these data, for fast real-time prediction, we train a transformer-based model offline on our concise dataset to predict future tire health over time, represented as remaining casing potential (RCP). Based on our architecture, our model quantifies both epistemic and aleatoric uncertainties, providing reliable confidence intervals around predicted RCP. Second, to incorporate real-time data, we update the predictive model in the DT framework, ensuring its accuracy throughout its lifespan with the aid of hybrid modeling and the use of the discrepancy function. Third, to assist decision-making in predictive maintenance, we implement a tire state decision algorithm, which strategically determines the optimal timing for tire replacement based on RCP forecasted by our transformer model. This approach ensures that our DT accurately predicts system health, continually refines its digital representation, and supports predictive maintenance decisions. Furthermore, our framework effectively embodies a physical system, leveraging big data and machine learning (ML) for predictive maintenance, model updates, and decision-making.

advanced computing infrastructure↗
NASA NTRS2000

Numerical Modeling Studies of Wake Vortex Transport and Evolution Within the Planetary Boundary Layer

The fundamental objective of this research is study behavior of aircraft wake vortices within atmospheric boundary layer (ABL) in support of developing the system, Aircraft VOrtex Spacing System (AVOSS), under NASA's Terminal Area Productivity (TAR) program that will control aircraft spacing within the narrow approach corridors of airports. The purpose of the AVOSS system is to increase airport capacity by providing a safe reduction in separation of aircraft compared to the now-existing flight rules. In our first funding period (7 January 19994 - 6 April 1997), we have accomplished extensive model development and validation of ABL simulations. Using the validated model, in our second funding period (7 April 1997 - 6 April 2000) we have investigated the effects of ambient atmospheric turbulence on vortex decay and descent, Crow instability, and wake vortex interaction with the ground. Recognizing the crucial influence of ABL turbulence on wake vortex behavior, we have also developed a software generating vertical profiles of turbulent kinetic energy (TKE) or energy dissipation rate (EDR), which are, in turn, used as input data in the AVOSS prediction algorithms.

Lin, Yuh-Lang↗
DOE OSTI2025

FedEFsz: Fair Cross-Silo Federated Learning System With Error-Bounded Lossy Compression

Cross-Silo federated learning systems have been identified as an efficient approach to scaling DNN training across geographically-distributed data silos to preserve the privacy of the training data. Communication efficiency and fairness are two major issues that need to be both satisfied when federated learning systems are deployed in practice. Simultaneously guaranteeing both of them, however, is exceptionally difficult because simply combining communication reduction and fairness optimization approaches often causes non-converged training or drastic accuracy degradation. Here, to bridge this gap, we propose FedEFsz. On the one hand, it integrates the state-of-the-art error-bounded lossy compressor SZ3 into cross-silo federated learning systems to significantly reduce communication traffic during the training. On the other hand, it achieves a high fairness (i.e., rather consistent model accuracy and performance across different clients) through a carefully designed heuristic algorithm that can tune the error-bound of SZ3 for different clients during the training. Extensive experimental results based on a GPU cluster with 65 GPU cards show that FedEFsz improves the fairness across different benchmarks by up to 60.88% and meanwhile reduces the communication traffic by up to 315×.

Cross-Silo Federated Learning Systems↗
NASA NTRS1978

Estimation of surface temperature in remote pollution measurement experiments

A simple algorithm has been developed for estimating the actual surface temperature by applying corrections to the effective brightness temperature measured by radiometers mounted on remote sensing platforms. Corrections to effective brightness temperature are computed using an accurate radiative transfer model for the 'basic atmosphere' and several modifications of this caused by deviations of the various atmospheric and surface parameters from their base model values. Model calculations are employed to establish simple analytical relations between the deviations of these parameters and the additional temperature corrections required to compensate for them. Effects of simultaneous variation of two parameters are also examined. Use of these analytical relations instead of detailed radiative transfer calculations for routine data analysis results in a severalfold reduction in computation costs.

Gupta, S. K.↗
NASA NTRS1993

Optimization of actuator arrays for aircraft interior noise control

A numerical procedure for grouping actuators in order to reduce the number of degrees of freedom in an active noise control system is evaluated using experimental data. Piezoceramic actuators for reducing aircraft interior noise are arranged into groups using a nonlinear optimization routine and clustering algorithm. An actuator group is created when two or more actuators are driven with the same control input. This procedure is suitable for active control applications where actuators are already mounted on a structure. The feasibility of this technique is demonstrated using measured data from the aft cabin of a Douglas DC-9 fuselage. The measured data include transfer functions between 34 piezoceramic actuators and 29 interior microphones and microphone responses due to the primary noise produced by external speakers. Control inputs for the grouped actuators were calculated so that a cost function, defined as a quadratic pressure term and a penalty term, was a minimum. The measured transfer functions and microphone responses are checked by comparing calculated noise reductions with measured noise reductions for four frequencies. The grouping procedure is then used to determine actuator groups that improve overall interior noise reductions by 5.3 to 15 dB, compared to the baseline experimental configuration.

Cabell, R. H.↗
NASA NTRS2005

NASA Tech Briefs, March 2005

Topics covered include: Scheme for Entering Binary Data Into a Quantum Computer; Encryption for Remote Control via Internet or Intranet; Coupled Receiver/Decoders for Low-Rate Turbo Codes; Processing GPS Occultation Data To Characterize Atmosphere; Displacing Unpredictable Nulls in Antenna Radiation Patterns; Integrated Pointing and Signal Detector for Optical Receiver; Adaptive Thresholding and Parameter Estimation for PPM; Data-Driven Software Framework for Web-Based ISS Telescience; Software for Secondary-School Learning About Robotics; Fuzzy Logic Engine; Telephone-Directory Program; Simulating a Direction-Finder Search for an ELT; Formulating Precursors for Coating Metals and Ceramics; Making Macroscopic Assemblies of Aligned Carbon Nanotubes; Ball Bearings Equipped for In Situ Lubrication on Demand; Synthetic Bursae for Robots; Robot Forearm and Dexterous Hand; Making a Metal-Lined Composite-Overwrapped Pressure Vessel; Ex Vivo Growth of Bioengineered Ligaments and Other Tissues; Stroboscopic Goggles for Reduction of Motion Sickness; Articulating Support for Horizontal Resistive Exercise; Modified Penning-Malmberg Trap for Storing Antiprotons; Tumbleweed Rovers; Two-Photon Fluorescence Microscope for Microgravity Research; Biased Randomized Algorithm for Fast Model-Based Diagnosis; Fast Algorithms for Model-Based Diagnosis; Simulations of Evaporating Multicomponent Fuel Drops; Formation Flying of Tethered and Nontethered Spacecraft; and Two Methods for Efficient Solution of the Hitting- Set Problem.

Source record↗
NASA NTRSDate not supplied

How Can We Harness the Power of Machine Learning With TEMPO Data?

There are many potential applications of machine learning for TEMPO data that include - Improve retrievals by reducing the effect of random instrument noise - Expand coverage by producing data in moderately cloudy conditions (see also Fasnacht et al. poster) - Help diagnose impacts of instrumental artifacts - Produce value-added products quickly by training on existing products from other sensors (land and ocean) - Speed up processing by training on products produced with full-physics algorithms (e.g., NO 2 slant column fitting may take ~1 hour/orbit but with a neural net it may take only minutes)

NO2↗
DOE OSTI2025

Spectroscopic Online Monitoring: Using a Multi-Track Visible Spectrometer to Facilitate a Mass Balance Study in a Simulated TALSPEAK Process

Nuclear energy is a promising low-carbon energy candidate to meet the increased demand for green energy, where the integration of fuel recycling can have significant benefits for material usage and waste reduction. Utilizing in situ monitoring tools can provide ample opportunities to better control and safeguard nuclear material recycle processes while also offering knowledge and insight into real-time solution properties. The simultaneous measurement of analytical targets in multiple process locations can enable real-time mass balance and material accountancy calculations. This is demonstrated here with a mass balance study of Nd 3+ on countercurrent aqueous/organic metal extraction within a single centrifugal contactor. The Nd 3+ concentration was simultaneously monitored at the inlets and outlets of both aqueous and organic phases using a visible absorbance detector that allowed for the simultaneous measurement of up to six locations. The Nd 3+ concentration was calculated by using chemical data science algorithms, where model training sets were collected on a single track of the detector. The discussion includes addressing the challenges of using a model collected on a single track and applying it as a model across the other tracks on the detector. Each track of the detector corresponds to one measurement location on the contactor. The difference in the integrated moles of Nd 3+ between the inlet and outlet at the end of the experiment was near zero, indicating that the mass balance of this experiment was maintained. Overall, the online spectroscopic monitoring was able to follow changing solution conditions and accurately measure the concentration of Nd 3+ in different locations within the contactor system.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
NASA NTRS2010

Current Applications of OMI Tropospheric NO2 Data for Air Quality and a Look to the Future

Ozone Monitoring Instrument (OMI) Tropospheric NO2 products are being used to enhance the ability to monitor changes in NO2 air quality, update emission inventories, and evaluate regional air quality models. Trends in tropospheric column NO2 have been examined over the eastern United States in relation to emissions changes mandated by regulatory actions. Decreases of 20 to 40 percent over the period 2005 to 2008 were noted, largely in response to major emission reductions at power plants. The OMI data have been used to identify regions in which the opposite trend has been found. We have also used OMI NO2 in efforts to improve emission inventories for NOx emissions from soil. Lightning NOx emissions have been added to CMAQ, the US Environmental Protection Agency's regional air quality model. Evaluation of the resulting NO2 columns in the model is being conducted using the OMI NO2 observations. Community Multiscale Air Quality (CMAQ) together with the OMI NO2 data comprise a valuable tool for monitoring and predicting air quality. Looking to the future, we expect that the combination of Global Ozone Monitoring Experiment-2 (GOME-2) (morning) and OMI (afternoon) data sets obtained through use of the same retrieval algorithms will substantially increase the possibility of successful integration of satellite information into regional air quality forecast models. Farther down the road, we anticipate the Geostationary Coastal and Air Pollution Events (GEO-CAPE) platform to supply data possibly on an hourly basis, allowing much more comprehensive analysis of air quality from space.

Pickering, Kenneth E.↗
NASA NTRS2013

Scheduling Operations for Massive Heterogeneous Clusters

High-performance computing (HPC) programming has become increasingly difficult with the advent of hybrid supercomputers consisting of multicore CPUs and accelerator boards such as the GPU. Manual tuning of software to achieve high performance on this type of machine has been performed by programmers. This is needlessly difficult and prone to being invalidated by new hardware, new software, or changes in the underlying code. A system was developed for task-based representation of programs, which when coupled with a scheduler and runtime system, allows for many benefits, including higher performance and utilization of computational resources, easier programming and porting, and adaptations of code during runtime. The system consists of a method of representing computer algorithms as a series of data-dependent tasks. The series forms a graph, which can be scheduled for execution on many nodes of a supercomputer efficiently by a computer algorithm. The schedule is executed by a dispatch component, which is tailored to understand all of the hardware types that may be available within the system. The scheduler is informed by a cluster mapping tool, which generates a topology of available resources and their strengths and communication costs. Software is decoupled from its hardware, which aids in porting to future architectures. A computer algorithm schedules all operations, which for systems of high complexity (i.e., most NASA codes), cannot be performed optimally by a human. The system aids in reducing repetitive code, such as communication code, and aids in the reduction of redundant code across projects. It adds new features to code automatically, such as recovering from a lost node or the ability to modify the code while running. In this project, the innovators at the time of this reporting intend to develop two distinct technologies that build upon each other and both of which serve as building blocks for more efficient HPC usage. First is the scheduling and dynamic execution framework, and the second is scalable linear algebra libraries that are built directly on the former.

Humphrey, John↗
NASA NTRS2019

Analysis of A Severe Dust Storm and Its Impact on Air Quality Conditions Using Wrf-Chem Modeling, Satellite Imagery, and Ground Observations

This study presents a comprehensive analysis of an extreme dust event recorded in the Arabian Peninsula and the United Arab Emirates (UAE) between 31 March and 3 April 2015. Simulations of the dust event with the Weather Research and Forecasting model coupled with the Chemistry module (WRF-Chem) were analyzed and verified using MSG-SEVIRI imagery and aerosol optical depth (AOD) from the recent 1-km Multi-Angle Implementation of Atmospheric Correction (MAIAC) algorithm for MODIS Terra/Aqua. Data from the National Centers for Atmospheric Prediction/National Center for Atmospheric Research (NCEP/NCAR) and the upper-air radiosonde observations were used to understand the synoptic of the event. In addition, the impact of the event on atmospheric and air quality conditions is investigated. The Air Quality Index (AQI) was calculated prior, during, and after the event to assess the degradation of air quality conditions. Simulated temperature, relative humidity, wind speed, and surface radiation were compared to observations at six monitoring stations in the UAE giving R2 values of 0.84, 0.63, 0.60, and 0.84, respectively. From 1 to 2 April 2015, both observations and simulations showed an average drop in temperature from 33 to 26 °C and radiance reduction from about 950 to 520 Wm−2. The AOD modeled by WRF-Chem showed a good correlation with Aerosol Robotic Network (AERONET) measurements in the UAE with R2 of 0.83. The AQI over the UAE reached hazardous levels during the peak of the dust event before rapidly decreasing to moderate–good air quality levels. This work is the first attempt to demonstrate the potential of using WRF-Chem to estimate AQI over the UAE along with two satellite products (MODIS-MAIAC and MSG-SEVIRI) for dust detection and tracking.

dust storm↗
NASA NTRS2023

Exploring Mission Design for Imaging Spectroscopy Retrievals for Land and Aquatic Ecosystems

The retrieval algorithms used for optical remote sensing satellite data to estimate Earth's geophysical properties have specific requirements for spatial resolution, temporal revisit, spectral range and resolution, and instrument signal-to-noise ratio (SNR) performance to meet biogeoscience objectives. Studies to estimate surface properties from hyperspectral data use a range of algorithms sensitive to various sources of spectroscopic uncertainty, which are in turn influenced by mission architecture choices. Retrieval algorithms vary across scientific fields and may be more or less sensitive to mission architecture choices that affect spectral, spatial, or temporal resolutions and spectrometer SNR. We used representative remote sensing algorithms across terrestrial and aquatic study domains to inform aspects of mission design that are most important for impacting accuracy in each scientific area. We simulated the propagation of uncertainties in the retrieval process including the effects of different instrument configuration choices. We found that retrieval accuracy and information content degrade consistently at >10 nm spectral resolution, >30 m spatial resolution, and >8-day revisit. In these studies, the noise reduction associated with lower spatial resolution improved accuracy vis à vis high spatial resolution measurements. The interplay between spatial resolution, temporal revisit, and SNR can be quantitatively assessed for imaging spectroscopy missions and used to identify key components of algorithm performance and mission observing criteria.

A. M. Raiho↗
DOE OSTI2026

The detection of marine microseismic activity with the CUORE tonne-scale cryogenic experiment

Vibrations from experimental setups and the environment are a persistent source of noise for low-temperature calorimeters searching for rare events, including neutrinoless double beta ( 0νββ ) decay or dark matter interactions. Such noise can significantly limit experimental sensitivity to the physics case under investigation. Here, we report the detection of marine microseismic vibrations using mK-scale calorimeters. This study employs a multi-device analysis correlating data from CUORE, the leading experiment in the search for 0νββ decay with mK-scale calorimeters, and the Copernicus Earth Observation program, revealing the seasonal impact of Mediterranean Sea activity on CUORE’s energy thresholds, resolution, and sensitivity over four years. The detection of marine microseisms underscores the need to address faint environmental noise in ultra-sensitive experiments. Understanding how such noise couples to the detector and developing mitigation strategies is essential for next-generation experiments. We demonstrate one such strategy: a noise decorrelation algorithm implemented in CUORE using auxiliary sensors, which reduces vibrational noise and improves detector performance. Enhancing sensitivity to 0νββ decay and to rare events with low-energy signatures requires identifying unresolved noise sources, advancing noise reduction methods, and improving vibration suppression systems, all of which inform the design of next-generation rare event experiments.

experimental nuclear physics↗
NASA NTRS1989

Laser transit anemometer software development program

Algorithms were developed for the extraction of two components of mean velocity, standard deviation, and the associated correlation coefficient from laser transit anemometry (LTA) data ensembles. The solution method is based on an assumed two-dimensional Gaussian probability density function (PDF) model of the flow field under investigation. The procedure consists of transforming the data ensembles from the data acquisition domain (consisting of time and angle information) to the velocity space domain (consisting of velocity component information). The mean velocity results are obtained from the data ensemble centroid. Through a least squares fitting of the transformed data to an ellipse representing the intersection of a plane with the PDF, the standard deviations and correlation coefficient are obtained. A data set simulation method is presented to test the data reduction process. Results of using the simulation system with a limited test matrix of input values is also given.

Abbiss, John B.↗
NASA NTRS2009

Estimating Thruster Impulses From IMU and Doppler Data

A computer program implements a thrust impulse measurement (TIM) filter, which processes data on changes in velocity and attitude of a spacecraft to estimate the small impulsive forces and torques exerted by the thrusters of the spacecraft reaction control system (RCS). The velocity-change data are obtained from line-of-sight-velocity data from Doppler measurements made from the Earth. The attitude-change data are the telemetered from an inertial measurement unit (IMU) aboard the spacecraft. The TIM filter estimates the threeaxis thrust vector for each RCS thruster, thereby enabling reduction of cumulative navigation error attributable to inaccurate prediction of thrust vectors. The filter has been augmented with a simple mathematical model to compensate for large temperature fluctuations in the spacecraft thruster catalyst bed in order to estimate thrust more accurately at deadbanding cold-firing levels. Also, rigorous consider-covariance estimation is applied in the TIM to account for the expected uncertainty in the moment of inertia and the location of the center of gravity of the spacecraft. The TIM filter was built with, and depends upon, a sigma-point consider-filter algorithm implemented in a Python-language computer program.

Lisano, Michael E.↗