Search NASA⌕ Search

SEARCH · Search NASA

Results for “data cleaning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 343 records · Page 19
All sourcesNASA NTRSDOE OSTI
NASA NTRS1983

Investigation of image enhancement techniques for the development of a self-contained airborne radar navigation system

This study was devoted to an investigation of the feasibility of applying advanced image processing techniques to enhance radar image characteristics that are pertinent to the pilot's navigation and guidance task. Millimeter (95 GHz) wave radar images for the overwater (i.e., offshore oil rigs) and overland (Heliport) scenario were used as a data base. The purpose of the study was to determine the applicability of image enhancement and scene analysis algorithms to detect and improve target characteristics (i.e., manmade objects such as buildings, parking lots, cars, roads, helicopters, towers, landing pads, etc.) that would be helpful to the pilot in determining his own position/orientation with respect to the outside world and assist him in the navigation task. Results of this study show that significant improvements in the raw radar image may be obtained using two dimensional image processing algorithms. In the overwater case, it is possible to remove the ocean clutter by thresholding the image data, and furthermore to extract the target boundary as well as the tower and catwalk locations using noise cleaning (e.g., median filter) and edge detection (e.g., Sobel operator) algorithms.

Phatak, A. V.↗
NASA NTRS2017

The Spectral and Chemical Measurement of Pollutants on Snow Near South Pole, Antarctica

Remote sensing of light-absorbing particles (LAPs), or dark colored impurities, such as black carbon (BC) and dust on snow, is a key remaining challenge in cryospheric surface characterization and application to snow, ice, and climate models. We present a quantitative data set of in situ snow reflectance, measured and modeled albedo, and BC and trace element concentrations from clean to heavily fossil fuel emission contaminated snow near South Pole, Antarctica. Over 380 snow reflectance spectra (350-2500 nm) and 28 surface snow samples were collected at seven distinct sites in the austral summer season of 2014-2015. Snow samples were analyzed for BC concentration via a single particle soot photometer and for trace element concentration via an inductively coupled plasma mass spectrometer. Snow impurity concentrations ranged from 0.14 to 7000 part per billion (ppb) BC, 9.5 to 1200 ppb sulfur, 0.19 to 660 ppb iron, 0.013 to 1.9 ppb chromium, 0.13 to 120 ppb copper, 0.63 to 6.3 ppb zinc, 0.45 to 82 parts per trillion (ppt) arsenic, 0.0028 to 6.1 ppb cadmium, 0.062 to 22 ppb barium, and 0.0044 to 6.2 ppb lead. Broadband visible to shortwave infrared albedo ranged from 0.85 in pristine snow to 0.62 in contaminated snow. LAP radiative forcing, the enhanced surface absorption due to BC and trace elements, spanned from less than 1 W m(exp. -2) for clean snow to approximately 70 W m(exp. -2) for snow with high BC and trace element content. Measured snow reflectance differed from modeled snow albedo due to specific impurity-dependent absorption features, which we recommend be further studied and improved in snow albedo models.

pollution↗
NASA NTRSDate not supplied

Building Capacity for Policy-makers in a Virtual Setting: Providing Tools to Analyze Wildfire Smoke Plumes and Their Impacts

The NASA DEVELOP Program conducted 10-week long feasibility projects in a remote work setting, including partnering with The Nature Conservancy’s Washington Chapter and the Puget Sound Clean Air Agency to investigate wildfire smoke from 2000 - 2020 in the Pacific Northwest using satellite-derived data. The team engaged with platforms for collaboration both internally with NASA affiliates and externally with community organizations. Working from multiple states, the team members used a variety of software including Google Meet, Microsoft Teams, and Google Earth Engine to foster communication and work with data in a shared virtual environment. Throughout the project, the team learned that executing the project in a distanced work setting made it easier to reach out to scientists across the country for expertise and guidance. To study changes in air quality resulting from wildfire smoke, the team utilized data from NASA’s Fire Information from Resource Management System (FIRMS) and the ESA’s Sentinel-5 TROPOspheric Monitoring Instrument (TROPOMI). The team created a Google Earth Engine web-based tool, “Plume Hazards and Observations of Emissions by Navigating an Interactive eXplorer” (PHOENIX), to visualize changes in pollutants and aerosol optical depth after fire events. The potential relationship between plume height and fire radiative power was evaluated by using NASA’s Moderate Resolution Imaging Spectroradiometer (MODIS) aboard Aqua and Terra satellites and NASA’s Multi-angle Imaging SpectroRadiometer (MISR) aboard Terra with the MISR INteractive eXplorer (MINX). The PHOENIX smoke assessment tool and science communication infographics will be shared electronically with the partner organizations. Furthermore, the team introduced the partners to MINX and will provide a tailored tutorial that included a recorded video and a written component with a live virtual workshop. These resources build capacity for further research and education on wildfire smoke and air quality within communities.

NASA DEVELOP↗
NASA NTRSDate not supplied

Status and Operations at the Granite Island, Michigan (GIM) BSRN Station

In June 2018, a new surface radiation site was established on Granite Island, Michigan (GIM), located in Lake Superior. GIM is a 0.1 square km (2.5 acre) rock island. GIM moved from candidate to active and became a fully-fledged member of the Baseline Surface Radiation Network (BSRN) in July 2020 (BSRN Label: GIM). The installation is solar powered, and autonomous instrument functions are accessed remotely from Hampton, Virginia, USA. The original motivation to establishing surface radiation measurements at GIM was to combine high quality downwelling shortwave and longwave measurements with existing evaporation measurements that could lead to improved understanding of the Earth’s energy budget. Other scientific benefits are the addition of a new "water" site to the BSRN network (Water sites are rare in the BSRN network) and a surface validation site for satellite measurements such as the Clouds and the Earth’s Radiant Energy System (CERES). In this poster, we present the status of GIM. GIM is equipped with standard downwelling flux at visible and infrared wavelengths as required by the BSRN network. Basic meteorological parameters are being monitored, as well as other data collections for aerosol and total column water vapor, PAR, and lake skin temperature. Lastly, the capabilities to clean shortwave optics remotely will be discussed and a current list of instruments and pictures will be displayed.

Bryan Fabbri↗
NASA NTRSDate not supplied

A Convolutional Neural Network for Removing GOES-17 Image Anomalies to Improve CERES Broadband Flux Measurement

Background - CERES provides satellite-based global climate data record of Earth's radiation budget and clouds - CERES = Clouds and the Earth's Radiant Energy System - Measurement anomalies impact cloud retrieval - Incorrect Cloud Phase = Incorrect Flux - Unmitigated bad scanlines will impact climate data records - GOES-17 ABI cooling system anomaly = many bad scanlines at night (~10:30 - 16:30 UTC) - Cleaning imagery of bad scanlines is laborious but necessary - A convolution neural network (CNN) can identify and clean bad scanlines as effectively as a human

Benjamin Scarino↗
DOE OSTI2024

Transforming Energy Through Computational Excellence: NREL's Computational Science Center

Computational methods underpin advancing the science and engineering of energy efficiency, sustainable transportation, renewable power technologies, and developing a knowledge base to optimize energy systems. NREL's Computational Science Center (CSC) proudly focuses on providing the service of computing, advancing the science of computing, and enabling NREL's clean energy mission.

applied mathematics↗
NASA NTRS1997

Wavelet Analyses of F/A-18 Aeroelastic and Aeroservoelastic Flight Test Data

Time-frequency signal representations combined with subspace identification methods were used to analyze aeroelastic flight data from the F/A-18 Systems Research Aircraft (SRA) and aeroservoelastic data from the F/A-18 High Alpha Research Vehicle (HARV). The F/A-18 SRA data were produced from a wingtip excitation system that generated linear frequency chirps and logarithmic sweeps. HARV data were acquired from digital Schroeder-phased and sinc pulse excitation signals to actuator commands. Nondilated continuous Morlet wavelets implemented as a filter bank were chosen for the time-frequency analysis to eliminate phase distortion as it occurs with sliding window discrete Fourier transform techniques. Wavelet coefficients were filtered to reduce effects of noise and nonlinear distortions identically in all inputs and outputs. Cleaned reconstructed time domain signals were used to compute improved transfer functions. Time and frequency domain subspace identification methods were applied to enhanced reconstructed time domain data and improved transfer functions, respectively. Time domain subspace performed poorly, even with the enhanced data, compared with frequency domain techniques. A frequency domain subspace method is shown to produce better results with the data processed using the Morlet time-frequency technique.

Martin J Brenner↗
NASA NTRS1993

The Communication Link and Error ANalysis (CLEAN) simulator

During the period July 1, 1993 through December 30, 1993, significant developments to the Communication Link and Error ANalysis (CLEAN) simulator were completed and include: (1) Soft decision Viterbi decoding; (2) node synchronization for the Soft decision Viterbi decoder; (3) insertion/deletion error programs; (4) convolutional encoder; (5) programs to investigate new convolutional codes; (6) pseudo-noise sequence generator; (7) soft decision data generator; (8) RICE compression/decompression (integration of RICE code generated by Pen-Shu Yeh at Goddard Space Flight Center); (9) Markov Chain channel modeling; (10) percent complete indicator when a program is executed; (11) header documentation; and (12) help utility. The CLEAN simulation tool is now capable of simulating a very wide variety of satellite communication links including the TDRSS downlink with RFI. The RICE compression/decompression schemes allow studies to be performed on error effects on RICE decompressed data. The Markov Chain modeling programs allow channels with memory to be simulated. Memory results from filtering, forward error correction encoding/decoding, differential encoding/decoding, channel RFI, nonlinear transponders and from many other satellite system processes. Besides the development of the simulation, a study was performed to determine whether the PCI provides a performance improvement for the TDRSS downlink. There exist RFI with several duty cycles for the TDRSS downlink. We conclude that the PCI does not improve performance for any of these interferers except possibly one which occurs for the TDRS East. Therefore, the usefulness of the PCI is a function of the time spent transmitting data to the WSGT through the TDRS East transponder.

Ebel, William J.↗
NASA NTRS2022

Washington, D.C. & Maryland Energy: Estimating Solar Potential Using NASA POWER Data to Inform Renewable Energy Policy for Washington, D.C.

In line with the Sustainable D.C. 2.0 plan to combat climate change, Washington D.C. aims to decrease its greenhouse gas emissions by 100% by 2050. As solar energy is a clean, renewable energy form, its integration into the region’s power grids lowers energy costs and incentivizes sustainable development. We partnered with the Washington D.C. Department of Energy & Environment (DOEE) to determine how urban areas surrounding D.C. can better be incorporated into decisions regarding renewable energy policy. The team used NASA’s Prediction of Worldwide Energy Resources (POWER) solar data and a Light Detection and Ranging (LiDAR) derived digital surface model, to estimate and visualize rooftop solar potential for Maryland’s Prince George’s and Montgomery counties. POWER provided solar irradiance data adjusted for tilt angle while the digital surface model contributed aspect and slope data. This methodology factored out areas that were unsuitable for solar panel installation while displaying areas that possess a high potential for energy return. The team found the total rooftop solar potential for the study area to be almost 32 million kW, which is equivalent to roughly 660 kW per building. The methodology used to generate the solar potential maps can be applied to other regions of the country seeking to efficiently utilize solar energy. The end users at the DOEE can use our resulting solar potential map and data table to effectively target buildings that have the highest potential to generate solar energy.

Edward Cronin↗
DOE OSTI2025

Community Choice Aggregation(CCA) Data Collection Webinar for Status and Trends in the Voluntary Market Report (2024 Data) [Slides]

We have subcontracted LEAN Energy US, to help us improve our CCA data collection effort for the Annual Voluntary Energy Markets Data Report. LEAN Energy US (Local Energy Aggregation Network) is a national 501(c)3 non-profit organization dedicated to accelerating the country's transition to clean and renewable power, supporting competition and customer choice in the energy sector, and maintaining affordable electricity rates. We work in partnership with a range of organizations to actively support the formation and operational success of Community Choice Aggregation (CCA) programs around the country. This webinar, hosted in partnership with LEAN Energy US, is intended to introduce their members to our data collection effort and encourage CCAs in their network to participate.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2024

Real Time-Optimal Power Flow-Based Distributed Energy Resource Management System (DERMS)

This project aims to promote lab-proven clean energy technology to commercially scalable versions of the technology, integrate the technology with broader systems, provide extended performance data, and validate the manufacturability and reliability of the technology. The lab-proven technology, RT-OPF DERMS, was developed and validated through previous U.S. Department of Energy-funded efforts, including Advanced Research Projects Agency-Energy funding under the Network Optimized Distributed Energy Systems program and Holy-Cross Energy High Impact Project. In the Advanced Research Projects Agency-Energy Network Optimized Distributed Energy Systems project, the RT-OPF DERMS was developed and implemented in multiple hardware platforms, demonstrating its performance and capabilities in the lab and field environments. The technology was also evaluated and matured via a participation in the U.S. Department of Energy I-Corps program, whose goal is to pair teams of researchers with industry mentors for an intensive 2-month training in which the researchers define technology value propositions, conduct customer discovery interviews, and develop viable market pathways for their technologies. These activities indicate the high technology maturity and Technology Readiness Level of the RT-OPF DERMS.

24 POWER TRANSMISSION AND DISTRIBUTION↗
NASA NTRS1967

Computer program for Video Data Processing System /VDPS/

Video data from spacecraft photographic mission telemetry is scanned to generate digital tape computer program which prints out intensity points, cleans noise and telemetry drop-out, enhances contrast, modifies the picture, and calculates contour lines. The output is converted into new photographic film.

Billingsley, F. C.↗
NASA NTRS1976

A new computer approach to mixed feature classification for forestry application

A computer approach for mapping mixed forest features (i.e., types, classes) from computer classification maps is discussed. Mixed features such as mixed softwood/hardwood stands are treated as admixtures of softwood and hardwood areas. Large-area mixed features are identified and small-area features neglected when the nominal size of a mixed feature can be specified. The computer program merges small isolated areas into surrounding areas by the iterative manipulation of the postprocessing algorithm that eliminates small connected sets. For a forestry application, computer-classified LANDSAT multispectral scanner data of the Sam Houston National Forest were used to demonstrate the proposed approach. The technique was successful in cleaning the salt-and-pepper appearance of multiclass classification maps and in mapping admixtures of softwood areas and hardwood areas. However, the computer-mapped mixed areas matched very poorly with the ground truth because of inadequate resolution and inappropriate definition of mixed features.

Kan, E. P.↗
NASA NTRS1976

Superconducting critical fields of alkali and alkaline-earth intercalates of MoS2

Results are reported for measurements of the critical-field anisotropy and temperature dependence of group-VIB semiconductor MoS2 intercalated with the alkali and alkaline-earth metals Na, K, Rb, Cs, and Sr. The temperature dependences are compared with present theories on the relation between critical field and transition temperature in the clean and dirty limits over the reduced-temperature range from 1 to 0.1. The critical-field anisotropy data are compared with predictions based on coupled-layers and thin-film ('independent-layers') models. It is found that the critical-field boundaries are steep in all cases, that the fields are greater than theoretical predictions at low temperatures, and that an unusual positive curvature in the temperature dependence appears which may be related to the high anisotropy of the layer structure. The results show that materials with the largest ionic intercalate atom diameters and hexagonal structures (K, Rb, and Cs compounds) have the highest critical temperatures, critical fields, and critical-boundary slopes; the critical fields of these materials are observed to exceed the paramagnetic limiting fields.

Woollam, J. A.↗
NASA NTRS1979

Reduction of rotor-turbulence interaction noise in static fan noise testing

Three effective inlet cleanup methods are described. A flared reverse cone inlet is used to eliminate wakes from the fan casings and/or probe supports. Boundary layer suction is employed ahead of the fan rotor and on the outer flare of the cone to reduce the boundary layer turbulence and remove any residual wakes. To reduce the midstream turbulent intensity and length scales, a turbulence control structure is used which is constructed with both a layer of honeycomb and a fine mesh screen. The effects of these cleanup methods are quantified by measuring the far-field noise in an anechoic chamber, using a high-speed 20-in.-diam fan of the current high passband type. The changes in the turbulent field impinging on this rotor are quantified by mapping the streamwise and transverse turbulent properties (spectra, intensity and length scale) with crossed hot film probes. It is convincingly shown that it is possible to clean up the inlet flow of a static fan noise test facility to a point where the static acoustic data simulate flight data.

Kantola, R. A.↗
NASA NTRS1983

The atmospheric lifetime experiment. I - Introduction, instrumentation, and overview

The Atmospheric Lifetime Experiment is designed to determine accurately the atmospheric concentrations of the four halocarbons CFCl3, CF2Cl2, CCl4, and CH3CCl3, and also of N2O with emphasis on measurement of their long-term trends in the atmosphere. Comparison of these concentrations and trends for the four halocarbons with estimates of their industrial emission rates then enables calculations of their global circulation rates and globally averaged atmospheric lifetimes. The experiment utilizes automated dual-column electron-capture gas chromatographs which sample the background air about 4 times daily at the following globally distributed sites: Adrigole, Ireland, Cape Meares, Oregon; Ragged Point, Barbados; Point Matatula, American Samoa, and Cape Grim, Tasmania. The climatology of these 'clean air' sites and their ability to describe the global air mass are reviewed. The instrumentation and methods for data acquisition and processing are then described. An overview of the data obtained and the trends derived during the 3-year period from July 1978 through June 1981 for each of the five species being measured is presented.

Prinn, R. G.↗