Search NASA⌕ Search

SEARCH · Search NASA

Results for “machine data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 451 records · Page 25

The application of support vector machines to analysis of global satellite data sets from MlSR

The Multi-angle Imaging Spectro Radiometer (MISR) is one of a suite of five instruments onboard NASA's Terra EOS satellite, launched in December 1999. Typical satellite imagers view the earth from a single direction, but MISR's cameras image the earth simultaneously from nine different directions in four spectral bands. In this way, MISR provides unique multiangle information about solar radiation scattered from clouds, aerosols and other terrestrial surfaces. One of the primary goals of the MISR mission is to improve our understanding of how clouds and aerosols affect the earth's global energy balance.

support vector machines↗

A New Machine Learning Based Analysis for Improving Satellite Retrieved Atmospheric Composition Data: OMI SO2 as an Example

Despite recent progress, satellite retrievals of anthropogenic SO2 still suffer from relatively low signal-tonoise ratios. In this study, we demonstrate a new machine learning data analysis method to improve the quality of satellite SO2 products. In the absence of large ground-truth datasets for SO2, we start from SO2 slant column densities (SCDs) retrieved from the Ozone Monitoring Instrument (OMI) using a data-driven, physically based algorithm and calculate the ratio between the SCD and the root mean square (rms) of the fitting residuals for each pixel. To build the training data, we select presumably clean pixels with small SCD / rms ratios (SRRs) and set their target SCDs to zero. For polluted pixels with relatively large SRRs, we set the target to the original retrieved SCDs. We then train neural networks (NNs) to reproduce the target SCDs using predictors including SRRs for individual pixels, solar zenith, viewing zenith and phase angles, scene reflectivity, and O3 column amounts, as well as the monthly mean SRRs. For data analysis, we employ two NNs: (1) one trained daily to produce analyzed SO2 SCDs for polluted pixels each day and (2) the other trained once every month to produce analyzed SCDs for less polluted pixels for the entire month. Test results for 2005 show that our method can significantly reduce noise and artifacts over background regions. Over polluted areas, the monthly mean NN-analyzed and original SCDs generally agree to within ±15 %, indicating that our method can retain SO2 signals in the original retrievals except for large volcanic eruptions. This is further confirmed by running both the NN-analyzed and original SCDs through a topdown emission algorithm to estimate the annual SO2 emissions for ∼ 500 anthropogenic sources, with the two datasets yielding similar results. We also explore two alternative approaches to the NN-based analysis method. In one, we employ a simple linear interpolation model to analyze the original SCD retrievals. In the other, we develop a PCA–NN algorithm that uses OMI measured radiances, transformed and dimension-reduced with a principal component analysis (PCA) technique, as inputs to NNs for SO2 SCD retrievals. While the linear model and the PCA–NN algorithm can reduce retrieval noise, they both underestimate SO2 over polluted areas. Overall, the results presented here demonstrate that our new data analysis method can significantly improve the quality of existing OMI SO2 retrievals. The method can potentially be adapted for other sensors and/or species and enhance the value of satellite data in air quality research and applications.

Can Li↗

Flux Improvement based on Machine Learning for the CERES FluxByCldTyp Data Product

The NASA Clouds and the Earth's Radiant Energy System (CERES) product provides over 20 years of accurately observed top-of-the-atmosphere (TOA) and surface flux data record for climate monitoring and diagnostic studies. The interaction between clouds and radiation interaction is a key factor that dominate climate feedbacks but is not well understood. To further advance our understanding of the cloud-radiation interaction, a new CERES FluxByCldTyp (FBCT) product has been developed that contains radiative fluxes by cloud-type, which can provide more stringent constraints when validating models and reveal more insight into the interactions between clouds and climate. For CERES partly cloudy and multiple cloud-type footprints, the FBCT product utilizes Moderate Resolution Imaging Spectroradiometer (MODIS) narrow-band (NB) imager channel radiances partitioned by cloud-type within a CERES footprint to estimate the cloud-type broadband fluxes. The MODIS multi-channel derived broadband fluxes were compared with the CERES observed footprint fluxes and were found to be within 1% and 2.5% for LW and SW, respectively, as well as being mostly free of cloud property dependencies. The FBCT all-sky and clear-sky monthly averaged fluxes were found to be consistent with the CERES SSF1deg product. This study takes advantage of recent progress in machine learning (ML) field by applying deep neural network algorithm to improve fluxes based on MODIS NB radiances. The preliminary study shows ML produce are an improvement over the current FBCT Edition 4 NB2BB algorithm. Furthermore, unlike Ed4 NB2BB, the new ML method convert NB radiances directly to broadband fluxes. For future Ed5, new NB radiances are proposed and used by ML to improve fluxes calculation. Prelimary results show significant LW improvement.

Moguo Sun↗

Personalized Tucker Decomposition: Modeling Commonality and Peculiarity on Tensor Data

In this paper, we propose a personalized Tucker decomposition (perTucker) to address the limitations of traditional tensor decomposition methods in capturing heterogeneity across different datasets. perTucker decomposes tensor data into shared global components and personalized local components. We introduce an order orthogonality assumption and develop a proximal gradient regularized block coordinate descent algorithm guaranteed to converge to a stationary point. The unique and common representations learned by perTucker reveal intrinsic statistical patterns in data and provide valuable information for a wide range of downstream analytics, including anomaly detection, source classification, and clustering. We demonstrate perTucker’s effectiveness through a simulation study and two case studies on solar flare detection and tonnage signal classification.

14 SOLAR ENERGY↗

Public Data Set: Initial Characterization of Electron Temperature and Density Profiles in PEGASUS Spherical Tokamak Discharges Driven Solely by Local Helicity Injection

This public data set contains openly-documented, machine readable digital research data corresponding to figures published in G.M. Bodner et al., ‘Initial Characterization of Electron Temperature and Density Profiles in PEGASUS Spherical Tokamak Discharges Driven Solely by Local Helicity Injection,’ Physics of Plasmas 28, 102504 (2021) and its erratum in Physics of Plasmas 31, 129904 (2024).

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Public Data Set: Effects of Injected Current Streams on MHD Equilibrium Reconstruction of Local Helicity Injection Plasmas in a Spherical Tokamak

This public data set contains openly-documented, machine readable digital research data corresponding to figures published in J.D. Weberski et al., 'Effects of Injected Current Streams on MHD Equilibrium Reconstruction of Local Helicity Injection Plasmas in a Spherical Tokamak,' Journal of Fusion Energy 43, 72 (2024).

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Public Data Set: A Magnetic Diagnostic Suite for the Pegasus-III Experiment

This public data set contains openly-documented, machine readable digital research data corresponding to figures published in J.A. Reusch et al., 'A Magnetic Diagnostic Suite for the Pegasus-III Experiment,' Review of Scientific Instruments 95, 093518 (2024). DOI: 10.1063/5.0219341

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Public Data Set: Erratum: “Initial Characterization of Electron Temperature and Density Profiles in PEGASUS Spherical Tokamak Discharges Driven Solely by Local Helicity Injection” [Phys. Plasmas 28, 102504 (2021)]

This public data set contains openly-documented, machine readable digital research data corresponding to figures published in G.M. Bodner et al., ‘Erratum: “Initial Characterization of Electron Temperature and Density Profiles in PEGASUS Spherical Tokamak Discharges Driven Solely by Local Helicity Injection” [Phys. Plasmas 28, 102504 (2021)],’ Physics of Plasmas 31, 129904 (2024).

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Curating Carbon Storage Data for Reuse: Enabling Research and Modeling from Earth’s Surface to Subsurface

The volume of public geologic carbon storage (GCS) data resources has continued to increase in recent years as the result of an increase in funding from government, industry, and academia towards national, basin, regional and field scale studies to ensure carbon capture and storage becomes a commercially viable operation. Despite the increasing volume of data, GCS data applied towards analyses such as geologic, cost, and risk modeling continues to be multi-sourced and often disparate in nature, published across government agencies, websites, data repositories and buried in derivative reports and documents. Much of the time preparing for an analysis and derivative product development is spent collecting, aggregating, transforming and preparing input data. There have been significant efforts within the DOE National Energy Technology Laboratory’s Carbon Storage Program to optimize multi-source, multi-scale subsurface geologic data curation and aggregation to support data discovery, interoperability, and reuse. Methods include the use of artificial intelligence, machine learning, and data science techniques. This talk will discuss the workflows, best practices, and processes developed to support the aggregation and curation of data through the whole system – surface to subsurface data - that support multi-scale, multi-purpose analysis for carbon storage research.

Morkner, Paige↗

Mapping soils, crops, and rangelands by machine analysis of multitemporal ERTS-1 data

ERTS-1 data, obtained during the period 25 August 1972 to 5 September 1973 over a range of test sites in the Central United States, have been used for identifying and mapping differences in soil patterns, species and conditions of cultivated crops, and conditions of rangelands. Multispectral scanner data from multiple ERTS passes over certain test sites have provided the opportunity to study temporal changes in the scene. Multispectral classifications delineating soils boundaries in different test sites compared well with existing soil association maps prepared by conventional means. Spectral analysis of ERTS data was used to identify, maps, and make areal measurements of wheat in western Kansas. Multispectral analysis of ERTS-1 data provided patterns in rangelands which can be related to soils differences, range management practices, and the extent of infestation of grasslands by mesquite (prosopis fuliflora) and juniper (juniperus spp.).

Baumgardner, M. F.↗

Snow cover monitoring by machine processing of multitemporal LANDSAT MSS data

LANDSAT frames were geometrically corrected and data sets from six different dates were overlaid to produce a 24 channel (six dates and four wavelength bands) data tape. Changes in the extent of the snowpack could be accurately and easily determined using a change detection technique on data which had previously been classified by the LARSYS software system. A second phase of the analysis involved determination of the relationship between spatial resolution or data sampling frequency and accuracy of measuring the area of the snowpack.

Luther, S. G.↗