Search NASA⌕ Search

SEARCH · Search NASA

Results for “gridded data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 343 records · Page 19

Point-spread Function Deconvolution of the IFU Data and Restoration of Galaxy Stellar Kinematics

We present a performance test of the point-spread function (PSF) deconvolution algorithm applied to astronomical integral field unit (IFU) spectroscopy data for restoration of galaxy kinematics. We deconvolve the IFU data by applying the Lucy–Richardson algorithm to the 2D image slice at each wavelength. We demonstrate that the algorithm can effectively recover the true stellar kinematics of the galaxy, by using mock IFU data with a diverse combination of surface brightness profile, signal-to-noise ratio, line-of-sight geometry, and line-of-sight velocity distribution (LOSVD). In addition, we show that the proxy of the spin parameter ${\lambda }_{{R}_{e}}$ can be accurately measured from the deconvolved IFU data. We apply the deconvolution algorithm to the actual SDSS-IV MaNGA IFU survey data. The 2D LOSVD, geometry, and ${\lambda }_{{R}_{e}}$ measured from the deconvolved MaNGA IFU data exhibit noticeable differences compared to the ones measured from the original IFU data. The method can be applied to any other regular-grid IFU data to extract the PSF-deconvolved spatial information.

79 ASTRONOMY AND ASTROPHYSICS↗

The integration of a LANDSAT analysis capability with a geographic information system

The integration of LANDSAT data was achieved through the development of a flexible, compatible analysis tool and using an existing data base to select the usable data from a LANDSAT analysis. The software package allows manipulation of grid cell data plus the flexibility to allow the user to include FORTRAN statements for special functions. Using this combination of capabilities the user can classify a LANDSAT image and then selectivity merge the results with other data that may exist for the study area.

Nordstrand, E. A.↗

Long-Term Validation and Variability of the Shortwave and Longwave Radiation Data of the GEWEX Surface Radiation Budget (SRB) Project

In this investigation, we make systematic Surface Radiation Budget-Baseline Surface Radiation Network (SRB-BSRN), Surface Radiation Data Centre (SRB-WRDC) and Surface Radiation Budget-Global Energy Balance Archive (SRB-GEBA) comparisons for both shortwave and longwave daily and monthly mean radiation fluxes at the Earth's surface. We first have an overview of all the comparable pairs of data in scatter or scatter density plots. Then we show the time series of the SRB data at grids in which there are ground sites where longterm records of data are available for comparison. An overall very good agreement between the SRB data and ground observations is found. To see the variability of the SRB data during the 21.5 years, we computed the global mean and its linear trend. No appreciable trend is detected at the 5% level. The empirical orthogonal functions (EOF) of the SRB deseasonalized shortwave downward flux are computed over the Pacific region, and the first EOF coefficient is found to be correlated with the ENSO Index at a high value of coefficient of 0.7083.

Zhang, Taiping↗

Surface reconstruction from scattered data through pruning of unstructured grids

This paper describes an algorithm for reconstructing a surface from a randomly digitized object. Scan data (treated as a cloud of points) is first tesselated out to its convex hull using Delaunay triangulation. The line-of-sight between each surface point and the scanning device is traversed, and any tetrahedra which are pierced by it are removed. The remaining tetrahedra form an approximate solid model of the scanned object. Due to the inherently limited resolution of any scan, this algorithm requires two additional procedures to produce a smooth, polyhedral surface: one process removes long, narrow tetrahedra which span indentations in the surface between digitized points; the other smooths sharp edges. The results for a moderately resolved sample body and a highly resolved aircraft are displayed.

Maksymiuk, C. M.↗

Parallax-corrected VISST-derived pixel-level products from satellite GOES-16

The NASA Langley group led by William Smith produced GOES-16 satellite cloud retrievals over an approximate 10 by 10 degree region over the CACTI field campaign location. These retrievals are described here: https://www.arm.gov/capabilities/vaps/visst and are available for download here . They use algorithms historically called VISST that are now referred to as SatCORPS. More information can be found in Trepte et al. (2019), Minnis et al. (2021), and Yost et al. (2021). If using this dataset, please cite these references, the CACTI VISST dataset DOI found at the download link above, and this dataset’s DOI. The CACTI VISST pixel-level retrievals are on a 2 km spatial grid and available every 15 minutes (every 10 minutes late in the campaign), producing 21,765 files for the entire field campaign between October 2018 and April 2019. They are not corrected for parallax error, which is an offset in the actual geographical location of a cloud above the surface due to the satellite viewing the cloud partly from the side off nadir. This dataset applies a correction for parallax using the location relative to the satellite and the retrieved cloud top height above the surface, which allows the dataset to be geo-located with surface-based observations. The parallax correction for each location depends on the longitude, latitude and cloud top height above ground level (AGL) for that longitude and latitude in the original VISST files. The cloud top height AGL requires first computing the surface elevation at each VISST grid point. Data from the Advanced Spaceborne Thermal Emission and Reflection (ASTER) Global Digital Elevation Map Version 3 at 30-m resolution is projected onto the VISST grid using conservative coarsening (conserving surface elevation) in the xESMF Python package. The surface elevation is then subtracted from the VISST-retrieved cloud top height above mean sea level. These cloud top heights AGL are then combined with longitude and latitude to estimate the latitude and longitude corrections. Due to variability in cloud top height, the parallax shifts produce an irregular grid of values since higher cloud tops are shifted further than lower cloud tops. A ball tree-based neighbor search with Haversine distance is performed using the Python-based scikit-learn library to find the nearest VISST grid point to each parallax correction-shifted point. The data value of the shifted point is then assigned to that VISST grid point. In this manner, the irregular geographical shifts to correct for parallax are projected back to the rectilinear VISST grid. Because relatively higher clouds should obscure lower clouds, the variable values for the highest cloud top are preferentially chosen if two or more values are assigned to a grid point. The parallax correction should be viewed as an improved but still imperfect estimation of the cloud top locations, largely because the cloud top height is an imperfect retrieval. Please see the attached README document for further information. Users are encouraged to contact the authors with any additional questions.

54 ENVIRONMENTAL SCIENCES↗

A method of smooth bivariate interpolation for data given on a generalized curvilinear grid

A method of locally bicubic interpolation is presented for data given at the nodes of a two-dimensional generalized curvilinear grid. The physical domain is transformed to a computational domain in which the grid is uniform and rectangular by a generalized curvilinear coordinate transformation. The metrics of the transformation are obtained by finite differences in the computational domain. Metric derivatives are determined by repeated application of the chain rule for partial differentiation. Given the metrics and the metric derivatives, the partial derivatives required to determine a locally bicubic interpolant can be estimated at each data point using finite differences in the computational domain. A bilinear transformation is used to analytically transform the individual quadrilateral cells in the physical domain into unit squares, thus allowing the use of simple formulas for bicubic interpolation.

Zingg, David W.↗

rmap: An R package to plot and compare tabular data on customizable maps across scenarios and time

`rmap` is an R package that allows users to easily plot tabular data (CSV or R data frames) on maps without any Geographic Information Systems (GIS) knowledge. Maps produced by `rmap` are `ggplot` objects and thus capitalize on the flexibility and advancements of the `ggplot2` package and all elements of each map are thus fully customizable. Additionally `rmap` automatically detects and produces comparison maps if the data has multiple scenarios or time periods as well as animations for time series data. Advanced users can load their own shapefiles if desired. `rmap` comes with a range of pre-built color palettes but users can also provide any `R` color palette or create their own as needed. Four different legend types are available to highlight different kinds of data distributions. The input spatial data can be both gridded or polygon data. `rmap` is desgined in particular for comparing spatial data across scenarios and time periods and comes preloaded with standard country, state, and basin maps as well as custom maps compatible with the Global Change Analysis Model (GCAM) spatial boundaries. `rmap` has a growing number of users and its products have been used in multiple multisector dynamics publications as well as a required dependency in other R packages such as `rfasst` and `metis`. `rmap's` automatic processing of tabular data using pre-built map selection, difference map calculations, faceting, and animations offers unique functionality which makes it a powerful and yet simple tool for users looking to explore multi-sector, multi-scenario data across space and time.

58 GEOSCIENCES↗

Unsteady transonic Navier-Stokes computations for an oscillating wing using single and multiple zones

Modern jet transports and maneuvering tactical fighters operating in the transonic regime often give rise to time-dependent fluid physics that interact with flexible structural components, e.g., vortical flow, shocks, and separation. Efficient computational fluid dynamic (CFD) methods are required to study such computationally intensive problems. In this work a numerical method is presented to address this problem. Time-dependent, compressible, Navier-Stokes equations are used to simulate unsteady transonic flow about a three-dimensional rigid wing undergoing a forced periodic motion in angle of attack. An efficient, implicit, diagonal algorithm is utilized because of its low operation count per time step compared to other methods that solve systems of block matrix equations. The formal time accuracy is addressed theoretically and demonstrated numerically by comparison of computational results with experimental data. A zonal grid approach, capable of treating complex geometries, is presented and its time accuracy is demonstrated by comparing a zonal computation with a single grid computation and experimental data.

Chaderjian, Neal M.↗

DISTRIBUTION TRANSFORMER ASSET MONITORING ON THE GRID EDGE USING SMART SENSOR DATA

As new loads such as rooftop photovoltaics, electric vehicles and other distributed energy resources become commonplace on the distribution grid, the stress on already aging assets begins to escalate. This increased loading and changing dynamics can exacerbate failure rates. While traditional monitoring efforts focus on transmission and generation assets, utilities are now beginning to pay close attention to distribution assets in order to increase reliability indices and reduce cost from unexpected outages. This research develops low-cost and scalable methods to monitoring the health of a critical distribution grid asset: the service transformer. Existing methods in literature are either invasive and thus difficult to implement or require the device to be tested offline in an expensive lab setting. Data from the ubiquitous smart meter as well as a novel Bluetooth based transformer monitor are leveraged to automatically notify the utility of deteriorating or damaged transformers. Voltage, temperature, and vibration are some of the signals measured and analyzed by the proposed algorithms to predict transformer failures. Furthermore, these algorithms are designed to keep the implementation and processing costs low by taking advantage of edge computing where possible.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Multiresolution With Super-Compact Wavelets

The solution data computed from large scale simulations are sometimes too big for main memory, for local disks, and possibly even for a remote storage disk, creating tremendous processing time as well as technical difficulties in analyzing the data. The excessive storage demands a corresponding huge penalty in I/O time, rendering time and transmission time between different computer systems. In this paper, a multiresolution scheme is proposed to compress field simulation or experimental data without much loss of important information in the representation. Originally, the wavelet based multiresolution scheme was introduced in image processing, for the purposes of data compression and feature extraction. Unlike photographic image data which has rather simple settings, computational field simulation data needs more careful treatment in applying the multiresolution technique. While the image data sits on a regular spaced grid, the simulation data usually resides on a structured curvilinear grid or unstructured grid. In addition to the irregularity in grid spacing, the other difficulty is that the solutions consist of vectors instead of scalar values. The data characteristics demand more restrictive conditions. In general, the photographic images have very little inherent smoothness with discontinuities almost everywhere. On the other hand, the numerical solutions have smoothness almost everywhere and discontinuities in local areas (shock, vortices, and shear layers). The wavelet bases should be amenable to the solution of the problem at hand and applicable to constraints such as numerical accuracy and boundary conditions. In choosing a suitable wavelet basis for simulation data among a variety of wavelet families, the supercompact wavelets designed by Beam and Warming provide one of the most effective multiresolution schemes. Supercompact multi-wavelets retain the compactness of Haar wavelets, are piecewise polynomial and orthogonal, and can have arbitrary order of approximation. The advantages of the multiresolution algorithm are that no special treatment is required at the boundaries of the interval, and that the application to functions which are only piecewise continuous (internal boundaries) can be efficiently implemented. In this presentation, Beam's supercompact wavelets are generalized to higher dimensions using multidimensional scaling and wavelet functions rather than alternating the directions as in the 1D version. As a demonstration of actual 3D data compression, supercompact wavelet transforms are applied to a 3D data set for wing tip vortex flow solutions (2.5 million grid points). It is shown that high data compression ratio can be achieved (around 50:1 ratio) in both vector and scalar data set.

Lee, Dohyung↗

Surface grid generation for flowfield applications using B-spline surfaces

The adequate discretization of the flowfield domain in structured grid techniques depends on the body surface, the zones, and the interior grid. Attention is presently given to the problem of obtaining a versatile surface-definition and grid-generation technique; a general surface grid-generation technique is presented which develops three-dimensional patches from point data. The grid is generated on a two-dimensional field on the basis of either a direct or inverse interpolation procedure. It is then mapped onto physical space to yield the surface grid.

Atwood, Christopher A.↗

Australian topography from Seasat overland altimetry

Retracking of overland returns from the Seasat altimeter using algorithms originally developed for recovering elevations over ice has led to the successful recovery of high quality continental topography over Australia and other continents. Cross-over analysis both before and after orbit adjustment shows the altimetric data over land to have a 2-3 m quality. Direct comparison of gridded Seasat data with surface data re-averaged in the same way shows excellent agreement except where Seasat data are sparse, due either to poor track spacing or to dropouts caused by loss of tracker lock over steeply sloping ground. These results suggest that useful topographic data can be derived from Seasat and the more recent Geosat altimeters for parts of the world where surface data are few or of poor quality.

Frey, Herbert↗

A Simple and Accurate Energy-Detector-Based Transient Waveform Detection for Smart Grids: Real-World Field Data Performance

Integration of distributed energy sources, advanced meshed operation, sensors, automation, and communication networks all contribute to autonomous operations and decision-making processes utilized in the grid. Therefore, smart grid systems require sophisticated supporting structures. Furthermore, rapid detection and identification of disturbances and transients are a necessary first step towards situationally aware smart grid systems. This way, high-level monitoring is achieved and the entire system kept operational. Even though smart grid systems are unavoidably sophisticated, low-complexity algorithms need to be developed for real-time sensing on the edge and online applications to alert stakeholders in the event of an anomaly. In this study, the simplest form of anomaly detection mechanism in the absence of any a priori knowledge, namely, the energy detector (also known as radiometer in the field of wireless communications and signal processing), is investigated as a triggering mechanism, which may include automated alerts and notifications for grid anomalies. In contrast to the mainstream literature, it does not rely on transform domain tools; therefore, utmost design and implementation simplicity are attained. Performance results of the proposed energy detector algorithm are validated by real power system data obtained from the DOE/EPRI National Database of power system events and the Grid Signature Library.

24 POWER TRANSMISSION AND DISTRIBUTION↗

GLIDE: a grid-based light-weight infrastructure for data-intensive environments

The promise of the grid is that it will enable public access and sharing of immense amounts of computational and data resources among dynamic coalitions of individuals and institutions. However, the current grid solutions make several limiting assumptions that curtail their widespread adoption. To address these limitations, we present GLIDE, a prototype light-weight, data-intensive middleware infrastructure that enables access to the robust data and computational power of the grid on DREAM platforms.

PRISM-MW↗

TuckerMPI: A Parallel C++/MPI Software Package for Large-scale Data Compression via the Tucker Tensor Decomposition

With this study, our goal is compression of massive-scale grid-structured data, such as the multi-terabyte output of a high-fidelity computational simulation. For such data sets, we have developed a new software package called TuckerMPI, a parallel C++/MPI software package for compressing distributed data. The approach is based on treating the data as a tensor, i.e., a multidimensional array, and computing its truncated Tucker decomposition, a higher-order analogue to the truncated singular value decomposition of a matrix. The result is a low-rank approximation of the original tensor-structured data. Compression efficiency is achieved by detecting latent global structure within the data, which we contrast to most compression methods that are focused on local structure. In this work, we describe TuckerMPI, our implementation of the truncated Tucker decomposition, including details of the data distribution and in-memory layouts, the parallel and serial implementations of the key kernels, and analysis of the storage, communication, and computational costs. We test the software on 4.5 and 6.7 terabyte data sets distributed across 100 s of nodes (1,000 s of MPI processes), achieving compression ratios between 100 and 200,000×, which equates to 99--99.999% compression (depending on the desired accuracy) in substantially less time than it would take to even read the same dataset from a parallel file system. Moreover, we show that our method also allows for reconstruction of partial or down-sampled data on a single node, without a parallel computer so long as the reconstructed portion is small enough to fit on a single machine, e.g., in the instance of reconstructing/visualizing a single down-sampled time step or computing summary statistics. The code is available at https://gitlab.com/tensors/TuckerMPI.

97 MATHEMATICS AND COMPUTING↗

Metrics for evaluating tropical cyclones in climate data

This manuscript describes a software suite that can be used for objective evaluation of tropical cyclones (TCs) in gridded climate data. Using cyclone trajectories derived from 6-hourly data, a comprehensive set of metrics is defined to systematically compare and contrast products to one another. In addition to annual TC climatologies, attention is paid to spatial and temporal patterns of storm occurrence and intensity. Assessment can be performed either on the global scale or regional domains. Simple to visualize ‘scorecards’ allow for rapid credibility assessment. We showcase three key findings enabled by this suite. First, we compare the representation of TCs in seven current-generation global reanalyses and conclude that higher resolution models and those with TC-specific assimilation contain more accurate storm climatologies. Second, using a free-running Earth system model (ESM) we find that full basin refinement is required in variable-resolution configurations to adequately simulate North Atlantic TC frequency. Furthermore, upstream refinement over northern Africa offers little benefit in simulating storm occurrence but spatial genesis patterns are improved. Finally, we show that TCs simulated by ESMs can be highly sensitive to individual parameterizations in climate models, with North Atlantic TC metrics varying greatly depending on version of the Morrison-Gettelman microphysics package.

54 ENVIRONMENTAL SCIENCES↗

Global mean sea surface computation using GEOS 3 altimeter data

A mean sea surface map has been determined for the global ocean areas between +62 deg and -62 deg latitude using GEOS 3 altimeter data. A grid of laser reference orbits computed using the GEM 10B gravity model has been used to orient the altimeter data in a center of mass coordinate system. The density of the altimeter tracks has enabled the computation of the sea surface heights above the reference ellipsoid on 1 deg x 1 deg grid in most of the oceanic areas. In the northwest Atlantic the dense coverage has enabled computations on a 0.25 deg x 0.25 deg grid. Comparisons of the global surface with an independently computed mean sea surface based upon SEASAT altimeter data indicate an rms agreement of a little over a meter. Comparisons of the regional solution in the northwest Atlantic with SEASAT profiles indicate a precision of a few decimeters in this surface. An analysis of the global crossover differences has indicated the possibility of a timing error in the altimeter data. Timing bias values of within 0.5 msec of 9.2 msec for 1975 and within 0.6 msec of 18.7 msec for 1976 have been recovered from an analysis of the altimeter data.

Marsh, J. G.↗

Digital Filter Design for Point-on-Wave Sensors: Highlighting Frequency Response Limitations and Enhancing Grid Simulation Accuracy

Data is proving to be the backbone of today's and, more importantly, tomorrow's grid. As the system changes and introduces fast-acting devices like power electronics, overall observability tends to decrease from the utility point-of-view. This can be mitigated by adding more high-fidelity sensors onto the grid, although this incurs a cost. These sensors are never ideal, and each have unique frequency responses that may influence the data produced. This may, in turn, impact the protection and control of the power grid. This paper presents a methodology of representing these point-on-wave sensors digitally by estimating digital-filter representations of them, thereby introducing means of improving the sensor models used in electromagnetic-transient (EMT) simulations. This may help with identifying potential high-frequency, sensor-induced distortions, and system resonance compensation. Three commercial-grade medium-voltage point-on-wave sensors are utilized in a lab environment to obtain experimental frequency responses with a frequency sweep, and it is shown that both Infinite Impulse Response (IIR) and Finite Impulse Response (FIR) filter representations may approximate these responses with varying degrees of accuracy, though each has their own strengths and weaknesses. It is found that, in general, FIR estimation better approximates these sensors than IIR estimation does.

Wilson, Aaron [ORNL] (ORCID:0000000327331697)↗