Search NASA⌕ Search

SEARCH · Search NASA

Results for “Scientific data interpolation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

Wavelet-Based Interpolation and Representation of Non-Uniformly Sampled Spacecraft Mission Data

A well-documented problem in the analysis of data collected by spacecraft instruments is the need for an accurate, efficient representation of the data set. The data may suffer from several problems, including additive noise, data dropouts, an irregularly-spaced sampling grid, and time-delayed sampling. These data irregularities render most traditional signal processing techniques unusable, and thus the data must be interpolated onto an even grid before scientific analysis techniques can be applied. In addition, the extremely large volume of data collected by scientific instrumentation presents many challenging problems in the area of compression, visualization, and analysis. Therefore, a representation of the data is needed which provides a structure which is conducive to these applications. Wavelet representations of data have already been shown to possess excellent characteristics for compression, data analysis, and imaging. The main goal of this project is to develop a new adaptive filtering algorithm for image restoration and compression. The algorithm should have low computational complexity and a fast convergence rate. This will make the algorithm suitable for real-time applications. The algorithm should be able to remove additive noise and reconstruct lost data samples from images.

Bose, Tamal↗

Use of shape-preserving interpolation methods in surface modeling

In many large-scale scientific computations, it is necessary to use surface models based on information provided at only a finite number of points (rather than determined everywhere via an analytic formula). As an example, an equation of state (EOS) table may provide values of pressure as a function of temperature and density for a particular material. These values, while known quite accurately, are typically known only on a rectangular (but generally quite nonuniform) mesh in (T,d)-space. Thus interpolation methods are necessary to completely determine the EOS surface. The most primitive EOS interpolation scheme is bilinear interpolation. This has the advantages of depending only on local information, so that changes in data remote from a mesh element have no effect on the surface over the element, and of preserving shape information, such as monotonicity. Most scientific calculations, however, require greater smoothness. Standard higher-order interpolation schemes, such as Coons patches or bicubic splines, while providing the requisite smoothness, tend to produce surfaces that are not physically reasonable. This means that the interpolant may have bumps or wiggles that are not supported by the data. The mathematical quantification of ideas such as physically reasonable and visually pleasing is examined.

Ftitsch, F. N.↗

Feature-Identification and Data-Compression Software

A report discusses the continuing development of Windows Interface for Nominal Displacement Selection (WINDS), a computer program for automated analysis of images of the Sun and planets acquired by scientific instruments aboard spacecraft. WINDS is intended to afford capabilities for identification of features, measurement of displacements and velocities, analysis of terrain and of atmospheres, and synthesis of animation sequences of images of terrains and atmospheres from small sets of samples by use of velocity-based interpolation. A major element of WINDS will be a nonlinear correlator capable of tracking small features in complex image sequences. For dynamic image sequences, the correlator will enable compression of data by factors >100. In processing image data, WINDS will take account of such factors as texture in image data, rotation of features during measurement intervals, effects of viewing and solar illumination angles, and vertical structures of atmospheres. WINDS will also take account of positions, aiming directions, and fields of view of cameras to determine three-dimensional feature structures by use of triangulation and stereoscopic analysis techniques.

Jong, Eric De↗

Processing TES Level-2 Data

TES Level 2 Subsystem is a set of computer programs that performs functions complementary to those of the program summarized in the immediately preceding article. TES Level-2 data pertain to retrieved species (or temperature) profiles, and errors thereof. Geolocation, quality, and other data (e.g., surface characteristics for nadir observations) are also included. The subsystem processes gridded meteorological information and extracts parameters that can be interpolated to the appropriate latitude, longitude, and pressure level based on the date and time. Radiances are simulated using the aforementioned meteorological information for initial guesses, and spectroscopic-parameter tables are generated. At each step of the retrieval, a nonlinear-least-squares- solving routine is run over multiple iterations, retrieving a subset of atmospheric constituents, and error analysis is performed. Scientific TES Level-2 data products are written in a format known as Hierarchical Data Format Earth Observing System 5 (HDF-EOS 5) for public distribution.

Poosti, Sassaneh↗

Developing Information Power Grid Based Algorithms and Software

This was an exploratory study to enhance our understanding of problems involved in developing large scale applications in a heterogeneous distributed environment. It is likely that the large scale applications of the future will be built by coupling specialized computational modules together. For example, efforts now exist to couple ocean and atmospheric prediction codes to simulate a more complete climate system. These two applications differ in many respects. They have different grids, the data is in different unit systems and the algorithms for inte,-rating in time are different. In addition the code for each application is likely to have been developed on different architectures and tend to have poor performance when run on an architecture for which the code was not designed, if it runs at all. Architectural differences may also induce differences in data representation which effect precision and convergence criteria as well as data transfer issues. In order to couple such dissimilar codes some form of translation must be present. This translation should be able to handle interpolation from one grid to another as well as construction of the correct data field in the correct units from available data. Even if a code is to be developed from scratch, a modular approach will likely be followed in that standard scientific packages will be used to do the more mundane tasks such as linear algebra or Fourier transform operations. This approach allows the developers to concentrate on their science rather than becoming experts in linear algebra or signal processing. Problems associated with this development approach include difficulties associated with data extraction and translation from one module to another, module performance on different nodal architectures, and others. In addition to these data and software issues there exists operational issues such as platform stability and resource management.

Dongarra, Jack↗

The Application of Jason-1 Measurements to Estimate the Global Near Surface Ocean Circulation for Climate Research

The scientific objective of this research program was to utilize drifter, Jason-1 altimeter data and a variety of wind data for the determination of time mean and time variable wind driven surface currents of the global ocean. To accomplish this task has required the interpolation of 6-hourly winds on drifter tracks and the computation of the wind coherent motions of the drifters. These calculations showed that the Ekman current model proposed by Ralph and Niiler for the tropical Pacific was valid for all the oceans south of 40N latitude. Improvements to RN99 model were computed and poster presentations of the results were given in several ocean science venues, including the November 2004 GODAY meeting in St. Petersburg, FL.

Niiler, Peran P.↗

Spline Trajectory Algorithm Development: Bezier Curve Control Point Generation for UAVs

A greater need for sophisticated autonomous piloting systems has risen in direct correlation with the ubiquity of Unmanned Aerial Vehicle (UAV) technology. Whether surveying unknown or unexplored areas of the world, collecting scientific data from regions in which humans are typically incapable of entering, locating lost or wanted persons, or delivering emergency supplies, an unmanned vehicle moving in close proximity to people and other vehicles, should fly smoothly and predictably. The mathematical application of spline interpolation can play an important role in autopilots' on-board trajectory planning. Spline interpolation allows for the connection of Three-Dimensional Euclidean Space coordinates through a continuous set of smooth curves. This paper explores the motivation, application, and methodology used to compute the spline control points, which shape the curves in such a way that the autopilot trajectory is able to meet vehicle-dynamics limitations. The spline algorithms developed used to generate these curves supply autopilots with the information necessary to compute vehicle paths through a set of coordinate waypoints.

Howell, Lauren R.↗

Validating a large geophysical data set: Experiences with satellite-derived cloud parameters

We are validating the global cloud parameters derived from the satellite-borne HIRS2 and MSU atmospheric sounding instrument measurements, and are using the analysis of these data as one prototype for studying large geophysical data sets in general. The HIRS2/MSU data set contains a total of 40 physical parameters, filling 25 MB/day; raw HIRS2/MSU data are available for a period exceeding 10 years. Validation involves developing a quantitative sense for the physical meaning of the derived parameters over the range of environmental conditions sampled. This is accomplished by comparing the spatial and temporal distributions of the derived quantities with similar measurements made using other techniques, and with model results. The data handling needed for this work is possible only with the help of a suite of interactive graphical and numerical analysis tools. Level 3 (gridded) data is the common form in which large data sets of this type are distributed for scientific analysis. We find that Level 3 data is inadequate for the data comparisons required for validation. Level 2 data (individual measurements in geophysical units) is needed. A sampling problem arises when individual measurements, which are not uniformly distributed in space or time, are used for the comparisons. Standard 'interpolation' methods involve fitting the measurements for each data set to surfaces, which are then compared. We are experimenting with formal criteria for selecting geographical regions, based upon the spatial frequency and variability of measurements, that allow us to quantify the uncertainty due to sampling. As part of this project, we are also dealing with ways to keep track of constraints placed on the output by assumptions made in the computer code. The need to work with Level 2 data introduces a number of other data handling issues, such as accessing data files across machine types, meeting large data storage requirements, accessing other validated data sets, processing speed and throughput for interactive graphical work, and problems relating to graphical interfaces.

Kahn, Ralph↗

NASA Soil Moisture Active Passive Mission Status and Science Highlights

The Soil Moisture Active Passive (SMAP) observatory was launched January 31, 2015, and its L-band radiometer and radar instruments became operational during April 2015. This paper provides a summary of the quality assessment of its baseline soil moisture and freeze/thaw products as well as an overview of new products. The first new product explores the Backus Gilbert optimum interpolation based on the oversampling characteristics of the SMAP radiometer. The second one investigates the disaggregation of the SMAP radiometer data using the European Space Agency's Sentinel-1 C-band synthetic aperture radar (SAR) data to obtain soil moisture products at about 1 to 3 km resolution. In addition, SMAPs L-band data have been found useful for many scientific applications, including depictions of water cycles, vegetation opacity, ocean surface salinity and hurricane ocean surface wind mapping. Highlights of these new applications will be provided.The SMAP soil moisture, freeze/taw state and SSSprovide a synergistic view of water cycle. For example, Fig.7 illustrates the transition of freeze/thaw state, change of soilmoisture near the pole and SSS in the Arctic Ocean fromApril to October in 2015 and 2016. In April, most parts ofAlaska, Canada, and Siberia remained frozen. Melt onsetstarted in May. Alaska, Canada, and a big part of Siberia havebecome thawed at the end of May; some freshwater dischargecould be found near the mouth of Mackenzie in 2016, but notin 2015. The soil moisture appeared to be higher in the Oband Yenisei river basins in Siberia in 2015. As a result,freshwater discharge was more widespread in the Kara Seanear the mouths of both rivers in June 2015 than in 2016. TheNorth America and Siberia have become completely thawedin July. After June, the freshwater discharge from other riversinto the Arctic, indicated by blue, also became visible. Thefreeze-up started in September and the high latitude regionsin North America and Eurasia became frozen. Comparing thespread of freshwater in August 2015 and 2016 suggests thatthere was more discharge from Ob and Yenisei in 2015,which appeared to correspond to a higher soil moisturecontent in the Ob and Yenisei basins. In contrast, Mackenzieappeared to have more discharge in September 2016.

soil moisture↗

Experimenting with the GMAO 4D Data Assimilation

The Global Modeling and Assimilation Office (GMAO) has been working to promote its prototype four-dimensional variational (4DVAR) system to a version that can be exercised at operationally desirable configurations. Beyond a general circulation model (GeM) and an analysis system, traditional 4DV AR requires availability of tangent linear (TL) and adjoint (AD) models of the corresponding GeM. The GMAO prototype 4DVAR uses the finite-volume-based GEOS GeM and the Grid-point Statistical Interpolation (GSI) system for the first two, and TL and AD models derived ITom an early version of the finite-volume hydrodynamics that is scientifically equivalent to the present GEOS nonlinear GeM but computationally rather outdated. Specifically, the TL and AD models hydrodynamics uses a simple (I-dimensional) latitudinal MPI domain decomposition, which has consequent low scalability and prevents the prototype 4DV AR ITom being used in realistic applications. In the near future, GMAO will be upgrading its operational GEOS GCM (and assimilation system) to use a cubed-sphere-based hydrodynamics. This versions of the dynamics scales to thousands of processes and has led to a decision to re-derive the TL and AD models for this more modern dynamics, thus taking advantage of a two-dimensional MPI decomposition and improved scalability properties. With the aid of the Transformation of Algorithms in FORTRAN (l'AF) automatic adjoint generation tool and some hand-coding, a version of the cubed-sphere-based TL and AD models, with a simplified vertical diffusion scheme, is now available, enabling multiple configurations of standard implementations of 4DV AR in GEOS. Concurrent to this development, collaboration with the National Centers for Environmental Prediction (NCEP) and the Earth System Research Laboratory (ESRL) has allowed GMAO to implement a hybrid-ensemble capability within the GEOS data assimilation system. Both 3Dand 4D-ensemble capabilities are presently available thus allowing GMAO to now evaluate the performance and benefit of various ensemble and variational assimilation strategies. This presentation will cover the most recent developments taking place at GMAO and show results from various comparisons from traditional techniques to more recent ensemble-based ones.

Todling, R.↗

CERES Fast Longwave And SHortwave Radiative Flux (FLASHFlux): Research to Operation

The Clouds and Earth’s Radiant Energy System (CERES) project provides satellite-based observations of how Earth’s energy flows are varying in time and space and how clouds and aerosols are affecting the Earth’s radiation budget. Nominally, CERES data products require months of validation and calibration before releasing a climate quality data. The Fast Longwave and Shortwave Radiative Flux (FLASHFlux) data product was developed as to provide key radiative flux data products within a week of observations for scientific, applied science research and educational usage. FLASHFlux achieves this by using simplified calibration process and optimized CERES data fusion production system, an operation meteorology product from Global Modeling and Assimilation Office(GMAO), and surface parameterized radiative flux models. The CERES FLASHFlux provides two data products: 1) an hourly Level 2 Single Scanner Footprint (SSF) data separately for Aqua and Terra observations, and 2) a daily Level 3 Time Interpolated and Spatially Averaged (TISA) 1ox1o gridded data that combines Aqua and Terra observations.The current operational Version 3C is being transitioned to Version4A. We compare the FLASHFlux Version4A fluxes using the specialized calibration to Version3C and to the climate quality CERES Edition4A TOA and surface fluxes over time for Terra and Aqua to determine the uncertainties of the calibration process. In addition, we also compare the impact of the fluxes by using the near real-time GMAO GEOS FP-IT instead of GMAO G5-CERES meteorology data.We also compare both SSF overpass products (for Terra and Aqua) and TISA radiative flux products to a set of surface measurement sites that are globally distributed and assess agreement.Lastly, we introduce the first CERES FF SSF data products from the CERES instrument on board NOAA-20.

P Sawaengphokhai↗

A Navier-Strokes Chimera Code on the Connection Machine CM-5: Design and Performance

We have implemented a three-dimensional compressible Navier-Stokes code on the Connection Machine CM-5. The code is set up for implicit time-stepping on single or multiple structured grids. For multiple grids and geometrically complex problems, we follow the 'chimera' approach, where flow data on one zone is interpolated onto another in the region of overlap. We will describe our design philosophy and give some timing results for the current code. A parallel machine like the CM-5 is well-suited for finite-difference methods on structured grids. The regular pattern of connections of a structured mesh maps well onto the architecture of the machine. So the first design choice, finite differences on a structured mesh, is natural. We use centered differences in space, with added artificial dissipation terms. When numerically solving the Navier-Stokes equations, there are liable to be some mesh cells near a solid body that are small in at least one direction. This mesh cell geometry can impose a very severe CFL (Courant-Friedrichs-Lewy) condition on the time step for explicit time-stepping methods. Thus, though explicit time-stepping is well-suited to the architecture of the machine, we have adopted implicit time-stepping. We have further taken the approximate factorization approach. This creates the need to solve large banded linear systems and creates the first possible barrier to an efficient algorithm. To overcome this first possible barrier we have considered two options. The first is just to solve the banded linear systems with data spread over the whole machine, using whatever fast method is available. This option is adequate for solving scalar tridiagonal systems, but for scalar pentadiagonal or block tridiagonal systems it is somewhat slower than desired. The second option is to 'transpose' the flow and geometry variables as part of the time-stepping process: Start with x-lines of data in-processor. Form explicit terms in x, then transpose so y-lines of data are in-processor. Form explicit terms in y, then transpose so z-lines are in processor. Form explicit terms in z, then solve linear systems in the z-direction. Transpose to the y-direction, then solve linear systems in the y-direction. Finally transpose to the x direction and solve linear systems in the x-direction. This strategy avoids inter-processor communication when differencing and solving linear systems, but requires a large amount of communication when doing the transposes. The transpose method is more efficient than the non-transpose strategy when dealing with scalar pentadiagonal or block tridiagonal systems. For handling geometrically complex problems the chimera strategy was adopted. For multiple zone cases we compute on each zone sequentially (using the whole parallel machine), then send the chimera interpolation data to a distributed data structure (array) laid out over the whole machine. This information transfer implies an irregular communication pattern, and is the second possible barrier to an efficient algorithm. We have implemented these ideas on the CM-5 using CMF (Connection Machine Fortran), a data parallel language which combines elements of Fortran 90 and certain extensions, and which bears a strong similarity to High Performance Fortran. We make use of the Connection Machine Scientific Software Library (CMSSL) for the linear solver and array transpose operations.

Jespersen, Dennis C.↗

Spatially Complete Global Surface Albedos Derived from Terra/MODIS Data

Spectral land surface albedo is an important parameter for describing the radiative properties of the Earth. Accordingly it reflects the consequences of natural and human interactions, such as anthropogenic, meteorological, and phenological effects, on global and local climatological trends. Consequently, albedos are integral parts in a variety of research areas, such as general circulation models (GCMs), energy balance studies, modeling of land use and land use change, and biophysical, oceanographic, and meteorological studies. Recent production of land surface anisotropy, diffuse bihemispherical (white-sky) albedo and direct beam directional hemispherical (black-sky) albedo from observations acquired by the MODIS instruments aboard NASA s Terra and Aqua satellite platforms have provided researchers with unprecedented spatial, spectral, and temporal information on the land surface's radiative characteristics. Cloud cover, which cutails retrievals, and the presence of ephemeral and seasonal snow limit the snow-free data to approximately half the global land surfaces on an annual equal-angle basis. This precludes the MOD43B3 albedo products from being used in some remote sensing and ground-based applications, climate models, and global change research projects. An ecosystem-dependent temporal interpolation technique is described that has been developed to fill missing or seasonally snow-covered data in the official MOD43B3 albedo product. The method imposes pixel-level and local regional ecosystem-dependent phenological behavior onto retrieved pixel temporal data in such a way as to maintain pixel-level spatial and spectral detail and integrity. The phenological curves are derived from statistics based on the MODIS MOD12Q1 IGBP land cover classification product geolocated with the MOD43B3 data. The resulting snow-free value-added products provide the scientific community with spatially and temporally complete global white- and black-sky surface albedo maps and statistics. These products are stored on 1'(approximately 10 km) and coarser resolution equal-angle grids, and are computed for the first seven MODIS wavelengths, ranging from 0.47 through 2.1 microns, and for three broadband wavelengths, 0.3-0.7,0.3-5.0 and 0.7-5.0 microns.

King, Michael D.↗

Managing Large Datasets for Atmospheric Research

Since the mid-1980s, airborne and ground measurements have been widely used to provide comprehensive characterization of atmospheric composition and processes. Field campaigns have generated a wealth of insitu data and have grown considerably over the years in terms of both the number of measured parameters and the data volume. This can largely be attributed to the rapid advances in instrument development and computing power. The users of field data may face a number of challenges spanning data access, understanding, and proper use in scientific analysis. This tutorial is designed to provide an introduction to using data sets, with a focus on airborne measurements, for atmospheric research. The first part of the tutorial provides an overview of airborne measurements and data discovery. This will be followed by a discussion on the understanding of airborne data files. An actual data file will be used to illustrate how data are reported, including the use of data flags to indicate missing data and limits of detection. Retrieving information from the file header will be discussed, which is essential to properly interpreting the data. Field measurements are typically reported as a function of sampling time, but different instruments often have different sampling intervals. To create a combined data set, the data merge process (interpolation of all data to a common time base) will be discussed in terms of the algorithm, data merge products available from airborne studies, and their application in research. Statistical treatment of missing data and data flagged for limit of detection will also be covered in this section. These basic data processing techniques are applicable to both airborne and ground-based observational data sets. Finally, the recently developed Toolsets for Airborne Data (TAD) will be introduced. TAD (tad.larc.nasa.gov) is an airborne data portal offering tools to create user defined merged data products with the capability to provide descriptive statistics and the option to treat measurement uncertainty.

Chen, Gao↗

Community Coordinated Modeling Center Support of Science Needs for Integrated Data Environment

Space science models are essential component of integrated data environment. Space science models are indispensable tools to facilitate effective use of wide variety of distributed scientific sources and to place multi-point local measurements into global context. The Community Coordinated Modeling Center (CCMC) hosts a set of state-of-the- art space science models ranging from the solar atmosphere to the Earth's upper atmosphere. The majority of models residing at CCMC are comprehensive computationally intensive physics-based models. To allow the models to be driven by data relevant to particular events, the CCMC developed an online data file generation tool that automatically downloads data from data providers and transforms them to required format. CCMC provides a tailored web-based visualization interface for the model output, as well as the capability to download simulations output in portable standard format with comprehensive metadata and user-friendly model output analysis library of routines that can be called from any C supporting language. CCMC is developing data interpolation tools that enable to present model output in the same format as observations. CCMC invite community comments and suggestions to better address science needs for the integrated data environment.

Kuznetsova, M. M.↗

Temporal Interpolation of Geostationary Satellite Imagery With Optical Flow

Applications of satellite data in areas such as weather tracking and modeling, ecosystem monitoring, wildfire detection, and land-cover change are heavily dependent on the tradeoffs to spatial, spectral, and temporal resolutions of observations. In weather tracking, high-frequency temporal observations are critical and used to improve forecasts, study severe events, and extract atmospheric motion, among others. However, while the current generation of geostationary (GEO) satellites has hemispheric coverage at 10-15-min intervals, higher temporal frequency observations are ideal for studying mesoscale severe weather events. In this work, we present a novel application of deep learning-based optical flow to temporal upsampling of GEO satellite imagery. We apply this technique to 16 bands of the GOES-R/Advanced Baseline Imager mesoscale dataset to temporally enhance full-disk hemispheric snapshots of different spatial resolutions from 10 to 1 min. Experiments show the effectiveness of task-specific optical flow and multiscale blocks for interpolating high-frequency severe weather events relative to bilinear and global optical flow baselines. Finally, we demonstrate strong performance in capturing variability during convective precipitation events.

Image processing↗