Search NASA⌕ Search

SEARCH · Search NASA

Results for “subsetting”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

GeoNEX-SUBSETS: Geostationary Satellite Observations Over International Observing Network Sites

Satellite remote sensing is crucial for monitoring the Earth’s surface and for simulating global carbon and water cycles. Subsets of satellite data from sensors such as MODIS over established observing networks have been valuable for researchers for comparing the ground observed phenomena with satellite observations. Here, we introduce new subsets of the GeoNEX geostationary satellite datasets over locations of several ground observation networks. The NASA Earth Exchange group has been generating geostationary satellite products with our international partners and universities to cover the entire globe. In comparison to polar-orbiting satellite sensors such as MODIS, the new generation geostationary satellites observe target areas at a higher frequency (5-10 minutes), which also significantly increased the data volume. To reduce the burden of downloading and extracting geostationary time series data and provide easy access to the community, we provide subsets of GeoNEX products through our data portal [www.data.nas.nasa.gov]. The ready-to-use subset follows the same format as the MODIS fixed sites subset tools for users who are familiar with MODIS subset data and software. The selected networks include Fluxnet, AERONET, and Phenocam over the conterminous US. We demonstrate the usage of the GeoNEX fixed-site subset data and showcase thir advantages with three example studies. The first example is simulating the diurnal cycle of plant ecophysiology at Fluxnet sites. The high frequency of the GeoNEX time series allows us to run ecological models at sub-hour time steps and directly compare the simulated carbon and water fluxes with half-hourly Fluxnet data. The second example uses the geostationary data to track phenological changes. It highlights the high-frequent observations of geostationary satellites in helping mask cloud covers and capture the quick responses of vegetation to environmental changes. As such, these examples demonstrate the value of ready-to-use GeoNEX subsets data in terrestrial ecophysiology research.

GeoNEX↗

Altered Cytokine Production By Specific Human Peripheral Blood Cell Subsets Immediately Following Spaceflight

In this study, we have attempted to combine standard immunological assays with the cellular resolving power of the flow cytometer to positively identify the specific cell types involved in spaceflight-induced immune alterations. We have obtained whole blood samples from 27 astronauts collected at three timepoints (L-10, R+0 and R+3) surrounding four recent space shuttle missions. The duration of these missions ranged from 10 to 18 days. Assays performed included serum/urine cortisol, comprehensive subset phenotyping, assessment of cellular activation markers and intracellular cytokine production following mitogenic stimulation. Absolute levels of peripheral granulocytes were significantly elevated following spaceflight, but the levels of circulating lymphocytes and monocytes were unchanged. Lymphocyte subset analysis demonstrated trends towards a decreased percentage of T cells and an increased percentage of B cells. Nearly all of the astronauts exhibited an increased CD4:CD8 ratio, which was dramatic in some individuals. Assessment of memory (CD45RA+) vs. naive (CD45RO+) CD4+ T cell subsets was more ambiguous, with subjects tending to group more as a flight crew. All subjects from one mission demonstrated an increased CD45RA:CD45RO ratio, while all subjects from another Mission demonstrated a decreased ratio. While no significant trend was seen in the monocyte population as defined by scatter, a decreased percentage of the CD14+ CD16+ monocyte subset was seen following spaceflight in all subjects tested. In general, most of the cellular changes described above which were assessed at R+O and compared to L-10 trended to pre-flight levels by R+3. Although no significant differences were seen in the expression of the cellular activation markers CD69 and CD25 following exposure to microgravity, significant alterations were seen in cytokine production in response to mitogenic activation for specific subsets. T cell (CD3+) production of IL-2 was significantly decreased after at R+O as was IL-2 production by both CD4+ and CD8+ T cell subsets for most subjects. Production of IFN(sub gamma) did not appear to be affected by microgravity exposure in either T cells in general or in the CD8+ T cell subset. There was a spaceflight-induced decrease in IFN(sub gamma) production in the CD4+ T cell subset, however it did not reach statistical significance. Serum and urine stress-hormone analysis indicated significant physiologic stresses in astronauts following spaceflight. In summary, these results demonstrate alterations in the peripheral immune system of astronauts immediately after spaceflight of 10 to 18 days duration and support continued research regarding microgravity and immunology (including in-flight sampling) prior to routine long-term spaceflight for astronauts.

Crucian, Brian E.↗

Altered cytokine production by specific human peripheral blood cell subsets immediately following space flight

In this study, flow cytometry was used to positively identify the specific lymphocyte subsets exhibiting space flight-induced alterations in cytokine production. Whole blood samples were collected from 27 astronauts at three points (one preflight, two postflight) surrounding four space shuttle missions. Assays performed included serum/urine stress hormones, white blood cell (WBC) phenotyping, and intracellular cytokine production following mitogenic stimulation. Absolute levels of peripheral granulocytes were significantly elevated following space flight, but the levels of circulating lymphocytes and monocytes were unchanged. Lymphocyte subset analysis demonstrated a decreased percentage of T cells, whereas percentages of B cells and natural killer (NK) cells remained unchanged after flight. Nearly all the astronauts exhibited an increased CD4/CD8 T cell ratio. Assessment of naive (CD45RA+) vs. memory (CD45RO+) CD4+ T cell subsets was ambiguous, and subjects tended to group within specific missions. Although no significant trend was seen in absolute monocyte levels, a significant decrease in the percentage of the CD14+ CD16+ monocytes was seen following space flight in all subjects tested. T cell (CD3+) production of interleukin-2 (IL-2) was significantly decreased after space flight, as was IL-2 production by both CD4+ and CD8+ T cell subsets. Production of interferon-gamma (IFN-gamma) was not altered by space flight for the CD8+ cell subset, but there was a significant decrease in IFN-gamma production for the CD4+ T cell subset. Serum and urine stress hormone analysis indicated significant physiologic stresses in astronauts following space flight. Altered peripheral leukocyte subsets, altered serum and urine stress hormone levels, and altered T cell cytokine secretion profiles were all observed postflight. In addition, there appeared to be differential susceptibility to space flight regarding cytokine secretion by T cell subsets. These alterations may be the result of either microgravity exposure or the physiologic stresses of landing and readaptation to unit gravity. Future studies, including in-flight analysis or sampling, will be necessary to determine the cause of these alterations.

NASA Discipline Cell Biology↗

Selection of a Representative Subset of Global Climate Models that Captures the Profile of Regional Changes for Integrated Climate Impacts Assessment

We present the Representative Temperature and Precipitation (T&P) GCM Subsetting Approach developed within the Agricultural Model Intercomparison and Improvement Project (AgMIP) to select a practical subset of global climate models (GCMs) for regional integrated assessment of climate impacts when resource limitations do not permit the full ensemble of GCMs to be evaluated given the need to also focus on impacts sector and economics models. Subsetting inherently leads to a loss of information but can free up resources to explore important uncertainties in the integrated assessment that would otherwise be prohibitive. The Representative T&P GCM Subsetting Approach identifies five individual GCMs that capture a profile of the full ensemble of temperature and precipitation change within the growing season while maintaining information about the probability that basic classes of climate changes (relatively cool/wet, cool/dry, middle, hot/wet, and hot/dry) are projected in the full GCM ensemble. We demonstrate the selection methodology for maize impacts in Ames, Iowa, and discuss limitations and situations when additional information may be required to select representative GCMs. We then classify 29 GCMs over all land areas to identify regions and seasons with characteristic diagonal skewness related to surface moisture as well as extreme skewness connected to snow-albedo feedbacks and GCM uncertainty. Finally, we employ this basic approach to recognize that GCM projections demonstrate coherence across space, time, and greenhouse gas concentration pathway. The Representative T&P GCM Subsetting Approach provides a quantitative basis for the determination of useful GCM subsets, provides a practical and coherent approach where previous assessments selected solely on availability of scenarios, and may be extended for application to a range of scales and sectoral impacts.

Climate Change; GCMs; Climate Model Subset; Repres↗

Easy, Scalable Subsetting of GEDI Point Clouds

The GEDI Subsetter, a Python tool developed for NASA’s Multi-mission Algorithm and Analysis Platform (MAAP), optimizes the accessibility and visualization of GEDI point clouds by enabling users to efficiently subset data in a convenient, scalable manner. Complex science data often requires users to learn new software skills and handle many large files. Handling and cleaning large data sets is tedious and error-prone. These challenges significantly impede analysis. One of the goals of NASA's MAAP is to provide a platform that lowers the barrier to conducting research and analysis at scale. When a group of MAAP users wanted to conduct above-ground biomass estimation using GEDI data, we found that their existing workflow for leveraging GEDI data suffered from the barriers mentioned above. Furthermore, their workflow did not scale easily beyond a small number of granules. We found that existing tools related to GEDI data retrieval and subsetting were too limiting, so the GEDI Subsetter was written to support MAAP users’ needs. Being able to run many subsetting jobs simultaneously in the MAAP, and parallelizing the code itself, has led to significant speed improvements in obtaining relevant data, reducing subsetting time from hours to minutes. MAAP users can now more quickly and easily obtain only the data relevant to their research, by choosing which GEDI collection they want to work with (L1A, L2A, L2B, or L4A), and how they want to subset it, by specifying an area of interest, a temporal range, and relevant attributes. This has significantly reduced the feedback loop for users, allowing them to much more quickly subset GEDI data and begin their analysis. Although the GEDI Subsetter originally targeted users of the MAAP, it is generalized such that it can also be used outside of the MAAP and includes a command-line interface for convenience. Furthermore, with minor modifications, it should be possible to use it with non-GEDI data as the general pattern should be applicable to other sparse/track-based sensors.

Charles Daniels↗

Subsetting and Formatting Landsat-7 LOR ETM+ and Data Products

The Landsat-7 Processing System (LPS) processes Landsat-7 Enhanced Thematic Mapper (ETM+) instrument data into large, contiguous segments called "subintervals" and stores them in Level OR (LOR) data files. The LPS processed subinterval products must be subsetted and reformatted before the Level I processing systems can ingest them. The initial full subintervals produced by the LPS are stored mainly in HDF Earth Observing System (HDF-EOS) format which is an extension to the Hierarchical Data Format (HDF). The final LOR products are stored in native HDF format. Primarily the EOS Core System (ECS) and alternately the DAAC Emergency System (DES) subset the subinterval data for the operational Landsat-7 data processing systems. The HDF and HDF-EOS application programming interfaces (APIs) can be used for extensive data subsetting and data reorganization. A stand-alone subsetter tool has been developed which is based on some of the DES code. This tool makes use of the HDF and HDFEOS APIs to perform Landsat-7 LOR product subsetting and demonstrates how HDF and HDFEOS can be used for creating various configurations of full LOR products. How these APIs can be used to efficiently subset, format, and organize Landsat-7 LOR data as demonstrated by the subsetter tool and the DES is discussed.

Reid, Michael R.↗

Simplifying Satellite and Ground Data Validation with Level-2 Subsetting

We demonstrate that scientists can simplify their satellite data validation workflow with the use of NASA Godddard Earth Sciences Data and Information Services Center (GES DISC) subsetting services. We perform a sample validation of Aura ozone products collocated with ground-based ozone measurements using subsetting services to trim satellite data to only the relevant user-defined variables and spatio-temporal region. Because the subsetting service automatically returns only relevant data granules that adhere to a set of user-defined coincidence criteria, user workload is greatly reduced. Moreover, the resultant data files are substantially smaller than full data granules due to the subsetting service further culling the data to the relevant geospatio-temporal coincidence criteria, user-defined variables, and user-defined dimensions of variables. This decreases data download throughput and file storage requirements. The validation presented here quantifies the time and file size savings that can be achieved by utilizing subsetting services within the satellite data validation workflow.

Johnson, James↗

GeoNEX-SUBSETS: Cutouts of geostationary satellite data over long-term monitoring sites

Satellite remote sensing data are important tool for extrapolating the knowledge obtained at the Fluxnet towers. We introduce our GEO-NEX geostationary satellite subset products, which make it easy to compare between ground observation and Geo-NEX products. The MODIS subset has been frequently used for validating ecosystem models developed at flux towers and upscaling the observed flux data to regional scales. However, MODIS on the polar orbiting satellites can observe target regions only once a day, while the Fluxnet eddy-covariance data are compiled as sub-hourly datasets. As a results, summarizing the sub-hourly flux data into daily statistics is necessary for the comparison between MODIS and Flux data. Here, the new generation geostationary satellite sensors (GOES-16/17 ABI and Himawari-8/9 AHI) has the high-frequent observation feature (10 minutes) in addition to similar spectral band and spatial resolution with MODIS. The high frequent observation allows us to compare the flux diurnal cycle with geostationary satellite sensor data. Some studies have already shown the effective utilization of time series of geostationary satellite data for ecosystem modeling. We are producing NEX Level-1G products, which is the gridded Top-of-Atmosphere reflectance and brightness temperature data of geostationary satellite sensors. We cut out the NEX Level-1G data using the same file format with the MODIS subset except for the projection. The other data products (e.g., surface reflectance, land surface temperature, vegetation indices and climate data) will be also added upon their availability. We selected the ground observation sites from Fluxnet, Phenocam, and AERONET networks. The NEX subset data will be provided through NASA NEX data portal.

GeoNEX↗

Neurochemical phenotype of corticocortical connections in the macaque monkey: quantitative analysis of a subset of neurofilament protein-immunoreactive projection neurons in frontal, parietal, temporal, and cingulate cortices

The neurochemical characteristics of the neuronal subsets that furnish different types of corticocortical connections have been only partially determined. In recent years, several cytoskeletal proteins have emerged as reliable markers to distinguish subsets of pyramidal neurons in the cerebral cortex of primates. In particular, previous studies using an antibody to nonphosphorylated neurofilament protein (SMI-32) have revealed a consistent degree of regional and laminar specificity in the distribution of a subpopulation of pyramidal cells in the primate cerebral cortex. The density of neurofilament protein-immunoreactive neurons was shown to vary across corticocortical pathways in macaque monkeys. In the present study, we have used the antibody SMI-32 to examine further and to quantify the distribution of a subset of corticocortically projecting neurons in a series of long ipsilateral corticocortical pathways in comparison to short corticocortical, commissural, and limbic connections. The results demonstrate that the long association pathways interconnecting the frontal, parietal, and temporal neocortex have a high representation of neurofilament protein-enriched pyramidal neurons (45-90%), whereas short corticocortical, callosal, and limbic pathways are characterized by much lower numbers of such neurons (4-35%). These data suggest that different types of corticocortical connections have differential representation of highly specific neuronal subsets that share common neurochemical characteristics, thereby determining regional and laminar cortical patterns of morphological and molecular heterogeneity. These differences in neuronal neurochemical phenotype among corticocortical circuits may have considerable influence on cortical processing and may be directly related to the type of integrative function subserved by each cortical pathway. Finally, it is worth noting that neurofilament protein-immunoreactive neurons are dramatically affected in the course of Alzheimer's disease. The present results support the hypothesis that neurofilament protein may be crucially linked to the development of selective neuronal vulnerability and subsequent disruption of corticocortical pathways that lead to the severe impairment of cognitive function commonly observed in age-related dementing disorders.

Non-NASA Center↗

Diagnosing Warm Frontal Cloud Formation in a GCM: A Novel Approach Using Conditional Subsetting

This study analyzes characteristics of clouds and vertical motion across extratropical cyclone warm fronts in the NASA Goddard Institute for Space Studies general circulation model. The validity of the modeled clouds is assessed using a combination of satellite observations from CloudSat, Cloud-Aerosol Lidar and Infrared Pathfinder Satellite Observations (CALIPSO), Advanced Microwave Scanning Radiometer for Earth Observing System (AMSR-E), and the NASA Modern-Era Retrospective Analysis for Research and Applications (MERRA) reanalysis. The analysis focuses on developing cyclones, to test the model's ability to generate their initial structure. To begin, the extratropical cyclones and their warm fronts are objectively identified and cyclone-local fields are mapped into a vertical transect centered on the surface warm front. To further isolate specific physics, the cyclones are separated using conditional subsetting based on additional cyclone-local variables, and the differences between the subset means are analyzed. Conditional subsets are created based on 1) the transect clouds and 2) vertical motion; 3) the strength of the temperature gradient along the warm front, as well as the storm-local 4) wind speed and 5) precipitable water (PW). The analysis shows that the model does not generate enough frontal cloud, especially at low altitude. The subsetting results reveal that, compared to the observations, the model exhibits a decoupling between cloud formation at high and low altitudes across warm fronts and a weak sensitivity to moisture. These issues are caused in part by the parameterized convection and assumptions in the stratiform cloud scheme that are valid in the subtropics. On the other hand, the model generates proper covariability of low-altitude vertical motion and cloud at the warm front and a joint dependence of cloudiness on wind and PW.

cyclones↗

On the reliable and flexible solution of practical subset regression problems

A new algorithm for solving subset regression problems is described. The algorithm performs a QR decomposition with a new column-pivoting strategy, which permits subset selection directly from the originally defined regression parameters. This, in combination with a number of extensions of the new technique, makes the method a very flexible tool for analyzing subset regression problems in which the parameters have a physical meaning.

Verhaegen, M. H.↗

On the reliable and flexible solution of practical subset regression problems

A new algorithm for solving subset regression problems is described. The algorithm performs a QR decomposition with a new column-pivoting strategy, which permits subset selection directly from the originally defined regression parameters. This, in combination with a number of extensions of the new technique, makes the method a very flexible tool for analyzing subset regression problems in which the parameters have a physical meaning.

Verhaegen, M.↗

Algorithm For Solution Of Subset-Regression Problems

Reliable and flexible algorithm for solution of subset-regression problem performs QR decomposition with new column-pivoting strategy, enables selection of subset directly from originally defined regression parameters. This feature, in combination with number of extensions, makes algorithm very flexible for use in analysis of subset-regression problems in which parameters have physical meanings. Also extended to enable joint processing of columns contaminated by noise with those free of noise, without using scaling techniques.

Verhaegen, Michel↗

AIRS Data Subsetting Service at the Goddard Earth Sciences (GES) DISC/DAAC

The AIRS mission, as a combination of the Atmospheric Infrared Sounder (AIRS), the Advanced Microwave Sounding Unit (AMSU) and the Humidity Sounder for Brazil (HSB), brings climate research and weather prediction into 21st century. From NASA' Aqua spacecraft, the AIRS/AMSU/HSB instruments measure humidity, temperature, cloud properties and the amounts of greenhouse gases. The AIRS also reveals land and sea- surface temperatures. Measurements from these three instruments are analyzed . jointly to filter out the effects of clouds from the IR data in order to derive clear-column air-temperature profiles and surface temperatures with high vertical resolution and accuracy. Together, they constitute an advanced operational sounding data system that have contributed to improve global modeling efforts and numerical weather prediction; enhance studies of the global energy and water cycles, the effects of greenhouse gases, and atmosphere-surface interactions; and facilitate monitoring of climate variations and trends. The high data volume generated by the AIRS/AMSU/HSB instruments and the complexity of its data format (Hierarchical Data Format, HDF) are barriers to AIRS data use. Although many researchers are interested in only a fraction of the data they receive or request, they are forced to run their algorithms on a much larger data set to extract the information of interest. In order to better server its users, the GES DISC/DAAC, provider of long-term archives and distribution services as well science support for the AIRS/AMSU/HSB data products, has developed various tools for performing channels, variables, parameter, spatial and derived products subsetting, resampling and reformatting operations. This presentation mainly describes the web-enabled subsetting services currently available at the GES DISC/DAAC that provide subsetting functions for all the Level 1B and Level 2 data products from the AIRS/AMSU/HSB instruments.

Vicente, Gilberto A.↗

Satellite Level 3 & 4 Data Subsetting at NASA GES DISC

Earth Science data are available in many file formats (NetCDF, HDF, GRB, etc.) and in a wide range of sizes, from kilobytes to gigabytes. These properties have become a challenge to users if they are not familiar with these formats or only want a small region of interest (ROI) from a specific dataset. At NASA Goddard Earth Sciences Data and Information Services Center (GES DISC), we have developed and implemented a multipurpose subset service to ease user access to Earth Science data. Our Level 3 & 4 Regridder is capable of subsetting across multiple parameters (spatially, temporally, by level, and by variable) as well as having additional beneficial features (temporal means, regridding to target grids, and file conversion to other data formats). In this presentation, we will demonstrate how users can use this service to better access only the data they need in the form they require.

subsetting↗

Design of a verifiable subset for HAL/S

An attempt to evaluate the applicability of program verification techniques to the existing programming language, HAL/S is discussed. HAL/S is a general purpose high level language designed to accommodate the software needs of the NASA Space Shuttle project. A diversity of features for scientific computing, concurrent and real-time programming, and error handling are discussed. The criteria by which features were evaluated for inclusion into the verifiable subset are described. Individual features of HAL/S with respect to these criteria are examined and justification for the omission of various features from the subset is provided. Conclusions drawn from the research are presented along with recommendations made for the use of HAL/S with respect to the area of program verification.

Browne, J. C.↗

The minimal residual QR-factorization algorithm for reliably solving subset regression problems

A new algorithm to solve test subset regression problems is described, called the minimal residual QR factorization algorithm (MRQR). This scheme performs a QR factorization with a new column pivoting strategy. Basically, this strategy is based on the change in the residual of the least squares problem. Furthermore, it is demonstrated that this basic scheme might be extended in a numerically efficient way to combine the advantages of existing numerical procedures, such as the singular value decomposition, with those of more classical statistical procedures, such as stepwise regression. This extension is presented as an advisory expert system that guides the user in solving the subset regression problem. The advantages of the new procedure are highlighted by a numerical example.

Verhaegen, M. H.↗

Subsetting of AVHRR and ERBE Data

One of the critical issues of EOSDIS is data subsetting. Often users require data from only a selected region of interest. This paper outlines a few examples of subsetting that have been applied to existing satellite data for earth radiation budget studies.

Christopher, Sundar A.↗