Search NASA⌕ Search

SEARCH · Search NASA

Results for “data ordering”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
NASA NTRS2000

Method and device for maximizing memory system bandwidth by accessing data in a dynamically determined order

A data processing system is disclosed which comprises a data processor and memory control device for controlling the access of information from the memory. The memory control device includes temporary storage and decision ability for determining what order to execute the memory accesses. The compiler detects the requirements of the data processor and selects the data to stream to the memory control device which determines a memory access order. The order in which to access said information is selected based on the location of information stored in the memory. The information is repeatedly accessed from memory and stored in the temporary storage until all streamed information is accessed. The information is stored until required by the data processor. The selection of the order in which to access information maximizes bandwidth and decreases the retrieval time.

Wulf, William A.↗
NASA NTRS2006

Merging IceSAT GLAS and Terra MODIS Data in Order to Derive Forest Type Specific Tree Heights in the Central Siberian Boreal Forest

Mapping of boreal forest's type, biomass, and other structural parameters are critical for understanding of the boreal forest's significance in the carbon cycle, its response to and impact on global climate change. We believe the nature of the forest structure information available from MISR and GLAS can be used to help identify forest type, age class, and estimate above ground biomass levels beyond that now possible with MODIS alone. The ground measurements will be used to develop relationships between remote sensing observables and forest characteristics and provide new information for understanding forest changes with respect to environmental change. Lidar is a laser altimeter that determines the distance from the instrument to the physical surface by measuring the time elapsed between the pulse emission and the reflected return. Other studies have shown that the returned signal may identify multiple returns originating from trees, building and other objects and permits the calculation of their height. Studies using field data have shown that lidar data can provide estimates of structural parameters such as biomass, stand volume and leaf area index and allows remarkable differentiation between primary and secondary forest. NASA's IceSAT Geoscience Laser Altimeter System (GLAS) was launched in January 2003 and collected data during February and September of that year. This study used data acquired over our study sites in central Siberia to examine the GLAS signal as a source of forest height and other structural characteristics. The purpose of our Siberia project is to improve forest cover maps and produce above-ground biomass maps of the boreal forest in Northern Eurasia from MODIS by incorporating structural information inherent in the Terra MISR and ICESAT Geoscience Laser Altimeter System (GLAS) instruments. A number of forest cover classifications exist for the boreal forest. We believe the limiting factor in these products is the lack of structural information, particularly in the vertical dimension. The emphasis of this project is to improve upon satellite maps of boreal forest structure parameters (i.e. height and biomass) using temporal, multi-angle, and vertical profile information of GLAS data. The existing and near future lidar data is useful for demonstrating these techniques and pursuing current estimates. Future lidar missions may be several years in the future, so we will work other new data sets that may aide in biomass estimates such as ALOS PALSAR We will continue this work to produce an accurate map of current above ground forest phytomass/carbon storage possible for the study area. We plan to develop, test, and integrate remote sensing methods for extracting forest canopy structure measures. We are compiling our field measurements and will compare them with the remote sensing methods where possible. We also be able to produce a realistic error bound on the remotely sensed carbon estimates.

Ranson, K. Jon↗
NASA NTRS2005

NASA Earth Observations (NEO): Data Access for Informal Education and Outreach

The NEO (NASA Earth Observations) web space is currently under development with the goal of significantly increasing the demand for NASA remote sensing data while dramatically simplifying public access to georeferenced images. NEO will target the unsophisticated, nontraditional data users who are currently underserved by the existing data ordering systems. These users will include formal and informal educators, museum and science center personnel, professional communicators, and citizen scientists and amateur Earth observers. Users will be able to view and manipulate georeferenced browse imagery and, if they desire, download directly or order the source HDF data from the data provider (e.g., NASA DAAC or science team) via a single, integrated interface. NE0 will accomplish this goal by anticipating users expectations and knowledge level, thus providing an interface that presents material to users in a more simplified manner, without relying upon the jargon/technical terminology that make even the identification of the appropriate data set a significant hurdle. NEO will also act as a gateway that manages users expectations by providing specific details about images and data formats, developing tutorials regarding the manipulation of georeferenced imagery and raw data, links to software tools and ensuring that users are able to get the image they want in the format they want as easily as possible.

Ward, Kevin↗
DOE OSTI2020

Pilot Study for Determining HVAC Fault Prevalence from Fault Monitoring Data

HVAC faults in U.S. commercial buildings are estimated to waste 0.7 quads of energy annually and many companies have deployed software at scale for fault detection and diagnosis (FDD). Yet the lack of comprehensive published data on fault prevalence makes it difficult for researchers, software developers, and building operators to target the most important types of faults and accelerate the widespread deployment of this technology. A multi-lab effort is underway to quantify the prevalence of commercial building HVAC faults. This paper describes initial analysis conducted on over 2-years of FDD data from 12 campus buildings to inform the methodology and data collection strategy of the full study. The analysis found a large variability in fault prevalence across different buildings, pieces of equipment, and fault types, many duplicate fault alarms, and challenges in validating faults with secondary data sources such as manually entered work order data. This paper also discusses the requirements for a successful full study, which necessitates the acquisition of a large, diverse dataset, from buildings that vary in end-use, climate region, and installed FDD software platform, as well as robust validation data easily linked to the FDD data. It is especially important to perform this analysis on data from multiple FDD providers and building owners to ensure that the results are agnostic to the software methodology used and building-specific settings. Future work will present the results of the full study, which will contain data from several different partner organizations, spanning a large proportion of U.S. climate zones.

Newman, Sarah F.↗
NASA NTRS2011

Determining the Optimal Number of Clusters with the Clustergram

Cluster analysis aids research in many different fields, from business to biology to aerospace. It consists of using statistical techniques to group objects in large sets of data into meaningful classes. However, this process of ordering data points presents much uncertainty because it involves several steps, many of which are subject to researcher judgment as well as inconsistencies depending on the specific data type and research goals. These steps include the method used to cluster the data, the variables on which the cluster analysis will be operating, the number of resulting clusters, and parts of the interpretation process. In most cases, the number of clusters must be guessed or estimated before employing the clustering method. Many remedies have been proposed, but none is unassailable and certainly not for all data types. Thus, the aim of current research for better techniques of determining the number of clusters is generally confined to demonstrating that the new technique excels other methods in performance for several disparate data types. Our research makes use of a new cluster-number-determination technique based on the clustergram: a graph that shows how the number of objects in the cluster and the cluster mean (the ordinate) change with the number of clusters (the abscissa). We use the features of the clustergram to make the best determination of the cluster-number.

Fluegemann, Joseph K.↗
NASA NTRS2020

GeneLab

GeneLab collects and enables analysis of spaceflight and ground-based spaceflight simulation genomic data, RNA and protein expression, and metabolic profiles. It interfaces with other existing databases containing spaceflight omic data. The 2011 National Research Council (NRC) Decadal Survey on NASA Life and Physical Sciences called for increased opportunities for multi-investigator spaceflight opportunities and greater use of genomic approaches to meet the needs of NASA researchers. To address these recommendations of the NRC Decadal Survey, the Space Life and Physical Sciences Research and Applications Division of NASA's Human Exploration and Operations Mission Directorate has initiated a transition to an Open Science architecture to increase research opportunities, and has developed the GeneLab Platform based on highly leveraged and integrated bioinformatics analytics. GeneLab is an interactive, open-access resource where scientists can upload, download, store, search, share, transfer, and analyze omics data from spaceflight and corresponding analogue experiments. Users can explore GeneLab datasets in the Data Repository, analyze data using the Analysis Platform, visualize high-order data and create collaborative projects using the Collaborative Workspace. Our primary goal is to maximize the utilization of the valuable biological research conducted aboard the International Space Station (ISS) by collecting genomic, transcriptomic, proteomic, and metabolomics data known as “omics”. By providing a portal linking processed data to flight parameters, GeneLab enables exploration of the molecular network responses of terrestrial biology to the space environment. This allows researchers to understand the complex responses of biological systems to the space environment. This technology development activity was transferred from the Human Exploration and Operations Mission Directorate to the Science Mission Directorate Division of Biological and Physical Sciences (BPS) in October 2020.

GeneLab↗
DOE OSTI2023

BEYONDPLANCK II. CMB mapmaking through Gibbs sampling

We present a Gibbs sampling solution to the mapmaking problem for cosmic microwave background (CMB) measurements that builds on existing destriping methodology. Gibbs sampling breaks the computationally heavy destriping problem into two separate steps: noise filtering and map binning. Considered as two separate steps, both are computationally much cheaper than solving the combined problem. This provides a huge performance benefit as compared to traditional methods and it allows us, for the first time, to bring the destriping baseline length to a single sample. Here, we applied the Gibbs procedure to simulated Planck 30 GHz data. We find that gaps in the time-ordered data are handled efficiently by filling them in with simulated noise as part of the Gibbs process. The Gibbs procedure yields a chain of map samples, from which we are able to compute the posterior mean as a best-estimate map. The variation in the chain provides information on the correlated residual noise, without the need to construct a full noise covariance matrix. However, if only a single maximum-likelihood frequency map estimate is required, we find that traditional conjugate gradient solvers converge much faster than a Gibbs sampler in terms of the total number of iterations. The conceptual advantages of the Gibbs sampling approach lies in statistically well-defined error propagation and systematic error correction. This methodology thus forms the conceptual basis for the mapmaking algorithm employed in the BEYONDPLANCK framework, which implements the first end-to-end Bayesian analysis pipeline for CMB observations.

79 ASTRONOMY AND ASTROPHYSICS↗
NASA NTRS1988

IUE archived spectra

The International Ultraviolet Explorer (IUE) Satellite has been in continuous operation since January 26, 1978. To date, approximately 65,000 spectra have been stored in an archive at Goddard Space Flight Center in Greenbelt, MD. A number of procedures have been generated to facilitate access to the data in the IUE spectral archive. This document describes the procedures which include on-line quick look of the displays, search of an observation data base for selected observations, and several methods for ordering data from the archive.

Sullivan, Edward C.↗
DOE OSTI2023

BeyondPlanck: XII. Cosmological parameter constraints with end-to-end error propagation

We present cosmological parameter constraints estimated using the Bayesian BEYONDPLANCK analysis framework. This method supports seamless end-to-end error propagation from raw time-ordered data onto final cosmological parameters. As a first demonstration of the method, we analyzed time-ordered Planck LFI observations, combined with selected external data (WMAP 33–61 GHz, Planck HFI DR4 353 and 857 GHz, and Haslam 408 MHz) in the form of pixelized maps that are used to break critical astrophysical degeneracies. Overall, all the results are generally in good agreement with previously reported values from Planck 2018 and WMAP, with the largest relative difference for any parameter amounting about 1σ when considering only temperature multipoles between 30 ≤ ℓ ≤ 600. In cases where there are differences, we note that the BEYONDPLANCK results are generally slightly closer to the high-ℓ HFI-dominated Planck 2018 results than previous analyses, suggesting slightly less tension between low and high multipoles. Using low-ℓ polarization information from LFI and WMAP, we find a best-fit value of τ = 0.066 ± 0.013, which is higher than the low value of τ = 0.052 ± 0.008 derived from Planck 2018 and slightly lower than the value of 0.069 ± 0.011 derived from the joint analysis of official LFI and WMAP products. Most importantly, however, we find that the uncertainty derived in the BEYONDPLANCK processing is about 30 % greater than when analyzing the official products, after taking into account the different sky coverage. We argue that this uncertainty is due to a marginalization over a more complete model of instrumental and astrophysical parameters, which results in more reliable and more rigorously defined uncertainties. We find that about 2000 Monte Carlo samples are required to achieve a robust convergence for a low-resolution cosmic microwave background (CMB) covariance matrix with 225 independent modes, and producing these samples takes about eight weeks on a modest computing cluster with 256 cores.

79 ASTRONOMY AND ASTROPHYSICS↗
NASA NTRS2013

Usage of Data-Encoded Web Maps with Client Side Color Rendering for Combined Data Access, Visualization and Modeling Purposes

Current approaches to satellite observation data storage and distribution implement separate visualization and data access methodologies which often leads to the need in time consuming data ordering and coding for applications requiring both visual representation as well as data handling and modeling capabilities. We describe an approach we implemented for a data-encoded web map service based on storing numerical data within server map tiles and subsequent client side data manipulation and map color rendering. The approach relies on storing data using the lossless compression Portable Network Graphics (PNG) image data format which is natively supported by web-browsers allowing on-the-fly browser rendering and modification of the map tiles. The method is easy to implement using existing software libraries and has the advantage of easy client side map color modifications, as well as spatial subsetting with physical parameter range filtering. This method is demonstrated for the ASTER-GDEM elevation model and selected MODIS data products and represents an alternative to the currently used storage and data access methods. One additional benefit includes providing multiple levels of averaging due to the need in generating map tiles at varying resolutions for various map magnification levels. We suggest that such merged data and mapping approach may be a viable alternative to existing static storage and data access methods for a wide array of combined simulation, data access and visualization purposes.

Pliutau, Denis↗
NASA NTRS2002

Spectral (Finite) Volume Method for Conservation Laws on Unstructured Grids II: Extension to Two Dimensional Scalar Equation

The framework for constructing a high-order, conservative Spectral (Finite) Volume (SV) method is presented for two-dimensional scalar hyperbolic conservation laws on unstructured triangular grids. Each triangular grid cell forms a spectral volume (SV), and the SV is further subdivided into polygonal control volumes (CVs) to supported high-order data reconstructions. Cell-averaged solutions from these CVs are used to reconstruct a high order polynomial approximation in the SV. Each CV is then updated independently with a Godunov-type finite volume method and a high-order Runge-Kutta time integration scheme. A universal reconstruction is obtained by partitioning all SVs in a geometrically similar manner. The convergence of the SV method is shown to depend on how a SV is partitioned. A criterion based on the Lebesgue constant has been developed and used successfully to determine the quality of various partitions. Symmetric, stable, and convergent linear, quadratic, and cubic SVs have been obtained, and many different types of partitions have been evaluated. The SV method is tested for both linear and non-linear model problems with and without discontinuities.

Wang, Z. J.↗
NASA NTRS2004

The LATEST Project: Operational Assessment of Total Lightning Data in the U.S.

A government, university, and industry alliance has joined forces to transition total lightning observations from ground-based research networks and NASA satellites (LIS/TRMM) to improve the short range prediction of severe weather. This interest builds on the desire of the U.S Weather Research Program to foster a national Nowcasting Test Bed, with this specific transition activity initiated through the NASA short-term Prediction Research and Transition (SPoRT) Center in Huntsville, AL. A kick-off national workshop sponsored by the SPoRT Center was held in Huntsville April 1-2 to identify the common goals and objectives of the research and operational community, and to assign roles and responsibilities within the alliance. The workshop agenda, presentations, and summary are available at the SPoRT Center Web site ( h h under the "Meetings" tab. The next national workshop is planned for 2005 in Dallas, TX. The NASA North Alabama regional Lightning Mapping Array &MA) has been operational in the Huntsville area for 3 years, and has continuously sampled a variety of severe weather systems during that period. A gridded version of the LMA total lightning data is currently being supplied to National Weather Service offices in Huntsville, Nashville and Birmingham through the NWS AWES decision support system, for the purposes of assessing the utility of the data in the nowcasting of severe weather such as tornadoes, damaging straight line winds, flash flooding and other weather hazards (lightning induced forest fires, microbursts). While the raw LMA data have been useful to NWS forecasters, even greater utility would be realized if higher-order data products could be supplied through AWIPS along with the gridded data over a larger domain. In 2003-2004 additional LMA systems have been deployed across the southern US. from Florida to New Mexico, providing an opportunity for more than 20 NWS forecast offices to evaluate the incremental value of total lightning data in the warning decision making process.

Goodman, Steven↗
DOE OSTI2020

Method and apparatus for maintaining data coherence in a non-uniform compute device

A data processing apparatus includes one or more host processors with first processing units, one or more caches with second processing unit, a non-cache memory having a third processing unit and a reorder buffer operable to maintain data order during execution of a program of instructions. An instruction scheduler routes instructions to the processing units. Data coherence is maintained by control logic that blocks access to data locations in use by a selected processing unit other than the selected processing unit until data associated with the data locations are released from the reorder buffer. Data stored in the cache is written to the memory if it is already in a modified state, otherwise the state is set to the modified state. A memory controller may be used to restrict access to memory locations to be operated on.

97 MATHEMATICS AND COMPUTING↗