Search NASA⌕ Search

SEARCH · Search NASA

Results for “data set”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,549 records · Page 86

Forest response to increased disturbance in the central Amazon and comparison to western Amazonian forests

Uncertainties surrounding vegetation response to increased disturbance rates associated with climate change remains a major global change issue for Amazonian forests. Additionally, turnover rates computed as the average of mortality and recruitment rates in the western Amazon basin are doubled when compared to the central Amazon, and notable gradients currently exist in specific wood density and aboveground biomass (AGB) between these two regions. This study investigates the extent to which the variation in disturbance regimes contributes to these regional gradients. To address this issue, we evaluated disturbance–recovery processes in a central Amazonian forest under two scenarios of increased disturbance rates using first ZELIG-TROP, a dynamic vegetation gap model which we calibrated using long-term inventory data, and second using the Community Land Model (CLM), a global land surface model that is part of the Community Earth System Model (CESM). Upon doubling the mortality rate in the central Amazon to mirror the natural disturbance regime in the western Amazon of ~2% mortality, the two regions continued to differ in multiple forest processes. With the inclusion of elevated natural disturbances, at steady state, AGB significantly decreased by 41.9% with no significant difference between modeled AGB and empirical AGB from the western Amazon data sets (104 vs. 107 Mg C ha -1 , respectively). However, different processes were responsible for the reductions in AGB between the models and empirical data set. The empirical data set suggests that a decrease in wood density is a driver leading to the reduction in AGB. While decreased stand basal area was the driver of AGB loss in ZELIG-TROP, a forest attribute that does not significantly vary across the Amazon Basin. Further comparisons found that stem density, specific wood density, and basal area growth rates differed between the two Amazonian regions. Last, to help quantify the impacts of increased disturbances on the climate and earth system, we evaluated the fidelity of tree mortality and disturbance in CLM. Similar to ZELIG-TROP, CLM predicted a net carbon loss of 49.9%, with an insignificant effect on aboveground net primary productivity (ANPP). Decreased leaf area index (LAI) was the driver of AGB loss in CLM, another forest attribute that does not significantly vary across the Amazon Basin, and the temporal variability in carbon stock and fluxes was not replicated in CLM. Our results suggest that (1) the variability between regions cannot be entirely explained by the variability in disturbance regime, but rather potentially sensitive to intrinsic environmental factors; or (2) the models are not accurately simulating all tropical forest characteristics in response to increased disturbances.

54 ENVIRONMENTAL SCIENCES↗

Geographic information system for fusion and analysis of high-resolution remote sensing and ground truth data

We seek to combine high-resolution remotely sensed data with models and ground truth measurements, in the context of a Geographical Information System, integrated with specialized image processing software. We will use this integrated system to analyze the data from two Case Studies, one at a bore Al forest site, the other a tropical forest site. We will assess the information content of the different components of the data, determine the optimum data combinations to study biogeophysical changes in the forest, assess the best way to visualize the results, and validate the models for the forest response to different radar wavelengths/polarizations. During the 1990's, unprecedented amounts of high-resolution images from space of the Earth's surface will become available to the applications scientist from the LANDSAT/TM series, European and Japanese ERS-1 satellites, RADARSAT and SIR-C missions. When the Earth Observation Systems (EOS) program is operational, the amount of data available for a particular site can only increase. The interdisciplinary scientist, seeking to use data from various sensors to study his site of interest, may be faced with massive difficulties in manipulating such large data sets, assessing their information content, determining the optimum combinations of data to study a particular parameter, visualizing his results and validating his model of the surface. The techniques to deal with these problems are also needed to support the analysis of data from NASA's current program of Multi-sensor Airborne Campaigns, which will also generate large volumes of data. In the Case Studies outlined in this proposal, we will have somewhat unique data sets. For the Bonanza Creek Experimental Forest (Case I) calibrated DC-8 SAR data and extensive ground truth measurement are already at our disposal. The data set shows documented evidence to temporal change. The Belize Forest Experiment (Case II) will produce calibrated DC-8 SAR and AVIRIS data, together with extensive measurements on the tropical rain forest itself. The extreme range of these sites, one an Arctic forest, the other a tropical rain forest, has been deliberately chosen to find common problems which can lead to generalized observations and unique problems with data which raise issues for the EOS System.

Freeman, Anthony↗

Impact of [{sup 18}F]Fluorodeoxyglucose PET-CT Staging on Treatment Planning in Radiotherapy Incorporating Elective Nodal Irradiation for Non-Small-Cell Lung Cancer: A Prospective Study;Non-small-cell lung cancer; PET; Radiotherapy; Elective nodal irradiation

Purpose: To evaluate prospectively how positron emission tomography (PET) information changes treatment plans for non-small-cell lung cancer (NSCLC) patients receiving or not receiving elective nodal irradiation (ENI). Methods and Materials: One hundred consecutive patients referred for curative radiotherapy were included in the study. Treatment plans were carried out with CT data sets only. For stage III patients, mediastinal ENI was planned. Then, patients underwent PET-CT for diagnostic/planning purposes. PET/CT was fused with the CT data for final planning. New targets were delineated. For stage III patients with minimal N disease (N0-N1, single N2), the ENI was omitted in the new plans. Patients were treated according to the PET-based volumes and plans. The gross tumor volume (GTV)/planning tumor volume (PTV) and doses for critical structures were compared for both data sets. The doses for areas of potential geographical misses derived with the CT data set alone were compared in patients with and without initially planned ENI. Results: In the 75 patients for whom the decision about curative radiotherapy was maintained after PET/CT, there would have been 20 cases (27%) with potential geographical misses by using the CT data set alone. Among them, 13 patients would receive ENI; of those patients, only 2 patients had the PET-based PTV covered by 90% isodose by using the plans based on CT alone, and the mean of the minimum dose within the missed GTV was 55% of the prescribed dose, while for 7 patients without ENI, it was 10% (p = 0.006). The lung, heart, and esophageal doses were significantly lower for plans with ENI omission than for plans with ENI use based on CT alone. Conclusions: PET/CT should be incorporated in the planning of radiotherapy for NSCLC, even in the setting of ENI. However, if PET/CT is unavailable, ENI may to some extent compensate for an inadequate dose coverage resulting from diagnostic uncertainties.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Diagnostic Models for Wind Turbine Gearbox Components Using SCADA Time Series Data: Preprint

This paper presents a scalable, autonomous framework for diagnostics of wind turbine gearbox failures using a multi-feature supervisory control and data acquisition data set spanning multiple years. Because of the size of the data set studied, all algorithms were constructed to be scalable using a Spark-Hadoop data framework. An unsupervised approach was used to detect significant failures based on predetermined criteria. The initial criteria selected were an abnormal spike in turbine component temperature followed by a turbine power off, which helps reduce the number of potential false alarms. To detect abnormal spikes in component temperature, a model was introduced to adjust the temperature data for effects caused by ambient temperature and normal temperature increases when loaded. This study evaluates methods for normalizing temperature sensor data to identify anomalies. The models that performed the best were a linear regression and a multivariate polynomial regression. The proposed process for finding failures has tunable parameters that can be adjusted to be more or less sensitive. The combination of sensor data normalization and application of these criteria is successful in finding turbine failures resulting in downtime. The proposed methods can operate without failure or maintenance logs and can be utilized for offline analysis of large high-resolution data sets.

17 WIND ENERGY↗

A BAYESIAN METHOD FOR THE INTERCALIBRATION OF SPECTRA IN REVERBERATION MAPPING

Flux calibration of spectra in reverberation mapping (RM) is most often performed by assuming the flux constancy of some specified narrow emission lines, which stem from an extended region that is sometimes partially spatially resolved, in contrast to the point-like broad-line region and the central continuum source. The inhomogeneous aperture geometries used among different observation sets in a joint monitoring campaign introduce systematic deviations to the fluxes of broad lines and central continuum, and intercalibration over these data sets is required. As an improvement to the previous empirical correction performed by comparing the (nearly) contemporaneous observation points, we describe a feasible Bayesian method that obviates the need for (nearly) contemporaneous observations, naturally incorporates physical models of flux variations, and fully takes into account the measurement errors. In particular, it fits all the data sets simultaneously regardless of samplings and makes use of all of the information in the data sets. A Markov Chain Monte Carlo implementation is employed to recover the parameters and uncertainties for intercalibration. Application to the RM data sets of NGC 5548 with joint monitoring shows the high fidelity of our method.

79 ASTRONOMY AND ASTROPHYSICS↗

Evaluation of SLAR and thematic mapper MSS data for forest cover mapping using computer-aided analysis techniques

The column normalizing technique was used to adjust the data for variations in the amplitude of the signal due to look angle effects with respect to solar zenith angle along the scan lines (i.e., across columns). Evaluation of the data set containing the geometric and radiometric adjustments, indicates that the data set should be satisfactory for further processing and analysis. Software was developed for degrading the spatial resolution of the aircraft data to produce a total of four data sets for further analysis. The quality of LANDSAT 2 CCT data for the test site is good for channels four, five, and six. Channel seven was not present on the tape. The data received were reformatted and analysis of the test site area was initiated.

Hoffer, R. M.↗

Integration of SAR and DEM data: Geometrical considerations

General principles for integrating data from different sources are derived from the experience of registration of SAR images with digital elevation models (DEM) data. The integration consists of establishing geometrical relations between the data sets that allow us to accumulate information from both data sets for any given object point (e.g., elevation, slope, backscatter of ground cover, etc.). Since the geometries of the two data are completely different they cannot be compared on a pixel by pixel basis. The presented approach detects instances of higher level features in both data sets independently and performs the matching at the high level. Besides the efficiency of this general strategy it further allows the integration of additional knowledge sources: world knowledge and sensor characteristics are also useful sources of information. The SAR features layover and shadow can be detected easily in SAR images. An analytical method to find such regions also in a DEM needs in addition the parameters of the flight path of the SAR sensor and the range projection model. The generation of the SAR layover and shadow maps is summarized and new extensions to this method are proposed.

Kropatsch, Walter G.↗

Region-based convolutional neural network for wind turbine wake characterization from scanning lidars

A convolutional neural network is applied to lidar scan images from three experimental campaigns to identify and characterize wind turbine wakes. Initially developed as a proof-of-concept model and applied to a single data set in complex terrain, the model is now improved and generalized and applied to two other unique lidar data sets, one located near an escarpment and one located offshore. The model, initially developed using lidar scans collected in predominantly westerly flow, exhibits sensitivity to wind flow direction. The model is thus successfully generalized through implementing a standard rotation process to scan images before input into the convolutional neural network to ensure the flow is westerly. The sample size of lidar scans used to train the model is increased, and along with the generalization process, these changes to the model are shown to enhance accuracy and robustness when characterizing dissipating and asymmetric wakes. Applied to the offshore data set in which nearly 20 wind turbine wakes are included per scan, the improved model exhibits a 95% success rate in characterizing wakes and a 74% success rate in characterizing dissipating wake fragments. The improved model is shown to generalize well to the two new data sets, although an increase in wake characterization accuracy is offset by an increase in model sensitivity and false positive wake identifications.

17 WIND ENERGY↗

Models, data, and scripts associated with “Prediction of Distributed River Sediment Respiration Rates using Community-Generated Data and Machine Learning”

This data package is associated with the publication “Prediction of Distributed River Sediment Respiration Rates using Community-Generated Data and Machine Learning’’ submitted to the Journal of Geophysical Research: Machine Learning and Computation (Scheibe et al. 2024). River sediment respiration observations are expensive and labor intensive to obtain and there is no physical model for predicting this quantity. The Worldwide Hydrobiogeochemisty Observation Network for Dynamic River Systems (WHONDRS) observational data set (Goldman et al.; 2020) is used to train machine learning (ML) models to predict respiration rates at unsampled sites. This repository archives training data, ML models, predictions, and model evaluation results for the purposes of reproducibility of the results in the associated manuscript and community reuse of the ML models trained in this project. One of the key challenges in this work was to find an optimum configuration for machine learning models to work with this feature-rich (i.e. 100+ possible input variables) data set. Here, we used a two-tiered approach to managing the analysis of this complex data set: 1) a stacked ensemble of ML models that can automatically optimize hyperparameters to accelerate the process of model selection and tuning and 2) feature permutation importance to iteratively select the most important features (i.e. inputs) to the ML models. The major elements of this ML workflow are modular, portable, open, and cloud-based, thus making this implementation a potential template for other applications. This data package is associated with the GitHub repository found at Please see the file level metadata (flmd; “sl-archive-whondrs_flmd.csv”) for a list of all files contained in this data package and descriptions for each. Please see the data dictionary (dd; “sl-archive-whondrs_dd.csv”) for a list of all column headers contained within comma separated value (csv) files in this data package and descriptions for each. The GitHub repository is organized into five top-level directories: (1) “input_data” holds the training data for the ML models; (2) “ml_models” holds machine learning models trained on the data in “input_data”; (3) “scripts” contains data preprocessing and postprocessing scripts and intermediate results specific to this data set that bookend the ML workflow; (4) “examples” contains the visualization of the results in this repository including plotting scripts for the manuscript (e.g., model evaluation, FPI results) and scripts for running predictions with the ML models (i.e., reusing the trained ML models); (5) “output_data” holds the overall results of the ML model on that branch. Each trained ML model resides on its own branch in the repository; this means that inputs and outputs can be different branch-to-branch. Furthermore, depending on the number of features used to train the ML models, the preprocessing and postprocessing scripts, and their intermediate results, can also be different branch-to-branch. The “main-*” branches are meant to be starting points (i.e. trunks) for each model branch (i.e. sprouts). Please see the Branch Navigation section in the top-level README.md in the GitHub repository for more details. There is also one hidden directory “.github/workflows”. This hidden directory contains information for how to run the ML workflow as an end-to-end automated GitHub Action but it is not needed for reusing the ML models archived here. Please the top-level README.md in the GitHub repository for more details on the automation.

13C↗

Utilization of satellite-derived cloud cover to improve the estimation of latent heat release in a winter extratropical cyclone

A simple scheme for utilizing satellite cloud pattern information to improve the estimation of parameterized stable and convective latent heat release is proposed and tested for an extratropical cyclone occurring over the United States during January 9-11, 1975. Calculations are done over the standard North American rawinsonde data region and over a sparse data region simulated by ignoring one-third of the original rawinsonde stations. Results indicate 15 percent and 30 percent improvements in latent heating estimates derived from the total and sparse data sets, respectively. A larger improvement was found using the sparse data set because the parameterized latent heat release estimates obtained using these data were poorer than those obtained using the total data set.

Lin, S.-J.↗

ROSAT investigation of flaring and activity on Prox Cen

The objective of this program was to investigate with high sensitivity the low-level flare activity which may underlie coronal heating. This was done. The ROSAT observations of Prox Cen were scheduled for 50 ks spread out from 26 Feb. - 10 Mar. 1992. Unfortunately because of spacecraft problems many of these pointings turned out to contain no useful data or extremely truncated valid data sets. Considerable time was spent trying to determine which of the data would be scientifically useful and which would not. Fortunately, several developments took place to augment the original data in such a way that the scientific goal of advancing the study of flaring and variability was able to be achieved after all. These are as follows: (1) a second round of ROSAT observations was carried out in Feb. 1993 which only came to the attention of the PI in Apr. 1993 when a new data tape arrived; (2) simultaneous IUE observations were requested and obtained; (3) data from the UK WFC are available via the collaboration with Dr. G. Bromage; and (4) the 'cleaned-up' original data set was found to include one major flare and 2 moderate flares. Because of the problems with the original data set, the unexpected acquisition of new data only two months ago, and the availability of IUE and WFC data, an article on Prox Cen for publication is not ready at this time. Such an article is being developed and can be completed as part of ongoing ROSAT research efforts on stellar coronae and flaring.

Haisch, Bernhard↗

Demand-Side Grid Model (dsgrid) Data from the Electrification Futures Project (EFS)

This data set contains the full-resolution and state-level data described in the linked technical report (https://www.nrel.gov/docs/fy18osti/71492.pdf). It can be accessed with the NREL-dsgrid-legacy-efs-api, available on GitHub at https://github.com/dsgrid/dsgrid-legacy-efs-api and through PyPI (pip install NREL-dsgrid-legacy-efs-api). The data format is HDF5. The API is written in Python. This initial dsgrid data set, whose description was originally published in 2018, covers electricity demand in the contiguous United States (CONUS) for the historical year of 2012. It is a proof-of-concept demonstrating the feasibility of reconciling bottom-up demand modeling results with top-down information about electricity demand to create a more detailed description than is possible with either type of data source on its own. The result is demand data that is more highly resolved along geographic, temporal, sectoral, and end-use dimensions as may be helpful for conducting electricity sector-wide "what-if" analysis of, e.g., energy efficiency, electrification, and/or demand flexibility. Although we conducted bottom-up versus top-down validation, the final residuals were significant, especially at higher geographic and temporal resolution. Please see the Executive Summary and/or Section 3 of the report to obtain an understanding of the data set limitations before deciding whether these data are suitable for any particular use case. New dsgrid datasets are under development. Please visit https://www.nrel.gov/analysis/dsgrid.html for the latest information which is also linked in the data resources.

analysis↗

The special effort processing of FGGE data

The basic FGGE level IIb data set was enhanced. It focused on removing deficiencies in the objective methods of quality assurance, removing efficiencies in certain types of operationally produced satellite soundings, and removing deficiencies in certain types of operationally produced cloud tracked winds. The Special Effort was a joint NASA-NOAA-University of Wisconsin effort. The University of Wisconsin installed an interactive McIDAS capability on the Amdahl computer at the Goddard Laboratory of Atmospheric Sciences (GLAS) with one interactive video terminal at Goddard and the other at the World Weather Building. With this interactive capability a joint processing effort was undertaken to reprocess certain FGGE data sets. NOAA produced a specially edited data set for the special observing periods (SOPs) of FGGE. NASA produced an enhanced satellite sounding data set for the SOPs while the University of Wisconsin produced an enhanced cloud tracked wind set from the Japanese geostationary satellite images.

Source record↗

COSMOGRAIL XVIII: time delays of the quadruply lensed quasar WFI2033-4723

We present new measurements of the time delays of WFI2033-4723. The data sets used in this work include 14 years of data taken at the 1.2m Leonhard Euler Swiss telescope, 13 years of data from the SMARTS 1.3m telescope at Las Campanas Observatory and a single year of high-cadence and high-precision monitoring at the MPIA 2.2m telescope. The time delays measured from these different data sets, all taken in the R-band, are in good agreement with each other and with previous measurements from the literature. Combining all the time-delay estimates from our data sets results in Dt_AB = 36.2-0.8+0.7 days (2.1% precision), Dt_AC = -23.3-1.4+1.2 days (5.6%) and Dt_BC = -59.4-1.3+1.3 days (2.2%). In addition, the close image pair A1-A2 of the lensed quasars can be resolved in the MPIA 2.2m data. We measure a time delay consistent with zero in this pair of images. We also explore the prior distributions of microlensing time-delay potentially affecting the cosmological time-delay measurements of WFI2033-4723. There is however no strong indication in our measurements that microlensing time delay is neither present nor absent. This work is part of a H0LiCOW series focusing on measuring the Hubble constant from WFI2033-4723.

79 ASTRONOMY AND ASTROPHYSICS↗

A comparison of SMMR and AVHRR data for continental land cover characterization

Images using reflected visible and NIR data and images using passive microwave data were compared in terms of their usefulness for characterizing land-cover types in South America and Africa. The former images are of the normalized difference vegetation index (NDVI), and the latter images are of the microwave polarization difference temperature (MPDT). The combined use of MPDT and NDVI data sets show clear synergistic benefits in using the two data sets. However, the evidence suggests that for most cover types, increasing the temporal frequency of the NDVI images is more advantageous than incorporating MPDT data sets.

Townshend, J. R. G.↗

Streaming Compression of Scientific Data via Weak-SINDy

Here, in this paper, a streaming weak-SINDy algorithm is developed specifically for compressing streaming scientific data. The production of scientific data, either via simulation or experiments, is undergoing a stage of exponential growth, which makes data compression important and often necessary for storing and utilizing large scientific data sets. As opposed to classical “offline” compression algorithms that perform compression on a readily available data set, streaming compression algorithms compress data “online” while the data generated from simulation or experiments is still flowing through the system. This feature makes streaming compression algorithms well suited for scientific data compression, where storing the full data set offline is often infeasible. This work proposes a new streaming compression algorithm, streaming weak-SINDy, which takes advantage of the underlying data characteristics during compression. The streaming weak-SINDy algorithm constructs feature matrices and target vectors in the online stage via a streaming integration method in a memory efficient manner. The feature matrices and target vectors are then used in the offline stage to build a model through a regression process that aims to recover equations that govern the evolution of the data. For compressing high-dimensional streaming data, we adopt a streaming proper orthogonal decomposition (POD) process to reduce the data dimension and then use the streaming weak-SINDy algorithm to compress the temporal data of the POD expansion. We propose modifications to the streaming weak-SINDy algorithm to accommodate the dynamically updated POD basis. By combining the built model from the streaming weak-SINDy algorithm and a small amount of data samples, the full data flow could be reconstructed accurately at a low memory cost, as shown in the numerical tests.

97 MATHEMATICS AND COMPUTING↗

HPC Analytics Support. Requirements for Uncertainty Quantification Benchmarks

This report outlines techniques for extending benchmark generation products so they support uncertainty quantification by benchmarked systems. We describe how uncertainty quantification requirements can be presented to candidate analytical tools supporting SPARQL. We describe benchmark data sets for evaluating uncertainty quantification, as well as an approach for using our benchmark generator to produce data sets for generating benchmark data sets.

benchmark↗

Geographic information system for fusion and analysis of high-resolution remote sensing and ground data

We seek to combine high-resolution remotely sensed data with models and ground truth measurements, in the context of a Geographical Information System (GIS), integrated with specialized image processing software. We will use this integrated system to analyze the data from two Case Studies, one at a boreal forest site, the other a tropical forest site. We will assess the information content of the different components of the data, determine the optimum data combinations to study biogeophysical changes in the forest, assess the best way to visualize the results, and validate the models for the forest response to different radar wavelengths/polarizations. During the 1990's, unprecedented amounts of high-resolution images from space of the Earth's surface will become available to the applications scientist from the LANDSAT/TM series, European and Japanese ERS-1 satellites, RADARSAT and SIR-C missions. When the Earth Observation Systems (EOS) program is operational, the amount of data available for a particular site can only increase. The interdisciplinary scientist, seeking to use data from various sensors to study his site of interest, may be faced with massive difficulties in manipulating such large data sets, assessing their information content, determining the optimum combinations of data to study a particular parameter, visualizing his results and validating his model of the surface. The techniques to deal with these problems are also needed to support the analysis of data from NASA's current program of Multi-sensor Airborne Campaigns, which will also generate large volumes of data. In the Case Studies outlined in this proposal, we will have somewhat unique data sets. For the Bonanza Creek Experimental Forest (Case 1) calibrated DC-8 SAR (Synthetic Aperture Radar) data and extensive ground truth measurement are already at our disposal. The data set shows documented evidence to temporal change. The Belize Forest Experiment (Case 2) will produce calibrated DC-8 SAR and AVIRIS data, together with extensive measurements on the tropical rain forest itself. The extreme range of these sites, one an Arctic forest, the other a tropical rain forest, has been deliberately chosen to find common problems which can lead to generalized observations and unique problems with data which raise issues for the EOS System.

Freeman, Anthony↗