Search NASA⌕ Search

SEARCH · Search NASA

Results for “data locality”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 379 records · Page 21
All sourcesNASA NTRSDOE OSTI
NASA NTRS1983

Stagnation region gas film cooling: Effects of dimensionless coolant temperature

An experimental investigation was conducted to mode the film cooling performance for a turbine vane leading edge using the stagnation region of a cylinder in cross flow. Experiments were conducted with a single row of spanwise angled (25 deg) coolant holes for a range of the coolant blowing ratio and dimensionless coolant temperature with free stream-to-wall temperature ratio approximately 1.7 and Re sub D = 90000. the cylindrical test surface was instrumented with miniature heat flux gages and wall thermocouples to determine the percentage reduction in the Stanton number as a function of the distance downstream from injection (x/d sub 0) and the location between adjacent holes (z/S). Data from local heat flux measurements are presented for injection from a single row located at 5 deg, 22.9 deg, 40.8 deg, from stagnation using a hole spacing ratio of S/d = 5. The film coolant was injected with T sub c T sub w with a dimensionless coolant temperature in the range 1.18 or equal to theta sub c or equal to 1.56. The data for local Stanton Number Reduction (SNR) showed a significant increase in SNR as theta sub c was increased above 1.0.

Bonnice, M. A.↗
NASA NTRS1976

Program on Earth Observation Data Management Systems (EODMS)

An assessment was made of the needs of a group of potential users of satellite remotely sensed data (state, regional, and local agencies) involved in natural resources management in five states, and alternative data management systems to satisfy these needs are outlined. Tasks described include: (1) a comprehensive data needs analysis of state and local users; (2) the design of remote sensing-derivable information products that serve priority state and local data needs; (3) a cost and performance analysis of alternative processing centers for producing these products; (4) an assessment of the impacts of policy, regulation and government structure on implementing large-scale use of remote sensing technology in this community of users; and (5) the elaboration of alternative institutional arrangements for operational Earth Observation Data Management Systems (EODMS). It is concluded that an operational EODMS will be of most use to state, regional, and local agencies if it provides a full range of information services -- from raw data acquisition to interpretation and dissemination of final information products.

Eastwood, L. F., Jr.↗
NASA NTRS2017

Comparison of Satellite Rainfall Estimates and Rain Gauge Measurements in Italy, and Impact on Landslide Modeling

Landslides can be triggered by intense or prolonged rainfall. Rain gauge measurements are commonly used to predict landslides even if satellite rainfall estimates are available. Recent research focuses on the comparison of satellite estimates and gauge measurements. The rain gauge data from the Italian network (collected in the system database Verifica Rischio Frana" (VRF)) are compared with the National Aeronautics and Space Administration (NASA) Tropical Rainfall Measuring Mission (TRMM) products. For the purpose, we couple point gauge and satellite rainfall estimates at individual grid cells, evaluating the correlation between gauge and satellite data in different morpho-climatological conditions. We then analyze the statistical distributions of both rainfall data types and the rainfall events derived from them. Results show that satellite data underestimates ground data, with the largest differences in mountainous areas. Power-law models, are more appropriate to correlate gauge and satellite data. The gauge and satellite-based products exhibit different statistical distributions and the rainfall events derived from them differ. In conclusion, satellite rainfall cannot be directly compared with ground data, requiring local investigation to account for specific morpho-climatological settings. Results suggest that satellite data can be used for forecasting landslides, only performing a local scaling between satellite and ground data.

landslide; satellite rainfall; TRMM; rain gauges; ↗
DOE OSTI2024

Photometric redshifts probability density estimation from recurrent neural networks in the DECam local volume exploration survey data release 2

Photometric wide-field surveys are imaging the sky in unprecedented detail. These surveys face a significant challenge in efficiently estimating galactic photometric redshifts while accurately quantifying associated uncertainties. In this work, we address this challenge by exploring the estimation of Probability Density Functions (PDFs) for the photometric redshifts of galaxies across a vast area of 17,000 square degrees, encompassing objects with a median 5 σ point-source depth of g = 24.3, r = 23 . 9 , i = 23.5, and z = 22.8 mag. Our approach uses deep learning, specifically integrating a Recurrent Neural Network architecture with a Mixture Density Network, to leverage magnitudes and colors as input features for constructing photometric redshift PDFs across the whole DECam Local Volume Exploration (DELVE) survey sky footprint. Subsequently, we rigorously evaluate the reliability and robustness of our estimation methodology, gauging its performance against other well-established machine learning methods to ensure the quality of our redshift estimations. Our best results constrain photometric redshifts with the bias of − 0 . 0013 , a scatter of 0.0293, and an outlier fraction of 5.1%. These point estimates are accompanied by well-calibrated PDFs evaluated using diagnostic tools such as Probability Integral Transform and Odds distribution. We also address the problem of the accessibility of PDFs in terms of disk space storage and the time demand required to generate their corresponding parameters.We present a novel Autoencoder model that reduces the size of PDF parameter arrays to one-sixth of their original length, significantly decreasing the time required for PDF generation to one-eighth of the time needed when generating PDFs directly from the magnitudes.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2015

Big Data in Reciprocal Space: Sliding Fast Fourier Transforms for Determining Periodicity

Significant advances in atomically resolved imaging of crystals and surfaces have occurred in the last decade allowing unprecedented insight into local crystal structures and periodicity. Yet, the analysis of the long-range periodicity from the local imaging data, critical to correlation of functional properties and chemistry to the local crystallography, remains a challenge. Here, we introduce a Sliding Fast Fourier Transform (FFT) filter to analyze atomically resolved images of in-situ grown La5/8Ca3/8MnO3 films. We demonstrate the ability of sliding FFT algorithm to differentiate two sub-lattices, resulting from a mixed-terminated surface. Principal Component Analysis (PCA) and Independent Component Analysis (ICA) of the Sliding FFT dataset reveal the distinct changes in crystallography, step edges and boundaries between the multiple sub-lattices. The method is universal for images with any periodicity, and is especially amenable to atomically resolved probe and electron-microscopy data for rapid identification of the sub-lattices present.

74 ATOMIC AND MOLECULAR PHYSICS↗
DOE OSTI2021

Data shuffling with hierarchical tuple spaces

Methods and systems for shuffling data are described. A processor may generate pair data from source data. The processor may insert the pair data into local tuple spaces. In response to a request for a particular key, the processor may determine a presence of the requested key in a global tuple space. The processor may, in response to a presence of the requested key in the global tuple space, update the global tuple space. The update may be based on the pair data among the local tuple spaces including the existing key. The processor may, in response to an absence of the requested key in the global tuple space, insert pair data including the missing key from the local tuple spaces into the global tuple space. The processor may fetch the requested pair data, and may shuffle the fetched data to generate a dataset.

Andrade Costa, Carlos Henrique↗
DOE OSTI2014

A comparison of the morphological properties between local and z ∼ 1 infrared luminous galaxies: Are local and high-z (U)LIRGs different?

Ultraluminous and luminous infrared galaxies (ULIRGs and LIRGs) are the most extreme star-forming galaxies in the universe and dominate the total star formation rate density at z > 1. In the local universe (z < 0.3), the majority of ULIRGs and a significant portion of LIRGs are triggered by interactions between gas-rich spiral galaxies, yet it is unclear if this is still the case at high z. To investigate the relative importance of galaxy interactions in infrared luminous galaxies, we carry out a comparison of optical morphological properties between local (U)LIRGs and (U)LIRGs at z = 0.5-1.5 based on the same sample selection, morphology classification scheme, and optical morphology at similar rest-frame wavelengths. In addition, we quantify the systematics in comparing local and high-z data sets by constructing a redshifted data set from local (U)LIRGs, in which its data quality mimics the high-z data set. Based on the Gini-M{sub 20} classification scheme, we find that the fraction of interacting systems decreases by ∼8% from local to z ≲ 1, and it is consistent with the reduction between local and redshifted data sets (6{sub −6}{sup +14}%). Based on visual classifications, the merger fraction of local ULIRGs is found to be ∼20% lower compared to published results, and the reduction due to redshifting is 15{sub −8}{sup +10}%. Consequently, the differences of merger fractions between local and z ≲ 1 (U)LIRGs is only ∼17%. These results demonstrate that there is no strong evolution in the fraction of (U)LIRGs classified as mergers at least out to z ∼ 1. At z > 1, the morphology types of ∼30% of (U)LIRGs cannot be determined due to their faintness in the F814W band; thus, the merger fraction measured at z > 1 suffers from large uncertainties.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2014

NuSTAR observations of the bullet cluster: constraints on inverse Compton emission

The search for diffuse non-thermal inverse Compton (IC) emission from galaxy clusters at hard X-ray energies has been undertaken with many instruments, with most detections being either of low significance or controversial. Because all prior telescopes sensitive at E > 10 keV do not focus light and have degree-scale fields of view, their backgrounds are both high and difficult to characterize. The associated uncertainties result in lower sensitivity to IC emission and a greater chance of false detection. In this work, we present 266 ks NuSTAR observations of the Bullet cluster, which is detected in the energy range 3-30 keV. NuSTAR's unprecedented hard X-ray focusing capability largely eliminates confusion between diffuse IC and point sources; however, at the highest energies, the background still dominates and must be well understood. To this end, we have developed a complete background model constructed of physically inspired components constrained by extragalactic survey field observations, the specific parameters of which are derived locally from data in non-source regions of target observations. Applying the background model to the Bullet cluster data, we find that the spectrum is well—but not perfectly—described as an isothermal plasma with kT = 14.2 ± 0.2 keV. To slightly improve the fit, a second temperature component is added, which appears to account for lower temperature emission from the cool core, pushing the primary component to kT ∼ 15.3 keV. We see no convincing need to invoke an IC component to describe the spectrum of the Bullet cluster, and instead argue that it is dominated at all energies by emission from purely thermal gas. The conservatively derived 90% upper limit on the IC flux of 1.1 × 10{sup –12} erg s{sup –1} cm{sup –2} (50-100 keV), implying a lower limit on B ≳ 0.2 μG, is barely consistent with detected fluxes previously reported. In addition to discussing the possible origin of this discrepancy, we remark on the potential implications of this analysis for the prospects for detecting IC in galaxy clusters in the future.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

PROTEUS: Machine Learning Driven Resilience for Extreme-scale Systems

The objective of this project is to design, develop, and evaluate scalable software to enhance resilience, data checkpointing, program restart, and analysis. The proposed tasks are to 1) develop scalable machine learning techniques to learn temporal change patterns in a scalable and in-situ manner, and to minimize data movement and maximize learning locally closest to data; 2) design a concise data representation and indexing mechanism to capture the distribution of changes in data that can guarantee point-wise user-defined tolerable errors while reducing the data storage requirements by an order of magnitude or more; 3) develop data reduction techniques as library modules; 4) exploit local SSD for minimizing data movement in storage hierarchy; 5) develop anomaly detection algorithms that can predict corruptions based on learning of emerging patterns; 6) develop software libraries to be incorporated within widely used data formats and APIs; and 7) evaluate the proposed software using DOE scientific applications. The outcomes of the proposed work are to satisfy many synergistic data reduction and resilience requirements for large-scale data intensive applications executed on extreme-scale computing systems. The developed mechanism for error-bound data approximation is directly applicable to existing scientific applications. Through machine learning from historical events and change distribution, this work will enable anomaly detection for DOE computer facility.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2018

An effective online data monitoring and saving strategy for large-scale climate simulations

Large-scale climate simulation models have been developed and widely used to generate historical data and study future climate scenarios. These simulation models often have to run for a couple of months to understand the changes in the global climate over the course of decades. This long-duration simulation process creates a huge amount of data with both high temporal and spatial resolution information; however, how to effectively monitor and record the climate changes based on these large-scale simulation results that are continuously produced in real time still remains to be resolved. Due to the slow process of writing data to disk, the current practice is to save a snapshot of the simulation results at a constant, slow rate although the data generation process runs at a very high speed. This study proposes an effective online data monitoring and saving strategy over the temporal and spatial domains with the consideration of practical storage and memory capacity constraints. Finally, our proposed method is able to intelligently select and record the most informative extreme values in the raw data generated from real-time simulations in the context of better monitoring climate changes.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Anomaly Detection, Localization and Classification using Drifting Synchrophasor Data Streams

With ongoing automation and digitization of the electric power system, several Phasor Measurement Units(PMUs) have been deployed for monitoring and control. PMU data can have multiple anomalies, and many of the researchers in the past have concentrated on training machine/deep learning algorithms offline for anomaly detection over PMU data (i.e., not in real time). These machine/deep learning algorithms, when trained offline on a sample rather than a population of the dataset, fail to consider the dynamic behavior of the power grid in real-time, resulting in low accuracy. Considering the dynamic behavior of the power grid (e.g., change in load, generation, distributed energy resources (DERs) switching, network, controls), the definition of data anomalies varies in time and requires online training. A fundamental challenge is to enable online (i.e., real-time) training of machine/deep learning algorithms for anomaly detection over streaming PMU data. While machine/deep learning is often desirable to manage data streams, training a deep learning algorithm over streaming PMU data is nontrivial due to changes in data statistics caused by dynamic streaming data. This paper proposes PMUNET: a novel device-level deep learning-based data-driven approach for anomaly detection, localization, and classification over streaming PMU data, using online learning and multivariate data-drift detection algorithm .Two variants of PMUNET, Dynamic data Change Driven Learning (DCDL) and Continuity Driven Learning (CDL), are proposed and compared. DCDL aims to train the deep learning algorithm whenever the definition of anomaly changes due to the power grid dynamics. On the other hand, CDL continuously trains the deep learning algorithm over the PMU data-stream. The experimental results verify that DCDL outperforms CDL and other efficient anomaly detection methods over multiple events such as faults and load/ generator/capacitor/DERs variations/switching for IEEE 14 and 39 Bus test system as well as real PMU industrial data. The result verifies that DCDL variant of PMUNET improves over existing approach with a gain of 2% - 10% in terms of accuracy, false-positive rate, and false-negative rate.

adversarial deep learning↗
DOE OSTI2013

A Parallel Ghosting Algorithm for The Flexible Distributed Mesh Database

Critical to the scalability of parallel adaptive simulations are parallel control functions including load balancing, reduced inter-process communication and optimal data decomposition. In distributed meshes, many mesh-based applications frequently access neighborhood information for computational purposes which must be transmitted efficiently to avoid parallel performance degradation when the neighbors are on different processors. This article presents a parallel algorithm of creating and deleting data copies, referred to as ghost copies, which localize neighborhood data for computation purposes while minimizing inter-process communication. The key characteristics of the algorithm are: (1) It can create ghost copies of any permissible topological order in a 1D, 2D or 3D mesh based on selected adjacencies. (2) It exploits neighborhood communication patterns during the ghost creation process thus eliminating all-to-all communication. (3) For applications that need neighbors of neighbors, the algorithm can create n number of ghost layers up to a point where the whole partitioned mesh can be ghosted. Strong and weak scaling results are presented for the IBM BG/P and Cray XE6 architectures up to a core count of 32,768 processors. The algorithm also leads to scalable results when used in a parallel super-convergent patch recovery error estimator, an application that frequently accesses neighborhood data to carry out computation.

Mubarak, Misbah↗
DOE OSTI2022

Thermal modeling of three lakes within the continuous permafrost zone in Alaska using the LAKE 2.0 model

Abstract. Lakes in the Arctic are important reservoirs of heat with much lower albedo in summer and greater absorption of solar radiation than surrounding tundra vegetation. In the winter, lakes that do not freeze to their bed have a mean annual bed temperature >0 ∘C in an otherwise frozen landscape. Under climate warming scenarios, we expect Arctic lakes to accelerate thawing of underlying permafrost due to warming water temperatures in the summer and winter. Previous studies of Arctic lakes have focused on ice cover and thickness, the ice decay process, catchment hydrology, lake water balance, and eddy covariance measurements, but little work has been done in the Arctic to model lake heat balance. We applied the LAKE 2.0 model to simulate water temperatures in three Arctic lakes in northern Alaska over several years and tested the sensitivity of the model to several perturbations of input meteorological variables (precipitation, shortwave radiation, and air temperature) and several model parameters (water vertical resolution, sediment vertical resolution, depth of soil column, and temporal resolution). The LAKE 2.0 model is a one-dimensional model that explicitly solves vertical profiles of water state variables on a grid. We used a combination of meteorological data from local and remote weather stations, as well as data derived from remote sensing, to drive the model. We validated modeled water temperatures with data of observed lake water temperatures at several depths over several years for each lake. Our validation of the LAKE 2.0 model is a necessary step toward modeling changes in Arctic lake ice regimes, lake heat balance, and thermal interactions with permafrost. The sensitivity analysis shows us that lake water temperature is not highly sensitive to small changes in air temperature or precipitation, while changes in shortwave radiation and large changes in precipitation produced larger effects. Snow depth and lake ice strongly affect water temperatures during the frozen season, which dominates the annual thermal regime of Arctic lakes. These findings suggest that reductions in lake ice thickness and duration could lead to more heat storage by lakes and enhanced permafrost degradation.

Clark, Jason A. (ORCID:0000000248105261)↗
DOE OSTI2022

Status of the OECD/NEA Watts Bar unit 1 benchmark and calculations of local reactor core power data of the Zero Power physics tests

The paper aims to provide an update on the status of the Organization for Economic Cooperation and Development (OECD) / the Nuclear Energy Agency (NEA) Tennessee Valley Authority (TVA) Watts Bar 1 (WB1) Multi-Physics Multi-Cycle depletion benchmark and the results associated with Exercise 1. The benchmark relies on the set of benchmark progression problems developed by the Department of Energy (DOE) Consortium for the Advanced Simulation of Light Water Reactors (CASL) for the Virtual Environment for Reactor (VERA), which are based on real plant design and operational data. The OECD/NEA TVA WB1 benchmark is designed for validation of both traditional and novel high-fidelity multi-physics codes to analyze Pressurized Water Reactors (PWR) depletion cycles. The activities are conducted under the Expert Group on Reactor Systems Multi-Physics (EGMUP) at NEA/OECD. In this work, we analyze Exercise 1 of the benchmark: stand-alone Three-Dimensional (3D) neutronics at Start-up Zero Power Physics Test (ZPPT) at Hot Zero Power Conditions (HZP) and the resulting power maps. The code used to model the exercise is the continuous energy Monte Carlo code Serpent 2.1.31 along with the nuclear data library ENDF/B-VII.1. Serpent results are compared with the high-fidelity deterministic code MPACT, which is part of VERA. The paper presents three selected results from power calculations required output. The results compared are the normalized axially integrated radial core power maps, the normalized axial averaged core power shapes, and the normalized core hottest and coldest assemblies radial power maps. The Root Mean Square Deviation (RMSD) between Serpent and MPACT is 0.51 % for the axially integrated radial core power map, 1.41 % for the axial averaged core power shape, 2.42 % for the hottest assembly axial power shape, 0.88 % for the coldest assembly axial integrated hottest assembly radial pin power map, and 0.17 % for the axially integrated coldest assembly radial pin power map. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2017

Carrboro, North Carolina: Achieving Building Efficiencies for Low-Income Households (City Energy: From Data to Decisions)

This fact sheet "Carrboro, North Carolina: Achieving Building Efficiencies for Low-Income Households" explains how the Town of Carrboro used data from the U.S. Department of Energy's Cities Leading through Energy Analysis and Planning (Cities-LEAP) and the State and Local Energy Data (SLED) programs to inform its city energy planning. It is one of ten fact sheets in the "City Energy: From Data to Decisions" series.

bedroom community↗