Search NASA⌕ Search

SEARCH · Search NASA

Results for “Distributed databases”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 307 records · Page 17

Spatial Designation of Critical Habitats for Endangered and Threatened Species in the United States

Establishing biological reserves or "hot spots" for endangered and threatened species is critical to support real-world species regulatory and management problems. Geographic data on the distribution of endangered and threatened species can be used to improve ongoing efforts for species conservation in the United States. At present no spatial database exists which maps out the location endangered species for the US. However, spatial descriptions do exists for the habitat associated with all endangered species, but in a form not readily suitable to use in a geographic information system (GIS). In our study, the principal challenge was extracting spatial data describing these critical habitats for 472 species from over 1000 pages of the federal register. In addition, an appropriate database schema was designed to accommodate the different tiers of information associated with the species along with the confidence of designation; the interpreted location data was geo-referenced to the county enumeration unit producing a spatial database of endangered species for the whole of US. The significance of these critical habitat designations, database scheme and methodologies will be discussed.

99 GENERAL AND MISCELLANEOUS↗

Generating realistic building electrical load profiles through the Generative Adversarial Network (GAN)

Building electrical load profiles can improve understanding of building energy efficiency, demand flexibility, and building-grid interactions. Current approaches to generating load profiles are time-consuming and not capable of reflecting the dynamic and stochastic behaviors of real buildings; some approaches also trigger data privacy concerns. In this study, we proposed a novel approach for generating realistic electrical load profiles of buildings through the Generative Adversarial Network (GAN), a machine learning technique that is capable of revealing an unknown probability distribution purely from data. The proposed approach has three main steps: (1) normalizing the daily 24-hour load profiles, (2) clustering the daily load profiles with the k-means algorithm, and (3) using GAN to generate daily load profiles for each cluster. The approach was tested with an open-source database – the Building Data Genome Project. We validated the proposed method by comparing the mean, standard deviation, and distribution of key parameters of the generated load profiles with those of the real ones. The KL divergence of the generated and real load profiles are within 0.3 for majority of parameters and clusters. Additionally, results showed the load profiles generated by GAN can capture not only the general trend but also the random variations of the actual electrical loads in buildings. We report the proposed GAN approach can be used to generate building electrical load profiles, verify other load profile generation models, detect changes to load profiles, and more importantly, anonymize smart meter data for sharing, to support research and applications of grid-interactive efficient buildings.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Realistic Geochemical Parameter Uncertainty for Performance Assessment Modeling - 17066

Performance assessments (PAs) include uncertain geochemical parameters that affect the fate and transport of contaminants in environmental media, such as partitioning coefficients for water/rock (K{sub d}) and water/air (K{sub H}), diffusion coefficients, and aqueous solubilities. A statistical approach to realistic, as opposed to 'conservative,' stochastic distribution development for geochemical parameters is presented here. For contaminants not identified as focus elements during screening, broad generic distributions are developed. If any parameter is flagged in the subsequent model sensitivity analysis (SA), it becomes a focus element for further research during the next round of distribution development. This iterative approach is efficient and technically defensible at each stage. Data are collected in databases and may be appropriately weighted or filtered. In the relatively few cases where data exist from local or analogous rocks, those data may be prioritized. Once established, the databases can be used for future PAs or other environmental models and can be expanded as needed based on model SA results, additional screening, and as additional relevant data become available. The iterative method is demonstrated for K{sub d} and K{sub H} in a PA model for a radioactive waste disposal facility. An SA was performed based on preliminary geochemical parameter distributions that showed certain model endpoints are sensitive to K{sub d} and K{sub H} values for some contaminants. This underscores the importance of including realistic uncertainty in these geochemical parameters. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Semantics-based distributed I/O for mpiBLAST.

BLAST is a widely used software toolkit for genomic sequence search. mpiBLAST is a freely available, open-source parallelization of BLAST that uses database segmentation to allow different worker processes to search (in parallel) unique segments of the database. After searching, the workers write their output to a filesystem. While mpiBLAST has been shown to achieve high performance in clusters with fast local filesystems, its I/O processing remains a concern for scalability, especially in systems having limited I/O capabilities such as distributed filesystems spread across a wide-area network. Thus, we present ParaMEDIC - a novel environment that uses application-specific semantic information to compress I/O data and improve performance in distributed environments. Specifically, for mpiBLAST, ParaMEDIC partitions worker processes into compute and I/O workers. Compute workers, instead of directly writing the output to the filesystem, the workers process the output using semantic knowledge about the application to generate metadata and write the metadata to the filesystem. I/O workers, which physically reside closer to the actual storage, then process this metadata to re-create the actual output and write it to the filesystem. This approach allows ParaMEDIC to reduce I/O time, thus accelerating mpiBLAST by as much as 25-fold.

99 GENERAL AND MISCELLANEOUS↗

High-performance Computing Applied to Semantic Databases

To-date, the application of high-performance computing resources to Semantic Web data has largely focused on commodity hardware and distributed memory platforms. In this paper we make the case that more specialized hardware can offer superior scaling and close to an order of magnitude improvement in performance. In particular we examine the Cray XMT. Its key characteristics, a large, global shared-memory, and processors with a memory-latency tolerant design, offer an environment conducive to programming for the Semantic Web and have engendered results that far surpass current state of the art. We examine three fundamental pieces requisite for a fully functioning semantic database: dictionary encoding, RDFS inference, and query processing. We show scaling up to 512 processors (the largest configuration we had available), and the ability to process 20 billion triples completely in-memory.

99 GENERAL AND MISCELLANEOUS↗

High-performance computing applied to semantic databases.

To-date, the application of high-performance computing resources to Semantic Web data has largely focused on commodity hardware and distributed memory platforms. In this paper we make the case that more specialized hardware can offer superior scaling and close to an order of magnitude improvement in performance. In particular we examine the Cray XMT. Its key characteristics, a large, global shared-memory, and processors with a memory-latency tolerant design, offer an environment conducive to programming for the Semantic Web and have engendered results that far surpass current state of the art. We examine three fundamental pieces requisite for a fully functioning semantic database: dictionary encoding, RDFS inference, and query processing. We show scaling up to 512 processors (the largest configuration we had available), and the ability to process 20 billion triples completely in-memory.

99 GENERAL AND MISCELLANEOUS↗

TU-C-BRE-11: 3D EPID-Based in Vivo Dosimetry: A Major Step Forward Towards Optimal Quality and Safety in Radiation Oncology Practice

Purpose: To develop a 3D in vivo dosimetry method that is able to substitute pre-treatment verification in an efficient way, and to terminate treatment delivery if the online measured 3D dose distribution deviates too much from the predicted dose distribution. Methods: A back-projection algorithm has been further developed and implemented to enable automatic 3D in vivo dose verification of IMRT/VMAT treatments using a-Si EPIDs. New software tools were clinically introduced to allow automated image acquisition, to periodically inspect the record-and-verify database, and to automatically run the EPID dosimetry software. The comparison of the EPID-reconstructed and planned dose distribution is done offline to raise automatically alerts and to schedule actions when deviations are detected. Furthermore, a software package for online dose reconstruction was also developed. The RMS of the difference between the cumulative planned and reconstructed 3D dose distributions was used for triggering a halt of a linac. Results: The implementation of fully automated 3D EPID-based in vivo dosimetry was able to replace pre-treatment verification for more than 90% of the patient treatments. The process has been fully automated and integrated in our clinical workflow where over 3,500 IMRT/VMAT treatments are verified each year. By optimizing the dose reconstruction algorithm and the I/O performance, the delivered 3D dose distribution is verified in less than 200 ms per portal image, which includes the comparison between the reconstructed and planned dose distribution. In this way it was possible to generate a trigger that can stop the irradiation at less than 20 cGy after introducing large delivery errors. Conclusion: The automatic offline solution facilitated the large scale clinical implementation of 3D EPID-based in vivo dose verification of IMRT/VMAT treatments; the online approach has been successfully tested for various severe delivery errors.

60 APPLIED LIFE SCIENCES↗

LONG-TERM TREND OF SOLAR CORONAL HOLE DISTRIBUTION FROM 1975 TO 2014

We developed an automated prediction technique for coronal holes using potential magnetic field extrapolation in the solar corona to construct a database of coronal holes appearing from 1975 February to 2015 July (Carrington rotations from 1625 to 2165). Coronal holes are labeled with the location, size, and average magnetic field of each coronal hole on the photosphere and source surface. As a result, we identified 3335 coronal holes and found that the long-term distribution of coronal holes shows a similar pattern known as the magnetic butterfly diagram, and polar/low-latitude coronal holes tend to decrease/increase in the last solar minimum relative to the previous two minima.

79 ASTRONOMY AND ASTROPHYSICS↗

The Microphysics of Stratiform Precipitation During OLYMPEX: Compatibility Between Triple‐Frequency Radar and Airborne In Situ Observations

Abstract The link between stratiform precipitation microphysics and multifrequency radar observables is thoroughly investigated by exploiting simultaneous airborne radar and in situ observations collected from two aircraft during the OLYMPEX/RADEX (Olympic Mountain Experiment/Radar Definition Experiment 2015) field campaign. Above the melting level, in situ images and triple‐frequency radar signatures both indicate the presence of moderately rimed aggregates. Various mass‐size relationships of ice particles and snow scattering databases are used to compute the radar reflectivity from the in situ particle size distribution. At Ku and Ka band, the best agreement with radar observations is found when using the self‐similar Rayleigh‐Gans approximation for moderately rimed aggregates. At W band, a direct comparison is challenging because of the non‐Rayleigh effects and of the probable attenuation due to ice aggregates and supercooled liquid water between the two aircraft. A variational method enables the retrieval of the full precipitation profile above and below the melting layer, by combining the observations from the three radars. Even with three radar frequencies, the retrieval of rain properties is challenging over land, where the integrated attenuation is not available. Otherwise, retrieved mean volume diameters and water contents of both solid and liquid precipitation are in agreement with in situ observations and indicate local changes of the degree of riming of ice aggregates, on the scale of 5 km. Finally, retrieval results are analyzed to explore the validity of using continuity constraints on the water mass flux and diameter within the melting layer in order to improve retrievals of ice properties.

47 OTHER INSTRUMENTATION↗

Understanding the evolution of conditions data access through Frontier for the ATLAS Experiment

The ATLAS Distributed Computing system uses the Frontier system to access the Conditions, Trigger, and Geometry database data stored in the Oracle Offline Database at CERN by means of the HTTP protocol. All ATLAS computing sites use Squid web proxies to cache the data, greatly reducing the load on the Frontier servers and the databases. One feature of the Frontier client is that in the event of failure, it retries with different services. While this allows transient errors and scheduled maintenance to happen transparently, it does open the system up to cascading failures if the load is high enough. Throughout LHC Run 2 there has been an ever increasing demand on the Frontier service. There have been multiple incidents where parts of the service failed due to high load. A significant improvement in the monitoring of the Frontier service was required. The monitoring was needed to identify both problematic tasks, which could then be killed or throttled, and to identify failing site services as the consequence of a cascading failure is much higher. This presentation describes the implementation and features of the monitoring system.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

INTERPRETING THE DISTANCE CORRELATION RESULTS FOR THE COMBO-17 SURVEY

The accurate classification of galaxies in large-sample astrophysical databases of galaxy clusters depends sensitively on the ability to distinguish between morphological types, especially at higher redshifts. This capability can be enhanced through a new statistical measure of association and correlation, called the distance correlation coefficient, which has more statistical power to detect associations than does the classical Pearson measure of linear relationships between two variables. The distance correlation measure offers a more precise alternative to the classical measure since it is capable of detecting nonlinear relationships that may appear in astrophysical applications. We showed recently that the comparison between the distance and Pearson correlation coefficients can be used effectively to isolate potential outliers in various galaxy data sets, and this comparison has the ability to confirm the level of accuracy associated with the data. In this work, we elucidate the advantages of distance correlation when applied to large databases. We illustrate how the distance correlation measure can be used effectively as a tool to confirm nonlinear relationships between various variables in the COMBO-17 database, including the lengths of the major and minor axes, and the alternative redshift distribution. For these outlier pairs, the distance correlation coefficient is routinely higher than the Pearson coefficient since it is easier to detect nonlinear relationships with distance correlation. The V-shaped scatter plots of Pearson versus distance correlation coefficients also reveal the patterns with increasing redshift and the contributions of different galaxy types within each redshift range.

79 ASTRONOMY AND ASTROPHYSICS↗

Community Structure of Arbuscular Mycorrhizal Fungi in Soils of Switchgrass Harvested for Bioenergy

We assessed the different species of beneficial fungi living in agricultural fields of switchgrass, a large grass grown for biofuels, using high-resolution DNA sequencing. Contrary to our expectations, the fungi were not greatly affected by fertilization. However, we found a positive relationship between plant productivity and the number of families of beneficial fungi at one site. Furthermore, we sequenced many species that could not be identified with existing reference databases. One group of fungi was highlighted in an earlier study for being widely distributed but of unknown taxonomy. We discovered that this group belonged to a family called Pervetustaceae , which may benefit switchgrass in stressful environments. To produce higher-yielding switchgrass in a more sustainable manner, it could help to study these undescribed fungi and the ways in which they may contribute to greater switchgrass yield in the absence of fertilization.

59 BASIC BIOLOGICAL SCIENCES↗

The influence of fire aerosols on surface climate and gross primary production in the Energy Exascale Earth System Model (E3SM)

Fire-emitted aerosols play an important role in influencing Earth’s climate, directly by scattering and absorbing radiation and indirectly by influencing cloud microphysics. The quantification of fire-aerosol interactions, however, remains challenging and subject to uncertainties in emissions, plume parameterizations, and aerosol properties. Here we optimized fire-associated aerosol emissions in the Energy Exascale Earth System Model (E3SM) using the Global Fire Emissions Database (GFED) and AERONET aerosol optical depth (AOD) observations during 1997-2016. Furthermore, we distributed fire emissions vertically using smoke plume heights from Multi-angle Imaging SpectroRadiometer (MISR) satellite observations. From the optimization, we estimate that global fires emit 45.5 Tg y -1 of primary particulate organic matter and 3.9 Tg y -1 of black carbon. We then performed two climate simulations with and without the optimized fire emissions. We find that fire aerosols significantly increase global AOD by 14 ± 7% and contribute to a reduction in net shortwave radiation at the surface (-2.3 ± 0.5 W m -2 ). Together, fire-induced direct and indirect aerosol effects cause annual mean global land surface air temperature to decrease by 0.17 ± 0.15°C, relative humidity to increase by 0.4 ± 0.3%, and diffuse light fraction to increase by 0.5 ± 0.3%. In response, GPP declines by 2.8 Pg C y -1 , as a result of large positive drivers (decreases in temperature and increases in humidity and diffuse light) nearly cancelling out large negative drivers (decreases shortwave radiation and soil moisture). Our analysis highlights the importance of fire aerosols in modifying surface climate and photosynthesis across the tropics.

54 ENVIRONMENTAL SCIENCES↗

Galaxy groups in the 2MASS redshift survey

A galaxy group catalog is constructed from the 2MASS Redshift Survey (2MRS) with the use of a halo-based group finder. The halo mass associated with a group is estimated using a “GAP” method based on the luminosity of the central galaxy and its gap with other member galaxies. Tests using mock samples show that this method is reliable, particularly for poor systems containing only a few members. On average, 80% of all the groups have completeness >0.8, and about 65% of the groups have zero contamination. Halo masses are estimated with a typical uncertainty of ∼0.35 dex. The application of the group finder to the 2MRS gives 29,904 groups from a total of 43,246 galaxies at z⩽0.08, with 5286 groups having two or more members. Some basic properties of this group catalog is presented, and comparisons are made with other group catalogs in overlap regions. With a depth to z∼0.08 and uniformly covering about 91% of the whole sky, this group catalog provides a useful database to study galaxies in the local cosmic web, and to reconstruct the mass distribution in the local universe.

79 ASTRONOMY AND ASTROPHYSICS↗

PV Inverter Experimental Dataset Version 2 with 100 Percent Power

The increase in power electronic based generation sources require accurate modeling of inverters. Accurate modeling requires experimental data over wider operation range. We used 20 kW off-the-shelf grid following PV inverter in the experiments. We used controllable AC supply and controllable DC supply to emulate AC and DC side characteristics. The experiments were performed at NREL's Energy Systems Integration Facility. The PV inverter is tested under 100%, 75%, 50%, 25% load conditions. In the first dataset, for each operating condition, controllable AC source voltage is varied from 0.88 to 1.09 per unit (p.u) with a step value of 0.025 p.u while keeping the frequency at 60 Hz. In the second dataset, under similar load conditions (100%, 75%, 50%, 25% ), the frequency of the controllable AC source voltage was varied from 59.4 Hz to 60.45 Hz with a step value of 0.2 Hz. Voltage and frequency range is chosen based on inverter protection. Voltages and currents on DC and AC side are included in the dataset.

14 SOLAR ENERGY↗

Interfacial Area Transport through Vertical-Downward Elbows in Air-water Two-phase Flow

In the study of two-phase flow, models are often developed by the data acquired in a test section with fixed orientation and with no flow restrictions. In view of practical nuclear reactor systems, however, two-phase flow through flow restrictions is important. Flow restrictions and orientations can alter both global and local two-phase flow parameters such as: cause additional pressure loss; alter the flow regime transition; change bubble distributions; affect the bubble velocity and the bubble interaction mechanisms. However, there is insufficient database and predictive models that can account for such effects. In view of above, the objectives of the current study are: (1) to establish database for local and global two-phase flow parameters downstream of a horizontal-to-vertical glass elbow with a non-dimensional radius of curvature, R{sub c}/D, of three, (2) to develop predictive models in the elbow region, and (3) to apply the developed model to the interfacial area transport equation (IATE) and evaluate it in elbow regions. (authors)

42 ENGINEERING↗

Information-Theoretic Approaches for Evaluating Complex Adaptive Social Simulation Systems

In this paper, we propose information-theoretic approaches for comparing and evaluating complex agent-based models. In information theoretic terms, entropy and mutual information are two measures of system complexity. We used entropy as a measure of the regularity of the number of agents in a social class; and mutual information as a measure of information shared by two social classes. Using our approaches, we compared two analogous agent-based (AB) models developed for regional-scale social-simulation system. The first AB model, called ABM-1, is a complex AB built with 10,000 agents on a desktop environment and used aggregate data; the second AB model, ABM-2, was built with 31 million agents on a highperformance computing framework located at Oak Ridge National Laboratory, and fine-resolution data from the LandScan Global Population Database. The initializations were slightly different, with ABM-1 using samples from a probability distribution and ABM-2 using polling data from Gallop for a deterministic initialization. The geographical and temporal domain was present-day Afghanistan, and the end result was the number of agents with one of three behavioral modes (proinsurgent, neutral, and pro-government) corresponding to the population mindshare. The theories embedded in each model were identical, and the test simulations focused on a test of three leadership theories - legitimacy, coercion, and representative, and two social mobilization theories - social influence and repression. The theories are tied together using the Cobb-Douglas utility function. Based on our results, the hypothesis that performance measures can be developed to compare and contrast AB models appears to be supported. Furthermore, we observed significant bias in the two models. Even so, further tests and investigations are required not only with a wider class of theories and AB models, but also with additional observed or simulated data and more comprehensive performance measures.

97 MATHEMATICS AND COMPUTING↗

A Hybrid Semi-supervised Classification Scheme for Mining Multisource Geospatial Data

Supervised learning methods such as Maximum Likelihood (ML) are often used in land cover (thematic) classification of remote sensing imagery. ML classifier relies exclusively on spectral characteristics of thematic classes whose statistical distributions (class conditional probability densities) are often overlapping. The spectral response distributions of thematic classes are dependent on many factors including elevation, soil types, and ecological zones. A second problem with statistical classifiers is the requirement of large number of accurate training samples (10 to 30 |dimensions|), which are often costly and time consuming to acquire over large geographic regions. With the increasing availability of geospatial databases, it is possible to exploit the knowledge derived from these ancillary datasets to improve classification accuracies even when the class distributions are highly overlapping. Likewise newer semi-supervised techniques can be adopted to improve the parameter estimates of statistical model by utilizing a large number of easily available unlabeled training samples. Unfortunately there is no convenient multivariate statistical model that can be employed for mulitsource geospatial databases. In this paper we present a hybrid semi-supervised learning algorithm that effectively exploits freely available unlabeled training samples from multispectral remote sensing images and also incorporates ancillary geospatial databases. We have conducted several experiments on real datasets, and our new hybrid approach shows over 25 to 35% improvement in overall classification accuracy over conventional classification schemes.

54 ENVIRONMENTAL SCIENCES↗