A Data Distribution Strategy for the 90's (Files Are Not Enough)
Virtually all of the data distribution strategies being contemplated for the EOSDIS era revolve around the use of files.
SEARCH · Search NASA
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Virtually all of the data distribution strategies being contemplated for the EOSDIS era revolve around the use of files.
The purpose of the ADAPT code is to generate Dynamic Event Trees (DET) using a user specified set of simulators. ADAPT can utilize any simulation tool which meets a minimal set of requirements. ADAPT is based on the concept of DET which uses explicit modeling of the deterministic dynamic processes that take place during a nuclear reactor plant system (or other complex system) evolution along with stochastic modeling. When DET are used to model various aspects of Probabilistic Risk Assessment (PRA), all accident progression scenarios starting from an initiating event are considered simultaneously. The DET branching occurs at user specified times and/or when an action is required by the system and/or the operator. These outcomes then decide how the dynamic system variables will evolve in time for each DET branch. Since two different outcomes at a DET branching may lead to completely different paths for system evolution, the next branching for these paths may occur not only at separate times, but can be based on different branching criteria. The computational infrastructure allows for flexibility in ADAPT to link with different system simulation codes, parallel processing of the scenarios under consideration, on-line scenario management (initiation as well as termination), analysis of results, and user friendly graphical capabilities. The ADAPT system is designed for a distributed computing environment; the scheduler can track multiple concurrent branches simultaneously. The scheduler is modularized so that the DET branching strategy can be modified (e.g. biasing towards the worst-case scenario/event). Independent database systems store data from the simulation tasks and the DET structure so that the event tree can be constructed and analyzed later. ADAPT is provided with a user-friendly client which can easily sort through and display the results of an experiment, precluding the need for the user to manually inspect individual simulator runs.
Plasmids harbor transferable genes that contribute to the functional repertoire of microbial communities, yet their contributions to metagenomes are often overlooked. Environmental plasmids have the potential to spread antibiotic resistance to clinical microbial strains. In soils, high microbiome diversity and high variability in plasmid characteristics present a challenge for studying plasmids. To improve the understanding of soil plasmids, we present RefSoil+, a database containing plasmid sequences from 922 soil microorganisms. Soil plasmids were larger than other described plasmids, which is a trait associated with plasmid mobility. There was a weak relationship between chromosome size and plasmid size and no relationship between chromosome size and plasmid number, suggesting that these genomic traits are independent in soil. We used RefSoil+ to inform the distributions of antibiotic resistance genes among soil microorganisms compared to those among nonsoil microorganisms. Soil-associated plasmids, but not chromosomes, had fewer antibiotic resistance genes than other microorganisms. These data suggest that soils may offer limited opportunity for plasmid-mediated transfer of described antibiotic resistance genes. RefSoil+ can serve as a reference for the diversity, composition, and host associations of plasmid-borne functional genes in soil, a utility that will be enhanced as the database expands. Our study improves the understanding of soil plasmids and provides a resource for assessing the dynamics of the genes that they carry, especially genes conferring antibiotic resistances.Soil-associated plasmids have the potential to transfer antibiotic resistance genes from environmental to clinical microbial strains, which is a public health concern. A specific resource is needed to aggregate the knowledge of soil plasmid characteristics so that the content, host associations, and dynamics of antibiotic resistance genes can be assessed and then tracked between the environment and the clinic. Here, we present RefSoil+, a database of soil-associated plasmids. RefSoil+ presents a contemporary snapshot of antibiotic resistance genes in soil that can serve as a reference as novel plasmids and transferred antibiotic resistances are discovered. Our study broadens our understanding of plasmids in soil and provides a community resource of important plasmid-associated genes, including antibiotic resistance genes.
Plasmids harbor transferable genes that contribute to the functional repertoire of microbial communities, yet their contributions to metagenomes are often overlooked. Environmental plasmids have the potential to spread antibiotic resistance to clinical microbial strains. In soils, high microbiome diversity and high variability in plasmid characteristics present a challenge for studying plasmids. To improve the understanding of soil plasmids, we present RefSoil+, a database containing plasmid sequences from 922 soil microorganisms. Soil plasmids were larger than other described plasmids, which is a trait associated with plasmid mobility. There was a weak relationship between chromosome size and plasmid size and no relationship between chromosome size and plasmid number, suggesting that these genomic traits are independent in soil. We used RefSoil+ to inform the distributions of antibiotic resistance genes among soil microorganisms compared to those among nonsoil microorganisms. Soil-associated plasmids, but not chromosomes, had fewer antibiotic resistance genes than other microorganisms. These data suggest that soils may offer limited opportunity for plasmid-mediated transfer of described antibiotic resistance genes. RefSoil+ can serve as a reference for the diversity, composition, and host associations of plasmid-borne functional genes in soil, a utility that will be enhanced as the database expands. Our study improves the understanding of soil plasmids and provides a resource for assessing the dynamics of the genes that they carry, especially genes conferring antibiotic resistances.
Distributed photovoltaic (PV) generation often occurs ``behind the meter": a grid operator can only observe the net load, which is the sum of the gross load and distributed PV generation. This lack of observability poses a challenge to system operation at both bulk level and distribution level. The lack of real-time or near-future disaggregated estimates of gross load and PV generation will lead to over scheduling of energy production and regulation reserves, reliability constraints violations, wear and tear of controller devices, and potentially cascading failures of a system. In this paper we propose the use of a Bayesian Structural Time Series (BSTS) model with local solar irradiance measurements to disaggregate the summed PV generation and gross load signals at a downstream measurement site. BSTSs are a highly expressive model class that blends classic time series models with the powerful Bayesian state space estimation framework. Disaggregation is done probabilistically, which automatically quantifies the uncertainties of the estimated PV generation and gross load consumption. Depending on the data availability in real-time, it can be used to disaggragate PV and gross load at customer site, or can be used at the feeder level. In this paper, we focus on solving the problem at feeder level. We compare the performance of a BSTS model as well as a handful of state-of-the-art methods on a Pecan Street AMI dataset, using the National Solar Radiation Database (NSRDB) to estimate local irradiance.
Integration of distributed energy sources, advanced meshed operation, sensors, automation, and communication networks all contribute to autonomous operations and decision-making processes utilized in the grid. Therefore, smart grid systems require sophisticated supporting structures. Furthermore, rapid detection and identification of disturbances and transients are a necessary first step towards situationally aware smart grid systems. This way, high-level monitoring is achieved and the entire system kept operational. Even though smart grid systems are unavoidably sophisticated, low-complexity algorithms need to be developed for real-time sensing on the edge and online applications to alert stakeholders in the event of an anomaly. In this study, the simplest form of anomaly detection mechanism in the absence of any a priori knowledge, namely, the energy detector (also known as radiometer in the field of wireless communications and signal processing), is investigated as a triggering mechanism, which may include automated alerts and notifications for grid anomalies. In contrast to the mainstream literature, it does not rely on transform domain tools; therefore, utmost design and implementation simplicity are attained. Performance results of the proposed energy detector algorithm are validated by real power system data obtained from the DOE/EPRI National Database of power system events and the Grid Signature Library.
Dedicated DIII-D experiments studied instabilities below the ion cyclotron frequency f ci and at cyclotron harmonics by injecting thirteen different neutral beam populations into plasmas with different thermal compositions of H and D at five different values of toroidal field. The resulting database of 2529 conditions is described in Part 1: Stability. This paper focuses on the temporal evolution. For some beam geometries, the ion cyclotron emission (ICE) is much stronger at the beginning of injection, suggesting the importance of ‘bump-on-tail’ energy drive. Sawtooth crashes cause the emission to cease for some beam types and emission bands, but the opposite effect occurs for others. When unstable, for virtually all conditions and frequency bands, the emission bursts in a cycle reminiscent of predator-prey oscillations. Evidence for nonlinear interaction between ICE harmonics is observed. Strongly unstable modes typically appear within 1 ms from the start of beam injection and often decay within 0.1 ms when the beam turns off, but both the initial rise and final decay of the mode power exhibit a wide variety of behavior.
The basic data provided in these data files are derived from time series of Global, Regional, and National Fossil-Fuel CO2 Emissions (http://cdiac.ess-dive.lbl.gov/trends/emis/overview_2013.html), the references therein, and the methodology described in Andres et al. (2011). The data accessible here take these tabular, national, mass-emissions data, multiply them by stable carbon isotopic signature (del 13C) as described in Andres et al. (2000), and distribute them spatially on a one degree latitude by one degree longitude grid. The within-country spatial distribution is achieved through a fixed population distribution as reported in Andres et al. (1996) for years prior to 1990 and a variable population distribution for later years (Andres et al. 2016). Note that the mass-emissions data used here are based on fossil-fuel consumption estimates as these are more representative of within country emissions than fossil-fuel production estimates (see http://cdiac.ess-dive.lbl.gov/faq.html#Q10 for a description why emission totals based upon consumption differ from those based upon production). The monthly, isotopic (δ 13C) fossil-fuel CO2 emissions estimates from 1950-2013 provided in this database are derived from time series of global, regional, and national fossil-fuel CO2 emissions (Boden et al. 2016), the references therein, and the methodology described in Andres et al. (2011). The data accessible here take these tabular, national, mass-emissions data, multiply them by stable carbon isotopic signatures (δ 13C) as described in Andres et al. (2000), and distribute them spatially on a one degree latitude by one degree longitude grid. The within-country spatial distribution is achieved through a fixed population distribution as reported in Andres et al. (1996). Note that the mass-emissions data used here are based on fossil-fuel consumption estimates as these are more representative of within country emissions than fossil-fuel production estimates (see http://cdiac.ess-dive.lbl.gov/faq.html#Q10 for a description why emission totals based upon consumption differ from those based upon production).
Buildings rarely perform as intended, resulting in energy use that is higher than anticipated. Building commissioning has emerged as a strategy for remedying this problem in non-residential buildings. Complementing traditional hardware-based energy savings strategies, commissioning is a 'soft' process of verifying performance and design intent and correcting deficiencies. Through an evaluation of a series of field projects, this report explores the efficacy of an emerging refinement of this practice, known as monitoring-based commissioning (MBCx). MBCx can also be thought of as monitoring-enhanced building operation that incorporates three components: (1) Permanent energy information systems (EIS) and diagnostic tools at the whole-building and sub-system level; (2) Retro-commissioning based on the information from these tools and savings accounting emphasizing measurement as opposed to estimation or assumptions; and (3) On-going commissioning to ensure efficient building operations and measurement-based savings accounting. MBCx is thus a measurement-based paradigm which affords improved risk-management by identifying problems and opportunities that are missed with periodic commissioning. The analysis presented in this report is based on in-depth benchmarking of a portfolio of MBCx energy savings for 24 buildings located throughout the University of California and California State University systems. In the course of the analysis, we developed a quality-control/quality-assurance process for gathering and evaluating raw data from project sites and then selected a number of metrics to use for project benchmarking and evaluation, including appropriate normalizations for weather and climate, accounting for variations in central plant performance, and consideration of differences in building types. We performed a cost-benefit analysis of the resulting dataset, and provided comparisons to projects from a larger commissioning 'Meta-analysis' database. A total of 1120 deficiency-intervention combinations were identified in the course of commissioning the projects described in this report. The most common location of deficiencies was in HVAC equipment (65% of sites), followed by air-handling and distributions systems (59%), cooling plant (29%), heating plants (24%), and terminal units (24%). The most common interventions were adjusting setpoints, modifying sequences of operations, calibration, and various mechanical fixes (each done in about two-thirds of the sites). The normalized rate of occurrence of deficiencies and corresponding interventions ranged from about 0.1/100ksf to 10/100ksf, depending on the issue. From these interventions flowed significant and highly cost-effective energy savings For the MBCx cohort, source energy savings of 22 kBTU/sf-year (10%) were achieved, with a range of 2% to 25%. Median electricity savings were 1.9 kWh/sf-year (9%), with a range of 1% to 17%. Peak electrical demand savings were 0.2 W/sf-year (4%), with a range of 3% to 11%. The aggregate commissioning cost for the 24 projects was $2.9 million. We observed a range of normalized costs from $0.37 to 1.62/sf, with a median value of $1.00/sf for buildings that implemented MBCx projects. Per the program design, monitoring costs as a percentage of total costs are significantly higher in MBCx projects (median value 40%) than typical commissioning projects included in the Meta-analysis (median value of 2% in the commissioning database). Half of the projects were in buildings containing complex and energy-intensive laboratory space, with higher associated costs. Median energy cost savings were $0.25/sf-year, for a median simple payback time of 2.5 years. Significant and cost-effective energy savings were thus obtained. The greatest absolute energy savings and shortest payback times were achieved in laboratory-type facilities. While impacts varied from project to project, on a portfolio basis we find MBCx to be a highly cost-effective means of obtaining significant program-level energy savings across a variety of building types. Energy savings are expected to be more robust and persistent for MBCx projects than for conventionally commissioned ones. Impacts of future programs can be maximized by benchmarking energy use and targeting the commissioning towards particularly energy-intensive facilities such as laboratories.
The antimicrobial resistance (AMR) mobilome plays a key role in the dissemination of resistance genes encoded by mobile genetics elements (MGEs) including plasmids, transposons (Tns), and insertion sequences (ISs). These MGEs contribute to the dissemination of multidrug resistance (MDR) in enteric bacterial pathogens which have been considered as a global public health risk. To further understand the diversity and distribution of AMR genes and MGEs across different plasmid types, we utilized multiple sequence-based computational approaches to evaluate AMR-associated plasmid genetics. A collection of 1,309 complete plasmid sequences from Gammaproteobacterial species, including 100 plasmids from each of the following 14 incompatibility (Inc) types: A/C, BO, FIA, FIB, FIC, FIIA, HI1, HI2, I1, K, M, N, P except W, where only 9 sequences were available, was extracted from the National Center for Biotechnology Information (NCBI) GenBank database using BLAST tools. The extracted FASTA files were analyzed using the AMRFinderPlus web-based tools to detect antimicrobial, disinfectant, biocide, and heavy metal resistance genes and ISFinder to identify IS/Tn MGEs within the plasmid sequences. In silico prediction based on plasmid replicon types showed that the resistance genes were diverse among plasmids, yet multiple genes were widely distributed across the plasmids from enteric bacterial species. These findings provide insights into the diversity of resistance genes and that MGEs mediate potential transmission of these genes across multiple plasmid replicon types. This notion was supported by the observation that many IS/Tn MGEs and resistance genes known to be associated with them were common across multiple different plasmid types. Our results provide critical insights about how the diverse population of resistance genes that are carried by the different plasmid types can allow for the dissemination of AMR across enteric bacteria. The results also highlight the value of computational-based approaches and in silico analyses for the assessment of AMR and MGEs, which are important elements of molecular epidemiology and public health outcomes.
A multispectrum nonlinear least squares fitting technique has been applied to measure accurate zero-pressure line center positions, Lorentz self- and N2-broadening coefficients and self- and N2-pressure-induced shift coefficients in the parallel ν4 band of CH3CN near 920 cm-1. Fifteen high-resolution (0.0029 cm-1) laboratory absorption spectra of pure and N2-broadened CH3CN recorded at room temperature using the Bruker IFS 125HR Fourier transform spectrometer located at the Pacific Northwest National Laboratory (PNNL) in Richland, Washington, U.S.A. were analyzed simultaneously. Short spectral intervals containing manifolds of transitions from the same value of J have been fitted together. In all, we have obtained high precision line positions, absolute line intensities, self- and N2-broadening coefficients for P(44) through P(3) and R(0) through R(46) manifolds. All measurements have been fitted successfully assuming a Voigt line shape. Preliminary fits of line intensities up to J = 47 using one principal dipole moment derivative and three Herman-Wallis terms are reported. The results are not fully satisfactory due to perturbations caused by interactions with other bands. The total intensity obtained from this prediction by summing individual line intensities for the v4 band region has been compared with the integrated absorption coefficient reported for the v4 band from lower resolution spectra measured at the same laboratory facility. The variations of N2 broadening, self-broadening, N2- shift and self-shift coefficients with the J and K quantum numbers have been measured for the first time. N2-broadening coefficients decrease with increasing J and K. Some self-broadening coefficients are very large (up to ~2 cm-1 atm-1 at 294 K). Ratios of N2-broadening coefficients to self-broadening coefficients show a compact distribution with rotational quantum number in both the P- and R-branches that range from ~0.45 to 15 with a maxima ratio near J"=13. Pressure-induced shifts for N2 are small (few exceed ±0.006 cm-1 atm-1 at 294 K). In contrast, self-shift coefficients are large (maxima of about ±0.06 cm-1 atm-1) and are both positive and negative with compact and distributions as a function of rotational quantum number. A calculation of the total internal partition function sum has been performed and those results have been made available for addition to the HITRAN and GEISA databases. We discuss the status of assignments for CH3CN that are currently available for other mid- and far infrared regions
Materials design aims to identify the material features that provide optimal properties for various engineering applications, such as aerospace, automotive, and naval. One of the important but challenging problems for materials design is to discover multiple polycrystalline microstructures with optimal properties. This paper proposes an end-to-end artificial intelligence (AI)-driven microstructure optimization framework for elastic properties of materials. In this work, the microstructure is represented by the Orientation Distribution Function (ODF) that determines the volume densities of crystallographic orientations. The framework was evaluated on two crystal systems, cubic and hexagonal, for Titanium (Ti) in Joint Automated Repository for Various Integrated Simulations (JARVIS) database and is expected to be widely applicable for materials with multiple crystal systems. The proposed framework can discover multiple polycrystalline microstructures without compromising the optimal property values and saving significant computational time.
Aims.The goal is to develop a database of rate coefficients for rotational state-to-state transitions in H 2 O + H 2 O collisions that is suitable for the modeling of energy transfer in nonequilibrium conditions, in which the distribution of rotational states of H 2 O deviates from local thermodynamic equilibrium. Methods.A two-temperature model was employed that assumed that although there is no equilibrium between all possible degrees of freedom in the system, the translational and rotational degrees of freedom can be expected to achieve their own equilibria independently, and that they can be approximately characterized by Boltzmann distributions at two different temperatures,T kin andT rot . Results.Upon introducing our new parameterization of the collisional rates, taking into account their dependence on bothT kin andT rot , we find a change of up to 20% in the H 2 O rotational level populations for both ortho and para-H 2 O for the part of the cometary coma where the nonequilibrium regime occurs.
Summarization and compression at current and future scales requires a framework for developing and benchmarking algorithms. We present a framework created by integrating existing, production-ready projects and provide timings of two particular algorithms that serve as exemplars for summarization: a wavelet-based data reduction filter and a generator for creating image-like databases of extracted features (isocontours in this case). Both support browser-based, post-hoc, interactive visualization of the summary for decision-making. A study of their weak-scaling on a distributed multi-GPU system is included in this article.
Analysts working with very large data sets often use statistical models to “guess” at unknown, inaccurate, or missing information associated with the data. For example, a distant object viewed through an optical lens will have its position slightly shifted by imperfections in the lens. Thus, rather than considering the object’s observed position to be absolutely correct, it makes sense to take into account the lens’s imperfections to obtain a probabilistic guess as to the object’s true position. For another example, it might be important to associate some sort of error distribution with each of the individual sensors in an array of magnetometers. This error distribution may be complex and include spatially-driven covariances, because errors in nearby sensors are likely to be correlated (caused, for example, by the presence of some nearby, fixed metal object). This project is concerned with the design and implementation of a prototype data management system called the Monte Carlo Database System, or MCDB for short. MCDB allows an expert-level analyst or statistician to attach arbitrary stochastic models to very large data sets in order to “guess” the values for unknown or inaccurate data, such as the actual position of the observed object in the lens example above. When the resulting data set is analyzed, the underlying stochastic models are used to generate hundreds or thousands of possible data set instances, and each of those possible instances is analyzed separately by MCDB. Thus, MCDB does not just give a single answer to the analysis, but it actually gives an empirical distribution of query results that embody the underlying uncertainty, and can in turn be analyzed using standard statistical techniques. The stochastic models in MCDB are implemented as user-defined, external C++ libraries called Variable Generation functions (VG functions for short). Because the VG function interface is exceedingly general, it allows MCDB to be used in a very wide variety of application domains, in conjunction with virtually any stochastic model. Ultimately, we ended up calling the system that we developed over the course of the project SimSQL, to denote the fact that it allowed for stochastic simulation of data. The software developed during the lifetime of the project is available for download from the SimSQL project website: http://cmj4.web.rice.edu/SimSQL/SimSQL.html.
The Metallic Fuels Irradiation and Physics Database (FIPD) is an organized collection of legacy metallic fuel U(Pu)Zr data, measurements, and reactor conditions from the Experimental Breeder Reactor II (EBR-II) and the Fast Flux Test Facility (FFTF). The database provides a wealth of information and is easily accessed and utilized by the U.S. nuclear industry and the Nuclear Regulatory Commission (NRC). The database contains three categories of data. The first category covers fuel pin fabrication specifications, including fuel slug diameter and length, cladding diameter, smeared density, etc. The second consists of operational conditions, which include axial distributions of power, temperature, fluence, burnup, isotopic density, etc. The third category contains post-irradiation examination (PIE) results, largely collected at facilities now part of the Idaho National Laboratory (INL), formerly part of Argonne National Laboratory -West (ANL-W) and at the Alpha-Gamma Hot Cell Facility (AGHCF) at Argonne National Laboratory, comprising fission gas release and chemistry analysis, profilometry measurements, neutron radiography data, etc. All these data have been organized and preserved in FIPD.
The Advanced Solid-State Array Spectroradiometer (ASAS) is an airborne, off-nadir tilting, imaging spectroradiometer that acquires digital image data for 29 spectral bands in the visible and near-infrared. The sensor is used principally for studies of the bidirectional distribution of solar radiation scattered by terrestial surfaces. ASAS has acquired data for a number of terrestial ecosystem field experiments and investigators have received over 170 radiometrically corrected, multiangle, digital image data sets. A database of ASAS digital imagery has been established in the Pilot Land Data System (PLDS) at the NASA/Goddard Space Flight Center to provide access to these data by the scientific community. ASAS, its processed data, and the PLDS are described, together with recent improvements to the sensor system.
The European Space Information System (ESIS) was originally conceived to provide the European space science community with simple and efficient access to space data archives, facilities with which to examine and analyze the retrieved data, and general information services. To achieve that ESIS will provide the scientists with a discipline specific environment for querying in a uniform and transparent manner data stored in geographically dispersed archives. Furthermore it will provide discipline specific tools for displaying and analyzing the retrieved data. The central concept of ESIS is to achieve a more efficient and wider usage of space scientific data, while maintaining the physical archives at the institutions which created them, and has the best background for ensuring and maintaining the scientific validity and interest of the data. In addition to coping with the physical distribution of data, ESIS is to manage also the heterogenity of the individual archives' data models, formats and data base management systems. Thus the ESIS system shall appear to the user as a single database, while it does in fact consist of a collection of dispersed and locally managed databases and data archives. The work reported in this paper is one of the results of the ESIS Pilot Project which is to be completed in 1993. More specifically it presents the pilot ESIS Query Environment (ESIS QE) system which forms the data retrieval and data dissemination axis of the ESIS system. The others are formed by the ESIS Correlation Environment (ESIS CE) and the ESIS Information Services. The ESIS QE Pilot Project is carried out for the European Space Agency's Research and Information center, ESRIN, by a Consortium consisting of Computer Resources International, Denmark, CISET S.p.a, Italy, the University of Strasbourg, France and the Rutherford Appleton Laboratories in the U.K. Furthermore numerous scientists both within ESA and space science community in Europe have been involved in defining the core concepts of the ESIS system.