Large scale maximum average power multiple inference on time-course count data with application to RNA-seq analysis
Not provided.
SEARCH · Search NASA
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Not provided.
The EC-Earth climate model is a seamless Earth System Model (ESM) used to carry out climate research in 24 academic institutions and meteorological services from 11 countries in Europe. This model couples several components and it is continuously under development. In this work we present a study regarding the impact of the I/O and data management when using EC-Earth in well-known supercomputing environments. Most large-scale and long-term climate simulators have been developed bearing in mind the paramount importance of its scalability. However, the computational capabilities of the High Performance Computing (HPC) environments increase at so great speed that it is almost impossible to re-implement the whole models so that they are able to exploit efficiently the new features. Therefore, it is necessary to design different strategies to take advantage of them. In this work we present an operational framework to run ensemble simulations in HPC platforms. A set of experiments are presented in order to validate the suitability of this technique. Moreover, the derived impact regarding the I/O and data management aspects is analyzed.
We present the first published method to convert data obtained by the Pioneer Venus Large Probe Neutral Mass Spectrometer (LNMS) into units of mixing ratio (ppm) and volume percent (v%) against CO 2 and N 2 , the dominant Venus atmospheric gases, including conversion to density (kg m −3 ). These unit conversions are key to unlocking the untapped potential of the data, which represents a significant challenge given the scant calibration data in the literature. Herein, we show that our data treatments and conversions yield mixing ratios and volume percent values for H 2 O, N 2 , and SO 2 that are within error to those reported for the gas chromatograph (LGC) on the Pioneer Venus Large Probe (PVLP). For the noble gases, we developed strategies to correct for instrument biases by treating the data as a relative scale and using PVLP and Venera-based measurements as calibration points. Together, these methods, conversions, calibrations, and comparisons afford novel unit conversions for the LNMS data and yield unified measures for Venus’ atmosphere from the LNMS and LGC on the PVLP. - Conversion into mixing ratio (ppm), volume percent (v%), and density (kg m −3 ). - Mixing ratios are expressed against CO 2 and N 2 . - LNMS and LGC measurements on the PVLP are consistent.
Population data represent an essential component in studies focusing on human–nature interrelationships, disaster risk assessment and environmental health. Several recent efforts have produced global- and continental-extent gridded population data which are becoming increasingly popular among various research communities. However, these data products, which are of very different characteristics and based on different modeling assumptions, have never been systematically reviewed and compared, which may impede their appropriate use. This article fills this gap and presents, compares and discusses a set of large-scale (global and continental) gridded datasets representing population counts or densities. It focuses on data properties, methodological approaches and relative quality aspects that are important to fully understand the characteristics of the data with regard to the intended uses. Written by the data producers and members of the user community, through the lens of the “fitness for use” concept, the aim of this paper is to provide potential data users with the knowledge base needed to make informed decisions about the appropriateness of the data products available in relation to the target application and for critical analysis.
Attention is given to the proposed Intelligent Information Fusion System (IIFS) within the framework of the Intelligent Data Management project at NASA-Goddard. IIFS is to use connectionist architectures to extract high-level attributes from incoming sensor images, and then send those characterizations and their associated ephemeris and ancillary image data to a large object-oriented database which will serve as the master catalog of sensor data. Important issues facing this project include the choice of rapid-access data structures (RADSs) for cataloging images by their high-level characterization, the implementation of efficient spatial data structures for cataloging images by their scene location, the automated population of such a database from a continuous stream of incoming ephemeris and ancillary data, and the translation and optimization of natural-language database queries so that RADSs are employed when appropriate.
Experiences in developing a large engineering data management system are described. Problems which were encountered are presented and projected to future systems. Business applications involving similar types of data bases are described. A data base management system architecture proposed by the business community is described and its applicability to engineering data management is discussed. It is concluded that the most difficult problems faced in engineering and business data management can best be solved by cooperative efforts.
The analysis of large sensor datasets for structural and functional features has applications in many domains, including weather and climate modeling, characterization of subsurface reservoirs, and biomedicine. The vast amount of data obtained from state-of-the-art sensors and the computational cost of analysis operations create a barrier to such analyses. In this paper, we describe middleware system support to take advantage of large clusters of hybrid CPU–GPU nodes to address the data and compute-intensive requirements of feature-based analyses of large spatio-temporal datasets.
Wide area data transfers play an important role in many science applications but rely on expensive infrastructure that often delivers disappointing performance in practice. In response, we present a systematic examination of a large set of data transfer log data to characterize transfer characteristics, including the nature of the datasets transferred, achieved throughput, user behavior, and resource usage. This analysis yields new insights that can help design better data transfer tools, optimize networking and edge resources used for transfers, and improve the performance and experience for end users. Our analysis shows that (i) most of the datasets as well as individual files transferred are very small; (ii) data corruption is not negligible for large data transfers; and (iii) the data transfer nodes utilization is low. Insights gained from our analysis suggest directions for further analysis.
Interpreting data from large-scale protein interaction experiments has been a challenging task because of the widespread presence of random false positives. Here, we present a network-based statistical algorithm that overcomes this difficulty and allows us to derive functions of unannotated proteins from large-scale interaction data. Our algorithm uses the insight that if two proteins share significantly larger number of common interaction partners than random, they have close functional associations. Analysis of publicly available data from Saccharomyces cerevisiae reveals >2,800 reliable functional associations, 29% of which involve at least one unannotated protein. By further analyzing these associations, we derive tentative functions for 81 unannotated proteins with high certainty. Our method is not overly sensitive to the false positives present in the data. Even after adding 50% randomly generated interactions to the measured data set, we are able to recover almost all (approximately 89%) of the original associations.
Managing scientific data has been identified by the scientific community as one of the most important emerging needs because of the sheer volume and increasing complexity of data being collected. Effectively generating, managing, and analyzing this information requires a comprehensive, end-to-end approach to data management that encompasses all of the stages from the initial data acquisition to the final analysis of the data. Based on community input, we have identified three significant requirements. First, more efficient access to storage systems is needed. In particular, parallel file system and I/O system improvements are needed to write and read large volumes of data without slowing a simulation. Second, scientists require technologies to facilitate better understanding of their data, in particular the ability to effectively perform complex data analysis and searches over extremely large data sets. Furthermore, exploratory analysis requires techniques for efficiently selecting subsets of the data. Third, generating the data, collecting and storing the results, keeping track of data provenance, data post-processing, and analysis of results is a tedious, fragmented process. Tools for automation of this process in a robust, tractable, and recoverable fashion are required to enhance scientific exploration.
A series of data assimilation experiments is performed to assess the impact of Seasat A satellite scatterometer (SASS) wind data on Goddard Laboratory for Atmospheric Sciences (GLAS) model forecasts. The SASS data are dealiased as part of an objective analysis system utilizing a three-pass procedure. The impact of the SASS data is evaluated with and without temperature soundings from the NOAA 4 Vertical Temperature Profile Radiometer (VTPR) instrument in order to study possible redundancy between surface wind data and upper air temperature data. In the northern hemisphere the SASS data are generally found to have a negligible effect on the forecasts. In the southern hemisphere the forecast impact from SASS data is somewhat larger and primarily beneficial in the absence of VTPR data. However, the inclusion of VTPR data effectively eliminates the positive impact over Australia and South America. This indicates that SASS data can be beneficial for numerical weather prediction in regions with large data gaps, but in the presence of satellite soundings the usefulness of SASS data is significantly reduced.
The temperature of the stratosphere has been measured in the Arctic vortex every 9-10 minutes along the trajectory of four Infra Red Montgolfier long duration balloons flown for 7 to 22 days during the winters of 1997 and 1999. From a number of comparisons to independent sensors, the accuracy of the measurements is demonstrated to be plus or minus 0.5 K during nighttime and at altitude below 28 km (10 hPa). The performances of the analyses of global meteorological models, European Center for Medium Range Weather Forecasts (ECMWF) 31 and 50 levels, United Kingdom Meteorological Office (UKMO), Data Assimilation Office (DAO), National Climatic Prediction Center (NCEP) and NCEP/NCAR reanalysis, used in photochemical simulations of ozone destruction and interpretation of satellite data, are evaluated by comparison to this large (3500 data points) and homogeneous experimental data set. Most of models, except ECMWF31 in 1999, do show a smal1 average warm bias of between 0 and 1.6 K, with deviations particularly large, up to 20 K at high altitude (5hPa) in stratospheric warming conditions in 1999. Particularly wrong was ECMWF 31 levels near its top level at 10 hPa in 1999 where temperature 25 K colder than the real atmosphere were reported. The average dispersion between models and measurements varies from plus or minus 1.0 to plus or minus 3.0 K depending on the model and the year. It is shown to be the result of three contributions. The largest is a long wave modulation likely caused by the displacement of the temperature field in the analyses compared to real atmosphere. The second is the overestimation of the vertical gradient of temperature particularly in warming conditions, which explains the increase of dispersion from 1997 to 1999. Unexpectedly, the third and smallest (plus or minus 0.6-0.7 K) is the contribution of meso and subgrid scale vertical and horizontal features associated to the vertical propagation of orographic or gravity waves. Compared to other models, the newly available ECMWF 50 levels version assimilating the high vertical resolution radiances of the space borne Advanced Microwave Sounding Unit, performs significantly better (0.03 plus or minus 1.12 K on average between 10 and 140 hPa in 1999) than other models.
P and S-wave datasets and associated report studying the ability to use three-component long offset surface seismic surveys to find large aperture fractures in geothermal resources at the San Emidio geothermal resource area in Washoe County, Nevada.
A molecular-level understanding of electrolyte solvation structure and ion–ion correlations is critical to developing next-generation battery chemistries. Atomistic simulation capabilities with sufficient accuracy, speed, and transferability to deliver reliable structural insights while avoiding arduous system-specific reparameterization are thus highly desirable. Machine learning interatomic potentials (MLIPs) trained on large, chemically diverse data sets are revolutionizing computational chemistry, enabling molecular dynamics simulations of battery electrolytes with near-DFT accuracy over 10,000× faster than DFT. While previous MLIP training data sets with suitable elemental coverage for electrolytes have been based on inorganic materials, the Open Molecules 2025 (OMol25) data set provides large-scale molecular DFT MLIP training data with broad elemental coverage and specifically samples tens of millions of electrolyte configurations. Here, we integrate computational modeling with experimental validation to systematically assess the ability of large-scale MLIPs pretrained on materials data or on OMol25 to accurately resolve nanoscale structural organization and ion-solvation characteristics in Na-ion battery electrolytes across diverse physicochemical conditions and compositional regimes. We find that the OMol25-trained Universal Model of Atoms (UMA-OMol) predicts experimentally measured densities and X-ray structure factors in substantially better agreement compared to state-of-the-art models trained only on inorganic materials data. Using UMA-OMol, we further analyze systematic trends in solvation structure as a function of cation identity, anion chemistry, salt concentration, and solvent topology. We observe that increasing system temperature amplifies the heterogeneity within the solvation environment, perturbing cation–solvent interactions and promoting the formation of contact ion pairs (CIPs). Moreover, subtle variations in the solvent topology of glyme-based electrolytes cause pronounced changes in ion correlations and solvation structure. The experimental agreement and microscopic insights shown here position OMol25-trained MLIPs as a practical route to predictive, high-throughput electrolyte simulations beyond the limits of classical force fields and direct DFT molecular dynamics, serving as a powerful tool for accelerating the design of next-generation Na-ion battery electrolytes and beyond.
One of the events postulated in the hazard analysis at the Waste Treatment and Immobilization Plant (WTP) and other U.S. Department of Energy (DOE) nuclear facilities is a breach in process piping that produces aerosols with droplet sizes in the respirable range. The current approach for predicting the size and concentration of aerosols produced in a spray leak involves extrapolating from correlations reported in the literature. These correlations are based on results obtained from small engineered spray nozzles using pure liquids with Newtonian fluid behavior. The narrow ranges of physical properties on which the correlations are based do not cover the wide range of slurries and viscous materials that will be processed in the WTP and across processing facilities in the DOE complex. To expand the data set upon which the WTP accident and safety analyses were based, an aerosol spray leak testing program was conducted by Pacific Northwest National Laboratory (PNNL). PNNL’s test program addressed two key technical areas to improve the WTP methodology (Larson and Allen 2010). The first technical area was to quantify the role of slurry particles in small breaches where slurry particles may plug the hole and prevent high-pressure sprays. The results from an effort to address this first technical area can be found in Mahoney et al. (2012a). The second technical area was to determine aerosol droplet size distribution and total droplet volume from prototypic breaches and fluids, including sprays from larger breaches and sprays of slurries for which literature data are largely absent. To address the second technical area, the testing program collected aerosol generation data at two scales, commonly referred to as small-scale and large-scale. The small-scale testing and resultant data are described in Mahoney et al. (2012b) and the large-scale testing and resultant data are presented in Schonewill et al. (2012). In tests at both scales, simulants were used to mimic the relevant physical properties projected for actual WTP process streams.
Non-negative matrix factorization (Nmf) is an important tool in high-performance large scale data analytics with applications ranging from community detection, recommender system, feature detection and linear and non-linear unmixing. While traditional Nmf works well when the data set is relatively dense, however, it may not extract sufficient structure when the data is extremely sparse. Specifically, traditional Nmf fails to exploit the structured sparsity of the large and sparse data sets resulting in dense factors. We propose a new algorithm for performing Nmf on sparse data that we call multifrontal Nmf (Mf-Nmf) since it borrows several ideas from the multifrontal method for unconstrained factorization (e.g. LU and QR). We also present an efficient shared memory parallel implementation of Mf-Nmf and discuss its performance and scalability. We conduct several experiments on synthetic and realworld datasets and demonstrate the usefulness of the algorithm by comparing it against standard baselines. We obtain a speedup of 1.2x to 19.5x on 24 cores with an average speed up of 10.3x across all the real world datasets.
Dark matter in the Milky Way may annihilate directly into γ rays, producing a monoenergetic spectral line. Therefore, detecting such a signature would be strong evidence for dark matter annihilation or decay. We search for spectral lines in the Fermi Large Area Telescope observations of the Milky Way halo in the energy range 200 MeV–500 GeV using analysis methods from our most recent line searches. The main improvements relative to previous works are our use of 5.8 years of data reprocessed with the Pass 8 event-level analysis and the additional data resulting from the modified observing strategy designed to increase exposure of the Galactic center region. Furthermore, we search in five sky regions selected to optimize sensitivity to different theoretically motivated dark matter scenarios and find no significant detections. In addition to presenting the results from our search for lines, we also investigate the previously reported tentative detection of a line at 133 GeV using the new Pass 8 data.
Synchrotron-based X-ray diffraction (XRD) and small-angle Xray scattering (SAXS) characterization techniques used on unirradiated and irradiated reactor pressure vessel steels yield large amounts of data. Machine learning techniques, including PCA, offer a novel method of analyzing and visualizing these large data sets in order to determine the effects of chemistry and irradiation conditions on the formation of radiation induced precipitates. In order to run analysis on these data sets, preprocessing must be carried out to convert the data to a usable format and mask the 2-D detector images to account for experimental variations. Once the data has been preprocessed, it can be organized and visualized using principal component analysis (PCA), multi-dimensional scaling, and k-means clustering. In conclusion, from these techniques, it is shown that sample chemistry has a notable effect on the formation of the radiation induced precipitates in reactor pressure vessel steels.