Search NASA⌕ Search

SEARCH · Search NASA

Results for “large data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,693 records · Page 94

AHF: AMIGA'S HALO FINDER

Cosmological simulations are the key tool for investigating the different processes involved in the formation of the universe from small initial density perturbations to galaxies and clusters of galaxies observed today. The identification and analysis of bound objects, halos, is one of the most important steps in drawing useful physical information from simulations. In the advent of larger and larger simulations, a reliable and parallel halo finder, able to cope with the ever-increasing data files, is a must. In this work we present the freely available MPI parallel halo finder AHF. We provide a description of the algorithm and the strategy followed to handle large simulation data. We also describe the parameters a user may choose in order to influence the process of halo finding, as well as pointing out which parameters are crucial to ensure untainted results from the parallel approach. Furthermore, we demonstrate the ability of AHF to scale to high-resolution simulations.

79 ASTRONOMY AND ASTROPHYSICS↗

Spacecraft Data Simulator for the test of level zero processing systems

The Microelectronic Systems Branch (MSB) at Goddard Space Flight Center (GSFC) has developed a Spacecraft Data Simulator (SDS) to support the development, test, and verification of prototype and production Level Zero Processing (LZP) systems. Based on a disk array system, the SDS is capable of generating large test data sets up to 5 Gigabytes and outputting serial test data at rates up to 80 Mbps. The SDS supports data formats including NASA Communication (Nascom) blocks, Consultative Committee for Space Data System (CCSDS) Version 1 & 2 frames and packets, and all the Advanced Orbiting Systems (AOS) services. The capability to simulate both sequential and non-sequential time-ordered downlink data streams with errors and gaps is crucial to test LZP systems. This paper describes the system architecture, hardware and software designs, and test data designs. Examples of test data designs are included to illustrate the application of the SDS.

Shi, Jeff↗

Potential origin of the state-dependent hard tail in the black hole microquasar Cygnus X-1 as seen with INTEGRAL

Context.0.1–10 MeV observations of the black hole microquasar Cygnus X-1 have shown the presence of a spectral feature in the form of a power law in addition to the standard black body (0.1–10 keV) and Comptontonization (10–200 keV) components usually seen in all black hole X-ray binaries. This so-called “high-energy tail” has recently been shown to be strong in the hard spectral state and has been interpreted as high-energy part of the emission from a compact jet. Aims. This result was, however, obtained from a data set largely dominated by hard state observations. In the soft state, only upper limits on the presence and hence the potential parameters of a hard tail could be derived. Using an extended data set we aim at obtaining better constraints on the properties of this spectral component in both states. Methods. We make use of data obtained from about 15 years of observations with the INTEGRAL satellite. The data set is separated into the different states and we analyse stacked state-resolved spectra obtained from both the gamma-ray Imager and the Spectrometer onboard. Results. A high-energy component is detected in both states, confirming its earlier detection in the hard state and its suspected presence in the soft state as seen in a much smaller SPI data set. We first characterize the hard tail components in the two states through a model-independent, phenomenological analysis. We then apply physical models based on hybrid Comptonization (eqpair and belm). The spectra are well modeled in all cases, with a similar goodness of the fit. The spectral properties of the tails in the two states are, however, quite different. This might indicate that the emission originates from different media in the two cases. Our results are compatible with a compact jet origin in the hard state and hybrid Comptonization in the soft state.

F. Cangemi↗

Names Don't Fly: Smart Filters for Profanity Detection and Classification in User-Generated Content

Generally, names associate with a person’s identity. But what if in the pretext of a legitimate name and given the opportunity, users of software provide names to online web forms that carry along offensive language, slurs, and other profanity that is then sent to Mars ? The answer is simple: they don’t fly. In this paper,we perform model explorations to detect and classify inappropriate content in the names submitted from people across the world to ‘Send Your Names to MARS’ public engagement campaign.We propose a novel pipeline approach, that can effectively overcome the issues of lack of negative samples, noisy labels by gathering expert knowledge over time with human(s) in the loop and data augmentation, and achieve high accuracy in classifying inappropriate names with very little or no context. We describe cloud-based infrastructure to deploy our application and run predictions on large-scale data through our pipeline and achieve significant speedup over offline processes, with enhanced reliability and security.

Soderstrom, Tomas↗

Data Standards for Omics Data: the Basis of Data Sharing and Reuse.

To facilitate sharing of Omics data, many groups of scientists have been working to establish the relevant data standards. The main components of data sharing standards are experiment description standards, data exchange standards, terminology standards, and experiment execution standards. Here we provide a survey of existing and emerging standards that are intended to assist the free and open exchange of large-format data.

59 BASIC BIOLOGICAL SCIENCES↗

Analyzing Real-World Light Duty Vehicle Efficiency Benefits

Off-cycle technologies represent an important pathway to achieve real-world fuel savings, through which OEMs can potentially receive credit toward CAFE compliance. DOE national labs such as NREL are well positioned to provide objective input on these technologies using large, national data sets in conjunction with OEM- and technology-specific testing. This project demonstrates an approach that combines vehicle testing (dynamometer and on-road) with powertrain modeling and simulation over large, representative datasets to quantify real-world fuel economy. The approach can be applied to specific off-cycle technologies (engine encapsulation, start/stop, connected vehicle, etc.) in A/B comparisons to support calculation of realistic real-world impacts. Future work will focus on testing-based A/B technology comparisons that demonstrate the significance of this approach.

33 ADVANCED PROPULSION SYSTEMS↗

Electron contamination in a mid-latitude soft X-ray astronomy experiment during an intense magnetic storm

A large area X-ray sky survey payload was launched from White Sands Missile Range (106 deg W 32 deg N) on 1 Nov. 1972 at 0530 hours U.T. The launch time coincided with intense geomagnetic activity (3 hour K sub p index = 8) following a solar flare. The data have been analyzed to determine possible contamination of X-ray data by large fluxes of low energy electrons that can precipitate down to low altitudes during magnetic storms. There is clear evidence in the data for low energy electrons of 10 - 50 keV contributing appreciably at about 200 km altitude in the 1 - 10 keV X-ray energy channels of the proportional counters used for the X-ray observations. The McIlwain parameters L and B for this altitude at White Sands are 1.25 and 0.46G, respectively.

Naranan, S.↗

Static vs stochastic optimization: A case study of FTSE Bursa Malaysia sectorial indices

Traditional portfolio optimization methods in the likes of Markowitz' mean-variance model and semi-variance model utilize static expected return and volatility risk from historical data to generate an optimal portfolio. The optimal portfolio may not truly be optimal in reality due to the fact that maximum and minimum values from the data may largely influence the expected return and volatility risk values. This paper considers distributions of assets' return and volatility risk to determine a more realistic optimized portfolio. For illustration purposes, the sectorial indices data in FTSE Bursa Malaysia is employed. The results show that stochastic optimization provides more stable information ratio.

97 MATHEMATICS AND COMPUTING↗

Extrapolating gravitational-wave data from numerical simulations

Two complementary techniques are developed for obtaining the asymptotic form of gravitational-wave data at large radii from numerical simulations, in the form of easily implemented algorithms. It is shown that, without extrapolation, near-field effects produce errors in extracted waveforms that can significantly affect LIGO data analysis. The extrapolation techniques are discussed in the context of Newman-Penrose data applied to extrapolation of waveforms from an equal-mass, nonspinning black-hole binary simulation. The results of the two methods are shown to agree within error estimates. The various benefits and deficiencies of the methods are discussed.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

The mineralogy of global magnetic anomalies

Progress is reported in developing predictive abilities to evaluate the potential stabilities of magnetic minerals in the Earth crust and mantle by: (1) computing oxidation state profiling as a function of temperature and pressure; (2) compiling data on basalts to establish validity of the oxidation state profiles; (3) determining Fe-Ni alloys in association with magnetitie as a function of temperature and oxidation state; and (4) acquiring large chemical data banks on the mineral ilmenite which decomposes to mineral spinel in the presence of high sulfur or carbonate environments in the lower crust upper mantle. In addition to acquiring these data which are related to constraining Curie isotherm depths, an excellent correlation was found between MAGSAT anomaly data and the geology of West Africa.

Haggerty, S. E.↗

Proof of CMB-driven X-ray brightening of high-z radio galaxies

We present a definitive assessment of the role of inverse Compton scattering of cosmic microwave background photons (IC/CMB) in the context of radio galaxies. Owing to the steep increase of the CMB radiation energy density, IC/CMB is supposed to become progressively more important with respect to radio synchrotron cooling as the redshift increases. For typical energies at play, this process will up-scatter the CMB photons into the X-ray band, and is thus expected to yield a redshift-dependent, concurrent X-ray brightening and radio dimming of the jet-powered structures. Here, we show how a conclusive proof of this effect hinges on high-resolution imaging data in which the extended lobes can be distinguished from the compact hotspots where synchrotron self-Compton dominates the X-ray emission regardless of redshift. We analyse Chandra and Very Large Array data of 11 radio galaxies between 1.3 ≲ z8 ≲ 4.3⁠, and demonstrate that the emission from their lobes is fully consistent with the expectations from IC/CMB in equipartition. Once the dependence on size and radio luminosity are properly accounted for, the measured lobe X-ray luminosities bear the characteristic ∝(1 + z)4 proportionality expected of a CMB seed radiation field. Whereas this effect can effectively quench the (rest-frame) GHz radio emission from z ≳ 3 radio galaxies below ≲ 1 mJy, IC/CMB alone cannot be responsible for a deficit in high-z, radio-loud active galactic nuclei (AGNs) if – as we argue – such AGNs typically have bright, compact hotspots.

Edmund Hodges-Kluck↗

Scalable Hybrid Learning Techniques for Scientific Data Compression

Data compression is becoming critical for storing scientific data because many scientific applications need to store large amounts of data and post process this data for scientific discovery. Unlike image and video compression algorithms that limit errors to primary data (PD), scientists require compression techniques that accurately preserve derived quantities of interest (QoIs). Here, this article presents a physics-informed compression technique implemented as an end-to-end, scalable, GPU-based pipeline for data compression that addresses this requirement. Our hybrid compression technique combines machine learning techniques and standard compression methods. Specifically, we combine an autoencoder, an error-bounded lossy compressor to provide guarantees on raw data error, and a constraint satisfaction post-processing step to preserve the QoIs within a minimal error (generally less than floating point error). The effectiveness of the data compression pipeline is demonstrated by compressing nuclear fusion simulation data generated by a large-scale fusion code, XGC, which produces hundreds of terabytes of data in a single day. Our approach works within the ADIOS framework and results in compression by a factor of more than 150 while requiring only a few percent of the computational resources necessary for generating the data, making the overall approach highly effective for practical scenarios.

ITER↗

A novel procedure on next generation sequencing data analysis using text mining algorithm

Background: Next-generation sequencing (NGS) technologies have provided researchers with vast possibilities in various biological and biomedical research areas. Efficient data mining strategies are in high demand for large scale comparative and evolutional studies to be performed on the large amounts of data derived from NGS projects. Topic modeling is an active research field in machine learning and has been mainly used as an analytical tool to structure large textual corpora for data mining. Methods: We report a novel procedure to analyse NGS data using topic modeling. It consists of four major procedures: NGS data retrieval, preprocessing, topic modeling, and data mining using Latent Dirichlet Allocation (LDA) topic outputs. The NGS data set of the Salmonella enterica strains were used as a case study to show the workflow of this procedure. The perplexity measurement of the topic numbers and the convergence efficiencies of Gibbs sampling were calculated and discussed for achieving the best result from the proposed procedure. Results: The output topics by LDA algorithms could be treated as features of Salmonella strains to accurately describe the genetic diversity of fliC gene in various serotypes. The results of a two-way hierarchical clustering and data matrix analysis on LDA-derived matrices successfully classified Salmonella serotypes based on the NGS data. The implementation of topic modeling in NGS data analysis procedure provides a new way to elucidate genetic information from NGS data, and identify the gene-phenotype relationships and biomarkers, especially in the era of biological and medical big data. Conclusion: The implementation of topic modeling in NGS data analysis provides a new way to elucidate genetic information from NGS data, and identify the gene-phenotype relationships and biomarkers, especially in the era of biological and medical big data.

59 BASIC BIOLOGICAL SCIENCES↗

Comparing the results of an analytical model of the no-vent fill process with no-vent fill test results for a 4.96 cu m (175 cu ft) tank

NASA-Lewis has been investigating a no-vent fill method for refilling cryogenic storage tanks in low gravity. Analytical modeling based on analyzing the heat transfer of a droplet has successfully represented the process in 0.034 and 0.142 sq m commercial dewars using liquid nitrogen and hydrogen. Recently a large tank (4.96 sq m) was tested with hydrogen. This lightweight tank is representative of spacecraft construction. This paper presents efforts to model the large tank test data. The droplet heat transfer model is found to overpredict the tank pressure level when compared to the large tank data. A new model based on equilibrium thermodynamics has been formulated. This new model is compared to the published large scale tank's test results as well as some additional test runs with the same equipment. The results are shown to match the test results within the measurement uncertainty of the test data except for the initial transient wall cooldown where it is conservative (i.e., overpredicts the initial pressure spike found in this time frame).

Taylor, William J.↗

An ensemble of 48 physically perturbed model estimates of the 1/8° terrestrial water budget over the conterminous United States, 1980–2015

Terrestrial water budget (TWB) data over large domains are of high interest for various hydrological applications. Spatiotemporally continuous and physically consistent estimations of TWB rely on land surface models (LSMs). As an augmentation of the operational North American Land Data Assimilation System Phase 2 (NLDAS-2) four-LSM ensemble, this paper describes a dataset simulated from an ensemble of 48 physics configurations of the Noah LSM with multi-physics options (Noah-MP). The 48 Noah-MP physics configurations are selected to give a representative cross-section of commonly used LSMs for parameterizing runoff, atmospheric surface layer turbulence, soil moisture limitation on photosynthesis, and stomatal conductance. The dataset spans from 1980 to 2015 over the conterminous United States (CONUS) at a monthly temporal resolution and a 1/8° spatial resolution. The dataset variables include total evapotranspiration and its constituents (canopy evaporation, soil evaporation, and transpiration), runoff (the surface and subsurface components), as well as terrestrial water storage (snow water equivalent, four-layer soil water content from the surface down to 2 m, and the groundwater storage anomaly). The dataset is available at https://doi.org/10.5281/zenodo.7109816. Evaluations carried out in this study and previous investigations show that the ensemble per forms well in reproducing the observed terrestrial water storage, snow water equivalent, soil moisture, and runoff. Noah-MP complements the NLDAS models well, and adding Noah-MP consistently improves the NLDAS es timations of the above variables in most areas of CONUS. Besides, the perturbed-physics ensemble facilitates the identification of model deficiencies. The parameterizations of shallow snow, spatially varying groundwater dynamics, and near-surface atmospheric turbulence should be improved in future model versions.

54 ENVIRONMENTAL SCIENCES↗

Climate-Driven Deformation of the Solid Earth from GRACE and GPS

GRACE data indicate large seasonal variations in gravity that are assumed to be related to climate-driven fluxes of space water. Seasonal redistribution of surface mass should deform the Earth, and our calculations using GRACE data suggest vertical deformations of approx. 13 mm in the region of greatest flux, the Amazon River Basin. To test the GRACE gravity-hydrology connection, we analyzed GPS data acquired from sites in this region. After accounting for degree 1 variations not observable with GRACE, we find that annual deformation measured with GPS correlates highly with predictions calculated from GRACE measurements. These results confirm the variations in surface water sensed by GRACE, which are significantly larger than those predicted by some hydrology models. The results also demonstrate that GRACE can be an important tool for monitoring deformation of the Earth, and suggest that combined analysis of GRACE and GPS may be a useful approach for estimation of geocenter variations.

Davis, J. L.↗

Potential origin of the state-dependent high-energy tail in the black hole microquasar Cygnus X-1 as seen with INTEGRAL

Context. 0.1–10 MeV observations of the black hole microquasar Cygnus X-1 have shown the presence of a spectral feature in the form of a power law in addition to the standard black body (0.1–10 keV) and Comptonization (10–200 keV) components observed by INTEGRAL in several black-hole X-ray binaries. This so-called “high-energy tail” was recently shown to be strong in the hard spectral state of Cygnus X-1, and, in this system, has been interpreted as the high-energy part of the emission from a compact jet. Aims. This result was nevertheless obtained from a data set largely dominated by hard state observations. In the soft state, only upper limits on the presence and hence the potential parameters of a high-energy tail could be derived. Using an extended data set, we aim to obtain better constraints on the properties of this spectral component in both states. Methods. We make use of data obtained from about 15 years of observations with the INTEGRAL satellite. The data set is separated into the different states and we analyze stacked state-resolved spectra obtained from the X-ray monitors, the gamma-ray imager, and the gamma-ray spectrometer (SPI) onboard. Results. A high-energy component is detected in both states, confirming its earlier detection in the hard state and its suspected presence in the soft state with INTEGRAL, as seen in a much smaller SPI data set. We first characterize the high-energy tail components in the two states through a model-independent, phenomenological analysis. We then apply physical models based on hybrid Comptonization (eqpair and belm). The spectra are well modeled in all cases, with a similar goodness of the fits. While in the semi-phenomenological approach the high-energy tail has similar indices in both states, the fits with the physical models seem to indicate slightly different properties. Based on this approach, we discuss the potential origins of the high-energy components in both the soft and hard states, and favor an interpretation where the high-energy component is due to a compact jet in the hard state and hybrid Comptonization in either a magnetized or nonmagnetized corona in the soft state.

accretion↗

The Computing and Data Grid Approach: Infrastructure for Distributed Science Applications

With the advent of Grids - infrastructure for using and managing widely distributed computing and data resources in the science environment - there is now an opportunity to provide a standard, large-scale, computing, data, instrument, and collaboration environment for science that spans many different projects and provides the required infrastructure and services in a relatively uniform and supportable way. Grid technology has evolved over the past several years to provide the services and infrastructure needed for building 'virtual' systems and organizations. We argue that Grid technology provides an excellent basis for the creation of the integrated environments that can combine the resources needed to support the large- scale science projects located at multiple laboratories and universities. We present some science case studies that indicate that a paradigm shift in the process of science will come about as a result of Grids providing transparent and secure access to advanced and integrated information and technologies infrastructure: powerful computing systems, large-scale data archives, scientific instruments, and collaboration tools. These changes will be in the form of services that can be integrated with the user's work environment, and that enable uniform and highly capable access to these computers, data, and instruments, regardless of the location or exact nature of these resources. These services will integrate transient-use resources like computing systems, scientific instruments, and data caches (e.g., as they are needed to perform a simulation or analyze data from a single experiment); persistent-use resources. such as databases, data catalogues, and archives, and; collaborators, whose involvement will continue for the lifetime of a project or longer. While we largely address large-scale science in this paper, Grids, particularly when combined with Web Services, will address a broad spectrum of science scenarios. both large and small scale.

Johnston, William E.↗