SEARCH · Search NASA

Results for “massive data sets”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

All sources NASA NTRS DOE OSTI

NASA NTRS1995

SAVS: A Space and Atmospheric Visualization Science system

The research environment faced by space and atmospheric scientists in the 1990s is characterized by unprecedented volumes of new data, by ever-increasing repositories of unexploited mission files, and by the widespread use of empirical and large-scale computational models needed for the synthesis of understanding across data sets and discipline boundaries. The effective analysis and interpretation of such massive amounts of information have become the subjects of legitimate concern. With SAVS (a Space and Atmospheric Visualization Science System), we address these issues by creating a 'push-button' software environment that mimics the logical scientific processes in data acquisition, reduction, and analysis without requiring a detailed understanding of the methods, networks, and modules that link the tools and effectively execute the functions. SAVS provides (1) a customizable framework for accessing a powerful set of visualization tools based on the popular AVS visualization software with hooks to PV-Wave and access to Khoros modules, (2) a set of mathematical and statistical tools, (3) an extensible library of discipline-specific functions and models (e.g., MSIS, IRI, Feldstein Oval, IGRF, satellite tracking with CADRE-3, etc.), and (4) capabilities for local and remote data base access. The system treats scalar, vector, and image data, and runs on most common Unix workstations. We present a description of SAVS and its components, followed by several applications based on generic research interests in interplanetary and magnetospheric physics (IMP/ISTP), active experiments in space (CRRES), and mission planning focused on the Earth's thermospheric, ionospheric, and mesospheric domains (TIMED).

Szuszczewicz, E. P.↗

DOE OSTI2019

Search for anomalous triple gauge couplings in WW and WZ production in lepton + jet events in proton-proton collisions at $\sqrt{s} =$ 13 TeV

A search is presented for three additional operators that would lead to anomalous WWγ or WWZ couplings with respect to those in the standard model. They are constrained by studying events with two vector bosons, a W boson decaying to eν or μν, and a W or Z boson decaying hadronically, reconstructed as a single, massive, large- radius jet. The search uses a data set of proton-proton collisions at a centre-of-mass energy of 13 TeV, recorded by the CMS experiment at the CERN LHC in 2016, and corresponding to an integrated luminosity of 35.9 fb$^{-1}$. Using the reconstructed diboson invariant mass, 95% confidence intervals are obtained for the anomalous coupling parameters of -1.58 < $c_{WWW}$/Λ$^{2}$< 1.59 TeV$^{-2}$, -2.00 < c$_{W}$/Λ$^{2}$< 2.65 TeV$^{-2}$, and -8.78 < c$_{B}$/Λ$^{2}$< 8.54 TeV$^{-2}$, in agreement with standard model expectations of zero for each parameter. These are the strictest bounds on these parameters to date.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

DOE OSTI2017

MC{sup 2}: Multiwavelength and Dynamical Analysis of the Merging Galaxy Cluster ZwCl 0008.8+5215: An Older and Less Massive Bullet Cluster

We present and analyze a rich data set including Subaru/SuprimeCam, HST/Advanced Camera for Surveys and Wide Field Camera 3, Keck/DEIMOS, Chandra/ACIS-I, and JVLA/C and D array for the merging cluster of galaxies ZwCl 0008.8+5215. With a joint Subaru+HST weak gravitational lensing analysis, we identify two dominant subclusters and estimate the masses to be M{sub 200}=5.7{sub −1.8}{sup +2.8}×10{sup 14} M{sub ⊙} and 1.2{sub −0.6}{sup +1.4}×10{sup 14} M{sub ⊙}. We estimate the projected separation between the two subclusters to be 924{sub −206}{sup +243} kpc. We perform a clustering analysis of spectroscopically confirmed cluster member galaxies and estimate the line-of-sight velocity difference between the two subclusters to be 92±164 km s{sup −1}. We further motivate, discuss, and analyze the merger scenario through an analysis of the 42 ks of Chandra/ACIS-I and JVLA/C and D array polarization data. The X-ray surface brightness profile reveals a merging gas-core reminiscent of the Bullet Cluster. The global X-ray luminosity in the 0.5–7.0 keV band is 1.7±0.1×10{sup 44} erg s{sup −1} and the global X-ray temperature is 4.90 ± 0.13 keV. The radio relics are polarized up to 40%, and along with the masses, velocities, and positions of the two subclusters, we input these quantities into a Monte Carlo dynamical analysis and estimate the merger velocity at pericenter to be 1800{sub −300}{sup +400} km s{sup −1}. This is a lower-mass version of the Bullet Cluster and therefore may prove useful in testing alternative models of dark matter (DM). We do not find significant offsets between DM and galaxies, but the uncertainties are large with the current lensing data. Furthermore, in the east, the BCG is offset from other luminous cluster galaxies, which poses a puzzle for defining DM–galaxy offsets.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2017

M32 analogs? A population of massive ultra-compact dwarf and compact elliptical galaxies in intermediate-redshift clusters

We report the discovery of relatively massive, M32-like ultra compact dwarf (UCD) and compact elliptical (CE) galaxy candidates in 0.2<z<0.6 massive galaxy clusters imaged by the Cluster Lensing And Supernova survey with Hubble (CLASH) survey. Examining the nearly unresolved objects in the survey, we identify a sample of compact objects concentrated around the cluster central galaxies with colors similar to cluster red sequence galaxies. Their colors and magnitudes suggest stellar masses around 10{sup 9}M{sub ⊙}. More than half of these galaxies have half-light radii smaller than 200 pc, falling into the category of massive UCDs and CEs, with properties similar to M32. The properties are consistent with a tidal stripping origin, but we cannot rule out the possibility that they are early-formed compact objects trapped in massive dark matter halos. The 17 CLASH clusters studied in this work on average contain 2.7 of these objects in their central 0.3 Mpc and 0.6 in their central 50 kpc. Our study demonstrates the possibility of statistically characterizing UCDs/CEs with a large set of uniform imaging survey data.

79 ASTRONOMY AND ASTROPHYSICS↗

NASA NTRS2021

The NANOGrav 11yr Data Set: Limits on Supermassive Black Hole Binaries in Galaxies within 500 Mpc

Supermassive black hole binaries (SMBHBs) should form frequently in galactic nuclei as a result of galaxy mergers. At subparsec separations, binaries become strong sources of low-frequency gravitational waves (GWs), targeted by Pulsar Timing Arrays. We used recent upper limits on continuous GWs from the North American Nanohertz Observatory for Gravitational Waves (NANOGrav) 11 yr data set to place constraints on putative SMBHBs in nearby massive galaxies. We compiled a comprehensive catalog of ∼44,000 galaxies in the local universe (up to redshift ∼0.05) and populated them with hypothetical binaries, assuming that the total mass of the binary is equal to the SMBH mass derived from global scaling relations. Assuming circular equal-mass binaries emitting at NANOGrav's most sensitive frequency of 8 nHz, we found that 216 galaxies are within NANOGrav's sensitivity volume. We ranked the potential SMBHBs based on GW detectability by calculating the total signal-to-noise ratio such binaries would induce within the NANOGrav array. We placed constraints on the chirp mass and mass ratio of the 216 hypothetical binaries. For 19 galaxies, only very unequal-mass binaries are allowed, with the mass of the secondary less than 10% that of the primary, roughly comparable to constraints on an SMBHB in the Milky Way. However, we demonstrated that the (typically large) uncertainties in the mass measurements can weaken the upper limits on the chirp mass. Additionally, we were able to exclude binaries delivered by major mergers (mass ratio of at least 1/4) for several of these galaxies. We also derived the first limit on the density of binaries delivered by major mergers purely based on GW data.

Zaven Arzoumanian↗

DOE OSTI2021

ABACUSSUMMIT : a massive set of high-accuracy, high-resolution N -body simulations

We present the public data release of the AbacusSummit cosmological N-body simulation suite, produced with the Abacus N-body code on the Summit supercomputer of the Oak Ridge Leadership Computing Facility. Abacus achieves $\mathcal {O}(10^{-5})$ median fractional force error at superlative speeds, calculating 70M particle updates per second per node at early times, and 45M particle updates per second per node at late times. The simulation suite totals roughly 60 trillion particles, the core of which is a set of 139 simulations with particle mass $2\times 10^{9}\, h^{-1}\, \mathrm{M}_\odot$ in box size $2\, h^{-1}\, \mathrm{Gpc}$. The suite spans 97 cosmological models, including Planck 2018, previous flagship simulation cosmologies, and a linear derivative and cosmic emulator grid. A subsuite of 1883 boxes of size $500\, h^{-1}\, \mathrm{Mpc}$ is available for covariance estimation. AbacusSummit data products span 33 epochs from z = 8 to 0.1 and include light cones, full particle snapshots, halo catalogues, and particle subsets sampled consistently across redshift. AbacusSummit is the largest high-accuracy cosmological N-body data set produced to date.

79 ASTRONOMY AND ASTROPHYSICS↗

NASA NTRS2011

Space-Time Data fusion for Remote Sensing Applications

NASA has been collecting massive amounts of remote sensing data about Earth's systems for more than a decade. Missions are selected to be complementary in quantities measured, retrieval techniques, and sampling characteristics, so these datasets are highly synergistic. To fully exploit this, a rigorous methodology for combining data with heterogeneous sampling characteristics is required. For scientific purposes, the methodology must also provide quantitative measures of uncertainty that propagate input-data uncertainty appropriately. We view this as a statistical inference problem. The true but notdirectly- observed quantities form a vector-valued field continuous in space and time. Our goal is to infer those true values or some function of them, and provide to uncertainty quantification for those inferences. We use a spatiotemporal statistical model that relates the unobserved quantities of interest at point-level to the spatially aggregated, observed data. We describe and illustrate our method using CO2 data from two NASA data sets.

carbon dioxide↗

NASA NTRS2018

Digital Technologies at NASA for Science and Engineering

While scientific and engineering advancements used to rely primarily on theoretical studies and physical experiments, today digital technology enabled by petaflops-scale supercomputers is an equal, if not a greater, contributor to such achievements. In addition, computational modeling and simulation serves as a predictive tool that is not otherwise available. As a result, the use of high performance computing is integral to NASA's work in all mission areas such as space exploration, aeronautics, and scientific discovery. But traditional supercomputing alone is not sufficient for all of the space agency's needs. The success of many NASA missions depends on solving complex computing challenges, some of which are NP-hard (decision theory) if using classical solution methods. Quantum computing promises an unprecedented ability to solve such intractable problems by harnessing quantum mechanical effects such as tunneling, superposition, and entanglement. Another disruptive digital technology is neuromorphic computing that uses brain-inspired lessons to generate new architectures that are much more energy efficient, and capable of massive parallel processing and learning in-situ. Finally, with large amounts of observational and computational data sets, the opportunities of big data and data analytics can be leveraged to enable deep learning and knowledge discovery - it's all a massive digital transformation. This talk will be an overview how NASA utilizes digital technologies for its science and engineering efforts.

Biswas, Rupak↗

DOE OSTI2023

Neutrino signatures of 100 2D Axisymmetric Core-Collapse Supernova Simulations

ABSTRACT We present in this paper a public data release of an unprecedentedly large set of core-collapse supernova (CCSN) neutrino emission models, comprising 100 detailed 2D axisymmetric radiation-hydrodynamic simulations evolved out to as late as ∼5 s post-bounce and spanning an extensive range of massive-star progenitors. The motivation for this paper is to provide a physically and numerically uniform benchmark data set to the broader neutrino detection community to help it characterize and optimize subsurface facilities for what is likely to be a once-in-a-lifetime galactic supernova burst event. With this release, we hope to (1) help the international experiment and modelling communities more efficiently optimize the retrieval of physical information about the next galactic CCSN, (2) facilitate the better understanding of core-collapse theory and modelling among interested experimentalists, and (3) help further integrate the broader supernova neutrino community.

Astronomy & Astrophysics↗

DOE OSTI2022

Wavelet and Deep-Learning-Based Approach for Generation System Problematic Parameters Identification and Calibration

Accurate models of generation systems are critical for maintaining reliable and secure grid operations. In this paper, a novel and systematic approach is proposed to identify and calibrate the generation system problematic parameters using continuous wavelet transform (CWT) and advanced deep-learning technology. The phasor measurement unit (PMU) data are used through “event playback” to check whether the parameter calibration is required, and if yes, a group of suspicious parameters will be identified as the primary problematic parameter candidates (PPCs). These primary PPCs are randomly perturbed to generate the event playback simulation data, which are used by the CWT and convolutional neural networks (CNNs) to further narrow down the primary PPCs into a smaller set of candidates. Then, the identified candidates are perturbed again to generate massive event playback simulation data for training a parameter calibration neural network. Here, we designed a multi-output neural network structure to find the mappings between the perturbed parameters and the simulation data using both CNN and long short-term memory (LSTM) models. Finally, the well-trained and tested CNN-LSTM model is used to estimate the accurate value of the suspicious parameters with actual PMU measurements. The proposed CNN-LSTM network can accurately and reliably estimate the generation-system problematic parameters, and has better performance when compared to other machine-learning methods, such as the multilayer perceptron network and the conditional variational autoencoder method. The accuracy and effectiveness of the proposed approach have been validated through simulation and real-world data.

24 POWER TRANSMISSION AND DISTRIBUTION↗

NASA NTRS2012

Graphics Processing Unit Assisted Thermographic Compositing

Objective Develop a software application utilizing high performance computing techniques, including general purpose graphics processing units (GPGPUs), for the analysis and visualization of large thermographic data sets. Over the past several years, an increasing effort among scientists and engineers to utilize graphics processing units (GPUs) in a more general purpose fashion is allowing for previously unobtainable levels of computation by individual workstations. As data sets grow, the methods to work them grow at an equal, and often greater, pace. Certain common computations can take advantage of the massively parallel and optimized hardware constructs of the GPU which yield significant increases in performance. These common computations have high degrees of data parallelism, that is, they are the same computation applied to a large set of data where the result does not depend on other data elements. Image processing is one area were GPUs are being used to greatly increase the performance of certain analysis and visualization techniques.

Ragasa, Scott↗

NASA NTRS2013

Graphics Processing Unit Assisted Thermographic Compositing

Objective: To develop a software application utilizing general purpose graphics processing units (GPUs) for the analysis of large sets of thermographic data. Background: Over the past few years, an increasing effort among scientists and engineers to utilize the GPU in a more general purpose fashion is allowing for supercomputer level results at individual workstations. As data sets grow, the methods to work them grow at an equal, and often greater, pace. Certain common computations can take advantage of the massively parallel and optimized hardware constructs of the GPU to allow for throughput that was previously reserved for compute clusters. These common computations have high degrees of data parallelism, that is, they are the same computation applied to a large set of data where the result does not depend on other data elements. Signal (image) processing is one area were GPUs are being used to greatly increase the performance of certain algorithms and analysis techniques.

Ragasa, Scott↗

DOE OSTI2018

SHAD: the Scalable High-performance Algorithms and Data-structures Library

The unprecedented amount of data that needs to be processed in emerging data analytics applications poses novel challenges to industry and academia. Scalability and high performance become more than a desirable feature because, due to the scale and the nature of the problems, they draw the line between what is achievable and what is unfeasible. In this paper, we propose SHAD, the Scalable High-performance Algorithms and Data-structures library. SHAD adopts a modular design that confines low level details and promotes reuse. SHAD's core is built on an Abstract Runtime Interface which enhances portability and identifies the minimal set of features of the underlying system required by the framework. The core library includes common data-structures such as: Array, Vector, Map and Set. These are designed to accommodate significant amount of data which can be accessed in massively parallel environments, and used as building blocks for SHAD extensions, i.e. higher level software libraries. We have validated and evaluated our design with a performance and scalability study of the core components of the library. We have validated the design flexibility by proposing a Graph Library as an example of SHAD extension, which implements two different graph data-structures; we evaluate their performance with a set of graph applications. Experimental results show that the approach is promising in terms of both performance and scalability. On a distributed system with 320 cores, SHAD Arrays are able to sustain a throughput of 65 billion operations per second, while SHAD Maps sustain 1 billion of operations per second. Algorithms implemented using the Graph Library exhibit performance and scalability comparable to a custom solution, but with smaller development effort.

Castellana, Vito G.↗

NASA NTRS2017

GeoDash: Assisting Visual Image Interpretation in Collect Earth Online by Leveraging Big Data on Google Earth Engine

Collect Earth Online (CEO) is a free and open online implementation of the FAO Collect Earth system for collaboratively collecting environmental data through the visual interpretation of Earth observation imagery. The primary collection mechanism in CEO is human interpretation of land surface characteristics in imagery served via Web Map Services (WMS). However, interpreters may not have enough contextual information to classify samples by only viewing the imagery served via WMS, be they high resolution or otherwise. To assist in the interpretation and collection processes in CEO, SERVIR, a joint NASA-USAID initiative that brings Earth observations to improve environmental decision making in developing countries, developed the GeoDash system, an embedded and critical component of CEO. GeoDash leverages Google Earth Engine (GEE) by allowing users to set up custom browser-based widgets that pull from GEE's massive public data catalog. These widgets can be quick looks of other satellite imagery, time series graphs of environmental variables, and statistics panels of the same. Users can customize widgets with any of GEE's image collections, such as the historical Landsat collection with data available since the 1970s, select date ranges, image stretch parameters, graph characteristics, and create custom layouts, all on-the-fly to support plot interpretation in CEO. This presentation focuses on the implementation and potential applications, including the back-end links to GEE and the user interface with custom widget building. GeoDash takes large data volumes and condenses them into meaningful, relevant information for interpreters. While designed initially with national and global forest resource assessments in mind, the system will complement disaster assessments, agriculture management, project monitoring and evaluation, and more.

SERVI↗

DOE OSTI2023

Dark Field Proton Radiography (Los Alamos LDRD Report)

Proton radiography at LANL (pRad) takes advantage of the high flux, high proton energy, and flexible timing structure of LANSCE's 800-MeV proton beam to visualize dense, dynamic systems under extreme strain. With recent needs identified for the development of the W93, the pRad team has been actively searching for ways to increase the facility's radiographic capabilities. Recently, we discovered that utilizing two magnetic lenses (one upstream and one downstream of the object), and specific combinations of collimator choices within the two lenses, that the signal-to-noise ratio was improved by more than a factor of two. However, we did not fully understand the mechanism, and found that results did not match forward modeling predictions. This work specifically sought to implement an engineering solution to solve this problem, through the development of an actuated collimator that reduced the time required to swap collimator settings from a typical 4-8 hours, to less than 30 seconds. This allowed, in combination with a unique multi-material, multi-resolution stepwedge, to acquire an unprecedently enormous dataset, with in total 24 collimation combinations, and multiple diffuser settings and pulse patterns, equivalent to almost a full run cycle's worth of data in a few days. This massive dataset is currently being harnessed to make a fully-predictive, ultra-fast Python-based model of the system, to dial in specific settings for any future experiments that fully optimize that radiographic sensitivity to the material of interest.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

NASA NTRS1998

Distributed Parallel Processing and Dynamic Load Balancing Techniques for Multidisciplinary High Speed Aircraft Design

Multidisciplinary design optimization (MDO) for large-scale engineering problems poses many challenges (e.g., the design of an efficient concurrent paradigm for global optimization based on disciplinary analyses, expensive computations over vast data sets, etc.) This work focuses on the application of distributed schemes for massively parallel architectures to MDO problems, as a tool for reducing computation time and solving larger problems. The specific problem considered here is configuration optimization of a high speed civil transport (HSCT), and the efficient parallelization of the embedded paradigm for reasonable design space identification. Two distributed dynamic load balancing techniques (random polling and global round robin with message combining) and two necessary termination detection schemes (global task count and token passing) were implemented and evaluated in terms of effectiveness and scalability to large problem sizes and a thousand processors. The effect of certain parameters on execution time was also inspected. Empirical results demonstrated stable performance and effectiveness for all schemes, and the parametric study showed that the selected algorithmic parameters have a negligible effect on performance.

Krasteva, Denitza T.↗

NASA NTRS2009

Software Development to Assist in the Processing and Analysis of Data Obtained Using Fiber Bragg Grating Interrogation Systems

A fiber Bragg grating is a portion of a core of a fiber optic strand that has been treated to affect the way light travels through the strand. Light within a certain narrow range of wavelengths will be reflected along the fiber by the grating, while light outside that range will pass through the grating mostly undisturbed. Since the range of wavelengths that can penetrate the grating depends on the grating itself as well as temperature and mechanical strain, fiber Bragg gratings can be used as temperature and strain sensors. This capability, along with the light-weight nature of the fiber optic strands in which the gratings reside, make fiber optic sensors an ideal candidate for flight testing and monitoring in which temperature and wing strain are factors. The purpose of this project is to research the availability of software capable of processing massive amounts of data in both real-time and post-flight settings, and to produce software segments that can be integrated to assist in the task as well.

Hicks, Rebecca↗

DOE OSTI2021

SNEWPY: A Data Pipeline from Supernova Simulations to Neutrino Signals

Current neutrino detectors will observe hundreds to thousands of neutrinos from a Galactic supernovae, and future detectors will increase this yield by an order of magnitude or more. With such a data set comes the potential for a huge increase in our understanding of the explosions of massive stars, nuclear physics under extreme conditions, and the properties of the neutrino. However, there is currently a large gap between supernova simulations and the corresponding signals in neutrino detectors, which will make any comparison between theory and observation very difficult. SNEWPY is an open-source software package which bridges this gap. The SNEWPY code can interface with supernova simulation data to generate from the model either a time series of neutrino spectral fluences at Earth, or the total time-integrated spectral fluence. Data from several hundred simulations of core-collapse, thermonuclear, and pair-instability supernovae is included in the package. This output may then be used by an event generator such as sntools or an event rate calculator such as SNOwGLoBES. Additional routines in the SNEWPY package automate the processing of the generated data through the SNOwGLoBES software and collate its output into the observable channels of each detector. In this paper we describe the contents of the package, the physics behind SNEWPY, the organization of the code, and provide examples of how to make use of its capabilities.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗