Search NASA⌕ Search

SEARCH · Search NASA

Results for “massive data sets”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6
All sourcesNASA NTRSDOE OSTI
NASA NTRS2017

GeoDash: Assisting Visual Image Interpretation in Collect Earth Online by Leveraging Big Data on Google Earth Engine

Collect Earth Online (CEO) is a free and open online implementation of the FAO Collect Earth system for collaboratively collecting environmental data through the visual interpretation of Earth observation imagery. The primary collection mechanism in CEO is human interpretation of land surface characteristics in imagery served via Web Map Services (WMS). However, interpreters may not have enough contextual information to classify samples by only viewing the imagery served via WMS, be they high resolution or otherwise. To assist in the interpretation and collection processes in CEO, SERVIR, a joint NASA-USAID initiative that brings Earth observations to improve environmental decision making in developing countries, developed the GeoDash system, an embedded and critical component of CEO. GeoDash leverages Google Earth Engine (GEE) by allowing users to set up custom browser-based widgets that pull from GEE's massive public data catalog. These widgets can be quick looks of other satellite imagery, time series graphs of environmental variables, and statistics panels of the same. Users can customize widgets with any of GEE's image collections, such as the historical Landsat collection with data available since the 1970s, select date ranges, image stretch parameters, graph characteristics, and create custom layouts, all on-the-fly to support plot interpretation in CEO. This presentation focuses on the implementation and potential applications, including the back-end links to GEE and the user interface with custom widget building. GeoDash takes large data volumes and condenses them into meaningful, relevant information for interpreters. While designed initially with national and global forest resource assessments in mind, the system will complement disaster assessments, agriculture management, project monitoring and evaluation, and more.

SERVI↗
DOE OSTI2023

Dark Field Proton Radiography (Los Alamos LDRD Report)

Proton radiography at LANL (pRad) takes advantage of the high flux, high proton energy, and flexible timing structure of LANSCE's 800-MeV proton beam to visualize dense, dynamic systems under extreme strain. With recent needs identified for the development of the W93, the pRad team has been actively searching for ways to increase the facility's radiographic capabilities. Recently, we discovered that utilizing two magnetic lenses (one upstream and one downstream of the object), and specific combinations of collimator choices within the two lenses, that the signal-to-noise ratio was improved by more than a factor of two. However, we did not fully understand the mechanism, and found that results did not match forward modeling predictions. This work specifically sought to implement an engineering solution to solve this problem, through the development of an actuated collimator that reduced the time required to swap collimator settings from a typical 4-8 hours, to less than 30 seconds. This allowed, in combination with a unique multi-material, multi-resolution stepwedge, to acquire an unprecedently enormous dataset, with in total 24 collimation combinations, and multiple diffuser settings and pulse patterns, equivalent to almost a full run cycle's worth of data in a few days. This massive dataset is currently being harnessed to make a fully-predictive, ultra-fast Python-based model of the system, to dial in specific settings for any future experiments that fully optimize that radiographic sensitivity to the material of interest.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
NASA NTRS1998

Distributed Parallel Processing and Dynamic Load Balancing Techniques for Multidisciplinary High Speed Aircraft Design

Multidisciplinary design optimization (MDO) for large-scale engineering problems poses many challenges (e.g., the design of an efficient concurrent paradigm for global optimization based on disciplinary analyses, expensive computations over vast data sets, etc.) This work focuses on the application of distributed schemes for massively parallel architectures to MDO problems, as a tool for reducing computation time and solving larger problems. The specific problem considered here is configuration optimization of a high speed civil transport (HSCT), and the efficient parallelization of the embedded paradigm for reasonable design space identification. Two distributed dynamic load balancing techniques (random polling and global round robin with message combining) and two necessary termination detection schemes (global task count and token passing) were implemented and evaluated in terms of effectiveness and scalability to large problem sizes and a thousand processors. The effect of certain parameters on execution time was also inspected. Empirical results demonstrated stable performance and effectiveness for all schemes, and the parametric study showed that the selected algorithmic parameters have a negligible effect on performance.

Krasteva, Denitza T.↗
NASA NTRS2009

Software Development to Assist in the Processing and Analysis of Data Obtained Using Fiber Bragg Grating Interrogation Systems

A fiber Bragg grating is a portion of a core of a fiber optic strand that has been treated to affect the way light travels through the strand. Light within a certain narrow range of wavelengths will be reflected along the fiber by the grating, while light outside that range will pass through the grating mostly undisturbed. Since the range of wavelengths that can penetrate the grating depends on the grating itself as well as temperature and mechanical strain, fiber Bragg gratings can be used as temperature and strain sensors. This capability, along with the light-weight nature of the fiber optic strands in which the gratings reside, make fiber optic sensors an ideal candidate for flight testing and monitoring in which temperature and wing strain are factors. The purpose of this project is to research the availability of software capable of processing massive amounts of data in both real-time and post-flight settings, and to produce software segments that can be integrated to assist in the task as well.

Hicks, Rebecca↗
DOE OSTI2021

SNEWPY: A Data Pipeline from Supernova Simulations to Neutrino Signals

Current neutrino detectors will observe hundreds to thousands of neutrinos from a Galactic supernovae, and future detectors will increase this yield by an order of magnitude or more. With such a data set comes the potential for a huge increase in our understanding of the explosions of massive stars, nuclear physics under extreme conditions, and the properties of the neutrino. However, there is currently a large gap between supernova simulations and the corresponding signals in neutrino detectors, which will make any comparison between theory and observation very difficult. SNEWPY is an open-source software package which bridges this gap. The SNEWPY code can interface with supernova simulation data to generate from the model either a time series of neutrino spectral fluences at Earth, or the total time-integrated spectral fluence. Data from several hundred simulations of core-collapse, thermonuclear, and pair-instability supernovae is included in the package. This output may then be used by an event generator such as sntools or an event rate calculator such as SNOwGLoBES. Additional routines in the SNEWPY package automate the processing of the generated data through the SNOwGLoBES software and collate its output into the observable channels of each detector. In this paper we describe the contents of the package, the physics behind SNEWPY, the organization of the code, and provide examples of how to make use of its capabilities.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2022

SNEWPY: A Data Pipeline from Supernova Simulations to Neutrino Signals

Current neutrino detectors will observe hundreds to thousands of neutrinos from Galactic supernovae, and future detectors will increase this yield by an order of magnitude or more. With such a data set comes the potential for a huge increase in our understanding of the explosions of massive stars, nuclear physics under extreme conditions, and the properties of the neutrino. However, there is currently a large gap between supernova simulations and the corresponding signals in neutrino detectors, which will make any comparison between theory and observation very difficult. SNEWPY is an open-source software package that bridges this gap. The SNEWPY code can interface with supernova simulation data to generate from the model either a time series of neutrino spectral fluences at Earth, or the total time-integrated spectral fluence. Data from several hundred simulations of core-collapse, thermonuclear, and pair-instability supernovae is included in the package. This output may then be used by an event generator such as sntools or an event rate calculator such as the SuperNova Observatories with General Long Baseline Experiment Simulator (SNOwGLoBES). Additional routines in the SNEWPY package automate the processing of the generated data through the SNOwGLoBES software and collate its output into the observable channels of each detector. In this paper we describe the contents of the package, the physics behind SNEWPY, the organization of the code, and provide examples of how to make use of its capabilities.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

Does the Z boson have a lighter cousin?

In the quenched electroweak theory on the lattice I construct a set of physical states which overlap the physical photon and Z boson states. This is done by employing eigenstates of the covariant lattice Laplacian, in addition to the Higgs and lattice link variables, to construct gauge invariant vector boson creation operators. Diagonalizing the transfer matrix in the subspace of Hilbert space spanned by this set yields a massless photon and massive Z particle, as expected. But in the numerical data there is evidence for more vector bosons in the spectrum, albeit with considerable uncertainty in their masses, with the lowest finite mass particle in the range of 3–4 GeV. Published by the American Physical Society 2025

Greensite, Jeff (ORCID:0000000317209436)↗
DOE OSTI2020

First Results on Dark Matter Substructure from Astrometric Weak Lensing

Low-mass structures of dark matter (DM) are expected to be entirely devoid of light-emitting regions and baryons. Precisely because of this lack of baryonic feedback, small-scale substructures of the Milky Way are a relatively pristine testing ground for discovering aspects of DM microphysics and primordial fluctuations on subgalactic scales. In this work, we report results from the first search for Galactic DM subhalos with time-domain astrometric weak gravitational lensing. The analysis is based on a matched-filter template of local lensing corrections to the proper motion of stars in the Magellanic Clouds. We describe a data analysis pipeline detailing sample selection, background subtraction, and handling outliers and other systematics. For tentative candidate lenses, we identify a signature based on an anomalous parallax template that can unequivocally confirm the presence of a DM lens, opening up prospects for robust discovery potential with full time-series data. We present our constraints on substructure fraction f l ≲5 at 90% CL (and f l ≲2 at 50% CL) for compact lenses with radii r l <1pc, with best sensitivity reached for lens masses M l around 10 7 -10 8 M ⊙ . Parametric improvements are expected with future astrometric data sets; by end of mission, Gaia could reach f l ≲10 -3 for these massive point-like objects, and be sensitive to lighter and/or more extended subhalos for O(1) substructure fractions.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2018

pnnl/SHAD

Scalable High-performance Algorithms and Data-structures. Scalable High-performance Algorithms and Data-structures (SHAD) is an application programming interface based on a generic software library. It has a modular design that enables reuse of modules. The core of this software tool set is built on an Abstract Runtime interface and it's library includes the common data structures such as array, vector, map and set. It is designed to accommodate significant amount of data which can be accessed in massively parallel environments, and used as building blocks for SHAD extensions, i.e. higher level software libraries.

Castellana, Vito↗
NASA NTRS1997

The Contribution of Ionizing Stars to the Far-Infrared and Radio Emission in the Galaxy

This is the first report of a new contract. However, this project represents ongoing work, so there are completed tasks as well as newly started tasks to report. The project involves the completion of the IRAS Galaxy Atlas (IGA), a large image database produced using data from the Infrared Astronomical Satellite (IRAS). In this phase, the project switches from the production and characterization of the IGA to its use in astronomical research studies of massive star formation. The research utilizes the IGA as well as two other large data sets being produced by research partners.

Cao, Yu↗
NASA NTRS2022

An ALMA Study of the Massive Molecular Clump N159W-North in the Large Magellanic Cloud: A Possible Gas Flow Penetrating One of the Most Massive Protocluster Systems in the Local Group

Massive dense clumps in the Large Magellanic Cloud can be an important laboratory to explore the formation ofpopulous clusters. We report multiscale ALMA observations of the N159W-North clump, which is the most CO-intense region in the galaxy. High-resolution CO isotope and 1.3 mm continuum observations with an angularresolution of∼025(∼0.07 pc)revealed more thanfive protostellar sources with CO outflows within the mainridge clump. One of the thermal continuum sources, MMS-2, shows an especially massive/dense nature whosetotal H2mass and peak column density are∼104Meand∼1024cm−2, respectively, and harbors massive(∼100Me)starless core candidates identified as its internal substructures. The main ridge containing this sourcecan be categorized as one of the most massive protocluster systems in the Local Group. The CO high-resolutionobservations found several distinctfilamentary clouds extending southward from the star-forming spots. The CO(1–0)data set with a largerfield of view reveals a conical,∼30 pc long complex extending toward the northerndirection. These features indicate that a large-scale gas compression event may have produced the massive star-forming complex. Based on the striking similarity between the N159W-North complex and the other twopreviously reported high-mass star-forming clouds in the nearby regions, we propose a“teardrops inflow model”that explains the synchronized, extreme star formation across>50 pc, including one of the most massiveprotocluster clumps in the Local Group.

Kazuki Tokuda↗
DOE OSTI2021

Optimization of the Observing Cadence for the Rubin Observatory Legacy Survey of Space and Time: A Pioneering Process of Community-focused Experimental Design

Vera C. Rubin Observatory is a ground-based astronomical facility under construction, a joint project of the National Science Foundation and the U.S. Department of Energy, designed to conduct a multipurpose 10 yr optical survey of the Southern Hemisphere sky: the Legacy Survey of Space and Time. Significant flexibility in survey strategy remains within the constraints imposed by the core science goals of probing dark energy and dark matter, cataloging the solar system, exploring the transient optical sky, and mapping the Milky Way. The survey’s massive data throughput will be transformational for many other astrophysics domains and Rubin’s data access policy sets the stage for a huge community of potential users. To ensure that the survey science potential is maximized while serving as broad a community as possible, Rubin Observatory has involved the scientific community at large in the process of setting and refining the details of the observing strategy. The motivation, history, and decision-making process of this strategy optimization are detailed in this paper, giving context to the science-driven proposals and recommendations for the survey strategy included in this Focus Issue.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2019

Assembly bias evidence in close galaxy pairs

ABSTRACT The growth channel of massive galaxies involving mergers can be studied via close pairs as putative merger progenitors, where the stellar populations of the satellite galaxies will be eventually incorporated into the massive primaries. We extend our recent analysis of the GAMA-based sample of close pairs presented in Ferreras et al. to the general spectroscopic data set of SDSS galaxies (DR14), for which the high S/N of the data enables a detailed analysis of the differences between satellite galaxies with respect to the mass of the primary galaxy. A sample of approximately 2000 satellites of massive galaxies is carefully selected within a relatively narrow redshift range (0.07<z<0.14). Two main parameters are considered as major drivers of the star formation history of these galaxies, namely: the stellar velocity dispersion of the satellite (σ), as a proxy of ‘local’ drivers, and the ratio between the stellar mass of the satellite and the primary, μ = MSAT/MPRI, meant to serve as an indicator of environment. Consistently with the independent, GAMA-based work, we find that satellites around the most massive primaries appear older, at fixed velocity dispersion, than satellites of lower mass primaries. This trend is more marked in lower mass satellites (σ ∼ 100 km s−1), with SSP-equivalent age differences up to ∼0.5 Gyr, and can be interpreted as a one-halo assembly bias, so that satellites corresponding to smaller values of μ represent older structures, akin to fossil groups.

Ferreras, I.↗
DOE OSTI2020

Effective field theory interactions for liquid argon target in DarkSide-50 experiment

We reanalize data collected with the DarkSide-50 experiment and recently used to set limits on the spin-independent interaction rate of weakly interacting massive particles (WIMPs) on argon nuclei with an effective field theory framework. The dataset corresponds to a total (16660 ± 270) kg d exposure using a target of low-radioactivity argon extracted from underground sources. We obtain upper limits on the effective couplings of the 12 leading operators in the nonrelativistic systematic expansion. For each effective coupling we set constraints on WIMP-nucleon cross sections, setting upper limits between 2.4×10-45 cm2 and 2.3×10-42 cm2 (8.9 ×10-45 cm2 and 6.0 ×10-42 cm2) for WIMPs of mass of 100 GeV/c2 (1000 GeV/c2) at 90% confidence level.

Agnes, P↗
DOE OSTI2019

Parallel membership queries on very large scientific data sets using bitmap indexes

© 2019 John Wiley & Sons, Ltd. Many scientific applications produce very large amounts of data as advances in hardware fuel computing and experimental facilities. Managing and analyzing massive quantities of scientific data is challenging as data are often stored in specific formatted files, such as HDF5 and NetCDF, which do not offer appropriate search capabilities. In this research, we investigated a special class of search capability, called membership query, to identify whether queried elements of a set are members of an attribute. Attributes that naturally have classification values appear frequently in scientific domains such as category and object type as well as in daily life such as zip code and occupation. Because classification attribute values are discrete and require random data access, performing a membership query on a large scientific data set creates challenges. We applied bitmap indexing and parallelization to membership queries to overcome these challenges. Bitmap indexing provides high performance not only for low cardinality attributes but also for high cardinality attributes, such as floating-point variables, electric charge, or momentum in a particle physics data set, due to compression algorithms such as Word-Aligned Hybrid. We conducted experiments, in a highly parallelized environment, on data obtained from a particle accelerator model and a synthetic data set.

Yildiz, Beytullah↗
NASA NTRS1987

Dark matter in the galactic disk

Observational data on the distributions of tracer stars, F dwarfs and K giants were used as input to obtain self-consistent solutions for the Poisson and Vlasov equations to set bounds on the amount of missing matter in the solar neighborhood. The numerical computations were carried out using Galaxy models which feature multiple disk components and an unseen massive halo. The star data included the mass components and velocity dispersions. Consideration of various possible distributions of the unseen matter leads to the conjecture that half of the disk material in the solar neighborhood has yet to be observed. Techniques for determining if brown dwarfs are a significant component of the missing mass are discussed, as are improved models which would use limited numbers of tracer stars to set further constraints on the amount and distribution of the missing mass.

Bahcall, John N.↗
DOE OSTI2020

Efficient cosmological analysis of the SDSS/BOSS data from the Effective Field Theory of Large-Scale Structure

The precision of the cosmological data allows us to accurately approximate the predictions for cosmological observables by Taylor expanding up to a low order the dependence on the cosmological parameters around a reference cosmology. By applying this observation to the redshift-space one-loop galaxy power spectrum of the Effective Field Theory of Large-Scale Structure, we analyze the BOSS DR12 data by scanning over all the parameters of ΛCDM cosmology with massive neutrinos. Furthermore, we impose several sets of priors, the widest of which is just a Big Bang Nucleosynthesis prior on the current fractional energy density of baryons, Ω b h 2 , and a bound on the sum of neutrino masses to be less than 0.9 eV. In this case we measure the primordial amplitude of the power spectrum, A s , the abundance of matter, Ω m , the Hubble parameter, H 0 , and the tilt of the primordial power spectrum, n s , to about 19%, 5.7%, 2.2% and 7.3% respectively, obtaining ln (10 10 A s )=2.91± 0.19, Ω m =0.314± 0.018, H 0 =68.7± 1.5 km/(s Mpc) and n s =0.979± 0.071 at 68% confidence level.

79 ASTRONOMY AND ASTROPHYSICS↗
NASA NTRS1996

Towards the Interoperability of Web, Database, and Mass Storage Technologies for Petabyte Archives

At the San Diego Supercomputer Center, a massive data analysis system (MDAS) is being developed to support data-intensive applications that manipulate terabyte sized data sets. The objective is to support scientific application access to data whether it is located at a Web site, stored as an object in a database, and/or storage in an archival storage system. We are developing a suite of demonstration programs which illustrate how Web, database (DBMS), and archival storage (mass storage) technologies can be integrated. An application presentation interface is being designed that integrates data access to all of these sources. We have developed a data movement interface between the Illustra object-relational database and the NSL UniTree archival storage system running in a production mode at the San Diego Supercomputer Center. With this interface, an Illustra client can transparently access data on UniTree under the control of the Illustr DBMS server. The current implementation is based on the creation of a new DBMS storage manager class, and a set of library functions that allow the manipulation and migration of data stored as Illustra 'large objects'. We have extended this interface to allow a Web client application to control data movement between its local disk, the Web server, the DBMS Illustra server, and the UniTree mass storage environment. This paper describes some of the current approaches successfully integrating these technologies. This framework is measured against a representative sample of environmental data extracted from the San Diego Ba Environmental Data Repository. Practical lessons are drawn and critical research areas are highlighted.

Moore, Reagan↗