Search NASA⌕ Search

SEARCH · Search NASA

Results for “DISTRIBUTED DATA PROCESSING”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 973 records · Page 54

Total absorption spectroscopy for the 𝛽 + decay strength distribution of 60 Ga

𝛽-decay properties play an important role in most astrophysical processes. In the absence of experimental data, astrophysical models rely on global theoretical calculations to provide the relevant properties. It is therefore important to provide strong experimental constraints when possible. In the case of 𝛽-decay, the most sensitive probe is the 𝛽-decay strength distribution. We report here on the first measurement of the latter quantity for the 𝛽 + decay of 60 Ga using the total absorption spectroscopy technique. The experimental results are compared to theoretical calculations often used in astrophysical models, namely the shell model and the quasiparticle random phase approximation (QRPA), as well as an extension of QRPA that includes higher-order nucleonic calculations. Both models are in reasonable agreement with the experimental results.

59 ≤ A ≤ 89↗

Real-time Intrusion Detection for High-bandwidth Research Networks using Unsupervised Deep Learning

Nowadays, data generated by large-scale scientific experiments are on the scale of petabytes per month. These data are transferred through dedicated high-bandwidth networks across distributed collaboration sites for processing, storage, and analysis. Like general purpose networks, research networks experience attacks. However, monitoring traffic in such high-bandwidth network environments is challenging with conventional deep packet inspection (DPI)- based network intrusion detection systems (NIDS). Recently, machine learning (ML) algorithms have shown potential in detecting anomalous patterns with better generalizability and faster speed. Compared to the general purpose networks, traffic movement in research network is less volatile and more likely to benefit from the ML-based anomaly analysis. We present ThunderSecure, an efficient AI-powered system for detecting anomalies in 100G research networks. ThunderSecure implements a high-throughput packet processing infrastructure using multi-cores and GPUs. It takes time-series statistics from a variety of network measurements and uses 2D Convolutional Neural Network (CNN) to explore both spatial and temporal dependencies in network data stream. Patterns of science data traffic are learned with a one-class neural network, which blends an Adversarial Autoencoder (AAE) with Gaussian mixture density estimation. Testing traffic flows exhibiting significant deviations from the learned baseline of normality are marked as anomalies. We trained ThunderSecure on hundreds of billions of science data packets recorded from a 100G research network at Fermi National Accelerator Laboratory. The detection performance was evaluated on traffic captured from the same research network days and weeks after the training with different types of attack flows injected. To the best of our knowledge, this is the first ML work in the area of network anomaly detection that has been validated on such extreme scale datasets. Results show that ThunderSecure can recognize science data traffic that are captured long after the training and make nearly certain detection on those with anomalous flows injected, even in the case when the anomaly-to-normal mixing ratio is 0.1%.

Gong, Qian↗

Approach for Propagating Radiometric Data Uncertainties Through NASA Ocean Color Algorithms

Spectroradiometric satellite observations of the ocean are commonly referred to as “ocean color” remote sensing. NASA has continuously collected, processed, and distributed ocean color datasets since the launch of the Sea-viewing Wide-field-of-view Sensor (SeaWiFS) in 1997. While numerous ocean color algorithms have been developed in the past two decades that derive geophysical data products from sensor-observed radiometry, few papers have clearly demonstrated how to estimate measurement uncertainty in derived data products. As the uptake of ocean color data products continues to grow with the launch of new and advanced sensors, it is critical that pixel-by-pixel data product uncertainties are estimated during routine data processing. Knowledge of uncertainties can be used when studying long-term climate records, or to assist in the development and performance appraisal of bio-optical algorithms. In this method paper we provide a comprehensive overview of how to formulate first-order first-moment (FOFM) calculus for propagating radiometric uncertainties through a selection of bio-optical models. We demonstrate FOFM uncertainty formulations for the following NASA ocean color data products: chlorophyll-a pigment concentration (Chl), the diffuse attenuation coefficient at 490 nm (K(sub d,490)), particulate organic carbon (POC), normalized fluorescent line height (nflh), and inherent optical properties (IOPs). Using a quality-controlled in situ hyperspectral remote sensing reflectance (R(sub rs,i)) dataset, we show how computationally inexpensive, yet algebraically complex, FOFM calculations may be evaluated for correctness using the more computationally expensive Monte Carlo approach. We compare bio-optical product uncertainties derived using our test R(sub rs) dataset assuming spectrally-flat, uncorrelated relative uncertainties of 1, 5, and 10%. We also consider spectrally dependent, uncorrelated relative uncertainties in R(sub rs). The importance of considering spectral covariances in R(sub rs), where practicable, in the FOFM methodology is highlighted with an example SeaWiFS image. We also present a brief case study of two POC algorithms to illustrate how FOFM formulations may be used to construct measurement uncertainty budgets for ecologically-relevant data products. Such knowledge, even if rudimentary, may provide useful information to end-users when selecting data products or when developing their own algorithms.

Bio-optics↗

Development of alternative data analysis techniques for improving the accuracy and specificity of natural resource inventories made with digital remote sensing data

An investigation was conducted into ways to improve the involvement of state and local user personnel in the digital image analysis process by isolating those elements of the analysis process which require extensive involvement by field personnel and providing means for performing those activities apart from a computer facility. In this way, the analysis procedure can be converted from a centralized activity focused on a computer facility to a distributed activity in which users can interact with the data at the field office level or in the field itself. A general image processing software was developed on the University of Minnesota computer system (Control Data Cyber models 172 and 74). The use of color hardcopy image data as a primary medium in supervised training procedures was investigated and digital display equipment and a coordinate digitizer were procured.

Lillesand, T. M.↗

Coupled‐cluster singles, doubles and perturbative triples with density fitting approximation for massively parallel heterogeneous platforms

Abstract A high‐performance implementation of the coupled‐cluster singles, doubles, and perturbative triples [CCSD(T)] is developed in the Massively Parallel Quantum Chemistry program. Novel features include: (1) reduced memory requirements via a density‐fitting (DF) CCSD implementation utilizing distributed lazy evaluation for tensors with more than two unoccupied indices and (2) the ability to utilize efficiently many‐core nodes (Intel Xeon Phi) and heterogeneous nodes with multiple NVIDIA GPUs on each node. All data that are greater than quadratic in the system size are distributed among processes. Excellent strong scaling is observed on distributed‐memory computers equipped with conventional CPUs, Intel Xeon Phi processors, and heterogeneous nodes with multiple NVIDIA GPUs Canonical CCSD(T) energies can be evaluated for systems containing 200 electrons and 1000 basis functions in a few days using a small size commodity cluster, with even larger computations possible on leadership‐class computing resources.

Peng, Chong↗

The Interaction Between Boundary Layer and Convection Schemes in a WRF Simulation of Post Cold Frontal Clouds Over the ARM East North Atlantic Site

Abstract The correct representation of low‐level midlatitude clouds found in the wake of cold fronts strongly relies on the representation of planetary boundary layer (PBL) and convection processes, which are typically parameterized separately in numerical models. Using the Weather Research and Forecasting Model (WRF), this study investigates how distinct pairs of PBL and convection parameterization schemes represent cloud fraction in the post cold frontal region. The simulations focus on the region of the Department of Energy Atmospheric Radiation Measurement (ARM) Eastern North Atlantic observation site in the Azores Islands in the wake of a cold front that passed on 25 December 2015. Different PBL and convection schemes are combined to create 12 distinct configurations. The main differences between the selected physical parameterizations are the strength of vertical mixing and the entrainment. The simulations produce a wide range of cloud fractions, where some configurations significantly underestimate while others clearly overestimate satellite and surface‐based estimates of cloud fraction. A skill score is used to quantitatively assess the performance of each configuration with respect to ground‐based radar data. The key processes that are found to significantly impact the cloud fraction distribution are the strength of the PBL decoupling, the vertical wind shear, entrainment and detrainment rates in shallow convection, and the occurrence of drizzle. This indicates that to successfully simulate post cold frontal clouds, modeled physics must balance strong internal vertical mixing and weak exchange with the free troposphere. For this case study, cloud fraction was more sensitive to the choice of convection scheme than PBL scheme.

54 ENVIRONMENTAL SCIENCES↗

Structural investigation of amorphous materials at high pressures

A modified diamond anvil cell (DAC) is used for structural studies of amorphous materials at high pressures using a monochromatic synchrotron x-ray beam. The DAC modification includes (1) the use of x-ray transparent seats for a large angular opening for x-ray scattering, and (2) the introduction of a boron gasket insert to increase the sample thickness and to minimize the gasket-hole deformation. A procedure for absorption correction and background subtraction in DAC experiments is described, together with an optimization process for obtaining accurate data of the structure factor and the corresponding pair distribution function. Data for amorphous iron at 67 GPa are presented for demonstration. It is shown that quantitative structural data can be determined for amorphous materials at very high pressures using the DAC. The apparatus should be also useful for structural studies of liquids at high pressures.

43 PARTICLE ACCELERATORS↗

Exclusive photoproduction of J/ψ and ψ(2S) in pp and AA collisions

The amplitude for γp → J/ψp(γp → ψ'p) is calculated in a pQCD k{sub ⊥}-factorization approach. The total cross section for this process is calculated for different unintegrated gluon distributions and compared with the HERA data and the data extracted recently by the LHCb collaboration. The amplitude for γp → J/ψp(γp → ψ'p) is used to predict the cross section for exclusive photoproduction of the J/ψ(ψ') meson in proton-proton and nucleus-nucleus collisions. In the pp case, compared to earlier calculations we include both Dirac and Pauli electromagnetic form factors. We also discuss the dependence of nuclear shadowing on the charmonium state.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

THE MASS DISTRIBUTION OF STELLAR-MASS BLACK HOLES

We perform a Bayesian analysis of the mass distribution of stellar-mass black holes using the observed masses of 15 low-mass X-ray binary systems undergoing Roche lobe overflow and 5 high-mass, wind-fed X-ray binary systems. Using Markov Chain Monte Carlo calculations, we model the mass distribution both parametrically-as a power law, exponential, Gaussian, combination of two Gaussians, or log-normal distribution-and non-parametrically-as histograms with varying numbers of bins. We provide confidence bounds on the shape of the mass distribution in the context of each model and compare the models with each other by calculating their relative Bayesian evidence as supported by the measurements, taking into account the number of degrees of freedom of each model. The mass distribution of the low-mass systems is best fit by a power law, while the distribution of the combined sample is best fit by the exponential model. This difference indicates that the low-mass subsample is not consistent with being drawn from the distribution of the combined population. We examine the existence of a 'gap' between the most massive neutron stars and the least massive black holes by considering the value, M{sub 1%}, of the 1% quantile from each black hole mass distribution as the lower bound of black hole masses. Our analysis generates posterior distributions for M{sub 1%}; the best model (the power law) fitted to the low-mass systems has a distribution of lower bounds with M{sub 1%}>4.3 M{sub sun} with 90% confidence, while the best model (the exponential) fitted to all 20 systems has M{sub 1%}>4.5 M{sub sun} with 90% confidence. We conclude that our sample of black hole masses provides strong evidence of a gap between the maximum neutron star mass and the lower bound on black hole masses. Our results on the low-mass sample are in qualitative agreement with those of Ozel et al., although our broad model selection analysis more reliably reveals the best-fit quantitative description of the underlying mass distribution. The results on the combined sample of low- and high-mass systems are in qualitative agreement with Fryer and Kalogera, although the presence of a mass gap remains theoretically unexplained.

79 ASTRONOMY AND ASTROPHYSICS↗

The Carnegie-Spitzer-IMACS redshift survey of galaxy evolution since z = 1.5. I. Description and methodology

We describe the Carnegie-Spitzer-IMACS (CSI) Survey, a wide-field, near-IR selected spectrophotometric redshift survey with the Inamori Magellan Areal Camera and Spectrograph (IMACS) on Magellan-Baade. By defining a flux-limited sample of galaxies in Spitzer Infrared Array Camera 3.6 μm imaging of SWIRE fields, the CSI Survey efficiently traces the stellar mass of average galaxies to z ∼ 1.5. This first paper provides an overview of the survey selection, observations, processing of the photometry and spectrophotometry. We also describe the processing of the data: new methods of fitting synthetic templates of spectral energy distributions are used to derive redshifts, stellar masses, emission line luminosities, and coarse information on recent star formation. Our unique methodology for analyzing low-dispersion spectra taken with multilayer prisms in IMACS, combined with panchromatic photometry from the ultraviolet to the IR, has yielded high-quality redshifts for 43,347 galaxies in our first 5.3 deg{sup 2} of the SWIRE XMM-LSS field. We use three different approaches to estimate our redshift errors and find robust agreement. Over the full range of 3.6 μm fluxes of our selection, we find typical redshift uncertainties of σ {sub z}/(1 + z) ≲ 0.015. In comparisons with previously published spectroscopic redshifts we find scatters of σ {sub z}/(1 + z) = 0.011 for galaxies at 0.7 ≤ z ≤ 0.9, and σ {sub z}/(1 + z) = 0.014 for galaxies at 0.9 ≤ z ≤ 1.2. For galaxies brighter and fainter than i = 23 mag, we find σ {sub z}/(1 + z) = 0.008 and σ {sub z}/(1 + z) = 0.022, respectively. Notably, our low-dispersion spectroscopy and analysis yields comparable redshift uncertainties and success rates for both red and blue galaxies, largely eliminating color-based systematics that can seriously bias observed dependencies of galaxy evolution on environment.

79 ASTRONOMY AND ASTROPHYSICS↗

Grid site availability evaluation and monitoring at CMS

The Compact Muon Solenoid (CMS) experiment at the Large Hadron Collider (LHC) uses distributed grid computing to store, process, and analyse the vast quantity of scientific data recorded every year. The computing resources are grouped into sites and organized in a tiered structure. Each site provides computing and storage to the CMS computing grid. Over a hundred sites worldwide contribute with resources from hundred to well over ten thousand computing cores and storage from tens of TBytes to tens of PBytes. In such a large computing setup scheduled and unscheduled outages occur continually and are not allowed to significantly impact data handling, processing, and analysis. Unscheduled capacity and performance reductions need to be detected promptly and corrected. CMS developed a sophisticated site evaluation and monitoring system for Run 1 of the LHC based on tools of the Worldwide LHC Computing Grid. For Run 2 of the LHC the site evaluation and monitoring system is being overhauled to enable faster detection/reaction to failures and a more dynamic handling of computing resources. Furthermore, enhancements to better distinguish site from central service issues and to make evaluations more transparent and informative to site support staff are planned.

43 PARTICLE ACCELERATORS↗

ggtaxplot v 0.0.1

ggtaxplot is an R package designed to process and visualize taxonomic data through a taxonomic river plot. This package is ideal for researchers and data scientists who need to visualize taxonomic data. ggtaxplot function processes data and generates a taxonomic river plot, allowing users to visualize the distribution of taxa across different samples.

Coclet, Clement [Lawrence Berkeley National Labora↗

Validation and Verification for INL Modelica-based TEDS models Via Experimental Results

This report provides an overview on the verification and validation (V&V) of the Thermal Energy Distribution System (TEDS) model developed in the Modelica process modeling ecosystem using experimental data. Model development has led to the creation of a dynamic process model of the experimental TEDS facility housed within the Energy Systems Laboratory (ESL) at Idaho National Laboratory (INL). The model was then used during the preconstruction phase of the experimental effort to inform experimental design (e.g., insulation requirements, bypass line placement, expected performance of components) and to test innovative control schemes prior to the initial operation. The TEDS model developed in Modelica includes the primary components of the TEDS experimental unit: a 200kW Chromalox heater; a single-tank packed-bed thermal energy storage system filled with 0.125-inch alumina (Al2O3) beads; an ethylene-glycol-to-Therminol-66 heat exchanger; system piping; five control valves; and all associated temperature, pressure, and volumetric flow sensors. Using the Institute of Electrical and Electronics Engineers (IEEE) V&V methodologies, considered the gold standard in the engineering field, the model was verified using a combination of static analysis, spatial convergence, and regression tests. Then using dynamic time warping (DTW) initial runs to validate and tune the TEDS model versus the experiment were conducted. This tuning method was accomplished using the INL Risk Analysis Virtual ENvironment (RAVEN) software package. Tuning is required to account for physical phenomena that are less understood within the empirical heat transfer correlations. Through the commencement of this work, a systems-level model of TEDS with associated control systems, sensors, piping diameters, and component capabilities has been created. This model was utilized in the pre-experimental phase to inform system design, insulation thicknesses, and potential control schemes to operate the system effectively and safely. Then, initial experimental startup and operational data were used to demonstrate the validation and tuning methodology. This process demonstrates the classical two-step approach of a model informing experimental design followed by the experiment validation and tuning the model.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Comparing Neutron Star Kicks to Supernova Remnant Asymmetries

Supernova explosions are inherently asymmetric and can accelerate new-born neutron stars (NSs) to hundreds of km s{sup −1}. Two prevailing theories to explain NS kicks are ejecta asymmetries (e.g., conservation of momentum between NS and ejecta) and anisotropic neutrino emission. Observations of supernova remnants (SNRs) can give us insights into the mechanism that generates these NS kicks. In this paper, we investigate the relationship between NS kick velocities and the X-ray morphologies of 18 SNRs observed with the Chandra X-ray Observatory and the Röntgen Satellite ( ROSAT ). We measure SNR asymmetries using the power-ratio method (a multipole expansion technique), focusing on the dipole, quadrupole, and octupole power ratios. Our results show no correlation between the magnitude of the power ratios and NS kick velocities, but we find that for Cas A and G292.0+1.8, whose emission traces the ejecta distribution, their NSs are preferentially moving opposite to the bulk of the X-ray emission. In addition, we find a similar result for PKS 1209–51, CTB 109, and Puppis A; however, their emission is dominated by circumstellar/interstellar material, so their asymmetries may not reflect their ejecta distributions. Our results are consistent with the theory that NS kicks are a consequence of ejecta asymmetries as opposed to anisotropic neutrino emission. In the future, additional observations to measure NS proper motions within ejecta-dominated SNRs are necessary to robustly constrain the NS kick mechanism.

79 ASTRONOMY AND ASTROPHYSICS↗

Statistical analysis of general aviation VG-VGH data

To represent the loads spectra of general aviation aircraft operating in the Continental United States, VG and VGH data collected since 1963 in eight operational categories were processed and analyzed. Adequacy of data sample and current operational categories, and parameter distributions required for valid data extrapolation were studied along with envelopes of equal probability of exceeding the normal load factor (n sub z) versus airspeed for gust and maneuver loads and the probability of exceeding current design maneuver, gust, and landing impact n sub z limits. The significant findings are included.

Clay, L. E.↗

Terrestrial weathering of Antarctic stone meteorites - Formation of Mg-carbonates on ordinary chondrites

Results are presented on the mineralogy, chemistry, and origin of white efflorescences on the surface of Lewis Cliff (Antarctica) 85320 (H5) chondrite (LEW 85320). Particular attention is given to determining the sources of the cations and anions of the evaporite, in order to establish the relative importance of the meteoritic element distribution and terrestrial contamination in the evaporite formation during the weathering process. The data on Na, K, Ca, and Rb abundances in efflorescence from LEW 85320 suggest that cations in evaporite minerals on Antarctic meteorites are not the products of contamination by terrestrial (marine) salts. It is suggested that the Mg in efflorescence on LEW 85320 originated from weathering of meteoritic olivine.

Velbel, Michael A.↗

TRMM Data Mining Service at the Goddard Earth Sciences (GES) DISC DAAC Tropical Rainfall Measuring Mission (TRMM)

TRMM has acquired more than four years of data since its launch in November 1997. All TRMM standard products are processed by the TRMM Science Data and Information System (TSDIS) and archived and distributed to general users by the GES DAAC. Table 1 shows the total archive and distribution as of February 28, 2002. The Utilization Ratio (UR), defined as the ratio of the number of distributed files to the number of archived files, of the TRMM standard products has been steadily increasing since 1998 and is currently at 6.98.

Source record↗

Design for the Structure and the Mechanics of Moballs

The moball is envisioned to be a round, self-powered, and wind-driven multifunctioning sensor used in the Gone with the Wind ON-Mars (GOWON) [http://www.lpi.usra.edu/meetings/ marsconcepts2012/pdf/4238.pdf]: A Wind-Driven Networked System of Mobile sensors on Mars. The moballs would have sensing, processing, and communication capabilities. The moballs would perform in situ detection of key environmental elements such as vaporized water, trace gases, wind, dust, clouds, light and UV exposure, temperature, as well as minerals of interest, possible biosignatures, surface magnetic and electric fields, etc. The embedded various low-power micro instruments could include a Multispectral Microscopic Imager (to detect various minerals), a compact curved focal plane array camera (UV/Vis/NIR) with a large field of view, a compact UV/Visible spectrometer, a micro-weather station, etc. The moballs could communicate with each other and an orbiter. Their wind- or gravity-driven rolling movement could be used to harvest and store electric energy. They could also generate and store energy using the sunlight, when available, and the diurnal temperature variations on Mars. The moballs would be self-aware of their (and their neighbors ) positions, energy storage, and memory availability; they would have processing power and could intelligently cooperate with neighboring moballs by distributing tasks, sharing data, and fusing information. The major advantages of using the wind-driven and spherical moball network over rovers or other fixed sensor webs to explore Mars would be: (1) moballs could explore a much larger expanse of Mars in a much faster fashion, (2) they could explore the difficult terrains such as steep slopes and sand dunes, and (3) they would be self-energy- generating and could work together and move around autonomously. The challenge in designing the structure and the mechanics of the moball would be that it should be sturdy enough to withstand the impact of its initial fall, as well as other impacts from obstacles in its way. A mechanism would be needed that could enable hundreds of moballs to be carried while they would be deflated and compact, then would inflate them just after deploying them to their drop site. Furthermore, the moballs should also be light enough to allow them to move easily over obstacles by force of the wind. They also should have some kind of maneuvering mechanism in place to help them avoid very hazardous sharp objects or events, and to enable them to get closer to the objects of interest. The structure of the moballs was designed so that they would have different layers. The outer layer should comprise a sturdy, yet light, polymer that could withstand both the impact of the initial drop, as well as the impact of the different obstacles it would encounter while traversing the surface of Mars. This polymer should not deteriorate with the 100 K daily temperature swings on Mars. The inner layer should consist of a very light gas such as nitrogen or helium. In terms of maneuvering, six very light weights placed at strategic locations would give moballs the ability to turn, or even hop, over hazardous (e.g., sharp) obstacles, or even initiate a movement (before getting more help from the wind to be carried around) when stuck. Maneuvering would be necessary in order to get closer to objects of interest. If the weights would be allowed to move freely, they could also be used to generate energy.

Davoodi, Faranak↗