Search NASA⌕ Search

SEARCH · Search NASA

Results for “DISTRIBUTED DATA PROCESSING”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 991 records · Page 55

TRMM Data Mining Service at the Goddard Earth Sciences (GES) DISC DAAC Tropical Rainfall Measuring Mission (TRMM)

TRMM has acquired more than four years of data since its launch in November 1997. All TRMM standard products are processed by the TRMM Science Data and Information System (TSDIS) and archived and distributed to general users by the GES DAAC. Table 1 shows the total archive and distribution as of February 28, 2002. The Utilization Ratio (UR), defined as the ratio of the number of distributed files to the number of archived files, of the TRMM standard products has been steadily increasing since 1998 and is currently at 6.98.

Source record↗

Design for the Structure and the Mechanics of Moballs

The moball is envisioned to be a round, self-powered, and wind-driven multifunctioning sensor used in the Gone with the Wind ON-Mars (GOWON) [http://www.lpi.usra.edu/meetings/ marsconcepts2012/pdf/4238.pdf]: A Wind-Driven Networked System of Mobile sensors on Mars. The moballs would have sensing, processing, and communication capabilities. The moballs would perform in situ detection of key environmental elements such as vaporized water, trace gases, wind, dust, clouds, light and UV exposure, temperature, as well as minerals of interest, possible biosignatures, surface magnetic and electric fields, etc. The embedded various low-power micro instruments could include a Multispectral Microscopic Imager (to detect various minerals), a compact curved focal plane array camera (UV/Vis/NIR) with a large field of view, a compact UV/Visible spectrometer, a micro-weather station, etc. The moballs could communicate with each other and an orbiter. Their wind- or gravity-driven rolling movement could be used to harvest and store electric energy. They could also generate and store energy using the sunlight, when available, and the diurnal temperature variations on Mars. The moballs would be self-aware of their (and their neighbors ) positions, energy storage, and memory availability; they would have processing power and could intelligently cooperate with neighboring moballs by distributing tasks, sharing data, and fusing information. The major advantages of using the wind-driven and spherical moball network over rovers or other fixed sensor webs to explore Mars would be: (1) moballs could explore a much larger expanse of Mars in a much faster fashion, (2) they could explore the difficult terrains such as steep slopes and sand dunes, and (3) they would be self-energy- generating and could work together and move around autonomously. The challenge in designing the structure and the mechanics of the moball would be that it should be sturdy enough to withstand the impact of its initial fall, as well as other impacts from obstacles in its way. A mechanism would be needed that could enable hundreds of moballs to be carried while they would be deflated and compact, then would inflate them just after deploying them to their drop site. Furthermore, the moballs should also be light enough to allow them to move easily over obstacles by force of the wind. They also should have some kind of maneuvering mechanism in place to help them avoid very hazardous sharp objects or events, and to enable them to get closer to the objects of interest. The structure of the moballs was designed so that they would have different layers. The outer layer should comprise a sturdy, yet light, polymer that could withstand both the impact of the initial drop, as well as the impact of the different obstacles it would encounter while traversing the surface of Mars. This polymer should not deteriorate with the 100 K daily temperature swings on Mars. The inner layer should consist of a very light gas such as nitrogen or helium. In terms of maneuvering, six very light weights placed at strategic locations would give moballs the ability to turn, or even hop, over hazardous (e.g., sharp) obstacles, or even initiate a movement (before getting more help from the wind to be carried around) when stuck. Maneuvering would be necessary in order to get closer to objects of interest. If the weights would be allowed to move freely, they could also be used to generate energy.

Davoodi, Faranak↗

JPSS Science Data Services for the Direct Readout Community

The Suomi National Polar-orbiting Partnership (S-NPP) and Joint Polar Satellite System (JPSS) High Rate Data (HRD) link provides Direct Broadcast data to users in real-time, utilizing their own remote field terminals. The Field Terminal Support (FTS) provides the resources needed to support the Direct Readout communities by providing software, documentation, and periodic updates to enable them to produce data products from SNPP and JPSS. The FTS distribution server will also provide the necessary ancillary and auxiliary data needed for processing the broadcasts, as well as making orbital data available to assist in locating the satellites of interest. In addition, the FTS provides development support for the algorithm and software through GSFC Direct Readout Laboratory (DRL) International Polar Orbiter Processing Package (IPOPP) and University of Wisconsin (UWISC) Community Satellite Processing Package (CSPP), to enable users to integrate the algorithms into their remote terminals. The support the JPSS Program provides to the institutions developing and maintaining these two software packages, will demonstrate the ability to produce ready-to-use products from the HRD link and provide risk reduction effort at a minimal cost. This paper discusses the key functions and system architecture of FTS.

Data Processing↗

The Interaction Between Boundary Layer and Convection Schemes in a WRF Simulation of Post‐Cold‐Frontal Clouds over the ARM East North Atlantic Site

The correct representation of lowlevel midlatitude clouds found in the wake of cold fronts strongly relies on the representation of planetary boundary layer (PBL) and convection processes, which are typically parameterized separately in numerical models. Using the Weather Research and Forecasting Model (WRF), this study investigates how distinct pairs of PBL and convection parameterization schemes represent cloud fraction in the postcoldfrontal region. The simulations focus on the region of the DOEARM Eastern North Atlantic observation site in the Azores Islands in the wake of a cold front that passed on December 25, 2015. Different PBL and convection schemes are combined to create 12 distinct configurations. The main differences between the selected physical parameterizations are the strength of vertical mixing and the entrainment. The simulations produce a wide range of cloud fractions, where some configurations significantly underestimate while others clearly overestimate satellite and surfacebased estimates of cloud fraction. A skill score is used to quantitatively assess the performance of each configuration with respect to groundbased radar data. The key processes that are found to significantly impact the cloud fraction distribution are the strength of the PBL decoupling, the vertical wind shear, entrainment and detrainment rates in shallow convection and the occurrence of drizzle. This indicates that to successfully simulate postcoldfrontal clouds, modeled physics must balance strong internal vertical mixing and weak exchange with the free troposphere. For this case study, cloud fraction was more sensitive to the choice of convection scheme than PBL scheme.

moist convection interaction between parameterizat↗

Locating underground features with seismic data processing

Methods are presented for determining the location of underground features (e.g., CO 2 ). One method includes capturing, by sensors distributed throughout a region, seismic traces associated with seismic signals generated by a seismic source. For multiple sensors, active noise is identified or passive noise is measured within each seismic trace and values for attributes associated with the active or passive noise are determined. Further, an unsupervised machine-learning model, based on the values of the attributes, is utilized to determine noise characteristics for multiple sensors. The sensors are grouped in clusters based on the noise characteristics for each sensor. For multiple clusters, a noise filter is created based on the noise characteristics of the sensors in the cluster, and the noise filter of the cluster is applied, for multiple sensors, to the seismic traces of the sensor. Additionally, the filtered seismic traces are analyzed to determine a location of CO 2 underground.

47 OTHER INSTRUMENTATION↗

Finding wombling boundaries in LHC data with Voronoi and Delaunay tessellations

We address the problem of finding a wombling boundary in point data generated by a general Poisson point process, a specific example of which is an LHC event sample distributed in the phase space of a final state signature, with the wombling boundary created by some new physics. We discuss the use of Voronoi and Delaunay tessellations of the point data for estimating the local gradients and investigate methods for sharpening the boundaries by reducing the statistical noise. The outcome from traditional wombling algorithms is a set of boundary cell candidates with relatively large gradients, whose spatial properties must then be scrutinized in order to construct the boundary and evaluate its significance. Here we propose an alternative approach where we simultaneously form and evaluate the significance of all possible boundaries in terms of the total gradient flux. We illustrate our method with several toy examples of both straight and curved boundaries with varying amounts of signal present in the data.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Privacy by Design in Distributed Edge Systems: Innovating Secure Workflows for Smart Cities

The proliferation of distributed edge systems, such as those in smart cities, healthcare, and industrial IoT, offers unprecedented opportunities for data processing closer to its source, thereby reducing latency and enhancing efficiency. However, these systems also present significant privacy challenges due to the handling of sensitive data from multiple sources. This article explores the critical need for designing privacy-preserving workflows in distributed edge systems to ensure data security while maximizing the potential of edge computing. By examining the challenges, technological advancements, and potential of privacy-by-design approaches, we highlight the importance of integrating advanced privacy-preserving techniques like federated learning, differential privacy, homomorphic encryption, secure multi-party computation, and zero-knowledge proofs. These innovations are crucial for enhancing data security, regulatory compliance, and public trust in smart city applications, ultimately leading to safer and more efficient urban environments.

Kotevska, Olivera↗

Web Monitoring of EOS Front-End Ground Operations, Science Downlinks and Level 0 Processing

This paper addresses the efforts undertaken and the technology deployed to aggregate and distribute the metadata characterizing the real-time operations associated with NASA Earth Observing Systems (EOS) high-rate front-end systems and the science data collected at multiple ground stations and forwarded to the Goddard Space Flight Center for level 0 processing. Station operators, mission project management personnel, spacecraft flight operations personnel and data end-users for various EOS missions can retrieve the information at any time from any location having access to the internet. The users are distributed and the EOS systems are distributed but the centralized metadata accessed via an external web server provide an effective global and detailed view of the enterprise-wide events as they are happening. The data-driven architecture and the implementation of applied middleware technology, open source database, open source monitoring tools, and external web server converge nicely to fulfill the various needs of the enterprise. The timeliness and content of the information provided are key to making timely and correct decisions which reduce project risk and enhance overall customer satisfaction. The authors discuss security measures employed to limit access of data to authorized users only.

Cordier, Guy R.↗

O(+) and He(+) restricted and extended (bi-modal) ion conic distributions

An automated procedure using standard image processing techniques has been developed that finds and characterizes energetic ion conic events in the data acquired by the Energetic Ion Composition Spectrometer on DE-1 in the altitude range 8000 to 24000 km. The algorithm discriminates between the two types of ion conic distribution, those restricted to a narrow angular range and those extended in angle. Extended (bimodal) ion conic distributions also have a significant flux of field-aligned energetic ions. Extended ion conics constitute more than one third of the ion conics found. The two types of ion conic distribution have different altitude dependences. The average properties of energetic conic distributions suggest that conic formation by localized, explosive, transverse energization is not the dominant mechanism responsible for producing energetic conic distributions above 8000 km.

Peterson, W. K.↗

Verification of an Algorithm for Processing Data from Multifrequency Lidar Sensing of Aerosols

We consider an algorithm for processing lidar signals, which for a lidar path with constant qualitative aerosol characteristics (particle size distribution in each aerosol mode, complex refractive index of the particles) lets us obtain a concentration profile for the fine aerosol component without using additional a priori information. The algorithm was verified based on lidar data from the Institute of Physics (National Academy of Sciences of Belarus). The vertical volume concentration profile for fine particles obtained by our algorithm is quite consistent with the results of its independent retrieval, based on integrated processing of lidar and sun photometer data.

42 ENGINEERING↗

Consolidating WLCG topology and configuration in the Computing Resource Information Catalogue

Here, the Worldwide LHC Computing Grid infrastructure links about 200 participating computing centres affiliated with several partner projects. It is built by integrating heterogeneous computer and storage resources in diverse data centres all over the world and provides CPU and storage capacity to the LHC experiments to perform data processing and physics analysis. In order to be used by the experiments, these distributed resources should be well described, which implies easy service discovery and detailed description of service configuration. Currently this information is scattered over multiple generic information sources like GOCDB, OIM, BDII and experiment-specific information systems. Such a model does not allow to validate topology and configuration information easily. Moreover, information in various sources is not always consistent. Finally, the evolution of computing technologies introduces new challenges. Experiments are more and more relying on opportunistic resources, which by their nature are more dynamic and should also be well described in the WLCG information system. This contribution describes the new WLCG configuration service CRIC (Computing Resource Information Catalogue) which collects information from various information providers, performs validation and provides a consistent set of UIs and APIs to the LHC VOs for service discovery and usage configuration. The main requirements for CRIC are simplicity, agility and robustness. CRIC should be able to be quickly adapted to new types of computing resources, new information sources, and allow for new data structures to be implemented easily following the evolution of the computing models and operations of the experiments.

97 MATHEMATICS AND COMPUTING↗

Reconstruction of a Bacterial Genome from DNA Cassettes

This basic research program comprised two major areas: (1) acquisition and analysis of marine microbial metagenomic data and development of genomic analysis tools for broad, external community use; (2) development of a minimal bacterial genome. Our Marine Metagenomic Diversity effort generated and analyzed shotgun sequencing data from microbial communities sampled from over 250 sites around the world. About 40% of the 26 Gbp of sequence data has been made publicly available to date with a complete release anticipated in six months. Our results and those mining the deposited data have revealed a vast diversity of genes coding for critical metabolic processes whose phylogenetic and geographic distributions will enable a deeper understanding of carbon and nutrient cycling, microbial ecology, and rapid rate evolutionary processes such as horizontal gene transfer by viruses and plasmids. A global assembly of the generated dataset resulted in a massive set (5Gbp) of genome fragments that provide context to the majority of the generated data that originated from uncultivated organisms. Our Synthetic Biology team has made significant progress towards the goal of synthesizing a minimal mycoplasma genome that will have all of the machinery for independent life. This project, once completed, will provide fundamentally new knowledge about requirements for microbial life and help to lay a basic research foundation for developing microbiological approaches to bioenergy.

59 BASIC BIOLOGICAL SCIENCES↗

Studies of Antarctic Sea Ice Concentrations from Satellite Data and Their Applications

Large changes in the sea ice cover have been observed recently. Because of the relevance of such changes to climate change studies it is important that key ice concentration data sets used for evaluating such changes are interpreted properly. High and medium resolution visible and infrared satellite data are used in conjunction with passive microwave data to study the true characteristics of the Antarctic sea ice cover, assess errors in currently available ice concentration products, and evaluate the applications and limitations of the latter in polar process studies. Cloud-free high resolution data provide valuable information about the natural distribution, stage of formation, and composition of the ice cover that enables interpretation of the large spatial and temporal variability of the microwave emissivity of Antarctic sea ice. Comparative analyses of co-registered visible, infrared and microwave data were used to evaluate ice concentrations derived from standard ice algorithms (i.e., Bootstrap and Team) and investigate the 10 to 35% difference in derived values from large areas within the ice pack, especially in the Weddell Sea, Amundsen Sea, and Ross Sea regions. Landsat and OLS data show a predominance of thick consolidated ice in these areas and show good agreement with the Bootstrap Algorithm. While direct measurements were not possible, the lower values from the Team Algorithm results are likely due to layering within the ice and snow and/or surface flooding, which are known to affect the polarization ratio. In predominantly new ice regions, the derived ice concentration from passive microwave data is usually lower than the true percentage because the emissivity of new ice changes with age and thickness and is lower than that of thick ice. However, the product provides a more realistic characterization of the sea ice cover, and are more useful in polar process studies since it allows for the identification of areas of significant divergence and polynya activities. Also, heat and salinity fluxes are proportionately increased in these areas compared to those from the thicker ice areas. A slight positive trend in ice extent and area from 1978 through 2000 is observed consistent with slight continental cooling during the period. However, the confidence in this result is only moderate because the overlap period for key instruments is just one month and the sensitivity to changes in sensor characteristics, calibration and threshold for the ice edge is quite high.

Comiso, Josefino C.↗

The fusion-fission process in the reaction {sup 34}S+{sup 186}W near the interaction barrier

The reaction {sup 34}S+{sup 186}W at E{sub lab}=160 MeV was investigated with the aim of diving into the features of the fusion-fission process. Gamma rays in coincidence with binary reaction fragments were measured using the high efficiency gamma-ray spectrometer ORGAM at the TANDEM Accelerator facility of I.P.N., Orsay, and the time-of-flight spectrometer for fission fragments (FF) registration CORSET of the Flerov Laboratory of Nuclear Reactions (FLNR), Dubna. The coupling of the ORGAM and CORSET setups offers the unique opportunity of extracting details for characterizing the fusion-fission process and gives information regarding production of neutron-rich heavy nuclei. The FF–γ coincidence method is of better use then the γ – γ coincidence method when dealing with low statistic measurements and also offers the opportunity to precisely correct the Dopler shift for in-flight emitted gamma rays. Evidence of symmetric and asymmetric fission modes were observed in the mass and TKE distributions, occurring due to shell effects in the fragments. Coincident measurements allow for discrimination between the gamma rays by accepting a specific range within the mass distribution of the reaction products. Details regarding the experimental setup, methods of processing the acquisitioned data and preliminary results are presented.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Using Micro-Synchrophasor Data for Advanced Distribution Grid Planning and Operations Analysis

This report reviews the potential for distribution-grid phase-angle data that will be available from new micro-synchrophasors (µPMUs) to be utilized in existing distribution-grid planning and operations analysis. This data could augment the current diagnostic capabilities of grid analysis software, used in both planning and operations for applications such as fault location, and provide data for more accurate modeling of the distribution system. µPMUs are new distribution-grid sensors that will advance measurement and diagnostic capabilities and provide improved visibility of the distribution grid, enabling analysis of the grid’s increasingly complex loads that include features such as large volumes of distributed generation. Large volumes of DG leads to concerns on continued reliable operation of the grid, due to changing power flow characteristics and active generation, with its own protection and control capabilities. Using µPMU data on change in voltage phase angle between two points in conjunction with new and existing distribution-grid planning and operational tools is expected to enable model validation, state estimation, fault location, and renewable resource/load characterization. Our findings include: data measurement is outstripping the processing capabilities of planning and operational tools; not every tool can visualize a voltage phase-angle measurement to the degree of accuracy measured by advanced sensors, and the degree of accuracy in measurement required for the distribution grid is not defined; solving methods cannot handle the high volumes of data generated by modern sensors, so new models and solving methods (such as graph trace analysis) are needed; standardization of sensor-data communications platforms in planning and applications tools would allow integration of different vendors’ sensors and advanced measurement devices. In addition, data from advanced sources such as µPMUs could be used to validate models to improve/ensure accuracy, providing information on normally estimated values such as underground conductor impedance, and characterization of complex loads. Although the input of high-fidelity data to existing tools will be challenging, µPMU data on phase angle (as well as other data from advanced sensors) will be useful for basic operational decisions that are based on a trend of changing data.

25 ENERGY STORAGE↗

Large Data Visualization on Distributed Memory Mulit-GPU Clusters

Data sets of immense size are regularly generated on large scale computing resources. Even among more traditional methods for acquisition of volume data, such as MRI and CT scanners, data which is too large to be effectively visualization on standard workstations is now commonplace. One solution to this problem is to employ a 'visualization cluster,' a small to medium scale cluster dedicated to performing visualization and analysis of massive data sets generated on larger scale supercomputers. These clusters are designed to fit a different need than traditional supercomputers, and therefore their design mandates different hardware choices, such as increased memory, and more recently, graphics processing units (GPUs). While there has been much previous work on distributed memory visualization as well as GPU visualization, there is a relative dearth of algorithms which effectively use GPUs at a large scale in a distributed memory environment. In this work, we study a common visualization technique in a GPU-accelerated, distributed memory setting, and present performance characteristics when scaling to extremely large data sets.

97 MATHEMATICS AND COMPUTING↗

Λ Baryon Production in ν¯µ Interactions in the MicroBooNE Detector

The Cabibbo suppressed production of $\Lambda$ baryons in anti-neutrino interactions with nuclei is a rare process that is yet to be measured with a modern neutrino detector with automated reconstruction. The cross section for this process is sensitive to a number of unique nuclear effects, most notably the secondary interactions of the produced hyperon while attempting to escape from the nucleus. Other interactions within the nuclear remnant can impact the estimation of neutrino energy in oscillation measurements, and thus an accurate description of the nuclear environment is required. The strangeness violating hyperon production process is only available to anti-neutrinos. The model of this interaction is implemented into the NuWro neutrino interaction Monte Carlo simulation, and some predictions are presented, focusing on the role of nuclear effects. This model introduces a hyperon-nucleus potential, which calculations from hypernuclear theory permit to be strongly repulsive in th e case of $\Sigma$ baryons. The presence of this potential is found to sculpt the shape of the differential cross section in some variables. The MicroBooNE detector will be described, followed by a description of a measurement of the flux averaged, restricted phase space cross section of Cabibbo suppressed $\Lambda$ baryon production. A sophisticated event selection is employed, as a very large quantity of background neutrino interactions must be removed to perform the measurement with any sensitivity. This selection introduces some novel techniques such as the island finding method, and achieves a background reduction of $\sim 10^6$, with an efficiency of around 7\%. The calculation of the systematic uncertainties will be explained, including two procedures explored to handle sources of background with extremely poor simulation statistics: an in-situ constraint using data from sidebands, and a visual inspection of the data and simulation to remove the troublesome background events. The sensitivity to the $\Lambda$ baryon production cross section is calculated in the form of Bayesian posterior probability distributions, combining the systematic uncertainties with data and simulation statistical uncertainties. As a rare process, the statistical uncertainties are highly non-Gaussian, and the Bayesian approach is applied to include the full shapes of these uncertainties. Data corresponding to $2.2 \times 10^{20}$ protons on target of neutrino mode running and $4.9 \times 10^{20}$ protons on target of anti-neutrino running is analysed. When the data was unblinded, five $\Lambda$ production candidates were selected from the data, consistent with the MC simulation prediction of $5.3 \pm 1.1$ events. The final estimated cross section is $1.8^{+2.0}_{-1.6} \times 10^{-40}$cm$^2/$Ar when employing the sideband constraint procedure. A similar result of $2.0^{+2.2}_{-1.8} \times 10^{-40}$cm$^2/$Ar is obtained when performing the visual scan instead. The methods used in t his analysis are intended to be easily exported to other LArTPC detectors such as the Short Baseline Near Detector.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Diffusion of Siderophile Elements in Fe Metal: Application to Zoned Metal Grains in Chondrites

The distribution of highly siderophile elements (HSE) in planetary materials is controlled mainly by metal. Diffusion processes can control the distribution or re-distribution of these elements within metals, yet there is little systematic or appropriate diffusion data that can be used to interpret HSE concentrations in such metals. Because our understanding of isotope chronometry, redox processes, kamacite/taenite-based cooling rates, and metal grain zoning would be enhanced with diffusion data, we have measured diffusion coefficients for Ni, Co, Ga, Ge, Ru, Pd, Ir and Au in Fe metal from 1200 to 1400 C and 1 bar and 10 kbar. These new data on refractory and volatile siderophile elements are used to evaluate the role of diffusional processes in controlling zoning patterns in metal-rich chondrites.

Righter, K.↗