Search NASA⌕ Search

SEARCH · Search NASA

Results for “DISTRIBUTED DATA PROCESSING”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5
All sourcesNASA NTRSDOE OSTI
NASA NTRS1985

Remote sensing and disaster monitoring - A review of applications in Indonesia

The role played by remote sensors on-board the Landsat and NOAA-7 satellites in monitoring and management of three catastrophic events that took place in 1982 and 1983 in Indonesia (two major volcanic eruptions and a large-scale forest fire) is assessed. The modes of operation of the satellite platforms, the types of data derived, and data availability to the users are described, and the sources of failures and delays (such as the presence of clouds, technical and computer errors, red-tape, etc.) are examined. The major drawbacks of the Landsat-supplied information for monitoring short-lived and fast-changing events were the insufficient frequency of data acquisition, delayed delivery of data, and extended times needed for data distribution and processing. Indonesia's NOAA-7 and GMS sensors, although of low spatial resolution, offered higher frequency of data collection, and profited from the existence of a local receiving station. The present value of the space-based imagery is seen mainly in the baseline assessment of the disaster-prone areas, which can assist in preparing these areas for the impending catastrophic events.

Malingreau, J. P.↗
NASA NTRS2003

TRMM Data from the Goddard Earth Sciences (GES) DISC DAAC: Tropical Rainfall Measuring Mission (TRMM)

Tropical rainfall affects the lives and economies of a majority of the Earth's population. Tropical rain systems, such as hurricanes, typhoons, and monsoons, are crucial to sustaining the livelihoods of those living in the tropics. Excess rainfall can cause floods and great property and crop damage, whereas too little rainfall can cause drought and crop failure. The latent heat release during the process of precipitation is a major source of energy that drives the atmospheric circulation. This latent heat can intensify weather systems, affecting weather thousands of kilometers away, thus making tropical rainfall an important indicator of atmospheric circulation and short-term climate change. The Tropical Rainfall Measuring Mission (TRMM), jointly sponsored by the National Aeronautics and Space Administration (NASA) of the United States and the National Space Development Agency (NASDA) of Japan, provides visible, infrared, and microwave observations of tropical and subtropical rain systems. The satellite observations are complemented by ground radar and rain gauge measurements to validate satellite rain estimation techniques. Goddard Space Flight Center's involvement includes the observatory, four instruments, integration and testing of the observatory, data processing and distribution, and satellite operations. TRMM has a design lifetime of three years. It is currently in its fifth year of operation. Data generated from TRMM and archived at the GES DAAC are useful not only for hydrologists, atmospheric scientists, and climatologists, but also for the health community studying infectious diseases, the ocean research community, and the agricultural community.

Source record↗
NASA NTRSDate not supplied

Atmospheric Infrared Sounder Version 7 Near-Real-Time Product and Imagery Released by NASA GES DISC

The NASA Goddard Earth Sciences Data and Information Services Center (GES DISC) has been the home of data processing, archive, and distribution services for data from the Atmospheric Infrared Sounder (AIRS) mission since its launch in 2002. The GES DISC provides service to both AIRS routine and Near Real-Time (NRT) products. The AIRS NRT products are an important element in the Land, Atmosphere Near real-time Capability for EOS (LANCE). In collaboration with AIRS Project, the GES DISC has just released products from the Version 7 algorithm. The new version algorithm provides significant improvements over the previous version. The most substantial advances are: improved consistency between day and night water vapor; improved total column ozone and temperature; improved infrared-only (IR-only) retrievals, especially in high latitude regions; an improved Stochastic Cloud Clearing Neural Network used as a first guess at the initial value in the iterative retrieval process; and removal of ambiguity in surface classification in the IR-only retrieval algorithm. In addition, the GES DISC produces AIRS NRT imagery. The AIRS NRT imagery are generated by mosaicking and mapping the available AIRS 6-minute retrieval granules to a global projection. The images are constantly refreshed when new granules are produced. The AIRS NRT Viewer and LANCE Worldview provide visualization services to online users for AIRS NRT imagery. The data products used to generate this imagery include atmospheric temperature, humidity, precipitation, cloud, Dust Score, CO, and SO2. In this presentation, we will demonstrate visualization of the AIRS NRT imagery from the new Version 7, and demonstrate some improvements over the previous version. Progress on improving the AIRS NRT imagery, a collaboration project with the AIRS Applications Development Team at NASA Jet Propulsion Laboratory (JPL), will also be presented.

Feng Ding↗
NASA NTRS1991

Version 0 EOSDIS - An overview

Attention is given to NASA's Earth Observing System Data and Information System (EOSDIS), which is to be a single, distributed but internally consistent evolutionary system to support the planning and execution of EOS data acquisitions and to process, archive, and distribute EOS data products and selected non-EOS data to enable interdisciplinary studies of the earth. V0 EOSDIS, a logical step in this evolutionary process, is to address both technical and managerial challenges. Technical challenges include developing a multidiscipline, distributed system for searching and ordering data in a heterogeneous environment, and standardizing data formats and distribution techniques among differing communities and organizations. Managerial challenges include establishing and maintaining a structure consisting of geographically distributed entities such that cooperative development is carried out effectively despite organizational differences, maintaining interactions with the scientific community to ensure its close involvement despite its size and diversity, and keeping the expectations for V0 consistent with its schedules and resources.

Ramapriyan, H. K.↗
NASA NTRS2007

Understanding Local Structure Globally in Earth Science Remote Sensing Data Sets

Empirical probability distributions derived from the data are the signatures of physical processes generating the data. Distributions defined on different space-time windows can be compared and differences or changes can be attributed to physical processes. This presentation discusses on ways to reduce remote sensing data in a way that preserves information, focusing on the rate-distortion theory and using the entropy-constrained vector quantization algorithm.

massive data sets↗
NASA NTRS1979

ALSEP termination report

The Apollo Lunar Surface Experiments Package (ALSEP) final report was prepared when support operations were terminated September 30, 1977, and NASA discontinued the receiving and processing of scientific data transmitted from equipment deployed on the lunar surface. The ALSEP experiments (Apollo 11 to Apollo 17) are described and pertinent operational history is given for each experiment. The ALSEP data processing and distribution are described together with an extensive discussion on archiving. Engineering closeout tests and results are given, and the status and configuration of the experiments at termination are documented. Significant science findings are summarized by selected investigators. Significant operational data and recommendations are also included.

Bates, J. R.↗
DOE OSTI2021

Dynamic Distribution of High-Rate Data Processing from CERN to Remote HPC Data Centers

The prompt reconstruction of the data recorded from the Large Hadron Collider (LHC) detectors has always been addressed by dedicated resources at the CERN Tier-0. Such workloads come in spikes due to the nature of the operation of the accelerator and in special high load occasions experiments have commissioned methods to distribute (spill-over) a fraction of the load to sites outside CERN. The present work demonstrates a new way of supporting the Tier-0 environment by provisioning resources elastically for such spilled-over workflows onto the Piz Daint Supercomputer at CSCS. Furthermore, this is implemented using containers, tuning the existing batch scheduler and reinforcing the scratch file system, while still using standard Grid middleware. ATLAS, CMS and CSCS have jointly run selected prompt data reconstruction on up to several thousand cores on Piz Daint into a shared environment, thereby probing the viability of the CSCS high performance computer site as on demand extension of the CERN Tier-0, which could play a role in addressing the future LHC computing challenges for the high luminosity LHC.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2015

Using spatial statistical methods to determine an effective minimum detectable activity - 15681

Instrument minimum detectable activity (MDA) is generally established by collecting multiple measurements over time of a single representative background location to estimate a probability distribution of instrument readings. A reading that is considered to be greater than would be expected from the background probability distribution (i.e., a low-probability event) is deemed to be sufficiently unlikely that it must be attributable to added radioactivity and is therefore used as the instrument MDA. An effective MDA can be determined from spatially distributed data that are much lower than the instrument MDA. This has been accomplished using a large number of spatially distributed data points (from a radiation survey) where patterns of elevated survey readings can be distinguished from background at levels. Given the variation of the instrument response and the relatively low regulatory action levels, it is vital to establish MDA thresholds that are well below corrective action levels. Processing of radiological survey data with the use of histogram binning and geo-statistics in enabling pattern recognition can be used to establish effective field MDAs that are much lower than instrument MDAs. (authors)

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
NASA NTRS2001

NASA IVHM Technology Experiment for X-vehicles (NITEX)

The purpose of the NASA IVHM Technology Experiment for X-vehicles (NITEX) is to advance the development of selected IVHM technologies in a flight environment and to demonstrate the potential for reusable launch vehicle ground processing savings. The technologies to be developed and demonstrated include system-level and detailed diagnostics for real-time fault detection and isolation, prognostics for fault prediction, automated maintenance planning based on diagnostic and prognostic results, and a microelectronics hardware platform. Complete flight The Evolution of Flexible Insulation as IVHM consists of advanced sensors, distributed data acquisition, data processing that includes model-based diagnostics, prognostics and vehicle autonomy for control or suggested action, and advanced data storage. Complete ground IVHM consists of evolved control room architectures, advanced applications including automated maintenance planning and automated ground support equipment. This experiment will advance the development of a subset of complete IVHM.

Sandra, Hayden↗
NASA NTRS2011

Experiment in Onboard Synthetic Aperture Radar Data Processing

Single event upsets (SEUs) are a threat to any computing system running on hardware that has not been physically radiation hardened. In addition to mandating the use of performance-limited, hardened heritage equipment, prior techniques for dealing with the SEU problem often involved hardware-based error detection and correction (EDAC). With limited computing resources, software- based EDAC, or any more elaborate recovery methods, were often not feasible. Synthetic aperture radars (SARs), when operated in the space environment, are interesting due to their relevance to NASAs objectives, but problematic in the sense of producing prodigious amounts of raw data. Prior implementations of the SAR data processing algorithm have been too slow, too computationally intensive, and require too much application memory for onboard execution to be a realistic option when using the type of heritage processing technology described above. This standard C-language implementation of SAR data processing is distributed over many cores of a Tilera Multicore Processor, and employs novel Radiation Hardening by Software (RHBS) techniques designed to protect the component processes (one per core) and their shared application memory from the sort of SEUs expected in the space environment. The source code includes calls to Tilera APIs, and a specialized Tilera compiler is required to produce a Tilera executable. The compiled application reads input data describing the position and orientation of a radar platform, as well as its radar-burst data, over time and writes out processed data in a form that is useful for analysis of the radar observations.

Holland, Matthew↗
NASA NTRS2015

The NASA Earth Science Program and Small Satellites

Earth's changing environment impacts every aspect of life on our planet and climate change has profound implications on society. Studying Earth as a single complex system is essential to understanding the causes and consequences of climate change and other global environmental concerns. NASA's Earth Science Division (ESD) shapes an interdisciplinary view of Earth, exploring interactions among the atmosphere, oceans, ice sheets, land surface interior, and life itself. This enables scientists to measure global and climate changes and to inform decisions by Government, other organizations, and people in the United States and around the world. The data collected and results generated are accessible to other agencies and organizations to improve the products and services they provide, including air quality indices, disaster prediction and response, agricultural yield projections, and aviation safety. ESD's Flight Program provides the spacebased observing systems and supporting infrastructure for mission operations and scientific data processing and distribution that support NASA's Earth science research and modeling activities. The Flight Program currently has 21 operating Earth observing space missions, including the recently launched Global Precipitation Measurement (GPM) mission, the Orbiting Carbon Observatory-2 (OCO-2), the Soil Moisture Active Passive (SMAP) mission, and the International Space Station (ISS) RapidSCAT and Cloud-Aerosol Transport System (CATS) instruments. The ESD has 22 more missions and instruments planned for launch over the next decade. These include first and second tier missions from the 2007 Earth Science Decadal Survey, Climate Continuity missions to assure availability of key climate data sets, and small-sized competitively selected orbital missions and instrument missions of opportunity belonging to the Earth Venture (EV) Program. Small satellites (~500 kg or less) are critical contributors to these current and future satellite missions. Some examples are the aforementioned Orbiting Carbon Observatory-2 (OCO-2), the Gravity Recovery and Climate Experiment Follow On (GRACE FO), and the Cyclone Global Navigation Satellite System (CYGNSS) microsatellite constellation. Small satellites also support ESD in space validation and risk reduction of enabling technologies (components and systems). The status of the ESD Flight Program and the role of small satellites will be discussed.

Earth Science Prog & Small Sat↗
NASA NTRS1974

Earth Observatory Satellite system definition study. Report no. 3: Design/cost tradeoff studies. Appendix E: EOS program supporting system trade data. Part 2: System trade studies no. 9 - 19

The relative merits of several international data acquisition (IDA) alternatives for the Earth Observatory Satellite (EOS) are established and rated on a cost effectiveness basis. The primary alternatives under consideration are: (1) direct transmission to foreign ground stations, (2) a wideband video tape recorder system for collection of foreign data and processing and distribution from the United States, and (3) a tracking and data relay satellite (TDRS) system for the relay of foreign data to the United States for processing and distribution. A requirements model is established for the analysis on the basis of the heaviest concentration of agricultural areas around the world. The model, the orbit path and the constraints of EOS and data volume summaries are presented. Alternative system descriptions and costs are given in addition to cost-performance summaries.

Source record↗
NASA NTRSDate not supplied

Hydrological Data at the NASA GES DISC: Current Capabilities and New Opportunities

The NASA Goddard Earth Sciences Data and Information Services Center (GES DISC) is one of twelve NASA Earth science data centers that document, process, archive and distribute data from Earth observation missions and projects. GES DISC maintains an archive of several hydrology datasets, including the Land Data Assimilation Systems (LDAS) and the Gravity Recovery and Climate Experiment (GRACE) Data Assimilation for Drought Monitoring (GRACE-DA-DM) data products. These datasets include model output of heat fluxes, rain, snow, soil temperature, soil moisture, and runoff; and observational forcing data, including surface pressure, temperature, precipitation, downward shortwave and longwave radiation, humidity, and wind. The temporal resolution of the hydrology data at GES DISC ranges from hourly to monthly, and spatial resolutions range from 0.1° to 1.0°. The GES DISC provides services which enable users to aggregate, temporally and spatially subset, regrid, and visualize archived data including the GES DISC Subsetter, Hydrology Data Rods, and the Geospatial Interactive Online Visualization and Analysis Infrastructure (GIOVANNI). The Hydrology Data Rods service optimally reorganizes large hydrological data sets as extended time series, providing more efficient access for the hydrological community. The time series data (aka “data rods”) were integrated into hydrology community tools, such as the Data Rods Explorer on HydroShare. Furthermore, the GES DISC is in the process of migrating its data and services to the cloud. Hydrological data available at the GES DISC are now available in the Amazon Web Services (AWS) cloud (us-west-2 region) providing users Direct S3 data access and the capability for cloud computing operations. In this presentation, the hydrology data products and services currently available at the GES DISC will be summarized. Also discussed are the migration to the cloud, user support through this transition, and the status of migrating the data rods service to the cloud.

Ashley Heath↗
DOE OSTI2015

Optimization of X-ray tomography through a cooperative computing system in grid

Cooperative Computing implemented as Cooperative Computing System (CCS) in grid has been proved a considerably reliable technique to execute the tasks with real time constraints in a grid environment. This technique can be applied in many high performance distributed computing applications. HPC has a large number of applications in various fields of physics. One such application in radiation physics is X-ray tomography. X-Ray tomography contains numerous applications in various fields of science, technology and research. As the technology is changing from analog to digital in almost all the scenarios, this paper presents an idea towards the attachment of X-ray tomography assembly to HPC environment so as to obtain the highly reliable optimization.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2012

WAVEMOTH-FAST SPHERICAL HARMONIC TRANSFORMS BY BUTTERFLY MATRIX COMPRESSION

We present Wavemoth, an experimental open source code for computing scalar spherical harmonic transforms (SHTs). Such transforms are ubiquitous in astronomical data analysis. Our code performs substantially better than existing publicly available codes owing to improvements on two fronts. First, the computational core is made more efficient by using small amounts of pre-computed data, as well as paying attention to CPU instruction pipelining and cache usage. Second, Wavemoth makes use of a fast and numerically stable algorithm based on compressing a set of linear operators in a pre-computation step. The resulting SHT scales as O(L{sup 2}log{sup 2} L) for the resolution range of practical interest, where L denotes the spherical harmonic truncation degree. For low- and medium-range resolutions, Wavemoth tends to be twice as fast as libpsht, which is the current state-of-the-art implementation for the HEALPix grid. At the resolution of the Planck experiment, L {approx} 4000, Wavemoth is between three and six times faster than libpsht, depending on the computer architecture and the required precision. Because of the experimental nature of the project, only spherical harmonic synthesis is currently supported, although adding support for spherical harmonic analysis should be trivial.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2015

Research in Elementary Particle Physics

This report details the accomplishments and research results for the High Energy Physics Group at the University of Texas at Arlington at the Energy and Intensity Frontiers. For the Energy Frontier we have made fundamental contributions in the search for supersymmetric particles, proposed to explain the stabilization of the mass of the Higgs Boson – the agent giving mass to all known particles. We have also made major contributions to the search for additional Higgs Bosons and to the planning for future searches. This work has been carried out in the context of the ATLAS Experiment at CERN (European Nuclear Research Laboratory) and for which we have made major contributions to computing and data distribution and processing, and have worked to calibrate the detector and prepare upgraded electronics for the future. Our other contribution to the Energy Frontier has been to the International Linear Collider (ILC) project, potentially hosted by Japan, and to the Silicon Detector Concept (SiD) in particular. We have lead the development of the SiD Concept and have worked on a new form of precise energy measurement for particles from the high energy collisions of electrons and positrons at the ILC. For the Intensity Frontier, we have worked to develop the concept of Long Baseline Neutrino Experiment(s) (LBNE) at the Fermi National Accelerator Laboratory. Our contributions to detector development, neutrino beam studies, particle identification, software development will facilitate future studies of the oscillation of one type of neutrino into other type(s), establish the order of the neutrino masses, and, through an innovative new idea, allow us to create a beam of dark matter particles.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗