Search NASA⌕ Search

SEARCH · Search NASA

Results for “DISTRIBUTED DATA PROCESSING”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 793 records · Page 44

NASA's Earth Observing Data and Information System

NASA's Earth Observing System Data and Information System (EOSDIS) has been a central component of NASA Earth observation program for over 10 years. It is one of the largest civilian science information system in the US, performing ingest, archive and distribution of over 3 terabytes of data per day much of which is from NASA s flagship missions Terra, Aqua and Aura. The system supports a variety of science disciplines including polar processes, land cover change, radiation budget, and most especially global climate change. The EOSDIS data centers, collocated with centers of science discipline expertise, archive and distribute standard data products produced by science investigator-led processing systems. Key to the success of EOSDIS is the concept of core versus community requirements. EOSDIS supports a core set of services to meet specific NASA needs and relies on community-developed services to meet specific user needs. EOSDIS offers a metadata registry, ECHO (Earth Observing System Clearinghouse), through which the scientific community can easily discover and exchange NASA s Earth science data and services. Users can search, manage, and access the contents of ECHO s registries (data and services) through user-developed and community-tailored interfaces or clients. The ECHO framework has become the primary access point for cross-Data Center search-and-order of EOSDIS and other Earth Science data holdings archived at the EOSDIS data centers. ECHO s Warehouse Inventory Search Tool (WIST) is the primary web-based client for discovering and ordering cross-discipline data from the EOSDIS data centers. The architecture of the EOSDIS provides a platform for the publication, discovery, understanding and access to NASA s Earth Observation resources and allows for easy integration of new datasets. The EOSDIS also has developed several methods for incorporating socioeconomic data into its data collection. Over the years, we have developed several methods for determining needs of the user community including use of the American Customer Satisfaction Index and a broad metrics program.

Mitchell, Andrew E.↗

Middle atmosphere processes revealed by satellite observations

The present paper deals with satellite measurements carried out over the past decade, which include radiance measurements (closely associated with temperatures in the lower stratosphere), temperature measurements in the mesopause, and ozone distributions. Some information obtained from satellite data on chemical, dynamical, energy-balance, and transport processes is reviewed, and data suitable for testing dynamical and photochemical theories are noted.

Gille, J. C.↗

Assurance Technology Challenges of Advanced Space Systems

The initiative to explore space and extend a human presence across our solar system to revisit the moon and Mars post enormous technological challenges to the nation's space agency and aerospace industry. Key areas of technology development needs to enable the endeavor include advanced materials, structures and mechanisms; micro/nano sensors and detectors; power generation, storage and management; advanced thermal and cryogenic control; guidance, navigation and control; command and data handling; advanced propulsion; advanced communication; on-board processing; advanced information technology systems; modular and reconfigurable systems; precision formation flying; solar sails; distributed observing systems; space robotics; and etc. Quality assurance concerns such as functional performance, structural integrity, radiation tolerance, health monitoring, diagnosis, maintenance, calibration, and initialization can affect the performance of systems and subsystems. It is thus imperative to employ innovative nondestructive evaluation methodologies to ensure quality and integrity of advanced space systems. Advancements in integrated multi-functional sensor systems, autonomous inspection approaches, distributed embedded sensors, roaming inspectors, and shape adaptive sensors are sought. Concepts in computational models for signal processing and data interpretation to establish quantitative characterization and event determination are also of interest. Prospective evaluation technologies include ultrasonics, laser ultrasonics, optics and fiber optics, shearography, video optics and metrology, thermography, electromagnetics, acoustic emission, x-ray, data management, biomimetics, and nano-scale sensing approaches for structural health monitoring.

Chern, E. James↗

State-Level Comparison of Processes and Timelines for Distributed Photovoltaic Interconnection in the United States

This report presents results from an analysis of distributed photovoltaic (PV) interconnection and deployment processes in the United States. Using data from more than 30,000 residential (up to 10 kilowatts) and small commercial (10-50 kilowatts) PV systems, installed from 2012 to 2014, we assess the range in project completion timelines nationally (across 87 utilities in 16 states) and in five states with active solar markets (Arizona, California, New Jersey, New York, and Colorado).

14 SOLAR ENERGY↗

Combined Data and Deep Learning Model Uncertainties: An Application to the Measurement of Solid Fuel Regression Rate

In complex physical process characterization, such as the measurement of the regression rate for solid hybrid rocket fuels, where both the observation data and the model used have uncertainties originating from multiple sources, combining these in a systematic way for quantities of interest (QoI) remains a challenge. In this paper, we present a forward propagation uncertainty quantification (UQ) process to produce a probabilistic distribution for the observed regression rate r. We characterized two input data uncertainty sources from the experiment (the distortion from the camera U c and the non-zero-angle fuel placement U Y ), the prediction and model form uncertainty from the deep neural network (U m ), as well as the variability from the manually segmented images used for training it (U s ). Here, we conducted seven case studies on combinations of these uncertainty sources with the model form uncertainty. The main contribution of this paper is the investigation and inclusion of the experimental image data uncertainties involved, and how to include them in a workflow when the QoI is the result of multiple sequential processes.

42 ENGINEERING↗

Reusing Information Management Services for Recommended Decadal Study Missions to Facilitate Aerosol and Cloud Studies

NASA Earth Sciences Division (ESD) has made great investments in the development and maintenance of data management systems and information technologies, to maximize the use of NASA generated Earth science data. With information management system infrastructure in place, mature and operational, very small delta costs are required to fully support data archival, processing, and data support services required by the recommended Decadal Study missions. This presentation describes the services and capabilities of the Goddard Space Flight Center (GSFC) Earth Sciences Data and Information Services Center (GES DISC) and the reusability for these future missions. The GES DISC has developed a series of modular, reusable data management components currently in use. They include data archive and distribution (Simple, Scalable, Script-based, Science [S4] Product Archive aka S4PA), data processing (S4 Processor for Measurements aka S4PM), data search (Mirador), data browse, visualization, and analysis (Giovanni), and data mining services. Information management system components are based on atmospheric scientist inputs. Large development and maintenance cost savings can be realized through their reuse in future missions.

Kempler, Steve↗

Density Functional Modeling of the Local Structure of Kaolinite Subjected to Thermal Dehydroxylation

Understanding the atomic-level changes that occur as kaolinite is converted (thermally dehydroxylated) to metakaolin is critical to the optimization of this large-scale industrial process. Metakaolin is X-ray amorphous; therefore, conventional crystallographic techniques do not reveal the changes in local structure during its formation. Local structure-based experimental techniques are useful in understanding the atomic structure but do not provide the thermodynamic information which is necessary to ensure plausibility of refined structures. Here, kaolinite dehydroxylation is modeled using density functional theory, and a stepwise methodology, where several water molecules are removed from the structure, geometry optimization is carried out, and then the process is repeated. Hence, the structure remains in an energetically and thermodynamically feasible state while transitioning from kaolinite to metakaolin. The structures generated during the dehydroxylation process are validated by comparison with X-ray and neutron pair distribution function data. Thus, this study illustrates one possible route by which dehydroxylation of kaolinite can take place, revealing a chemically, energetically, and experimentally plausible structure of metakaolin. This methodology of density functional modeling of the stepwise changes in a material is not limited in application to kaolinite or other aluminosilicates and provides an accurate representation of the local structural changes occurring in materials used in industrially important processes.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Investigating the influence of particle distribution on force and torque statistics using hierarchical machine learning

An accurate representation of hydrodynamic force and torque experienced by every particle in a distribution can be obtained from particle resolved (PR) simulations. These unique quantities are influenced by the deterministic position of surrounding particles. However, systems simulated with this methodology are typically limited to particles due to the involved computational cost. This resource requirement is a major bottleneck in analyzing the effect of variations in particle distribution. Here, this article attempts to address this bottleneck by availing relatively inexpensive deep learning models. The surrogate models that we employ in this article use a physics‐based hierarchical framework and symmetry‐preserving neural networks to achieve robustness with limited training data. This article first performs additional generalizability tests on PR data of distinct distributions that are not involved in the training process. The models are then deployed on several different particle distributions. Impact of clustering and structure on the observed statistics are investigated.

42 ENGINEERING↗

Coherent structure in solar wind C{sup 6+}/C{sup 4+} ionic composition data during the quiet-sun conditions of 2008

This analysis offers evidence of characteristic scale sizes in solar wind charge state data measured in situ for 13 quiet-Sun Carrington rotations in 2008. Using a previously established novel methodology, we analyze the wavelet power spectrum of the charge state ratio C{sup 6+}/C{sup 4+} measured in situ by ACE/SWICS for 2 hr and 12 minute cadence. We construct a statistical significance level in the wavelet power spectrum to quantify the interference effects arising from filling missing data in the time series, allowing extraction of significant power from the measured data to a resolution of 24 minutes. We analyze each wavelet power spectrum for transient coherency and global periodicities resulting from the superposition of repeating coherent structures. From the significant wavelet power spectra, we find evidence for a general upper limit on individual transient coherency of ∼10 days. We find evidence for a set of global periodicities between 4-5 hr and 35-45 days. We find evidence for the distribution of individual transient coherency scales consisting of two distinct populations. Below the ∼2 day timescale, the distribution is reasonably approximated by an inverse power law, whereas for scales ≳2 days, the distribution levels off, showing discrete peaks at common coherency scales. In addition, by organizing the transient coherency scale distributions by wind type, we find that these larger, common coherency scales are more prevalent and well defined in coronal hole wind. Finally, we discuss the implications of our results for current theories of solar wind generation and describe future work for determining the relationship between the coherent structures in our ionic composition data and the structure of the coronal magnetic field.

79 ASTRONOMY AND ASTROPHYSICS↗

Differential Power Processing for Ultra-Efficient Data Storage

Here this paper presents the hardware, software, and power codesign of an ultra-efficient data storage server with differential power processing (DPP). DPP can reduce the power conversion stress, improve the efficiency, and enhance the functionality of modular power electronics systems. The power inputs of a large number of hard disk drives (HDDs) were connected in series and supported by a multiport ac-coupled differential power processing (MAC-DPP) converter through a multiwinding transformer. Methods for controlling the multi-input multi-output power flow in the multiwinding transformer while avoiding core saturation were investigated. A ten-port MAC-DPP prototype with 700-W/in 3 power density was built to support a 450-W HDD storage system with ten series-stacked voltage domains. The prototype was tested on a 50-HDD server testbench, and the overall system loss is below 1 W (99.77% system efficiency). The server was able to maintain high-speed reading and writing operation of all 50 HDDs against the worst hot-swapping scenarios. A variety of hardware/software configurations and many cloud storage techniques were tested on the fully functioning server. Experimental results show that the energy efficiency of large-scale information systems (CPU/GPU clusters, memory banks, HDD arrays, etc.) can be greatly improved by software, hardware, and power codesign.

42 ENGINEERING↗

Computerized comprehensive data analysis of Lung Imaging Database Consortium (LIDC)

Purpose: Lung Image Database Consortium (LIDC) is the largest public CT image database of lung nodules. In this study, the authors present a comprehensive and the most updated analysis of this dynamically growing database under the help of a computerized tool, aiming to assist researchers to optimally use this database for lung cancer related investigations. Methods: The authors developed a computer scheme to automatically match the nodule outlines marked manually by radiologists on CT images. A large variety of characteristics regarding the annotated nodules in the database including volume, spiculation level, elongation, interobserver variability, as well as the intersection of delineated nodule voxels and overlapping ratio between the same nodules marked by different radiologists are automatically calculated and summarized. The scheme was applied to analyze all 157 examinations with complete annotation data currently available in LIDC dataset. Results: The scheme summarizes the statistical distributions of the abovementioned geometric and diagnosis features. Among the 391 nodules, (1) 365 (93.35%) have principal axis length {<=}20 mm; (2) 120, 75, 76, and 120 were marked by one, two, three, and four radiologists, respectively; and (3) 122 (32.48%) have the maximum volume overlapping ratios {>=}80% for the delineations of two radiologists, while 198 (50.64%) have the maximum volume overlapping ratios <60%. The results also showed that 72.89% of the nodules were assessed with malignancy score between 2 and 4, and only 7.93% of these nodules were considered as severely malignant (malignancy {>=}4). Conclusions: This study demonstrates that LIDC contains examinations covering a diverse distribution of nodule characteristics and it can be a useful resource to assess the performance of the nodule detection and/or segmentation schemes.

60 APPLIED LIFE SCIENCES↗

Accelerated Assessment of Critical Infrastructure in Aiding Recovery Efforts During Natural and Human-made Disaster

Relief and recovery from disasters (both natural and human-made) require a coordinated approach across several federal and state government agencies. In order to achieve optimal resource allocation and deployment of first responders, accurate and timely assessment of the impact and extent of destruction are the cornerstones to any recovery effort. Ideally, this knowledge should be gathered and shared within the first 0-24 hours (termed as "Acute Phase" by the U.S. CDC guideline) for informed decision-making. But achieving this poses significant challenges for the data collection and data harmonization processes, particularly when voluminous data are being generated from diverse and distributed sources during the disaster responses. To this end, this work developed a scalable and efficient workflow to dynamically collect and harmonize crowd-sourced geographic multi-modal data, and then assess critical infrastructure (CI) damaged during disaster events. We demonstrate the application of our framework with two real-world experiences in addressing post-disaster recovery efforts - for the Bahamas (Natural - due to Hurricane Dorian, 2019) and Beirut (Human-made - due to explosion caused by the ammonium nitrate stored in a warehouse, 2020). We have illustrated that a coordinated effort is needed for planning as well as for execution to achieve informed decision making.

Thakur, Gautam Malviya↗

The Third Data Release of the KODIAQ Survey

We present and make publicly available the third data release (DR3) of the Keck Observatory Database of Ionized Absorption toward Quasars (KODIAQ) survey. KODIAQ DR3 consists of a fully reduced sample of 727 quasars at 0.1 < z {sub em} < 6.4 observed with the Echellette Sepctrograph and Imager at moderate resolution (4000 ≤ R ≤ 10,000). DR3 contains 872 spectra available in flux calibrated form, representing a sum total exposure time of ∼2.8 megaseconds. These coadded spectra arise from a total of 2753 individual exposures of quasars taken from the Keck Observatory Archive (KOA) in raw form and uniformly processed using a data reduction package made available through the XIDL distribution. DR3 is publicly available to the community, housed as a higher level science product at the KOA and in the igmspec database.

74 ATOMIC AND MOLECULAR PHYSICS↗

Automated thematic mapping and change detection of ERTS-1 images

A system that inventories and updates resources must be capable of recognizing resources and their changes rapidly, using imagery acquired by a resources satellite such as ERTS-1. The conversion of ERTS images to thematic maps showing the distribution of resources is the first step in the data reduction process. To accomplish this task, the resources must be recognized from spatial and multispectral signatures. In addition, resource boundaries must be accurately established, and the data from different acquisition dates must be registered. This paper describes a system that combines multispectral and spatial pattern recognition techniques to produce thematic maps. This system has been applied to ERTS-1 MSS images, and the results obtained are discussed.

Gramenopoulos, N.↗

Time delay occultation data of the Helios spacecrafts and preliminary analysis for probing the solar corona

S-band time delay measurements were collected from the spacecrafts Helios A and B during three solar occultations in 1975/76 within heliocentric distances of about 3 and 215 solar radii in terms of range, Doppler frequency shift, and electron content. A description is given concerning some characteristic features of the methods of measurement and data processing. Typical data sets are discussed to probe the electron density distribution near the sun (west and east limb as well) including the outer and extended corona. Steady-state and dynamical aspects of the solar corona are presented and compared with earth-bound K-coronagraph measurements. Using a weighted least squares estimation 3 parameters of an average coronal electron density profile are derived in a preliminary analysis to yield electron densities of about 130 billion; 100 million; 7 million/cu m at r?3; 65; 215 solar radii. Transient phenomena are discussed and a velocity of propagation v approximately 900 km/s for plasma ejecta from a solar flare is determined from an extraordinary set of Helios B electron content measurements on April 30/May 1, 1976.

Edenhofer, P.↗

2-165 keV observations of active galaxies and the diffuse background

HEAO 1 spectral observations of 12 active galaxies in the 12-165 keV and 2-50 keV ranges are reported. The spectra of these galaxies in the 2-165 keV range are well represented by a single power law model; within experimental uncertainties a narrow dispersion in power law index attributable to the individual galaxies is observed, while the 2-165 keV luminosities of these galaxies ranged from 3 x 10 to the 43rd to 3 x 10 to the 45th ergs/s. An apparent universality of the spectral form is found which can be interpreted as due to a common electron distribution with a temperature of tens of keV in the Compton scattering region or as a common nonthermal power-law distribution generating the observed flux through synchrotron-Compton processes. The data indicate that relativistic particles are likely to be responsible for the X-rays from cores of active galaxies through synchroton-Compton processes. In addition, it is noted that only weak number evolution, if any at all, is present in active galaxies.

Rothschild, R. E.↗

Bibliography On Multiprocessors And Distributed Processing

Multiprocessor and Distributed Processing Bibliography package consists of large machine-readable bibliographic data base, which in addition to usual keyword searches, used for producing citations, indexes, and cross-references. Data base contains UNIX(R) "refer" -formatted ASCII data and implemented on any computer running under UNIX(R) operating system. Easily convertible to other operating systems. Requires approximately one megabyte of secondary storage. Bibliography compiled in 1985.

Miya, Eugene N.↗