Search NASA⌕ Search

SEARCH · Search NASA

Results for “data reduction”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 793 records · Page 44

Top Ten Interaction Challenges in Extreme-Scale Visual Analytics

The chapter presents ten selected user interfaces and interaction challenges in extreme-scale visual analytics. The study of visual analytics is often referred to as 'the science of analytical reasoning facilitated by interactive visual interfaces' in the literature. The discussion focuses on the issues of applying visual analytics technologies to extreme-scale scientific and non-scientific data ranging from petabyte to exabyte in sizes. The ten challenges are: in situ interactive analysis, user-driven data reduction, scalability and multi-level hierarchy, representation of evidence and uncertainty, heterogeneous data fusion, data summarization and triage for interactive query, analytics of temporally evolving features, the human bottleneck, design and engineering development, and the Renaissance of conventional wisdom. The discussion addresses concerns that arise from different areas of hardware, software, computation, algorithms, and human factors. The chapter also evaluates the likelihood of success in meeting these challenges in the near future.

99 GENERAL AND MISCELLANEOUS↗

Striped Data Analysis Framework

Traditionally, High Energy data analysis is based on the model where data are stored in files and analyzed by running multiple analysis processes, each reading one or more of the data files. This process involves repeated data reduction step, which produces smaller files, which is time consuming and leads to data duplication. We propose an alternative approach to data storage and analysis, based on the Big Data technologies. The idea is to store each element of data once and only once in a distributed scalable database and analyze data by reading only "interesting" pieces of data from the database. To make this approach possible, we developed columnar Striped Data Representation Format as the basis of the framework. Traditional columnar approach allows for efficient analysis of complex data structures. While keeping all the benefits of columnar data representation, striped mechanism goes further by enabling efficient parallelization of computations and flexible dist ribution of data analysis. The framework includes scalable and elastic data storage, compute and user analysis backend components. The framework uses off-the shelf web services and data caching technologies as the compute/data co-location mechanism. Flexible architecture allows the framework run in the cloud using container technologies. The framework offers Python/Jupyter as the user analysis backend platform, but can also run in command line or batch mode. In the article, we will present the results of the FNAL-LDRD-2016-032 FNAL LDRD project, the design, implementation, features and performance characteristics of the Striped Data Analysis Framework.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Precise time and time interval data handling and reduction

In the past year, the increase in Precise Time And Time Interval data to be reduced to the U.S. Naval Observatory Master Clock and the requirement for its quick dissemination has necessitated development of more efficient methods of data handling and reduction. An outline of the data involved and of the Time Service computerization of these functions is presented.

Fisher, L. C.↗

CONTINUUM HALOS IN NEARBY GALAXIES: AN EVLA SURVEY (CHANG-ES). II. FIRST RESULTS ON NGC 4631

We present the first results from the Continuum Halos in Nearby Galaxies-an EVLA Survey (CHANG-ES), a new survey of 35 edge-on galaxies to search for both in-disk and extraplanar radio continuum emission. CHANG-ES is exploiting the new wide-band, multi-channel capabilities of the Karl G. Jansky Very Large Array (i.e., the Expanded Very Large Array or EVLA) with observations in two bands centered at 1.5 and 6 GHz in a variety of array configurations with full polarization. The motivation and science case for the survey are presented in a companion paper (Paper I). These first results are based on C-array test observations in both observing bands of the well-known radio halo galaxy, NGC 4631. In this paper, we outline the observations and the data reduction steps that are required for wide-band calibration and mapping of EVLA data, including polarization. With modest on-source observing times (30 minutes at 1.5 GHz and 75 minutes at 6 GHz for the test data), we have achieved best rms noise levels of 22 and 3.5 {mu}Jy beam{sup -1} at 1.5 GHz and 6 GHz, respectively. New disk-halo features have been detected, among them two at 1.5 GHz that appear as loops in projection. We present the first 1.5 GHz spectral index map of NGC 4631 to be formed from a single wide-band observation in a single array configuration. This map represents tangent slopes to the intensities within the band centered at 1.5 GHz, rather than fits across widely separated frequencies as has been done in the past and is also the highest spatial resolution spectral index map yet presented for this galaxy. The average spectral index in the disk is {alpha}-bar{sub 1.5GHz} = -0.84 {+-} 0.05 indicating that the emission is largely non-thermal, but a small global thermal contribution is sufficient to explain a positive curvature term in the spectral index over the band. Two specific star-forming regions have spectral indices that are consistent with thermal emission. Polarization results (uncorrected for internal Faraday rotation) are consistent with previous observations and also reveal some new features. On broad scales, we find strong support for the notion that magnetic fields constrain the X-ray-emitting hot gas.

79 ASTRONOMY AND ASTROPHYSICS↗

HIGH-RESOLUTION XMM-NEWTON SPECTROSCOPY OF THE COOLING FLOW CLUSTER A3112

We examine high signal-to-noise XMM-Newton European Photon Imaging Camera (EPIC) and Reflection Grating Spectrometer (RGS) observations to determine the physical characteristics of the gas in the cool core and outskirts of the nearby rich cluster A3112. The XMM-Newton Extended Source Analysis Software data reduction and background modeling methods were used to analyze the XMM-Newton EPIC data. From the EPIC data, we find that the iron and silicon abundance gradients show significant increase toward the center of the cluster while the oxygen abundance profile is centrally peaked but has a shallower distribution than that of iron. The X-ray mass modeling is based on the temperature and deprojected density distributions of the intracluster medium determined from EPIC observations. The total mass of A3112 obeys the M-T scaling relations found using XMM-Newton and Chandra observations of massive clusters at r{sub 500}. The gas mass fraction f{sub gas} = 0.149{sup +0.036}{sub -0.032} at r{sub 500} is consistent with the seven-year Wilkinson Microwave Anisotropy Probe results. The comparisons of line fluxes and flux limits on the Fe XVII and Fe XVIII lines obtained from high-resolution RGS spectra indicate that there is no spectral evidence for cooler gas associated with the cluster with temperature below 1.0 keV in the central <38'' ({approx}52 kpc) region of A3112. High-resolution RGS spectra also yield an upper limit to the turbulent motions in the compact core of A3112 (206 km s{sup -1}). We find that the contribution of turbulence to total energy is less than 6%. This upper limit is consistent with the energy contribution measured in recent high-resolution simulations of relaxed galaxy clusters.

79 ASTRONOMY AND ASTROPHYSICS↗

Expanding Lorentz and spectrum corrections to large volumes of reciprocal space for single-crystal time-of-flight neutron diffraction

Evidence is mounting that potentially exploitable properties of technologically and chemically interesting crystalline materials are often attributable to local structure effects, which can be observed as modulated diffuse scattering (mDS) next to Bragg diffraction (BD). BD forms a regular sparse grid of intense discrete points in reciprocal space. Traditionally, the intensity of each Bragg peak is extracted by integration of each individual reflection first, followed by application of the required corrections. In contrast, mDS is weak and covers expansive volumes of reciprocal space close to, or between, Bragg reflections. For a representative measurement of the diffuse scattering, multiple sample orientations are generally required, where many points in reciprocal space are measured multiple times and the resulting data are combined. The common post-integration data reduction method is not optimal with regard to counting statistics. A general and inclusive data processing method is needed. In this contribution, a comprehensive data analysis approach is introduced to correct and merge the full volume of scattering data in a single step, while correctly accounting for the statistical weight of the individual measurements. Development of this new approach required the exploration of a data treatment and correction protocol that includes the entire collected reciprocal space volume, using neutron time-of-flight or wavelength-resolved data collected at TOPAZ at the Spallation Neutron Source at Oak Ridge National Laboratory.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

High-Throughput Method for Strontium Isotope Analysis by Multi-Collector-Inductively Coupled Plasma-Mass Spectrometer

This technical report presents the details of the Sr column configuration and the high-throughput Sr separation protocol. Data showing the performance of the method as well as the best practices for optimizing Sr isotope analysis by MC-ICP-MS is presented. Lastly, this report offers tools for data handling and data reduction of Sr isotope results from the Thermo Scientific Neptune software to assist in data quality assurance, which help avoid issues of data glut associated with high sample throughput rapid analysis.

47 OTHER INSTRUMENTATION↗

High-Throughput Method for Strontium Isotope Analysis by Multi-Collector-Inductively Coupled Plasma-Mass Spectrometer

This technical report presents the details of the Sr column configuration and the high-throughput Sr separation protocol. Data showing the performance of the method as well as the best practices for optimizing Sr isotope analysis by MC-ICP-MS is presented. Lastly, this report offers tools for data handling and data reduction of Sr isotope results from the Thermo Scientific Neptune software to assist in data quality assurance, which help avoid issues of data glut associated with high sample throughput rapid analysis.

47 OTHER INSTRUMENTATION↗

Results of investigations on an 0.015-scale 140A/B configuration of the Rockwell International space shuttle orbiter (model 49-O) in the NASA/Ames Research Center 3.5-foot hypersonic wind tunnel (OA36)

The results of wind tunnel tests of the 140A/B configuration components are reported for the fuselage, canopy, elevons, bodyflaps, pods, engine nozzles, rudder, vertical tail, and wing. The test facility, and data reduction procedures are described. Test results for each component are graphed, and tabulated source data are included.

Milam, M. D.↗

An evaluation of the partial reflection technique and results from the winter 1971 - 1972 D region

Fundamental physical and chemical processes, and measurement techniques on the D region are reviewed. Design considerations about a partial-reflection system are made, and the main characteristics of the partial-reflection system at the University of Illinois are presented. The nature of the partial reflections is discussed, particularly reflections produced by gradients in electron density and by random fluctuations in a locally homogeneous random medium. Possible reasons for disagreement between partial reflections and rocket measurements are discussed. Some suggestions are made to improve partial-reflection data reduction, including the use of only maximums of the reflections and deconvolution of the data. The results of partial-reflection measurements at Wallops Island, Virginia during the 1971-1972 winter are presented and compared to rocket measurements.

Dasilva, L. C.↗

Real time control of satellite tracking station operation for millimeter wave experiments and associated data processing

Real time control, data collection, and data reduction of an earth-satellite millimeter wave system are discussed. Experiment control and data processing requirements are considered with attention to signal data acquisition, weather data acquisition, support and control functions, task classifications, the fundamental data acquisition procedure, and the computer-experiment interface. The general analysis is applied to a description of the Communications Technology Satellite system and its hardware.

Kauffman, S. R.↗

Development of advanced acreage estimation methods

The use of the AMOEBA clustering/classification algorithm was investigated as a basis for both a color display generation technique and maximum likelihood proportion estimation procedure. An approach to analyzing large data reduction systems was formulated and an exploratory empirical study of spatial correlation in LANDSAT data was also carried out. Topics addressed include: (1) development of multiimage color images; (2) spectral spatial classification algorithm development; (3) spatial correlation studies; and (4) evaluation of data systems.

Guseman, L. F., Jr.↗

Instant-replay data system for combustion tests

A portable, inexpensive, easily programmed, and flexible pressure measuring and display system is described and evaluated in a multi-port combustion model. The data reduction system consists of a desk-top graphics display system and calculator with data tape storage and standard data communications interfacing capabilities, while a hard copy unit provides a permanent record of all plots and tables. The system offers the advantages of recording and comparing a large number of pressures at high data rates along with the display of the results in a meaningful graphical form for near real time analysis. Some discussion of combustor and engine experiments are included as examples of the data system application.

Trexler, C. A.↗

Summary of shuttle data processing and aerodynamic performance comparisons for the first 11 flights

NASA Space Shuttle aerodynamic and aerothermodynamic research is but one part of the most comprehensive end-to-end flight test program ever undertaken considering: the extensive pre-flight experimental data base development; the multitude of spacecraft and remote measurements taken during entry flight; the complexity of the Orbiter aerodynamic configuration; the variety of flight conditions available across the entire speed regime; and the efforts devoted to flight data reduction throughout the aerospace community. Shuttle entry flights provide a wealth of research quality data, in essence a veritable flying wind tunnel, for use by researchers to verify and improve the operational capability of the Orbiter and provide data for evaluations of experimental facilities as well as computational methods. This final report merely summarizes the major activities conducted by the AMA, Inc. under NASA Contract NAS1-16087 as part of that interesting research. Investigators desiring more detailed information can refer to the glossary of AMA publications attached herein as Appendix A. Section I provides background discussion of software and methodology development to enable Best Estimate Trajectory (BET) generation. Actual products generated are summarized in Section II as tables which completely describe the post-flight products available from the first three-year Shuttle flight history. Summary results are presented in Section III, with longitudinal performance comparisons included as Appendices for each of the flights.

Findlay, J. T.↗

The IRAS asteroid and comet survey

Observations made by the Infrared Astronomical Satellite (IRAS) during 1983 constitute the largest, most complete, and least biased of the asteroid surveys to date. A total of 1811 asteroids and 25 comets with known orbits were measured. Thermal flux densities at 12, 25, 60, and 100 microns, as well as (in the case of asteroids) their derived radiometric albedos and diameters have been compiled in the IRAS Asteroid and Comet Survey. Useful low-resolution spectra were obtained for 47 numbered asteroids. There is evidence in the IRAS data base for a large population of asteroids with unknown orbits. The methods of observation are outlined. The survey strategy and the data reduction are discussed. The rationale is given for the various IRAS asteroid and comet data products. Some directions for future research using IRAS data are suggested.

Matson, Dennis L.↗