Search NASA⌕ Search

SEARCH · Search NASA

Results for “data reduction”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 937 records · Page 52

HIGH-RESOLUTION VERY LARGE ARRAY IMAGING OF SLOAN DIGITAL SKY SURVEY STRIPE 82 AT 1.4 GHz

We present a high-resolution radio survey of the Sloan Digital Sky Survey (SDSS) Southern Equatorial Stripe, a.k.a. Stripe 82. This 1.4 GHz survey was conducted with the Very Large Array primarily in the A-configuration, with supplemental B-configuration data to increase sensitivity to extended structure. The survey has an angular resolution of 1.''8 and achieves a median rms noise of 52 {mu}Jy beam{sup -1} over 92 deg{sup 2}. This is the deepest 1.4 GHz survey to achieve this large of an area, filling a gap in the phase space between small, deep and large, shallow surveys. It also serves as a pilot project for a larger high-resolution survey with the Expanded Very Large Array. We discuss the technical design of the survey and details of the observations, and we outline our method for data reduction. We present a catalog of 17,969 isolated radio components, for an overall source density of {approx}195 sources deg{sup -2}. The astrometric accuracy of the data is excellent, with an internal check utilizing multiply observed sources yielding an rms scatter of 0.''19 in both right ascension and declination. A comparison to the SDSS DR7 Quasar Catalog further confirms that the astrometry is well tied to the optical reference frame, with mean offsets of 0.''02 {+-} 0.''01 in right ascension, and 0.''01 {+-} 0.''02 in declination. A check of our photometry reveals a small, negative CLEAN-like bias on the level of 35 {mu}Jy. We report on the catalog completeness, finding that 97% of FIRST-detected quasars are recovered in the new Stripe 82 radio catalog, while faint, extended sources are more likely to be resolved out by the resolution bias. We conclude with a discussion of the optical counterparts to the catalog sources, including 76 newly detected radio quasars. The full catalog as well as a search page and cutout server are available online at http://third.ucllnl.org/cgi-bin/stripe82cutout.

79 ASTRONOMY AND ASTROPHYSICS↗

Michigan Orbital DEbris Survey Telescope Observations of the Geosynchronous Orbital Debris Environment. Observing Years: 2007-2009

NASA uses the Michigan Orbital DEbris Survey Telescope (MODEST), the University of Michigan's 0.61-m aperture Curtis-Schmidt telescope at the Cerro Tololo Inter-American Observatory in Chile, to help characterize the debris environment in geosynchronous orbit; this began in February 2001 and continues to the present day. Detected objects that are found to be on the U.S. Space Surveillance Network cataloged objects list are termed correlated targets (CTs), while those not found on the list are called uncorrelated targets (UCTs). This Johnson Space Center report provides details of observational and data-reduction processes for the entire MODEST dataset acquired in calendar years (CYs) 2007, 2008, and 2009. Specifically, this report describes the collection and analysis of 36 nights of data collected in CY 2007, 43 nights of data collected in CY 2008, and 43 nights of data collected in CY 2009. MODEST is equipped with a 2048 x 2048-pixel charged coupled device camera with a 1.3 by 1.3 deg field of view. This system is capable of detecting objects fainter than 18th magnitude (R filter) using a 5-s integration. This corresponds to a 20-cm diameter, 0.175-albedo object at 36,000 km altitude assuming a diffuse Lambertian phase function. The average number of detections each night over all 3 years was 26. The percentage of this number that represented the UCT population ranged from 34% to 18%, depending on the observing strategy and the field center location. Due to the short orbital arc over which observations are made, the eccentricity of the object s orbit is extremely difficult to measure accurately. Therefore, a circular orbit was assumed when calculating the orbital elements. A comparison of the measured inclination (INC), right ascension of ascending node (RAAN), and mean motion to the quantities for CTs from the U.S. Space Surveillance Network shows acceptable errors. This analysis lends credibility to the determination of the UCT orbital distributions. Figure 1 shows the size distribution of 3,143 objects detected in the data processed for CYs 2007, 2008, and 2009. The actual peak of the absolute magnitude distribution for the functional correlated targets is 10th magnitude, whereas the peak was 11th magnitude in 2002 2003 and 10th magnitude for 2004-2006. An absolute magnitude of 10.5 corresponds to objects with average diameters of 6.3 m, assuming an albedo of 0.175 and a diffuse Lambertian phase function. This result generally agrees with the known sizes of intact satellites. The absolute magnitude distribution for the UCTs is broad, but starts to roll off near 25 cm diameter or 17.5 magnitude. This roll off in the distribution reflects the detection capability of MODEST, not the true nature of the population. The true population is believed to continue at the same slope through fainter magnitudes based on comparisons with the LEO break-up law.

Abercromby, K. J.↗

A Description of the Development, Capabilities, and Operational Status of the Test SLATE Data Acquisition System at the National Transonic Facility

The paper will present a brief background of the previous data acquisition system at the National Transonic Facility (NTF) and the reasoning and goals behind the upgrade to the current Test SLATE (Test Software Laboratory and Automated Testing Environments) data acquisition system. The components, performance characteristics, and layout of the Test SLATE system within the NTF control room will be discussed. The development, testing, and integration of Test SLATE within NTF operations will be detailed. The operational capabilities of the system will be outlined including: test setup, instrumentation calibration, automatic test sequencer setup, data recording, communication between data and facility control systems, real time display monitoring, and data reduction. The current operational status of the Test SLATE system and its performance during recent NTF testing will be highlighted including high-speed, frame-by-frame data acquisition with conditional sampling post-processing applied. The paper concludes with current development work on the system including the capability for real-time conditional sampling during data acquisition and further efficiency enhancements to the wind tunnel testing process.

Cramer, Christopher J.↗

Adaptive filtering of Echelle spectra of distant Quasars

The study of the Ly alpha - forest of distant (approximately greater than 3) Quasars is an important tool in obtaining a more detailed picture of the distribution of matter along the line of sight and thus of the general distribution of matter in the Universe and is therefore of important cosmological significance. Obviously, this is one of the tasks where spectral resolution plays an important role. The spectra used were obtained with the EFOSC at the ESO 3.6m telescope. Applying for the data reduction the standard Echelle procedure, as it is implemented for instance in the MIDAS-package, one uses stationary filters (e.g. median) for noise and cosmic particle event reduction in the 2-dimensional Echelle image. These filters are useful if the spatial spectrum of the noise reaches essentially higher frequencies then the highest resolution features in the image. Otherwise the resolution in the data will be degraded and the spectral lines smoothed. However, in the Echelle spectra the highest resolution is already in the range of one or a few pixels and therefore stationary filtering means always a loss of resolution. An Echelle reduction procedure on the basis of a space variable filter described which recognizes the local resolution in the presence of noise and adapts to it is developed. It was shown that this technique leads to an improvement in resolution by a factor of 2 with respect to standard procedures.

Priebe, A.↗

A Study of the Trade-off Between Reducing Precision and Reducing Resolution for Data Analysis and Visualization

There presently exist two dominant strategies to reduce data sizes in analysis and visualization: reducing the precision of the data, e.g., through quantization, or reducing its resolution, e.g., by subsampling. Both have advantages and disadvantages and both face fundamental limits at which the reduced information ceases to be useful. The paper explores the additional gains that could be achieved by combining both strategies. In particular, we present a common framework that allows us to study the trade-off in reducing precision and/or resolution in a principled manner. We represent data reduction schemes as progressive streams of bits and study how various bit orderings such as by resolution, by precision, etc., impact the resulting approximation error across a variety of data sets as well as analysis tasks. Additionally, we compute streams that are optimized for different tasks to serve as lower bounds on the achievable error. Scientific data management systems can use the results proposed in this paper as guidance on how to store and stream data to make efficient use of the limited storage and bandwidth in practice.

97 MATHEMATICS AND COMPUTING↗

QuickNXS

Data reduction software for the Oak Ridge National Laboratory Spallation Neutron Source's Magnetism Reflectometer beam line 4A, used to extract reflectivity, off-specular and GISANS scattering from raw data in NeXus file format. The package consists of a Python library for the extraction and a Qt4 based graphical user interface to work with the data.

Glavic, ArturGregor↗

Propfan experimental data analysis

A data reduction method, which is consistent with the performance prediction methods used for analysis of new aircraft designs, is defined and compared to the method currently used by NASA using data obtained from an Ames Res. Center 11 foot transonic wind tunnel test. Pressure and flow visualization data from the Ames test for both the powered straight underwing nacelle, and an unpowered contoured overwing nacelle installation is used to determine the flow phenomena present for a wind mounted turboprop installation. The test data is compared to analytic methods, showing the analytic methods to be suitable for design and analysis of new configurations. The data analysis indicated that designs with zero interference drag levels are achieveable with proper wind and nacelle tailoring. A new overwing contoured nacelle design and a modification to the wing leading edge extension for the current wind tunnel model design are evaluated. Hardware constraints of the current model parts prevent obtaining any significant performance improvement due to a modified nacelle contouring. A new aspect ratio wing design for an up outboard rotation turboprop installation is defined, and an advanced contoured nacelle is provided.

Vernon, David F.↗

NASA Marshall Space Flight Center Solar Observatory report, July - September 1990

A description of the NASA Marshall Space Flight C nter's Solar Vector Magnetograph Facility is provided and gives a summary of its observations and data reduction during Jul. - Sep. 1990. The systems that make up the facility are a magnetograph telescope, an H-alpha telescope, a Questar telescope, and a computer code. The data are represented by longitudinal contours with azimuth plots.

Smith, James E.↗

Evaluation of structural integrity using integrated testing and analysis

An integrated approach to dynamic testing and mathematical model analysis is described. The overall approach addresses four key tasks, namely, pretest planning and analysis, test data acquisition, data reduction and analysis, and test/analysis correlation and mathematical model updates. Several key software programs are employed to accomplish this task. They are a leading finite element code, a sophisticated data analysis processor and a graphical pre- and post-processor along with an advanced interface utility. Several practical structures are used to illustrate tools and concepts employed in the integrated test analysis process.

Coppolino, Robert N.↗

The Accuracy of Parameter Estimation in System Identification of Noisy Aircraft Load Measurement

This thesis focuses on the subject of the accuracy of parameter estimation and system identification techniques. Motivated by a complicated load measurement from NASA Dryden Flight Research Center, advanced system identification techniques are needed. The objective of this problem is to accurately predict the load experienced by the aircraft wing structure during flight determined from a set of calibrated load and gage response relationship. We can then model the problem as a black box input-output system identification from which the system parameter has to be estimated. Traditional LS (Least Square) techniques and the issues of noisy data and model accuracy are addressed. A statistical bound reflecting the change in residual is derived in order to understand the effects of the perturbations on the data. Due to the intrinsic nature of the LS problem, LS solution faces the dilemma of the trade off between model accuracy and noise sensitivity. A method of conflicting performance indices is presented, thus allowing us to improve the noise sensitivity while at the same time configuring the degredation of the model accuracy. SVD techniques for data reduction are studied and the equivalence of the Correspondence Analysis (CA) and Total Least Squares Criteria are proved. We also looked at nonlinear LS problems with NASA F-111 data set as an example. Conventional methods are neither easily applicable nor suitable for the specific load problem since the exact model of the system is unknown. Neural Network (NN) does not require prior information on the model of the system. This robustness motivated us to apply the NN techniques on our load problem. Simulation results for the NN methods used in both the single load and the 'warning signal' problems are both useful and encouraging. The performance of the NN (for single load estimate) is better than the LS approach, whereas no conventional approach was tried for the 'warning signals' problems. The NN design methodology is also presented. The use of SVD, CA and Collinearity Index methods are used to reduce the number of neurons in a layer.

Kong, Jeffrey↗

QuickNXS

Data reduction software for the Oak Ridge National Laboratory Spallation Neutron Source's Magnetism Reflectometer beam line 4A, used to extract reflectivity, off-specular and GISANS scattering from raw data in NeXus file format. The package consists of a Python library for the extraction and a Qt4 based graphical user interface to work with the data.

Glavic, Artur Gregor↗

Using Big Data Technologies for HEP Analysis

The HEP community is approaching an era were the excellent performances of the particle accelerators in delivering collision at high rate will force the experiments to record a large amount of information. The growing size of the datasets could potentially become a limiting factor in the capability to produce scientific results timely and efficiently. Recently, new technologies and new approaches have been developed in industry to answer to the necessity to retrieve information as quickly as possible to analyze PB and EB datasets. Providing the scientists with these modern computing tools will lead to rethinking the principles of data analysis in HEP, making the overall scientific process faster and smoother. In this paper, we are presenting the latest developments and the most recent results on the usage of Apache Spark for HEP analysis. The study aims at evaluating the efficiency of the application of the new tools both quantitatively, by measuring the performances, and qualitatively, focusing on the user experience. The first goal is achieved by developing a data reduction facility: working together with CERN Openlab and Intel, CMS replicates a real physics search using Spark-based technologies, with the ambition of reducing 1 PB of public data in 5 hours, collected by the CMS experiment, to 1 TB of data in a format suitable for physics analysis. The second goal is achieved by implementing multiple physics use-cases in Apache Spark using as input preprocessed datasets derived from official CMS data and simulation. By performing different end-analyses up to the publication plots on different hardware, feasibility, usability and portability are compared to the ones of a traditional ROOT-based workflow.

Cremonesi, Matteo↗

Distributed computing strategies for processing of FT-ICR MS imaging datasets for continuous mode data visualization

High-resolution Fourier transform ion cyclotron resonance (FT-ICR) mass spectrometry imaging enables the spatial mapping and identification of biomolecules from complex surfaces. The need for long time-domain transients, and thus large raw file sizes, results in a large amount of raw data (“big data”) that must be processed efficiently and rapidly. This can be compounded by largearea imaging and/or high spatial resolution imaging. For FT-ICR, data processing and data reduction must not compromise the high mass resolution afforded by the mass spectrometer. The continuous mode “Mosaic Datacube” approach allows high mass resolution visualization (0.001 Da) of mass spectrometry imaging data, but requires additional processing as compared to featurebased processing. We describe the use of distributed computing for processing of FT-ICR MS imaging datasets with generation of continuous mode Mosaic Datacubes for high mass resolution visualization. An eight-fold improvement in processing time is demonstrated using a Dutch nationally available cloud service.

Environmental Molecular Sciences Laboratory↗

UVUDF: Ultraviolet imaging of the Hubble ultra deep field with wide-field camera 3

We present an overview of a 90 orbit Hubble Space Telescope treasury program to obtain near-ultraviolet imaging of the Hubble Ultra Deep Field using the Wide Field Camera 3 UVIS detector with the F225W, F275W, and F336W filters. This survey is designed to: (1) investigate the episode of peak star formation activity in galaxies at 1 < z < 2.5; (2) probe the evolution of massive galaxies by resolving sub-galactic units (clumps); (3) examine the escape fraction of ionizing radiation from galaxies at z ∼ 2-3; (4) greatly improve the reliability of photometric redshift estimates; and (5) measure the star formation rate efficiency of neutral atomic-dominated hydrogen gas at z ∼ 1-3. In this overview paper, we describe the survey details and data reduction challenges, including both the necessity of specialized calibrations and the effects of charge transfer inefficiency. We provide a stark demonstration of the effects of charge transfer inefficiency on resultant data products, which when uncorrected, result in uncertain photometry, elongation of morphology in the readout direction, and loss of faint sources far from the readout. We agree with the STScI recommendation that future UVIS observations that require very sensitive measurements use the instrument's capability to add background light through a 'post-flash'. Preliminary results on number counts of UV-selected galaxies and morphology of galaxies at z ∼ 1 are presented. We find that the number density of UV dropouts at redshifts 1.7, 2.1, and 2.7 is largely consistent with the number predicted by published luminosity functions. We also confirm that the image mosaics have sufficient sensitivity and resolution to support the analysis of the evolution of star-forming clumps, reaching 28-29th magnitude depth at 5σ in a 0.''2 radius aperture depending on filter and observing epoch.

79 ASTRONOMY AND ASTROPHYSICS↗

THE CARNEGIE SUPERNOVA PROJECT: FIRST NEAR-INFRARED HUBBLE DIAGRAM TO z approx 0.7

The Carnegie Supernova Project (CSP) is designed to measure the luminosity distance for Type Ia supernovae (SNe Ia) as a function of redshift, and to set observational constraints on the dark energy contribution to the total energy content of the universe. The CSP differs from other projects to date in its goal of providing an I-band rest-frame Hubble diagram. Here, we present the first results from near-infrared observations obtained using the Magellan Baade telescope for SNe Ia with 0.1 <z < 0.7. We combine these results with those from the low-redshift CSP at z < 0.1. In this paper, we describe the overall goals of this long-term program, the observing strategy, data reduction procedures, and treatment of systematic uncertainties. We present light curves and an I-band Hubble diagram for this first sample of 35 SNe Ia, and we compare these data to 21 new SNe Ia at low redshift. These data support the conclusion that the expansion of the universe is accelerating. When combined with independent results from baryon acoustic oscillations, these data yield OMEGA {sub m} = 0.27 +- 0.02(statistical) and OMEGA{sub DE} = 0.76 +- 0.13(statistical) +- 0.09(systematic), for the matter and dark energy densities, respectively. If we parameterize the data in terms of an equation of state, w (with no time dependence), assume a flat geometry, and combine with baryon acoustic oscillations, we find that w = -1.05 +- 0.13(statistical) +- 0.09(systematic). The largest source of systematic uncertainty on w arises from uncertainties in the photometric calibration, signaling the importance of securing more accurate photometric calibrations for future supernova cosmology programs. Finally, we conclude that either the dust affecting the luminosities of SNe Ia has a different extinction law (R{sub V} = 1.8) than that in the Milky Way (where R{sub V} = 3.1), or that there is an additional intrinsic color term with luminosity for SNe Ia, independent of the decline rate. Understanding and disentangling these effects is critical for minimizing the systematic uncertainties in future SN Ia cosmology studies.

79 ASTRONOMY AND ASTROPHYSICS↗

Design and flight testing of a nullable compressor face rake

A compressor face rake with an internal valve arrangement to permit nulling was designed, constructed, and tested in the laboratory and in flight at the NASA Flight Research Center. When actuated by the pilot in flight, the nullable rake allowed the transducer zero shifts to be determined and then subsequently removed during data reduction. Design details, the fabrication technique, the principle of operation, brief descriptions of associated digital zero-correction programs and the qualification tests, and test results are included. Sample flight data show that the zero shifts were large and unpredictable but could be measured in flight with the rake. The rake functioned reliably and as expected during 25 hours of operation under flight environmental conditions and temperatures from 230 K (-46 F) to greater than 430 K (314 F). The rake was nulled approximately 1000 times. The in-flight zero-shift measurement technique, as well as the rake design, was successful and should be useful in future applications, particularly where accurate measurements of both steady-state and dynamic pressures are required under adverse environmental conditions.

Holzman, J. K.↗

ADAMS executive and operating system

The ADAMS Executive and Operating System, a multitasking environment under which a variety of data reduction, display and utility programs are executed, a system which provides a high level of isolation between programs allowing them to be developed and modified independently, is described. The Airborne Data Analysis/Monitor System (ADAMS) was developed to provide a real time data monitoring and analysis capability onboard Boeing commercial airplanes during flight testing. It inputs sensor data from an airplane performance data by applying transforms to the collected sensor data, and presents this data to test personnel via various display media. Current utilization and future development are addressed.

Pittman, W. D.↗

NASA Marshall Space Flight Center solar observatory

A description is provided of the NASA Marshall Space Flight Center's Solar Vector Magnetograph Facility and a summary is given of its observations and data reduction during Jan. to Mar. 1988. The systems that make up the facility are a magnetograph telescope, an H-alpha telescope, a Questar telescope, and a computer center. The data are represented by longitudinal contours with azimuth plots.

Smith, James E.↗