Search NASA⌕ Search

SEARCH · Search NASA

Results for “Data reduction methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Scaling up to address data science challenges

Statistics and Data Science provide a variety of perspectives and technical approaches for exploring and understanding Big Data. Partnerships between scientists from different fields such as statistics, machine learning, computer science, and applied mathematics can lead to innovative approaches for addressing problems involving increasingly large amounts of data in a rigorous and effective manner that takes advantage of advances in computing. Here, this article will explore various challenges in Data Science and will highlight statistical approaches that can facilitate analysis of large-scale data including sampling and data reduction methods, techniques for effective analysis and visualization of large-scale simulations, and algorithms and procedures for efficient processing.

97 MATHEMATICS AND COMPUTING↗

The orbit and transit prospects for β pictoris b constrained with one milliarcsecond astrometry

A principal scientific goal of the Gemini Planet Imager (GPI) is obtaining milliarcsecond astrometry to constrain exoplanet orbits. However, astrometry of directly imaged exoplanets is subject to biases, systematic errors, and speckle noise. Here, we describe an analytical procedure to forward model the signal of an exoplanet that accounts for both the observing strategy (angular and spectral differential imaging) and the data reduction method (Karhunen–Loève Image Projection algorithm). We use this forward model to measure the position of an exoplanet in a Bayesian framework employing Gaussian processes and Markov-chain Monte Carlo to account for correlated noise. In the case of GPI data on β Pic b, this technique, which we call Bayesian KLIP-FM Astrometry (BKA), outperforms previous techniques and yields 1σ errors at or below the one milliarcsecond level. We validate BKA by fitting a Keplerian orbit to 12 GPI observations along with previous astrometry from other instruments. The statistical properties of the residuals confirm that BKA is accurate and correctly estimates astrometric errors. Our constraints on the orbit of β Pic b firmly rule out the possibility of a transit of the planet at 10-σ significance. However, we confirm that the Hill sphere of β Pic b will transit, giving us a rare chance to probe the circumplanetary environment of a young, evolving exoplanet. As a result, we provide an ephemeris for photometric monitoring of the Hill sphere transit event, which will begin at the start of April in 2017 and finish at the end of January in 2018.

79 ASTRONOMY AND ASTROPHYSICS↗

CANDELS: THE COSMIC ASSEMBLY NEAR-INFRARED DEEP EXTRAGALACTIC LEGACY SURVEY-THE HUBBLE SPACE TELESCOPE OBSERVATIONS, IMAGING DATA PRODUCTS, AND MOSAICS

This paper describes the Hubble Space Telescope imaging data products and data reduction procedures for the Cosmic Assembly Near-infrared Deep Extragalactic Legacy Survey (CANDELS). This survey is designed to document the evolution of galaxies and black holes at z Almost-Equal-To 1.5-8, and to study Type Ia supernovae at z > 1.5. Five premier multi-wavelength sky regions are selected, each with extensive multi-wavelength observations. The primary CANDELS data consist of imaging obtained in the Wide Field Camera 3 infrared channel (WFC3/IR) and the WFC3 ultraviolet/optical channel, along with the Advanced Camera for Surveys (ACS). The CANDELS/Deep survey covers {approx}125 arcmin{sup 2} within GOODS-N and GOODS-S, while the remainder consists of the CANDELS/Wide survey, achieving a total of {approx}800 arcmin{sup 2} across GOODS and three additional fields (Extended Groth Strip, COSMOS, and Ultra-Deep Survey). We summarize the observational aspects of the survey as motivated by the scientific goals and present a detailed description of the data reduction procedures and products from the survey. Our data reduction methods utilize the most up-to-date calibration files and image combination procedures. We have paid special attention to correcting a range of instrumental effects, including charge transfer efficiency degradation for ACS, removal of electronic bias-striping present in ACS data after Servicing Mission 4, and persistence effects and other artifacts in WFC3/IR. For each field, we release mosaics for individual epochs and eventual mosaics containing data from all epochs combined, to facilitate photometric variability studies and the deepest possible photometry. A more detailed overview of the science goals and observational design of the survey are presented in a companion paper.

79 ASTRONOMY AND ASTROPHYSICS↗

SPITZER SECONDARY ECLIPSE DEPTHS WITH MULTIPLE INTRAPIXEL SENSITIVITY CORRECTION METHODS OBSERVATIONS OF WASP-13b, WASP-15b, WASP-16b, WASP-62b, AND HAT-P-22b

We measure the 4.5 μ m thermal emission of five transiting hot Jupiters, WASP-13b, WASP-15b, WASP-16b, WASP-62b, and HAT-P-22b using channel 2 of the Infrared Array Camera (IRAC) on the Spitzer Space Telescope . Significant intrapixel sensitivity variations in Spitzer IRAC data require careful correction in order to achieve precision on the order of several hundred parts per million (ppm) for the measurement of exoplanet secondary eclipses. We determine eclipse depths by first correcting the raw data using three independent data reduction methods. The Pixel Gain Map (PMAP), Nearest Neighbors (NNBR), and Pixel Level Decorrelation (PLD) each correct for the intrapixel sensitivity effect in Spitzer photometric time-series observations. The results from each methodology are compared against each other to establish if they reach a statistically equivalent result in every case and to evaluate their ability to minimize uncertainty in the measurement. We find that all three methods produce reliable results. For every planet examined here NNBR and PLD produce results that are in statistical agreement. However, the PMAP method appears to produce results in slight disagreement in cases where the stellar centroid is not kept consistently on the most well characterized area of the detector. We evaluate the ability of each method to reduce the scatter in the residuals as well as in the correlated noise in the corrected data. The NNBR and PLD methods consistently minimize both white and red noise levels and should be considered reliable and consistent. The planets in this study span equilibrium temperatures from 1100 to 2000 K and have brightness temperatures that require either high albedo or efficient recirculation. However, it is possible that other processes such as clouds or disequilibrium chemistry may also be responsible for producing these brightness temperatures.

79 ASTRONOMY AND ASTROPHYSICS↗

Improving the precision of astrometry for space debris

The data reduction method for optical space debris observations has many similarities with the one adopted for surveying near-Earth objects; however, due to several specific issues, the image degradation is particularly critical, which makes it difficult to obtain precise astrometry. An automatic image reconstruction method was developed to improve the astrometry precision for space debris, based on the mathematical morphology operator. Variable structural elements along multiple directions are adopted for image transformation, and then all the resultant images are stacked to obtain a final result. To investigate its efficiency, trial observations are made with Global Positioning System satellites and the astrometry accuracy improvement is obtained by comparison with the reference positions. The results of our experiments indicate that the influence of degradation in astrometric CCD images is reduced, and the position accuracy of both objects and stellar stars is improved distinctly. Our technique will contribute significantly to optical data reduction and high-order precision astrometry for space debris.

79 ASTRONOMY AND ASTROPHYSICS↗

A Binary Offset Effect in CCD Readout and Its Impact on Astronomical Data

We have discovered an anomalous behavior of CCD readout electronics that affects their use in many astronomical applications. An offset in the digitization of the CCD output voltage that depends on the binary encoding of one pixel is added to pixels that are read out one, two, and/or three pixels later. One result of this effect is the introduction of a differential offset in the background when comparing regions with and without flux from science targets. Conventional data reduction methods do not correct for this offset. We find this effect in 16 of 22 instruments investigated, covering a variety of telescopes and many different front-end electronics systems. The affected instruments include LRIS and DEIMOS on the Keck telescopes, WFC3 UVIS and STIS on HST, MegaCam on CFHT, SNIFS on the UH88 telescope, GMOS on the Gemini telescopes, HSC on Subaru, and FORS on VLT. The amplitude of the introduced offset is up to 4.5 ADU per pixel, and it is not directly proportional to the measured ADU level. We have developed a model that can be used to detect this "binary offset effect" in data, and correct for it. Understanding how data are affected and applying a correction for the effect is essential for precise astronomical measurements.

79 ASTRONOMY AND ASTROPHYSICS↗

Robotic laser adaptive optics imaging of 715 Kepler exoplanet candidates using Robo-AO

The Robo-AO Kepler Planetary Candidate Survey is observing every Kepler planet candidate host star with laser adaptive optics imaging to search for blended nearby stars, which may be physically associated companions and/or responsible for transit false positives. In this paper, we present the results from the 2012 observing season, searching for stars close to 715 Kepler planet candidate hosts. We find 53 companions, 43 of which are new discoveries. We detail the Robo-AO survey data reduction methods including a method of using the large ensemble of target observations as mutual point-spread-function references, along with a new automated companion-detection algorithm designed for large adaptive optics surveys. Our survey is sensitive to objects from ≈0.''15 to 2.''5 separation, with magnitude differences up to Δm ≈ 6. We measure an overall nearby-star probability for Kepler planet candidates of 7.4% ± 1.0%, and calculate the effects of each detected nearby star on the Kepler-measured planetary radius. We discuss several Kepler Objects of Interest (KOIs) of particular interest, including KOI-191 and KOI-1151, which are both multi-planet systems with detected stellar companions whose unusual planetary system architecture might be best explained if they are 'coincident multiple' systems, with several transiting planets shared between the two stars. Finally, we find 98% confidence evidence that short-period giant planets are two to three times more likely than longer-period planets to be found in wide stellar binaries.

79 ASTRONOMY AND ASTROPHYSICS↗

Estimation of combinatoric background in seaquest using an event-mixing method

All experiments observing dilepton pairs (e.g. e + e -, μ + μ - ) must confront the existence of a combinatoricbackground caused by the combining of tracks not arising from the same physics vertex. Some method must be devised to calculate and remove this background. In this document we describe a particular event-mixing method relying on many of the unique aspects of the SeaQuest spectrometer and data. The method described here calculates the combinatoric background with correct normalization; i.e., there is no need to assign a floating normalization factor that is then determined in a subsequent fitting procedure. Numerous tests are applied to demonstrate the reliability of the method.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

GIXSGUI : a MATLAB toolbox for grazing-incidence X-ray scattering data visualization and reduction, and indexing of buried three-dimensional periodic nanostructured films

GIXSGUI is a MATLAB toolbox that offers both a graphical user interface and script-based access to visualize and process grazing-incidence X-ray scattering data from nanostructures on surfaces and in thin films. It provides routine surface scattering data reduction methods such as geometric correction, one-dimensional intensity linecut, two-dimensional intensity reshaping etc . Three-dimensional indexing is also implemented to determine the space group and lattice parameters of buried organized nanoscopic structures in supported thin films.

Jiang, Zhang↗

Uncertainty Propagation from Experiment Measurements to Modeling Approaches: A Case for SMR Steam Entrainment Testing

To license new and advanced reactor designs, regulators must be convinced that their unique safety cases—relative to existing large scale reactors—have been adequately addressed by the designed reactor protection systems. In water cooled small modular reactors (SMRs), droplet entrainment in steam flow has significant implications on the progression of accident scenarios due to its compact design features, which requires representative test data applicable to SMR designs. Computer code, modeling and simulation (M&S) tools and models require adequate verification, assessment, and qualification. This includes M&S results validation against scaled empirical data within allowable uncertainty bands to gain regulatory approvals during the various stages of reactor system design, demonstration, and commercialization. However, measurement uncertainty within the empirical datasets and test data applicability ranges requires careful consideration of M&S inputs (i.e., boundary conditions, and initial conditions), and verification and validation efforts. This study focuses on uncertainty quantification in designing scaled test facilities for SMR applications with appropriate measurements and a standard data-reduction method to estimate thermal hydraulics characteristics parameters that incorporate physics phenomena of interest. In addition, this study supports the evaluation model development and assessment process using M&S that interfaces with advanced computing tools and digital twin capabilities. This will allow synchronization between experiment and modeling approaches for droplet entrainment testing and analysis, improving diagnostics, prognostics, and decision-making to accelerate regulatory approval.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Analysis of Thermal and Chemical Effets on Negative Valve Overlap Period Energy Recovery for Low-Temperature Gasoline Combustion

A central challenge for efficient auto-ignition controlled low-temperature gasoline combustion (LTGC) engines has been achieving the combustion phasing needed to reach stable performance over a wide operating regime. The negative valve overlap (NVO) strategy has been explored as a way to improve combustion stability through a combination of charge heating and altered reactivity via a recompression stroke with a pilot fuel injection. The study objective was to analyze the thermal and chemical effects on NVO-period energy recovery. The analysis leveraged experimental gas sampling results obtained from a single-cylinder LTGC engine along with cylinder pressure measurements and custom data reduction methods used to estimate period thermodynamic properties. The engine was fueled by either iso-octane or ethanol, and operated under sweeps of NVO-period oxygen concentration, injection timing, and fueling rate. Gas sampling at the end of the NVO period was performed via a custom dump-valve apparatus, with detailed sample speciation by in-house gas chromatography. The balance of NVO-period input and output energy flows was calculated in terms of fuel energy, work, heat loss, and change in sensible energy. Experiment results were complemented by detailed chemistry single-zone reactor simulations performed at relevant mixing and thermodynamic conditions, with results used to evaluate ignition behavior and expected energy recovery yields. For the intermediate bulk-gas temperatures present during the NVO period (900-1100 K), weak negative temperature coefficient behavior with iso-octane fueling significantly lengthened ignition delays relative to similar ethanol fueled conditions. Faster ethanol ignition chemistry led to lower recovered fuel intermediate yields relative to similar iso-octane fueled conditions due to more complete fuel oxidation. From the energy analysis it was found that increased NVO-period global equivalence ratio, either from lower NVOperiod oxygen concentrations or higher fueling rates, in general led to a greater fraction of net recovered fuel energy and work as heat losses were minimized. These observations were supported by complementary single-zone reactor model results, which further indicated that kinetic time-scales favor chemical energy-consuming exothermic oxidation over slower endothermic reformation. Nonetheless, fuel energy recovery close to the thermodynamic equilibrium solution was achieved for baseline conditions that featured 4% NVO-period oxygen concentration.

ethanol↗

Reactor Containment Passive Safety Analysis: Steam Condensation in Presence of Non-condensable Gas Scaled Experiment and Modeling

This study presents steam condensation scaled experiments and semi-empirical models in presence of nitrogen (N)—a noncondensable gas (NCG), simulating air in the reactor containment—to support water-cooled small modular reactors (SMRs) passive containment cooling system (PCCS) design and analysis. Previous experimental studies on PCCS are focused on fixed and smaller tube (mostly 2-in.) geometries and specific test condition variations, bringing challenges with geometric scaling and mismatching with SMR prototypic design. To address these challenges, this study presents steam condensation test dataset obtained from three scaled test sections of 1-, 2-, and 4-in.-diameter steam condensers with an annular/jacket cooling of 2-, 3-, and 6 in.-diameter tubes, respectively. Test data were collected for steam ranges from 58 to 63 kg/hr., and NCG flow of 4.4 to 13.3 kg/hr. Annular cooling water flow was varied to obtain required testing conditions of saturated steam inlet and fully condensed outlet. Axial temperature test data of bulk cooling water, steam and condensate were collected by thermocouples for three test sections and various steam-NCG mixing/testing conditions. A standard data reduction method was adopted—utilizing iterative and nodalized mass and heat transfer calculation—to estimate axial local heat fluxes, heat transfer coefficients (HTCs), condensation rates, film thickness, and Nusselt number. Based on the obtained dataset semi-empirical model results—a ratio of experimental and Nusselt’s theoretical HTC are presented. Such results and findings are supportive of developing scaled-up testing facility, to enable model validations and accelerate next generation of reactors development and deployment

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Presentation: Reactor Containment Passive Safety Analysis: Steam Condensation in Presence of Non-condensable Gas Scaled Experiment and Modeling

This study presents steam condensation scaled experiments and semi-empirical models in presence of nitrogen--a noncondensable gas (NCG), simulating air in the reactor containment--to support water-cooled small modular reactors (SMRs) passive containment cooling system (PCCS) design and analysis. Previous experimental studies on PCCS are focused on fixed and smaller tube (mostly 2-in.) geometries and specific test condition variations, bringing challenges with geometric scaling and mismatching with SMR prototypic design. To address these challenges, this study presents steam condensation test dataset obtained from three scaled test sections of 1-, 2-, and 4-in.-diameter steam condensers with an annular/jacket cooling of 2-, 3-, and 6 in.-diameter tubes, respectively. Test data were collected for steam ranges from 58 to 63 kg/hr., and NCG flow of 4.4 to 13.3 kg/hr. Annular cooling water flow was varied to obtain required testing conditions of saturated steam inlet and fully condensed outlet. Axial temperature test data of bulk cooling water, steam and condensate were collected by thermocouples for three test sections and various steam-NCG mixing/testing conditions. A standard data reduction method was adopted--utilizing iterative and nodalized mass and heat transfer calculation to estimate axial local heat fluxes, heat transfer coefficients (HTCs), condensation rates, film thickness, and Nusselt number. Based on the obtained dataset semi-empirical model results--a ratio of experimental and Nusselt's theoretical HTC are presented. Such results and findings are supportive of developing scaled-up testing facility, to enable model validations and accelerate next generation of reactors development and deployment.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

The JCMT Transient Survey: Data Reduction and Calibration Methods

Though there has been a significant amount of work investigating the early stages of low-mass star formation in recent years, the evolution of the mass assembly rate onto the central protostar remains largely unconstrained. Examining in depth the variation in this rate is critical to understanding the physics of star formation. Instabilities in the outer and inner circumstellar disk can lead to episodic outbursts. Observing these brightness variations at infrared or submillimeter wavelengths constrains the current accretion models. The JCMT Transient Survey is a three-year project dedicated to studying the continuum variability of deeply embedded protostars in eight nearby star-forming regions at a one-month cadence. We use the SCUBA-2 instrument to simultaneously observe these regions at wavelengths of 450 and 850 μ m. In this paper, we present the data reduction techniques, image alignment procedures, and relative flux calibration methods for 850 μ m data. We compare the properties and locations of bright, compact emission sources fitted with Gaussians over time. Doing so, we achieve a spatial alignment of better than 1″ between the repeated observations and an uncertainty of 2%–3% in the relative peak brightness of significant, localized emission. This combination of imaging performance is unprecedented in ground-based, single-dish submillimeter observations. Finally, we identify a few sources that show possible and confirmed brightness variations. These sources will be closely monitored and presented in further detail in additional studies throughout the duration of the survey.

79 ASTRONOMY AND ASTROPHYSICS↗

Adaptive machine learning for time-varying systems: low dimensional latent space tuning

Machine learning (ML) tools such as encoder-decoder convolutional neural networks (CNN) can represent incredibly complex nonlinear functions which map between combinations of images and scalars. For example, CNNs can be used to map combinations of accelerator parameters and images which are 2D projections of the 6D phase space distributions of charged particle beams as they are transported between various particle accelerator locations. Despite their strengths, applying ML to time-varying systems, or systems with shifting distributions, is an open problem, especially for large systems for which collecting new data for re-training is impractical or interrupts operations. Particle accelerators are one example of large time-varying systems for which collecting detailed training data requires lengthy dedicated beam measurements which may no longer be available during regular operations. We present a novel method of adaptive ML for time-varying systems. Our approach is to map very high (N ≈ 100k) dimensional inputs (a combination of scalar parameters and images) into the low dimensional (N ≈ 2) latent space at the output of the encoder section of an encoder-decoder CNN. We then actively tune the low dimensional latent space-based representation of complex system dynamics by the addition of an adaptively tuned feedback vector directly before the decoder sections builds back up to our image-based high-dimensional phase space density representations. This method allows us to learn correlations within and to quickly tune the characteristics of incredibly large parameter space systems and to track their evolution in real time based on feedback without massive new data sets for re-training. We demonstrate that our method can accurately predict and track the phase space of charged particle beams at various locations in a particle accelerator by adaptively adjusting in real-time while the unknown input beam distribution of the accelerator is changing in shape, charge, and offset and while the RF system of the accelerator itself is also changing in an unpredictable way. For FACET-II we demonstrate that such an approach has the potential to use transverse deflecting cavity and energy spread spectrum beam measurements to accurately predict 2D projections of the 6D phase space of the electron beam at the plasma wakefield acceleration interaction point where such diagnostics are unavailable.

47 OTHER INSTRUMENTATION↗

Waveform processing using neural network algorithms on the front-end electronics

In a multi-channel radiation detector readout system, waveform sampling, digitization, and raw data transmission to the data acquisition system constitute a conventional processing chain. The deposited energy on the sensor is estimated by extracting peak amplitudes, area under pulse envelopes from the raw data, and starting times of signals or time of arrivals. However, such quantities can be estimated using machine learning algorithms on the front-end Application-Specific Integrated Circuits (ASICs), often termed as “edge computing”. Edge computation offers enormous benefits, especially when the analytical forms are not fully known or the registered waveform suffers from noise and imperfections of practical implementations. In this work, we aim to predict peak amplitude from a single waveform snippet whose rising and falling edges containing only 3 to 4 samples. We thoroughly studied two well-accepted neural network algorithms, Multi-Layer Perceptron (MLP) and Convolutional Neural Network (CNN) by varying their model sizes. Further, to better fit front-end electronics, neural network model reduction techniques, such as network pruning methods and variable-bit quantization approaches, were also studied. By combining pruning and quantization, our best performing model has the size of 1.5 KB, reduced from 16.6 KB of its full model counterpart. It can reach mean absolute error of 0.034 comparing to that of a naive baseline of 0.135. Such parameter-efficient and predictive neural network models established feasibility and practicality of their deployment on front-end ASICs.

47 OTHER INSTRUMENTATION↗

Two-stage Framework for Visualization of Clustered High Dimensional Data

In this paper, we discuss 2D visualization methods of high dimensional representation of the data that are clustered and their associated label information is available. We propose a two-stage framework for visualization of such data based on dimension reduction methods. In the first stage, we obtain the reduced dimensional data by a supervised dimension reduction method such as linear discriminant analysis that preserves the original cluster structure in terms of its criterion. The resulting optimal reduced dimension depends on the optimization criteria and is often larger than 2. In the second stage, in order to further reduce the dimension to 2 for visualization purposes, we apply another dimension reduction method such as principal component analysis that minimizes the distortion in the lower dimensional representation of the data obtained in the first stage. Using this framework, we propose several two-stage methods, and present their theoretical characteristics as well as experimental comparisons on both artificial and real-world text data sets.

97 MATHEMATICS AND COMPUTING↗

Beyond PCA: Additional Dimension Reduction Techniques to Consider in the Development of Climate Fingerprints

Abstract Dimension reduction techniques are an essential part of the climate analyst’s toolkit. Due to the enormous scale of climate data, dimension reduction methods are used to identify major patterns of variability within climate dynamics, to create compelling and informative visualizations, and to quantify major named modes such as El Niño–Southern Oscillation. Principal components analysis (PCA), also known as the method of empirical orthogonal functions (EOFs), is the most commonly used form of dimension reduction, characterized by a remarkable confluence of attractive mathematical, statistical, and computational properties. Despite its ubiquity, PCA suffers from several difficulties relevant to climate science: high computational burden with large datasets, decreased statistical accuracy in high dimensions, and difficulties comparing across multiple datasets. In this paper, we introduce several variants of PCA that are likely to be of use in climate sciences and address these problems. Specifically, we introduce non-negative , sparse , and tensor PCA and demonstrate how each approach provides superior pattern recognition in climate data. We also discuss approaches to comparing PCA-family results within and across datasets in a domain-relevant manner. We demonstrate these approaches through an analysis of several runs of the E3SM climate model from 1991 to 1995, focusing on the simulated response to the Mt. Pinatubo eruption; our findings are consistent with a recently identified stratospheric warming fingerprint associated with this type of stratospheric aerosol injection.

Weylandt, Michael↗