Search NASA⌕ Search

SEARCH · Search NASA

Results for “Data reduction methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 361 records · Page 20

waveSZ: A Hardware-Algorithm Co-Design of Efficient Lossy Compression for Scientific Data

Error-bounded lossy compression is critical to the success of extreme-scale scientific research because of ever-increasing volumes of data produced by today's high-performance computing (HPC) applications. Not only can error-controlled lossy compressors significantly reduce the I/O and storage burden but they can retain high data fidelity for post analysis. Existing state-of-the-art lossy compressors, however, generally suffer from relatively low compression and decompression throughput (up to hundreds of megabytes per second on a single CPU core), which considerably restrict the adoption of lossy compression by many HPC applications especially those with a fairly high data production rate. In this paper, we propose a highly efficient lossy compression approach based on field programmable gate arrays (FPGAs) under the state-of-the-art lossy compression model SZ. Our contributions are fourfold. (1) We adopt a wavefront memory layout to alleviate the data dependency during the prediction for higher-dimensional predictors, such as the Lorenzo predictor. (2) We propose a co-design framework named WAVESZ based on the wavefront memory layout and the characteristics of SZ algorithm and carefully implement it by using high-level synthesis. (3) We propose a hardware-algorithm co-optimization method to improve the performance. (4) We evaluate our proposed WAVESZ on three real-world HPC simulation datasets from the Scientific Data Reduction Benchmarks and compare it with other state-of-the-art methods on both CPUs and FPGAs. Experiments show that our WAVESZ can improve SZ's compression throughput by 6.9x similar to 8.7x over the production version running on a state-of-the-art CPU and improve the compression ratio and throughput by 2.1x and 5.8x on average, respectively, respectively, compared with the state-of-the-art FPGA design.

Compression Ratio↗

Comparative analysis of nonlinear dimensionality reduction techniques for breast MRI segmentation

Purpose: Visualization of anatomical structures using radiological imaging methods is an important tool in medicine to differentiate normal from pathological tissue and can generate large amounts of data for a radiologist to read. Integrating these large data sets is difficult and time-consuming. A new approach uses both supervised and unsupervised advanced machine learning techniques to visualize and segment radiological data. This study describes the application of a novel hybrid scheme, based on combining wavelet transform and nonlinear dimensionality reduction (NLDR) methods, to breast magnetic resonance imaging (MRI) data using three well-established NLDR techniques, namely, ISOMAP, local linear embedding (LLE), and diffusion maps (DfM), to perform a comparative performance analysis. Methods: Twenty-five breast lesion subjects were scanned using a 3T scanner. MRI sequences used were T1-weighted, T2-weighted, diffusion-weighted imaging (DWI), and dynamic contrast-enhanced (DCE) imaging. The hybrid scheme consisted of two steps: preprocessing and postprocessing of the data. The preprocessing step was applied for B{sub 1} inhomogeneity correction, image registration, and wavelet-based image compression to match and denoise the data. In the postprocessing step, MRI parameters were considered data dimensions and the NLDR-based hybrid approach was applied to integrate the MRI parameters into a single image, termed the embedded image. This was achieved by mapping all pixel intensities from the higher dimension to a lower dimensional (embedded) space. For validation, the authors compared the hybrid NLDR with linear methods of principal component analysis (PCA) and multidimensional scaling (MDS) using synthetic data. For the clinical application, the authors used breast MRI data, comparison was performed using the postcontrast DCE MRI image and evaluating the congruence of the segmented lesions. Results: The NLDR-based hybrid approach was able to define and segment both synthetic and clinical data. In the synthetic data, the authors demonstrated the performance of the NLDR method compared with conventional linear DR methods. The NLDR approach enabled successful segmentation of the structures, whereas, in most cases, PCA and MDS failed. The NLDR approach was able to segment different breast tissue types with a high accuracy and the embedded image of the breast MRI data demonstrated fuzzy boundaries between the different types of breast tissue, i.e., fatty, glandular, and tissue with lesions (>86%). Conclusions: The proposed hybrid NLDR methods were able to segment clinical breast data with a high accuracy and construct an embedded image that visualized the contribution of different radiological parameters.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Generation of hybrid sinograms for the recovery of kV-CT images with metal artifacts for helical tomotherapy

Purpose: The overall goal of this study is to restore kilovoltage computed tomography (kV-CT) images which are disfigured by patients’ metal prostheses. By generating a hybrid sinogram that is a combination of kV and megavoltage (MV) projection data, the authors suggest a novel metal artifact-reduction (MAR) method that retains the image quality to match that of kV-CT and simultaneously restores the information of metal prostheses lost due to photon starvation. Methods: CT projection data contain information about attenuation coefficients and the total length of the attenuation. By normalizing raw kV projections with their own total lengths of attenuation, mean attenuation projections were obtained. In the same manner, mean density projections of MV-CT were obtained by the normalization of MV projections resulting from the forward projection of density-calibrated MV-CT images with the geometric parameters of the kV-CT device. To generate the hybrid sinogram, metal-affected signals of the kV sinogram were identified and replaced by the corresponding signals of the MV sinogram following a density calibration step with kV data. Filtered backprojection was implemented to reconstruct the hybrid CT image. To validate the authors’ approach, they simulated four different scenarios for three heads and one pelvis using metallic rod inserts within a cylindrical phantom. Five inserts describing human body elements were also included in the phantom. The authors compared the image qualities among the kV, MV, and hybrid CT images by measuring the contrast-to-noise ratio (CNR), the signal-to-noise ratio (SNR), the densities of all inserts, and the spatial resolution. In addition, the MAR performance was compared among three existing MAR methods and the authors’ hybrid method. Finally, for clinical trials, the authors produced hybrid images of three patients having dental metal prostheses to compare their MAR performances with those of the kV, MV, and three existing MAR methods. Results: The authors compared the image quality and MAR performance of the hybrid method with those of other imaging modalities and the three MAR methods, respectively. The total measured mean of the CNR (SNR) values for the nonmetal inserts was determined to be 14.3 (35.3), 15.3 (37.8), and 25.5 (64.3) for the kV, MV, and hybrid images, respectively, and the spatial resolutions of the hybrid images were similar to those of the kV images. The measured densities of the metal and nonmetal inserts in the hybrid images were in good agreement with their true densities, except in cases of extremely low densities, such as air and lung. Using the hybrid method, major streak artifacts were suitably removed and no secondary artifacts were introduced in the resultant image. In clinical trials, the authors verified that kV and MV projections were successfully combined and turned into the resultant hybrid image with high image contrast, accurate metal information, and few metal artifacts. The hybrid method also outperformed the three existing MAR methods with regard to metal information restoration and secondary artifact prevention. Conclusions: The authors have shown that the hybrid method can restore the overall image quality of kV-CT disfigured by severe metal artifacts and restore the information of metal prostheses lost due to photon starvation. The hybrid images may allow for the improved delineation of structures of interest and accurate dose calculations for radiation treatment planning for patients with metal prostheses.

60 APPLIED LIFE SCIENCES↗

An iterative bidirectional gradient boosting approach for CVR baseline estimation

Here this paper presents a novel Iterative Bidirectional Gradient Boosting Model (IBi-GBM) for estimating the baseline of Conservation Voltage Reduction (CVR) programs. In contrast to many existing methods, we treat CVR baseline estimation as a missing data retrieval problem. The approach involves dividing the load and its corresponding temperature profiles into three periods: pre-CVR, CVR, and post-CVR. To restore the missing load profile during the CVR period, the method employs a three-step process. First, a forward-pass GBM is executed using data from the pre-CVR period as inputs. Subsequently, a backward-pass GBM is applied using data from the post-CVR period. The two restored load profiles are reconciled, considering pre-calculated weights derived from forecasting accuracy, and only the leftmost and rightmost points are retained. The newly restored points are then included as inputs for the subsequent iteration. This iterative procedure continues until the original load data in the CVR period is fully restored. We develop IBi-GBM using actual smart meter and Supervisory Control and Data Acquisition (SCADA) data. Our results demonstrate that IBi-GBM exhibits robust performance across various data resolutions and in different seasons and outperforms existing methods by achieving a 1-2% reduction in normalized Root Mean Square Error (nRMSE).

42 ENGINEERING↗

NICMOS Spectroscopy of HD 189733b

Spectral features corresponding to methane and water opacity were reported based on transmission spectroscopy of HD 189733b with Hubble/NICMOS. Recently, these data, and a similar data set for XO-1b, have been reexamined in Gibson et al. 2010, who claim they cannot reliably reproduce prior results. We examine the methods used by the Gibson team and identify two specific issues that could act to increase the formal uncertainties and to create instability in the minimization process. This would also be consistent with the GPA10 finding that they could not identify a way to select among the several instrument models they constructed. In the case of XO-1b, the Gibson team significantly changed the way in which the instrument model is defined (both with respect to the three approaches they used for HD 189733b, and the approach used by previous authors); this change, which omits the effect of the spectrum position on the detector, makes direct intercomparison of results difficult. In the experience of our group, the position of the spectrum on the detector is an important element of the instrument model because of the significant residual structure in the NICMOS spectral flat field. The approach of changing instrument models significantly complicates understanding the data reduction process and interpreting the results. Our team favors establishing a consistent method of handling NICMOS instrument systematic errors and applying it uniformly to data sets.

infrared↗

On the Scalability of Data Reduction Techniques in Current and Upcoming HPC Systems from an Application Perspective

We implement and benchmark parallel I/O methods for the fully-manycore driven particle-in-cell code PIConGPU. Identifying throughput and overall I/O size as a major challenge for applications on today’s and future HPC systems, we present a scaling law characterizing performance bottlenecks in state-of-the-art approaches for data reduction. Consequently, we propose, implement and verify multi-threaded data-transformations for the I/O library ADIOS as a feasible way to trade underutilized host-side compute potential on heterogeneous systems for reduced I/O latency.

Huebl, Axel↗

An efficient algorithm using matrix methods to solve wind tunnel force-balance equations

An iterative procedure applying matrix methods to accomplish an efficient algorithm for automatic computer reduction of wind-tunnel force-balance data has been developed. Balance equations are expressed in a matrix form that is convenient for storing balance sensitivities and interaction coefficient values for online or offline batch data reduction. The convergence of the iterative values to a unique solution of this system of equations is investigated, and it is shown that for balances which satisfy the criteria discussed, this type of solution does occur. Methods for making sensitivity adjustments and initial load effect considerations in wind-tunnel applications are also discussed, and the logic for determining the convergence accuracy limits for the iterative solution is given. This more efficient data reduction program is compared with the technique presently in use at the NASA Langley Research Center, and computational times on the order of one-third or less are demonstrated by use of this new program.

Smith, D. L.↗

Radiation dose reduction in medical x-ray CT via Fourier-based iterative reconstruction

Purpose: A Fourier-based iterative reconstruction technique, termed Equally Sloped Tomography (EST), is developed in conjunction with advanced mathematical regularization to investigate radiation dose reduction in x-ray CT. The method is experimentally implemented on fan-beam CT and evaluated as a function of imaging dose on a series of image quality phantoms and anonymous pediatric patient data sets. Numerical simulation experiments are also performed to explore the extension of EST to helical cone-beam geometry. Methods: EST is a Fourier based iterative algorithm, which iterates back and forth between real and Fourier space utilizing the algebraically exact pseudopolar fast Fourier transform (PPFFT). In each iteration, physical constraints and mathematical regularization are applied in real space, while the measured data are enforced in Fourier space. The algorithm is automatically terminated when a proposed termination criterion is met. Experimentally, fan-beam projections were acquired by the Siemens z-flying focal spot technology, and subsequently interleaved and rebinned to a pseudopolar grid. Image quality phantoms were scanned at systematically varied mAs settings, reconstructed by EST and conventional reconstruction methods such as filtered back projection (FBP), and quantified using metrics including resolution, signal-to-noise ratios (SNRs), and contrast-to-noise ratios (CNRs). Pediatric data sets were reconstructed at their original acquisition settings and additionally simulated to lower dose settings for comparison and evaluation of the potential for radiation dose reduction. Numerical experiments were conducted to quantify EST and other iterative methods in terms of image quality and computation time. The extension of EST to helical cone-beam CT was implemented by using the advanced single-slice rebinning (ASSR) method. Results: Based on the phantom and pediatric patient fan-beam CT data, it is demonstrated that EST reconstructions with the lowest scanner flux setting of 39 mAs produce comparable image quality, resolution, and contrast relative to FBP with the 140 mAs flux setting. Compared to the algebraic reconstruction technique and the expectation maximization statistical reconstruction algorithm, a significant reduction in computation time is achieved with EST. Finally, numerical experiments on helical cone-beam CT data suggest that the combination of EST and ASSR produces reconstructions with higher image quality and lower noise than the Feldkamp Davis and Kress (FDK) method and the conventional ASSR approach. Conclusions: A Fourier-based iterative method has been applied to the reconstruction of fan-bean CT data with reduced x-ray fluence. This method incorporates advantageous features in both real and Fourier space iterative schemes: using a fast and algebraically exact method to calculate forward projection, enforcing the measured data in Fourier space, and applying physical constraints and flexible regularization in real space. Our results suggest that EST can be utilized for radiation dose reduction in x-ray CT via the readily implementable technique of lowering mAs settings. Numerical experiments further indicate that EST requires less computation time than several other iterative algorithms and can, in principle, be extended to helical cone-beam geometry in combination with the ASSR method.

60 APPLIED LIFE SCIENCES↗

Fostering Better Collaboration in Software Development Cycles Between Scientists and Programmers to Ensure the Integrity of and Promote the Development of New Scientific Data Products.

Misaligned incentives lead to reduced interaction between scientists and programmers on modern NASA science data-product development teams. Typically, situations arise where the scientist is not incentivized to learn modern coding practices and the programmer does not understand the science algorithms in the code. A programmer is responsible for the deliverable code thus setting a tradeoff between the desire for code improvement versus fear of compromising the integrity of data-product while the scientist continues to rely on their legacy codebases owing to the complexity of using the delivered code outside the processing environment and lack of validation modules. The NASA/CERES-TISA project has adopted a collaborative approach, with scientists and programmers both utilizing the same software repository with multiple branches, some optimized for delivery to a processing datacenter and others for scientific product development and validation. A team of scientists and programmers jointly review any new science code updates for integration into the codebase and strive to improve practices through promoting algorithm understanding, better institutional knowledge exchange and documentation, modularization, and developing data processing flow-dictated validation and debugging methods. This leads to a reduction in the personnel single point failures and reduced development time for creation of new science data-products.

CERES↗

Hierarchical optimization for neutron scattering problems

We present a scalable optimization method for neutron scattering problems that determines confidence regions of simulation parameters in lattice dynamics models used to fit neutron scattering data for crystalline solids. The method uses physics-based hierarchical dimension reduction in both the computational simulation domain and the parameter space. We demonstrate for silicon that after a few iterations the method converges to parameters values (interatomic force-constants) computed with density functional theory simulations.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Precision Asteroid Astrometry

Among the methods used to guide spacecraft to their destinations, Optical Navigation (OpNav) remains an effective option. OpNav makes use of star fields and small body ephemerides to precisely locate spacecraft. To facilitate accurate OpNav, the small body ephemerides must be constantly updated; asteroid orbits accumulate errors each year of a few milliarcseconds. Through extended exposures, taken with strategic offsets, a least-squares solution can be found that determines updated ephemeris data. This updated data can also be used by occultation astronomers to gain further information about the small bodies, including their size and shape. Using the 24-inch telescope at the Caltech Table Mountain Observatory (TMO), we capture two or more 180 second exposures of each target. These images, combined with a file for the predicted background star field and two reference files, are then processed through a series of scripts and programs. Starting with a prediction file and two to five exposures of the asteroid, the data is processed. This original data is about 32MB per observation. Once the data are reduced to only Right Ascension and Declination for each target, the data are ready for delivery. This consists of text only, and for each target takes about 80 bytes; this resulting data reduction is about five orders of magnitude. This method produces observed positions that are refined by about 12 milliarcseconds, a refinement that is accomplished almost nowhere else. The occultation observations that are facilitated by the ephemerides being refined also produce results that are not possible in any other way from ground-based observations.

Dial, Jason↗

Boosting efficiency and reducing graph reliance: Basis adaptation integration in Bayesian multi-fidelity networks

The computational cost of high-fidelity numerical models makes outer-loop analysis, which requires repeated interrogation of the model such as uncertainty quantification, computationally demanding. Multi-fidelity methods, which construct a surrogate model using data from an ensemble of models of varying cost and accuracy, can substantially reduce the cost of outer-loop analysis. However, these methods can be difficult to apply when the model ensemble does not admit a clear hierarchy a priori and the correlations between models are low. Consequently, in this paper, we present a multi-fidelity method that leverages dimension reduction to enhance the correlation between models, thereby reducing the amount of data needed to train a surrogate from an unordered ensemble of models. Our method utilizes basis adaptation to build low-dimensional polynomial chaos expansions of each model and employs Multi-fidelity Networks to encode the relationships among models. We show that the resulting method exhibit two notable advantages over its counterpart: (1) enhanced accuracy (both reduced bias and variance); and (2) reduced dependency on the graph structure encoding relationships among models. We demonstrate the approach on an analytical test problem and a challenging finite element model for a spent nuclear fuel. Our method produces a surrogate model that is significantly more accurate than either a single-fidelity surrogate or a multi-fidelity surrogate constructed without basis adaptation.

42 ENGINEERING↗

Advanced data analysis in inertial confinement fusion and high energy density physics

Bayesian analysis enables flexible and rigorous definition of statistical model assumptions with well-characterized propagation of uncertainties and resulting inferences for single-shot, repeated, or even cross-platform data. This approach has a strong history of application to a variety of problems in physical sciences ranging from inference of particle mass from multi-source high-energy particle data to analysis of black-hole characteristics from gravitational wave observations. The recent adoption of Bayesian statistics for analysis and design of high-energy density physics (HEDP) and inertial confinement fusion (ICF) experiments has provided invaluable gains in expert understanding and experiment performance. In this Review, we discuss the basic theory and practical application of the Bayesian statistics framework. We highlight a variety of studies from the HEDP and ICF literature, demonstrating the power of this technique. Due to the computational complexity of multi-physics models needed to analyze HEDP and ICF experiments, Bayesian inference is often not computationally tractable. Two sections are devoted to a review of statistical approximations, efficient inference algorithms, and data-driven methods, such as deep-learning and dimensionality reduction, which play a significant role in enabling use of the Bayesian framework. We provide additional discussion of various applications of Bayesian and machine learning methods that appear to be sparse in the HEDP and ICF literature constituting possible next steps for the community. We conclude by highlighting community needs, the resolution of which will improve trust in data-driven methods that have proven critical for accelerating the design and discovery cycle in many application areas.

47 OTHER INSTRUMENTATION↗

A highly accurate method for the determination of mass and center of mass of a spacecraft

An extremely accurate method for the measurement of mass and the lateral center of mass of a spacecraft has been developed. The method was needed for the Voyager spacecraft mission requirement which limited the uncertainty in the knowledge of lateral center of mass of the spacecraft system weighing 750 kg to be less than 1.0 mm (0.04 in.). The method consists of using three load cells symmetrically located at 120 deg apart on a turntable with respect to the vertical axis of the spacecraft and making six measurements for each load cell. These six measurements are taken by cyclic rotations of the load cell turntable and of the spacecraft, about the vertical axis of the measurement fixture. This method eliminates all alignment, leveling, and load cell calibration errors for the lateral center of mass determination, and permits a statistical best fit of the measurement data. An associated data reduction computer program called MASCM has been written to implement this method and has been used for the Voyager spacecraft.

Chow, E. Y.↗

Reduction and Analysis of Phosphor Thermography Data With the IHEAT Software Package

Detailed aeroheating information is critical to the successful design of a thermal protection system (TPS) for an aerospace vehicle. This report describes NASA Langley Research Center's (LaRC) two-color relative-intensity phosphor thermography method and the IHEAT software package which is used for the efficient data reduction and analysis of the phosphor image data. Development of theory is provided for a new weighted two-color relative-intensity fluorescence theory for quantitatively determining surface temperatures on hypersonic wind tunnel models; an improved application of the one-dimensional conduction theory for use in determining global heating mappings; and extrapolation of wind tunnel data to flight surface temperatures. The phosphor methodology at LaRC is presented including descriptions of phosphor model fabrication, test facilities and phosphor video acquisition systems. A discussion of the calibration procedures, data reduction and data analysis is given. Estimates of the total uncertainties (with a 95% confidence level) associated with the phosphor technique are shown to be approximately 8 to 10 percent in the Langley's 31-Inch Mach 10 Tunnel and 7 to 10 percent in the 20-Inch Mach 6 Tunnel. A comparison with thin-film measurements using two-inch radius hemispheres shows the phosphor data to be within 7 percent of thin-film measurements and to agree even better with predictions via a LATCH computational fluid dynamics solution (CFD). Good agreement between phosphor data and LAURA CFD computations on the forebody of a vertical takeoff/vertical lander configuration at four angles of attack is also shown. In addition, a comparison is given between Mach 6 phosphor data and laminar and turbulent solutions generated using the LAURA, GASP and LATCH CFD codes. Finally, the extrapolation method developed in this report is applied to the X-34 configuration with good agreement between the phosphor extrapolation and LAURA flight surface temperature predictions. The phosphor process outlined in the paper is believed to provide the aerothermodynamic community with a valuable capability for rapidly obtaining (4 to 5 weeks) detailed heating information needed in TPS design.

Merski, N. Ronald↗

A Rapid Aerodynamic Design Procedure Based on Artificial Neural Networks

An aerodynamic design procedure that uses neural networks to model the functional behavior of the objective function in design space has been developed. This method incorporates several improvements to an earlier method that employed a strategy called parameter-based partitioning of the design space in order to reduce the computational costs associated with design optimization. As with the earlier method, the current method uses a sequence of response surfaces to traverse the design space in search of the optimal solution. The new method yields significant reductions in computational costs by using composite response surfaces with better generalization capabilities and by exploiting synergies between the optimization method and the simulation codes used to generate the training data. These reductions in design optimization costs are demonstrated for a turbine airfoil design study where a generic shape is evolved into an optimal airfoil.

Rai, Man Mohan↗

EXOPLANETS FROM THE ARCTIC: THE FIRST WIDE-FIELD SURVEY AT 80 Degree-Sign N

Located within 10 Degree-Sign of the North Pole, northern Ellesmere Island offers continuous darkness in the winter months. This capability can greatly enhance the detection efficiency of planetary transit surveys and other time domain astronomy programs. We deployed two wide-field cameras at 80 Degree-Sign N, near Eureka, Nunavut, for a 152 hr observing campaign in 2012 February. The 16 megapixel camera systems were based on commercial f/1.2 lenses with 70 mm and 42 mm apertures, and they continuously imaged 504 and 1295 deg{sup 2}, respectively. In total, the cameras took over 44,000 images and produced better than 1% precision light curves for approximately 10,000 stars. We describe a new high-speed astrometric and photometric data reduction pipeline designed for the systems, test several methods for the precision flat fielding of images from very-wide-angle cameras, and evaluate the cameras' image qualities. We achieved a scintillation-limited photometric precision of 1%-2% in each 10 s exposure. Binning the short exposures into 10 minute chunks provided a photometric stability of 2-3 mmag, sufficient for the detection of transiting exoplanets around the bright stars targeted by our survey. We estimate that the cameras, when operated over the full Arctic winter, will be capable of discovering several transiting exoplanets around bright (m{sub V} < 9.5) stars.

79 ASTRONOMY AND ASTROPHYSICS↗