SEARCH · Search NASA

Results for “high dimensional data analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

All sources NASA NTRS DOE OSTI

NASA NTRS1998

Analysis of Information Content in High-Spectral Resolution Sounders using Subset Selection Analysis

In this paper, we summarize the results of the sensitivity analysis and data reduction carried out to determine the information content of AIRS and IASI channels. The analysis and data reduction was based on the use of subset selection techniques developed in the linear algebra and statistical community to study linear dependencies in high dimensional data sets. We applied the subset selection method to study dependency among channels by studying the dependency among their weighting functions. Also, we applied the technique to study the information provided by the different levels in which the atmosphere is discretized for retrievals and analysis. Results from the method correlate well with intuition in many respects and point out to possible modifications for band selection in sensor design and number and location of levels in the analysis process.

Velez-Reyes, Miguel↗

DOE OSTI2025

Simulating Continuum-based Redshift Measurement in the Roman’s High Latitude Spectroscopic Survey

We investigate the capability of the Nancy Grace Roman Space Telescope’s (Roman) Wide-Field Instrument G150 slitless grism to detect red, quiescent galaxies based on the current reference survey. We simulate dispersed images for Roman reference High-Latitude Spectroscopic Survey (HLSS) and analyze two-dimensional spectroscopic data using the grism Redshift and Line Analysis (Grizli) software. This study focus on assessing Roman grism’s capability for continuum-level redshift measurement for a redshift range of 0.5 ≤ z ≤ 2.5. The redshift recovery is assessed by setting three requirements of: σ z = $\frac{|z–z_{true}|}{1+z}$ ≤ 0.01, signal-to-noise ratio≥ 5 and the presence of a single dominant peak in redshift likelihood function. We find that, for quiescent galaxies, the reference HLSS can reach a redshift recovery completeness of ≥50% for F158 magnitude brighter than 20.2 mag. We also explore how different survey parameters, such as exposure time and the number of exposures, influence the accuracy and completeness of redshift recovery, providing insights that could optimize future survey strategies and enhance the scientific yield of the Roman in cosmological research.

Astronomical simulations↗

NASA NTRS1979

Calculation of the three-dimensional flow field in supersonic inlets at angle of attack using a bicharacteristic method with discrete shock wave fitting

An analysis is presented for calculating the flow field in supersonic mixed-compression aircraft inlets operating at angle of attack. The flow field is computed by a steady three-dimensional bicharacteristic method. The bow shock wave and the reflected internal shock wave system are computed by a three-dimensional discrete shock wave fitting procedure. Viscous and thermal diffusion may be included as source terms in the bicharacteristic method. A production type computer program capable of determining the flow field in a variety of axisymmetric mixed-compression supersonic inlets is available. The results of the present analysis agree well with those produced by the two-dimensional method of characteristics when axisymmetric flow fields are computed. For three-dimensional flow fields, the results of the present analysis agree well with experimental data except in regions of high viscous interaction and boundary layer removal. The present analysis does not compute the boundary layer, nor does it account for boundary layer bleed.

Vadyak, J.↗

NASA NTRS2013

Scalable Adaptive Graphics Environment (SAGE) Software for the Visualization of Large Data Sets on a Video Wall

The use of collaborative scientific visualization systems for the analysis, visualization, and sharing of "big data" available from new high resolution remote sensing satellite sensors or four‐dimensional numerical model simulations is propelling the wider adoption of ultra‐resolution tiled display walls interconnected by high speed networks. These systems require a globally connected and well‐integrated operating environment that provides persistent visualization and collaboration services. This abstract and subsequent presentation describes a new collaborative visualization system installed for NASA's Shortterm Prediction Research and Transition (SPoRT) program at Marshall Space Flight Center and its use for Earth science applications. The system consists of a 3 x 4 array of 1920 x 1080 pixel thin bezel video monitors mounted on a wall in a scientific collaboration lab. The monitors are physically and virtually integrated into a 14' x 7' for video display. The display of scientific data on the video wall is controlled by a single Alienware Aurora PC with a 2nd Generation Intel Core 4.1 GHz processor, 32 GB memory, and an AMD Fire Pro W600 video card with 6 mini display port connections. Six mini display‐to‐dual DVI cables are used to connect the 12 individual video monitors. The open source Scalable Adaptive Graphics Environment (SAGE) windowing and media control framework, running on top of the Ubuntu 12 Linux operating system, allows several users to simultaneously control the display and storage of high resolution still and moving graphics in a variety of formats, on tiled display walls of any size. The Ubuntu operating system supports the open source Scalable Adaptive Graphics Environment (SAGE) software which provides a common environment, or framework, enabling its users to access, display and share a variety of data‐intensive information. This information can be digital‐cinema animations, high‐resolution images, high‐definition video‐teleconferences, presentation slides, documents, spreadsheets or laptop screens. SAGE is cross‐platform, community‐driven, open‐source visualization and collaboration middleware that utilizes shared national and international cyberinfrastructure for the advancement of scientific research and education.

Jedlovec, Gary↗

DOE OSTI2024

Data-Efficient Dimensionality Reduction and Surrogate Modeling of High-Dimensional Stress Fields

Tensor datatypes representing field variables like stress, displacement, velocity, etc., have increasingly become a common occurrence in data-driven modeling and analysis of simulations. Numerous methods [such as convolutional neural networks (CNNs)] exist to address the meta-modeling of field data from simulations. As the complexity of the simulation increases, so does the cost of acquisition, leading to limited data scenarios. Modeling of tensor datatypes under limited data scenarios remains a hindrance for engineering applications. Here, in this article, we introduce a direct image-to-image modeling framework of convolutional autoencoders enhanced by information bottleneck loss function to tackle the tensor data types with limited data. The information bottleneck method penalizes the nuisance information in the latent space while maximizing relevant information making it robust for limited data scenarios. The entire neural network framework is further combined with robust hyperparameter optimization. We perform numerical studies to compare the predictive performance of the proposed method with a dimensionality reduction-based surrogate modeling framework on a representative linear elastic ellipsoidal void problem with uniaxial loading. The data structure focuses on the low-data regime (fewer than 100 data points) and includes the parameterized geometry of the ellipsoidal void as the input and the predicted stress field as the output. The results of the numerical studies show that the information bottleneck approach yields improved overall accuracy and more precise prediction of the extremes of the stress field. Additionally, an in-depth analysis is carried out to elucidate the information compression behavior of the proposed framework.

artificial intelligence↗

NASA NTRS1998

Efficient Methods to Assimilate Satellite Retrievals Based on Information Content: Suboptimal Retrieval Assimilation - Part 2

One of the outstanding problems in data assimilation has been and continues to be how best to utilize satellite data while balancing the tradeoff between accuracy and computational cost. A number of weather prediction centers have recently achieved remarkable success in improving their forecast skill by changing the method by which satellite data are assimilated into the forecast model from the traditional approach of assimilating retrievals to the direct assimilation of radiances in a variational framework. The operational implementation of such a substantial change in methodology involves a great number of technical details, e.g., pertaining to quality control procedures, systematic error correction techniques, and tuning of the statistical parameters in the analysis algorithm. Although there are clear theoretical advantages to the direct radiance assimilation approach, it is not obvious at all to what extent the improvements that have been obtained so far can be attributed to the change in methodology, or to various technical aspects of the implementation. The issue is of interest because retrieval assimilation retains many practical and logistical advantages which may become even more significant in the near future when increasingly high-volume data sources become available. The central question we address here is: how much improvement can we expect from assimilating radiances rather than retrievals, all other things being equal? We compare the two approaches in a simplified one-dimensional theoretical framework, in which problems related to quality control and systematic error correction are conveniently absent. By assuming a perfect radiative transfer model and perfect knowledge of radiance and background error covariances, we are able to formulate a nonlinear local error analysis for each assimilation method. Direct radiance assimilation is optimal in this idealized context, while the traditional method of assimilating retrievals is suboptimal because it ignores the cross-covariances between background errors and retrieval errors. We show that interactive retrieval assimilation (where the same background used for assimilation is also used in the retrieval step) is equivalent to direct assimilation of radiances with suboptimal analysis weights. We illustrate and extend these theoretical arguments with several one-dimensional assimilation experiments, where we estimate vertical atmospheric profiles using simulated data from both the High-resolution InfraRed Sounder 2 (HIRS2) and the future Atmospheric InfraRed Sounder (AIRS).

Joiner, J.↗

NASA NTRS2004

Predictions for the Effects of Free Stream Turbulence on Turbine Blade Heat Transfer

An approach to predicting the effects of free stream turbulence on turbine vane and blade heat transfer is described. Four models for predicting the effects of free stream turbulence were in incorporated into a Navier-Stokes CFD analysis. Predictions were compared with experimental data in order to identify an appropriate model for use across a wide range of flow conditions. The analyses were compared with data from five vane geometries and from four rotor geometries. Each of these nine geometries had data for different Reynolds numbers. Comparisons were made for twenty four cases. Steady state calculations were done because all experimental data were obtained in steady state tests. High turbulence levels often result in suction surface transition upstream of the throat, while at low to moderate Reynolds numbers the pressure surface remains laminar. A two-dimensional analysis was used because the flow is predominately two-dimensional in the regions where free stream turbulence significantly augments surface heat transfer. Because the evaluation of models for predicting turbulence effects can be affected by other factors, the paper discusses modeling for transition, relaminarization, and near wall damping. Quantitative comparisons are given between the predictions and data.

Boyle, Robert J.↗

NASA NTRS2013

Analyzing Tropical Waves Using the Parallel Ensemble Empirical Model Decomposition Method: Preliminary Results from Hurricane Sandy

In this study, we discuss the performance of the parallel ensemble empirical mode decomposition (EMD) in the analysis of tropical waves that are associated with tropical cyclone (TC) formation. To efficiently analyze high-resolution, global, multiple-dimensional data sets, we first implement multilevel parallelism into the ensemble EMD (EEMD) and obtain a parallel speedup of 720 using 200 eight-core processors. We then apply the parallel EEMD (PEEMD) to extract the intrinsic mode functions (IMFs) from preselected data sets that represent (1) idealized tropical waves and (2) large-scale environmental flows associated with Hurricane Sandy (2012). Results indicate that the PEEMD is efficient and effective in revealing the major wave characteristics of the data, such as wavelengths and periods, by sifting out the dominant (wave) components. This approach has a potential for hurricane climate study by examining the statistical relationship between tropical waves and TC formation.

PEEMD↗

NASA NTRS1996

Prediction Capability for Transonic Nozzle Afterbodies Improved

Under the High Speed Research (HSR) Program, the NASA Lewis Research Center, the NASA Langley Research Center, and the aerospace industry have been developing exhaust nozzle concepts for a future High Speed Civil Transport (HSCT). For such an aircraft to be both economically viable and environmentally acceptable, the exhaust nozzles must combine highly efficient operation throughout the flight envelope with low noise levels at takeoff. A team composed of researchers from Lewis, Langley, and McDonnell Douglas created a two-dimensional data base using computational fluid dynamics. First, each group validated their computational fluid dynamics code against existing experimental data to gain confidence in the code's results. Next, the organizations analyzed several configurations, and the results were used to create the new data base. Then, the analysis methods were updated to account for the effects of two-dimensional nozzles. This will result in a more accurate analysis of the propulsion system for the High Speed Civil Transport.

Source record↗

NASA NTRS2025

Efficient GPU-Accelerated MultiSource Global Fit Pipeline for LISA Data Analysis

The large-scale analysis task of deciphering gravitational-wave signals in the LISA data stream will be difficult, requiring a large amount of computational resources and extensive development of computational methods. Its high dimensionality, multiple model types, and complicated noise profile require a global fit to all parameters and input models simultaneously. In this work, we detail our global fit algorithm, called “Erebor,” designed to accomplish this challenging task. It is capable of analyzing current state-of-the-art datasets and then growing into the future as more pieces of the pipeline are completed and added. We describe our pipeline strategy, the algorithmic setup, and the results from our analysis of the LDC2A Sangria dataset, which contains massive black hole binaries, compact galactic binaries, and a parametrized noise spectrum whose parameters are unknown to the user. The Erebor algorithm includes three unique and very useful contributions: GPU acceleration for enhanced computational efficiency; ensemble Markov Chain Monte Carlo (MCMC) sampling with multiple MCMC walkers per temperature for better mixing and parallelized sample creation; and special online updates to reversible-jump (or transdimensional) sampling distributions to ensure sampler mixing and accurate initial estimates for detectable sources in the data.We recover posterior distributions for all 15 (6) of the injected massive black hole binaries (MBHB) in the LDC2A training (hidden) dataset. We catalog ∼12000 galactic binaries (∼8000 as high confidence detections) for both the training and hidden datasets. All of the sources and their posterior distributions are provided in publicly available catalogs.

LISA↗

NASA NTRS2000

Monitoring Global Sea Level: Eustatic Variations, Local Variations, and Solid Earth Effects

Project BIFROST (Baseline Inferences for Fennoscandian Rebound Observations. Sea-level and Tectonics) combines networks of continuously operating CPS receivers in Sweden and Finland to measure ongoing crustal deformation due to glacial isostatic adjustment, (CIA). We present an analysis of data collected in the years 1993-1998. We compare the CPS determinations of three-dimensional crustal motion to predictions calculated using the high resolution Fennoscandian deglaciation model recently proposed by Lambeck et al. We find that the the maximum observed uplift rate (approx. 10 mm/ yr) and the maximum predicted uplift rate agree to better than 1 mm/ yr. The patterns of uplift also agree quite well, although differences are discernible. The chi(exp 2) difference between predicted and GPS-observed radial rates is reduced by a factor of 5-6 compared to that for the "null" (no uplift) model, depending on whether a mean difference is first removed. The north components of velocity agree at about the same relative level. whereas the agreement for the east components is worse, a problem possibly related to the lack of bias fixing. We have also compared the values for the observed radial deformation rates to those based on sea-level rates from Baltic tide gauges. The weighted RMS difference between CPS and tide-gauge rates (after removing a mean) is 0.6 mm/ yr, giving an indication of the combined accuracy of the CPS and tide-gauge measurement systems. Spectral analysis of the time series of position estimates yields spectral indices in the range -1 to -2. An EOF analysis indicates, however, that much of this power is correlated among the sites. The correlation appears to be regional and falls off only slightly with distance. Some of this correlated noise is associated with snow accumulation on the antennas or, for those antennas with radomes, on the radomes. This problem has caused us to modify the radomes used several times, leading to one of our more significant sources of uncertainty.

Davis, James L.↗

DOE OSTI2025

Chemistry imaging and distribution analysis of rare earth elements in coal using LIBS and LA-ICP-MS instruments

Currently, demand for rare earth elements (REEs) increased significantly. Coal is actively evaluated as potential economic sources for extraction of REEs. Here, in this work, laser-induced breakdown spectroscopy (LIBS) was evaluated for rapid estimation of REEs content and their distribution in the natural coal samples. The results were compared with similar laser ablation–inductively coupled plasma–mass spectrometry (LA-ICP-MS) measurements. Thirteen coal samples (nine standard samples and five natural samples) were used in this study. Powder samples were pressed into pellets while coal chunks were directly ablated for data recording. Pellets of the powder standard samples were used to optimize the data acquisition system and then data recorded with this optimized system was used to identify the proper data acquisition and analysis models. After establishing the proper data acquisition system and analysis model using the standard samples, natural coal samples in powder form and their chunks were utilized to record LIBS and LA-ICP-MS spectra. Multivariate calibration models were developed using four of the natural samples, which were evaluated by predicting the REE content in the fifth sample. Principal component analysis was performed on the LIBS data obtained from the natural samples and it classified all the samples with high accuracy. Two-dimensional (2D) elemental mapping on coal chunk samples was also performed using both LIBS and LA-ICP-MS to study the distribution of REEs in the samples. The resulting elemental images and their correlations can be used to infer mineral distributions.

01 COAL, LIGNITE, AND PEAT↗

DOE OSTI2024

Designing Remote Monitoring for Smart Manufacturing Facilities: Hazard Identification and Classification

This study investigates the process of hazard identification in complex manufacturing environments during the design phase, emphasizing the significance of the design process in developing designs that effectively mitigate hazards in contexts with numerous variables, such as a variety of machines, sensors, actuators, and agents. Through a mixed-methods approach, the objective of this work is to understand how the evolution of design outcomes across various stages might influence a designer’s ability to recognize both standard and novel hazards. To achieve this understanding, an experimental design task was conducted with six designers from a national lab specializing in manufacturing technologies. This approach combined qualitative and quantitative data analysis from a one-hour virtual session with participants. Findings suggest that the complexity of identifying hazards in a high-dimensional design space is challenging within a limited time frame and that the identification of hazards is significantly influenced by the stage of the design task and the initial design decisions, indicating the need for extended time and strategic initial planning in the design process to enhance hazard identification.

Ballestas, Caseysimone↗

NASA NTRS1992

Unsteady aerodynamic interaction effects on turbomachinery blade life and performance

This paper is an attempt to address the impact of a class of unsteady flows on the life and performance of turbomachinery blading. These class of flows to be investigated are those whose characteristic frequency is an integral multiple of rotor shaft speed. Analysis of data recorded downstream of a compressor and turbine rotor will reveal that this class of flows can be highly three-dimensional and may lead to the generation of secondary flows within downstream blading. By explicitly accounting for these unsteady flows in the design of turbomachinery blading for multistage applications, it may be possible to bring about gains in performance and blade life.

Adamczyk, John J.↗

NASA NTRS1989

Evaluation of leading- and trailing-edge flaps on flat and cambered delta wings at supersonic speeds

An experimental investigation has been conducted to evaluate the effectiveness of leading- and trailing-edge flaps on a flat and cambered wing at superconic speeds. Results from the experimental tests showed that highly complex and three-dimensional flow can occur over the wings with leading- and/or trailing-edge flaps deflected. An analysis of the data also showed that flap effectiveness varies significantly between a cambered and flat wing of identical planform and flap geometry. Mach number effects are similar for both flat and cambered wings for all aerodynamic parameters.

Hernandez, Gloria↗

NASA NTRS1981

Application of a Laser Interferometer Skin-Friction Meter in Complex Flows

A nonintrusive skin-friction meter has been found useful for a variety of complex wind-tunnel flows. This meter measures skin friction with a remotely located laser interferometer that monitors the thickness change of a thin oil film. Its accuracy has been proven in a low-speed flat-plate flow. The wind-tunnel flows described here include sub-sonic separated and reattached flow over a rearward-facing step, supersonic flow over a flat plate at high Reynolds numbers, and supersonic three - dimensional vortical flow over the lee of a delta wing at angle of attack. The data-reduction analysis was extended to apply to three-dimensional flows with unknown flow direction, large pressure and shear gradients, and large oil viscosity changes with time. The skin friction measurements were verified, where possible, with results from more conventional techniques and also from theoretical computations.

Monson, D. J.↗

NASA NTRS2003

Mining Distance Based Outliers in Near Linear Time with Randomization and a Simple Pruning Rule

Defining outliers by their distance to neighboring examples is a popular approach to finding unusual examples in a data set. Recently, much work has been conducted with the goal of finding fast algorithms for this task. We show that a simple nested loop algorithm that in the worst case is quadratic can give near linear time performance when the data is in random order and a simple pruning rule is used. We test our algorithm on real high-dimensional data sets with millions of examples and show that the near linear scaling holds over several orders of magnitude. Our average case analysis suggests that much of the efficiency is because the time to process non-outliers, which are the majority of examples, does not depend on the size of the data set.

Bay, Stephen D.↗

NASA NTRSDate not supplied

Improved Plate and Beam Models for Thermoviscoelastic Constitutive Modeling of Composites

The effective properties of composites are influenced by the time-dependent behavior of polymer matrices very sensitive to changes in temperature. Improved plate and beam models are required to efficiently design, and simulate composite structures when the long-term performance of large anisotropic composite structures is the matter of interest. In this work, mechanics of structure genome (MSG) is used to con-struct linear thermoviscoelastic plate and beam models that can homogenize three-dimensional heterogeneous materials made of constituents with time- and temperature-dependent behavior. The formulation derives the transient strain energy based on integral formulation for thermorheologically simple materials subject to finite temperature changes with the restriction that the strain is small. The reduced time parameter is introduced to relate the time-temperature dependency of the anisotropic material by means of master curves at reference conditions. The new formulation has been implemented in SwiftCompTM, a general-purpose multiscale constitutive modeling code based on MSG. Experimental data and three-dimensional direct numerical simulations of thin-ply high-strain composites (TP-HSC) using a commercial finite element analysis (FEA) package are conducted to verify the accuracy of SwiftCompTM results. The paper also analyzes the relationship between the shift factor of the polymer matrix and the temperature dependencies of the effective beam properties.

Finite element analysis↗