Explaining Neural Network Predictions of Characteristics of Explosive Devices Using Functional Principal Components Analysis and Permutation Feature Importance.
Abstract not provided.
Goode, Katherine Jean↗
SEARCH · Search NASA
Results for “Principal Component”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Employing Principal Component Analysis for XRD Signal Extraction of Germanium Antimony Telluride Thin Films During Crystallization.
Abstract not provided.
Rodriguez, Mark A.↗
Explaining Neural Network Predictions for Functional Data Using Principal Component and Feature Importance.
Abstract not provided.
Goode, Katherine Jean↗
Explaining Neural Network Predictions for Functional Data Using Principal Component Analysis and Feature Importance.
Abstract not provided.
Goode, Katherine Jean↗
Explaining Neural Network Predictions for Functional Data Using Principal Component Analysis and Feature Importance.
Abstract not provided.
Goode, Katherine Jean↗
Principal Component Analysis for Modal Optimization in Resonant Ultrasound Spectroscopy
Explore the source record for details and available documents.
Beardslee, Luke Berny↗
LANDSAT-D thematic mapper image dimensionality reduction and geometric correction accuracy
When principal component analysis of a subscene of a section of the Sacramento River showed lower correlation among the TM spectral components that were observed for the MSS spectral components, principal component analysis was applied to a LANDSAT 2 MSS subscene of the same area for comparison purposes. Correlation coefficient matrices indicate the pairwise similarity and correlation of the data for the spectral components. The principal components transformation matrix, indicates the weights applied to the original components to generate the transformed components. The first two TM components can be described as visible and near infrared. For the MSS data, the first transformed component is roughly the average of the four original components. The second transformed component is roughly the difference between the visible and infrared components. Tables show that 97.0% of the variance in an MSS image is contained in only two transformed components.
Ford, G. E.↗
Automated and efficient local adaptive regression for principal component-based reduced-order modeling of turbulent reacting flows
Principal Component Analysis can be used to reduce the cost of Computational Fluid Dynamics simulations of turbulent reacting flows by reducing the dimensionality of the transported variables through projection of the thermochemical state onto a lower-dimensional manifold. However, because of the nonlinearity of the principal component source terms, nonlinear regression techniques must be utilized for the source terms in terms of the principal components. Unfortunately, widely available and utilized nonlinear regression techniques can have prohibitive computational requirements and/or accuracy that is highly dependent on user experience in ad hoc tuning of model architecture and hyperparameters. Here, in this work, a new nonlinear regression approach is proposed that is both computationally efficient and automated so does not require any user input. The approach is evaluated through a priori prediction of principal component source terms using data from a Direct Numerical Simulation of a turbulent nonpremixed n-heptane/air jet flame. In particular, the proposed framework consists of local regressions whose complexity is adapted according to the local nonlinearity of the data: local linear regression when accurate enough and local Artificial Neural Networks when nonlinear regression is required. The number of local clusters for local regression is determined automatically using the Davies-Bouldin index. In addition, Bayesian optimization is utilized for model training (i.e., to select the best architectures and hyperparameters of the nonlinear regressions in an unsupervised fashion), eliminating ad hoc hand-tuning and/or expensive grid searches. Overall, compared to a single, global neural network, the new local adaptive regression approach is shown to have comparable accuracy but 69% less training time due to the utilization of local linear regression and faster training of local neural networks.
42 ENGINEERING↗
Understanding software faults and their role in software reliability modeling
This study is a direct result of an on-going project to model the reliability of a large real-time control avionics system. In previous modeling efforts with this system, hardware reliability models were applied in modeling the reliability behavior of this system. In an attempt to enhance the performance of the adapted reliability models, certain software attributes were introduced in these models to control for differences between programs and also sequential executions of the same program. As the basic nature of the software attributes that affect software reliability become better understood in the modeling process, this information begins to have important implications on the software development process. A significant problem arises when raw attribute measures are to be used in statistical models as predictors, for example, of measures of software quality. This is because many of the metrics are highly correlated. Consider the two attributes: lines of code, LOC, and number of program statements, Stmts. In this case, it is quite obvious that a program with a high value of LOC probably will also have a relatively high value of Stmts. In the case of low level languages, such as assembly language programs, there might be a one-to-one relationship between the statement count and the lines of code. When there is a complete absence of linear relationship among the metrics, they are said to be orthogonal or uncorrelated. Usually the lack of orthogonality is not serious enough to affect a statistical analysis. However, for the purposes of some statistical analysis such as multiple regression, the software metrics are so strongly interrelated that the regression results may be ambiguous and possibly even misleading. Typically, it is difficult to estimate the unique effects of individual software metrics in the regression equation. The estimated values of the coefficients are very sensitive to slight changes in the data and to the addition or deletion of variables in the regression equation. Since most of the existing metrics have common elements and are linear combinations of these common elements, it seems reasonable to investigate the structure of the underlying common factors or components that make up the raw metrics. The technique we have chosen to use to explore this structure is a procedure called principal components analysis. Principal components analysis is a decomposition technique that may be used to detect and analyze collinearity in software metrics. When confronted with a large number of metrics measuring a single construct, it may be desirable to represent the set by some smaller number of variables that convey all, or most, of the information in the original set. Principal components are linear transformations of a set of random variables that summarize the information contained in the variables. The transformations are chosen so that the first component accounts for the maximal amount of variation of the measures of any possible linear transform; the second component accounts for the maximal amount of residual variation; and so on. The principal components are constructed so that they represent transformed scores on dimensions that are orthogonal. Through the use of principal components analysis, it is possible to have a set of highly related software attributes mapped into a small number of uncorrelated attribute domains. This definitively solves the problem of multi-collinearity in subsequent regression analysis. There are many software metrics in the literature, but principal component analysis reveals that there are few distinct sources of variation, i.e. dimensions, in this set of metrics. It would appear perfectly reasonable to characterize the measurable attributes of a program with a simple function of a small number of orthogonal metrics each of which represents a distinct software attribute domain.
Munson, John C.↗
Principal Component-Based Radiative Transfer Model (PCRTM) for Hyperspectral Sensors: Theoretical Concept - Part I
Modern infrared satellite sensors such as Atmospheric Infrared Sounder (AIRS), Cosmic Ray Isotope Spectrometer (CrIS), Thermal Emission Spectrometer (TES), Geosynchronous Imaging Fourier Transform Spectrometer (GIFTS) and Infrared Atmospheric Sounding Interferometer (IASI) are capable of providing high spatial and spectral resolution infrared spectra. To fully exploit the vast amount of spectral information from these instruments, super fast radiative transfer models are needed. This paper presents a novel radiative transfer model based on principal component analysis. Instead of predicting channel radiance or transmittance spectra directly, the Principal Component-based Radiative Transfer Model (PCRTM) predicts the Principal Component (PC) scores of these quantities. This prediction ability leads to significant savings in computational time. The parameterization of the PCRTM model is derived from properties of PC scores and instrument line shape functions. The PCRTM is very accurate and flexible. Due to its high speed and compressed spectral information format, it has great potential for super fast one-dimensional physical retrievals and for Numerical Weather Prediction (NWP) large volume radiance data assimilation applications. The model has been successfully developed for the National Polar-orbiting Operational Environmental Satellite System Airborne Sounder Testbed - Interferometer (NAST-I) and AIRS instruments. The PCRTM model performs monochromatic radiative transfer calculations and is able to include multiple scattering calculations to account for clouds and aerosols.
Liu, Xu↗
A Principal Component-Based Radiative Transfer Forward Model (PCRTM) for Vertically in Homogeneous Cloud
A principal-component based radiative transfer model (PCRTM) is developed for simulating the infrared spectral radiance at the top of the atmosphere (TOA). The PCRTM approach removes the redundancy in radiative transfer calculation in high resolution infrared spectra, and saves significant amount of computational time with great accuracy. In PCRTM, both ice and water clouds are treated as effective transmissivity and reflectivity stored in a pre-calculated lookup tables. These quantities are calculated using cloud single scattering properties such as cloud optical depth, cloud particle size, cloud phase, etc. The cloud can be inserted into any pressure layer in the PCRTM model (up to 100 layers). The effective temperature of each cloud layer is treated as a function of its optical depth. To test the accuracy of this approximation, the results are compared with the more rigorous DISORT model, which treats cloud as a plane parallel layer. The root-mean-square error of PCRTM, with respect to DISORT results, is generally less than 0.5 K in brightness temperature. However, the CPU time required by PCRTM was approximately two orders of magnitude less than that required by DISORT.
Li, Hui↗
Confidentiality-preserving machine learning algorithms for soft-failure detection in optical communication networks
Automated fault management is at the forefront of next-generation optical communication networks. The increase in complexity of modern networks has triggered the need for programmable and software-driven architectures to support the operation of agile and self-managed systems. In these scenarios, the European Telecommunications Standards Institute zero-touch network and service management approach is imperative. The need for machine learning algorithms to process the large volume of telemetry data brings safety concerns as distributed cloud-computing solutions become the preferred approach for deploying reliable communication network automation. This paper’s contribution is twofold. First, we propose a simple yet effective method to guarantee the confidentiality of the telemetry data based on feature scrambling. The method allows the operation of third-party computational services without direct access to the full content of the collected data. Additionally, the effectiveness of four unsupervised machine learning algorithms for soft-failure detection is evaluated when applied to the scrambled telemetry data. The methods are based on factor analysis, principal component analysis, nonlinear principal component analysis, and singular value decomposition. Most dimensionality reduction algorithms have the common property that they can maintain similar levels of fault classification performance while hiding the data structure from unauthorized access. Evaluations of the proposed algorithms demonstrate this capability.
97 MATHEMATICS AND COMPUTING↗
Image and numerical display aids for manual interpretation
Four color image display techniques, developed to aid in interpreting LANDSAT imagery, are described. These are the cluster image, the principal component transformation, the principal component greenness transformation, and the color-coded spectral plot. Experimental results show that the four techniques are useful in selecting and/or identifying representative samples of signatures in a given LANDSAT scene.
Abotteen, R. A.↗
Bayesian Estimation of Precipitation from Satellite Passive Microwave Observations Using Combined Radar-Radiometer Retrievals
Precipitation estimation from satellite passive microwave radiometer observations is a problem that does not have a unique solution that is insensitive to errors in the input data. Traditionally, to make this problem well posed, a priori information derived from physical models or independent, high-quality observations is incorporated into the solution. In the present study, a database of precipitation profiles and associated brightness temperatures is constructed to serve as a priori information in a passive microwave radiometer algorithm. The precipitation profiles are derived from a Tropical Rainfall Measuring Mission (TRMM) combined radar radiometer algorithm, and the brightness temperatures are TRMM Microwave Imager (TMI) observed. Because the observed brightness temperatures are consistent with those derived from a radiative transfer model embedded in the combined algorithm, the precipitation brightness temperature database is considered to be physically consistent. The database examined here is derived from the analysis of a month-long record of TRMM data that yields more than a million profiles of precipitation and associated brightness temperatures. These profiles are clustered into a tractable number of classes based on the local sea surface temperature, a radiometer-based estimate of the echo-top height (the height beyond which the reflectivity drops below 17 dBZ), and brightness temperature principal components. For each class, the mean precipitation profile, brightness temperature principal components, and probability of occurrence are determined. The precipitation brightness temperature database supports a radiometer-only algorithm that incorporates a Bayesian estimation methodology. In the Bayesian framework, precipitation estimates are weighted averages of the mean precipitation values corresponding to the classes in the database, with the weights being determined according to the similarity between the observed brightness temperature principal components and the brightness temperature principal components of the classes. Because the classes are stratified by the sea surface temperature and the echo-top-height estimator, the number of classes that are considered for retrieval is significantly smaller than the total number of classes, making the algorithm computationally efficient. The radiometer-only algorithm is applied to TMI observations, and precipitation estimates are compared with combined TRMM precipitation radar (PR) TMI reference estimates. The TMI-only algorithm, supported by the empirically derived database, produces estimates that are more consistent with the reference values than the precipitation estimates from the version-6 TRMM facility TMI algorithm. Cloud-resolving model simulations are used to assign a latent heating profile to each precipitation profile in the empirically derived database, making it possible to estimate latent heating using the radiometer-only algorithm. Although the evaluation of latent heating estimates in this study is preliminary, because realistic conditional probability distribution functions are attached to latent heating structures in the algorithm s database, a generally positive impact on latent heating estimation from passive microwave observations is expected.
Grecu, Mircea↗
The luminosity structure and objective classification of galaxies
The luminosity structure of spiral galaxies is studied using the technique of principal component analysis. It is found that approximately 94% of the variation in the luminosity distribution of galaxies can be accounted for by just two principal components. The principal luminosity components may contain valuable information about star formation history or whatever luminosity-regulating process occurs in galaxies. Practically, these principal components provide a new approach for the investigation of the luminosity structures of galaxies and their dependence on other properties. They also serve as an excellent objective classification system for galaxies. We introduce in this paper such a classification scheme and explore its various properties. The new system shows a number of very impressive characteristics. Most important, it can well segregate virtually all the important galactic properties we tested and does so much better than the conventional morphological classification systems. Of particular interest is that some distance-dependent parameters can also be determined to a surprisingly good accuracy; for example, absolute magnitude may be determined to an accuracy of approximately 0.6 mag (yet further improvement is believed to be highly possible). Second, the system is objective, and the classification procedure can be automated to a large degree; also the new system can apply to much smaller and fainter images than do eye-based clasification systems. These properties make the new system suitable for practical application, especially on very large (and deeper) digital image catalogs. Third, the classification is expressed in dimensionless numbers, yet the simple notation bears significant and easily understandable meaning, making it easy and convenient to use. Finally, the new system has another extremely useful feature: it provides a very powerful and convenient platform not only for classification, but also for easily recording, examining, and studying the variations and correlations of galaxy properties-all these may be carried out graphically by using the C-vectors and the C-diagrams introduced in the paper. We wil also give an example to demonstrate the use of the classification system for the study of the internal extinction problem in spiral galaxies.
Han, Mingshen↗
System and method for automated extraction of high resolution structural dynamics from video
A method for extracting vibrational modes of a structure includes: receiving a plurality of video frames, each of the video frames including a plurality of pixels; decomposing each of the video frames on a plurality of spatial scales in accordance with complex steerable pyramid filters to obtain a filter response for each of the spatial scales; computing a plurality of local phases of the pixels of each frame; removing a temporal mean from each frame to obtain a plurality of factored vibration motion functions; performing principal component analysis on the factored vibration motion functions to obtain principal components; blind source separating the principal components to compute a plurality of modal coordinates; computing frequency and damping ratios in accordance with the modal coordinates; and outputting the computed frequency and damping ratios.
42 ENGINEERING↗
Snowfall Rate Retrieval using NPP ATMS Passive Microwave Measurements
Passive microwave measurements at certain high frequencies are sensitive to the scattering effect of snow particles and can be utilized to retrieve snowfall properties. Some of the microwave sensors with snowfall sensitive channels are Advanced Microwave Sounding Unit (AMSU), Microwave Humidity Sounder (MHS) and Advance Technology Microwave Sounder (ATMS). ATMS is the follow‐on sensor to AMSU and MHS. Currently, an AMSU and MHS based land snowfall rate (SFR) product is running operationally at NOAA/NESDIS. Based on the AMSU/MHS SFR, an ATMS SFR algorithm has been developed recently. The algorithm performs retrieval in three steps: snowfall detection, retrieval of cloud properties, and estimation of snow particle terminal velocity and snowfall rate. The snowfall detection component utilizes principal component analysis and a logistic regression model. The model employs a combination of temperature and water vapor sounding channels to detect the scattering signal from falling snow and derive the probability of snowfall (Kongoli et al., 2014). In addition, a set of NWP model based filters is also employed to improve the accuracy of snowfall detection. Cloud properties are retrieved using an inversion method with an iteration algorithm and a two‐stream radiative transfer model (Yan et al., 2008). A method developed by Heymsfield and Westbrook (2010) is adopted to calculate snow particle terminal velocity. Finally, snowfall rate is computed by numerically solving a complex integral. The ATMS SFR product is validated against radar and gauge snowfall data and shows that the ATMS algorithm outperforms the AMSU/MHS SFR.
Meng, Huan↗
NPP ATMS Snowfall Rate Product
Passive microwave measurements at certain high frequencies are sensitive to the scattering effect of snow particles and can be utilized to retrieve snowfall properties. Some of the microwave sensors with snowfall sensitive channels are Advanced Microwave Sounding Unit (AMSU), Microwave Humidity Sounder (MHS) and Advance Technology Microwave Sounder (ATMS). ATMS is the follow‐on sensor to AMSU and MHS. Currently, an AMSU and MHS based land snowfall rate (SFR) product is running operationally at NOAA/NESDIS. Based on the AMSU/MHS SFR, an ATMS SFR algorithm has been developed recently. The algorithm performs retrieval in three steps: snowfall detection, retrieval of cloud properties, and estimation of snow particle terminal velocity and snowfall rate. The snowfall detection component utilizes principal component analysis and a logistic regression model. The model employs a combination of temperature and water vapor sounding channels to detect the scattering signal from falling snow and derive the probability of snowfall (Kongoli et al., 2015). In addition, a set of NWP model based filters is also employed to improve the accuracy of snowfall detection. Cloud properties are retrieved using an inversion method with an iteration algorithm and a two‐stream radiative transfer model (Yan et al., 2008). A method developed by Heymsfield and Westbrook (2010) is adopted to calculate snow particle terminal velocity. Finally, snowfall rate is computed by numerically solving a complex integral. NCEP CMORPH analysis has shown that integration of ATMS SFR has improved the performance of CMORPH‐Snow. The ATMS SFR product is also being assessed at several NWS Weather Forecast Offices for its usefulness in weather forecast.
Forecasting↗