Nonparametric ranking and selection procedures Final report, 1 Oct. 1968 - 30 Sep. 1969
Research and development of nonparametric methodology in statistical ranking and selection procedures
Rizvi, M. H.↗
SEARCH · Search NASA
Results for “statistical selection”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Sensor Selection and Data Validation for Reliable Integrated System Health Management
For new access to space systems with challenging mission requirements, effective implementation of integrated system health management (ISHM) must be available early in the program to support the design of systems that are safe, reliable, highly autonomous. Early ISHM availability is also needed to promote design for affordable operations; increased knowledge of functional health provided by ISHM supports construction of more efficient operations infrastructure. Lack of early ISHM inclusion in the system design process could result in retrofitting health management systems to augment and expand operational and safety requirements; thereby increasing program cost and risk due to increased instrumentation and computational complexity. Having the right sensors generating the required data to perform condition assessment, such as fault detection and isolation, with a high degree of confidence is critical to reliable operation of ISHM. Also, the data being generated by the sensors needs to be qualified to ensure that the assessments made by the ISHM is not based on faulty data. NASA Glenn Research Center has been developing technologies for sensor selection and data validation as part of the FDDR (Fault Detection, Diagnosis, and Response) element of the Upper Stage project of the Ares 1 launch vehicle development. This presentation will provide an overview of the GRC approach to sensor selection and data quality validation and will present recent results from applications that are representative of the complexity of propulsion systems for access to space vehicles. A brief overview of the sensor selection and data quality validation approaches is provided below. The NASA GRC developed Systematic Sensor Selection Strategy (S4) is a model-based procedure for systematically and quantitatively selecting an optimal sensor suite to provide overall health assessment of a host system. S4 can be logically partitioned into three major subdivisions: the knowledge base, the down-select iteration, and the final selection analysis. The knowledge base required for productive use of S4 consists of system design information and heritage experience together with a focus on components with health implications. The sensor suite down-selection is an iterative process for identifying a group of sensors that provide good fault detection and isolation for targeted fault scenarios. In the final selection analysis, a statistical evaluation algorithm provides the final robustness test for each down-selected sensor suite. NASA GRC has developed an approach to sensor data qualification that applies empirical relationships, threshold detection techniques, and Bayesian belief theory to a network of sensors related by physics (i.e., analytical redundancy) in order to identify the failure of a given sensor within the network. This data quality validation approach extends the state-of-the-art, from red-lines and reasonableness checks that flag a sensor after it fails, to include analytical redundancy-based methods that can identify a sensor in the process of failing. The focus of this effort is on understanding the proper application of analytical redundancy-based data qualification methods for onboard use in monitoring Upper Stage sensors.
Garg, Sanjay↗
Theory of Alike Selectivity in Biological Channels
We introduce a statistical mechanical model of the selectivity filter that accounts for the interaction between ions within the channel and derive Eisenman equation of the filter selectivity directly from the condition of barrier-less conduction.
alike selectivity↗
Statistical generic design of glass and optimization: Selective review on oxide glasses
Designing a single glass composition for a multidimensional property space is challenging, and the difficulty increases with the number of design criteria. Traditionally, the task is accomplished using multiple statistical models that describe the relationships between composition (C) and property (P) values, i.e., C-P models. Recently, the structure (S)-property (P) statistical modeling has emerged as a complementary approach. The S-P modeling approach has also been shown to be a preferred method for modeling glass properties, particularly when a small data set is available, such as in single-component studies, or when strong nonlinearities exist between composition and properties. The combined model package, C-S-P, implements the concept of generic glass design, i.e., designing glass for performance by first selecting a specific or optimized set of glass network structural groups using S-P models and then transferring the designed structures (genes) to a particular composition using C-S models. This article reviews a set of supporting cases from the previous C-S-P modeling studies of phosphate, silicate, and borosilicate glasses, which are relevant for many critical commercial applications. The methodology for developing the statistical C-S-P database is presented, enabling the application of P?S?C to achieve a generic glass design and optimization, targeting multiple design criteria for both performance and processing properties simultaneously.
Network structure↗
Optical identification of serendipitous Einstein sources - 19 X-ray-selected active galactic nuclei
The identification of counterparts to 19 serendipitous Einstein Observatory X-ray sources at high galactic latitude is reported. The counterparts are identified as previously uncataloged active galactic nuclei (AGNs) - quasars or Seyfert galaxies - with redshifts varying from z = 0.036 through z = 1.40. The success rate, that is, the fraction of X-ray sources that are identified as AGNs, is approximately 50%, an order of magnitude larger than for traditional ultraviolet surveys. It is expected that this method will produce a large number of X-ray-selected AGNs for statistical studies. For the 19 AGNs in this sample, which is free from the radio selection effects that have complicated previous studies, the X-ray-to-optical-flux slope is found to be 1.30 + or - 0.05.
Chanan, G. A.↗
A systematic feature extraction and selection framework for data-driven whole-building automated fault detection and diagnostics in commercial buildings
In data-driven automated fault detection and diagnostics (AFDD) modeling for building energy systems, feature engineering is a critical process of extracting information from high-dimensional and noisy sensor measurement and turning it into informative and representative inputs or features for data-driven modeling. However, few studies specifically discuss the feature engineering, especially the interactions between feature extraction and feature selection in whole-building AFDD. We developed a systematic feature extraction and selection framework for whole-building AFDD. In this framework, features are aggressively extracted from raw sensor data using statistical feature extraction techniques with various window sizes and statistics. With many features extracted, a hybrid feature selection algorithm that combines the filter and wrapper method then selects the best feature set. The framework considers diversity in the duration of fault behavior among fault types in whole-building AFDD, thus achieving high model generalization. We implemented our developed framework in a virtual testbed calibrated with measured data from Oak Ridge National Laboratory's Flexible Research Platform designed to mimic the operation of a typical small commercial building. The AFDD model is trained by the simulation data generated from the virtual testbed. The results show that (1) the developed framework improves the generalization of the AFDD model by 10.7% compared with literature-reported feature extraction and selection methods and (2) features with diverse window sizes and statistics are selected, providing insight into physical systems beyond the current understanding of buildings and faults and improving the detection and diagnostics of multiple fault types.
32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
An examination of the relationships between selected ground properties and Landsat MSS data in an area of complex terrain in southern Italy
The paper deals with the method and results of a study which involved an examination of the statistical relationships between selected ground properties and Landsat MSS data, and whose aim was to assess the applicability of Landsat data to surface cover mapping in areas characterized by high-frequency spatial variations of surface cover type over small areas. The results indicate that by systematic ground data collection it is possible to understand the basic relationships between ground properties and Landsat sensor data in areas of complex surface cover and terrain, and to classify the cover types.
Justice, C. O.↗
Pilot climate data system: A state-of-the-art capability in scientific data management
The Pilot Climate Data System (PCDS) was developed by the Information Management Branch of NASA's Goddard Space Flight Center to manage a large collection of climate-related data of interest to the research community. The PCDS now provides uniform data catalogs, inventories, access methods, graphical displays and statistical calculations for selected NASA and non-NASA data sets. Data manipulation capabilities were developed to permit researchers to easily combine or compare data. The current capabilities of the PCDS include many tools for the statistical survey of climate data. A climate researcher can examine any data set of interest via flexible utilities to create a variety of two- and three-dimensional displays, including vector plots, scatter diagrams, histograms, contour plots, surface diagrams and pseudo-color images. The graphics and statistics subsystems employ an intermediate data storage format which is data-set independent. Outside of the graphics system there exist other utilities to select, filter, list, compress, and calculate time-averages and variances for any data of interest. The PCDS now fully supports approximately twenty different data sets and is being used on a trial basis by several different in-house research grounds.
Smith, P. H.↗
Multidimensional scaling informed by F -statistic: Visualizing grouped microbiome data with inference
Multidimensional scaling (MDS) is a widely used dimensionality reduction technique in microbial ecology data analysis that captures the multivariate structure of the data while preserving pairwise distances between samples. While improvements in MDS have enhanced the ability to reveal group-specific data patterns, these MDS-based methods require prior assumptions for inference, limiting their application in general microbiome analysis. Here, in this study, we introduce a new MDS-based ordination method, “F-informed MDS,” which configures the data distribution based on the F-statistic, the ratio of dispersion between groups sharing common and different characteristics. Using semisynthetic datasets, we demonstrate that the proposed method is robust to hyperparameter selection while maintaining statistical significance throughout the ordination process. Various quality metrics for evaluating dimensionality reduction confirm that F-informed MDS is comparable to state-of-the-art methods in preserving both local and global data structures. Its application to a diatom-associated bacterial community suggests the role of this new method in interpreting the community’s response to the host. Our approach offers a well-founded refinement of MDS that aligns with statistical test results, which can be beneficial for broader multidimensional data analyses in microbiology and ecology. This new visualization tool can be incorporated into standard microbiome data analyses.
Biological and medical sciences↗
Adaptive variable-length coding for efficient compression of spacecraft television data.
An adaptive variable length coding system is presented. Although developed primarily for the proposed Grand Tour missions, many features of this system clearly indicate a much wider applicability. Using sample to sample prediction, the coding system produces output rates within 0.25 bit/picture element (pixel) of the one-dimensional difference entropy for entropy values ranging from 0 to 8 bit/pixel. This is accomplished without the necessity of storing any code words. Performance improvements of 0.5 bit/pixel can be simply achieved by utilizing previous line correlation. A Basic Compressor, using concatenated codes, adapts to rapid changes in source statistics by automatically selecting one of three codes to use for each block of 21 pixels. The system adapts to less frequent, but more dramatic, changes in source statistics by adjusting the mode in which the Basic Compressor operates on a line-to-line basis. Furthermore, the compression system is independent of the quantization requirements of the pulse-code modulation system.
Rice, R. F.↗
Scalable multiphoton quantum metrology with neither pre- nor post-selected measurements
The quantum statistical fluctuations of electromagnetic fields establish a limit, known as the shot-noise limit, on the sensitivity of optical measurements performed with classical technologies. However, quantum technologies are not constrained by this shot-noise limit. In this regard, the possibility of using every photon produced by quantum sources of light to estimate small physical parameters, beyond the shot-noise limit, constitutes one of the main goals of quantum optics. Here, we experimentally demonstrate a scalable protocol for quantum-enhanced optical phase estimation across a broad range of phases, with neither pre- nor post-selected measurements. This is achieved through the efficient design of a source of spontaneous parametric downconversion in combination with photon-number-resolving detection. The robustness of two-mode squeezed vacuum states against loss allows us to outperform schemes based on N00N states, in which the loss of a single photon is enough to remove all phase information from a quantum state. In contrast to other schemes that rely on N00N states or conditional measurements, the sensitivity of our technique could be improved through the generation and detection of high-order photon pairs. This unique feature of our protocol makes it scalable. Furthermore, our work is important for quantum technologies that rely on multiphoton interference such as quantum imaging, boson sampling, and quantum networks.
36 MATERIALS SCIENCE↗
Tropical Tropospheric Ozone Trends (1990 to 2022): A Re-evaluation Based on SHADOZ and IAGOS Profiles and TOMS/OMI Columns
Changes in tropical tropospheric ozone (TTO) are of importance because this region spans roughly a third of the Earth and portions of it are experiencing variability in trends of ozone precursors (CO, NO x , CH 4 and nonmethane hydrocarbons) associated with economic growth and fires. In addition to ozone changes affecting radiative forcing, tropical ozone is an important source of the OH radical and thus, the oxidizing capacity of the planet (Thompson, 1992). Recent studies examining TTO trends satellite and in-situ observations over the past ~25 years include: Thompson et al., JGR, 2021; Gaudel et al., ACP, 2023; Stauffer et al., ACP, 2023. The results show considerable regional and seasonal variability in TTO trends and sensitivity to data selection, frequency, and statistical method used. The satellite data vary most widely in method, time period and reliability. Here we revisit trends for the 1990-2022 period with the best-characterized buv-based satellite products that span that period (derived from TOMS and OMI, Ziemke et al., 2019). The satellite-based trends are compared to trends based on in-situ data from the Southern Hemisphere Additional Ozonesondes (SHADOZ) network (1998-2022), measurements from selected pre-SHADOZ and IAGOS commercial aircraft data (Gaudel et al., 2023). Among sensitivities examined are the dependence of ozone trends on start and end years, impacts of ENSO events and the COVID-19 perturbation to emissions. Two statistical methods are used, quantile regression (QR) and multiple linear regression (MLR). Trends of total TTO, ozone segments in the boundary layer (to ~700 hPa), and free troposphere (700-300 hPa) are compared.
ozone, OMI, tropospheric ozone, SHADOZ↗
Retrieved Surface Emissivity Impact of New Cloud-Clearing Channel Set
A viewgraph presentation on a proposed new cloud clearing channel set to improve land products and validate surface emissivity is given. The topics include: 1) Methodology; 2) Channel Selection; 3) Temperature Statistics; 4) 850 hPa Temperature Variability; 5) Status of Surface Retrieval; 6) Emissivity at 9 micrometers; 7) Emissivity Spectra; 8) Ha Megev (Israel); 9) Egypt One; 10) Salonga National Park, Zaire; 11) HaGolan (Israel/Syria); 12) Emissivity at 3.75 micrometers; 13) Improving Surface Retrieval; 14) Work Needed for V5 Delivery; 15) Effects of MODIS Emissivity; 16) Channel Selection; 17) 500 hPa Temperature Variability; 18) 850 hPa Temperature Variability; and 19) 850 hPa Temperature Differences;
Atmospheric Infrared Sounder (AIRS)↗
Weak-lensing Analysis of X-Ray-selected XXL Galaxy Groups and Clusters with Subaru HSC Data
We present a weak-lensing analysis of X-ray galaxy groups and clusters selected from the XMM-XXL survey using the first-year data from the Hyper Suprime-Cam (HSC) Subaru Strategic Program. Our joint weaklensing and X-ray analysis focuses on 136 spectroscopically confirmed X-ray-selected systems at 0.031 6 z 6 1.033 detected in the 25 deg2 XXL-N region, which largely overlaps with the HSC-XMM field. With high-quality HSC weak-lensing data, we characterize the mass distributions of individual clusters and establish the concentration–mass (c–M) relation for the XXL sample, by accounting for selection bias and statistical effects and marginalizing over the remaining mass calibration uncertainty. We find the mass-trend parameter of the c–M relation to be β = -0.07 ± 0.28 and the normalization to be c200 = 4.8 ± 1.0 (stat) ± 0.8 (syst) at M 200 = 1014h -1M and z = 0.3. We find no statistical evidence for redshift evolution. Our weaklensing results are in excellent agreement with dark-matter-only c–M relations calibrated for recent ΛCDM cosmologies. The level of intrinsic scatter in c200 is constrained as σ(ln c 200 ) < 24% (99.7% CL), which is smaller than predicted for the full population of ΛCDM halos. This is likely caused in part by the X-ray selection bias in terms of the cool-core or relaxation state. We determine the temperature–mass (TX–M 500 ) relation for a subset of 105 XXL clusters that have both measured HSC lensing masses and X-ray temperatures. The resulting TX–M 500 relation is consistent with the self-similar prediction. Our TX–M 500 relation agrees with the XXL DR1 results at group scales but has a slightly steeper mass trend, implying a smaller mass scale in the cluster regime. The overall offset in the TX–M 500 relation is at the ~ 1.5σ level, corresponding to a mean mass offset of (34 ± 20)%. We also provide bias-corrected, weak-lensing-calibrated M 200 and M 500 mass estimates of individual XXL clusters based on their measured X-ray temperatures.
79 ASTRONOMY AND ASTROPHYSICS↗
Leveraging design of experiments to build chemometric models for the quantification of uranium (VI) and HNO3 by Raman spectroscopy
Partial least squares regression (PLSR) and support vector regression (SVR) models were optimized for the quantification of U(VI) (10–320 g L −1 ) and HNO 3 (0.6–6 M) by Raman spectroscopy with optimized calibration sets chosen by optimal design of experiments. The designed approach effectively minimized the number of samples in the calibration set for PLSR and SVR by selecting sample concentrations with a quadratic process model, despite complex confounding and covarying spectral features in the spectra. The top PLS2 model resulted in percent root mean square errors of prediction for U(VI), HNO 3 , and NO 3 − of 3.7%, 3.6%, and 2.9%, respectively. PLS1 models performed similarly despite modeling an analyte with a majority linear response (i.e., uranyl symmetric stretch) and another with more covarying vibrational modes (i.e., HNO 3 ). Partial least squares (PLS) model loadings and regression coefficients were evaluated to better understand the relationship between weaker Raman bands and covarying spectral features. Support vector machine models outperformed PLS1 models, resulting in percent root mean square error of prediction values for U(VI) and HNO 3 of 1.5% and 3.1%, respectively. The optimal nonlinear SVR model was trained using a similar number of samples (11) compared with the PLSR model, even though PLS is a linear modeling approach. The generic D-optimal design presented in this work provides a robust statistical framework for selecting training set samples in disparate two-factor systems. This approach reinforces Raman spectroscopy for the quantification of species relevant to the nuclear fuel cycle and provides a robust chemometric modeling approach to bolster online monitoring in challenging process environments.
37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
Evaluation of the potential of one to three SEASAT-SMMR channels in retrieving sea surface temperature
The scanning multichannel microwave radiometer (SMMR) aboard the SEASAT satellite measured emitted radiation in both horizontal and vertical polarizations at microwave frequencies of 6.6, 10.69, 18.0, 21.0 and 37.0 GHz. Retrieval algorithms, for sea surface temperature (SST) determination, from subsets of one to three SMMR channels are obtained by a two step statistical technique. The technique first selects the best subsets of a given size defined by an R2 criterion (coefficient of determination), of a given size by the application of an efficient 'leaps and bounds' technique on a statistical data base. It then performs a regression analysis on the selected subsets. The statistical data base employed a large (600) set of seasonally and geographically diverse atmospheric and surface parameters for radiative transfer calculations. The results of the study of one to three channel subset retrieval algorithms indicate the possibility of using 6.6V, 6.6H and 18V channels for SST determination from SEASAT-SMMR data.
Pandey, P. C.↗
Behavior of the maximum likelihood in quantum state tomography
Quantum state tomography on a d-dimensional system demands resources that grow rapidly with d. They may be reduced by using model selection to tailor the number of parameters in the model (i.e., the size of the density matrix). Most model selection methods typically rely on a test statistic and a null theory that describes its behavior when two models are equally good. Here, we consider the loglikelihood ratio. Because of the positivity constraint ρ ≥ 0, quantum state space does not generally satisfy local asymptotic normality (LAN), meaning the classical null theory for the loglikelihood ratio (the Wilks theorem) should not be used. Thus, understanding and quantifying how positivity affects the null behavior of this test statistic is necessary for its use in model selection for state tomography. We define a new generalization of LAN, metric-projected LAN, show that quantum state space satisfies it, and derive a replacement for the Wilks theorem. In addition to enabling reliable model selection, our results shed more light on the qualitative effects of the positivity constraint on state tomography.
71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
Characterization of Pulmonary Nodules Based on Features of Margin Sharpness and Texture
Lung cancer is the leading cause of cancer-related deaths in the world, and one of its manifestations occurs with the appearance of pulmonary nodules. The classification of pulmonary nodules may be a complex task to specialists due to temporal, subjective, and qualitative aspects. Therefore, it is important to integrate computational tools to the early pulmonary nodule classification process, since they have the potential to characterize objectively and quantitatively the lesions. In this context, the goal of this work is to perform the classification of pulmonary nodules based on image features of texture and margin sharpness. Computed tomography scans were obtained from a publicly available image database. Texture attributes were extracted from a co-occurrence matrix obtained from the nodule volume. Margin sharpness attributes were extracted from perpendicular lines drawn over the borders on all nodule slices. Feature selection was performed by different algorithms. Classification was performed by several machine learning classifiers and assessed by the area under the receiver operating characteristic curve, sensitivity, specificity, and accuracy. Highest classification performance was obtained by a random forest algorithm with all 48 extracted features. However, a decision tree using only two selected features obtained statistically equivalent performance on sensitivity and specificity.
62 RADIOLOGY AND NUCLEAR MEDICINE↗