Search NASA⌕ Search

SEARCH · Search NASA

Results for “Statistical Testing Approach”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 649 records · Page 36

Prediction, evaluation, and specification of flying qualities by means of step target tracking

A new approach to flying qualities specification and evaluation is presented which coordinates current research in the areas of pilot ratings, pilot-aircraft modeling techniques, and simulation and flight test procedures. A time-domain pilot model is described which can model discontinuous and nonlinear pilot behavior in conjunction with completely general time-varying nonlinear aircraft models to simulate discrete maneuvers. This pilot-aircraft model is applied to an existing set of in-flight simulation data, and calculates tracking error and time-on-target statistics for step target tracking that directly relate to the reported pilot comments and ratings. Predicted step target tracking data for eighteen F-5E flight conditions are presented, and the use of the method for control system design is demonstrated using the YF-17.

Onstott, E. D.↗

Motion-base simulator results of advanced supersonic transport handling qualities with active controls

Handling qualities of the unaugmented advanced supersonic transport (AST) are deficient in the low-speed, landing approach regime. Consequently, improvement in handling with active control augmentation systems has been achieved using implicit model-following techniques. Extensive fixed-based simulator evaluations were used to validate these systems prior to tests with full motion and visual capabilities on a six-axis motion-base simulator (MBS). These tests compared the handling qualities of the unaugmented AST with several augmented configurations to ascertain the effectiveness of these systems. Cooper-Harper ratings, tracking errors, and control activity data from the MBS tests have been analyzed statistically. The results show the fully augmented AST handling qualities have been improved to an acceptable level.

Feather, J. B.↗

Flexible Wing Base Micro Aerial Vehicles: Vision-Guided Flight Stability and Autonomy for Micro Air Vehicles

Substantial progress has been made recently towards design building and test-flying remotely piloted Micro Air Vehicle's (MAVs). We seek to complement this progress in overcoming the aerodynamic obstacles to.flight at very small scales with a vision stability and autonomy system. The developed system based on a robust horizon detection algorithm which we discuss in greater detail in a companion paper. In this paper, we first motivate the use of computer vision for MAV autonomy arguing that given current sensor technology, vision may he the only practical approach to the problem. We then briefly review our statistical vision-based horizon detection algorithm, which has been demonstrated at 30Hz with over 99.9% correct horizon identification. Next we develop robust schemes for the detection of extreme MAV attitudes, where no horizon is visible, and for the detection of horizon estimation errors, due to external factors such as video transmission noise. Finally, we discuss our feed-back controller for self-stabilized flight, and report results on vision autonomous flights of duration exceeding ten minutes.

Ettinger, Scott M.↗

How to avoid multiple scattering in strongly scattering SANS and USANS samples

Small Angle Neutron Scattering (SANS) and Ultra Small Angle Neutron Scattering (USANS) are the only available experimental techniques to provide seamless non-destructive measurements of the geometry of the accessible and inaccessible pore structure of rocks from sub-nanopore size to the scale of macropores. They have therefore become the measurement of choice for tight reservoir rocks such as organic rich shales. A simplifying assumption in the analysis is, however, that during the path of neutrons through the sample each neutron is only scattered once. Shales are samples with a high scattering power and Multiple Scattering (MS) may occur which requires special modelling for deconvolution of the results. The approach to avoid MS is to simply reduce the sample thickness to <0.15–0.5 mm. Here, in this work, we present a systematic method on wavelength selection and preparation of samples to optimise extraction of microstructural data and minimise parasitic errors. Experimentally measured SAS transmission (TSAS) values are used as a practical criterion for estimation of the extent of MS. Generous beamtime allocations allowed robust testing revealing that sample thicknesses can be twice as thick as predicted using the standard protocol. Analysing thicker samples is particularly beneficial for statistically relevant characterisation of heterogeneous samples making the new protocol the method of choice for such samples.

(U)SANS↗

Interpretable Machine Learning Models for Autonomous Characterization of Analogue Ocean World Seawater Chemistry and Biosignature Potential Using Isotope Ratio Data

Background: Future missions to ocean worlds, such as Enceladus and Europa, will attempt to characterize the subsurface seawater chemistry and assess the potential for life. Such missions will be equipped with capabilities to precisely measure volatile isotopes in plumes, atmospheres, and exospheres. Motivation: While large isotopic fractionations can indicate a biological source, there are signatures resulting from abiotic geochemical processes that mimic isotopic biosignatures. While machine learning (ML) has the potential to disentangle competing effects and biotic mimicry, high-dimensional isotope ratio mass spectrometry (IRMS) data is likely to contain noise/irrelevant features and involve complex statistical interactions that make human inference and interpretation difficult. Further, ML predictions with as far-reaching implications as an extraterrestrial biosignature on an ocean world requires the use of interpretable models (i.e., not “black box” models) with physically and mathematically meaningful feature spaces along with false positive diagnostics. Methods: We use volatile CO2 IRMS data of analogue ocean world seawaters to validate an ML approach to provide biogeochemical context for biosignature detection. We employ a feature selection method called nearest-neighbor projected distance regression (NPDR) that detects statistical interactions and helps elucidate the mechanisms of the Random Forest classification models. Results: We train and validate predictive ML models on volatile CO2 IRMS data of analogue ocean world seawaters to predict major salt components (e.g., MgSO4, NaHCO3), pH, ionic strength, and the presence of biosignatures. Features derived from IRMS measurements are augmented with extracted time-series features. Our results show high test accuracy and interpretability, which is increased by interaction network visualization, sample-wise variable importance scores, and single-sample class probability estimates. We demonstrate an ML mission software solution that triggers autonomous data transmission and biogeochemical sample prediction.

geochemistry↗

X-Ray Microtomography Measurements of Coevolving Particle Size and Shape

This study measures simultaneous changes in particle size and shape during grain crushing and proposes quantitative metrics to track their coevolving statistical distribution. Idealized granular materials with widely different initial particle shapes (i.e., spheres, quasi-ellipsoids, plates, and rods) are compressed oedometrically at vertical stress levels sufficient to induce particle breakage. X-ray microtomography and digital image analysis are then used to track changes in particle-scale characteristics. The observations indicate that more irregular particles tend to exhibit a higher degree of breakage compared to more spherical grains subjected to an equivalent stress level. Despite these differences, the measurements also indicate that all the tested particle sets approach a common attractor (expressed in terms of aspect ratio, flatness, and elongation), regardless of their initial morphology. A new shape evolution index is proposed to quantify such trends. With this new metric, it is shown that in all the tested materials, the particle shape evolves faster than size, especially for the more regular morphologies, thus implying that the shape tends to reach its attractor point before the grading reaches its ultimate particle size distribution. Furthermore, this finding underpins an ultimate stage of crushing-driven compression that occurs with particle size reduction but minimal shape changes (i.e., self-replicating shapes due to fractures).

Oedometric compression↗

Emerging opportunities for hybrid perovskite solar cells using machine learning

While there are several bottlenecks in hybrid organic–inorganic perovskite (HOIP) solar cell production steps, including composition screening, fabrication, material stability, and device performance, machine learning approaches have begun to tackle each of these issues in recent years. Different algorithms have successfully been adopted to solve the unique problems at each step of HOIP development. Specifically, high-throughput experimentation produces vast amount of training data required to effectively implement machine learning methods. Here, we present an overview of machine learning models, including linear regression, neural networks, deep learning, and statistical forecasting. Experimental examples from the literature, where machine learning is applied to HOIP composition screening, thin film fabrication, thin film characterization, and full device testing, are discussed. These paradigms give insights into the future of HOIP solar cell research. As databases expand and computational power improves, increasingly accurate predictions of the HOIP behavior are becoming possible.

Hering, Abigail R. (ORCID:0000000270806953)↗

Controlling and leveraging small-scale information in tomographic galaxy–galaxy lensing

ABSTRACT The tangential shear signal receives contributions from physical scales in the galaxy–matter correlation function well below the transverse scale at which it is measured. Since small scales are difficult to model, this non-locality has generally required stringent scale cuts or new statistics for cosmological analyses. Using the fact that uncertainty in these contributions corresponds to an uncertainty in the enclosed projected mass around the lens, we provide an analytic marginalization scheme to account for this. Our approach enables the inclusion of measurements on smaller scales without requiring numerical sampling over extra free parameters. We extend the analytic marginalization formalism to retain cosmographic (shear-ratio) information from small-scale measurements that would otherwise be removed due to modelling uncertainties, again without requiring the addition of extra sampling parameters. We test the methodology using simulated likelihood analysis of a Dark Energy Survey Year 5-like galaxy–galaxy lensing and galaxy clustering datavector. We demonstrate that we can remove parameter biases due to the presence of an unmodelled one-halo contamination of the galaxy–galaxy lensing signal, and use the shear-ratio information on small scales to improve cosmological parameter constraints.

79 ASTRONOMY AND ASTROPHYSICS↗

Pion and kaon PDFs from lattice QCD via large momentum effective theory and short-distance factorization

In this paper, we present a first-principles lattice-QCD calculation of the unpolarized quark PDF for the pion and the kaon. The lattice data rely on matrix elements calculated for boosted mesons coupled to non-local operators containing a Wilson line. The calculations on this lattice ensemble correspond to two degenerate light, a strange, and a charm quark (𝑁 𝑓 = 2 + 1 + 1), using maximally twisted mass fermions with a clover term. The lattice volume is 32 3 × 64, with a lattice spacing of 0.0934 fm, and a pion mass of 260 MeV. Matrix elements are calculated for hadron boosts of |𝑃 3 | = 0, 0.41, 0.83, 1.25, 1.66, and 2.07 GeV. To match lattice QCD results to their light-cone counterparts, we employ two complementary frameworks: the large-momentum effective theory (LaMET) and the short-distance factorization (SDF). Using these approaches in parallel, we also test the lattice data to identify methodology-driven systematics. Results are presented for the standard quark PDFs, as well as the valence sector. Beyond obtaining the PDFs, we also explore the possibility of extracting information on SU(3) flavor-symmetry-breaking effects. For LaMET, we also parametrize the momentum dependence to obtain the infinite-momentum PDFs. Since the present calculation is performed on a single ensemble at a pion mass of 260 MeV and fixed lattice spacing, the uncertainties reported are statistical only, and systematic uncertainties remain to be addressed in future multi-ensemble studies.

Miller, Joshua [Temple University, Philadelphia, P↗

Case Studies for the Statistical Design of Experiments Applied to Powered Rotor Wind Tunnel Tests

The application of statistical Design of Experiments (DOE) to helicopter wind tunnel testing was explored during two powered rotor wind tunnel entries during the summers of 2012 and 2013. These tests were performed jointly by the U.S. Army Aviation Development Directorate Joint Research Program Office and NASA Rotary Wing Project Office, currently the Revolutionary Vertical Lift Project, at NASA Langley Research Center located in Hampton, Virginia. Both entries were conducted in the 14- by 22-Foot Subsonic Tunnel with a small portion of the overall tests devoted to developing case studies of the DOE approach as it applies to powered rotor testing. A 16-47 times reduction in the number of data points required was estimated by comparing the DOE approach to conventional testing methods. The average error for the DOE surface response model for the OH-58F test was 0.95 percent and 4.06 percent for drag and download, respectively. The DOE surface response model of the Active Flow Control test captured the drag within 4.1 percent of measured data. The operational differences between the two testing approaches are identified, but did not prevent the safe operation of the powered rotor model throughout the DOE test matrices.

Overmeyer, Austin D.↗

Whose Gas is it anyway? Differentiating the Source of a Large Soil Vapor Plume beneath Two Adjacent Waste Sites - 20487

DOE contractor CH2M Hill Plateau Remediation Company is currently responsible for conducting groundwater contamination monitoring at several RCRA treatment, storage, and disposal units located on the Hanford Site in Richland, Washington State. The Nonradioactive Dangerous Waste Landfill treatment, storage, and disposal unit presents a distinct groundwater monitoring problem because of a large multi-contaminant soil vapor plume beneath it that is a likely source of low-level volatile organic compound groundwater contamination. Adjacent to Nonradioactive Dangerous Waste Landfill is the Solid Waste Landfill. Volatile organic compounds are inventory components of both the Nonradioactive Dangerous Waste Landfill and the Solid Waste Landfill. Therefore, it is possible that both sites could be contributing to the soil vapor plume. For regulatory purposes, it is important to differentiate which site is the primary contributor of volatile organic compounds to the plume. An approach was developed to identify the primary volatile organic compound source of the soil vapor plume beneath Nonradioactive Dangerous Waste Landfill and Solid Waste Landfill. The site conceptual model hypothesis of vapor-phase volatile organic compound transport to the dissolved phase in groundwater was tested by a simple mathematical model of vapor/liquid equilibrium concentrations at the groundwater/air interface. Once it was shown that vapor-phase volatile organic compound transport to groundwater was a valid conceptual model for Nonradioactive Dangerous Waste Landfill and Solid Waste Landfill, spatial and statistical methods were used to determine the primary site contributing to the majority of volatile organic compounds to the soil vapor plume. Average groundwater chloroform, tetrachloroethene, and trichloroethene concentrations from Nonradioactive Dangerous Waste Landfill and Solid Waste Landfill monitoring network wells were plotted on maps of the facilities and immediate vicinities and compared to soil vapor sampling probe locations. Principal component analysis and mixing ratios were used to identify source contributions of each treatment, storage, and disposal unit to the plume. Results of the vapor/liquid equilibrium concentrations mathematical model showed that transport phenomena outweigh steady-state equilibria. Estimated vapor/liquid equilibrium concentrations were considerably lower than soil vapor measurements. The results indicate that dynamic vadose zone and groundwater factors such as decreased vapor concentrations with depth, vapor dilution from dispersion in the vadose zone, and advective and diffusional volatile organic compound dilution in groundwater result in groundwater volatile organic compound concentrations much less than would be measured under steady-state equilibrium conditions. Site source contribution differentiation by principal component analysis and mixing ratios was inconclusive using actual soil gas data because of the similarity in concentration values in both datasets for Nonradioactive Dangerous Waste Landfill and Solid Waste Landfill. Similar data populations suggest mixing of the vapor contributions from both sites by dispersion through the soil matrix pore spaces. However, when groundwater volatile organic compound data were compared between the Nonradioactive Dangerous Waste Landfill and Solid Waste Landfill monitoring networks, Solid Waste Landfill mean concentrations were higher, suggesting more vapor-phase volatile organic compound transport to groundwater at those locations. Simulated volatile organic compound soil vapor and groundwater datasets created to test the methods developed for this study show that the method can be successful in source differentiation when significantly different datasets are compared. This paper will describe a method of testing a conceptual model for vapor-phase contaminant transport to groundwater and for differentiating site sources of contaminants comprising a mixed-constituent soil vapor plume. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Optimal band selection for target detection with a LWIR multispectral imager

Multispectral imaging can offer many benefits in cost, complexity, resolution, size, weight, and power, relative to hyperspectral imaging. When designing a multispectral system, spectral bandpasses can be selected using optimization algorithms configured to maximally separate target detection scores between target and background regions. A hyperspectral image (HSI) can serve as the source of data from which band groupings can be tested for optimality. The output of an adaptive cosine estimator target detection algorithm is used in an objective function. Three optimization algorithms are compared: particle swarm, dual annealing, and differential evolution. A global optimum is also found using a brute force approach on the Livermore Computing Syrah supercomputer. Three materials are investigated: calcite, gypsum, and limestone. This is done for 3-, 4-, and 5-band systems. The data originate from a longwave infrared HSI of a material display board. The optimization algorithms were run 30 times for every scenario. Performance statistics (maximum, minimum, mean, standard deviation, and median) based on the separation values are given. Additional characterization was performed using receiver operator characteristic (ROC) curves and the area under the ROC curve. While good performance was obtained for the three optimization algorithms, the dual annealing algorithm produced the highest and most consistent detection separation scores on average.

47 OTHER INSTRUMENTATION↗

Progress in modeling atmospheric propagation of sonic booms

The improved simulation of sonic boom propagation through the real atmosphere requires greater understanding of how the transient acoustic pulses popularly termed sonic booms are affected by humidity and turbulence. A realistic atmosphere is invariably somewhat turbulent, and may be characterized by an ambient fluid velocity v and sound speed c that vary from point to point. The absolute humidity will also vary from point to point, although possibly not as irregularly. What is ideally desired is a relatively simple scheme for predicting the probable spreads in key sonic boom signature parameters. Such parameters could be peak amplitudes, rise times, or gross quantities obtainable by signal processing that correlate well with annoyance or damage potential. The practical desire for the prediction scheme is that it require a relatively small amount of knowledge, possibly of a statistical nature, concerning the atmosphere along, the propagation path from the aircraft to the ground. The impact of such a scheme, if developed, implemented, and verified, would be that it would give the persons who make planning decisions a tool for assessing the magnitude of environmental problems that might result from any given overflight or sequence of overflights. The technical approach that has been followed by the author and some of his colleagues is to formulate a hierarchy of simple approximate models based on fundamental physical principles and then to test these models against existing data. For propagation of sonic booms and of other types of acoustic pulses in nonturbulent model atmospheres, there exists a basic overall theoretical model that has evolved as an outgrowth of geometrical acoustics. This theoretical model depicts the sound as propagating within ray tubes in a manner analogous to sound in a waveguide of slowly varying cross-section. Propagation along the ray tube is quasi-one-dimensional, and a wave equation for unidirectional wave propagation is used. A nonlinear term is added to this equation to account for nonlinear steepening, and the formulation has been carried through to allow for spatially varying sound speed, ambient density, and ambient wind velocities. The model intrinsically neglects diffraction, so it cannot take into account what has previously been mentioned in the literature as possibly important mechanisms for turbulence-related distortion. The model as originally developed could predict an idealized N-waveform which often agrees with data in terms of peak amplitude and overall positive phase duration. It is possible, moreover, to develop simple methods based on the physics of relaxation processes for incorporating molecular relaxation into the quasi-one-dimensional model of nonlinear propagation along ray tubes.

Pierce, Allan D.↗

Enhanced data validation strategy of air quality monitoring network

Quick validation and detection of faults in measured air quality data is a crucial step towards achieving the objectives of air quality networks. Therefore, the objectives of this paper are threefold: (i) to develop a modeling technique that can be used to predict the normal behavior of air quality variables and help provide accurate reference for monitoring purposes; (ii) to develop fault detection method that can effectively and quickly detect any anomalies in measured air quality data. For this purpose, a new fault detection method that is based on the combination of generalized likelihood ratio test (GLRT) and exponentially weighted moving average (EWMA) will be developed. GLRT is a well-known statistical fault detection method that relies on maximizing the detection probability for a given false alarm rate. In this paper, we propose to develop GLRT-based EWMA fault detection method that will be able to detect the changes in the values of certain air quality variables; (iii) to develop fault isolation and identification method that allows defining the fault source(s) in order to properly apply appropriate corrective actions. In this paper, reconstruction approach that is based on Midpoint-Radii Principal Component Analysis (MRPCA) model will be developed to handle the types of data and models associated with air quality monitoring networks. All air quality modeling, fault detection, fault isolation and reconstruction methods developed in this paper will be validated using real air quality data (such as particulate matter, ozone, nitrogen and carbon oxides measurement).

54 ENVIRONMENTAL SCIENCES↗

Guiding the choice of informatics software and tools for lipidomics research applications

Progress in mass spectrometry lipidomics has led to a rapid proliferation of studies across biology and biomedicine. These generate extremely large raw datasets requiring sophisticated solutions to support automated data processing. To address this, numerous software tools have been developed and tailored for specific tasks. However, for researchers, deciding which approach best suits their application relies on ad hoc testing, which is inefficient and time consuming. Here we first review the data processing pipeline, summarizing the scope of available tools. Next, to support researchers, LIPID MAPS provides an interactive online portal listing open-access tools with a graphical user interface. This guides users towards appropriate solutions within major areas in data processing, including (1) lipid-oriented databases, (2) mass spectrometry data repositories, (3) analysis of targeted lipidomics datasets, (4) lipid identification and (5) quantification from untargeted lipidomics datasets, (6) statistical analysis and visualization, and (7) data integration solutions. Detailed descriptions of functions and requirements are provided to guide customized data analysis workflows.

59 BASIC BIOLOGICAL SCIENCES↗

Seismic moment tensor classification using elliptical distribution functions on the hypersphere

Discrimination of underground explosions from naturally occurring earthquakes and other anthropogenic sources is one of the fundamental challenges of nuclear explosion monitoring. In an operational setting, the number of events that can be thoroughly investigated by analysts is limited by available resources. The capability to rapidly screen out events that can be robustly identified as not being explosions is, therefore, of great potential benefit. Nevertheless, possible mis-classification of explosions as earthquakes currently limits the use of screening methods for verification of test-ban treaties. Moment tensors provide a physics-based classification tool for the characterization of different seismic sources and have enabled the advent of new techniques for discriminating between earthquakes and explosions. Following normalization and projection of their six-degree vectors onto the hypersphere, existing screening approaches use spherically symmetric metrics to determine whether any new moment tensor may have been an explosion. Here, we show that populations of moment tensors for both earthquakes and explosions are anisotropically distributed on the hypersphere. Distributions possessing elliptical symmetry, such as the scaled von Mises–Fisher distribution, therefore provide a better description of these populations than the existing spherically symmetric models. We describe a method that uses these elliptical distributions in combination with a Bayesian classifier to achieve successful classification rates of 99 per cent for explosions and 98 per cent for earthquakes using existing catalogues of events from the western United States. The 1983 May 5 Crowdie underground nuclear test and 2018 July 20 DAG-1 deep-borehole chemical explosion are the only two explosions out of 140 that are incorrectly classified. Application of the method to the 2006–2017 nuclear tests in the Democratic People’s Republic of Korea yields 100 per cent identification rates and we provide a simple routine MTid for general usage. The approach provides a means to rapidly assess the likelihood of an event being an explosion and can be built into monitoring workflows that rely on simultaneously assessing multiple different discrimination metrics.

58 GEOSCIENCES↗

Deep Learning Experiments for Tropical Cyclone Intensity Forecasts

Reducing tropical cyclone (TC) intensity forecast errors is a challenging task that has interested the operational forecasting and research community for decades. To address this, we developed a deep learning (DL)-based multilayer perceptron (MLP) TC intensity prediction model. The model was trained using the global Statistical Hurricane Intensity Prediction Scheme (SHIPS) predictors to forecast the change in TC maximum wind speed for the Atlantic basin. In the first experiment, a 24-h forecast period was considered. To overcome sample size limitations, we adopted a leave one year out (LOYO) testing scheme, where a model is trained using data from all years except one and then evaluated on the year that is left out. When tested on 2010–18 operational data using the LOYO scheme, the MLP outperformed other statistical–dynamical models by 9%–20%. Additional independent tests in 2019 and 2020 were conducted to simulate real-time operational forecasts, where the MLP model again outperformed the statistical–dynamical models by 5%–22% and achieved comparable results as HWFI. The MLP model also correctly predicted more rapid intensification events than all the four operational TC intensity models compared. In the second experiment, we developed a lightweight MLP for 6-h intensity predictions. When coupled with a synthetic TC track model, the lightweight MLP generated realistic TC intensity distribution in the Atlantic basin. Therefore, the MLP-based approach has the potential to improve operational TC intensity forecasts, and will also be a viable option for generating synthetic TCs for climate studies.

58 GEOSCIENCES↗

Launch Vehicle Propulsion Design with Multiple Selection Criteria

The approach and techniques described herein define an optimization and evaluation approach for a liquid hydrogen/liquid oxygen single-stage-to-orbit system. The method uses Monte Carlo simulations, genetic algorithm solvers, a propulsion thermo-chemical code, power series regression curves for historical data, and statistical models in order to optimize a vehicle system. The system, including parameters for engine chamber pressure, area ratio, and oxidizer/fuel ratio, was modeled and optimized to determine the best design for seven separate design weight and cost cases by varying design and technology parameters. Significant model results show that a 53% increase in Design, Development, Test and Evaluation cost results in a 67% reduction in Gross Liftoff Weight. Other key findings show the sensitivity of propulsion parameters, technology factors, and cost factors and how these parameters differ when cost and weight are optimized separately. Each of the three key propulsion parameters; chamber pressure, area ratio, and oxidizer/fuel ratio, are optimized in the seven design cases and results are plotted to show impacts to engine mass and overall vehicle mass.

Shelton, Joey D.↗