Search NASA⌕ Search

SEARCH · Search NASA

Results for “Statistical Testing Approach”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 739 records · Page 41

Statistical characterization of life drivers for a probabilistic design analysis

This paper discusses the issue of statistical characterization of life drivers for a probabilistic design analysis (PDA) approach to support the conventional deterministic structural design methods that are currently used. The probabilistic approach takes into consideration the modeling inadequacies and uncertainties in many design variables such as loads, environments, and material properties. The importance of the distributional assumption is motivated by illustrating an example where the results differ substantially due to the distribution selected. Different types of distributions are discussed and techniques for estimating the parameters are given. Given this information, procedures are outlined for selecting the appropriate distribution based on the particular type of variable (i.e., dimensional, performance) as well as the information that is available (i.e., test data, engineering analysis). Finally, techniques are given for generating random numbers from these selected distributions within the PDA process.

Fox, Eric P.↗

Real-Time Parameter Estimation for Flexible Aircraft

A method for estimating aeroelastic stability and control derivatives for flexible aircraft is developed and demonstrated using flight test data for the X-56A subscale demonstrator. The method uses the equation-error approach with frequency-domain data, and can be applied post-flight or in real time during flight. The non-dimensional aeroelastic forces and moments and the explanatory variables (including generalized displacement, rate, and acceleration states for the vibration modes) are estimated using a finite element model and onboard sensor measurements in both a least squares and Kalman filtering framework. The data are then transformed into the frequency domain for parameter estimation using equation error. This method can result in a more efficient analysis than with other iterative methods, and can leverage existing statistical tools for model structure determination, data collinearity detection, combining multiple maneuvers or prior information, and others to improve model quality.

Grauer, Jared A.↗

Bringing Climate Scientist's Tools into Classrooms to Improve Conceptual Understandings

Efforts to address anthropogenic global climate change (AGCC) require public understanding of Earth and climate science. To meet this need, educational reforms and prominent scientists have called for instructional approaches that teach students how climate scientists examine AGCC. Yet, only a few educational studies have reported clear empirical results on what instructional approaches and climate education technologies best accomplish this goal. This manuscript presents detailed analysis and statistically significant results on the educational impact pre to post of students learning to use a National Aeronautics and Space Administration (NASA) global climate model (GCM). This series of case studies demonstrates that differing instructional approaches and climate education technologies result in differing levels of understanding of AGCC and ability to engage with policies addressing it. Students who learned the scientific process of climate modeling scored significantly higher pre to post on exams (quantitatively) and gained more complete conceptual understandings of the issue (qualitatively). Yet, teaching students to conduct research with complex technology can be difficult. This study also found lecture-based learning better improved recall of facts about GCMs tested by multiple-choice questions. Our findings indicate what educational systems and related technologies might provide the public with the conceptual understandings necessary to engage in the political debate over AGCC.

Public understanding↗

Infusing Statistical Thinking into the NASA Quesst Community Test Campaign

Statistical thinking permeates many important decisions as NASA plans its Quesst mission, which will culminate in a series of community overflights using the X-59 aircraft to demonstrate low-noise supersonic flight. Month-long longitudinal surveys will be deployed to assess human perception and annoyance to this new acoustic phenomenon. NASA works with a large contractor team to develop systems and methodologies to estimate noise doses, to test and field socio-acoustic surveys, and to study the relationship between the two quantities, dose and response, through appropriate choices of statistical models. This latter dose-response relationship will serve as an important tool as national and international noise regulators debate whether overland supersonic flights could be permitted once again within permissible noise limits. In this presentation we highlight several areas where statistical thinking has come into play, including issues of sampling, classification and data fusion, and analysis of longitudinal survey data that are subject to rare events and the consequences of measurement error. We note several operational constraints that shape the appeal or feasibility of some decisions on statistical approaches, and we identify several important remaining questions to be addressed.

Bayesian model↗

The Dark Energy Survey supernova program: cosmological biases from supernova photometric classification

ABSTRACT Cosmological analyses of samples of photometrically identified type Ia supernovae (SNe Ia) depend on understanding the effects of ‘contamination’ from core-collapse and peculiar SN Ia events. We employ a rigorous analysis using the photometric classifier SuperNNova on state-of-the-art simulations of SN samples to determine cosmological biases due to such ‘non-Ia’ contamination in the Dark Energy Survey (DES) 5-yr SN sample. Depending on the non-Ia SN models used in the SuperNNova training and testing samples, contamination ranges from 0.8 to 3.5 per cent, with a classification efficiency of 97.7–99.5 per cent. Using the Bayesian Estimation Applied to Multiple Species (BEAMS) framework and its extension BBC (‘BEAMS with Bias Correction’), we produce a redshift-binned Hubble diagram marginalized over contamination and corrected for selection effects, and use it to constrain the dark energy equation-of-state, w. Assuming a flat universe with Gaussian ΩM prior of 0.311 ± 0.010, we show that biases on w are <0.008 when using SuperNNova, with systematic uncertainties associated with contamination around 10 per cent of the statistical uncertainty on w for the DES-SN sample. An alternative approach of discarding contaminants using outlier rejection techniques (e.g. Chauvenet’s criterion) in place of SuperNNova leads to biases on w that are larger but still modest (0.015–0.03). Finally, we measure biases due to contamination on w0 and wa (assuming a flat universe), and find these to be <0.009 in w0 and <0.108 in wa, 5 to 10 times smaller than the statistical uncertainties for the DES-SN sample.

79 ASTRONOMY AND ASTROPHYSICS↗

Estimating the Adequacy of a Multi-Objective Optimization

Multi-objective optimization methods can be criticized for lacking a statistically valid measure of the quality and representativeness of a solution. This stance is especially relevant to metaheuristic optimization approaches but can also apply to other methods that typically might only report a small representative subset of a Pareto frontier. Here we present a method to address this deficiency based on random sampling of a solution space to determine, with a specified level of confidence, the fraction of the solution space that is surpassed by an optimization. The Superiority of Multi-Objective Optimization to Random Sampling, or SMORS method, can evaluate quality and representativeness using dominance or other measures, e.g., a spacing measure for high-dimensional spaces. SMORS has been tested in a combinatorial optimization context using a genetic algorithm but could be useful for other optimization methods.

42 ENGINEERING↗

A Systems Approach to Increasing Carbon Flux to Seed Oil for Biofuels and Bioproducts Production in Camelina sativa (Final Report)

To combat climate change and alleviate the dependency of the United States on fossil fuels, the transition to biofuel crops has long been proposed as a crucial part of the long-term solution. Camelina sativa has emerged as one of the leading commercially viable options for biofuel and bioproduct production for the U.S. Camelina has the advantages of low agronomic inputs and natural resistance to diverse biotic and abiotic stresses relative to other oilseed crops, and Camelina oil-based blends have been tested and approved as liquid transportation fuels. A major limitation in the widespread adoption of Camelina as a viable industrial oilseed crop is its modest oil yields. This project directly investigated possible paths towards increasing oil, by employing tissue-specific and whole plant systems approaches to identify major regulatory bottlenecks. We developed a new high-throughput method for the identification of multi-gene transformants in polyploid species like Camelina sativa and used this to determine that, contrary to what mathematical models suggested, introduction of the microbial Entner-Doudoroff (ED) pathway into Camelina sativa did not result in significant seed oil increases. We developed flux maps providing accurate and statistically robust models of central carbon metabolism in Camelina, including of cultured Camelina embryos. This knowledge was used in the capacitation of a number of junior researchers in gaining knowledge on approaches used for quantitative flux map analyses. We identified several novel Camelina transcription factor genes regulating fatty acid biosynthesis that showed variable effects on seed oil accumulation in transgenic plants. Among a number of community resources, we also developed a knowledge base web resource (CamRegBase) to integrate Camelina gene regulatory information. Together, research outcomes from this project have contributed to a much better understanding of the regulation and bottlenecks to engineer seed oil production in Camelina.

09 BIOMASS FUELS↗

Broadband Liner Optimization for the Source Diagnostic Test Fan

The broadband component of fan noise has grown in relevance with the utilization of increased bypass ratio and advanced fan designs. Thus, while the attenuation of fan tones remains paramount, the ability to simultaneously reduce broadband fan noise levels has become more appealing. This paper describes a broadband acoustic liner optimization study for the scale model Source Diagnostic Test fan. Specifically, in-duct attenuation predictions with a statistical fan source model are used to obtain optimum impedance spectra over a number of flow conditions for three liner locations in the bypass duct. The predicted optimum impedance information is then used with acoustic liner modeling tools to design liners aimed at producing impedance spectra that most closely match the predicted optimum values. Design selection is based on an acceptance criterion that provides the ability to apply increased weighting to specific frequencies and/or operating conditions. Typical tonal liner designs targeting single frequencies at one operating condition are first produced to provide baseline performance information. These are followed by multiple broadband design approaches culminating in a broadband liner targeting the full range of frequencies and operating conditions. The broadband liner is found to satisfy the optimum impedance objectives much better than the tonal liner designs. In addition, the broadband liner is found to provide better attenuation than the tonal designs over the full range of frequencies and operating conditions considered. Thus, the current study successfully establishes a process for the initial design and evaluation of novel broadband liner concepts for complex engine configurations.

Nark, Douglas M.↗

Seeking Repeating Anthropogenic Seismic Sources: Implications for Seismic Velocity Monitoring at Fault Zones

Abstract Seismic velocities in rocks are highly sensitive to changes in permanent deformation and fluid content. The temporal variation of seismic velocity during the preparation phase of earthquakes has been well documented in laboratories but rarely observed in nature. It has been recently found that some anthropogenic, high‐frequency (>1 Hz) seismic sources are powerful enough to generate body waves that travel down to a few kilometers and can be used to monitor fault zones at seismogenic depth. Anthropogenic seismic sources typically have fixed spatial distribution and provide new perspectives for velocity monitoring. In this work, we propose a systematic workflow to seek such powerful seismic sources in a rapid and straightforward manner. We tackle the problem from a statistical point of view, considering that persistent, powerful seismic sources yield highly coherent correlation functions (CFs) between pairs of seismic sensors. The algorithm is tested in California and Japan. Multiple sites close to fault zones show high‐frequency CFs stable for an extended period of time. These findings have great potential for monitoring fault zones, including the San Jacinto Fault and the Ridgecrest area in Southern California, Napa in Northern California, and faults in central Japan. However, extra steps, such as beamforming or polarization analysis, are required to determine the dominant seismic sources and study the source characteristics, which are crucial to interpreting the velocity monitoring results. Train tremors identified by the present approach have been successfully used for seismic velocity monitoring of the San Jacinto Fault in previous studies.

58 GEOSCIENCES↗

Image feature extraction and galaxy classification: a novel and efficient approach with automated machine learning

ABSTRACT In this work, we explore the possibility of applying machine learning methods designed for 1D problems to the task of galaxy image classification. The algorithms used for image classification typically rely on multiple costly steps, such as the point spread function deconvolution and the training and application of complex Convolutional Neural Networks of thousands or even millions of parameters. In our approach, we extract features from the galaxy images by analysing the elliptical isophotes in their light distribution and collect the information in a sequence. The sequences obtained with this method present definite features allowing a direct distinction between galaxy types. Then, we train and classify the sequences with machine learning algorithms, designed through the platform Modulos AutoML. As a demonstration of this method, we use the second public release of the Dark Energy Survey (DES DR2). We show that we are able to successfully distinguish between early-type and late-type galaxies, for images with signal-to-noise ratio greater than 300. This yields an accuracy of $86{{\ \rm per\ cent}}$ for the early-type galaxies and $93{{\ \rm per\ cent}}$ for the late-type galaxies, which is on par with most contemporary automated image classification approaches. The data dimensionality reduction of our novel method implies a significant lowering in computational cost of classification. In the perspective of future data sets obtained with e.g. Euclid and the Vera Rubin Observatory, this work represents a path towards using a well-tested and widely used platform from industry in efficiently tackling galaxy classification problems at the peta-byte scale.

79 ASTRONOMY AND ASTROPHYSICS↗

The Clustering of Galaxies in the Completed SDSS-III Baryon Oscillation Spectroscopic Survey: Cosmic Flows and Cosmic Web from Luminous Red Galaxies

We present a Bayesian phase-space reconstruction of the cosmic large-scale matter density and velocity fields from the Sloan Digital Sky Survey-III Baryon Oscillations Spectroscopic Survey Data Release 12 CMASS galaxy clustering catalogue. We rely on a given Λ cold dark matter cosmology, a mesh resolution in the range of 6-10 h -1 Mpc, and a lognormal-Poisson model with a redshift-dependent non-linear bias. The bias parameters are derived from the data and a general renormalized perturbation theory approach. We use combined Gibbs and Hamiltonian sampling, implemented in the ARGO code, to iteratively reconstruct the darkmatter density field and the coherent peculiar velocities of individual galaxies, correcting hereby for coherent redshift space distortions. Our tests relying on accurate N-body-based mock galaxy catalogues show unbiased real space power spectra of the non-linear density field up to k ~ 0.2 h Mpc -1 , and vanishing quadrupoles down to r ~ 20 h -1 Mpc. We also demonstrate that the non-linear cosmic web can be obtained from the tidal field tensor based on the Gaussian component of the reconstructed density field. We find that the reconstructed velocities have a statistical correlation coefficient compared to the true velocities of each individual lightcone mock galaxy of r ~ 0.68 including about 10 per cent of satellite galaxies with virial motions (about r = 0.75 without satellites). The power spectra of the velocity divergence agree well with theoretical predictions up to k ~ 0.2 h Mpc -1 . This work will be especially useful to improve, for example, baryon acoustic oscillation reconstructions, kinematic Sunyaev- Zeldovich, integrated Sachs-Wolfe measurements or environmental studies.

Ata, Metin↗

CIGS Technology Advancement via Fundamental Modeling of Defect/Impurity Interactions (Final Technical Report)

The primary goals of the proposed work were to provide modeling tools (and the associated insight which comes along with model development) for design and optimization of CuIn x Ga 1-x Se 2 (CIGS) and CdSeTe (CST) solar cell manufacturing processes and to establish the foundation for comprehensive end-to-end predictive modeling tools to enable optimization of thin film photovoltaic technology for performance, cost, yield, and reliability. The initial focus of efforts within this project was to develop coupled process/optical/device models for CIGS PV technology and to work with Siva Power to apply that TCAD (technology computer-aided design) system to improve the efficiency and reduce manufacturing costs for CIGS solar cells. Our approach to that end was to generate an extensive database of DFT calculations and to use those calculations via statistical thermodynamics methods and Monte Carlo simulation to develop and characterize models for the behavior of native defects as well as intentional and unintentional impurities, including the redistribution of the primary components of CIGS films. Increased effort went toward coupling those models for defect behavior and composition evolution to the performance of multicrystalline CIGS solar cells via prediction of doping level and recombination lifetime as function of manufacturing process. In the second budget period, the project pivoted to developing a similar system for the CdSeTe system, focused especially on understanding the role of Se/Te alloy concentration. Execution of the project resulted in the successful development of TCAD systems for both CIGS and CdSeTe thin film PV within the Synopsys Sentaurus framework by utilizing the Alagator interface. In the first budget period of the project, we developed quantitative models for the major components of CIGS PV and implemented them within a framework that couples process, optical, and device simulation. From the insights we have gained, we identified novel opportunities for enhancing CIGS solar cell performance and have laid the groundwork to further optimize the layer structure, composition profile, and thermal cycles for substantially improved efficiency and lower manufacturing costs. For the CIGS system, process changes to achieve greater than 1% absolute enhancement in efficiency were identified, but testing of those approaches was stymied by lack of a domestic CIGS manufacturing partner after the closure of Siva Power as well as Miasole. For CdSeTe, a fully capable TCAD system only became ready to apply near the end of the project period, so substantial opportunities remain to apply those models to enhance the leading thin film PV technology.

14 SOLAR ENERGY↗

Uncertainty-Aware, Structure-Preserving Machine Learning Approach for Domain Shift Detection From Nonlinear Dynamic Responses of Structural Systems

Complex structural systems deployed for aerospace, civil, or mechanical applications must operate reliably under varying operational conditions. Structural health monitoring (SHM) systems help ensure the reliability of these systems by providing continuous monitoring of the state of the structure. SHM relies on synthesizing measured data with a predictive model to make informed decisions about structural states. However, these models—which may be thought of as a form of a digital twin—need to be updated continuously as structural changes (e.g., due to damage) arise. We propose an uncertainty-aware machine learning model that enforces distance preservation of the original input state space and then encodes a distance-aware mechanism via a Gaussian process (GP) kernel. The proposed approach leverages the spectral-normalized neural GP algorithm to combine the flexibility of neural networks with the advantages of GP, subjected to structure-preserving constraints, to produce an uncertainty-aware model. This model is used to detect domain shift due to structural changes that cannot be observed directly because they may be spatially isolated (e.g., inside a joint or localized damage). This work leverages detection theory to detect domain shift systematically given statistical features of the prediction variance produced by the model. The proposed approach is demonstrated on a nonlinear structure being subjected to damage conditions. In conclusion, it is shown that the proposed approach is able to rely on distances of the transformed input state space to predict increased variance in shifted domains while being robust to normative changes.

Algorithms↗

Benchmarking FFTF LOFWOS Test# 13 using SAM code: Baseline model development and uncertainty quantification

The development and deployment of advanced reactors, such as the sodium-cooled fast reactor (SFR), relies on sophisticated modeling tools to ensure the safety of the design under various transients. The predictive capability of these advanced modeling tools requires validation to garner trust in supporting the licensing of the advanced reactors. For this reason, the International Atomic Energy Agency (IAEA) initiated a coordinated research project (CRP) in 2018 for the analysis of the Fast Flux Test Facility (FFTF) Loss of Flow Without Scram (LOFWOS) Test #13.In this study, we present and discuss the benchmarking efforts of the modern system code SAM on the FFTF LOFWOS Test #13. Further, the SAM baseline model was developed according to the benchmark specification, which included a detailed core model with reactivity feedback. Generally, good agreement was observed between the baseline results and benchmark measurements; however, discrepancies persisted, particularly in predicted fuel assembly coolant outlet temperatures. Utilizing the baseline model, uncertainty quantification (UQ) and sensitivity analysis (SA) were conducted with the assistance of various statistical learning and machine learning methods, including kernel density estimation, Gaussian processes, and Sobol indices. Following the baseline model prediction and UQ and SA results, we discuss the reasons for the simulation discrepancies and propose further improvements to the model. This benchmarking effort adheres to the best-estimate plus uncertainty approach and can serve as a valuable example for supporting risk-informed licensing of advanced reactors.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Extracting forces from noisy dynamics in dusty plasmas

Extracting environmental forces from noisy data is a common yet challenging task in complex physical systems. Machine learning (ML) represents a robust approach to this problem, yet is mostly tested on simulated data with known parameters. Here we use supervised ML to extract the electrostatic, dissipative, and stochastic forces acting on micron-sized charged particles levitated in an argon plasma (dusty plasma). By tracking the sub-pixel motion of particles in subsequent images, we successfully estimated these forces from their random motion. The experiments contained important sources of non-Gaussian noise, such as drift and pixel-locking, representing a data mismatch from methods used to analyze simulated data with purely Gaussian noise. Our model was trained on simulated particle trajectories that included all of these artifacts, and used more than 100 dynamical and statistical features, resulting in a prediction with 50\% better accuracy than conventional methods. Lastly, in systems with two interacting particles, the model provided non-contact measurements of the particle charge and Debye length in the plasma environment.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Quantum and anharmonic effects in non-adiabatic transition state theory

Quantitative descriptions of non-adiabatic transition rates at intermediate temperatures are challenging due to the simultaneous importance of quantum and anharmonic effects. Here, in this paper, the interplay between quantum effects—for motion across or along the seam of crossing—and anharmonicity in the seam potential is considered within the weak coupling limit. The well-known expression for quantized 1-D motion across the seam (i.e., tunneling) in the linear terms approximation is derived in the thermal domain using the Lagrangian formalism, which is then applied to the case when tunneling is distributed along the seam of crossing (treating motion along the seam classically). For high-frequency quantum modes, a vibrationally adiabatic (VA) approach is developed that introduces to the non-adiabatic rate constant a factor associated with high-frequency wavefunction overlap; this approach treats the high-frequency motion along the seam quantum mechanically. To test these methodologies, the reaction N 2 O ↔ N 2 + O( 3 P) was chosen. CCSD(T)-F12b/cc-pVTZ-F12 explorations of the 3 A'- 1 A' seam of N 2 O revealed that seam anharmonicity has a strong effect on the rate constant (a factor of ~20 at 2000 K). Several quantum effects were found to be significant at intermediate/lower temperatures, including the quantum N–N vibration that was coupled with seam anharmonicity using the VA approach. Finally, a 1-D approximation to non-adiabatic instanton theory is presented to estimate the validity limit of the linear terms model at low temperatures (⁠~ 250 K for N 2 O). We recommend that the assumptions built into many statistical theories for non-adiabatic reactions—harmonic behavior, classical motion, linear terms, and weak coupling—should be verified on a case-by-case basis.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Evaluating proxy influence in assimilated paleoclimate reconstructions – Testing the exchangeability of two ensembles of spatial processes

Climate field reconstructions (CFR) attempt to estimate spatiotemporal fields of climate variables in the past using climate proxies such as tree rings, ice cores, and corals. Data Assimilation (DA) methods are a recent and promising new means of deriving CFRs that optimally fuse climate proxies with climate model output. Despite the growing application of DA-based CFRs, little is understood about how much the assimilated proxies change the statistical properties of the climate model data. To address this question, we propose a robust and computationally efficient method, based on functional data depth, to evaluate differences in the distributions of two spatiotemporal processes. In this study, we apply our test to study global and regional proxy influence in DA-based CFRs by comparing the background and analysis states, which are treated as two samples of spatiotemporal fields. We find that the analysis states are significantly altered from the climate-model-based background states due to the assimilation of proxies. Moreover, the difference between the analysis and background states increases with the number of proxies, even in regions far beyond proxy collection sites. Our approach allows us to characterize the added value of proxies, indicating where and when the analysis states are distinct from the background states.

54 ENVIRONMENTAL SCIENCES↗

Surrogate Models for Estimating Failure in Brittle and Quasi-Brittle Materials

In brittle fracture applications, failure paths, regions where the failure occurs and damage statistics, are some of the key quantities of interest (QoI). High-fidelity models for brittle failure that accurately predict these QoI exist but are highly computationally intensive, making them infeasible to incorporate in upscaling and uncertainty quantification frameworks. The goal of this paper is to provide a fast heuristic to reasonably estimate quantities such as failure path and damage in the process of brittle failure. Towards this goal, we first present a method to predict failure paths under tensile loading conditions and low-strain rates. The method uses a k-nearest neighbors algorithm built on fracture process zone theory, and identifies the set of all possible pre-existing cracks that are likely to join early to form a large crack. The method then identifies zone of failure and failure paths using weighted graphs algorithms. We compare these failure paths to those computed with a high-fidelity fracture mechanics model called the Hybrid Optimization Software Simulation Suite (HOSS). A probabilistic evolution model for average damage in a system is also developed that is trained using 150 HOSS simulations and tested on 40 simulations. A non-parametric approach based on confidence intervals is used to determine the damage evolution over time along the dominant failure path. For upscaling, damage is the key QoI needed as an input by the continuum models. This needs to be informed accurately by the surrogate models for calculating effective moduli at continuum-scale. We show that for the proposed average damage evolution model, the prediction accuracy on the test data is more than 90%. In terms of the computational time, the proposed models are ≈ O ( 10 6 ) times faster compared to high-fidelity fracture simulations by HOSS. These aspects make the proposed surrogate model attractive for upscaling damage from micro-scale models to continuum models. We would like to emphasize that the surrogate models are not a replacement of physical understanding of fracture propagation. The proposed method in this paper is limited to tensile loading conditions at low-strain rates. This loading condition corresponds to a dominant fracture perpendicular to tensile direction. The proposed method is not applicable for in-plane shear, out-of-plane shear, and higher strain rate loading conditions.

36 MATERIALS SCIENCE↗