Search NASA⌕ Search

SEARCH · Search NASA

Results for “Statistical Testing Approach”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 577 records · Page 32

STAT7 v2.0 User Guide

The STAT7 software was developed to perform steady-state, single-phase thermal hydraulics analysis of plate-fueled reactors based on statistical propagation of uncertainties. Application of the software includes non-power research and test reactor analysis, and it has been used for the conversion to low- enriched uranium fuel of U.S. High Performance Research Reactors such as the Massachusetts Institute of Technology Research Reactor. Since it can be necessary to repeat reactor safety analysis, such as during fuel reloading, STAT7 accommodates flexibility in analyzing many practical aspects of reactor fuel management. STAT7 uses a Monte Carlo approach to model uncertainty in common fuel fabrication parameters and other key reactor operating parameters required for reactor thermal hydraulics analysis. These safety calculations are ultimately intended to protect against high fuel plate temperatures due to critical heat flux, or onset of flow instability. STAT7 supports water properties based on the IAPWS-IF97 functions (The International Association for the Properties of Water and Steam Industrial Formulation 1997 for the Thermodynamic Properties of Water and Steam) in addition to fitted functions. STAT7 predicts axial profiles of fuel, cladding, and coolant temperature along a lateral stripe that runs the full length of the fuel plate from the bottom to the top. STAT7 can simultaneously analyze every axial node in each lateral stripe of all fuel plates and coolant channels in every fuel element of an entire reactor core. Power splits are calculated for each axial node of each plate to determine how much of the power goes out each face of the plate. In a single execution, STAT7 can be used to perform full core analysis by analyzing the margin to onset of nucleate boiling and onset of flow instability for each axial node of each stripe of each plate of each fuel element in the core.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

An analysis of defect densities found during software inspections

Software inspection is a technical evaluation process for finding and removing defects in requirements, design, code, and tests. Detailed data was collected during the first three years of experience at JPL on 203 inspections. Statistics are discussed for this set of inspections. Included, on a per inspection basis, are averages of: staff time expended, pages covered, major defects found, minor defects found, and inspection team size. Analysis of variance showed a significantly higher density of defects during requirements inspections. It was also observed, that the defect densities found decreased exponentially as the work products approached the coding phase. Increasing the pace of the inspection meeting decreased the density of defects found. This relationship was observed to hold for both major and minor defect densities, although it was more pronounced for minor defects. Guidelines are provided for conducting successful software inspections based upon three years of JPL experience.

Kelly, John C.↗

Stepwise approach to SNP-set analysis illustrated with the Metabochip and colorectal cancer in Japanese Americans of the Multiethnic Cohort

Background: Common variants have explained less than the amount of heritability expected for complex diseases, which has led to interest in less-common variants and more powerful approaches to the analysis of whole-genome scans. Because of low frequency (low statistical power), less-common variants are best analyzed using SNP-set methods such as gene-set or pathway-based analyses. However, there is as yet no clear consensus regarding how to focus in on potential risk variants following set-based analyses. We used a stepwise, telescoping approach to analyze commonand rare-variant data from the Illumina Metabochip array to assess genomic association with colorectal cancer (CRC) in the Japanese sub-population of the Multiethnic Cohort (676 cases, 7180 controls). We started with pathway analysis of SNPs that are in genes and pathways having known mechanistic roles in colorectal cancer, then focused on genes within the pathways that evidenced association with CRC, and finally assessed individual SNPs within the genes that evidenced association. Pathway SNPs downloaded from the dbSNP database were cross-matched with Metabochip SNPs and analyzed using the logistic kernel machine regression approach (logistic SNP-set kernel-machine association test, or sequence kernel association test; SKAT) and related methods. Results: The TGF-β and WNT pathways were associated with all CRC, and the WNT pathway was associated with colon cancer. Individual genes demonstrating the strongest associations were TGFBR2 in the TGF-β pathway and SMAD7 (which is involved in both the TGF-β and WNT pathways). As partial validation of our approach, a known CRC risk variant in SMAD7 (in both the TGF-β and WNT pathways: rs11874392) was associated with CRC risk in our data. We also detected two novel candidate CRC risk variants (rs13075948 and rs17025857) in TGFBR2, a gene known to be associated with CRC risk. Conclusions: A stepwise, telescoping approach identified some potentially novel risk variants associated with colorectal cancer, so it may be a useful method for following up on results of set-based SNP analyses. Further work is required to assess the statistical characteristics of the approach, and additional applications should aid in better clarifying its utility.

59 BASIC BIOLOGICAL SCIENCES↗

Evaluation of detectability and distinguishability of aircraft control element failures using flight test data

This paper examines the detectability and distinguishability of control element failures on the B-737 aircraft. The results of Weiss (1985) are used to define decentralized residuals from analytic redundancy relationships, and the results of Weiss et al. (1984) are used to define the probabilistic distance measures which provide bounds on the minimum achievable probabilities or error. The residual signals are then generated using data which were recorded during a landing approach of the NASA-Langley Advanced Transport Operations (ATOPS) transportation systems research vehicle (TSRV). The distance measures are computed using estimates of the statistics of these residual signals.

Weiss, J. L.↗

Estimation of UH-60 blade aerodynamic loads and rotor impedance using generalized strain pattern/Kalman filter approach

The purpose of the study is to develop and verify a methodology capable of predicting the vibration levels and estimating the aerodynamic loads and rotor impedance of a rotorcraft blade. Simulated flight test data is generated, blade airloads and elastic hub motions are estimated from the simulated data through the use of the Kalman filter/smoother, simulation upgrading and parameter identification are performed, and the ability to identify rotor impedance from a simulation by isolating the rotor model and providing a prescribed motion for the hub as rotor excitation is demonstrated. It is pointed out that the statistical estimation procedure utilized in the proposed methodology minimizes the impact of sensor noise, truncation error, and instrumentation bias on the results.

Bruhis, Ofer↗

Structural Qualification of Composite Airframes

The development of fundamental approaches for predicting failure and elongation characteristics of fibrous composites are summarized in this document. The research described includes a statistical formulation for individual fiber breakage and fragmentation and clustered fiber breakage, termed macrodefects wherein the aligned composite may represent a structural component such as a reinforcing bar element, a rebar. Experimental work conducted in support of the future exploitation of aligned composite rebar elements is also described. This work discusses the experimental challenges associated with rebar tensile test evaluation and describes initial numerical analyses performed in support of the experimental program.

Kedward, Keith T.↗

Frontiers in computing for artificial intelligence

An emerging diversity of computational platforms offers many different approaches to adopting the paradigm of artificial intelligence to the study of electron-ion collisions. Here we review several leading candidates in this computational frontier and their workflows for experimental applications of artificial intelligence that may impact the future Electron-Ion Collider. We discuss the motivation for exploring novel methods to solve artificial intelligence and machine learning problems including with customized devices, quantum simulation, and heterogeneous computing systems. Furthermore, these technologies offer promising approaches to address some of the leading concerns of future computing that may impact the Electron-Ion Collider but they will require further development and testing in order to support future planning efforts.

detector design and construction technologies and ↗

Statistical Approach for Determining the Sandia Array Performance Model Coefficients that Considers String-Level Mismatch

Commonly used performance models, such as PVsyst, Sandia Array Performance Model (SAPM), and PV LIB, treat the PV array as being constructed of identical modules. Each of the models attempts to account for mismatch losses by applying a simple percent reduction factor to the overall estimated power. The present work attempted to reduce uncertainty of mismatch losses by determining a representative set of performance coefficients for the SAPM that were developed from a characterization of a sample of modules. This approach was compared with current practice, where only a single module’s thermal and electrical properties are testing. However, the results indicate that minimal to no improvements in model predictions were achieved.

47 OTHER INSTRUMENTATION↗

Testing Nesting DXTRAN Spheres for Neutron Transport in Air

The deterministic transport sphere (DXTRAN sphere) is a technology that can be utilized in MCNP for improving sampling in the vicinity of a particular geometry, when the solid angle, between the source and particular geometry, is small. At a collision event, a DXTRAN particle is created and deterministically transported to the DXTRAN sphere, while the colliding particle (NONDXTRAN particle) continues transporting as if no DXTRAN event had occurred. Weight is balanced by killing the NONDXTRAN particle when traversing the DXTRAN sphere. If set up correctly, the DXTRAN particle placed on the DXTRAN sphere has a high probability of interacting with the geometry within the DXTRAN sphere. The Central Limit Theorem (CLT) states that the estimated mean approaches a normal distribution with known variance as the number of random samples grows sufficiently large. In reality the variance is seldom known and therefore must be estimated. In a Monte Carlo calculation, one must determine when the number of random samples is sufficiently large for the CLT to be satisfied. For the CLT to be satisfied, the first two moments (mean and variance) must exist. The second moment, the variance of a normal distribution is estimated. The slope test, which uses the largest 201 history scores of each tally fluctuation chart (TFC) bin fit to a Pareto function, is used to determine if the largest history scores decrease faster than 1/x{sup 3}. If the slope is less than 3, then enough histories have not yet been sampled such to meet the second moment existence requirement of the CLT. Usually, a slope of less than 3 indicates that the effects of high weight scores have not been satisfactorily sampled; such a consequence can also be manifested in examining trends in the 4. moment, the variance of the variance (VOV). For example, when examining the TFC, if the VOV is monotonically decreasing for a few sets of histories and then drastically increases for the next set of histories, chances are a rare high weight score, significantly greater than the average score, was encountered. As a result of the 1/R{sup 2} term, a point detector can achieve an extremely high weight, much greater than the average, as the distance from collision to point detector approaches zero. To remedy this difficulty, a 'radius of exclusion' is applied, where within the radius of exclusion 'the point detector estimate is assumed to be the average flux uniformly distributed'. A DXTRAN sphere can suffer from the same weight fluctuation as collisions in the vicinity of the DXTRAN sphere produce much larger weights than collisions happening far from the DXTRAN sphere. If the rare large weight put on the DXTRAN sphere then scores in a tally, there will be a significant increase in the VOV and the slope may drop below 3. To compliment that analysis, here we utilize an air composition and density that varies as a function of altitude, detailing the trials and tribulations of attempting to pass the 10 statistical checks for a variety of single and nested DXTRAN sphere approaches. The objective here is to illuminate important considerations for radiation transport problems with small solid angles in a scatter medium of few mean free paths (MFPs)

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Coherency-Constrained Spectral Clustering for Power Network Reduction

This paper presents a methodology for reducing the complexity of large-scale power network models using spectral clustering, aggregation of electrical components, and cost function approximation. Two approaches are explored using unconstrained and constrained spectral clustering to determine areas for effective system reduction. Once the system areas are determined, both loads and generators by type are aggregated, and their new cost function is approximated through polynomial curve-fitting or statistical methods. The performance of reduced networks is evaluated in terms of their ability to follow the true daily cost of the original system over a 24-hour period considering a set of several days. Two test systems are taken as test beds. Application of the methodology to a modified version of the IEEE 39-bus system reduces it from 17 generators to a 4-bus system and 9 generators with about 93% of accuracy. Similarly, the IEEE 118-bus system is reduced from 19 generators to a 3-bus system with three aggregated units achieving over 99% of accuracy. These findings address scalability challenges and enhance accuracy for high and mid-loading level conditions, and by aggregating thermal units with similar cost functions.

42 ENGINEERING↗

Statistical analysis of effective singular values in matrix rank determination

A major problem in using SVD (singular-value decomposition) as a tool in determining the effective rank of a perturbed matrix is that of distinguishing between significantly small and significantly large singular values to the end, conference regions are derived for the perturbed singular values of matrices with noisy observation data. The analysis is based on the theories of perturbations of singular values and statistical significance test. Threshold bounds for perturbation due to finite-precision and i.i.d. random models are evaluated. In random models, the threshold bounds depend on the dimension of the matrix, the noisy variance, and predefined statistical level of significance. Results applied to the problem of determining the effective order of a linear autoregressive system from the approximate rank of a sample autocorrelation matrix are considered. Various numerical examples illustrating the usefulness of these bounds and comparisons to other previously known approaches are given.

Konstantinides, Konstantinos↗

A Method for Calculating the Probability of Successfully Completing a Rocket Propulsion Ground Test

Propulsion ground test facilities face the daily challenge of scheduling multiple customers into limited facility space and successfully completing their propulsion test projects. Over the last decade NASA s propulsion test facilities have performed hundreds of tests, collected thousands of seconds of test data, and exceeded the capabilities of numerous test facility and test article components. A logistic regression mathematical modeling technique has been developed to predict the probability of successfully completing a rocket propulsion test. A logistic regression model is a mathematical modeling approach that can be used to describe the relationship of several independent predictor variables X(sub 1), X(sub 2),.., X(sub k) to a binary or dichotomous dependent variable Y, where Y can only be one of two possible outcomes, in this case Success or Failure of accomplishing a full duration test. The use of logistic regression modeling is not new; however, modeling propulsion ground test facilities using logistic regression is both a new and unique application of the statistical technique. Results from this type of model provide project managers with insight and confidence into the effectiveness of rocket propulsion ground testing.

Messer, Bradley↗

Hybrid FEA/SEA Assessment for an Orthogrid Cylindrical Panel Section and Periodic Subsystem Modeling Evaluation

In the lower frequency range, where particular boundary conditions can make a significant difference to panel response characteristics Statistical Energy Analysis (SEA) has never been the analytical tool of choice. In addition to boundary condition effects, SEA is not well suited in frequency bands where no modes or less than a few modes exist. The advent of the Hybrid Module has enabled integration of Finite Element Analysis to expand and enhance the capability for response calculations within VA One into the lower frequency range. Exploration of several additional modeling approaches was completed for the cylindrical orthogrid panel test article that was examined in Reference 1. Comparison of the new analytical response predictions with the measured response data from ground test and the pure SEA results from the reference will be presented. One approach that is considered promising is the periodic subsystem capability. Initially, a detailed FEM of just one region of the test article is defined. After evaluating this small region using symmetric boundary conditions, the FEM may be expanded to determine the properties of the entire system using similar connected regions that map over the entire test article. Another approach is the direct use of a very detailed finite element model of the entire panel, explicitly modeling pocket and rib details of the structure. A third approach is to approximate localized structure geometry details with a smeared property generalization using a PCOMP (NASTRAN card used to define layered composite structures) to define skin layer and ribbed layer for the orthogrid panel. The authors expect to demonstrate that the integrated Hybrid/FEM approach increases confidence in response prediction in the lower frequency range (for example from 20-300 Hz for the test article under consideration). In addition the strength and weakness of each additional approach will be highlighted and compared to those reported with those reported in an earlier paper

Smith, Andrew M.↗

Evaluation of Response Surface Experiment Designs for Distributed Propulsion Aircraft Aero-Propulsive Modeling

Modern distributed hybrid and electric propulsion aircraft, including vertical, short, and conventional takeoff and landing configurations, exhibit significant aero-propulsive complexity and a large number of interacting test factors. This paper presents the development and evaluation of experiment designs for aero-propulsive characterization of distributed propulsion aircraft. Five different foundational response surface designs are evaluated to inform the development of two sequential design approaches tailored to complex aircraft aerodynamic characterization experiments. The first approach, which builds on sequential face-centered central composite designs, has been used previously to develop aero-propulsive models for complex aircraft using wind tunnel testing. The second approach is a new design strategy leveraging a regular I-optimal and nested I-optimal design that was developed for this study. The two sequential design strategies are compared for experiments with a large number of test factors using pre-experiment design evaluation metrics, as well as modeling results obtained from simulated wind tunnel data for the NASA LA-8 aircraft. The design evaluation metrics show that the sequential I-optimal base design has higher statistical power, lower correlation among candidate regressors, lower prediction variance, and more precise parameter estimates. The simulated wind tunnel experiments conducted using each design reveal that the sequential I-optimal base design has better predictive capability with fewer test points. The experiment design and evaluation procedures are described in detail to inform future aerodynamic characterization experiments for complex aircraft.

design of experiments↗

Hardware Verification and Validation for a Navigation Sensor Software Model in Support of Flight Vehicle Performance Analysis

… or, “It’s in the details, how to make complicated software perform like complicated hardware.” In attempts to minimize development time and quickly build an operational vehicle, NASA’s Space Launch System (SLS) has had to be intentional about integrated testing. Constraints on budget and schedule have required balance between testing needs and the desire for an integrated flight vehicle as soon as possible. To provide key insights early in design and analysis cycles, a large amount of effort has shifted into maturing and validating models at the component level with integrated testing as a means to validate their integration. In terms of SLS Navigation, this, and the model-based design approach have pushed explicit requirements for sensor models to be validated against flight hardware to high precision. This paper covers the approach taken to verify and validate the models for the two key navigation sensors on the SLS vehicle, the Redundant Inertial Navigation Sensor and the Rate Gyro Assembly. These models are used in performance evaluation, fault detection, and operations development extensively. Using a mix of data from hardware vendor documentation and testing reports, limited in-house testing, and integration activities, these models were able to be validated against flight hardware at multiple levels, from the internal software design to statistical behavior at the raw sensor and integrated box levels. The high level of insight into the hardware elements is instrumental to support flight certification activities and building confidence in SLS Navigation capability. Focused testing enabled additional insight and validation that proved invaluable and the resulting insights were used to focus and mature models. Additionally, of having validated performance-based hardware models enables a wide breadth of activities including detailed fault detection studies and integration into future vehicle frameworks, such as an upper stage and provide a valuable asset to continued SLS analysis and design.

Evan J Anzalone↗

Hardware Verification and Validation for a Navigation Sensor Software Model in Support of Flight Vehicle Performance Analysis

… or, “It’s in the details, how to make complicated software perform like complicated hardware.” In attempts to minimize development time and quickly build an operational vehicle, NASA’s Space Launch System (SLS) has had to be intentional about integrated testing. Constraints on budget and schedule have required balance between testing needs and the desire for an integrated flight vehicle as soon as possible. To provide key insights early in design and analysis cycles, a large amount of effort has shifted into maturing and validating models at the component level with integrated testing as a means to validate their integration. In terms of SLS Navigation, this, and the model-based design approach have pushed explicit requirements for sensor models to be validated against flight hardware to high precision. This paper covers the approach taken to verify and validate the models for the two key navigation sensors on the SLS vehicle, the Redundant Inertial Navigation Sensor and the Rate Gyro Assembly. These models are used in performance evaluation, fault detection, and operations development extensively. Using a mix of data from hardware vendor documentation and testing reports, limited in-house testing, and integration activities, these models were able to be validated against flight hardware at multiple levels, from the internal software design to statistical behavior at the raw sensor and integrated box levels. The high level of insight into the hardware elements is instrumental to support flight certification activities and building confidence in SLS Navigation capability. Focused testing enabled additional insight and validation that proved invaluable and the resulting insights were used to focus and mature models. Additionally, of having validated performance-based hardware models enables a wide breadth of activities including detailed fault detection studies and integration into future vehicle frameworks, such as an upper stage and provide a valuable asset to continued SLS analysis and design.

Thomas Park↗

Temperature-dependent mechanical properties and crystal plasticity parameters for additively manufactured Haynes-214 alloy: Experiments and numerical modeling

Our experimental mechanical testing data demonstrated that the additively manufactured (AM) laser powder bed fusion (L-PBF) Haynes-214 alloy exhibits non-linear mechanical properties as the temperature rises from ambient to 870 °C. Crystal plasticity (CP) simulations provide an effective approach to gaining deeper insights into microstructure-property linkages under thermomechanical loading. This method can reduce the need for costly high-temperature mechanical testing while accounting for the effects of crystallographic texture and grain morphology on the mechanical behavior of AM materials. However, calibrating a CP model is time-consuming because individual simulations are computationally expensive and hundreds (or more) of iterations over parameter sets may be required. To address this issue, we have designed a machine learning-differential evolution (ML-DE) CP framework that can accurately interpolate the tensile properties of AM L-PBF Haynes-214 alloy across a wide temperature range from ambient to 870 °C, with minimal reliance on experimental data. The framework uses electron backscatter diffraction (EBSD) measurements to generate statistically equivalent microstructural volume elements to serve as inputs to the CP modeling framework. Stress–strain curves were generated from 1000 CP simulations, which serve as the training data set for the three ML regression algorithms explored: linear, extra-trees, and multi-layer perceptron. These three regression models were independently evaluated to compare their efficiency and identify the most suitable algorithm for the given problem. Results revealed that the extra-trees ML regressor outperforms the other models in both qualitative and quantitative aspects with an R 2 of 0.98. Subsequently, the differential evolution optimization approach is employed to calibrate the ML-based CP material parameters with experimental results obtained at various temperatures. Finally, temperature-dependent CP material parameters are formulated. The effectiveness and efficiency of the designed framework are validated through comparison with experimental results, demonstrating a high degree of agreement. These calibrated parametric constitutive equations enable further use of the CP model to study the deformation behavior of this alloy under a wide range of thermo-mechanical loading conditions.

36 MATERIALS SCIENCE↗

Advanced Signal Decomposition Analysis and Anomaly Detection in Photovoltaic Systems

With the rapid expansion of large-scale photovoltaic (PV) plants, it is paramount for solar stakeholders to understand the reliability and efficiency of their plants to inform maintenance decisions, increase production, and understand the design factors that impact performance. Diagnosing underperformance in PV plants is challenging due to the relatively few monitoring points with respect to the large geographic footprint of the plant. This work introduces a cutting-edge method that transforms the analysis and management of key factors influencing PV plant performance, including performance loss rate (PLR), recoverable soiling, and major system changes. Identifying these factors is critical for deriving actionable insights. Leveraging advanced analytical techniques such as wavelet transformation, robust regression, and extreme point analysis, this approach provides a nuanced understanding of these factors. This method has been tested across two synthetic datasets and one real dataset, consistently surpassing existing benchmarks by achieving a lower median mean absolute error and reduced error variability across all comparable components.

14 SOLAR ENERGY↗