Search NASA⌕ Search

SEARCH · Search NASA

Results for “Statistical Testing Approach”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15

The Johnson Space Center Management Information Systems (JSCMIS): An interface for organizational databases

The Management Information and Decision Support Environment (MIDSE) is a research activity to build and test a prototype of a generic human interface on the Johnson Space Center (JSC) Information Network (CIN). The existing interfaces were developed specifically to support operations rather than the type of data which management could use. The diversity of the many interfaces and their relative difficulty discouraged occasional users from attempting to use them for their purposes. The MIDSE activity approached this problem by designing and building an interface to one JSC data base - the personnel statistics tables of the NASA Personnel and Payroll System (NPPS). The interface was designed against the following requirements: generic (use with any relational NOMAD data base); easy to learn (intuitive operations for new users); easy to use (efficient operations for experienced users); self-documenting (help facility which informs users about the data base structure as well as the operation of the interface); and low maintenance (easy configuration to new applications). A prototype interface entitled the JSC Management Information Systems (JSCMIS) was produced. It resides on CIN/PROFS and is available to JSC management who request it. The interface has passed management review and is ready for early use. Three kinds of data are now available: personnel statistics, personnel register, and plan/actual cost.

Bishop, Peter C.↗

A Method for Validating Causal Diagrams of Human Health Risk in Space Flight

The complexity of cause-and-effect relationships between spaceflight hazards and resulting health conditions clouds understanding of the totality of human system risk in space. In response, NASA has introduced Directed Acyclic Graphs (causal diagrams) into the human systems risk management process. These diagrams allow for a common understanding of the mechanisms that lead from unique hazards of spaceflight to the health outcomes important to agencies and astronauts. However, the paucity of available biomedical data from spaceflight creates a need for methods of validating causal models that can accommodate data from spaceflight model analogs. Here we outline one approach utilizing open-access rodent bone datasets from the Ames Life Sciences Data Archive. The properties of directed acyclic graphs themselves can provide an epistemological and statistical framework for validation of a priori causal representations of human system risk in space flight. The assumed causal connections on the graph creates sets of logical implications: variables that – if the causal diagram is correct – should be correlated, as well as sets that should be conditionally independent. By testing these implied correlations and conditional independencies both statistically and heuristically, we can provide evidence for or against specific causal pathways on the causal diagram. In addition to validation of expert-generated causal diagrams, machine learning techniques can learn the most likely structure of a causal diagram from a given dataset. Comparison with and reconciliation between machine-learned causal diagrams and expert-generated diagrams is another technique for challenging assumptions and improving our understanding of causal mechanisms. Accurately representing complex causation is essential to systemic understanding of human health risks in space travel. Having a robust system of validating causal diagrams helps us arrive at more accurate representations of causal systems. This process will be integral to developing the countermeasures necessary for extended exploration of the moon and Mars.

Robert Reynolds↗

An analysis of defect densities found during software inspections

Software inspection is a technical evaluation process for finding and removing defects in requirements, design, code, and tests. Detailed data was collected during the first three years of experience at JPL on 203 inspections. Statistics are discussed for this set of inspections. Included, on a per inspection basis, are averages of: staff time expended, pages covered, major defects found, minor defects found, and inspection team size. Analysis of variance showed a significantly higher density of defects during requirements inspections. It was also observed, that the defect densities found decreased exponentially as the work products approached the coding phase. Increasing the pace of the inspection meeting decreased the density of defects found. This relationship was observed to hold for both major and minor defect densities, although it was more pronounced for minor defects. Guidelines are provided for conducting successful software inspections based upon three years of JPL experience.

Kelly, John C.↗

Evaluation of detectability and distinguishability of aircraft control element failures using flight test data

This paper examines the detectability and distinguishability of control element failures on the B-737 aircraft. The results of Weiss (1985) are used to define decentralized residuals from analytic redundancy relationships, and the results of Weiss et al. (1984) are used to define the probabilistic distance measures which provide bounds on the minimum achievable probabilities or error. The residual signals are then generated using data which were recorded during a landing approach of the NASA-Langley Advanced Transport Operations (ATOPS) transportation systems research vehicle (TSRV). The distance measures are computed using estimates of the statistics of these residual signals.

Weiss, J. L.↗

Estimation of UH-60 blade aerodynamic loads and rotor impedance using generalized strain pattern/Kalman filter approach

The purpose of the study is to develop and verify a methodology capable of predicting the vibration levels and estimating the aerodynamic loads and rotor impedance of a rotorcraft blade. Simulated flight test data is generated, blade airloads and elastic hub motions are estimated from the simulated data through the use of the Kalman filter/smoother, simulation upgrading and parameter identification are performed, and the ability to identify rotor impedance from a simulation by isolating the rotor model and providing a prescribed motion for the hub as rotor excitation is demonstrated. It is pointed out that the statistical estimation procedure utilized in the proposed methodology minimizes the impact of sensor noise, truncation error, and instrumentation bias on the results.

Bruhis, Ofer↗

Structural Qualification of Composite Airframes

The development of fundamental approaches for predicting failure and elongation characteristics of fibrous composites are summarized in this document. The research described includes a statistical formulation for individual fiber breakage and fragmentation and clustered fiber breakage, termed macrodefects wherein the aligned composite may represent a structural component such as a reinforcing bar element, a rebar. Experimental work conducted in support of the future exploitation of aligned composite rebar elements is also described. This work discusses the experimental challenges associated with rebar tensile test evaluation and describes initial numerical analyses performed in support of the experimental program.

Kedward, Keith T.↗

Statistical analysis of effective singular values in matrix rank determination

A major problem in using SVD (singular-value decomposition) as a tool in determining the effective rank of a perturbed matrix is that of distinguishing between significantly small and significantly large singular values to the end, conference regions are derived for the perturbed singular values of matrices with noisy observation data. The analysis is based on the theories of perturbations of singular values and statistical significance test. Threshold bounds for perturbation due to finite-precision and i.i.d. random models are evaluated. In random models, the threshold bounds depend on the dimension of the matrix, the noisy variance, and predefined statistical level of significance. Results applied to the problem of determining the effective order of a linear autoregressive system from the approximate rank of a sample autocorrelation matrix are considered. Various numerical examples illustrating the usefulness of these bounds and comparisons to other previously known approaches are given.

Konstantinides, Konstantinos↗

A Method for Calculating the Probability of Successfully Completing a Rocket Propulsion Ground Test

Propulsion ground test facilities face the daily challenge of scheduling multiple customers into limited facility space and successfully completing their propulsion test projects. Over the last decade NASA s propulsion test facilities have performed hundreds of tests, collected thousands of seconds of test data, and exceeded the capabilities of numerous test facility and test article components. A logistic regression mathematical modeling technique has been developed to predict the probability of successfully completing a rocket propulsion test. A logistic regression model is a mathematical modeling approach that can be used to describe the relationship of several independent predictor variables X(sub 1), X(sub 2),.., X(sub k) to a binary or dichotomous dependent variable Y, where Y can only be one of two possible outcomes, in this case Success or Failure of accomplishing a full duration test. The use of logistic regression modeling is not new; however, modeling propulsion ground test facilities using logistic regression is both a new and unique application of the statistical technique. Results from this type of model provide project managers with insight and confidence into the effectiveness of rocket propulsion ground testing.

Messer, Bradley↗

Hybrid FEA/SEA Assessment for an Orthogrid Cylindrical Panel Section and Periodic Subsystem Modeling Evaluation

In the lower frequency range, where particular boundary conditions can make a significant difference to panel response characteristics Statistical Energy Analysis (SEA) has never been the analytical tool of choice. In addition to boundary condition effects, SEA is not well suited in frequency bands where no modes or less than a few modes exist. The advent of the Hybrid Module has enabled integration of Finite Element Analysis to expand and enhance the capability for response calculations within VA One into the lower frequency range. Exploration of several additional modeling approaches was completed for the cylindrical orthogrid panel test article that was examined in Reference 1. Comparison of the new analytical response predictions with the measured response data from ground test and the pure SEA results from the reference will be presented. One approach that is considered promising is the periodic subsystem capability. Initially, a detailed FEM of just one region of the test article is defined. After evaluating this small region using symmetric boundary conditions, the FEM may be expanded to determine the properties of the entire system using similar connected regions that map over the entire test article. Another approach is the direct use of a very detailed finite element model of the entire panel, explicitly modeling pocket and rib details of the structure. A third approach is to approximate localized structure geometry details with a smeared property generalization using a PCOMP (NASTRAN card used to define layered composite structures) to define skin layer and ribbed layer for the orthogrid panel. The authors expect to demonstrate that the integrated Hybrid/FEM approach increases confidence in response prediction in the lower frequency range (for example from 20-300 Hz for the test article under consideration). In addition the strength and weakness of each additional approach will be highlighted and compared to those reported with those reported in an earlier paper

Smith, Andrew M.↗

Evaluation of Response Surface Experiment Designs for Distributed Propulsion Aircraft Aero-Propulsive Modeling

Modern distributed hybrid and electric propulsion aircraft, including vertical, short, and conventional takeoff and landing configurations, exhibit significant aero-propulsive complexity and a large number of interacting test factors. This paper presents the development and evaluation of experiment designs for aero-propulsive characterization of distributed propulsion aircraft. Five different foundational response surface designs are evaluated to inform the development of two sequential design approaches tailored to complex aircraft aerodynamic characterization experiments. The first approach, which builds on sequential face-centered central composite designs, has been used previously to develop aero-propulsive models for complex aircraft using wind tunnel testing. The second approach is a new design strategy leveraging a regular I-optimal and nested I-optimal design that was developed for this study. The two sequential design strategies are compared for experiments with a large number of test factors using pre-experiment design evaluation metrics, as well as modeling results obtained from simulated wind tunnel data for the NASA LA-8 aircraft. The design evaluation metrics show that the sequential I-optimal base design has higher statistical power, lower correlation among candidate regressors, lower prediction variance, and more precise parameter estimates. The simulated wind tunnel experiments conducted using each design reveal that the sequential I-optimal base design has better predictive capability with fewer test points. The experiment design and evaluation procedures are described in detail to inform future aerodynamic characterization experiments for complex aircraft.

design of experiments↗

Hardware Verification and Validation for a Navigation Sensor Software Model in Support of Flight Vehicle Performance Analysis

… or, “It’s in the details, how to make complicated software perform like complicated hardware.” In attempts to minimize development time and quickly build an operational vehicle, NASA’s Space Launch System (SLS) has had to be intentional about integrated testing. Constraints on budget and schedule have required balance between testing needs and the desire for an integrated flight vehicle as soon as possible. To provide key insights early in design and analysis cycles, a large amount of effort has shifted into maturing and validating models at the component level with integrated testing as a means to validate their integration. In terms of SLS Navigation, this, and the model-based design approach have pushed explicit requirements for sensor models to be validated against flight hardware to high precision. This paper covers the approach taken to verify and validate the models for the two key navigation sensors on the SLS vehicle, the Redundant Inertial Navigation Sensor and the Rate Gyro Assembly. These models are used in performance evaluation, fault detection, and operations development extensively. Using a mix of data from hardware vendor documentation and testing reports, limited in-house testing, and integration activities, these models were able to be validated against flight hardware at multiple levels, from the internal software design to statistical behavior at the raw sensor and integrated box levels. The high level of insight into the hardware elements is instrumental to support flight certification activities and building confidence in SLS Navigation capability. Focused testing enabled additional insight and validation that proved invaluable and the resulting insights were used to focus and mature models. Additionally, of having validated performance-based hardware models enables a wide breadth of activities including detailed fault detection studies and integration into future vehicle frameworks, such as an upper stage and provide a valuable asset to continued SLS analysis and design.

Evan J Anzalone↗

Hardware Verification and Validation for a Navigation Sensor Software Model in Support of Flight Vehicle Performance Analysis

… or, “It’s in the details, how to make complicated software perform like complicated hardware.” In attempts to minimize development time and quickly build an operational vehicle, NASA’s Space Launch System (SLS) has had to be intentional about integrated testing. Constraints on budget and schedule have required balance between testing needs and the desire for an integrated flight vehicle as soon as possible. To provide key insights early in design and analysis cycles, a large amount of effort has shifted into maturing and validating models at the component level with integrated testing as a means to validate their integration. In terms of SLS Navigation, this, and the model-based design approach have pushed explicit requirements for sensor models to be validated against flight hardware to high precision. This paper covers the approach taken to verify and validate the models for the two key navigation sensors on the SLS vehicle, the Redundant Inertial Navigation Sensor and the Rate Gyro Assembly. These models are used in performance evaluation, fault detection, and operations development extensively. Using a mix of data from hardware vendor documentation and testing reports, limited in-house testing, and integration activities, these models were able to be validated against flight hardware at multiple levels, from the internal software design to statistical behavior at the raw sensor and integrated box levels. The high level of insight into the hardware elements is instrumental to support flight certification activities and building confidence in SLS Navigation capability. Focused testing enabled additional insight and validation that proved invaluable and the resulting insights were used to focus and mature models. Additionally, of having validated performance-based hardware models enables a wide breadth of activities including detailed fault detection studies and integration into future vehicle frameworks, such as an upper stage and provide a valuable asset to continued SLS analysis and design.

Thomas Park↗

The construction of life prediction models for the design of Stirling engine heater components

The service life of Stirling-engine heater structures of Fe-based high-temperature alloys is predicted using a numerical model based on a linear-damage approach and published test data (engine test data for a Co-based alloy and tensile-test results for both the Co-based and the Fe-based alloys). The operating principle of the automotive Stirling engine is reviewed; the economic and technical factors affecting the choice of heater material are surveyed; the test results are summarized in tables and graphs; the engine environment and automotive duty cycle are characterized; and the modeling procedure is explained. It is found that the statistical scatter of the fatigue properties of the heater components needs to be reduced (by decreasing the porosity of the cast material or employing wrought material in fatigue-prone locations) before the accuracy of life predictions can be improved.

Petrovich, A.↗

Damage detection in elastic structures using vibratory residual forces and weighted sensitivity

A methodology is presented for detecting structural damage in elastic structures by nondestructive means. Measured modal test data along with a correlated analytical structural model are used to locate potentially damaged regions using residual modal force vectors and to conduct a weighted sensitivity analysis to assess the extent of mass and/or stiffness variations, where damage is characterized as a stiffness reduction. The current approach is unique among other approaches in that it accounts for (1) variations in system mass, system stiffness, and mass center (locations), (2) perturbations of both the natural frequencies and modal vectors, and (3) statistical confidence factors for the structural parameters and potential experimental instrumentation error. Moreover, this procedure can be used with either full or reduced models. A wide variety of numerical examples are presented that show that the current method provides a precise indication of both the location and the extent of structural damage.

Ricles, J. M.↗

A GPS-Based Pitot-Static Calibration Method Using Global Output-Error Optimization

Pressure-based airspeed and altitude measurements for aircraft typically require calibration of the installed system to account for pressure sensing errors such as those due to local flow field effects. In some cases, calibration is used to meet requirements such as those specified in Federal Aviation Regulation Part 25. Several methods are used for in-flight pitot-static calibration including tower fly-by, pacer aircraft, and trailing cone methods. In the 1990 s, the introduction of satellite-based positioning systems to the civilian market enabled new inflight calibration methods based on accurate ground speed measurements provided by Global Positioning Systems (GPS). Use of GPS for airspeed calibration has many advantages such as accuracy, ease of portability (e.g. hand-held) and the flexibility of operating in airspace without the limitations of test range boundaries or ground telemetry support. The current research was motivated by the need for a rapid and statistically accurate method for in-flight calibration of pitot-static systems for remotely piloted, dynamically-scaled research aircraft. Current calibration methods were deemed not practical for this application because of confined test range size and limited flight time available for each sortie. A method was developed that uses high data rate measurements of static and total pressure, and GPSbased ground speed measurements to compute the pressure errors over a range of airspeed. The novel application of this approach is the use of system identification methods that rapidly compute optimal pressure error models with defined confidence intervals in nearreal time. This method has been demonstrated in flight tests and has shown 2- bounds of approximately 0.2 kts with an order of magnitude reduction in test time over other methods. As part of this experiment, a unique database of wind measurements was acquired concurrently with the flight experiments, for the purpose of experimental validation of the optimization method. This paper describes the GPS-based pitot-static calibration method developed for the AirSTAR research test-bed operated as part of the Integrated Resilient Aircraft Controls (IRAC) project in the NASA Aviation Safety Program (AvSP). A description of the method will be provided and results from recent flight tests will be shown to illustrate the performance and advantages of this approach. Discussion of maneuver requirements and data reduction will be included as well as potential applications.

Foster, John V.↗

Wind-Tunnel Balance Characterization for Hypersonic Research Applications

Wind-tunnel research was recently conducted at the NASA Langley Research Center s 31-Inch Mach 10 Hypersonic Facility in support of the Mars Science Laboratory s aerodynamic program. Researchers were interested in understanding the interaction between the freestream flow and the reaction control system onboard the entry vehicle. A five-component balance, designed for hypersonic testing with pressurized flow-through capability, was used. In addition to the aerodynamic forces, the balance was exposed to both thermal gradients and varying internal cavity pressures. Historically, the effect of these environmental conditions on the response of the balance have not been fully characterized due to the limitations in the calibration facilities. Through statistical design of experiments, thermal and pressure effects were strategically and efficiently integrated into the calibration of the balance. As a result of this new approach, researchers were able to use the balance continuously throughout the wide range of temperatures and pressures and obtain real-time results. Although this work focused on a specific application, the methodology shown can be applied more generally to any force measurement system calibration.

Lynn, Keith C.↗

Development and in-flight performance of the Mariner 9 spacecraft propulsion system

On November 14, 1971, Mariner 9 was decelerated into orbit about Mars by a 1334 N (300 lbf) liquid bipropellant propulsion system. This paper describes and summarizes the development and in-flight performance of this pressure-fed, nitrogen tetroxide/monomethyl hydrazine bipropellant system. The design of all Mariner propulsion subsystems has been predicted upon the premise that simplicity of approach, coupled with thorough qualification and margin-limits testing, is the key to cost-effective reliability. The qualification test program and analytical modeling are also discussed. Since the propulsion subsystem is modular in nature, it was completely checked, serviced, and tested independent of the spacecraft. Proper prediction of in-flight performance required the development of three significant modeling tools to predict and account for nitrogen saturation of the propellant during the six-month coast period and to predict and statistically analyze in-flight data.

Evans, D. D.↗

Explicit 3D continuum fracture modeling with smooth particle hydrodynamics

Impact phenomena shaped our solar system. As usual for most solar system processes, the scales are far different than we can address directly in the laboratory. Impact velocities are often much higher than we can achieve, sizes are often vastly larger, and most impacts take place in an environment where the only gravitational force is the mutual pull of the impactors. The Smooth Particle Hydrodynamics (SPH) technique has been applied in the past to the simulations of giant impacts. In these simulations, the colliding objects were so massive (at least a sizeable fraction of the Earth's mass) that material strength was negligible compared to gravity. This assumption can no longer be made when the bodies are much smaller. To this end, we have developed a 3D SPH code that includes a strength model to which we have added a von Mises yielding relation for stresses beyond the Hugoniot Elastic Limit. At the lower stresses associated with brittle failure, we use a rate-dependent strength based on the nucleation of incipient flaws whose number density is given by a Weibull distribution. Following Grady and Kipp and Melosh et al., we introduce a state variable D ('damage'), 0 less than D less than 1, which expresses the local reduction in strength due to crack growth under tensile loading. Unfortunately for the hydrodynamics, Grady and Kipp's model predicts which fragments are the most probable ones and not the ones that are really formed. This means, for example, that if a given laboratory experiment is modeled, the fragment distribution obtained from the Grady-Kipp theory would be equivalent to a ensemble average over many realizations of the experiment. On the other hand, the hydrodynamics itself is explicit and evolves not an ensemble average but very specific fragments. Hence, there is a clear incompatibility with the deterministic nature of the hydrodynamics equations and the statistical approach of the Grady-Kipp dynamical fracture model. We remedy these shortcomings by making the incipient flaw distribution explicit, i.e., particles carry activation strains which are distributed at random with a probability of occurrence given by the Weibull distribution. If the local principal axis strain exceeds this limit, damage starts to grow. By growing explicit cracks together with statistical cracks (damage) at the sub-particle scale, we ensure that material strength and fragmentation is independent of model resolution. We tested our scheme by simulating laboratory impact experiments on basalt spheres.

Benz, W.↗