Search NASA⌕ Search

SEARCH · Search NASA

Results for “Statistical Testing Approach”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

Integrated Testing Regimen: Assessment of Countermeasures for Long Duration Space Flight

Space flight has been shown to induce changes in the physiology of crewmembers which can adversely affect their performance. The objectives of Countermeasures Evaluation and Validation Project (CEVP) are to develop and validate potential countermeasures to the deleterious effects of space flight for operational implementation and use. In order to accomplish this objective, a group of standardized tests, the Integrated Testing Regimen or ITR, will be utilized for the evaluation of candidate countermeasures. Additionally, the ITR will illuminate intersystem effects of the potential countermeasures and provide normative values for the physiological responses. Due to the small number of crewmembers available as test subjects, statistically rigorous validation of countermeasures presents a challenging problem. Strategies for reliable evaluation of small N clinical studies will be utilized for these activities. These approaches will permit effective analysis of promising countermeasure to support human space flights of increasing duration.

Sams, Clarence F.↗

Probability Bounds Analysis Applied to Multi-Purpose Crew Vehicle Nonlinearity

The Multi-Purpose Crew Vehicle (MPCV) Program Orion vehicle finite element model (FEM) was updated based on a modal test performed by Lockheed Martin. Due to nonlinearity observed in the test results, linear low force level (LL) and high force level (HL) FEMs were developed for use during various Space Launch System (SLS) flight regimes depending on expected forcing levels. Uncertainty models were derived for the combined MPCV and MPCV Stage Adaptor LL and HL Hurty/Craig-Bampton (HCB) components based on the MPCV structural test article Configuration 4 modal test-analysis correlation results. Subsequently, system-level uncertainty quantification analyses were performed using both models for various SLS flight configurations to determine the impact of the nonlinearity on important system metrics. The system metrics included both transfer functions associated with attitude control and dynamic loads associated with aerodynamic buffeting during ascent. In each case, an independent Monte Carlo (MC) analysis was performed, and no attempt was made to combine the results. The Hybrid Parametric Variation (HPV) method was used to develop the LL and HL MPCV HCB uncertainty models. The HPV method provides both parametric and non-parametric components of uncertainty. The non-parametric uncertainty accounts for the difference in model-form between the linearized analytical model and the corresponding linearized component test results in the form of mode shapes and frequencies at that force level. This linear model-form uncertainty is implemented in the HPV method using random matrix theory. However, the HPV uncertainty models developed for the linear LL and HL MPCV components do not account for the nonlinearity in the MPCV. With respect to the linearized models, this nonlinearity is also an uncertainty in model form, but in this case, it must be treated independently as an epistemic uncertainty. It represents a lack of knowledge, in contrast to an aleatory uncertainty due to the randomness of a variable. In the case of an epistemic variable, the true value is unknown, only the interval within which it lies is known. Epistemic uncertainty can be reduced with increased knowledge, while in general, aleatory uncertainty cannot. This work combines the epistemic uncertainty due to the MPCV nonlinearity with the parametric and non-parametric uncertainty within the HPV method using a second order propagation approach. The LL and HL test data is augmented with surrogate test data derived from a nonlinear MPCV representation. The impact of the MPCV nonlinearity on system response statistics is determined using a series of cumulative distribution functions in the form of a horsetail plot, or p-box. This results in an interval of probabilities for a specific response value, or an interval of response values at a specific probability.

Daniel C Kammer↗

Flight Test Evaluation of the Airborne Information for Lateral Spacing (AILS) Concept

The Airborne Information for Lateral Spacing (AILS) concept is designed to support independent parallel approach operations to runways spaced as close as 2,500 feet. This report briefly describes the AILS operational concept and the results of a flight test of one implementation of this concept. The focus of this flight test experiment was to validate a prior simulator study, evaluating pilot performance, pilot acceptability, and minimum miss-distances for the rare situation in which an aircraft on one approach intrudes into the path of an aircraft on the other approach. Although the flight data set was not meant to be a statistically valid sample, the trends acquired in flight followed those of the simulator and therefore met the intent of validating the findings from the simulator. Results from this study showed that the design-goal mean miss-distance of 1,200 feet to potential collision situations was surpassed with an actual mean miss-distance of 1,859 feet. Pilot reaction times to the alerting system, which was an operational concern, averaged 0.65 seconds, were well below the design goal reaction time of 2.0 seconds. From the results of both of these tests, it can be concluded that this operational concept, with supporting technology and procedures, may provide an operationally viable means for conducting simultaneous, independent instrument approaches to runways spaced as close as 2500 ft.

Abbott, Terence S.↗

Roles of Engineering Correlations in Hypersonic Entry Boundary Layer Transition Prediction

Efforts to design and operate hypersonic entry vehicles are constrained by many considerations that involve all aspects of an entry vehicle system. One of the more significant physical phenomenon that affect entry trajectory and thermal protection system design is the occurrence of boundary layer transition from a laminar to turbulent state. During the Space Shuttle Return To Flight activity following the loss of Columbia and her crew of seven, NASA's entry aerothermodynamics community implemented an engineering correlation based framework for the prediction of boundary layer transition on the Orbiter. The methodology for this implementation relies upon similar correlation techniques that have been is use for several decades. What makes the Orbiter boundary layer transition correlation implementation unique is that a statistically significant data set was acquired in multiple ground test facilities, flight data exists to assist in establishing a better correlation and the framework was founded upon state of the art chemical nonequilibrium Navier Stokes flow field simulations. Recent entry flight testing performed with the Orbiter Discovery now provides a means to validate this engineering correlation approach to higher confidence. These results only serve to reinforce the essential role that engineering correlations currently exercise in the design and operation of entry vehicles. The framework of information related to the Orbiter empirical boundary layer transition prediction capability will be utilized to establish a fresh perspective on this role, and to discuss the characteristics which are desirable in a next generation advancement. The details of the paper will review the experimental facilities and techniques that were utilized to perform the implementation of the Orbiter RTF BLT Vsn 2 prediction capability. Statistically significant results for multiple engineering correlations from a ground testing campaign will be reviewed in order to describe why only certain correlations were selected for complete implementation to support the Shuttle Program. Historical Orbiter flight data on early boundary layer transition due to protruding gap fillers will be described in relation to the selected empirical correlations. In addition, Orbiter entry flight testing results from the BLT Flight Experiment will be discussed in relation to these correlations. Applicability of such correlations to the entry design problem will be reviewed, and finally a perspective on the desirable characteristics for a next generation capability based on high fidelity physical models will be provided.

Campbell, Charles H.↗

Processing electrophysiological signals for the monitoring of alertness

Mathematical techniques are described for processing EEG signals associated with varying states of alertness. Fast algorithms for implementing real-time computations of alertness estimates were developed. A realization of the phase-distortionless digital filter is presented which approaches real-time filtering and a transform for EEG signals. This transform provides information for the alertness estimates and can be performed in real time. A statistical test for stationarity in EEG signals is being developed that will provide a method for determining the duration of the EEG signals necessary for estimating the short-time power or energy spectra for nonstationary analysis of EEG signals.

Lai, D. C.↗

The systematic radial downflow in the transition region of the quiet sun from limb-to-limb observations of the C IV resonance lines

This paper presents absolute velocities of C IV 1548, 1550 nm measured as a function of position along the solar equator, which was free of both active regions and coronal holes, and uniformly representative of the quiet sun. These observations were made with moderate spatial resolution (18 arcsec) using an EUV spectrometer dedicated to measuring absolute wavelengths (velocities) by direct comparison with a platinum spectrum generated on board the sounding rocket. On the assumption that systematic horizontal motions cancel statistically so that the line-of-sight velocities approach zero at the limb, a net radial downflow of 7.5 + or - 1.0 km/sec was found. The assumption was tested using the wavelength reference and found to be valid within the absolute accuracy of the rest wavelengths of the C IV lines.

Rottman, Gary J.↗

The Role of Formal Experiment Design in Hypersonic Flight System Technology Development

Hypersonic airbreathing engine (scramjet) powered vehicles are being considered to replace conventional rocket-powered launch systems. Effective utilization of scramjet engines requires careful integration with the air vehicle. This integration synergistically combines aerodynamic forces with propulsive cycle functions of the engine. Due to the highly integrated nature of the hypersonic vehicle design problem, the large flight envelope, and the large number of design variables, the use of a statistical design approach in design is effective. Modern Design-of-Experiments (MDOE) has been used throughout the Hyper-X program, for both systems analysis and experimental testing. Application of MDOE fall into four categories: (1) experimental testing; (2) studies of unit phenomena; (3) refining engine design; and (4) full vehicle system optimization. The MDOE process also provides analytical models, which are also used to document lessons learned, supplement low-level design tools, and accelerate future studies. This paper will discuss the design considerations for scramjet-powered vehicles, specifics of MDOE utilized for Hyper-X, and present highlights from the use of these MDOE methods within the Hyper-X Program.

McClinton, Charles R.↗

The X-Ray Variable Sky

A novel approach to search for rapid time variability of every source, whether persistent or transient, within the entire ROSAT detector field has been developed. Semi-automated software statistically tests the photon arrival time event list for source variability and reports significant (greater than 5 sigma) variable enhancement in the photon count rate on time scales ranging from 5-500 seconds. The computational algorithms have been thoroughly tested, and are able to discriminate between false detections induced by instrumental effects, and real X-ray variable sources (XRVs); when carefully scrutinized by the PI. The analysis has proven to be successful, with both periodic and transient XRVs having been found. Some of these are entirely new discoveries, while others have been detected in previous X-ray missions, yet their nature remained elusive since source identification and analysis had yet to be performed. On average, one new (unidentified) XRV is found per ROSAT PSPC field analyzed. In some cases the XRVs show only a transient signature (a burst type event) with no persistent X-ray or other known (optical) counterpart. The ambitious goal of this project was to process as much of the ROSAT PSPC archive data as feasibly possible to discover XRVs and analyze this data.

Stringfellow, Guy↗

Sub-Shot Noise Power Source for Microelectronics

Low-current, high-impedance microelectronic devices can be affected by electric current shot noise more than they are affected by Nyquist noise, even at room temperature. An approach to implementing a sub-shot noise current source for powering such devices is based on direct conversion of amplitude-squeezed light to photocurrent. The phenomenon of optical squeezing allows for the optical measurements below the fundamental shot noise limit, which would be impossible in the domain of classical optics. This becomes possible by affecting the statistical properties of photons in an optical mode, which can be considered as a case of information encoding. Once encoded, the information describing the photon (or any other elementary excitations) statistics can be also transmitted. In fact, it is such information transduction from optics to an electronics circuit, via photoelectric effect, that has allowed the observation of the optical squeezing. It is very difficult, if not technically impossible, to directly measure the statistical distribution of optical photons except at extremely low light level. The photoelectric current, on the other hand, can be easily analyzed using RF spectrum analyzers. Once it was observed that the photocurrent noise generated by a tested light source in question is below the shot noise limit (e.g. produced by a coherent light beam), it was concluded that the light source in question possess the property of amplitude squeezing. The main novelty of this technology is to turn this well-known information transduction approach around. Instead of studying the statistical property of an optical mode by measuring the photoelectron statistics, an amplitude-squeezed light source and a high-efficiency linear photodiode are used to generate photocurrent with sub-Poissonian electron statistics. By powering microelectronic devices with this current source, their performance can be improved, especially their noise parameters. Therefore, a room-temperature sub-shot noise current source can be built that will be beneficial for a very broad range of low-power, low-noise electronic instruments and applications, both cryogenic and room-temperature. Taking advantage of recent demonstrations of the squeezed light sources based on optical micro-disks, this sub-shot noise current source can be made compatible with the size/power requirements specific of the electronic devices it will support.

Strekalov, Dmitry V.↗

Calibration improvements to electronically scanned pressure systems and preliminary statistical assessment

Orifice-to-orifice inconsistencies in data acquired with an electronically-scanned pressure system at the beginning of a wind tunnel experiment forced modifications to the standard, instrument calibration procedures. These modifications included a large increase in the number of calibration points which would allow a critical examination of the calibration curve-fit process, and a subsequent post-test reduction of the pressure data. Evaluation of these data has resulted in an improved functional representation of the pressure-voltage signature for electronically-scanned pressures sensors, which can reduce the errors due to calibration curve fit to under 0.10 percent of reading compared to the manufacturer specified 0.10 percent of full scale. Application of the improved calibration function allows a more rational selection of the calibration set-point pressures. These pressures should be adjusted to achieve a voltage output which matches the physical shape of the pressure-voltage signature of the sensor. This process is conducted in lieu of the more traditional approach where a calibration pressure is specified and the resulting sensor voltage is recorded. The fifteen calibrations acquired over the two-week duration of the wind tunnel test were further used to perform a preliminary, statistical assessment of the variation in the calibration process. The results allowed the estimation of the bias uncertainty for a single instrument calibration; and, they form the precursor for more extensive and more controlled studies in the laboratory.

Everhart, Joel L.↗

A computer program for model verification of dynamic systems

Dynamic model verification is the process whereby an analytical model of a dynamic system is compared with experimental data, and then qualified for future use in predicting system response in a different dynamic environment. There are various ways to conduct model verification. The approach adopted in MOVER II employs Bayesian statistical parameter estimation. Unlike curve fitting whose objective is to minimize the difference between some analytical function and a given quantity of test data (or curve), Bayesian estimation attempts also to minimize the difference between the parameter values of that function (the model) and their initial estimates, in a least squares sense. The objectives of dynamic model verification, therefore, are to produce a model which: (1) is in agreement with test data, (2) will assist in the interpretation of test data, (3) can be used to help verify a design, (4) will reliably predict performance, and (5) in the case of space structures, facilitate dynamic control.

Chrostowski, J. D.↗

Development of thermomechanical life prediction models for thermal barrier coatings

Thermal barrier coatings (TBCs) for turbine airfoils in high-performance engines represent an advanced materials technology with both performance and durability benefits. The foremost TBC benefit is the reduction of heat transferred into air-cooled components. To achieve these benefits, however, the TBC system must be reliable. Mechanistic thermomechanical and thermochemical life models and statistically significant design data are therefore required for the reliable exploitation of TBC benefits on gas turbine airfoils. Garrett's NASA-HOST Program (NAS3-23945) is designed to fulfill these requirements. This program focuses on predicting the lives of two types of strain-tolerant and oxidation-resistant TBC systems that are produced by commercial coating suppliers to the gas turbine industry. The plasma-sprayed TBC system, composed of a low-pressure plasma-spray (LPPS) applied oxidation resistant NiCrAlY bond coating, and an air-plasma-sprayed yttria partially stabilized zirconia insulated layer is applied by both Chromalloy and Klock. The second type of TBC is applied by the electron beam-physical vapor deposition process by Temescal. Thermomechanical life models are being tailored to predict TBC strain tolerance in terms of materials, engine, and mission parameters. Continuum and fracture mechanics approaches and statistical methods are being evaluated to develop tensile and compressive strain functions required to drive a mission analysis capable thermomechanical life model for TBCs. Results of initial testing to calibrate these life models will be presented.

Strangman, T. E.↗

Effect of short-term exposure to stereoscopic three-dimensional flight displays on real-world depth perception

High-fidelity color pictorial displays that incorporate depth cues in the display elements are currently available. Depth cuing applied to advanced head-down flight display concepts potentially enhances the pilot's situational awareness and improves task performance. Depth cues provided by stereopsis exhibit constraints that must be fully understood so depth cuing enhancements can be adequately realized and exploited. A fundamental issue (the goal of this investigation) is whether the use of head-down stereoscopic displays in flight applications degrade the real-world depth perception of pilots using such displays. Stereoacuity tests are used in this study as the measure of interest. Eight pilots flew repeated simulated landing approaches using both nonstereo and stereo 3-D head-down pathway-in-the-sky displays. At this decision height of each approach (where the pilot changes to an out-the-window view to obtain real-world visual references) the pilots changed to a stereoacuity test that used real objects. Statistical analysis of stereoacuity measures (data for a control condition of no exposure to any electronic flight display compared with data for changes from nonstereo and from stereo displays) reveals no significant differences for any of the conditions. Therefore, changing from short-term exposure to a head-down stereo display has no more effect on real-world relative depth perception than does changing from a nonstereo display. However, depth perception effects based on sized and distance judgements and on long-term exposure remain issues to be investigated.

Busquets, Anthony M.↗

A Multi-Parameter Approach for Calculating Crack Instability

An accurate fracture control analysis of spacecraft pressure systems, boosters, rocket hardware and other critical low-cycle fatigue cases where the fracture toughness highly impacts cycles to failure requires accurate knowledge of the material fracture toughness. However, applicability of the measured fracture toughness values using standard specimens and transferability of the values to crack instability analysis of the realistically complex structures is refutable. The commonly used single parameter Linear Elastic Fracture Mechanics (LEFM) approach which relies on the key assumption that the fracture toughness is a material property would result in inaccurate crack instability predictions. In the past years extensive studies have been conducted to improve the single parameter (K-controlled) LEFM by introducing parameters accounting for the geometry or in-plane constraint effects]. Despite the importance of the thickness (out-of-plane constraint) effects in fracture control problems, the literature is mainly limited to some empirical equations for scaling the fracture toughness data] and only few theoretically based developments can be found. In aerospace hardware where the structure might have only one life cycle and weight reduction is crucial, reducing the design margin of safety by decreasing the uncertainty involved in fracture toughness evaluations would result in lighter hardware. In such conditions LEFM would not suffice and an elastic-plastic analysis would be vital. Multi-parameter elastic plastic crack tip field quantifying developments combined with statistical methods] have been shown to have the potential to be used as a powerful tool for tackling such problems. However, these approaches have not been comprehensively scrutinized using experimental tests. Therefore, in this paper a multi-parameter elastic-plastic approach has been used to study the crack instability problem and the transferability issue by considering the effects of geometrical constraints as well as the thickness. The feasibility of the approach has been examined using a wide range of specimen geometries and thicknesses manufactured from 7075-T7351 aluminum alloy.

Zanganeh, M.↗

Signal Processing Methods for Liquid Rocket Engine Combustion Stability Assessments

The J2X Gas Generator engine design specifications include dynamic, spontaneous, and broadband combustion stability requirements. These requirements are verified empirically based high frequency chamber pressure measurements and analyses. Dynamic stability is determined with the dynamic pressure response due to an artificial perturbation of the combustion chamber pressure (bomb testing), and spontaneous and broadband stability are determined from the dynamic pressure responses during steady operation starting at specified power levels. J2X Workhorse Gas Generator testing included bomb tests with multiple hardware configurations and operating conditions, including a configuration used explicitly for engine verification test series. This work covers signal processing techniques developed at Marshall Space Flight Center (MSFC) to help assess engine design stability requirements. Dynamic stability assessments were performed following both the CPIA 655 guidelines and a MSFC in-house developed statistical-based approach. The statistical approach was developed to better verify when the dynamic pressure amplitudes corresponding to a particular frequency returned back to pre-bomb characteristics. This was accomplished by first determining the statistical characteristics of the pre-bomb dynamic levels. The pre-bomb statistical characterization provided 95% coverage bounds; these bounds were used as a quantitative measure to determine when the post-bomb signal returned to pre-bomb conditions. The time for post-bomb levels to acceptably return to pre-bomb levels was compared to the dominant frequency-dependent time recommended by CPIA 655. Results for multiple test configurations, including stable and unstable configurations, were reviewed. Spontaneous stability was assessed using two processes: 1) characterization of the ratio of the peak response amplitudes to the excited chamber acoustic mode amplitudes and 2) characterization of the variability of the peak response's frequency over the test duration. This characterization process assists in evaluating the discreteness of a signal as well as the stability of the chamber response. Broadband stability was assessed using a running root-mean-square evaluation. These techniques were also employed, in a comparative analysis, on available Fastrac data, and these results are presented here.

Kenny, R. Jeremy↗

QuantifyML: How good is my machine learning model?

This paper presents an approach, QuantifyML, which employs model counting to assess the learnability and robustness of machine learning models. Typically the efficacy of machine learning models is determined by computing their accuracy statistically on test data sets. However, this may be misleading, if the test data is not representative of the problem that is being studied. Further, two different models may have the same accuracy on a given data set, measured statistically, but may be very different in their behavior on unseen data. Also, models with high accuracy could have poor adversarial robustness. In QuantifyML, our goal is to precisely quantify the extent to which machine learning models have learned and generalized from the given data. In QuantifyML, a trained model is translated into a C program, which is fed to the CBMC model checking tool to produce a formula in Conjunctive Normal Form (CNF), which in turn is analyzed with state-of-the-art model counters to efficiently obtain precise counts w.r.t different outputs. QuantifyML enables i) evaluating the learnability of models by comparing the counts for the outputs to ground truth, expressed as logical predicates (if available), ii) comparing the performance of different models that may be built with different machine learning algorithms (e.g., decision-trees vs. neural networks), and iii) quantifying the robustness of trained models around given inputs. Our evaluation demonstrates these applications of QuantifyML on decision trees and neural networks trained to learn relational properties of graphs, for which we know the ground truth, and to perform image classification, for which we do not have the ground truth, but we can quantify local robustness.

Deep Neural Networks↗

Fatigue failure of materials under narrow band random vibrations. I.

A novel approach for the study of fatigue failure of materials under the multifactor influence of narrow band random vibrations is developed. The approach involves the conduction of an experiment in conjunction with various statistical techniques. Three factors including two statistical properties of the excitation or response are considered and varied simultaneously. A minimum of 6 tests for 3 variables is possible for a fractional f actorial design. The four coefficients of the predicting equation can be independently estimated. A look at 3 predicting equations shows the predominant effect of the root mean square stress of the first order equation.

Huang, T. C.↗

Method for Identifying Probable Archaeological Sites from Remotely Sensed Data

Archaeological sites are being compromised or destroyed at a catastrophic rate in most regions of the world. The best solution to this problem is for archaeologists to find and study these sites before they are compromised or destroyed. One way to facilitate the necessary rapid, wide area surveys needed to find these archaeological sites is through the generation of maps of probable archaeological sites from remotely sensed data. We describe an approach for identifying probable locations of archaeological sites over a wide area based on detecting subtle anomalies in vegetative cover through a statistically based analysis of remotely sensed data from multiple sources. We further developed this approach under a recent NASA ROSES Space Archaeology Program project. Under this project we refined and elaborated this statistical analysis to compensate for potential slight miss-registrations between the remote sensing data sources and the archaeological site location data. We also explored data quantization approaches (required by the statistical analysis approach), and we identified a superior data quantization approached based on a unique image segmentation approach. In our presentation we will summarize our refined approach and demonstrate the effectiveness of the overall approach with test data from Santa Catalina Island off the southern California coast. Finally, we discuss our future plans for further improving our approach.

Tilton, James C.↗