Search NASA⌕ Search

SEARCH · Search NASA

Results for “Statistical Testing Approach”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16
All sourcesNASA NTRSDOE OSTI
NASA NTRS2003

Software Reliability 2002

In FY01 we learned that hardware reliability models need substantial changes to account for differences in software, thus making software reliability measurements more effective, accurate, and easier to apply. These reliability models are generally based on familiar distributions or parametric methods. An obvious question is 'What new statistical and probability models can be developed using non-parametric and distribution-free methods instead of the traditional parametric method?" Two approaches to software reliability engineering appear somewhat promising. The first study, begin in FY01, is based in hardware reliability, a very well established science that has many aspects that can be applied to software. This research effort has investigated mathematical aspects of hardware reliability and has identified those applicable to software. Currently the research effort is applying and testing these approaches to software reliability measurement, These parametric models require much project data that may be difficult to apply and interpret. Projects at GSFC are often complex in both technology and schedules. Assessing and estimating reliability of the final system is extremely difficult when various subsystems are tested and completed long before others. Parametric and distribution free techniques may offer a new and accurate way of modeling failure time and other project data to provide earlier and more accurate estimates of system reliability.

Wallace, Dolores R.↗
NASA NTRS2005

Evaluation of Airborne Precision Spacing in a Human-in-the-Loop Experiment

A significant bottleneck in the current air traffic system occurs at the runway. Expanding airports and adding new runways will help solve this problem; however, this comes with significant costs: financially, politically and environmentally. A complementary solution is to safely increase the capacity of current runways. This can be achieved by precisely spacing aircraft at the runway threshold, with a resulting reduction in the spacing bu er required under today s operations. At NASA's Langley Research Center, the Airspace Systems program has been investigating airborne technologies and procedures that will assist the flight crew in achieving precise spacing behind another aircraft. A new spacing clearance allows the pilot to follow speed cues from a new on-board guidance system called Airborne Merging and Spacing for Terminal Arrivals (AMSTAR). AMSTAR receives Automatic Dependent Surveillance-Broadcast (ADS-B) reports from an assigned, leading aircraft and calculates the appropriate speed for the ownship to fly to achieve the desired spacing interval, time- or distance-based, at the runway threshold. Since the goal is overall system capacity, the speed guidance algorithm is designed to provide system-wide benefits and stability to a string of arriving aircraft. An experiment was recently performed at the NASA Langley Air Traffic Operations Laboratory (ATOL) to test the flexibility of Airborne Precision Spacing operations under a variety of operational conditions. These included several types of merge and approach geometries along with the complementary merging and in-trail operations. Twelve airline pilots and four controllers participated in this simulation. Performance and questionnaire data were collected from a total of eighty-four individual arrivals. The pilots were able to achieve precise spacing with a mean error of 0.5 seconds and a standard deviation of 4.7 seconds. No statistically significant di erences in spacing performance were found between in-trail and merging operations or among the three modeled airspaces. Questionnaire data showed general acceptance for both pilots and controllers. These results reinforce previous findings from full-mission simulation and flight evaluation of the in-trail operations. This paper reviews the results of this simulation in detail.

Barmore, Bryan E.↗
NASA NTRSDate not supplied

Supersonic Free-Flight Dynamics Testing in the Stratosphere

A new technique for obtaining stratospheric free-flight dynamics data for atmospheric entry capsules is described. The Stratospheric Projectile Experiment of Entry Dynamics (SPEED) represents a new approach to characterizing the free-flight dynamics of vehicles in the supersonic and transonic regime of flight. The SPEED test architecture leverages a stratospheric balloon and 3D-printed flight system in a novel two-stage configuration to deliver test articles to supersonic conditions in the atmosphere which achieve dynamic similitude with a full-scale vehicle. Designed to address the limitations of existing test facilities, SPEED captures the complete time evolution of a vehicle’s dynamic state while producing a statistically significant number of observed flight trajectories to address the stochastic nature of the wake-driven dynamic stability phenomenon. SPEED was developed over two years at NASA Ames Research Center. The inaugural flight of the SPEED test platform was conducted in the summer of 2024 where scaled capsules of the Mars Sample Return Earth Entry System and Dragonfly entry vehicle were tested. This paper describes the motivation for a new test architecture, operational constraints and achievable flight test envelopes, the design and development of the SPEED concept, and results from the demonstration flight. Techniques for estimating the dynamic aerodynamic characteristics and atmospheric conditions for each test article individually and as a collective are also discussed.

Entry Vehicle↗
NASA NTRSDate not supplied

Design and Technology Maturation of the Stratospheric Projectile Experiment of Entry Dynamics

A new technique for obtaining stratospheric free-flight dynamics data for atmospheric entry capsules is described. The Stratospheric Projectile Experiment of Entry Dynamics (SPEED) represents a new approach to characterizing the free-flight dynamics of vehicles in the supersonic and transonic regime of flight. The SPEED test architecture leverages a stratospheric balloon and 3D-printed flight system in a novel two-stage configuration to deliver test articles to supersonic conditions in the atmosphere which achieve dynamic similitude with a full-scale vehicle. Designed to address the limitations of existing test facilities, SPEED captures the complete time evolution of a vehicle’s dynamic state while producing a statistically significant number of observed flight trajectories to address the stochastic nature of the wake-driven dynamic stability phenomenon. SPEED was developed over two years at NASA Ames Research Center. This presentation describes the motivation for a new test architecture, operational constraints and achievable flight test envelopes, the design, and development of the SPEED concept.

Dynamic Stability↗
NASA NTRS2004

A New Approach to Using a Cloud-Resolving Model to Study the Interactions between Clouds, Precipitation and Aerosols

Recently Grabowski and Khairoutdinov and Randall have proposed and demonstrated, the feasibility of using 2D CRMs (these did not include detailed land processes and used periodic lateral boundary conditions) as 'super-parameterizations or a multi-scale modeling framework MMF' for cloud processes within atmospheric generation circulation models (GCMs). In the MMF, a fine-resolution 2D CRM takes the place of the single-column parameterization that is used in conventional GCMs. An overview of this approach is given by Randall et al.. Since a CRM can explicitly simulate cloud processes at the natural space and time scales of clouddynamical processes, it's possible to compute statistics of cloud fields, including radiances and radar backscatters, directly simulated/produced by the CRM. A seed fund is available at NASA Goddard to build a MMF based on a 2D GCE model and the Goddard fvGCM. A prototype MMF will be developed at end of 2004. The major objectives are to test and evaluate its performance using the GCE model as the super parameterization and compare its results with other super parameterizations, conventional GCMs and observations. Recently, a detailed spectral-bin microphysical scheme was implemented into the Goddard Cumulus Ensemble (WE) model. The GCE model is a CRM and it has been improved and applied to study the precipitation processes in the past two decades. Atmospheric aerosols are also described using number density size-distribution functions. The model is tested by studying the evolution of deep tropical clouds in the west Pacific warm pool region and summertime convection over a mid-latitude continent with different concentrations of CCN: a low 'clean' concentration and a high 'dirty' concentration. The impact of atmospheric aerosol concentration on cloud and precipitation will be investigated. In addition, the similarities and differences between bulk- and spectral-bin microphysics will be presented,

Tao, Wei-Kuo↗
NASA NTRS2001

Inferring Instantaneous, Multivariate and Nonlinear Sensitivities for the Analysis of Feedback Processes in a Dynamical System: Lorenz Model Case Study

A new approach is presented for the analysis of feedback processes in a nonlinear dynamical system by observing its variations. The new methodology consists of statistical estimates of the sensitivities between all pairs of variables in the system based on a neural network modeling of the dynamical system. The model can then be used to estimate the instantaneous, multivariate and nonlinear sensitivities, which are shown to be essential for the analysis of the feedbacks processes involved in the dynamical system. The method is described and tested on synthetic data from the low-order Lorenz circulation model where the correct sensitivities can be evaluated analytically.

Aires, Filipe↗
NASA NTRS2010

Analyzing Non Stationary Processes in Radiometers

The lack of well-developed techniques for modeling changing statistical moments in our observations has stymied the application of stochastic process theory for many scientific and engineering applications. Non linear effects of the observation methodology is one of the most perplexing aspects to modeling non stationary processes. This perplexing problem was encountered when modeling the effect of non stationary receiver fluctuations on the performance of radiometer calibration architectures. Existing modeling approaches were found not applicable; particularly problematic is modeling processes across scales over which they begin to exhibit non stationary behavior within the time interval of the calibration algorithm. Alternatively, the radiometer output is modeled as samples from a sequence random variables; the random variables are treated using a conditional probability distribution function conditioned on the use of the variable in the calibration algorithm. This approach of treating a process as a sequence of random variables with non stationary stochastic moments produce sensible predictions of temporal effects of calibration algorithms. To test these model predictions, an experiment using the Millimeter wave Imaging Radiometer (MIR) was conducted. The MIR with its two black body calibration references was configured in a laboratory setting to observe a third ultra-stable reference (CryoTarget). The MIR was programmed to sequentially sample each of the three references in approximately a 1 second cycle. Data were collected over a six-hour interval. The sequence of reference measurements form an ensemble sample set comprised of a series of three reference measurements. Two references are required to estimate the receiver response. A third reference is used to estimate the uncertainty in the estimate. Typically, calibration algorithms are designed to suppress the non stationary effects of receiver fluctuations. By treating the data sequence as an ensemble collection, it is possible to apply temporal algorithms which exacerbate the non stationary effects. By varying the algorithm, information about the properties of the non stationary receiver fluctuations is obtained. Comparisons of analytical calculations and statistical analysis of data demonstrate impressive agreement.

Racette, Paul↗
NASA NTRS1972

Development and in-flight performance of the Mariner 9 spacecraft propulsion system

On November 14, 1971, Mariner 9 was decelerated into orbit about Mars by a 1334-newton (300-lbf) liquid bipropellant propulsion system. The development and in-flight performance are described and summarized of this pressure-fed, nitrogen tetroxide/monomethyl hydrazine bipropellant system. The design of all Mariner propulsion subsystems has been predicated upon the premise that simplicity of approach, coupled with thorough qualification and margin-limits testing, is the key to cost-effective reliability. The qualification test program and analytical modeling of the Mariner 9 subsystem are discussed. Since the propulsion subsystem is modular in nature, it was completely checked, serviced, and tested independent of the spacecraft. Proper prediction of in-flight performance required the development of three significant modeling tools to predict and account for nitrogen saturation of the propellant during the six-month coast period and to predict and statistically analyze in-flight data. The flight performance of the subsystem was excellent, as were the performance prediction correlations. These correlations are presented.

Evans, D. D.↗
NASA NTRS1999

Adaptive Error Estimation in Linearized Ocean General Circulation Models

Data assimilation methods are routinely used in oceanography. The statistics of the model and measurement errors need to be specified a priori. This study addresses the problem of estimating model and measurement error statistics from observations. We start by testing innovation based methods of adaptive error estimation with low-dimensional models in the North Pacific (5-60 deg N, 132-252 deg E) to TOPEX/POSEIDON (TIP) sea level anomaly data, acoustic tomography data from the ATOC project, and the MIT General Circulation Model (GCM). A reduced state linear model that describes large scale internal (baroclinic) error dynamics is used. The methods are shown to be sensitive to the initial guess for the error statistics and the type of observations. A new off-line approach is developed, the covariance matching approach (CMA), where covariance matrices of model-data residuals are "matched" to their theoretical expectations using familiar least squares methods. This method uses observations directly instead of the innovations sequence and is shown to be related to the MT method and the method of Fu et al. (1993). Twin experiments using the same linearized MIT GCM suggest that altimetric data are ill-suited to the estimation of internal GCM errors, but that such estimates can in theory be obtained using acoustic data. The CMA is then applied to T/P sea level anomaly data and a linearization of a global GFDL GCM which uses two vertical modes. We show that the CMA method can be used with a global model and a global data set, and that the estimates of the error statistics are robust. We show that the fraction of the GCM-T/P residual variance explained by the model error is larger than that derived in Fukumori et al.(1999) with the method of Fu et al.(1993). Most of the model error is explained by the barotropic mode. However, we find that impact of the change in the error statistics on the data assimilation estimates is very small. This is explained by the large representation error, i.e. the dominance of the mesoscale eddies in the T/P signal, which are not part of the 21 by 1" GCM. Therefore, the impact of the observations on the assimilation is very small even after the adjustment of the error statistics. This work demonstrates that simult&neous estimation of the model and measurement error statistics for data assimilation with global ocean data sets and linearized GCMs is possible. However, the error covariance estimation problem is in general highly underdetermined, much more so than the state estimation problem. In other words there exist a very large number of statistical models that can be made consistent with the available data. Therefore, methods for obtaining quantitative error estimates, powerful though they may be, cannot replace physical insight. Used in the right context, as a tool for guiding the choice of a small number of model error parameters, covariance matching can be a useful addition to the repertory of tools available to oceanographers.

Chechelnitsky, Michael Y.↗
NASA NTRS1978

Prediction, evaluation, and specification of flying qualities by means of step target tracking

A new approach to flying qualities specification and evaluation is presented which coordinates current research in the areas of pilot ratings, pilot-aircraft modeling techniques, and simulation and flight test procedures. A time-domain pilot model is described which can model discontinuous and nonlinear pilot behavior in conjunction with completely general time-varying nonlinear aircraft models to simulate discrete maneuvers. This pilot-aircraft model is applied to an existing set of in-flight simulation data, and calculates tracking error and time-on-target statistics for step target tracking that directly relate to the reported pilot comments and ratings. Predicted step target tracking data for eighteen F-5E flight conditions are presented, and the use of the method for control system design is demonstrated using the YF-17.

Onstott, E. D.↗
NASA NTRS1981

Motion-base simulator results of advanced supersonic transport handling qualities with active controls

Handling qualities of the unaugmented advanced supersonic transport (AST) are deficient in the low-speed, landing approach regime. Consequently, improvement in handling with active control augmentation systems has been achieved using implicit model-following techniques. Extensive fixed-based simulator evaluations were used to validate these systems prior to tests with full motion and visual capabilities on a six-axis motion-base simulator (MBS). These tests compared the handling qualities of the unaugmented AST with several augmented configurations to ascertain the effectiveness of these systems. Cooper-Harper ratings, tracking errors, and control activity data from the MBS tests have been analyzed statistically. The results show the fully augmented AST handling qualities have been improved to an acceptable level.

Feather, J. B.↗
NASA NTRS2002

Flexible Wing Base Micro Aerial Vehicles: Vision-Guided Flight Stability and Autonomy for Micro Air Vehicles

Substantial progress has been made recently towards design building and test-flying remotely piloted Micro Air Vehicle's (MAVs). We seek to complement this progress in overcoming the aerodynamic obstacles to.flight at very small scales with a vision stability and autonomy system. The developed system based on a robust horizon detection algorithm which we discuss in greater detail in a companion paper. In this paper, we first motivate the use of computer vision for MAV autonomy arguing that given current sensor technology, vision may he the only practical approach to the problem. We then briefly review our statistical vision-based horizon detection algorithm, which has been demonstrated at 30Hz with over 99.9% correct horizon identification. Next we develop robust schemes for the detection of extreme MAV attitudes, where no horizon is visible, and for the detection of horizon estimation errors, due to external factors such as video transmission noise. Finally, we discuss our feed-back controller for self-stabilized flight, and report results on vision autonomous flights of duration exceeding ten minutes.

Ettinger, Scott M.↗
NASA NTRSDate not supplied

Interpretable Machine Learning Models for Autonomous Characterization of Analogue Ocean World Seawater Chemistry and Biosignature Potential Using Isotope Ratio Data

Background: Future missions to ocean worlds, such as Enceladus and Europa, will attempt to characterize the subsurface seawater chemistry and assess the potential for life. Such missions will be equipped with capabilities to precisely measure volatile isotopes in plumes, atmospheres, and exospheres. Motivation: While large isotopic fractionations can indicate a biological source, there are signatures resulting from abiotic geochemical processes that mimic isotopic biosignatures. While machine learning (ML) has the potential to disentangle competing effects and biotic mimicry, high-dimensional isotope ratio mass spectrometry (IRMS) data is likely to contain noise/irrelevant features and involve complex statistical interactions that make human inference and interpretation difficult. Further, ML predictions with as far-reaching implications as an extraterrestrial biosignature on an ocean world requires the use of interpretable models (i.e., not “black box” models) with physically and mathematically meaningful feature spaces along with false positive diagnostics. Methods: We use volatile CO2 IRMS data of analogue ocean world seawaters to validate an ML approach to provide biogeochemical context for biosignature detection. We employ a feature selection method called nearest-neighbor projected distance regression (NPDR) that detects statistical interactions and helps elucidate the mechanisms of the Random Forest classification models. Results: We train and validate predictive ML models on volatile CO2 IRMS data of analogue ocean world seawaters to predict major salt components (e.g., MgSO4, NaHCO3), pH, ionic strength, and the presence of biosignatures. Features derived from IRMS measurements are augmented with extracted time-series features. Our results show high test accuracy and interpretability, which is increased by interaction network visualization, sample-wise variable importance scores, and single-sample class probability estimates. We demonstrate an ML mission software solution that triggers autonomous data transmission and biogeochemical sample prediction.

geochemistry↗
NASA NTRS2015

Case Studies for the Statistical Design of Experiments Applied to Powered Rotor Wind Tunnel Tests

The application of statistical Design of Experiments (DOE) to helicopter wind tunnel testing was explored during two powered rotor wind tunnel entries during the summers of 2012 and 2013. These tests were performed jointly by the U.S. Army Aviation Development Directorate Joint Research Program Office and NASA Rotary Wing Project Office, currently the Revolutionary Vertical Lift Project, at NASA Langley Research Center located in Hampton, Virginia. Both entries were conducted in the 14- by 22-Foot Subsonic Tunnel with a small portion of the overall tests devoted to developing case studies of the DOE approach as it applies to powered rotor testing. A 16-47 times reduction in the number of data points required was estimated by comparing the DOE approach to conventional testing methods. The average error for the DOE surface response model for the OH-58F test was 0.95 percent and 4.06 percent for drag and download, respectively. The DOE surface response model of the Active Flow Control test captured the drag within 4.1 percent of measured data. The operational differences between the two testing approaches are identified, but did not prevent the safe operation of the powered rotor model throughout the DOE test matrices.

Overmeyer, Austin D.↗
NASA NTRS1994

Progress in modeling atmospheric propagation of sonic booms

The improved simulation of sonic boom propagation through the real atmosphere requires greater understanding of how the transient acoustic pulses popularly termed sonic booms are affected by humidity and turbulence. A realistic atmosphere is invariably somewhat turbulent, and may be characterized by an ambient fluid velocity v and sound speed c that vary from point to point. The absolute humidity will also vary from point to point, although possibly not as irregularly. What is ideally desired is a relatively simple scheme for predicting the probable spreads in key sonic boom signature parameters. Such parameters could be peak amplitudes, rise times, or gross quantities obtainable by signal processing that correlate well with annoyance or damage potential. The practical desire for the prediction scheme is that it require a relatively small amount of knowledge, possibly of a statistical nature, concerning the atmosphere along, the propagation path from the aircraft to the ground. The impact of such a scheme, if developed, implemented, and verified, would be that it would give the persons who make planning decisions a tool for assessing the magnitude of environmental problems that might result from any given overflight or sequence of overflights. The technical approach that has been followed by the author and some of his colleagues is to formulate a hierarchy of simple approximate models based on fundamental physical principles and then to test these models against existing data. For propagation of sonic booms and of other types of acoustic pulses in nonturbulent model atmospheres, there exists a basic overall theoretical model that has evolved as an outgrowth of geometrical acoustics. This theoretical model depicts the sound as propagating within ray tubes in a manner analogous to sound in a waveguide of slowly varying cross-section. Propagation along the ray tube is quasi-one-dimensional, and a wave equation for unidirectional wave propagation is used. A nonlinear term is added to this equation to account for nonlinear steepening, and the formulation has been carried through to allow for spatially varying sound speed, ambient density, and ambient wind velocities. The model intrinsically neglects diffraction, so it cannot take into account what has previously been mentioned in the literature as possibly important mechanisms for turbulence-related distortion. The model as originally developed could predict an idealized N-waveform which often agrees with data in terms of peak amplitude and overall positive phase duration. It is possible, moreover, to develop simple methods based on the physics of relaxation processes for incorporating molecular relaxation into the quasi-one-dimensional model of nonlinear propagation along ray tubes.

Pierce, Allan D.↗
NASA NTRS2005

Launch Vehicle Propulsion Design with Multiple Selection Criteria

The approach and techniques described herein define an optimization and evaluation approach for a liquid hydrogen/liquid oxygen single-stage-to-orbit system. The method uses Monte Carlo simulations, genetic algorithm solvers, a propulsion thermo-chemical code, power series regression curves for historical data, and statistical models in order to optimize a vehicle system. The system, including parameters for engine chamber pressure, area ratio, and oxidizer/fuel ratio, was modeled and optimized to determine the best design for seven separate design weight and cost cases by varying design and technology parameters. Significant model results show that a 53% increase in Design, Development, Test and Evaluation cost results in a 67% reduction in Gross Liftoff Weight. Other key findings show the sensitivity of propulsion parameters, technology factors, and cost factors and how these parameters differ when cost and weight are optimized separately. Each of the three key propulsion parameters; chamber pressure, area ratio, and oxidizer/fuel ratio, are optimized in the seven design cases and results are plotted to show impacts to engine mass and overall vehicle mass.

Shelton, Joey D.↗
NASA NTRS2010

Impact of Damping Uncertainty on SEA Model Response Variance

Statistical Energy Analysis (SEA) is commonly used to predict high-frequency vibroacoustic levels. This statistical approach provides the mean response over an ensemble of random subsystems that share the same gross system properties such as density, size, and damping. Recently, techniques have been developed to predict the ensemble variance as well as the mean response. However these techniques do not account for uncertainties in the system properties. In the present paper uncertainty in the damping loss factor is propagated through SEA to obtain more realistic prediction bounds that account for both ensemble and damping variance. The analysis is performed on a floor-equipped cylindrical test article that resembles an aircraft fuselage. Realistic bounds on the damping loss factor are determined from measurements acquired on the sidewall of the test article. The analysis demonstrates that uncertainties in damping have the potential to significantly impact the mean and variance of the predicted response.

Schiller, Noah↗
NASA NTRS2013

Closed-Loop Analysis of Soft Decisions for Serial Links

We describe the benefit of using closed-loop measurements for a radio receiver paired with a counterpart transmitter. We show that real-time analysis of the soft decision output of a receiver can provide rich and relevant insight far beyond the traditional hard-decision bit error rate (BER) test statistic. We describe a Soft Decision Analyzer (SDA) implementation for closed-loop measurements on single- or dual- (orthogonal) channel serial data communication links. The analyzer has been used to identify, quantify, and prioritize contributors to implementation loss in live-time during the development of software defined radios. This test technique gains importance as modern receivers are providing soft decision symbol synchronization as radio links are challenged to push more data and more protocol overhead through noisier channels, and software-defined radios (SDRs) use error-correction codes that approach Shannon's theoretical limit of performance.

Lansdowne, Chatwin A.↗