Search NASA⌕ Search

SEARCH · Search NASA

Results for “Assessment Methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 685 records · Page 38

Modern wing flutter analysis by computational fluid dynamics methods

The application and assessment of the recently developed CAP-TSD transonic small-disturbance code for flutter prediction is described. The CAP-TSD code has been developed for aeroelastic analysis of complete aircraft configurations and was previously applied to the calculation of steady and unsteady pressures with favorable results. Generalized aerodynamic forces and flutter characteristics are calculated and compared with linear theory results and with experimental data for a 45 deg sweptback wing. These results are in good agreement with the experimental flutter data which is the first step toward validating CAP-TSD for general transonic aeroelastic applications. The paper presents these results and comparisons along with general remarks regarding modern wing flutter analysis by computational fluid dynamics methods.

Cunningham, Herbert J.↗

Executive Summary: Special Section on Credible Computational Fluid Dynamics Simulations

This summary presents the motivation for the Special Section on the credibility of computational fluid dynamics (CFD) simulations, its objective, its background and context, its content, and its major conclusions. Verification and validation (V&V) are the processes for establishing the credibility of CFD simulations. Validation assesses whether correct things are performed and verification assesses whether they are performed correctly. Various aspects of V&V are discussed. Progress is made in verification of simulation models. Considerable effort is still needed for developing a systematic validation method that can assess the credibility of simulated reality.

Mehta, Unmeel B.↗

Uncertainty Models for the Hybrid Parametric Variation Method of Uncertainty Quantification; Analysis

There is some level of uncertainty in every finite element model (FEM), which flows to a level of uncertainty in predicted results. The purpose of uncertainty quantification (UQ) is to provide statistical bounds on prediction accuracy based on model uncertainty. This is distinct from model updating, which attempts to modify models to improve their accuracy. UQ does not improve the accuracy of models, but accepts that the models are inherently inaccurate and attempts to quantify the impact of that inaccuracy on predicted results. Previously, an alternate method for UQ, called the Hybrid Parametric Variation (HPV) method, was applied to Space Launch System (SLS) Hurty/Craig-Bampton (HCB) components to predict system-level statistics for launch vehicle attitude control transfer functions and core stage section loads due to buffet. The HPV method combines a parametric variation of the HCB fixed-interface (FI) modal frequencies with a nonparametric variation (NPV) method that randomly varies the HCB mass and stiffness matrices as Wishart random matrix distributions using random matrix theory (RMT). Alternatively, the most common method for modeling uncertainty in the structural dynamics community is a parametric approach, which varies physical parameters in the model. However, there are several disadvantages associated with the parametric method. Determining a reduced set of parameters that have a significant impact on the system response can be time consuming, and the selected parameter probability distributions are rarely reliably known. Therefore, in practice, the parameters are surrogates for the actual errors, and the link to parameter uncertainty is unknown. Another major drawback is that the uncertainty that can be represented is limited to the form of the nominal FEM. It is the experience of the authors that based on numerous aerospace programs, almost all FEM errors are in form rather than parameter values. This hypothesis is supported by the observation of the authors that it is almost never possible to ‘tune’ a FEM to match modal test results by only modifying model parameters. Model-form uncertainty cannot be directly represented by FEM input parameters nor included in a parametric approach. However, model-form uncertainty can be modeled using RMT, where a probability distribution is developed for the matrix ensemble of interest. The major advantage of the NPV method is that it covers errors in model form. The HPV method anchors uncertainty at the HCB component level to component modal test results by matching the HCB and test modes based on mode descriptions or other methods, and then applying differing levels of frequency variation. The specific variations depend on the confidence to which a component FEM has been validated through modal testing. The NPV method is layered on the frequency variation to match modal test self-orthogonality and cross-orthogonality (XO) results. Once the component uncertainty models are identified, they are assembled, and the uncertainty is propagated to the system level using a Monte Carlo (MC) analysis approach that generates statistics for system-level predictions This provides a UQ method that can be traced to test data, which can be updated as additional data and improved correlated models become available. The purpose of this paper is to collect and present all of the theory for HPV that has been previously published in reports and papers and to present examples of its application. Specifically, component uncertainty models based on the dispersion of corresponding mass and stiffness matrices using proposed test/analysis correlation metrics are investigated. The first example is purely academic so that the true answers are known, and the validity of the HPV method and the corresponding uncertainty models can be determined. The purpose of this paper is to collect and present all of the theory for HPV that has been previously published in reports and papers and to present examples of its application. Specifically, component uncertainty models based on the dispersion of corresponding mass and stiffness matrices using proposed test/analysis correlation metrics are investigated. The first example is purely academic so that the true answers are known, and the validity of the HPV method and the corresponding uncertainty models can be determined. The second example is an application to a component that is design specific to the SLS. Based on this work and other assessments, the HPV method provides another tool to the toolset used for complex system UQ analysis. From experience gathered to date using the HPV method, additional design specific applications must be investigated to provide further confidence in the validity of the HPV method of UQ analysis.

Uncertainty quantification↗

Analysis of terrestrial conditions and dynamics

Land spectral reflectance properties for selected locations, including the Goddard Space Flight Center, the Wallops Flight Facility, a MLA test site in Cambridge, Maryland, and an acid test site in Burlington, Vermont, were measured. Methods to simulate the bidirectional reflectance properties of vegetated landscapes and a data base for spatial resolution were developed. North American vegetation patterns observed with the Advanced Very High Resolution Radiometer were assessed. Data and methods needed to model large-scale vegetation activity with remotely sensed observations and climate data were compiled.

Goward, S. N.↗

A wall interference assessment/correction system

A Wall Signature method, the Hackett method, has been selected to be adapted for the 12-ft Wind Tunnel wall interference assessment/correction (WIAC) system in the present phase. This method uses limited measurements of the static pressure at the wall, in conjunction with the solid wall boundary condition, to determine the strength and distribution of singularities representing the test article. The singularities are used in turn for estimating wall interferences at the model location. The Wall Signature method will be formulated for application to the unique geometry of the 12-ft Tunnel. The development and implementation of a working prototype will be completed, delivered and documented with a software manual. The WIAC code will be validated by conducting numerically simulated experiments rather than actual wind tunnel experiments. The simulations will be used to generate both free-air and confined wind-tunnel flow fields for each of the test articles over a range of test configurations. Specifically, the pressure signature at the test section wall will be computed for the tunnel case to provide the simulated 'measured' data. These data will serve as the input for the WIAC method-Wall Signature method. The performance of the WIAC method then may be evaluated by comparing the corrected parameters with those for the free-air simulation. Each set of wind tunnel/test article numerical simulations provides data to validate the WIAC method. A numerical wind tunnel test simulation is initiated to validate the WIAC methods developed in the project. In the present reported period, the blockage correction has been developed and implemented for a rectangular tunnel as well as the 12-ft Pressure Tunnel. An improved wall interference assessment and correction method for three-dimensional wind tunnel testing is presented in the appendix.

Lo, Ching F.↗

Risk assessment methodologies for target fragments produced in high-energy nucleon reactions

Collisions of energetic protons with target nuclei yield nuclear products of large linear energy transfer, and it is usually assumed that the energy of the heavy products is absorbed locally with a quality factor of 20. Past methods of risk assessment have relied on the Bertini (1969) model to evaluate the nuclear reaction products. If the Q(F) of 20 is correct, then a significant underestimate of biological risk from the nuclear products could result from the use of Bertini's model. On the other hand, a Q(F) of 20 is probably too large for some of the lighter fragments, leaving prior risk estimates as possibly correct or even conservative. This issue is discussed here in the context of the recently proposed nuclear data set of Wilson et al. (1989).

Shinn, J. L.↗

Hierarchical Simulation to Assess Hardware and Software Dependability

This thesis presents a method for conducting hierarchical simulations to assess system hardware and software dependability. The method is intended to model embedded microprocessor systems. A key contribution of the thesis is the idea of using fault dictionaries to propagate fault effects upward from the level of abstraction where a fault model is assumed to the system level where the ultimate impact of the fault is observed. A second important contribution is the analysis of the software behavior under faults as well as the hardware behavior. The simulation method is demonstrated and validated in four case studies analyzing Myrinet, a commercial, high-speed networking system. One key result from the case studies shows that the simulation method predicts the same fault impact 87.5% of the time as is obtained by similar fault injections into a real Myrinet system. Reasons for the remaining discrepancy are examined in the thesis. A second key result shows the reduction in the number of simulations needed due to the fault dictionary method. In one case study, 500 faults were injected at the chip level, but only 255 propagated to the system level. Of these 255 faults, 110 shared identical fault dictionary entries at the system level and so did not need to be resimulated. The necessary number of system-level simulations was therefore reduced from 500 to 145. Finally, the case studies show how the simulation method can be used to improve the dependability of the target system. The simulation analysis was used to add recovery to the target software for the most common fault propagation mechanisms that would cause the software to hang. After the modification, the number of hangs was reduced by 60% for fault injections into the real system.

Ries, Gregory Lawrence↗

Risk Reduction on X-33/RLV Engines

Risk management has received considerable attention in the X-33 and Reusable Launch Vehicle (RLV) program due to aggressive schedules, limited funding. and planned private investment to develop the commercial VentureStar vehicle. As an X-33 and RLV team member and main propulsion supplier, Boeing Rocketdyn Propulsion and Power has addressed risk through a methodical application of systems engineering in identifying, assessing, and mitigating risks. The methods employed involve rigorous risk mitigation planning early in development, continuous risk monitoring and assessment during the course of development, and the systematic verification of compliance with technical requirements prior to delivery. In addition, an engine system reliability analysis was conducted to reduce risk. In July 1996, NASA selected Lockheed Martin's "Skunk Works" (LMSW) as the lead contractor for the X-33 and RLV program. The X-33 vehicle is a half-scale pathfinder for the full-scale RLV. The LMSW RLV design is a lifting body shaped vehicle employing linear aerospike engine provided propulsion. The initial X-33 flight is planned for the summer of 2000, and the initial VentureStar flight is planned for between 2005 and 2007.

Crowley, Tim↗

On the Assessment of Acoustic Scattering and Shielding by Time Domain Boundary Integral Equation Solutions

Based on the time domain boundary integral equation formulation of the linear convective wave equation, a computational tool dubbed Time Domain Fast Acoustic Scattering Toolkit (TD-FAST) has recently been under development. The time domain approach has a distinct advantage that the solutions at all frequencies are obtained in a single computation. In this paper, the formulation of the integral equation, as well as its stabilization by the Burton-Miller type reformulation, is extended to cases of a constant mean flow in an arbitrary direction. In addition, a "Source Surface" is also introduced in the formulation that can be employed to encapsulate regions of noise sources and to facilitate coupling with CFD simulations. This is particularly useful for applications where the noise sources are not easily described by analytical source terms. Numerical examples are presented to assess the accuracy of the formulation, including a computation of noise shielding by a thin barrier motivated by recent Historical Baseline F31A31 open rotor noise shielding experiments. Furthermore, spatial resolution requirements of the time domain boundary element method are also assessed using point per wavelength metrics. It is found that, using only constant basis functions and high-order quadrature for surface integration, relative errors of less than 2% may be obtained when the surface spatial resolution is 5 points-per-wavelength (PPW) or 25 points-per-wavelength squared (PPW2).

Hu, Fang Q.↗

Assessment of an Euler-Interacting Boundary Layer Method Using High Reynolds Number Transonic Flight Data

Flight-measured high Reynolds number turbulent-flow pressure distributions on a transport wing in transonic flow are compared to unstructured-grid calculations to assess the predictive ability of a three-dimensional Euler code (USM3D) coupled to an interacting boundary layer module. The two experimental pressure distributions selected for comparative analysis with the calculations are complex and turbulent but typical of an advanced technology laminar flow wing. An advancing front method (VGRID) was used to generate several tetrahedral grids for each test case. Initial calculations left considerable room for improvement in accuracy. Studies were then made of experimental errors, transition location, viscous effects, nacelle flow modeling, number and placement of spanwise boundary layer stations, and grid resolution. The most significant improvements in the accuracy of the calculations were gained by improvement of the nacelle flow model and by refinement of the computational grid. Final calculations yield results in close agreement with the experiment. Indications are that further grid refinement would produce additional improvement but would require more computer memory than is available. The appendix data compare the experimental attachment line location with calculations for different grid sizes. Good agreement is obtained between the experimental and calculated attachment line locations.

Bonhaus, Daryl L.↗

Probabilistic Risk Assessment Procedures Guide for NASA Managers and Practitioners (Second Edition)

Probabilistic Risk Assessment (PRA) is a comprehensive, structured, and logical analysis method aimed at identifying and assessing risks in complex technological systems for the purpose of cost-effectively improving their safety and performance. NASA's objective is to better understand and effectively manage risk, and thus more effectively ensure mission and programmatic success, and to achieve and maintain high safety standards at NASA. NASA intends to use risk assessment in its programs and projects to support optimal management decision making for the improvement of safety and program performance. In addition to using quantitative/probabilistic risk assessment to improve safety and enhance the safety decision process, NASA has incorporated quantitative risk assessment into its system safety assessment process, which until now has relied primarily on a qualitative representation of risk. Also, NASA has recently adopted the Risk-Informed Decision Making (RIDM) process [1-1] as a valuable addition to supplement existing deterministic and experience-based engineering methods and tools. Over the years, NASA has been a leader in most of the technologies it has employed in its programs. One would think that PRA should be no exception. In fact, it would be natural for NASA to be a leader in PRA because, as a technology pioneer, NASA uses risk assessment and management implicitly or explicitly on a daily basis. NASA has probabilistic safety requirements (thresholds and goals) for crew transportation system missions to the International Space Station (ISS) [1-2]. NASA intends to have probabilistic requirements for any new human spaceflight transportation system acquisition. Methods to perform risk and reliability assessment in the early 1960s originated in U.S. aerospace and missile programs. Fault tree analysis (FTA) is an example. It would have been a reasonable extrapolation to expect that NASA would also become the world leader in the application of PRA. That was, however, not to happen. Early in the Apollo program, estimates of the probability for a successful roundtrip human mission to the moon yielded disappointingly low (and suspect) values and NASA became discouraged from further performing quantitative risk analyses until some two decades later when the methods were more refined, rigorous, and repeatable. Instead, NASA decided to rely primarily on the Hazard Analysis (HA) and Failure Modes and Effects Analysis (FMEA) methods for system safety assessment.

Stamatelatos,Michael↗

Work In Progress: Using Internships as Means for Indirect Assessment of ABET Criteria 3 “1-7” Student Outcomes

The Electrical & Computer Engineering (ECE) Department at Portland State University (PSU) has developed a Power Engineering Internship (PEI) program that provides engineering career development pathways within the electric utility industry. The PEI is supported by several U.S. Department of Energy grants that aim to develop quality career opportunities and develop a future electric utility workforce that represents the nation’s diverse populations. The PSU ECE Department intends to use surveys of internship participants as assessment tools for its ABET accreditation process, in particular, the ABET Criteria 3 Student Outcomes (SOs). SOs relate to the knowledge, skills, and behaviors that students acquire as they progress through an engineering program [1]. They describe what engineering students are expected to know and should be able to do by the time they graduate. Engineering education literature presents multiple methods for using internships as means for assessing SOs. Methods include using self-assessments that derive from internship experiences as well as mapping survey responses from employers and interns to SOs. Such methods gain value as they are assessed over multiple years. However, the majority of this literature discusses assessment tools that were developed for the ABET 2000 Criteria 3 “a through k” SOs. One of our motivations is to provide assessment tools that can be used to assess modern Criteria 3 SOs based on students’ internship experiences.

Bass, Robert [Portland State University]↗

The analysis of Gemini 7 EEG data by three different computer oriented methods

The problem in assessment of electroencephalograms has been the subject element in visual evaluations of such records as well as the need for extensive training (2 or 3 years) before suitable candidate is capable to perform this task. There have been variety of computer type analyses of EEG during the past ten years or more, and we are still searching for a reliable, inexpensive, online data processing procedure for this task. We are aware our Soviet colleagues are routinely using computer assessment of EEGs, using relatively inexpensive hardware. In our report we endeavor to show how four different assessment procedures (visual assessment, zero crossing technique, smoothing and peak counting technique, and Weibull Statistic) may be utilized, and indicate the advantages and disadvantages peculiar to each. We wish to point out that in the Gemini 7 EEG analog records supplied to the Henry Ford Hospital, Channel II (mid-line central to mid-line occipital electrodes) could not be assessed reliably after approximately 26 hours of flight. Channel I (left central to left occipital electrodes) provided the more assessable EEG up to approximately 54 hours of flight. These channels were compared during the first 26 hours of flight, and no significant difference was found by our various assessment procedures. We, therefore, have limited this report to the findings on the analyses of Channel I during its approximate 54 hours of flight.

Proctor, L. D.↗

Assessing the impact of different satellite retrieval methods on forecast available potential energy

The effects of the inclusion of satellite temperature retrieval data, and of different satellite retrieval methods, on forecasts made with the NASA Goddard Laboratory for Atmospheres (GLA) fourth-order model were investigated using, as the parameter, the available potential energy (APE) in its isentropic form. Calculation of the APE were used to study the differences in the forecast sets both globally and in the Northern Hemisphere during 72-h forecast period. The analysis data sets used for the forecasts included one containing the NESDIS TIROS-N retrievals, the GLA retrievals using the physical inversion method, and a third, which did not contain satellite data, used as a control; two data sets, with and without satellite data, were used for verification. For all three data sets, the Northern Hemisphere values for the total APE showed an increase throughout the forecast period, mostly due to an increase in the zonal component, in contrast to the verification sets, which showed a steady level of total APE.

Whittaker, Linda M.↗

An Assessment of Artificial Compressibility and Pressure Projection Methods for Incompressible Flow Simulations

Performance of the two commonly used numerical procedures, one based on artificial compressibility method and the other pressure projection method, are compared. These formulations are selected primarily because they are designed for three-dimensional applications. The computational procedures are compared by obtaining steady state solutions of a wake vortex and unsteady solutions of a curved duct flow. For steady computations, artificial compressibility was very efficient in terms of computing time and robustness. For an unsteady flow which requires small physical time step, pressure projection method was found to be computationally more efficient than an artificial compressibility method. This comparison is intended to give some basis for selecting a method or a flow solution code for large three-dimensional applications where computing resources become a critical issue.

Kwak, Dochan↗

Assessment of NASA Dual Microstructure Heat Treatment Method for Multiple Forging Batch Heat Treatment

NASA dual microstructure heat treatment technology previously demonstrated on single forging heat treat batches of a generic disk shape was successfully demonstrated on a multiple disk batch of a production shape component. A group of four Rolls-Royce Corporation 3rd Stage AE2100 forgings produced from alloy ME209 were successfully dual microstructure heat treated as a single heat treat batch. The forgings responded uniformly as evidenced by part-to-part consistent thermocouple recordings and resultant macrostructures, and from ultrasonic examination. Multiple disk DMHT processing offers a low cost alternative to other published dual microstructure processing techniques.

Gayda, John↗

Assessment of NASA Dual Microstructure Heat Treatment Method Utilizing Ladis SuperCooler(trademark) Cooling Technology

The intent of this investigation was to demonstrate the NASA DMHT method with a tailored Ladish SuperCool(Trademark) cooling method on a Rolls-Royce AE2100, stage 3 disk shape. One disk each of two alloys, LSHR and ME3, were successfully converted as shown by macrostructure. DMHT heating time selection and cooling rate was aided by finite element modeling analysis. Residual stresses were also predicted and reported. Detailed microstructural analysis was performed by NASA and included in this report. Mechanical property characterization, also planned by NASA, is incomplete at this time and not part of this report.

Lemsky, Joe↗

Signal Processing Methods for Liquid Rocket Engine Combustion Stability Assessments

The J2X Gas Generator engine design specifications include dynamic, spontaneous, and broadband combustion stability requirements. These requirements are verified empirically based high frequency chamber pressure measurements and analyses. Dynamic stability is determined with the dynamic pressure response due to an artificial perturbation of the combustion chamber pressure (bomb testing), and spontaneous and broadband stability are determined from the dynamic pressure responses during steady operation starting at specified power levels. J2X Workhorse Gas Generator testing included bomb tests with multiple hardware configurations and operating conditions, including a configuration used explicitly for engine verification test series. This work covers signal processing techniques developed at Marshall Space Flight Center (MSFC) to help assess engine design stability requirements. Dynamic stability assessments were performed following both the CPIA 655 guidelines and a MSFC in-house developed statistical-based approach. The statistical approach was developed to better verify when the dynamic pressure amplitudes corresponding to a particular frequency returned back to pre-bomb characteristics. This was accomplished by first determining the statistical characteristics of the pre-bomb dynamic levels. The pre-bomb statistical characterization provided 95% coverage bounds; these bounds were used as a quantitative measure to determine when the post-bomb signal returned to pre-bomb conditions. The time for post-bomb levels to acceptably return to pre-bomb levels was compared to the dominant frequency-dependent time recommended by CPIA 655. Results for multiple test configurations, including stable and unstable configurations, were reviewed. Spontaneous stability was assessed using two processes: 1) characterization of the ratio of the peak response amplitudes to the excited chamber acoustic mode amplitudes and 2) characterization of the variability of the peak response's frequency over the test duration. This characterization process assists in evaluating the discreteness of a signal as well as the stability of the chamber response. Broadband stability was assessed using a running root-mean-square evaluation. These techniques were also employed, in a comparative analysis, on available Fastrac data, and these results are presented here.

Kenny, R. Jeremy↗