Search NASA⌕ Search

SEARCH · Search NASA

Results for “evaluation methodology”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 631 records · Page 35

Pressure Flammability Thresholds in Oxygen of Selected Aerospace Materials

The experimental approach consisted of concentrating the testing in the flammability transition zone following the Bruceton Up-and-Down Method. For attribute data, the method has been shown to be very repeatable and most efficient. Other methods for characterization of critical levels (Karberand Probit) were also considered. The data yielded the upward limiting pressure index (ULPI), the pressure level where approx.50% of materials self-extinguish in a given environment.Parametric flammability thresholds other than oxygen concentration can be determined with the methodology proposed for evaluating the MOC when extinguishment occurs. In this case, a pressure threshold in 99.8% oxygen was determined with the methodology and found to be 0.4 to 0.9 psia for typical spacecraft materials. Correlation of flammability thresholds obtained with chemical, hot wire, and other ignition sources will be conducted to provide recommendations for using alternate ignition sources to evaluate flammability of aerospace materials.

Hirsch, David↗

Tectonic risk forecasting through expert elicitation for geological repositories: the TOPAZ project

This paper describes the development of a probabilistic methodology for the evaluation of tectonic hazards to geological repositories in Japan. The approach is a development of NUMO's ITM methodology, which produced probabilistic hazard maps for volcanism and rock deformation for periods up to about 100,000 years in a set of Case Studies that covered a large area of the country. To address potential regulatory requirements, the TOPAZ project has extended the ITM methodology to look into the period between 100,000 and 1 million years, where significant uncertainties begin to emerge about the tectonic framework within which quantitative forecasting can be made. Part of this methodology extension has been to adopt expert elicitation techniques to capture differing expert views as a means of addressing such uncertainties. This paper briefly outlines progress in this development work to date. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Plan evaluation for heat resilience: complementary methods to comprehensively assess heat planning in Tempe and Tucson, Arizona

Abstract Escalating impacts from climate change and urban heat are increasing the urgency for communities to equitably plan for heat resilience. Cities in the desert Southwest are among the hottest and fastest warming in the U.S., placing them on the front lines of heat planning. Urban heat resilience requires an integrated planning approach that coordinates strategies across the network of plans that shape the built environment and risk patterns. To date, few studies have assessed cities’ progress on heat planning. This research is the first to combine two emerging plan evaluation approaches to examine how networks of plans shape urban heat resilience through case studies of Tempe and Tucson, Arizona. The first methodology, Plan Quality Evaluation for Heat Resilience, adapts existing plan quality assessment approaches to heat. We assess whether plans meet 56 criteria across seven principles of high-quality planning and the types of heat strategies included in the plans. The second methodology, the Plan Integration for Resilience Scorecard™ (PIRS™) for Heat, focuses on plan policies that could influence urban heat hazards. We categorize policies by policy tool and heat mitigation strategy and score them based on their heat impact. Scored policies are then mapped to evaluate their spatial distribution and the net effect of the plan network. The resulting PIRS™ for Heat scorecard is compared with heat vulnerability indicators to assess policy alignment with risks. We find that both cities are proactively planning for heat resilience using similar plan and strategy types, however, there are clear and consistent opportunities for improvement. Combining these complementary plan evaluation methods provides a more comprehensive understanding of how plans address heat and a generalizable approach that communities everywhere could use to identify opportunities for improved heat resilience planning.

Environmental Sciences & Ecology↗

An improved approach for flight readiness certification: Probabilistic models for flaw propagation and turbine blade failure. Volume 1: Methodology and applications

An improved methodology for quantitatively evaluating failure risk of spaceflight systems to assess flight readiness and identify risk control measures is presented. This methodology, called Probabilistic Failure Assessment (PFA), combines operating experience from tests and flights with analytical modeling of failure phenomena to estimate failure risk. The PFA methodology is of particular value when information on which to base an assessment of failure risk, including test experience and knowledge of parameters used in analytical modeling, is expensive or difficult to acquire. The PFA methodology is a prescribed statistical structure in which analytical models that characterize failure phenomena are used conjointly with uncertainties about analysis parameters and/or modeling accuracy to estimate failure probability distributions for specific failure modes. These distributions can then be modified, by means of statistical procedures of the PFA methodology, to reflect any test or flight experience. State-of-the-art analytical models currently employed for designs failure prediction, or performance analysis are used in this methodology. The rationale for the statistical approach taken in the PFA methodology is discussed, the PFA methodology is described, and examples of its application to structural failure modes are presented. The engineering models and computer software used in fatigue crack growth and fatigue crack initiation applications are thoroughly documented.

Moore, N. R.↗

An improved approach for flight readiness certification: Probabilistic models for flaw propagation and turbine blade failure. Volume 2: Software documentation

An improved methodology for quantitatively evaluating failure risk of spaceflights systems to assess flight readiness and identify risk control measures is presented. This methodology, called Probabilistic Failure Assessment (PFA), combines operating experience from tests and flights with analytical modeling of failure phenomena to estimate failure risk. The PFA methodology is of particular value when information on which to base an assessment of failure risk, including test experience and knowledge of parameters used in analytical modeling, is expensive or difficult to acquire. The PFA methodology is a prescribed statistical structure in which analytical models that characterize failure phenomena are used conjointly with uncertainties about analysis parameters and/or modeling accuracy to estimate failure probability distributions for specific failure modes. These distributions can then be modified, by means of statistical procedures of the PFA methodology, to reflect any test or flight experience. State-of-the-art analytical models currently employed for design, failure prediction, or performance analysis are used in this methodology. The rationale for the statistical approach taken in the PFA methodology is discussed, the PFA methodology is described, and examples of its application to structural failure modes are presented. The engineering models and computer software used in fatigue crack growth and fatigue crack initiation applications are thoroughly documented.

Moore, N. R.↗

Adaptation of EVIAVE methodology for monitoring and follow-up when evaluating the environmental impact of landfills

Treatment and final disposal of Municipal Solid Waste can have a significant role in the generation of negative environmental impacts. As a prevention strategy, such activities are subjected to the process of Environmental Impact Assessment (EIA). Still, the follow-up of Environmental Management Plans or mitigation measures is limited, for one due to a lack of methodological approaches. In searching for possibilities, the University of Granada (Spain) developed a diagnostic methodology named EVIAVE, which allows one to quantify, by means of indexes, the environmental impact of landfills in view of their location and the conditions of exploitation. EVIAVE is applicable within the legal framework of the European Union and can be adapted to the environmental and legal conditions of other countries. This study entails its adaptation in Colombia, for the follow-up and control of the EIA process for landfills. Modifications involved inclusion of the environmental elements flora and fauna, and the evaluation of the environmental descriptors in agreement with the concept of vulnerability. The application of the modified EVIAVE in Colombian landfills allowed us to identify the elements affected by the operating conditions and maintenance. It may be concluded that this methodology is viable and effective for the follow-up and environmental control of EIA processes for landfills, and to analyze the associated risks, as it takes into account related environmental threats and vulnerabilities. - Highlights: • A modified methodology is used to monitor and follow-up environmental impacts in landfills. • The improved methodology includes the Vulnerability of Flora and Fauna to evaluate environmental impact of landfills. • The methodology serves to identify and evaluate the sources of risk generated in the construction and siting of landfills. • Environmental vulnerability indicators improve effectiveness of the control and follow-up phases of landfill management. • The follow-up of environmental management plans may help diminish the implementation gap in Environmental Impact Assessment.

54 ENVIRONMENTAL SCIENCES↗

Experimental Studies and Energy Modeling for Evaluating Performance of Various Deep Wall Retrofits

The Pacific Northwest National Laboratory, Oak Ridge National Laboratory, and the University of Minnesota conducted a three-year, multipart study on residential retrofit wall assemblies. The project, which was funded by the U.S. Department of Energy’s Building Technology Office, aimed to compare a range of residential wall retrofit systems that prioritized affordability, durability, and energy savings potential. The research team identified, constructed, tested, simulated, and analyzed the feasibility and economics of 16 wall retrofit assemblies (14 test configurations and two baseline configurations) that can be applied to the exterior side of existing walls (either with or without the existing cladding). The 16 wall assemblies were installed in an in-situ laboratory environment, to evaluate the ease of construction and study the thermal and hygrothermal performance of the walls. This paper presents the methodology used to evaluate the thermal performance of the walls and discusses the energy modeling results of the study. The results from the experiments were used to calibrate a THERM model of each wall assembly, which was then applied to a whole building using the EnergyPlus 8.6 simulation engine. A residential prototype building was used to extrapolate whole-building energy savings in each U.S. climate zone. To capture the conditions of the largest number of homes in the United States, the most frequent building characteristics (e.g., attic insulation level, window specifications, foundation insulation, etc.) were extracted from ResStock data and applied to the prototype model. Results from the energy modeling showed that the climate zones with the highest potential for retrofit savings are those which are heating-dominated (i.e., Cold and Very Cold climate designations). In these climate zones, heating and cooling energy savings due to the wall retrofits alone ranged from 21.5% to 38.2%.

Nagda, Harshil↗

Technologies for Nondestructive Evaluation of Surfaces and Thin Coatings

The effort included in this project included several related activities encompassing basic understanding, technological development, customer identification and commercial transfer of several methodologies for nondestructive evaluation of surfaces and thin surface coatings. Consistent with the academic environment, students were involved in the effort working with established investigators to further their training, provide a nucleus of experienced practitioners in the new technologies during their industrial introduction, and utilize their talents for project goals. As will be seen in various portions of the report, some of the effort has led to commercialization. This process has spawned other efforts related to this project which are supported from outside sources. These activities are occupying the efforts of some of the people who were previously supported within this grant and its predecessors. The most advanced of the supported technologies is thermography, for which the previous joint efforts of the investigators and NASA researchers have developed several techniques for extending the utility of straight thermographic inspection by producing methods of interpretation and analysis accessible to automatic image processing with computer data analysis. The effort reported for this technology has been to introduce the techniques to new user communities, who are then be able to add to the effective uses of existing products with only slight development work. In a related development, analysis of a thermal measurement situation in past efforts led to a new insight into the behavior of simple temperature probes. This insight, previously reported to the narrow community in which the particular measurement was made, was reported to the community of generic temperature measurement experts this year. In addition to the propagation of mature thermographic techniques, the development of a thermoelastic imaging system has been an important related development. Part of the work carried out in the effort reported here has been to prepare reports introducing the newly commercially available thermoelastic measurements to the appropriate user communities.

Source record↗

Center for Integrated Nanotechnologies (CINT) Chemical Release Modeling Evaluation

This evaluation documents the methodology and results of chemical release modeling for operations at Building 518, Center for Integrated Nanotechnologies (CINT) Core Facility. This evaluation is intended to supplement an update to the CINT [Standalone] Hazards Analysis (SHA). This evaluation also updates the original [Design] Hazards Analysis (DHA) completed in 2003 during the design and construction of the facility; since the original DHA, additional toxic materials have been evaluated and modeled to confirm the continued low hazard classification of the CINT facility and operations. This evaluation addresses the potential catastrophic release of the current inventory of toxic chemicals at Building 518 based on a standard query in the Chemical Information System (CIS).

77 NANOSCIENCE AND NANOTECHNOLOGY↗

Space network scheduling benchmark: A proof-of-concept process for technology transfer

This paper describes a detailed proof-of-concept activity to evaluate flexible scheduling technology as implemented in the Request Oriented Scheduling Engine (ROSE) and applied to Space Network (SN) scheduling. The criteria developed for an operational evaluation of a reusable scheduling system is addressed including a methodology to prove that the proposed system performs at least as well as the current system in function and performance. The improvement of the new technology must be demonstrated and evaluated against the cost of making changes. Finally, there is a need to show significant improvement in SN operational procedures. Successful completion of a proof-of-concept would eventually lead to an operational concept and implementation transition plan, which is outside the scope of this paper. However, a high-fidelity benchmark using actual SN scheduling requests has been designed to test the ROSE scheduling tool. The benchmark evaluation methodology, scheduling data, and preliminary results are described.

Moe, Karen↗

Evaluation of the Sum-of-Fractions Methodology for Water and Polyethylene Moderated Systems

Sum-of-Fractions is a method intended to assure a subcritical margin for aqueous solutions and slurries of fissionable isotopes. The method indicates that a system is subcritical if the sum of the ratios of the mass of each isotope in a mixture to its individual minimum subcritical mass limit is less than or equal to one. The basis of the Sum-of Fractions has historically been derived from allowances given in ANSI/ANS-8.15-1981. However, the allowance was removed in ANSI/ANS-8.15-2014 due to a lack of technical basis. A methodology was developed to assess the validity of using the Sum-of-Fractions for water or polyethylene moderated systems for the following nuclides: 232 U, 233 U, 234 U, 235 U, 237 Np, 236 Pu, 238 Pu, 239 Pu, 240 Pu, 241 Pu, 242 Pu, 241 Am, 242 mAm, 243 Am, 242 Cm, 243 Cm, 244 Cm, 245 Cm, 246 Cm, 247 Cm, 249 Cf, and 251 Cf. The methodology uses available benchmark data for mixtures of 233 U, 235 U, and 239 Pu to establish the calculational margin, and a mass limit reduction to establish the margin of subcriticality. Water or polyethylene moderated and reflected mixtures containing the nuclides are evaluated with SCALE 6.2.4. Including the calculational margin, subcritical mass limits for each nuclide were computed for optimally water or polyethylene moderated and fully reflected systems. These masses were used to create nuclide mixtures in which the sum of the mass to subcritical mass limit ratios is one. The various nuclide mixtures were modeled over a range of moderation and demonstrate the k eff does not exceed the calculational margin. For additional assurance of subcriticality, a significant mass reduction is applied to each computed minimum critical mass of the nuclides without adequate benchmark data consistent with the method in ANSI/ANS-8.15-2014.

07 ISOTOPE AND RADIATION SOURCES↗

IMPAC: An Integrated Methodology for Propulsion and Airframe Control

The National Aeronautics and Space Administration is actively involved in the development of enabling technologies that will lead towards aircraft with new/enhanced maneuver capabilities such as Short Take-Off Vertical Landing (STOVL) and high angle of attack performance. Because of the high degree of dynamic coupling between the airframe and propulsion systems of these types of aircraft, one key technology is the integration of the flight and propulsion control. The NASA Lewis Research Center approach to developing Integrated Flight Propulsion Control (IFPC) technologies is an in-house research program referred to as IMPAC (Integrated Methodology for Propulsion and Airframe Control). The goals of IMPAC are to develop a viable alternative to the existing integrated control design methodologies that will allow for improved system performance and simplicity of control law synthesis and implementation, and to demonstrate the applicability of the methodology to a supersonic STOVL fighter aircraft. Based on some preliminary control design studies that included evaluation of the existing methodologies, the IFPC design methodology that is emerging at the Lewis Research Center consists of considering the airframe and propulsion system as one integrated system for an initial centralized controller design and then partitioning the centralized controller into separate airframe and propulsion system subcontrollers to ease implementation and to set meaningful design requirements for detailed subsystem control design and evaluation. An overview of IMPAC is provided and detailed discussion of the various important design and evaluation steps in the methodology are included.

Garg, Sanjay↗

Potential Effect of Interfacial Bonding on Used Nuclear Fuel Vibration Reliability

This summary abstract describes the methodology used to evaluate the effect of pellet pellet and pellet clad interactions with consideration of the interfacial bonding efficiency on UNF vibration integrity. This methodology provides a solid roadmap for further protocol development with respect to effective lifetime prediction of a UNF system under normal transportation vibration. The proposed methodology that couples FEA simulations and experimental exploration efforts is also under development. The current methodology is focused on assessing the influence of interfacial bonding at the pellet pellet and the pellet clad interfaces on UNF vibration integrity. The FEA simulation results were also calibrated and benchmarked with the fatigue aging data obtained from reversible bending fatigue testing.

fuel-pellet interface↗

Condensing Furnace Venting Part 2: Evaluation of Same-Chimney Vent Systems for Condensing Furnaces and Natural Draft Water Heaters

In 1987, the National Appliance Energy Conservation Act prescribed the first federal minimum energy conservation standard for natural gas furnaces at an annual fuel utilization efficiency of 78%, effective January 1, 1992. One of the techno-economic issues that has prevented higher furnace efficiency standards since then is the lack of cost-effective, simple, and safe solutions that enable condensing furnaces and atmospheric combustion water heaters to vent through the same existing chimney. Part 1 of this two-part report series, published in October 2014, documents the issue, prospective solutions, and a test laboratory established to evaluate prospective venting solutions. This part 2 report documents the updated prospective solutions (because they have evolved since part 1 was written), the methodology for experimentally evaluating prospective solutions, and results of the evaluations.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

On Applying the Prognostic Performance Metrics

Prognostics performance evaluation has gained significant attention in the past few years. As prognostics technology matures and more sophisticated methods for prognostic uncertainty management are developed, a standardized methodology for performance evaluation becomes extremely important to guide improvement efforts in a constructive manner. This paper is in continuation of previous efforts where several new evaluation metrics tailored for prognostics were introduced and were shown to effectively evaluate various algorithms as compared to other conventional metrics. Specifically, this paper presents a detailed discussion on how these metrics should be interpreted and used. Several shortcomings identified, while applying these metrics to a variety of real applications, are also summarized along with discussions that attempt to alleviate these problems. Further, these metrics have been enhanced to include the capability of incorporating probability distribution information from prognostic algorithms as opposed to evaluation based on point estimates only. Several methods have been suggested and guidelines have been provided to help choose one method over another based on probability distribution characteristics. These approaches also offer a convenient and intuitive visualization of algorithm performance with respect to some of these new metrics like prognostic horizon and alpha-lambda performance, and also quantify the corresponding performance while incorporating the uncertainty information.

Saxena, Abhinav↗

Probabilistic evaluation of uncertainties and risks in aerospace components

This paper summarizes a methodology developed at NASA Lewis Research Center which computationally simulates the structural, material, and load uncertainties associated with Space Shuttle Main Engine (SSME) components. The methodology was applied to evaluate the scatter in static, buckling, dynamic, fatigue, and damage behavior of the SSME turbo pump blade. Also calculated are the probability densities of typical critical blade responses, such as effective stress, natural frequency, damage initiation, most probable damage path, etc. Risk assessments were performed for different failure modes, and the effect of material degradation on the fatigue and damage behaviors of a blade were calculated using a multi-factor interaction equation. Failure probabilities for different fatigue cycles were computed and the uncertainties associated with damage initiation and damage propagation due to different load cycle were quantified. Evaluations on the effects of mistuned blades on a rotor were made; uncertainties in the excitation frequency were found to significantly amplify the blade responses of a mistuned rotor. The effects of the number of blades on a rotor were studied. The autocorrelation function of displacements and the probability density function of the first passage time for deterministic and random barriers for structures subjected to random processes also were computed. A brief discussion was included on the future direction of probabilistic structural analysis.

Shah, A. R.↗

Adaptation of Mesoscale Weather Models to Local Forecasting

Methodologies have been developed for (1) configuring mesoscale numerical weather-prediction models for execution on high-performance computer workstations to make short-range weather forecasts for the vicinity of the Kennedy Space Center (KSC) and the Cape Canaveral Air Force Station (CCAFS) and (2) evaluating the performances of the models as configured. These methodologies have been implemented as part of a continuing effort to improve weather forecasting in support of operations of the U.S. space program. The models, methodologies, and results of the evaluations also have potential value for commercial users who could benefit from tailoring their operations and/or marketing strategies based on accurate predictions of local weather. More specifically, the purpose of developing the methodologies for configuring the models to run on computers at KSC and CCAFS is to provide accurate forecasts of winds, temperature, and such specific thunderstorm-related phenomena as lightning and precipitation. The purpose of developing the evaluation methodologies is to maximize the utility of the models by providing users with assessments of the capabilities and limitations of the models. The models used in this effort thus far include the Mesoscale Atmospheric Simulation System (MASS), the Regional Atmospheric Modeling System (RAMS), and the National Centers for Environmental Prediction Eta Model ( Eta for short). The configuration of the MASS and RAMS is designed to run the models at very high spatial resolution and incorporate local data to resolve fine-scale weather features. Model preprocessors were modified to incorporate surface, ship, buoy, and rawinsonde data as well as data from local wind towers, wind profilers, and conventional or Doppler radars. The overall evaluation of the MASS, Eta, and RAMS was designed to assess the utility of these mesoscale models for satisfying the weather-forecasting needs of the U.S. space program. The evaluation methodology includes objective and subjective verification methodologies. Objective (e.g., statistical) verification of point forecasts is a stringent measure of model performance, but when used alone, it is not usually sufficient for quantifying the value of the overall contribution of the model to the weather-forecasting process. This is especially true for mesoscale models with enhanced spatial and temporal resolution that may be capable of predicting meteorologically consistent, though not necessarily accurate, fine-scale weather phenomena. Therefore, subjective (phenomenological) evaluation, focusing on selected case studies and specific weather features, such as sea breezes and precipitation, has been performed to help quantify the added value that cannot be inferred solely from objective evaluation.

Manobianco, John T.↗

A risk-informed assessment tool to support review of license amendment requests for spent nuclear fuel dry cask storage systems

We report that while risk-informed safety evaluations are common methodologies used by the U.S. Nuclear Regulatory Commission (NRC), their application in the field of commercial spent nuclear fuel (SNF) dry storage has received limited attention. For instance, license amendment requests (LARs) for SNF dry cask storage systems (DCSSs) are evaluated according to U.S. NRC standard review plans (SRPs). However, risk-informed LAR review strategies could improve the understanding of critical system modifications, and lead to more predictable, efficient, and consistent LAR review processes. A methodology to develop a risk-informed LAR review tool is presented. Although focused on DCSSs, this methodology can be used to develop similar tools for a broad spectrum of safety-relevant systems. The end product (i.e., the tool) includes a tree diagram to help visualize the review risk significances assigned to a predefined set of system modifications and supporting rationale documentation. Instructions support correct tool application and provide the user with a path to incorporate currently unevaluated modifications in the tool structure. The demonstration of the methodology leads to the conclusion that risk-informed reviews of DCSS LARs are possible, although the tool precision could benefit from additional risk information. Further, the results indicate that many typical LARs involve low-risk or medium-risk modifications.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗