Search NASA⌕ Search

SEARCH · Search NASA

Results for “evaluation methodology”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 595 records · Page 33

Application of Field Evaluations of Ecological Resources at Hanford and Other DOE Sites for Consistency of Resource Protection and Sustainability - 16404

Remediation and management of contaminated facilities, soil, sediment and biota is an essential element of the DOE-EM mission for site completion, contaminant footprint reduction, and protection of human health and the environment. Protecting ecological resources is an integral part of protecting human health because people are part of the ecosystem and rely on ecological resources for food, fiber, clean air and water, recreational, aesthetic, and cultural values. Evaluation and management require understanding the past and current conditions, as well as protecting, preserving, and enhancing ecological resources. Understanding past and current resources includes evaluation of individual and population health within a local and regional context. The objective of this research is to describe a field method of evaluating ecological resources, based on work at the Hanford Site, which can be applied to sustainability of ecological resources as another mandate of DOE. This requires objective methods to characterize and evaluate resources spatially, within a context of local and regional importance. The DOE complex is large, diverse, and multi-state. The habitats and ecological resources are diverse, and the relative importance of ecological resources to the local ecosystem, region, and human communities varies. Large and diverse sites such as Hanford, Idaho National Laboratory, Los Alamos, hold resources of substantial importance to local and regional ecosystems, as well as to the ecology and cultural values of Tribes and other residents. However, other smaller sites (e.g. Oak Ridge, Brookhaven) also hold key ecological resources to local and regional ecosystems, cultures, and economics. Understanding the relative importance of ecological resources on each remediation site at different spatial scales, within and among DOE-EM sites is critical to management, stewardship, and ensuring sustainability for generations to come. Without a standardized methodology it is difficult to develop sound remediation and management plans to protect human health and the environment. The Ecological Evaluation of Resources described in this paper is part of the Consortium for Risk Evaluation with Stakeholder Participation's (CRESP) Risk Review Project on the Hanford Site. It is an independent assessment based of on-site field evaluations that encompasses evaluations of site resources in comparison to the Columbia Basin Ecosystem prior evaluations made by DOE, the States of Washington and Oregon, Nature Conservancy and Tribes. The on-site field evaluations are the focus of the current paper. The on-site field evaluation methodology was developed to update existing information on habitat values in light of changing landscape features (edge, patch size and shape, connectivity) and the current presence of invasive species. Both aspects change with time, especially given that remediation of remediation units changes the landscape. That is, every time there is a remediation and restoration of an operable unit (remediation site) on a DOE site, it changes the adjacent landscape (and ecological resources). The changes are greater where new roads were built to access a remediation site, staging areas constructed, and as a function of the size and time-frame for the remediation. Since ecological resources form a continuum across the landscape, and activities from remediation on a given site can affect those on adjacent areas, we evaluated resources both on the remediation site itself, and on a buffer equal to the largest diameter of the remediation site. The field evaluation methodology developed at Hanford Site makes use of existing resource level maps (DOE/RL-96-32 2013) and field surveys and measurements of current vegetation and habitat conditions to evaluate potential ecological impacts associated with cleanup activities at the evaluation unit. Additional information used in the ecological resource evaluations include current Endangered and Threatened Species distribution data (both state and federal), aerial imagery, locations of waste sites and infrastructure, and species and habitats of special concern. We suggest that the field methodology developed for the Hanford Site could be used across the DOE complex to evaluate ecological resources. This would provide DOE-EM with a common data base to make long-term decisions about the protection and sustainability of resources on the DOE complex, and would provide Tribes and the public with information on ecological resources on DOE sites. Such information could be provided in a web-based format which DOE, regulators, Tribes, and the public could easily access. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Evaluate the impact of sensor accuracy on model performance in data-driven building fault detection and diagnostics using Monte Carlo simulation

The performance of data-driven fault detection and diagnostics (FDD) is heavily dependent on sensors. However, sensor inaccuracy and sensor faults are pervasive in building operation: inaccurate and missing sensor readings deteriorate FDD performance; sensor inaccuracy will also affect the selection of sensor for data-driven FDD in the model training process, which is another key factor of data-driven FDD performance. Sensor accuracy and sensor selection individually are well-studied research topics in this field, but the impact of sensor accuracy on sensor selection and its further impact on FDD performance has not been evaluated and quantified. In this paper, we developed a novel analysis methodology that comprehensively evaluates sensor fault on sensor selection and FDD accuracy. Monte Carlo simulation is applied to deal with multiple stochastic sensor inaccuracy and provide probabilistic analysis results of the impact of sensor inaccuracy on sensor selection and FDD accuracy. This methodology focuses on the net impact of fault states across a full sensor set. The developed methodology can be used for the early-stage sensor design and operation-stage sensor maintenance. Furthermore, a case study is conducted to demonstrate the analysis methodology using a commercial building model crated to Flexible Research Platform located at Oak Ridge National Laboratory, USA.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

An advanced evaluation of the mechanistic scale-up methodology of gas–solid spouted beds using radioactive particle tracking

For this work, we implemented for the first time our radioactive particle tracking as an advanced noninvasive technique to further evaluate and validate our newly developed mechanistic scale-up methodology based on matching the radial profile of the gas holdup. Two spouted beds with diameters of 0.076 and 0.152 m were used. Three sets of conditions were implemented; i.e., conditions of the reference case, conditions that provided a gas-holdup radial profile similar to that of the reference case, and conditions that provided a gas-holdup radial profile dissimilar to that of the reference case. The results confirm the validation of the scale-up methodology in terms of obtaining closer dimensionless values and radial profiles of components of the particle velocity, normal stress, shear stress, and turbulent kinetic energy. The results further advance the understanding of gas–solids spouted beds, provide deeper insight into the solids dynamics of the beds and present important benchmarking data for validating computational fluid dynamics codes and models.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Knowledge-Based Aircraft Automation: Managers Guide on the use of Artificial Intelligence for Aircraft Automation and Verification and Validation Approach for a Neural-Based Flight Controller

The ultimate goal of this report was to integrate the powerful tools of artificial intelligence into the traditional process of software development. To maintain the US aerospace competitive advantage, traditional aerospace and software engineers need to more easily incorporate the technology of artificial intelligence into the advanced aerospace systems being designed today. The future goal was to transition artificial intelligence from an emerging technology to a standard technology that is considered early in the life cycle process to develop state-of-the-art aircraft automation systems. This report addressed the future goal in two ways. First, it provided a matrix that identified typical aircraft automation applications conducive to various artificial intelligence methods. The purpose of this matrix was to provide top-level guidance to managers contemplating the possible use of artificial intelligence in the development of aircraft automation. Second, the report provided a methodology to formally evaluate neural networks as part of the traditional process of software development. The matrix was developed by organizing the discipline of artificial intelligence into the following six methods: logical, object representation-based, distributed, uncertainty management, temporal and neurocomputing. Next, a study of existing aircraft automation applications that have been conducive to artificial intelligence implementation resulted in the following five categories: pilot-vehicle interface, system status and diagnosis, situation assessment, automatic flight planning, and aircraft flight control. The resulting matrix provided management guidance to understand artificial intelligence as it applied to aircraft automation. The approach taken to develop a methodology to formally evaluate neural networks as part of the software engineering life cycle was to start with the existing software quality assurance standards and to change these standards to include neural network development. The changes were to include evaluation tools that can be applied to neural networks at each phase of the software engineering life cycle. The result was a formal evaluation approach to increase the product quality of systems that use neural networks for their implementation.

Broderick, Ron↗

Assessment of Options for the Treatment of Nitrate Salt Wastes at Los Alamos National Laboratory

This paper summarizes the methodology used to evaluate options for treatment of the remediated nitrate salt waste containers at Los Alamos National Laboratory. The method selected must enable treatment of the waste drums, which consist of a mixture of complex nitrate salts (oxidizer) improperly mixed with sWheat Scoop®1, an organic kitty litter and absorbent (fuel), in a manner that renders the waste safe, meets the specifications of waste acceptance criteria, and is suitable for transport and final disposal in the Waste Isolation Pilot Plant located in Carlsbad, New Mexico. A Core Remediation Team was responsible for comprehensively reviewing the options, ensuring a robust, defensible treatment recommendation. The evaluation process consisted of two steps. First, a prescreening process was conducted to cull the list on the basis for a decision of feasibility of certain potential options with respect to the criteria. Then, the remaining potential options were evaluated and ranked against each of the criteria in a consistent methodology. Numerical scores were established by consensus of the review team. Finally, recommendations were developed based on current information and understanding of the scientific, technical, and regulatory situation. A discussion of the preferred options and documentation of the process used to reach the recommended treatment options are presented.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Assessment of Options for the Treatment of Nitrate Salt Wastes at Los Alamos National Laboratory - 16541

This paper summarizes the methodology used to evaluate options for treatment of the remediated nitrate salt waste containers at Los Alamos National Laboratory. The method selected must enable treatment of the waste drums, which consist of a mixture of complex nitrate salts (oxidizer) improperly mixed with sWheat Scoop{sup R}, an organic kitty litter and absorbent (fuel), in a manner that renders the waste safe, meets the specifications of waste acceptance criteria, and is suitable for transport and final disposal in the Waste Isolation Pilot Plant located in Carlsbad, New Mexico. A Core Remediation Team was responsible for comprehensively reviewing the options ensuring a robust, defensible treatment recommendation. The evaluation process consisted of two steps. First, a pre-screening process was conducted to cull the list on the basis for a decision of feasibility of certain potential options with respect to the criteria. Then, the remaining potential options were evaluated and ranked against each of the criteria in a consistent methodology. Numerical scores were established by consensus of the review team. Finally, recommendations were developed based on current information and understanding of the scientific, technical, and regulatory situation. A discussion of the preferred options and documentation of the process used to reach the recommended treatment options are presented. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Radiological Consequences of Hydrogen Explosions in Vessels and Piping at the WTP

Hydrogen (along with other gases) is generated in process vessels and other components at the Hanford Waste Treatment and Immobilization Plant (WTP) due to the radiolysis of water and to the radiolysis and thermolysis of organics in WTP radioactive process wastes. In the absence of controls, the hydrogen may accumulate until a flammable or explosive concentration is reached. Once a buildup has occurred, ignition of the hydrogen causes an explosion that creates radioactive aerosols that could escape the confinement boundary and be released to the environment. Such a release could cause significant radiological exposures to a public receptor at the site boundary and to a co-located worker (CLW/) in the yard areas outside the physical facilities. Hydrogen explosion events therefore require evaluation as to the potential magnitude of their consequences. The WTP methodology for the evaluation of the potential radiological consequences due to hydrogen explosions in vessels and piping is a conservative approach that is defensible from a regulatory standpoint yet only results in the need for Safety controls for the most highly radioactive process vessels (generally those containing waste with significant quantities of solids). For WTP vessels with waste not containing significant quantities of solids, radiological dose consequences are sufficiently low such that neither Safety Class controls for the public receptor nor Safety Significant controls for the CLW are required. Similarly, the dose consequences for hydrogen explosions in piping and ancillary vessels are all very low to both receptors, again indicating that no Safety Class or Safety Significant controls are required. The WTP vessel and piping hydrogen explosion calculations are dependent on vessel and pipe sizes, hydrogen generation rates, operational requirements, and waste stream properties such as solids content, radioisotope concentration, and slurry density. Consequently, the WTP-specific results discussed above cannot be extrapolated directly to other facilities. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Exploring Microsimulation Process for Energy Impact Evaluation of Connected and Automated Vehicles

In this paper, the authors present a microsimulation-based methodological approach for evaluating the energy impact of connected and automated vehicles (CAVs). They use an open-source micro-simulator, SUMO, and provide a way to set up a simulation environment that emulates real-world traffic dynamics. They also employ the Intelligent Driver Model to represent human drivers and calibrate its driving behavior using real-world traffic data and driving statistics. The authors conduct extensive simulation studies considering different penetration rates of CAVs, different car-following models, and varying car-following model parameters. Using the state-of-the-art Future Automotive System Technology Simulator (FASTSim), they estimate the fuel economy of each vehicle and analyze the energy impact of the given CAV implementation. Finally, the authors analyze the possible factors affecting the simulation results, and also discuss limitations and future work.

ADVANCED PROPULSION SYSTEMS↗

Report on an Assessment of the Application of EPP Results from the Strain Limit Evaluation Procedure to the Prediction of Cyclic Life Based on the SMT Methodology

The goal of the proposed integrated Elastic Perfectly-Plastic (EPP) and Simplified Model Test (SMT) methodology is to incorporate an SMT data based approach for creep-fatigue damage evaluation into the EPP methodology to avoid the separate evaluation of creep and fatigue damage and eliminate the requirement for stress classification in current methods; thus greatly simplifying evaluation of elevated temperature cyclic service. This methodology should minimize over-conservatism while properly accounting for localized defects and stress risers. To support the implementation of the proposed methodology and to verify the applicability of the code rules, analytical studies and evaluation of thermomechanical test results continued in FY17. This report presents the results of those studies. An EPP strain limits methodology assessment was based on recent two-bar thermal ratcheting test results on 316H stainless steel in the temperature range of 405 to 7050C. Strain range predictions from the EPP evaluation of the two-bar tests were also evaluated and compared with the experimental results. The role of sustained primary loading on cyclic life was assessed using the results of pressurized SMT data from tests on Alloy 617 at 9500C. A viscoplastic material model was used in an analytic simulation of two-bar tests to compare with EPP strain limits assessments using isochronous stress strain curves that are consistent with the viscoplastic material model. A finite element model of a prior 304H stainless steel Oak Ridge National Laboratory (ORNL) nozzle-to-sphere test was developed and used for an EPP strain limits and creep-fatigue code case damage evaluations. A theoretical treatment of a recurring issue with convergence criteria for plastic shakedown illustrated the role of computer machine precision in EPP calculations.

36 MATERIALS SCIENCE↗

An improved approach for flight readiness certification: Methodology for failure risk assessment and application examples, volume 1

An improved methodology for quantitatively evaluating failure risk of spaceflight systems to assess flight readiness and identify risk control measures is presented. This methodology, called Probabilistic Failure Assessment (PFA), combines operating experience from tests and flights with engineering analysis to estimate failure risk. The PFA methodology is of particular value when information on which to base an assessment of failure risk, including test experience and knowledge of parameters used in engineering analyses of failure phenomena, is expensive or difficult to acquire. The PFA methodology is a prescribed statistical structure in which engineering analysis models that characterize failure phenomena are used conjointly with uncertainties about analysis parameters and/or modeling accuracy to estimate failure probability distributions for specific failure modes. These distributions can then be modified, by means of statistical procedures of the PFA methodology, to reflect any test or flight experience. Conventional engineering analysis models currently employed for design of failure prediction are used in this methodology. The PFA methodology is described and examples of its application are presented. Conventional approaches to failure risk evaluation for spaceflight systems are discussed, and the rationale for the approach taken in the PFA methodology is presented. The statistical methods, engineering models, and computer software used in fatigue failure mode applications are thoroughly documented.

Moore, N. R.↗

An improved approach for flight readiness certification: Methodology for failure risk assessment and application examples. Volume 2: Software documentation

An improved methodology for quantitatively evaluating failure risk of spaceflight systems to assess flight readiness and identify risk control measures is presented. This methodology, called Probabilistic Failure Assessment (PFA), combines operating experience from tests and flights with engineering analysis to estimate failure risk. The PFA methodology is of particular value when information on which to base an assessment of failure risk, including test experience and knowledge of parameters used in engineering analyses of failure phenomena, is expensive or difficult to acquire. The PFA methodology is a prescribed statistical structure in which engineering analysis models that characterize failure phenomena are used conjointly with uncertainties about analysis parameters and/or modeling accuracy to estimate failure probability distributions for specific failure modes, These distributions can then be modified, by means of statistical procedures of the PFA methodology, to reflect any test or flight experience. Conventional engineering analysis models currently employed for design of failure prediction are used in this methodology. The PFA methodology is described and examples of its application are presented. Conventional approaches to failure risk evaluation for spaceflight systems are discussed, and the rationale for the approach taken in the PFA methodology is presented. The statistical methods, engineering models, and computer software used in fatigue failure mode applications are thoroughly documented.

Moore, N. R.↗

An improved approach for flight readiness certification: Methodology for failure risk assessment and application examples. Volume 3: Structure and listing of programs

An improved methodology for quantitatively evaluating failure risk of spaceflight systems to assess flight readiness and identify risk control measures is presented. This methodology, called Probabilistic Failure Assessment (PFA), combines operating experience from tests and flights with engineering analysis to estimate failure risk. The PFA methodology is of particular value when information on which to base an assessment of failure risk, including test experience and knowledge of parameters used in engineering analyses of failure phenomena, is expensive or difficult to acquire. The PFA methodology is a prescribed statistical structure in which engineering analysis models that characterize failure phenomena are used conjointly with uncertainties about analysis parameters and/or modeling accuracy to estimate failure probability distributions for specific failure modes. These distributions can then be modified, by means of statistical procedures of the PFA methodology, to reflect any test or flight experience. Conventional engineering analysis models currently employed for design of failure prediction are used in this methodology. The PFA methodology is described and examples of its application are presented. Conventional approaches to failure risk evaluation for spaceflight systems are discussed, and the rationale for the approach taken in the PFA methodology is presented. The statistical methods, engineering models, and computer software used in fatigue failure mode applications are thoroughly documented.

Moore, N. R.↗

Uncertainty evaluation for the realistic safety analysis methodology of RIA by utilizing experimental results

An audit calculation methodology for the safety analysis of reactivity-initiated accident (RIA) in a PWR based on the realistic approach is under developing in Korean Institute of Nuclear Safety. In this paper important uncertainty parameters to the rod performance were described, and the validity of those parameters was assessed by utilizing the CABRI and NSRR experimental results. Sensitivity study has been carried out to identify the parameters by changing fuel burnup, injected energy and full-width half maximum (FWHM) of given RIA power pulses. FRAPCON-3.5 and FRAPTRAN-1.5 fuel performance code were utilized. Non-parametric order statistics was used for the uncertainty quantification, and 124 inputs on each experimental case were produced by simple random sampling technique. Analysis results showed that the assessed fuel performance uncertainties such as the fuel enthalpy, fission gas release and clad plastic hoop strain could not bound some experimental results. This means that the currently considered uncertainty range, particularly for the peak power, is not enough to cover the fuel performance uncertainty within a sufficient probability and confidence level. (author)

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Technical Specification Surveillance Interval Extension Using Self-Diagnostics

As part of the Light Water Reactor Sustainability program, an ongoing research effort is being conducted on technical specifications surveillance interval extension of digital equipment in nuclear power plants. The research team is led by Idaho National Laboratory and includes Pacific Northwest National Laboratory, Technology Resources, and Oak Ridge National Laboratory. This research focuses on developing methods for applying the U.S. Nuclear Regulatory Commission (NRC)–approved guidance to implement a licensee-controlled, risk-informed surveillance frequency change program in digital instrumentation and control (I&C) systems that include self-diagnostics and online monitoring (OLM) capabilities. Although approved methods exist for extending technical specifications (TS) surveillance test intervals (STIs) for general equipment, including analog I&C equipment, gaps remain in technology and guidance on crediting newer digital equipment’s internal self-diagnostics and OLM characteristics. Previous research described a general methodology for crediting internal self-diagnostics for extending surveillance test intervals. The methodology used self-diagnostics to detect—and credited recovery from—failure. Self-diagnostics were also applied for performance monitoring during the extended surveillance interval. This report discusses the status of recent activities to evaluate the previously developed methodology using a pilot study. Although both a utility partner for a pilot study and a specific digital asset were identified in FY2020, delays in obtaining proprietary information resulted in a limited ability to fully evaluate the methodology, and further interactions were complicated by the COVID pandemic. Therefore, at that time, the use of public-domain information—along with current processes for surveillance interval extension through a surveillance frequency control program—identified the need to fully assess diagnostic coverage as part of the pilot study. Furthermore, self-diagnostics were also identified as a potential option to replace the drift analyses conducted as part of current STI extension procedures. In FY2022, the project was reconstituted with the industry partner, and information and data were made available by the industry partner to the research team for review. The shared information included failure event descriptions and data for a digital I&C system since its implementation, as well as recent STI extension interval reports developed by the utility partner on that digital I&C system. This report presents an evaluation of this information and data and describes an application of the proposed methodology cited above. The methodology seeks to take advantage of the self-diagnostics and OLM capabilities to reduce risk or reduce the level of qualitative monitoring assessment needed to perform a risk-informed STI extension using existing NRC approved guidance or both. Addressing these issues of STI extension by crediting self-diagnostics is likely to result in benefits for current and future nuclear power plant (NPP) operations, including lowering the barriers to adoption of digital I&C systems and increasing cost savings by deferring or eliminating unneeded preventive maintenance (tasks or checks or activities). Specifically, self-diagnostic and OLM capabilities of newer digital equipment being installed in non-safety and safety applications are designed to detect failures, provide early warning of potential failures, and notify plant operators to take appropriate action to reduce out of service (OOS) time thus protecting safety margins. Moreover, the equipment is expected to provide information that time-related operational degradation is identified early to ensure timely and planned corrective actions instead of a reactive and unplanned approach ahead of an extended-surveillance interval.

42 ENGINEERING↗

Exterior Insulation Systems Containing Vacuum Insulation Panels Tested Using a Heat Flux Meter Apparatus

A proposed wall system that will provide a high thermal resistance in a relatively thin profile incorporates vacuum insulation panels (VIP) enclosed within closed-cell insulating foam. In addition to providing some additional thermal resistance, the foam protects the vacuum panels during construction and provides a surface appropriate for an adhesive joint on both sides of the foam-VIP unit. Multiple configurations of the composite structure were considered and experimental measurements were sought to provide more information in the final selection. Small sub-sections of each candidate arrangement were prepared and tested in a special-purpose heat flux meter apparatus. Those measurements are described here, along with additional modeling efforts based on these smaller-scale measurements. The focus of the tests reported here is to investigate the impact of vacuum panel size, the type of foam used to encase the vacuum panels, the thickness and shape of the foam sections between panels, and possible adhesive effects. A new procedure was developed to map the heat flux meter measurement results onto full-scale wall designs to predict the system thermal performance. Several potential arrangements of the foam-VIP unit were also evaluated using a finite-difference methodology. The report also evaluates procedures for testing VIPs in a heat flux meter apparatus, and makes some recommendations.

Childs, Kenneth W.↗

Flight test technique for evaluation of gust load alleviation analysis methodology

A technique for gust load alleviation (GLA) flight testing that will approximate a turbulence-like excitation of the wing has been devised. An artificial excitation is produced by randomly deflecting inboard control surfaces on the wing, thereby producing incremental loads on the wing. This presentation covers the background and development of the flight test technique and analyses performed to date.

Perry, B., III↗

Performance evaluation in full-mission simulation - Methodological advances and research challenges

The crew-factors research program at NASA Ames has developed a methodology for studying the impact of a variety of variables on the effectiveness of crews flying realistic but high workload simulated trips. The validity of investigations using the methodology is enhanced by careful design of full-mission scenarios, performance assessment using converging sources of data, and recruitment of representative subjects. Recently, portions of this methodology have been adapted for use in assessing the effectiveness of crew coordination among participants in line-oriented flight training.

Chidester, Thomas R.↗

6th AIAA Biennial Flight Test Conference, Hilton Head Island, SC, Aug. 24-26, 1992, Selected Papers

Topics presented include training for avionics evaluation, flight testing in the '90s, methodology for the critical evaluation of flight test data, flight testing of an electric powered vehicle, and the flying qualities of a remotely piloted vehicle. Also presented are airspeed calibration using GPS, the design and conduct of a windshear detection flight experiment, the 757 fly-by-wire demonstrator flight test, and an update of the B-52 flight test program.

American Institute of Aeronautics and Astronautics↗