Search NASA⌕ Search

SEARCH · Search NASA

Results for “evaluation methodology”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 613 records · Page 34

Evaluation of a Progressive Failure Analysis Methodology for Laminated Composite Structures

A progressive failure analysis methodology has been developed for predicting the nonlinear response and failure of laminated composite structures. The progressive failure analysis uses C plate and shell elements based on classical lamination theory to calculate the in-plane stresses. Several failure criteria, including the maximum strain criterion, Hashin's criterion, and Christensen's criterion, are used to predict the failure mechanisms. The progressive failure analysis model is implemented into a general purpose finite element code and can predict the damage and response of laminated composite structures from initial loading to final failure.

Sleight, David W.↗

The Evaluation of Cryogenic Force Balance Calibration Methodologies with Respect to Wind Tunnel Results

Independent tests of the NASA Common Research Model (CRM) at NASA's National Transonic Facility (NTF) and the European Transonic Windtunnel (ETW) revealed discrepancies at low operating temperatures and high Reynolds numbers that warranted further investigation. Since each facility used their own force balance for their tunnel entry, one suggestion for the discrepancy was the temperature compensation methodology developed and applied for each balance. This hypothesis is explored through simulation and experimentally. Independent calibrations of NASA's NTF-118A balance at NASA Langley and ETW reveal discrepancies in the thermal compensation of the normal force and pitching moment primary sensitivities with temperature, while the axial force primary sensitivities are in good agreement. The application of the force balance calibrations performed at NASA and ETW to the prior wind tunnel data suggests that the thermal compensation discrepancies are an order of magnitude less than the discrepancies observed between the wind tunnel aerodynamic coefficients.

Burns, Devin E.↗

Advancing Methodologies for Applying Machine Learning and Evaluating Spatiotemporal Models of Fine Particulate Matter (PM 2.5 ) Using Satellite Data Over Large Regions

Reconstructing the distribution of fine particulate matter (PM 2.5 ) in space and time, even far from ground monitoring sites, is an important exposure science contribution to epidemiologic analyses of PM 2.5 health impacts. Flexible statistical methods for prediction have demonstrated the integration of satellite observations with other predictors, yet these algorithms are susceptible to overfitting the spatiotemporal structure of the training datasets. We present a new approach for predicting PM 2.5 using machine-learning methods and evaluating prediction models for the goal of making predictions where they were not previously available. We apply extreme gradient boosting (XGBoost) modeling to predict daily PM 2.5 on a 1 x 1 km 2 resolution for a 13 state region in the Northeastern USA for the years 2000–2015 using satellite-derived aerosol optical depth and implement a recursive feature selection to develop a parsimonious model. We demonstrate excellent predictions of withheld observations but also contrast an RMSE of 3.11 μg/m 3 in our spatial cross-validation withholding nearby sites versus an overfit RMSE of 2.10 μg/m 3 using a more conventional random ten-fold splitting of the dataset. As the field of exposure science moves forward with the use of advanced machine-learning approaches for spatiotemporal modeling of air pollutants, our results show the importance of addressing data leakage in training, overfitting to spatiotemporal structure, and the impact of the predominance of ground monitoring sites in dense urban sub-networks on model evaluation. The strengths of our resultant modeling approach for exposure in epidemiologic studies of PM 2.5 include improved efficiency, parsimony, and interpretability with robust validation while still accommodating complex spatiotemporal relationships.

air pollution↗

The GIF Proliferation Resistance and Physical Protection Working Group (PRPPWG): Achievements and Perspectives

The Generation IV International Forum (GIF) “Technology Roadmap” identified proliferation resistance and physical protection (PR&PP) as one of the four goal areas to advance nuclear energy into its next, “fourth” generation. It recommended the development of a methodology to define measures for PR&PP and to evaluate them for the six nuclear energy systems selected by GIF. Accordingly, the Forum formed a PR&PP Working Group (PRPPWG) to develop a methodology and to define the parameters against which PR&PP would be measured. The PRPPWG developed the methodology through a series of development and demonstration case studies, by use of a hypothetical “Example Sodium Fast Reactor” (ESFR). The PR&PP ESFR assessment was the first opportunity to exercise the full methodology on a complete system, and many insights were gained from the process. The PRPPWG and representatives of the GIF System Steering Committees (SSCs) for each of the six GIF design concepts carried out a study on the PR&PP aspects of the six GIF designs. This interaction allowed the PRPPWG to engage the designers and to raise awareness about PR&PP. A number of international workshops have also been held which have introduced the methodology to design groups and other stakeholders. In this paper, we first summarize the technical progress and the major accomplishments of the PRPPWG: the evaluation methodology and the ESFR case study used to develop and test the methodology. The interaction with the GIF System Steering Committees and the relaunching of the activity is then presented. Finally, an outline of the future challenges is provided along the lines identified in the GIF R&D outlook 2018 report.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

NASA PC software evaluation project

The USL NASA PC software evaluation project is intended to provide a structured framework for facilitating the development of quality NASA PC software products. The project will assist NASA PC development staff to understand the characteristics and functions of NASA PC software products. Based on the results of the project teams' evaluations and recommendations, users can judge the reliability, usability, acceptability, maintainability and customizability of all the PC software products. The objective here is to provide initial, high-level specifications and guidelines for NASA PC software evaluation. The primary tasks to be addressed in this project are as follows: to gain a strong understanding of what software evaluation entails and how to organize a structured software evaluation process; to define a structured methodology for conducting the software evaluation process; to develop a set of PC software evaluation criteria and evaluation rating scales; and to conduct PC software evaluations in accordance with the identified methodology. Communication Packages, Network System Software, Graphics Support Software, Environment Management Software, General Utilities. This report represents one of the 72 attachment reports to the University of Southwestern Louisiana's Final Report on NASA Grant NGT-19-010-900. Accordingly, appropriate care should be taken in using this report out of context of the full Final Report.

Dominick, Wayne D.↗

Evaluation of Heat Exchanger Technology for Integrated Energy System: Methodology and Preliminary Application

This report proposes a novel heat exchanger evaluation method, based on integrated QFD-AHP technique, to support strategic optimal selection of heat exchanger (HX) technology for integrated energy systems. The term “optimal selection” is defined as selecting a product (i.e., HX) that best meets various aspects of end user demand, including both technical and economic requirements. Compared to previous HX evaluation methods, the proposed approach allows decision makers to explicitly take into account the practical demand of customers (i.e., HX end users) which may vary depending on the HX application target. In addition, the proposed evaluation method can be used not only for high-level decisions to select HX type, but also for low-level decisions such as the selection of the key components including HX material or heat transfer fluid. The focus of this study is to describe the new HX evaluation method and to illustrate the overall HX evaluation and selection processes using the three nuclear heat application cases that represent the thermal integration between advanced nuclear reactors and industrial processes. As a preliminary study, three different types of HX, i.e., shell-and-tube heat exchanger, printed circuit heat exchanger, and heat pipe heat exchanger, were compared.

42 ENGINEERING↗

Infrared Algorithm Development for Ocean Observations with EOS/MODIS

Efforts continue under this contract to develop algorithms for the computation of sea surface temperature (SST) from MODIS infrared measurements. This effort includes radiative transfer modeling, comparison of in situ and satellite observations, development and evaluation of processing and networking methodologies for algorithm computation and data accession, evaluation of surface validation approaches for IR radiances, development of experimental instrumentation, and participation in MODIS (project) related activities. Activities in this contract period have focused on radiative transfer modeling, evaluation of atmospheric correction methodologies, undertake field campaigns, analysis of field data, and participation in MODIS meetings.

Brown, Otis B.↗

Methodology issues concerning the accuracy of kinematic data collection and analysis using the ariel performance analysis system

Kinematics, the study of motion exclusive of the influences of mass and force, is one of the primary methods used for the analysis of human biomechanical systems as well as other types of mechanical systems. The Anthropometry and Biomechanics Laboratory (ABL) in the Crew Interface Analysis section of the Man-Systems Division performs both human body kinematics as well as mechanical system kinematics using the Ariel Performance Analysis System (APAS). The APAS supports both analysis of analog signals (e.g. force plate data collection) as well as digitization and analysis of video data. The current evaluations address several methodology issues concerning the accuracy of the kinematic data collection and analysis used in the ABL. This document describes a series of evaluations performed to gain quantitative data pertaining to position and constant angular velocity movements under several operating conditions. Two-dimensional as well as three-dimensional data collection and analyses were completed in a controlled laboratory environment using typical hardware setups. In addition, an evaluation was performed to evaluate the accuracy impact due to a single axis camera offset. Segment length and positional data exhibited errors within 3 percent when using three-dimensional analysis and yielded errors within 8 percent through two-dimensional analysis (Direct Linear Software). Peak angular velocities displayed errors within 6 percent through three-dimensional analyses and exhibited errors of 12 percent when using two-dimensional analysis (Direct Linear Software). The specific results from this series of evaluations and their impacts on the methodology issues of kinematic data collection and analyses are presented in detail. The accuracy levels observed in these evaluations are also presented.

Wilmington, R. P.↗

Succession planning for technical experts

This report describes a methodology for identifying, evaluating, and mitigating the loss of key technical skills at nuclear operations facilities. The methodology can be adapted for application within regulatory authorities and research and development organizations, and can be directly applied by international engagement partners of the Department of Energy’s National Nuclear Security Administration (NNSA). The resultant product will be of direct benefit to two types of NNSA missions: (1) domestic human capital development programs tasked to provide focused technical expertise to succeed an aging nuclear operations workforce, and (2) international safeguards programs charged with maintaining operational safeguards for developing/existing nuclear power program in nations where minimal available resources must be used effectively. This report considers succession planning and the critical skills necessary to meet an institution’s goals and mission. Closely tied to succession planning are knowledge management and mentorship. In considering succession planning, critical skill sets are identified and are greatly dependent on the subject matter expert in question. This report also provides examples of critical skills that are job specific.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

A Methodology for Succession Planning for Technical Experts

This report describes a methodology for identifying, evaluating, and mitigating the loss of key technical skills at nuclear operations facilities. The methodology can be adapted for application within regulatory authorities and research and development organizations, and can be directly applied by international engagement partners of the Department of Energy’s National Nuclear Security Administration (NNSA). The resultant product will be of direct benefit to two types of NNSA missions: (1) domestic human capital development programs tasked to provide focused technical expertise to succeed an aging nuclear operations workforce, and (2) international safeguards programs charged with maintaining operational safeguards for developing/existing nuclear power program in nations where minimal available resources must be used effectively. This report considers succession planning and the critical skills necessary to meet an institution’s goals and mission. Closely tied to succession planning are knowledge management and mentorship. In considering succession planning, critical skill sets are identified and are greatly dependent on the subject matter expert in question. This report also provides examples of critical skills that are job specific.

99 GENERAL AND MISCELLANEOUS↗

A Methodology for Succession Planning for Technical Experts

This report describes a methodology for identifying, evaluating, and mitigating the loss of key technical skills at nuclear operations facilities. The methodology can be adapted for application within regulatory authorities and research and development organizations, and can be directly applied by international engagement partners of the Department of Energy’s National Nuclear Security Administration (NNSA). The resultant product will be of direct benefit to two types of NNSA missions: (1) domestic human capital development programs tasked to provide focused technical expertise to succeed an aging nuclear operations workforce, and (2) international safeguards programs charged with maintaining operational safeguards for developing/existing nuclear power program in nations where minimal available resources must be used effectively. This report considers succession planning and the critical skills necessary to meet an institution’s goals and mission. Closely tied to succession planning are knowledge management and mentorship. In considering succession planning, critical skill sets are identified and are greatly dependent on the subject matter expert in question. This report also provides examples of critical skills that are job specific.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Recommended Practices for Managing Induced Seismicity Risk Associated with Geologic Carbon Storage

The geologic storage of carbon dioxide (CO 2 ) is one method to help reduce or eliminate atmospheric CO 2 emissions. The sequestered CO 2 is originally captured from the atmosphere or from a stationary industrial source and subsequently injected into a deep subsurface porous rock formation. To facilitate the successful deployment of field scale carbon storage projects, the U.S. Department of Energy (DOE) is developing tools and protocols for defensible, science-based frameworks to quantify and mitigate risks associated with the long-term storage of CO 2 . This protocol specifically addresses the risk of induced seismicity due to injection in a geologic carbon storage (GCS) site. This integrated and risk-based protocol is a product of the U.S. DOE Fossil Energy’s National Risk Assessment Partnership (NRAP), a multi-year collaborative research effort of Los Alamos National Laboratory (LANL), Lawrence Berkeley National Laboratory (LBNL), Lawrence Livermore National Laboratory (LLNL), National Energy Technology Laboratory (NETL), and Pacific Northwest National Laboratory (PNNL). These recommended practices describe a set of 7 steps to evaluate, manage, communicate, and mitigate the risk of induced seismicity at GCS sites. The base methodology of the recommended practices follows a framework similar to the Protocol for Addressing Induced Seismicity Associated with Enhanced Geothermal Systems (Majer et al., 2012), developed for the Geothermal Technology Office of the U.S. DOE. These recommended practices present a framework to systematically assess the induced seismicity risk and quantify the associated uncertainties. These recommendations are based on current research and are sufficiently general to allow for modification and application to a variety of different types of sites. The substance of the recommended practices contained herein includes both technical and non-technical issues, and covers all operational stages of the GCS project lifecycle. They start at the preliminary risk assessment phase, continue through site assessment and characterization, include best practice communication and seismic monitoring plan methodologies, discuss the evaluation and mitigation of seismic hazard and risk, and closes with an exploration of operational management plans, which conclude when the induced seismicity risk abates back to background level. The focus of these recommendations is on actively managing the risks associated with induced seismicity by developing an actionable risk management plan that starts at the project proposal stage and continues through site closure through an iterative assessment and improvement process. The audience of this document is expected to include all interested stakeholders (e.g., operators, project developers, regulators, and the general public) and is expressly written to be accessible to this broad range of partners. This document is intended to disseminate knowledge gained through recent advances in the science of induced seismicity hazard and risk assessments, to provide updates based on recent experience gained by similar corollary injection-induced seismicity cases, and most importantly to establish a uniform framework to carry out a successful induced seismicity risk management plan for carbon storage projects in the future. These recommendations do not directly address any domestic or international regulations or standards. A complementary NRAP report makes recommendations for the assessment and management of environmental subsurface risks associated with unwanted fluid migration at GCS sites (Thomas et al., 2021) and should be referred to in order to address those additional GCS site risks.

54 ENVIRONMENTAL SCIENCES↗

Recommended Practices for Managing Induced Seismicity Risk Associated with Geologic Carbon Storage

The geologic storage of carbon dioxide (CO 2 ) is one method to help reduce or eliminate atmospheric CO 2 emissions. The sequestered CO 2 is originally captured from the atmosphere or from a stationary industrial source and subsequently injected into a deep subsurface porous rock formation. To facilitate the successful deployment of field scale carbon storage projects, the U.S. Department of Energy (DOE) is developing tools and protocols for defensible, science-based frameworks to quantify and mitigate risks associated with the long-term storage of CO 2 . This protocol specifically addresses the risk of induced seismicity due to injection in a geologic carbon storage (GCS) site. This integrated and risk-based protocol is a product of the U.S. DOE Fossil Energy’s National Risk Assessment Partnership (NRAP), a multi-year collaborative research effort of Los Alamos National Laboratory (LANL), Lawrence Berkeley National Laboratory (LBNL), Lawrence Livermore National Laboratory (LLNL), National Energy Technology Laboratory (NETL), and Pacific Northwest National Laboratory (PNNL). These recommended practices describe a set of 7 steps to evaluate, manage, communicate, and mitigate the risk of induced seismicity at GCS sites. The base methodology of the recommended practices follows a framework similar to the $\textit{Protocol for Addressing Induced Seismicity Associated with Enhanced Geothermal Systems}$ (Majer et al., 2012), developed for the Geothermal Technology Office of the U.S. DOE. These recommended practices present a framework to systematically assess the induced seismicity risk and quantify the associated uncertainties. These recommendations are based on current research and are sufficiently general to allow for modification and application to a variety of different types of sites. The substance of the recommended practices contained herein includes both technical and non-technical issues, and covers all operational stages of the GCS project lifecycle. They start at the preliminary risk assessment phase, continue through site assessment and characterization, include best practice communication and seismic monitoring plan methodologies, discuss the evaluation and mitigation of seismic hazard and risk, and closes with an exploration of operational management plans, which conclude when the induced seismicity risk abates back to background level. The focus of these recommendations is on actively managing the risks associated with induced seismicity by developing an actionable risk management plan that starts at the project proposal stage and continues through site closure through an iterative assessment and improvement process. The audience of this document is expected to include all interested stakeholders (e.g., operators, project developers, regulators, and the general public) and is expressly written to be accessible to this broad range of partners. This document is intended to disseminate knowledge gained through recent advances in the science of induced seismicity hazard and risk assessments, to provide updates based on recent experience gained by similar corollary injection-induced seismicity cases, and most importantly to establish a uniform framework to carry out a successful induced seismicity risk management plan for carbon storage projects in the future. These recommendations do not directly address any domestic or international regulations or standards. A complementary NRAP report makes recommendations for the assessment and management of environmental subsurface risks associated with unwanted fluid migration at GCS sites (Thomas et al., 2021) and should be referred to in order to address those additional GCS site risks

58 GEOSCIENCES↗

Probabilistic micromechanics for high-temperature composites

The three-year program of research had the following technical objectives: the development of probabilistic methods for micromechanics-based constitutive and failure models, application of the probabilistic methodology in the evaluation of various composite materials and simulation of expected uncertainties in unidirectional fiber composite properties, and influence of the uncertainties in composite properties on the structural response. The first year of research was devoted to the development of probabilistic methodology for micromechanics models. The second year of research focused on the evaluation of the Chamis-Hopkins constitutive model and Aboudi constitutive model using the methodology developed in the first year of research. The third year of research was devoted to the development of probabilistic finite element analysis procedures for laminated composite plate and shell structures.

Reddy, J. N.↗

An improved approach for flight readiness assessment

An improved methodology for quantitatively evaluating failure risk for a spaceflight system in order to assess flight readiness is presented. This methodology is of particular value when information relevant to failure prediction, including test experience and knowledge of parameters used in engineering analyses of failure phenomena, is limited. In this approach, engineering analysis models that characterize specific failure modes based on the physics and mechanics of the failure phenomena are used in a prescribed probabilistic structure to generate a failure probability distribution that is modified by test and flight experience in a Bayesian statistical procedure. The probabilistic structure and statistical methodology are generally applicable to any failure mode for which quantitative engineering analysis can be employed to characterize the failure phenomenon and are particularly well suited for use under the constraints on information availability that are typical of such spaceflight systems as the Space Shuttle and planetary spacecraft.

Moore, N. R.↗

Report on FY17 testing in support of integrated EPP-SMT design methods development

The goal of the proposed integrated Elastic Perfectly-Plastic (EPP) and Simplified Model Test (SMT) methodology is to incorporate a SMT data-based approach for creep-fatigue damage evaluation into the EPP methodology to avoid the separate evaluation of creep and fatigue damage and eliminate the requirement for stress classification in current methods; thus greatly simplifying evaluation of elevated temperature cyclic service. The purpose of this methodology is to minimize over-conservatism while properly accounting for localized defects and stress risers. To support the implementation of the proposed methodology and to verify the applicability of the code rules, thermomechanical tests continued in FY17. This report presents the recent test results for Type 1 SMT specimens on Alloy 617 with long hold times, pressurization SMT on Alloy 617, and two-bar thermal ratcheting test results on SS316H at the temperature range of 405 °C to 705 °C. Preliminary EPP strain range analysis on the two-bar tests are critically evaluated and compared with the experimental results.

97 MATHEMATICS AND COMPUTING↗