Search NASA⌕ Search

SEARCH · Search NASA

Results for “evaluation methodology”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 415 records · Page 23
All sourcesNASA NTRSDOE OSTI
NASA NTRS1997

Evaluation of a Progressive Failure Analysis Methodology for Laminated Composite Structures

A progressive failure analysis methodology has been developed for predicting the nonlinear response and failure of laminated composite structures. The progressive failure analysis uses C plate and shell elements based on classical lamination theory to calculate the in-plane stresses. Several failure criteria, including the maximum strain criterion, Hashin's criterion, and Christensen's criterion, are used to predict the failure mechanisms. The progressive failure analysis model is implemented into a general purpose finite element code and can predict the damage and response of laminated composite structures from initial loading to final failure.

Sleight, David W.↗
NASA NTRS2018

The Evaluation of Cryogenic Force Balance Calibration Methodologies with Respect to Wind Tunnel Results

Independent tests of the NASA Common Research Model (CRM) at NASA's National Transonic Facility (NTF) and the European Transonic Windtunnel (ETW) revealed discrepancies at low operating temperatures and high Reynolds numbers that warranted further investigation. Since each facility used their own force balance for their tunnel entry, one suggestion for the discrepancy was the temperature compensation methodology developed and applied for each balance. This hypothesis is explored through simulation and experimentally. Independent calibrations of NASA's NTF-118A balance at NASA Langley and ETW reveal discrepancies in the thermal compensation of the normal force and pitching moment primary sensitivities with temperature, while the axial force primary sensitivities are in good agreement. The application of the force balance calibrations performed at NASA and ETW to the prior wind tunnel data suggests that the thermal compensation discrepancies are an order of magnitude less than the discrepancies observed between the wind tunnel aerodynamic coefficients.

Burns, Devin E.↗
NASA NTRS2020

Advancing Methodologies for Applying Machine Learning and Evaluating Spatiotemporal Models of Fine Particulate Matter (PM 2.5 ) Using Satellite Data Over Large Regions

Reconstructing the distribution of fine particulate matter (PM 2.5 ) in space and time, even far from ground monitoring sites, is an important exposure science contribution to epidemiologic analyses of PM 2.5 health impacts. Flexible statistical methods for prediction have demonstrated the integration of satellite observations with other predictors, yet these algorithms are susceptible to overfitting the spatiotemporal structure of the training datasets. We present a new approach for predicting PM 2.5 using machine-learning methods and evaluating prediction models for the goal of making predictions where they were not previously available. We apply extreme gradient boosting (XGBoost) modeling to predict daily PM 2.5 on a 1 x 1 km 2 resolution for a 13 state region in the Northeastern USA for the years 2000–2015 using satellite-derived aerosol optical depth and implement a recursive feature selection to develop a parsimonious model. We demonstrate excellent predictions of withheld observations but also contrast an RMSE of 3.11 μg/m 3 in our spatial cross-validation withholding nearby sites versus an overfit RMSE of 2.10 μg/m 3 using a more conventional random ten-fold splitting of the dataset. As the field of exposure science moves forward with the use of advanced machine-learning approaches for spatiotemporal modeling of air pollutants, our results show the importance of addressing data leakage in training, overfitting to spatiotemporal structure, and the impact of the predominance of ground monitoring sites in dense urban sub-networks on model evaluation. The strengths of our resultant modeling approach for exposure in epidemiologic studies of PM 2.5 include improved efficiency, parsimony, and interpretability with robust validation while still accommodating complex spatiotemporal relationships.

air pollution↗
NASA NTRS1986

NASA PC software evaluation project

The USL NASA PC software evaluation project is intended to provide a structured framework for facilitating the development of quality NASA PC software products. The project will assist NASA PC development staff to understand the characteristics and functions of NASA PC software products. Based on the results of the project teams' evaluations and recommendations, users can judge the reliability, usability, acceptability, maintainability and customizability of all the PC software products. The objective here is to provide initial, high-level specifications and guidelines for NASA PC software evaluation. The primary tasks to be addressed in this project are as follows: to gain a strong understanding of what software evaluation entails and how to organize a structured software evaluation process; to define a structured methodology for conducting the software evaluation process; to develop a set of PC software evaluation criteria and evaluation rating scales; and to conduct PC software evaluations in accordance with the identified methodology. Communication Packages, Network System Software, Graphics Support Software, Environment Management Software, General Utilities. This report represents one of the 72 attachment reports to the University of Southwestern Louisiana's Final Report on NASA Grant NGT-19-010-900. Accordingly, appropriate care should be taken in using this report out of context of the full Final Report.

Dominick, Wayne D.↗
DOE OSTI2022

Evaluation of Heat Exchanger Technology for Integrated Energy System: Methodology and Preliminary Application

This report proposes a novel heat exchanger evaluation method, based on integrated QFD-AHP technique, to support strategic optimal selection of heat exchanger (HX) technology for integrated energy systems. The term “optimal selection” is defined as selecting a product (i.e., HX) that best meets various aspects of end user demand, including both technical and economic requirements. Compared to previous HX evaluation methods, the proposed approach allows decision makers to explicitly take into account the practical demand of customers (i.e., HX end users) which may vary depending on the HX application target. In addition, the proposed evaluation method can be used not only for high-level decisions to select HX type, but also for low-level decisions such as the selection of the key components including HX material or heat transfer fluid. The focus of this study is to describe the new HX evaluation method and to illustrate the overall HX evaluation and selection processes using the three nuclear heat application cases that represent the thermal integration between advanced nuclear reactors and industrial processes. As a preliminary study, three different types of HX, i.e., shell-and-tube heat exchanger, printed circuit heat exchanger, and heat pipe heat exchanger, were compared.

42 ENGINEERING↗
NASA NTRS1997

Infrared Algorithm Development for Ocean Observations with EOS/MODIS

Efforts continue under this contract to develop algorithms for the computation of sea surface temperature (SST) from MODIS infrared measurements. This effort includes radiative transfer modeling, comparison of in situ and satellite observations, development and evaluation of processing and networking methodologies for algorithm computation and data accession, evaluation of surface validation approaches for IR radiances, development of experimental instrumentation, and participation in MODIS (project) related activities. Activities in this contract period have focused on radiative transfer modeling, evaluation of atmospheric correction methodologies, undertake field campaigns, analysis of field data, and participation in MODIS meetings.

Brown, Otis B.↗
NASA NTRS1992

Methodology issues concerning the accuracy of kinematic data collection and analysis using the ariel performance analysis system

Kinematics, the study of motion exclusive of the influences of mass and force, is one of the primary methods used for the analysis of human biomechanical systems as well as other types of mechanical systems. The Anthropometry and Biomechanics Laboratory (ABL) in the Crew Interface Analysis section of the Man-Systems Division performs both human body kinematics as well as mechanical system kinematics using the Ariel Performance Analysis System (APAS). The APAS supports both analysis of analog signals (e.g. force plate data collection) as well as digitization and analysis of video data. The current evaluations address several methodology issues concerning the accuracy of the kinematic data collection and analysis used in the ABL. This document describes a series of evaluations performed to gain quantitative data pertaining to position and constant angular velocity movements under several operating conditions. Two-dimensional as well as three-dimensional data collection and analyses were completed in a controlled laboratory environment using typical hardware setups. In addition, an evaluation was performed to evaluate the accuracy impact due to a single axis camera offset. Segment length and positional data exhibited errors within 3 percent when using three-dimensional analysis and yielded errors within 8 percent through two-dimensional analysis (Direct Linear Software). Peak angular velocities displayed errors within 6 percent through three-dimensional analyses and exhibited errors of 12 percent when using two-dimensional analysis (Direct Linear Software). The specific results from this series of evaluations and their impacts on the methodology issues of kinematic data collection and analyses are presented in detail. The accuracy levels observed in these evaluations are also presented.

Wilmington, R. P.↗
DOE OSTI2021

Recommended Practices for Managing Induced Seismicity Risk Associated with Geologic Carbon Storage

The geologic storage of carbon dioxide (CO 2 ) is one method to help reduce or eliminate atmospheric CO 2 emissions. The sequestered CO 2 is originally captured from the atmosphere or from a stationary industrial source and subsequently injected into a deep subsurface porous rock formation. To facilitate the successful deployment of field scale carbon storage projects, the U.S. Department of Energy (DOE) is developing tools and protocols for defensible, science-based frameworks to quantify and mitigate risks associated with the long-term storage of CO 2 . This protocol specifically addresses the risk of induced seismicity due to injection in a geologic carbon storage (GCS) site. This integrated and risk-based protocol is a product of the U.S. DOE Fossil Energy’s National Risk Assessment Partnership (NRAP), a multi-year collaborative research effort of Los Alamos National Laboratory (LANL), Lawrence Berkeley National Laboratory (LBNL), Lawrence Livermore National Laboratory (LLNL), National Energy Technology Laboratory (NETL), and Pacific Northwest National Laboratory (PNNL). These recommended practices describe a set of 7 steps to evaluate, manage, communicate, and mitigate the risk of induced seismicity at GCS sites. The base methodology of the recommended practices follows a framework similar to the Protocol for Addressing Induced Seismicity Associated with Enhanced Geothermal Systems (Majer et al., 2012), developed for the Geothermal Technology Office of the U.S. DOE. These recommended practices present a framework to systematically assess the induced seismicity risk and quantify the associated uncertainties. These recommendations are based on current research and are sufficiently general to allow for modification and application to a variety of different types of sites. The substance of the recommended practices contained herein includes both technical and non-technical issues, and covers all operational stages of the GCS project lifecycle. They start at the preliminary risk assessment phase, continue through site assessment and characterization, include best practice communication and seismic monitoring plan methodologies, discuss the evaluation and mitigation of seismic hazard and risk, and closes with an exploration of operational management plans, which conclude when the induced seismicity risk abates back to background level. The focus of these recommendations is on actively managing the risks associated with induced seismicity by developing an actionable risk management plan that starts at the project proposal stage and continues through site closure through an iterative assessment and improvement process. The audience of this document is expected to include all interested stakeholders (e.g., operators, project developers, regulators, and the general public) and is expressly written to be accessible to this broad range of partners. This document is intended to disseminate knowledge gained through recent advances in the science of induced seismicity hazard and risk assessments, to provide updates based on recent experience gained by similar corollary injection-induced seismicity cases, and most importantly to establish a uniform framework to carry out a successful induced seismicity risk management plan for carbon storage projects in the future. These recommendations do not directly address any domestic or international regulations or standards. A complementary NRAP report makes recommendations for the assessment and management of environmental subsurface risks associated with unwanted fluid migration at GCS sites (Thomas et al., 2021) and should be referred to in order to address those additional GCS site risks.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Recommended Practices for Managing Induced Seismicity Risk Associated with Geologic Carbon Storage

The geologic storage of carbon dioxide (CO 2 ) is one method to help reduce or eliminate atmospheric CO 2 emissions. The sequestered CO 2 is originally captured from the atmosphere or from a stationary industrial source and subsequently injected into a deep subsurface porous rock formation. To facilitate the successful deployment of field scale carbon storage projects, the U.S. Department of Energy (DOE) is developing tools and protocols for defensible, science-based frameworks to quantify and mitigate risks associated with the long-term storage of CO 2 . This protocol specifically addresses the risk of induced seismicity due to injection in a geologic carbon storage (GCS) site. This integrated and risk-based protocol is a product of the U.S. DOE Fossil Energy’s National Risk Assessment Partnership (NRAP), a multi-year collaborative research effort of Los Alamos National Laboratory (LANL), Lawrence Berkeley National Laboratory (LBNL), Lawrence Livermore National Laboratory (LLNL), National Energy Technology Laboratory (NETL), and Pacific Northwest National Laboratory (PNNL). These recommended practices describe a set of 7 steps to evaluate, manage, communicate, and mitigate the risk of induced seismicity at GCS sites. The base methodology of the recommended practices follows a framework similar to the $\textit{Protocol for Addressing Induced Seismicity Associated with Enhanced Geothermal Systems}$ (Majer et al., 2012), developed for the Geothermal Technology Office of the U.S. DOE. These recommended practices present a framework to systematically assess the induced seismicity risk and quantify the associated uncertainties. These recommendations are based on current research and are sufficiently general to allow for modification and application to a variety of different types of sites. The substance of the recommended practices contained herein includes both technical and non-technical issues, and covers all operational stages of the GCS project lifecycle. They start at the preliminary risk assessment phase, continue through site assessment and characterization, include best practice communication and seismic monitoring plan methodologies, discuss the evaluation and mitigation of seismic hazard and risk, and closes with an exploration of operational management plans, which conclude when the induced seismicity risk abates back to background level. The focus of these recommendations is on actively managing the risks associated with induced seismicity by developing an actionable risk management plan that starts at the project proposal stage and continues through site closure through an iterative assessment and improvement process. The audience of this document is expected to include all interested stakeholders (e.g., operators, project developers, regulators, and the general public) and is expressly written to be accessible to this broad range of partners. This document is intended to disseminate knowledge gained through recent advances in the science of induced seismicity hazard and risk assessments, to provide updates based on recent experience gained by similar corollary injection-induced seismicity cases, and most importantly to establish a uniform framework to carry out a successful induced seismicity risk management plan for carbon storage projects in the future. These recommendations do not directly address any domestic or international regulations or standards. A complementary NRAP report makes recommendations for the assessment and management of environmental subsurface risks associated with unwanted fluid migration at GCS sites (Thomas et al., 2021) and should be referred to in order to address those additional GCS site risks

58 GEOSCIENCES↗
NASA NTRS1993

Probabilistic micromechanics for high-temperature composites

The three-year program of research had the following technical objectives: the development of probabilistic methods for micromechanics-based constitutive and failure models, application of the probabilistic methodology in the evaluation of various composite materials and simulation of expected uncertainties in unidirectional fiber composite properties, and influence of the uncertainties in composite properties on the structural response. The first year of research was devoted to the development of probabilistic methodology for micromechanics models. The second year of research focused on the evaluation of the Chamis-Hopkins constitutive model and Aboudi constitutive model using the methodology developed in the first year of research. The third year of research was devoted to the development of probabilistic finite element analysis procedures for laminated composite plate and shell structures.

Reddy, J. N.↗
NASA NTRS1990

An improved approach for flight readiness assessment

An improved methodology for quantitatively evaluating failure risk for a spaceflight system in order to assess flight readiness is presented. This methodology is of particular value when information relevant to failure prediction, including test experience and knowledge of parameters used in engineering analyses of failure phenomena, is limited. In this approach, engineering analysis models that characterize specific failure modes based on the physics and mechanics of the failure phenomena are used in a prescribed probabilistic structure to generate a failure probability distribution that is modified by test and flight experience in a Bayesian statistical procedure. The probabilistic structure and statistical methodology are generally applicable to any failure mode for which quantitative engineering analysis can be employed to characterize the failure phenomenon and are particularly well suited for use under the constraints on information availability that are typical of such spaceflight systems as the Space Shuttle and planetary spacecraft.

Moore, N. R.↗
NASA NTRS2010

Pressure Flammability Thresholds in Oxygen of Selected Aerospace Materials

The experimental approach consisted of concentrating the testing in the flammability transition zone following the Bruceton Up-and-Down Method. For attribute data, the method has been shown to be very repeatable and most efficient. Other methods for characterization of critical levels (Karberand Probit) were also considered. The data yielded the upward limiting pressure index (ULPI), the pressure level where approx.50% of materials self-extinguish in a given environment.Parametric flammability thresholds other than oxygen concentration can be determined with the methodology proposed for evaluating the MOC when extinguishment occurs. In this case, a pressure threshold in 99.8% oxygen was determined with the methodology and found to be 0.4 to 0.9 psia for typical spacecraft materials. Correlation of flammability thresholds obtained with chemical, hot wire, and other ignition sources will be conducted to provide recommendations for using alternate ignition sources to evaluate flammability of aerospace materials.

Hirsch, David↗
DOE OSTI2024

Plan evaluation for heat resilience: complementary methods to comprehensively assess heat planning in Tempe and Tucson, Arizona

Abstract Escalating impacts from climate change and urban heat are increasing the urgency for communities to equitably plan for heat resilience. Cities in the desert Southwest are among the hottest and fastest warming in the U.S., placing them on the front lines of heat planning. Urban heat resilience requires an integrated planning approach that coordinates strategies across the network of plans that shape the built environment and risk patterns. To date, few studies have assessed cities’ progress on heat planning. This research is the first to combine two emerging plan evaluation approaches to examine how networks of plans shape urban heat resilience through case studies of Tempe and Tucson, Arizona. The first methodology, Plan Quality Evaluation for Heat Resilience, adapts existing plan quality assessment approaches to heat. We assess whether plans meet 56 criteria across seven principles of high-quality planning and the types of heat strategies included in the plans. The second methodology, the Plan Integration for Resilience Scorecard™ (PIRS™) for Heat, focuses on plan policies that could influence urban heat hazards. We categorize policies by policy tool and heat mitigation strategy and score them based on their heat impact. Scored policies are then mapped to evaluate their spatial distribution and the net effect of the plan network. The resulting PIRS™ for Heat scorecard is compared with heat vulnerability indicators to assess policy alignment with risks. We find that both cities are proactively planning for heat resilience using similar plan and strategy types, however, there are clear and consistent opportunities for improvement. Combining these complementary plan evaluation methods provides a more comprehensive understanding of how plans address heat and a generalizable approach that communities everywhere could use to identify opportunities for improved heat resilience planning.

Environmental Sciences & Ecology↗
NASA NTRS1992

An improved approach for flight readiness certification: Probabilistic models for flaw propagation and turbine blade failure. Volume 1: Methodology and applications

An improved methodology for quantitatively evaluating failure risk of spaceflight systems to assess flight readiness and identify risk control measures is presented. This methodology, called Probabilistic Failure Assessment (PFA), combines operating experience from tests and flights with analytical modeling of failure phenomena to estimate failure risk. The PFA methodology is of particular value when information on which to base an assessment of failure risk, including test experience and knowledge of parameters used in analytical modeling, is expensive or difficult to acquire. The PFA methodology is a prescribed statistical structure in which analytical models that characterize failure phenomena are used conjointly with uncertainties about analysis parameters and/or modeling accuracy to estimate failure probability distributions for specific failure modes. These distributions can then be modified, by means of statistical procedures of the PFA methodology, to reflect any test or flight experience. State-of-the-art analytical models currently employed for designs failure prediction, or performance analysis are used in this methodology. The rationale for the statistical approach taken in the PFA methodology is discussed, the PFA methodology is described, and examples of its application to structural failure modes are presented. The engineering models and computer software used in fatigue crack growth and fatigue crack initiation applications are thoroughly documented.

Moore, N. R.↗
NASA NTRS1992

An improved approach for flight readiness certification: Probabilistic models for flaw propagation and turbine blade failure. Volume 2: Software documentation

An improved methodology for quantitatively evaluating failure risk of spaceflights systems to assess flight readiness and identify risk control measures is presented. This methodology, called Probabilistic Failure Assessment (PFA), combines operating experience from tests and flights with analytical modeling of failure phenomena to estimate failure risk. The PFA methodology is of particular value when information on which to base an assessment of failure risk, including test experience and knowledge of parameters used in analytical modeling, is expensive or difficult to acquire. The PFA methodology is a prescribed statistical structure in which analytical models that characterize failure phenomena are used conjointly with uncertainties about analysis parameters and/or modeling accuracy to estimate failure probability distributions for specific failure modes. These distributions can then be modified, by means of statistical procedures of the PFA methodology, to reflect any test or flight experience. State-of-the-art analytical models currently employed for design, failure prediction, or performance analysis are used in this methodology. The rationale for the statistical approach taken in the PFA methodology is discussed, the PFA methodology is described, and examples of its application to structural failure modes are presented. The engineering models and computer software used in fatigue crack growth and fatigue crack initiation applications are thoroughly documented.

Moore, N. R.↗
DOE OSTI2022

Experimental Studies and Energy Modeling for Evaluating Performance of Various Deep Wall Retrofits

The Pacific Northwest National Laboratory, Oak Ridge National Laboratory, and the University of Minnesota conducted a three-year, multipart study on residential retrofit wall assemblies. The project, which was funded by the U.S. Department of Energy’s Building Technology Office, aimed to compare a range of residential wall retrofit systems that prioritized affordability, durability, and energy savings potential. The research team identified, constructed, tested, simulated, and analyzed the feasibility and economics of 16 wall retrofit assemblies (14 test configurations and two baseline configurations) that can be applied to the exterior side of existing walls (either with or without the existing cladding). The 16 wall assemblies were installed in an in-situ laboratory environment, to evaluate the ease of construction and study the thermal and hygrothermal performance of the walls. This paper presents the methodology used to evaluate the thermal performance of the walls and discusses the energy modeling results of the study. The results from the experiments were used to calibrate a THERM model of each wall assembly, which was then applied to a whole building using the EnergyPlus 8.6 simulation engine. A residential prototype building was used to extrapolate whole-building energy savings in each U.S. climate zone. To capture the conditions of the largest number of homes in the United States, the most frequent building characteristics (e.g., attic insulation level, window specifications, foundation insulation, etc.) were extracted from ResStock data and applied to the prototype model. Results from the energy modeling showed that the climate zones with the highest potential for retrofit savings are those which are heating-dominated (i.e., Cold and Very Cold climate designations). In these climate zones, heating and cooling energy savings due to the wall retrofits alone ranged from 21.5% to 38.2%.

Nagda, Harshil↗
NASA NTRS1999

Technologies for Nondestructive Evaluation of Surfaces and Thin Coatings

The effort included in this project included several related activities encompassing basic understanding, technological development, customer identification and commercial transfer of several methodologies for nondestructive evaluation of surfaces and thin surface coatings. Consistent with the academic environment, students were involved in the effort working with established investigators to further their training, provide a nucleus of experienced practitioners in the new technologies during their industrial introduction, and utilize their talents for project goals. As will be seen in various portions of the report, some of the effort has led to commercialization. This process has spawned other efforts related to this project which are supported from outside sources. These activities are occupying the efforts of some of the people who were previously supported within this grant and its predecessors. The most advanced of the supported technologies is thermography, for which the previous joint efforts of the investigators and NASA researchers have developed several techniques for extending the utility of straight thermographic inspection by producing methods of interpretation and analysis accessible to automatic image processing with computer data analysis. The effort reported for this technology has been to introduce the techniques to new user communities, who are then be able to add to the effective uses of existing products with only slight development work. In a related development, analysis of a thermal measurement situation in past efforts led to a new insight into the behavior of simple temperature probes. This insight, previously reported to the narrow community in which the particular measurement was made, was reported to the community of generic temperature measurement experts this year. In addition to the propagation of mature thermographic techniques, the development of a thermoelastic imaging system has been an important related development. Part of the work carried out in the effort reported here has been to prepare reports introducing the newly commercially available thermoelastic measurements to the appropriate user communities.

Source record↗