Search NASA⌕ Search

SEARCH · Search NASA

Results for “evaluation methodology”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 721 records · Page 40

Continuation Report: Creep-fatigue Behavior and Damage Accumulation of a Candidate Structural Material for Concentrating Solar Thermal Receiver

At the start of this phase, six alloys were determined to be candidate materials for the concentrating solar power (CSP) thermal receiver: Alloys 617, 625, 740H, 230, 282 and Alloy X. From these, Alloys 740H and 282 were determined to be the most suitable, with both alloys exhibiting similar high temperature strength properties. Alloy 740H was selected due to its ease to work with (simpler heat treatments and welding procedures) and a larger database of existing data. Fatigue testing was started in this phase, with four fatigue tests having been completed, with additional fatigue testing planned, as well as tensile, creep and creep-fatigue tests starting in the next phase. Two fatigue tests performed at 850 °C and were completed in significantly fewer cycles than the two tests performed at 750 °C. Metallography was performed on the fatigued specimens to examine crack path and surrounding microstructure. These preliminary results suggest a significant drop in strength at elevated temperatures above 750 °C, however, more test results will be needed prior to setting design limits. Several potential model high temperature design methods were evaluated that could form the basis of our final recommended creep-fatigue design method for Alloy 740H. To do this we expanded on the receiver finite element model to develop a model representative of a potential Gen 3 design using KCl-MgCl2 salt coolant and operating with a salt inlet temperature of 550°C and salt outlet temperature of 720°C. Using the temperature fields from the model thermohydraulic analysis we determined the design life of the reference receiver assuming it was constructed from 740H seamless tubing and assuming high temperature design properties for 740H from literature data and, where required, naïve extrapolation. As experimental data is generated, these tentative design parameters will be updated to match the actual performance of 740H in elevated temperature service. The results of this design study are a rank ordering of potential design methods for two criteria: ease of use and design margin. The end goal of this project is to develop a creep-fatigue design method with adequate, but not over conservative, design margin that is straightforward to execute. Our receiver model is based on the preliminary design provided to DOE by Solar Reserve. Our analysis indicates a peak metal temperature of around 840° C for this design (comparable to Solar Reserve’s analysis, which shows a peak metal temperature of around 830° C). The Solar Reserve tube thickness is too thin to sustain creep-fatigue loading at this temperature. This means that the current trial design is not well-suited for evaluating different design methodologies, as we predict it will have a very short design life. We suggest that we modify our reference design with input from DOE in order to lower the maximum metal temperature to less than 800° C. We can then repeat these analyses and give a more meaningful comparison of different design methods before making a final selection.

14 SOLAR ENERGY↗

Introduction to Special Section: Machine Learning for Image-based Geologic Interpretation

Image-based geological interpretation has been a labor-intensive and time-consuming process because it requires well-trained geoscientists to identify geological structures, features, and textures from various types of images. These images include scanning electron microscopic images, optical microscopic images, optical photos, resistivity images, seismic volumes, remote-sensing images, etc. With fast-evolving machine learning (ML) technology and computing power in recent decades, computers can achieve nearhuman-level to super-human-level performance with scalable high efficiency in the computer vision field. These technological revolutions facilitated image-based geological interpretation in petroleum exploration and production. For example, a fault picking method applied to 3-D seismic volume data using deep learning can achieve superior performance in comparison to conventional auto-picking methods. In addition, under the new normal of low oil prices, the petroleum industry seeks cost-effective strategies such as automating traditionally labor-intensive processes. Nevertheless, the potential of applying ML to geological image interpretation is still facing a few key challenges including data scarcity, data distribution, poor data and/or label quality, data leakage, learning algorithms, model architecture, training methodologies, testing and evaluation metrics, hyper-parameters optimization, model drift, production deployment, and the like.

58 GEOSCIENCES↗

Assessment of Modeling and Simulation Technical Gaps in Safety Analysis of High Burnup Accident-Tolerant Fuels

The United States nuclear industry is facing a strong challenge to maintain regulatory-required levels of safety while ensuring economic competitiveness to stay in business. Safety remains a key parameter for all aspects related to the operation of light water reactor (LWR) nuclear power plants (NPPs), and it can be achieved more economically by using a risk-informed ecosystem, such as that being developed by the Risk-Informed Systems Analysis (RISA) Pathway under the U.S. Department of Energy (DOE) Light Water Reactor Sustainability (LWRS) Program. The LWRS Program is promoting a wide range of research and development activities to maximize both the safety and economically efficient performance of NPPs through improved scientific understanding, especially given that many plants are considering second license renewal. The RISA Pathway has two main goals: The deployment of methodologies and technologies that enable better representation of safety margins and the factors that contribute to cost and safety, and; The development of advanced applications that enable cost-effective plant operation. As part of the RISA Pathway, the Enhanced Resilient Plant (ERP) project refers to an NPP where safety is improved by implementing various measures, such as accident-tolerant fuels (ATF), diverse and flexible coping strategy (FLEX), enhancements to plant components and systems, incorporation of augmented or new passive cooling systems, and utilization of advanced battery technologies. The objective of the ERP research is to use novel methods and computational tools to enhance existing reactors’ safety while reducing operational costs. Many U.S. utilities are targeting implementation of ATFs instead of traditional fuel in the near future since ATFs offer benefits in terms of improved performance and cost savings. The robust properties of ATF make it possible to extend the refueling cycle from 18 to 24 months in addition to the opportunity to use less of fuel. Extensive safety assessments are required to support regulatory requirements and obtain the approvals to use ATFs and the ERP project support the industry by developing novel effective methodologies for safety evaluations. In this project, the technical gaps in the modeling and simulation of the high burnup (HBU) ATF were assessed in terms of the fuel cladding behavior during the postulated accident events. The issues were identified in modeling the cladding deformation, the hydrodynamic change due to cladding deformation and the critical heat flux (CHF). The RELAP5-3D cladding deformation model was assessed by multiple verification tests and validation with the instrumented fuel assembly (IFA) experiment.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Demonstration of Algorithm for Sensor Placement Optimization using Simulation Data

This deliverable reports FY26 progress in advancing a neural-network-based Green’s-function framework for reconstructing neutron-flux distributions from ex-core measurements and for translating reconstruction requirements into a practical detector-layout strategy. Building on the FY25 formulation, the present work had two main objectives: (1) refine and re-evaluate the reconstruction methodology on an updated Purdue University Reactor Number One (PUR-1) model, and (2) develop a systematic, Green’s-function-guided procedure for boundary detector placement.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Personalized, disease-stage specific, rapid identification of immunosuppression in sepsis

Introduction Data overlapping of different biological conditions prevents personalized medical decision-making. For example, when the neutrophil percentages of surviving septic patients overlap with those of non-survivors, no individualized assessment is possible. To ameliorate this problem, an immunological method was explored in the context of sepsis. Methods Blood leukocyte counts and relative percentages as well as the serum concentration of several proteins were investigated with 4072 longitudinal samples collected from 331 hospitalized patients classified as septic (n=286), non-septic (n=43), or not assigned (n=2). Two methodological approaches were evaluated: (i) a reductionist alternative, which analyzed variables in isolation; and (ii) a non-reductionist version, which examined interactions among six (leukocyte-, bacterial-, temporal-, personalized-, population-, and outcome-related) dimensions. Results The reductionist approach did not distinguish outcomes: the leukocyte and serum protein data of survivors and non-survivors overlapped. In contrast, the non-reductionist alternative differentiated several data groups, of which at least one was only composed of survivors (a finding observable since hospitalization day 1). Hence, the non-reductionist approach promoted personalized medical practices: every patient classified within a subset associated with 100% survival subset was likely to survive. The non-reductionist method also revealed five inflammatory or disease-related stages (provisionally named ‘early inflammation, early immunocompetence, intermediary immuno-suppression, late immuno-suppression, or other’). Mortality data validated these labels: both ‘suppression’ subsets revealed 100% mortality, the ‘immunocompetence’ group exhibited 100% survival, while the remaining sets reported two-digit mortality percentages. While the ‘intermediary’ suppression expressed an impaired monocyte-related function, the ‘late’ suppression displayed renal-related dysfunctions, as indicated by high concentrations of urea and creatinine. Discussion The data-driven differentiation of five data groups may foster early and non-overlapping biomedical decision-making, both upon admission and throughout their hospitalization. This approach could evaluate therapies, at personalized level, earlier. To ascertain repeatability and investigate the dynamics of the ‘other’ group, additional studies are recommended.

Immunology↗

Metrics for Intercomparison of Remapping Algorithms (MIRA) protocol applied to Earth system models

Abstract. Strongly coupled nonlinear phenomena such as those described by Earth system models (ESMs) are composed of multiple component models with independent mesh topologies and scalable numerical solvers. A common operation in ESMs is to remap or interpolate component solution fields defined on their computational mesh to another mesh with a different combinatorial structure and decomposition, e.g., from the atmosphere to the ocean, during the temporal integration of the coupled system. Several remapping schemes are currently in use or available for ESMs. However, a unified approach to compare the properties of these different schemes has not been attempted previously. We present a rigorous methodology for the evaluation and intercomparison of remapping methods through an independently implemented suite of metrics that measure the ability of a method to adhere to constraints such as grid independence, monotonicity, global conservation, and local extrema or feature preservation. A comprehensive set of numerical evaluations is conducted based on a progression of scalar fields from idealized and smooth to more general climate data with strong discontinuities and strict bounds. We examine four remapping algorithms with distinct design approaches, namely ESMF Regrid (Hill et al., 2004), TempestRemap (Ullrich and Taylor, 2015), generalized moving least squares (GMLS) (Trask and Kuberry, 2020) with post-processing filters, and WLS-ENOR (Li et al., 2020). By repeated iterative application of the high-order remapping methods to the test fields, we verify the accuracy of each scheme in terms of their observed convergence order for smooth data and determine the bounded error propagation using challenging, realistic field data on both uniform and regionally refined mesh cases. In addition to retaining high-order accuracy under idealized conditions, the methods also demonstrate robust remapping performance when dealing with non-smooth data. There is a failure to maintain monotonicity in the traditional L2-minimization approaches used in ESMF and TempestRemap, in contrast to stable recovery through nonlinear filters used in both meshless GMLS and hybrid mesh-based WLS-ENOR schemes. Local feature preservation analysis indicates that high-order methods perform better than low-order dissipative schemes for all test cases. The behavior of these remappers remains consistent when applied on regionally refined meshes, indicating mesh-invariant implementations. The MIRA intercomparison protocol proposed in this paper and the detailed comparison of the four algorithms demonstrate that the new schemes, namely GMLS and WLS-ENOR, are competitive compared to standard conservative minimization methods requiring computation of mesh intersections. The work presented in this paper provides a foundation that can be extended to include complex field definitions, realistic mesh topologies, and spectral element discretizations, thereby allowing for a more complete analysis of production-ready remapping packages.

58 GEOSCIENCES↗

Call to Action for Global Access to and Harmonization of Quality Information of Individual Earth Science Datasets

Knowledge about the quality of data and metadata is important to support informed decisions on the (re)use of individual datasets and is an essential part of the ecosystem that supports open science. Quality assessments reflect the reliability and usability of data. They need to be consistently curated, fully traceable, and adequately documented, as these are crucial for sound decision- and policy-making efforts that rely on data. Quality assessments also need to be consistently represented and readily integrated across systems and tools to allow for improved sharing of information on quality at the dataset level for individual quality attribute or dimension. Although the need for assessing the quality of data and associated information is well recognized, methodologies for an evaluation framework and presentation of resultant quality information to end users may not have been comprehensively addressed within and across disciplines. Global interdisciplinary domain experts have come together to systematically explore needs, challenges and impacts of consistently curating and representing quality information through the entire lifecycle of a dataset. This paper describes the findings of that effort, argues the importance of sharing dataset quality information, calls for community action to develop practical guidelines, and outlines community recommendations for developing such guidelines. Practical guidelines will allow for global access to and harmonization of quality information at the level of individual Earth science datasets, which in turn will support open science.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

Common practices for quantifying methane emissions from plumes detected by remote sensing

This document provides a set of community-accepted practices for quantifying methane emissions based on plumes detected via spectroscopic remote sensing. Its primary goal is to promote consistency in the generation, validation, reporting, and quality assessment of methane emission estimates derived from remote sensing radiances. Developed by subject matter experts with deep experience across all stages of the measurement process, this guidance reflects a critical evaluation of current methodologies and highlights key practices needed to produce reliable, interoperable, and traceable products. The focus is specifically on methane emissions quantified from distinct plumes originating from localized sources, rather than diffuse emissions spread over large regions, which are beyond the scope of this work. This document is intended to serve both data producers and users. For producers, it offers a framework for aligning with field-recognized standards to ensure their outputs meet rigorous quality and transparency criteria. For users, it provides a reference to assess dataset fitness-for-purpose by highlighting essential metadata, assumptions, and methodological choices that underpin emission estimates. By fostering a shared understanding of best practices, this work aims to enhance comparability, confidence, and utility of remotely sensed methane emission products.

54 ENVIRONMENTAL SCIENCES↗

Parametric study of STOL short-haul transport engine cycles and operational techniques to minimize community noise impact

The effect of aircraft operational techniques in the terminal area on community noise impact of future short haul aircraft was investigated. Aircraft equipped with mechanical flap (MF) and aircraft with externally blown flap (EBF) were used to study the noise impact at four U.S. airports. The four airports were: (1) Hanscom Field (Boston), (2) Washington National (D.C.), (3) Midway (Chicago) and (4) Orange County (California). With the exception of Washington National (D.C.), the study showed that a reduction of approximately 40 percent in the number of people highly annoyed can be obtained by using the recommended operational techniques. The evaluation procedures and methodology developed in the study represent an advance in acoustical state-of-the-art and provide an effective and useful tool for determining aircraft noise impact on the airport community.

Source record↗

Parametric study of STOL short-haul engine cycles and operational techniques to minimize community noise impact

The effect of aircraft operational techniques in the terminal area on community noise impact of future short-haul aircraft was investigated. These operational techniques affected altitude, flap retraction rate, thrust cutback altitude, amount of thrust cutback, and amount of turning. During landing the parameters varied were glide slope angle, change in slope angle (two segment approach), and flap extension rate. One mechanical-flap (MF) aircraft and one externally-blown-flap (EBF) aircraft were used to study by noise impact at four U.S. airports, Hanscom Field (Boston); Washington National; Midway (Chicago); and Orange County (California). With the exception of Washington National (DCA), the study showed that a reduction of approximately 40 percent in the number of people highly annoyed (as defined in the study) can be obtained by using these operational techniques. At DCA the number of people highly annoyed using the standard procedure was quite low, but it is significant that the minimumimpact case for Runway 36 reduced the number of people highly annoyed to zero using a power cutback and a turning departure path. The evaluation procedures and methodology developed in this study represents an advance in acoustical state-of-the-art and should provide an effective and useful tool for determining aircraft noise impact upon the airport community.

Source record↗

Nondestructive evaluation

Technological survey summarizes accumulated knowledge of nondestructive-evaluation (NDE) testing methodology application and reliability as it is presented in literature covering time period from 1962 to 1975.

Mandel, G.↗

Shuttle payload minimum cost vibroacoustic tests

This paper is directed toward the development of the methodology needed to evaluate cost effective vibroacoustic test plans for Shuttle Spacelab payloads. Statistical decision theory is used to quantitatively evaluate seven alternate test plans by deriving optimum test levels and the expected cost for each multiple mission payload considered. The results indicate that minimum costs can vary by as much as $6 million for the various test plans. The lowest cost approach eliminates component testing and maintains flight vibration reliability by performing subassembly tests at a relatively high acoustic level. Test plans using system testing or combinations of component and assembly level testing are attractive alternatives. Component testing alone is shown not to be cost effective.

Stahle, C. V.↗

Automated image processing of LANDSAT 2 digital data for watershed runoff prediction

The U.S. Soil Conservation Service (SCS) model for watershed runoff prediction uses soil and land cover information as its major drivers. Kern County Water Agency is implementing the SCS model to predict runoff for 10,400 sq cm of mountainous watershed in Kern County, California. The Remote Sensing Unit, University of California, Santa Barbara, was commissioned by KCWA to conduct a 230 sq cm feasibility study in the Lake Isabella, California region to evaluate remote sensing methodologies which could be ultimately extrapolated to the entire 10,400 sq cm Kern County watershed. Digital results indicate that digital image processing of Landsat 2 data will provide usable land cover required by KCWA for input to the SCS runoff model.

Sasso, R. R.↗

OSTA/ADS standards development process

A phased approach to data systems standards was developed. The standards survey, user requirements, methodology survey, and evaluation criteria were completed. Remaining to be done are data system planning interim standards, a concept for implementation of a core applications data service, a data systems policy definition, and full capability data services definition.

Walton, B.↗

Application of in-flight thrust determination uncertainty

A numerical example is given of a previously proposed methodology for the evaluation of in-flight thrust measurement uncertainty, using data extracted from a performance report comparing two different missile prototypes under a variety of flight conditions. Attention is given to the data for the AGM-68B Air Launched Cruise Missile, which is powered by the F107 dual-spool, mixed flow turbofan engine. Assessments are made of the definition of the measurement process, instrumentation error estimation, the propagation of errors to thrust calculation, mathematical model errors, the in-flight thrust error component, and correction to standard conditions. It is concluded that in-flight thrust measurement uncertainty limits can be evaluated from measurement system error analysis results and test data for the missile evaluation process presently described.

Adams, G. R.↗

Creating competitive rotorcraft noise technology

Rotorcraft noise includes turbofan engine noise components, as well as noise from the main and tail rotors that is conditioned by the aircraft's various operational modes. Both of the rotors generate loading noise and broadband noise. Another noise contributor is blade/vortex interaction noise, which results when shed vortices are encountered by a following blade, releasing impulsive acoustic energy. Attention is presently given to the experimental and developmental initiatives to be made by a NASA/industry five-year program that began in 1983. Aeroacoustic data acquired from experiments conducted in NASA facilities can be used in the development of empirical noise prediction methods, in the improvement of existing noise prediction methodology, in the evaluation of proposed reduced noise designs, and in the establishment of useful scaling relationships for selected noise-generating mechanisms.

Raney, J. P.↗

Proceedings of the Ninth Annual Software Engineering Workshop

Experiences in measurement, utilization, and evaluation of software methodologies, models, and tools are discussed. NASA's involvement in ever larger and more complex systems, like the space station project, provides a motive for the support of software engineering research and the exchange of ideas in such forums. The topics of current SEL research are software error studies, experiments with software development, and software tools.

Source record↗

Pilot land data system

During the fall of 1983, the Information Systems Office of NASA's Office of Space Science and Applications assembled a Working Group to develop initial plans for a Pilot Land Data System (PLDS). Workshops coordinated planning and concept development activities between land-related and computer science disciplines, and examined land research requirements, information science technology requirements, PLDS architecture, and methodologies for system evaluation. The PLDS will be a limited-scale distributed information system to explore scientific, technical and management approaches to satisfy land science research needs. PLDS will pave the way for a Land Data System to improve data access, processing, transfer and analysis, fostering an environment in which land science information synthesis can occur on a scale not previously possible owing to limits to data assembly and access and efficiency of processing.

Cressy, P. J.↗