Search NASA⌕ Search

SEARCH · Search NASA

Results for “Assessment Methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

Validation of an Erythema-Weighted UV Model Using Broadband Solar Irradiance Measurements From Eleven U.S. Sites: Preprint

Erythema-weighted UV solar irradiance (UV-E) has a potential impact on human health if the recommended maximum exposure times are exceeded. In spite of this, it is not measured at most sites that measure Global Horizontal Irradiance (GHI). However, since UV-E is highly correlated with GHI and total ozone content it can be estimated from this information with sufficient accuracy to assisst in public health recommendations. The Power Model (PM) provides a simple method to estimate the erythema-weighted UV irradiance (UV-E) from measured GHI, total ozone column and air mass. In this work, the performance of the PM method is assessed using high-quality data from 11 sites in the continental U.S. (part of SURFRAD and SOLRAD networks) and total ozone estimates publicly available from the MERRA-2 re-analysis database. A three year period (2021- 2023) at 1-minute frequency is considered. The results (for time aggregations of 5 and 60 minutes) show a high Pearson's correlations (> 0.99), consistently positive mean bias deviations (below 13%) and dispersions in the 8-19% range at all sites. Relative values are expressed in terms of the corresponding measurement mean. The performance indicators remain consistent across time resolutions (5 or 60 minutes), suggesting that the model's performance is robust and not significantly affected by short-term variability (which is captured by GHI). Spatial patterns reveal higher biases and RMSD in northern and eastern locations. These values represent a significant improvement over widely used satellite-based global UV-E estimates and open the possibility of using the PM with satellite-based GHI estimates for operational UV-E mapping over the contiguous U.S. territory.

14 SOLAR ENERGY↗

A Benchmarking Framework for Evaluating Large Language Model Capabilities in Nuclear Reactor Safety Applications

Large language models (LLMs) are increasingly capable of answering technical questions, synthesizing domain knowledge, and supporting engineering workflows. For nuclear science and engineering, these capabilities require careful, domain-specific evaluation before they can be credibly incorporated into safety-related activities, regulatory review, or technical decision support. This paper presents preliminary results from benchmarking framework for evaluating LLM capabilities in nuclear contexts. The framework is organized into three evaluation categories: nuclear fundamentals, general dual-use knowledge, and plant specific knowledge. These categories are intended to distinguish general nuclear engineering competence from broader technical reasoning and more context-dependent nuclear knowledge. Initial evaluations focus on nuclear fundamentals using questions representative of the knowledge expected of a nuclear professional engineer. Results indicate that contemporary frontier models perform at a high level and substantially exceed the performance of older model generations, with some models approaching saturation of the current benchmark. These findings suggest both the rapid improvement of LLM capabilities in specialized technical domains and the need for more discriminating evaluation methods. The paper presents the benchmark structure, preliminary model-comparison results, and ongoing work. This work supports development of verifiable, responsible, and safety-conscious methods for assessing AI systems in nuclear engineering applications.

21 - SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLAN↗

Assessment of Heavy-Duty Fueling Methods and Components

Building on the successful commissioning and demonstration of NREL's heavy-duty (HD) fast flow research facility under the Innovating Hydrogen Station's Project, researchers advanced R&D activities to the next phase under a new project titled, Assessment of Heavy-Duty Fueling Methods and Components. This Cooperative Research and Development Agreement (CRADA) is led by NREL in partnership with NextEnergy, Argonne National Laboratory, and Chevron with NextEnergy representing a larger group of industry partners that includes AirLiquide, Hyundai, Nel, Nikola, Shell, and Toyota. The CRADA seeks to develop a comprehensive assessment of HD fuel cell electric vehicle fueling protocols and fueling hardware to understand the effects of fueling protocol architectures on station design, vehicle design, functional safety requirements, and the implications on the total cost of ownership (TCO) and techno economic assessment (TEA).

class 8 truck↗

Success Path Method: Introduction to the Success Path Method Software Tool©

As part of its commitment to advancing safety and reliability assessment methodologies, Argonne National Laboratory pioneered the use of an evaluation method called the Success Path Method (SPM) to improve risk management for offshore oil and gas operations. The development of the SPM at Argonne has been driven by the need to improve existing risk assessment methodologies by focusing on the steps necessary for success rather than failure modes alone. This is particularly important for industrial environments like offshore facilities that perform multiple functions under a continuously evolving set of operational conditions – such as water depth and temperature, currents, and weather conditions. In these dynamic environments, the traditional Probabilistic Risk Assessment (PRA) approach is far too complex as it focuses on what can go wrong – which comprises an infinite failure space that must be fully explored and understood. By shifting the focus to a finite space of success paths, the SPM enables operators and decision makers to prioritize a manageable number of steps that must go right to ensure success. Building on its five decades of experience in safety assessments for the nuclear industry, Argonne made major adaptations to existing risk assessment methods utilizing features similar to fault trees that are traditionally used in PRA to map all pathways in which the system can malfunction. In contrast, SPM identifies the components and processes that must function correctly to achieve specific outcomes – such as preventing the uncontrolled release of hydrocarbons during drilling operations. The SPM framework integrates equipment, procedures, software, processes, and human actions to ensure that physical barriers meet critical safety functions in dynamic operational conditions. This approach helps identify failure modes and improve operational risk management by narrowing the focus to key success elements, which in turn reduces uncertainty and helps users understand, manage, and respond to failures.

97 MATHEMATICS AND COMPUTING↗

Accuracy-Based Annotation Quality Score (ABAQS) v1.0

Assessing genome annotation quality is crucial for downstream analyses, but current methods are inadequate for eukaryotes. We present Accuracy-Based Annotation Quality Score (ABAQS), a novel, minimal-data-driven method that comprehensively assesses annotation quality. ABAQS evaluates multiple factors, including genome completeness, gene model validity, and protein profile accuracy, outperforming other metrics like BUSCO and PSAURON. We applied ABAQS to over 2500 eukaryotic genomes and showed its robustness and effectiveness in evaluating genome annotation quality, making it a valuable tool for researchers working with genomic data. ABAQS reveals significant variation in annotation quality and highlights the importance of filtering in improving annotation quality and accuracy.

Haridas, Sajeet [Lawrence Berkeley National Labora↗

A Refined Method to Translate Solar Data Quality Assessment Flags to Estimated Measurement Uncertainty

Integrating solar resource uncertainties due to radiometer measurement performance and operational data quality assessment can provide improved estimates of economic bankability, system design performance, and compliance of solar energy conversion systems. Estimating radiometer measurement uncertainty is an established procedure consistent with recognized best practices and international guidelines. SERI QC is a robust solar data quality assessment software tool that has been in continuous use for more than three decades. This report, the fourth of six for the Data Quality and Uncertainty Integration Project, presents a refined algorithm description for software to translate solar resource data quality assessment results into estimated uncertainty values in a Solar Resource Operational Uncertainty Integrator (SROUI) application. This algorithm requires three-component solar irradiance measurements - global horizontal irradiance, direct normal irradiance, and diffuse horizontal irradiance - collected at 1- to 60-minute intervals, as described in the previous deliverables. The development of this report as Deliverable 6.4 was an iterative process that included reviews and feedback from the project team on initial drafts designed to refine how the new software could best support determining solar resource data uncertainty. The results of this effort will contribute to the final software system development by National Renewable Energy Laboratory staff.

14 SOLAR ENERGY↗

Environmental Durability Assessment and Development of Subcomponent Test Methods for Advanced Materials in Marine Energy Applications

Marine energy developers are beginning to rely more heavily on advanced composite materials for their load-bearing structures. Understanding how these materials respond and degrade in harsh marine environments is a complex problem. Much research has been performed at smaller laboratory scales to understand the fundamental physical and chemical degradation mechanisms, but little structural testing research has been performed at larger scales to understand how these physical and chemical interactions scale and how they should be accounted for in the design process. The Advanced Materials project is a multilaboratory research collaboration that addresses these issues with the intention of reducing risks and barriers to marine energy developers wanting to adopt advanced composite materials. The National Laboratory of the Rockies has been playing a leading role in developing larger-scale testing infrastructure and test methods to validate complex numerical degradation models and standardize testing procedures to do so. This paper reviews past structural testing activities, how they have grown into current research activities, and how they will continue to evolve to directly address industry needs. This paper covers key research areas - large-scale water absorption and subsequent structural validation testing, qualification of bolted and adhesive connections, and combined submerged fatigue testing at increasing scales. It provides insights into the complex requirements for testing infrastructure and test method development to effectively qualify materials and certify marine energy structures for harsh marine environments. This research program paves the way for better guidance and standardization within the industry when adopting advanced composite materials.

16 TIDAL AND WAVE POWER↗

Environmental Durability Assessment and Development of Subcomponent Test Methods for Advanced Materials in Marine Energy Applications: Preprint

Marine energy developers are beginning to rely more heavily on advanced composite materials for their load bearing structures. Understanding how these materials respond and degrade in harsh marine environments is a complex problem. Much research has been performed at smaller laboratory scales to understand the fundamental physical and chemical degradation mechanisms, but little structural testing research has been performed at larger scales to understand how these physical and chemical interactions scale and how they should be accounted for in the design process. The Advanced Materials project is a multilaboratory research collaboration that has been addressing these issues with the intention of reducing risks and barriers to marine energy developers wanting to adopt advanced composite materials. The National Laboratory of the Rockies has been playing a leading role in developing larger scale testing infrastructure and test methods to validate complex numerical degradation models and standardize testing procedures to do so. This paper provides a review of past structural testing activities and how they have grown into current research activities and will continue to evolve into the future to directly address industry needs. This paper covers key research areas large-scale water absorption and subsequent structural validation testing, qualification of bolted and adhesive connections, and conducting combined submerged fatigue testing at increasing scales. This paper provides insights into the complex requirements for testing infrastructure and test method development to effectively qualify materials and certify marine energy structures for harsh marine environments. This research program paves the way for better guidance and standardization within the industry when adopting advanced composite materials.

16 TIDAL AND WAVE POWER↗

Application of Electrochemical Methods to Molten Salt Reactors: Draft TLR Documenting Assessment of Electrochemical Monitoring

Nuclear Regulatory Commission (NRC) is developing the regulatory framework and technical expertise to support regulatory review of advanced non-water reactors, including molten salt reactors (MSRs). In an MSR, it is essential that the salt chemistry be maintained in a desired range in terms of redox potential for reliable operation and mitigation of corrosion to structural materials in the reactor, particularly the reactor vessel and heater exchanger. Measuring the redox potential of the salt in the reactor would also allow for the material lifetimes to be predicted more accurately, and chemical issues to be diagnosed more quickly. In addition to the chemical composition analysis by ICP-MS, electrochemical methods including potentiometry and linear wave scanning (LSC) were also used in molten salt reactor experiment (MSRE) for redox potential monitoring purposes. Electrochemcial methods offers unique advantages such as quick turnaround in results and unique capability of in-line monitoring of redox potential, and are considered popular electroanalytical techniques that can be used to monitor redox potentials and salt chemistry including impurities. The last two decades have seen significant advances in science and engineering of electrochemical methods for potential application to molten salts. The primary goal of this report is to assist NRC in understanding the monitoring of the salt chemistry by electrochemical methods and provide NRC reviewers with necessary information and tools to support regulatory review of MSR designs. This reports consists of two majors parts—Part 1, chemical potential of molten salts and effects by fission process in MSR; Part 2, assessment of electrochemical methods for application to MSRs. The TRLs of the typical relevant electrochemical methods for molten salts were evaluated based on the DOE TRL guidelines and upon a review of the current status of the electrochemical methods for two typical salt systems, fluoride and chloride, for MSRs.

11 - NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Probabilistic inference in very large universes

Our current favored cosmological theories allow for the striking and controversial possibility that the observable universe is just a small part of a much larger universe in which parameters that describe the effective, low-energy laws of physics vary from one region to another. The controversy is largely driven by the fact that such a “very large universe” is mostly observationally inaccessible to us, so the issue arises of how we can reasonably assess a theory that describes such a universe. In this paper, we propose a Bayesian method for theory assessment based on theory-generated probability distributions for our observations. We focus on the principles that define this method, leaving aside concerns about how, in practice, one would carry out the required calculations. (One important issue that we set aside is the measure problem.) We argue that cosmological theories can be tested by the standard method of Bayesian updating, but we need to use theoretical predictions for “first-person” probabilities—that is, probabilities that we should use for our observations, taking into account all relevant selection effects. These selection effects can vary from one observer to another and can vary with time, so, in principle, first-person probabilities are defined for each observer instant—an observer at a specific instant of time. Calculations of first-person probabilities should take into account everything that the observer believes about herself and her surroundings, which we refer to as her subjective state. If the universe is very large, a theory might predict that there are many observer instants in the same subjective state; we argue that first-person probabilities should be calculated using a principle of self-locating indifference (PSLI), the assumption that any real observer should make predictions for her future as if she were chosen randomly and uniformly from the theoretically predicted observer instants that share her subjective state. We believe the PSLI is intuitively very reasonable, but we also argue that, if the theory is correct, the use of this principle maximizes the expected fraction of observers who will make correct predictions. A further complication is that cosmological theories are not expected to fully predict the detailed properties of the universe, but rather will predict a set of possible universes, each with a probability. Different possible universes will generically have different numbers of observers. We argue that, in the calculation of first-person probabilities, the probability for each possible universe should be weighted by the number of observer instants in the specified subjective state that it contains. These issues have been controversial in the literature, so we also provide a rebuttal to the claim that principles like the PSLI involve a “selection fallacy”; a rebuttal to what we dub the principle of required certainty; an argument rejecting theories that predict a preponderance of Boltzmann brains; a rebuttal to a parable about humans and Jovians used by Hartle and Srednicki to argue that assumptions of typicality can lead to absurd consequences; and, finally, a discussion about how the use of “old evidence” can be fit into a Bayesian mold.

Azhar, Feraz [University of Notre Dame, IN (United↗

Assessment of Accelerated Stress Testing Data for Silicon Photovoltaics Using Tensor Decomposition Methods

The photovoltaic (PV) industry is simultaneously targeting long warranties and new materials/designs for high-energy-yield modules, requiring an advanced methodology to forecast long-term durability of products with un-proven materials combinations. Extended, sequential, and combined stress testing methods are gaining popularity for assessing durability of PV modules/materials beyond the early-stage mortalities. Importantly, multiple degradation mechanisms can proceed simultaneously, and their separate contributions to the overall power loss should ideally be quantified. This work examines the use of data-driven tools towards developing a strategy for faster learning cycles in accelerated stress testing.

accelerated stress testing↗

Assessing thermal comfort and participation in residential demand flexibility programs

Residential space-conditioning-based demand flexibility (DF) has become an increasingly sought-after method for demand-side load management to enhance grid reliability and facilitate integration of renewable energy generation. However, predicting the effectiveness and flexibility of residential DF resources is challenging due to the variability in household energy use behaviors. Current estimates show that only 50 % of projected savings from DF resources are actualized due to regulatory, technological, and social barriers. From a household perspective, concerns over thermal comfort during space conditioning-based DF events significantly impact participation decisions. Currently, there is a very limited understanding of how thermal comfort during space-conditioning-based DF events in real-world settings impacts household energy use behaviors and, consequently, the success of DF programs in achieving targeted savings. This paper proposes a method to comprehensively assess the thermal comfort implications of DF strategies and presents results of their impacts on DF event participation decisions and demand savings. Here, the proposed method was applied to a heat pump DF field study in Cordova, Alaska. The study’s key findings are: 1) DF event setpoint offsets that maintain indoor operative temperatures between 18 to 22 °C (65 to 71°F) may be preferred in Cordova, Alaska; 2) Household-level thermal comfort is more sensitive to the duration of the DF event than to the degree of temperature offset from baseline conditions; 3) The delayed impact of changes in indoor operative temperature in response to setpoint offsets, both during and after a DF event, influences occupants’ thermal comfort perceptions and willingness to persistently participate in events. The findings from application of the proposed method can help inform future larger-scale occupant-centric DF programs as it can capture information not readily available through utility and device-level energy use data. Thus, it can supplement these sources and help program administrators develop occupant-centric DF strategies, enabling more accurate predictions of participation rates and savings estimates for space-conditioning-based DF programs.

Demand side management↗

Feasibility of carbon foam-based sorbents for the abatement of gaseous mercury and iodine

The U.S. Department of Energy Hanford Site in Washington State is in the process of commissioning the Waste Treatment and Immobilization Plant to process a portion of the 54 million gallons of radioactive and chemical waste from cold war weapon production. Technologies for the capture of volatile species of concern are still being assessed, and new methods and materials are developed as operational and flowsheet mission risks are identified. One such area still being assessed is the abatement efficacy of the Carbon Adsorber units to retain gaseous mercury and 129 I released during processing. It is challenging to predict the mercury chemistry due to the variability of the feed, and different methods/materials are required for the capture of gaseous Hg 0 and Hg II compounds. In this study, the feasibility of using developmental carbon foam (CF) sorbents for the capture of iodine and mercury was assessed using static and dynamic flow testing and compared against a commercially available sorbent, BATII-37. Both CF and CF functionalized with bismuth particles (CF-Bi) chemisorbed iodine, and CF-Bi had similar mercury capture performance to BATII-37 in dynamic flow tests. While species loading concentrations were measurable, limitations in achieving a mass balance prevented a full evaluation of capture efficacy. Nonetheless, the results serve as an important first step in demonstrating the potential for simultaneous iodine and mercury capture.

Hanford site↗

MRCI Subtask 2.4/2.5: Regional/Subregional Analysis and Risk Assessment Final Technical Summary Report

The objective of the Midwest Regional Carbon Initiative (MRCI) project is to implement a collaborative Regional Initiative (RI) to accelerate the deployment of carbon capture, and storage (CCS) in the Midwest-Northeastern quadrant of the United States. This report is a Technical Summary report describing work performed on Tasks 2.4 (Conducting Regional/Subregional Analysis) and 2.5 (Assessing and Managing Risk) during the MRCI project. In Task 2.4, detailed numerical reservoir simulation models were developed for selected carbon storage (CS) systems identified under Task 2.1 (Battelle, 2021a) in the MRCI study area. The objective of Task 2.4 is to demonstrate a dynamic modeling methodology for evaluating the suitability of the (selected) CS systems in the MRCI region for hosting a commercial-scale storage project. In this study, CO2 injectivity was evaluated for different CS systems with an annual injection rate of 1 million metric tonnes (MMT) of CO2 considered as the minimum requirement for a commercial scale project. The objective of Task 2.5 is to assess key risks associated with storing CO2 in the different CS systems across the MRCI region and to demonstrate a method(s) for assessing these risks that may be used by developers of future CO2 storage projects in the region. The risk analysis was limited to evaluating two types of leakage risks (i.e., wellbore leakage, flow across unfractured caprock) at three modeled sites considered in Task 2.4.

MRCI,Report,Summary,Technical Challenges,dynamic m↗

Independent Review of Non-Destructive Assay for the K-25/K-27 D&D Project: November 30-December 3, 2004, Oak Ridge, TN

The DOE with concurrence from the D&D contractor has chartered an assessment of the methods and procedures used to obtain the original NDA results of holdup deposits at the K-25 and K-27 uranium gaseous diffusion facilities in Oak Ridge. The assessment has been performed by an external review team with the participation of the D&D contractor, DOE, and DOE/OR. This document is the final report for the assessment. The DOE provided the charter for this review. The review team spent a week in Oak Ridge attending meetings and participating in discussions with expert contractor staff. Substantial additional input for the review came from numerous written materials, unpublished and published. This final report of observations, findings, and recommendations in areas defined by the charter is based on information from the meetings, discussions, and documents. The assessment of the Review Team is that the DOE/OR and BJC approach in using historical NDA data for the D&D of K-25 and K-27 is appropriate and generally acceptable. Resolving issues, addressing findings, and implementing the recommendations documented in this report will reconcile specific technical concerns.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Comparison Study of Conventional and Adaptive Mesh Refinement in Organic Material Decomposition Models

This study compares conventional mesh refinement techniques, specifically Uniform Mesh Refinement (UMR), with a new Adaptive Mesh Refinement (AMR) method, applied to Organic Material Decomposition (OMD) models. The proposed benefit of AMR is that only areas that require refinement, based on minimizing a specific field gradient, are refined thus decreasing model wall time compared to conventional UMR methods. This work specifically focuses on comparing UMR and AMR methods on decomposing (both No-Flow and Porous-Flow material models) Polymeric Methylene Diisocyanate (PMDI) polyurethane foam. Throughout the work, the geometry increased in complexity to assess the refinement methods performance at varying levels geometric intricacy. While AMR has been shown to work well in a variety of applications, the UMR approach proved to be computationally faster, for many of the geometries and foam decomposition models, than AMR. However, it was observed that at higher levels of refinement, greater than 3 UMR, AMR begins to be computationally better. Additionally, the settings used to perform AMR greatly impact its performance, and lessons learned, in terms of OMD models, are shared. Due to physics involved in material decomposition, specifically the evolution of state variables, these problems don’t fully benefit from the advantages of AMR.

36 MATERIALS SCIENCE↗

Evaluating Technology Adoption Risks in Early-Stage Materials Research

Development of new technologies often begins with fundamental materials science research. Decisions at this stage can shape factors related to the eventual adoption readiness of the technology, such as process scalability or materials availability. Here we present the early-Stage Technology Evaluation for Adoption Risks (STEAR) framework as a method for qualitatively assessing metrics spanning four categories of adoption risks: value proposition, market acceptance, resource maturity, and license to operate. We conduct a case study applying STEAR to different methanol production processes at a range of technology readiness levels and demonstrate how the assessment identifies key challenges related to adoption readiness. Finally, we discuss efforts to expand the applicability and utility of STEAR, including focus group feedback and complementary quantitative analysis methods.

36 MATERIALS SCIENCE↗