SEARCH · Search NASA

Results for “Assessments”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10

All sources NASA NTRS DOE OSTI

DOE OSTI2021

Developing Technology Performance Level Assessments for Early-Stage Wave Energy Converter Technologies: Preprint

The advantage of using Technology Performance Level (TPL) in conjunction with Technology Readiness Level (TRL) assessments in guiding technology development trajectories to successful outcomes in less time, at less overall cost, and with less encountered risk has been well articulated in the literature. In partnership with industry and international collaborators, a TPL assessment methodology for grid-connected applications has been developed through the application of the systems engineering approach. Metrics under seven different categories have been developed, weighted based on their relative relevance, and combined to yield a composite score. The methodology has been implemented in a spreadsheet tool plus a web application specifically aimed at assessing early stage (TRL 1-3) concepts. The target use cases are (a) technology developers improving their design, to find fatal flaws early, to get feedback on current design, to identify areas of improvement that will yield the highest return on investment, (b) reviewers assessing technologies in competitions or for making funding decisions, (c) investor or project developer doing due diligence, (d) policy makers landscaping the technology domain for formulating R&D strategy. The methodology and the tools are undergoing continuous improvement based on the experience and lessons learnt from applying it to internal and external marine energy technology development projects. The methodology is also being adapted for assessing WECs servicing markets outside the continental grid - broadly categorized as Powering the Blue Economy (PBE) applications. Such applications have vastly different functional requirements entailing a modification of the methodology to account for their higher risk tolerance, reduced price sensitivities, lower power needs, different permitting protocols, etc. This paper presents the latest status of the TPL assessment methodology and tools, describes its adaptation to select PBE markets, and explores its extension to other domains where it could provide a comprehensive and holistic measure of a nascent or disruptive technology's technoeconomic performance potential.

metrics↗

DOE OSTI2021

Developing Technology Performance Level Assessments for Early-Stage Wave Energy Converter Technologies

metrics↗

DOE OSTI2022

Dynamic risk assessment for geologic CO 2 sequestration

At a geologic CO 2 sequestration (GCS) site, geologic uncertainty usually leads to large uncertainty in the predictions of properties that influence metrics for leakage risk assessment, such as CO 2 saturations and pressures in potentially leaky wellbores, CO 2 /brine leakage rates, and leakage consequences such as changes in drinking water quality in groundwater aquifers. The large uncertainty in these risk-related system properties and risk metrics can lead to over-conservative risk management decisions to ensure safe operations of GCS sites. The objective of this work is to develop a novel approach based on dynamic risk assessment to effectively reduce the uncertainty in the predicted risk-related system properties and risk metrics. We demonstrate our framework for dynamic risk assessment on two case studies: a 3D synthetic example and a synthetic field example based on the Rock Springs Uplift (RSU) storage site in Wyoming, USA. Results show that the U.S. National Risk Assessment Partnership’s Open Source Integrated Assessment Model (NRAP-Open-IAM) coupled with a conformance evaluation can be used to effectively quantify and reduce the uncertainty in the predictions of risk-related system properties and risk metrics in GCS.

58 GEOSCIENCES↗

DOE OSTI2023

A Geo-Data Science Method for Assessing Unconventional Rare-Earth Element Resources in Sedimentary Systems

Abstract Rare-earth elements (REEs) supply raw materials that constitute many of our modern critical infrastructure, defense, technology, and electrification needs. Despite REE accumulations occurring in conventional bedrock and ion-adsorption deposits sourced from weathering of igneous rocks, unconventional host materials such as coal and related sedimentary strata have been identified as promising sources of REEs to meet growing demand. To maximize the potential of unconventional resources such as REE-coal systems, new approaches are needed overcome challenges from mineral systems with no known deposits and areas with sparse geochemical data. This article presents a systematic knowledge-data resource assessment method for predicting and identifying REE resource potential and occurrence in these unconventional systems. The method utilizes a geologic and geospatial knowledge-data approach informed and guided by REE accumulation mechanisms to systematically assess and identify areas of higher enrichment. An assessment of the Powder River Basin is presented as a test case to demonstrate the method workflow and results. The key output is a potential enrichment score map reported with varying confidence levels based on the amount of supporting evidence. Results from the test case indicate several locations with promising potential for different types of coal-REE deposits, demonstrating the viability of the method for exploration and assessment of unconventional REE resources. The method is flexible by design and, with sufficient applicable knowledge and data, can be adapted for assessing critical mineral systems in other sedimentary systems as well.

58 GEOSCIENCES↗

DOE OSTI2020

After the hurricane: Validating a resilience assessment methodology

With increasing utility grid outages in the United States, there is growing interest in assessing risk and developing mitigation strategies to reduce the impact of grid outages. Working with the U.S. Air Force, the U.S. Department of Energy's National Renewable Energy Laboratory (NREL) developed a replicable energy resilience assessment methodology and investment decision tool to: (1) identify and score hazards and vulnerabilities at the site level; (2) analyze risks to energy infrastructure; and (3) identify and prioritize energy resilience investments. This work improves on existing resilience assessment methodologies and tools by combining a bottom-up, all-hazards assessment methodology with top-down geographic information system mapping capabilities to provide an innovative, dynamic tool for identifying and prioritizing actionable solutions. This process combines probabilistic forecasting with an iterative approach for continuously updating and reassessing risks to address temporal dynamism. Relationships among systems are modeled and visualized to estimate the effectiveness of resilience actions across multiple interdependent systems and inform financial priorities through cost-difficulty-impact trade-offs. The approach is validated in a case study at Tyndall Air Force Base (AFB) in Florida, which experienced a Category 5 hurricane in 2018. The risks and mitigation strategies identified pre-hurricane are compared with post-hurricane, realized impacts. The assessment effectively identifies risks and actions to increase site energy resilience, but the methodology can be enhanced though greater consideration of the interdependencies between the energy system and related systems like transportation, communication, and food/water systems, which impact the recovery of the energy system and the base.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2023

Integrating risk assessment methods for carbon storage: A case study for the quest carbon capture and storage facility

This paper documents how tools developed by the National Risk Assessment Partnership (NRAP) complement the Bowtie risk assessment approach through the demonstration of a risk-based Area of Review (AoR) determination for the Quest Carbon Capture and Storage (CCS) facility near Edmonton, Alberta with the NRAP Open-Source Integrated Assessment Model (NRAP Open-IAM). The Bowtie risk assessment for the Quest CCS site was developed by Shell Canada Ltd., who operates the asset on behalf of the Athabasca Oil Sand Project — a joint venture, owned by Canadian Natural Resources Ltd, Chevron Canada and Shell Canada Ltd. The Quest Bowtie treats site risk comprehensively – considering a large set of technical and project risks (e.g., operational risks, above ground infrastructure, public perception, etc.). NRAP tools, methods, and analyses are focused on quantitative assessment of subsurface technical risks. NRAP-Open-IAM was used to evaluate potential groundwater impacts at the Quest site, i.e., a sufficient change above background groundwater quality levels to be measurable, should CO 2 and/or brine leak from the reservoir via a faulty and/or compromised wellbore. Our results show there is a low potential for groundwater impact and support a further reduction (from ~460 to 100 km 2 ) to the established AoR for the Quest site. Integrating both approaches early in the site characterization period could significantly benefit commercial-scale projects by drastically reducing the region over which leakage risks (e.g., legacy wells) need to be evaluated, i.e., the AoR. This is especially true for brownfield sites, which could contain hundreds to thousands of legacy wells. Further, basing monitoring network design on those regions where impacts are most likely to occur has the potential to facilitate more efficient deployment of monitoring technologies and improve the likelihood of detecting a leak should one occur.

58 GEOSCIENCES↗

DOE OSTI2026

A rapid embodied carbon assessment tool for priority materials

Embodied carbon limits within building materials are a driving factor in global trade, generating new research and analysis tools in industry. These product assessments, which require utilizing life-cycle assessment (LCA) across broad supply chains, can be expensive, time and data-intensive, and subject to significant variations. Existing methods and tools, such as specific environmental product declarations, typically do not capture these variations and dynamics in supply and manufacturing. Moreover, models and tools must enable stakeholders to assess customized supply chains and future scenarios. In this study, we present the Rapid Embodied Carbon Assessment and Target-setting for Emissions-intensive Materials (REDuCE) tool for building materials. We developed a tool that allows users to select production technologies, transportation mode and distances, concrete carbonation, fuel sources, and regional electricity mixes to supply customization for cement and concrete produced and consumed in California. We generated and integrated a material demand model using residential building stock projections. We provide the user with a wide range of mitigation alternatives through low-carbon production pathways, material use efficiency, transportation modes, and projected electricity grid mixes. In a case study application through four mitigation scenarios, we find emission savings up to 80% by maximizing user mitigation alternatives, primarily driven by reductions in material use intensities. This work represents a foundation for expanding LCA and embodied carbon tools to better enable stakeholders to rapidly and accurately assess customized supply chains while meeting trade requirements.

building materials↗

DOE OSTI2023

Robust Power System Stability Assessment Against Adversarial Machine Learning-Based Cyberattacks via Online Purification

The increasing complexity associated with renewable generation brings more challenges to power system stability assessment (SA). Data-driven approaches based on machine learning (ML) techniques for stability assessment have received significant research interest and shown their promising performance. However, ML-based models are recognized to be vulnerable to adversarial disturbances, where a slight perturbation to power system measurements could lead to unacceptable errors. To address this issue, this paper develops a novel lightweight mitigation strategy, i.e., robust online stability assessment (ROSA), to enhance the ML-based assessment model against both white-box and the black-box adversarial disturbances (i.e., purification) in the online implementation. The ROSA involves a supervised learning-based module for the primary stability assessment and a self-supervised learning-based module. Further, the two modules are trained jointly with different objective (loss) functions and implemented in sequence. A suitable purification objective and various time-series data augmentation methods are designed for SA applications to tackle adversarial disturbances adaptively. Case studies are performed, and the comparative results have clearly illustrated the competitive, robust accuracy against various adversarial scenarios and verified the effectiveness of the proposed online purification strategy.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2024

An Integrated Framework for Risk Assessment of Safety-related Digital Instrumentation and Control Systems in Nuclear Power Plants: Methodology Advancement and Application

This report documents activities performed by Idaho National Laboratory (INL) during fiscal year (FY) 2024 for the U.S. Department of Energy (DOE) Light Water Reactor Sustainability (LWRS) Program, Risk Informed Systems Analysis (RISA) Pathway, Digital Instrumentation and Control (DI&C) Risk Assessment project. The goal of the RISA Pathway is to optimize safety margins and minimize uncertainties to achieve economic efficiencies while maintaining high levels of safety. This is accomplished by providing scientific basis to better represent safety margins and factors that contribute to cost and safety, and by developing new technologies that reduce operating costs. The research efforts for FY 2024 encompass methodology refinement and exploration. The efforts include: (1) The implementation of a natural language processing tool to expedite key aspects of the reliability analysis methods developed by INL; (2) advances to support intersystem CCF analysis by providing guidance for and identification of coupling mechanisms that may contribute to CCF; (3) the investigation of how generative artificial intelligence tools can aid in hazard analysis and diversity and defense in depth (i.e., D3) assessments; (4) Industry collaboration, allowing the demonstration of and INL's risk assessment tools to support risk assessment of DI&C systems at early and late stages of development; (4) a roadmap for the development of a software for each of INL's risk assessment tools; (5) The development of a theory and methodology manual for a risk quantification methodology; (6) the development of a reliability analysis for machine learning (ML)-integrated control systems.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

DOE OSTI2024

Large-scale Hydrogen Storage Risk Assessment

This project investigated risks involved in deploying a large-scale hydrogen storage system at the Port of Seattle (hereafter, the Port) for its on-terminal and maritime applications in an urban industrial setting. Alongside, the project attempted to address some of the barriers to risk assessment such as need for an exact system design for a systematic investigation, direct access to surrounding communities to gauge their perceptions, and an integrated software required to undertake a full-fledged risk assessment. These barriers were overcome using illustrative reference station designs, engaging with community-facing agencies through Port support, and pooling national laboratory capabilities available for risk assessments. The project identified relevant public safety risk metrics, compared various hydrogen carriers, engaged with community-facing agencies, and explored potential gaps in existing safety codes and standards. The primary impacts of this project include the development of risk assessment guidance for ports and utilities, informing them of the trade-offs in the choice of hydrogen carriers, and the ability to increase public capacity for dialog and engagement. This paves the way toward decarbonization of the Port activities, bringing about awareness around jobs in the market for risk assessments, and the need to ramp up community engagement long before any hydrogen system deployment is undertaken.

08 HYDROGEN↗

DOE OSTI2020

A Review on Artificial Intelligence (AI) for Stability Assessment: Preprint

Artificial intelligence provides a convenient route for power grid stability assessment. Compared with simulation-based approaches, artificial intelligence can potentially save time on model development and numerical computation in stability assessment. This paper first reviewed existing literature on using artificial intelligence for power grid stability assessment. Then a machine-leaning-based tool is presented and developed to assess power grid transient stability, frequency stability, and small-signal stability. Test results verified the accuracy and effectiveness of the artificial intelligence tool for power grid stability assessment.

artificial intelligence↗

DOE OSTI2021

Supporting the Transition from Grid-Scale to Emerging Market Wave Energy Converter Design and Assessment

In the past decade there has been increasing interest in emerging markets for wave energy, both as a stepping stone for development and as a way to create new opportunities for offshore markets such as ocean observation or desalination. Developers who were once focused exclusively on grid-scale development have begun to engage with more unique markets. This has led researchers to begin examining means of assessing emerging-market devices. In this paper, we analyze the Technology Performance Level (TPL) Assessment for its potential use in the assessment of emerging market wave energy converters (EM-WECs). We use Quality Function Deployment (QFD) and a question-by-question analysis of the TPL assessment to determine the changes necessary for such an assessment to be applicable in emerging markets. We discuss how the primary differences between the markets could impact the viable development pathways for developers hoping to succeed in multiple markets. We determine that the different stakeholders and stakeholder requirements of some emerging markets compared to gridscale applications should be met with changes to cost-toperformance metrics, prototype testing processes, recovery planning, materials selection, optimization objectives, and public engagement.

blue economy↗

DOE OSTI2022

Revisiting Current Paradigms: Subject Matter Expert Views on High Consequence Facility Security Assessments

Security assessments support decision-makers' ability to evaluate current capabilities of high consequence facilities (HCF) to respond to possible attacks. However, increasing complexity of today's operational environment requires a critical review of traditional approaches to ensure that implemented assessments are providing relevant and timely insights into security of HCFs. Using interviews and focus groups with diverse subject matter experts (SMEs), this study evaluated the current state of security assessments and identified opportunities to achieve a more "ideal" state. The SME-based data underscored the value of a systems approach for understanding the impacts of changing operational designs and contexts (as well as cultural influences) on security to address methodological shortcomings of traditional assessment processes. These findings can be used to inform the development of new approaches to HCF security assessments that are able to more accurately reflect changing operational environments and effectively mitigate concerns arising from new adversary capabilities.

36 MATERIALS SCIENCE↗

DOE OSTI2023

A Comprehensive Assessment Tool for Low-TRL Current Energy Converters: Preprint

Along with a market-competitive levelized cost of energy, a current energy converter technology strongly benefits from an extensive consideration of socioeconomic, environmental, and regulatory factors early in the design process. As part of a technology performance level assessment, a series of assessment questions and guidance are developed and presented to evaluate an early-stage current energy technology on holistic criteria considering the entire device lifecycle. The assessment represents an accumulation of industry and research experience to date and relies on regular updates to ensure alignment with industry best-practices, regulatory requirements, and up-to-date technical understanding. A cradle-to-grave (materials, manufacturing, installation and deployment, operations and maintenance, and end-of-life) assessment of capabilities and functional requirements for tidal, river, and ocean current technologies has been completed. This work presents the evaluation questions and qualitative performance criteria for current energy converters deployed in tidal, ocean current, and/or river applications. Key considerations related to manufacturing and installation include supply chain robustness, manufacturability and related job creation in the end-user and/or adjacent communities, and the time-to-repayment of the embodied energy debt. During deployment and maintenance operations, the safety of the device and subsystems during disconnect or grid failure, the difficulty and frequency of offshore heavy-lift activities, the avoidance or mitigation of area use conflicts, the sea-states and weather conditions that permit maintenance access, and the availability of contingency plans (should conditions change unexpectedly) are a portion of the considered assessment criteria. Results include the potential impact of early-stage design decisions on the socioeconomic, environmental, and regulatory performance of a technology that allows developers to increase the product value and probability of success, and minimize costly late-stage design iterations through early and broad consideration of factors affecting overall performance and acceptability.

industry support↗

DOE OSTI2025

Multi-agent AI collaboration for digital twin development and assessment

Developing a digital twin (DT) model involves different steps that encompass formulating requirements, model development, implementation, and assessment with respect to real applications. Human expertise is required to coordinate and implement different steps in the DT development and assessment process. However, certain parts of this process can be automated using artificial intelligence (AI) agents for efficient workflow development. In this work, we test and analyze a multiagent AI collaboration with humans in the loop to automate different elements of the DT development and assessment process. To implement the workflow for multiagent AI DT development and assessment, we use Autogen, a multiagent framework developed by Microsoft. Autogen offers a modular and flexible framework for configuring and designing task-specific multiagent workflows. In this framework, large language models (LLMs) form the core intelligence of the AI agents where the quality and performance of the automated element is governed by the inherent capabilities and knowledge base of the LLM. We use retrieval augmented generation to supplement the LLM with relevant domain-specific information for DT requirement formulation. We illustrate this multiagent workflow using a case study on a thermal energy storage system, focusing on how AI agents can collaborate with humans to expedite and optimize different elements of DT development and assessment process.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗

DOE OSTI2022

Adapting the Technology Performance Level Integrated Assessment Framework to Low-TRL Technologies Within the Carbon Capture, Utilization, and Storage Industry, Part I

With the urgent need to mitigate climate change and rising global temperatures, technological solutions that reduce atmospheric CO 2 are an increasingly important part of the global solution. As a result, the nascent carbon capture, utilization, and storage (CCUS) industry is rapidly growing with a plethora of new technologies in many different sectors. There is a need to holistically evaluate these new technologies in a standardized and consistent manner to determine which technologies will be the most successful and competitive in the global marketplace to achieve decarbonization targets. Life cycle assessment (LCA) and techno-economic assessment (TEA) have been employed as rigorous methodologies for quantitatively measuring a technology's environmental impacts and techno-economic performance, respectively. However, these metrics evaluate a technology's performance in only three dimensions and do not directly incorporate stakeholder needs and values. In addition, technology developers frequently encounter trade-offs during design that increase one metric at the expense of the other. The technology performance level (TPL) combined indicator provides a comprehensive and holistic assessment of an emerging technology's potential, which is described by its techno-economic performance, environmental impacts, social impacts, safety considerations, market/deployability opportunities, use integration impacts, and general risks. TPL incorporates TEA and LCA outputs and quantifies the trade-offs between them directly using stakeholder feedback and requirements. In this article, the TPL methodology is being adapted from the marine energy domain to the CCUS domain. Adapted metrics and definitions, a stakeholder analysis, and a detailed foundation-based application of the systems engineering approach to CCUS are presented. The TPL assessment framework is couched within the internationally standardized LCA framework to improve technical rigor and acceptance. It is demonstrated how stakeholder needs and values can be directly incorporated, how LCA and TEA metrics can be balanced, and how other dimensions (listed earlier) can be integrated into a single metric that measures a technology's potential.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

DOE OSTI2022

Adapting Technology Learning Curves for Prospective Techno-Economic and Life Cycle Assessments of Emerging Carbon Capture and Utilization Pathways

Comparisons of emerging carbon capture and utilization (CCU) technologies with equivalent incumbent technologies are necessary to support technology developers and to help policy-makers design appropriate long-term incentives to mitigate climate change through the deployment of CCU. In particular, early-stage CCU technologies must prove their economic viability and environmental reduction potential compared to already-deployed technologies. These comparisons can be misleading, as emerging technologies typically experience a drastic increase in performance and decrease in cost and greenhouse gas emissions as they develop from research to mass-market deployment due to various forms of learning. These changes complicate the interpretation of early techno-economic assessments (TEAs) and life cycle assessments (LCAs) of emerging CCU technologies. The effects of learning over time or cumulative production themselves can be quantitatively described using technology learning curves (TLCs). While learning curve approaches have been developed for various technologies, a harmonized methodology for using TLCs in TEA and LCA for CCU in particular is required. To address this, we describe a methodology that incorporates TLCs into TEA and LCA to forecast the environmental and economic performance of emerging CCU technologies. This methodology is based on both an evaluation of the state of the art of learning curve assessment and a literature review of TLC approaches developed in various manufacturing and energy generation sectors. Additionally, we demonstrate how to implement this methodology using a case study on a CO 2 mineralization pathway. Finally, commentary is provided on how researchers, technology developers, and LCA and TEA practitioners can advance the use of TLCs to allow for consistent, high-resolution modeling of technological learning for CCU going forward and enable holistic assessments and fairer comparisons with other climate technologies.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

DOE OSTI2023

Availability of state-level climate change projection resources for use in site-level risk assessment

In recent years, incorporating climate change considerations has become an important focus of organizations’ resilience planning and risk assessment efforts, including United States federal agencies. This has led to an increasing demand for higher-resolution and higher-quality climate projection information that is easy to understand for non-expert users. In particular, there is a demand for information about how climate change may affect high-impact, low-frequency (HILF) hazards that are central to risk assessments focused on infrastructure. While national-level resources like the National Climate Assessment provide information on climate impacts for different sectors and regions in the United States, downscaled information with location-specific context is often required for site-level resilience planning. As higher-resolution and higher-quality climate resources continue to be developed at the state level, it is imperative to understand ongoing and planned efforts, as well as key drivers for developing these state-level resources. Based primarily on stakeholder input from climate experts from 31 states, we identify key state-level climate resources, as well as drivers accelerating the development of these resources. We assess the availability of climate change resources, specifically those with information about HILF events that have been developed at the state level and can support users in conducting site-level resilience planning. We identify three key drivers or predictors for the development of climate change resources at the state level: (1) existence of state laws, mandates, Executive Orders, and other state policies, (2) existence of university partnerships; and (3) the makeup of the stakeholder groups (in terms of dominant discipline/expertise) participating in the effort. The diverse state strategies and resources surveyed in this study could support the incorporation of higher-resolution climate information into site-level planning.

54 ENVIRONMENTAL SCIENCES↗