Search NASA⌕ Search

SEARCH · Search NASA

Results for “evaluation methodology”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12

Secondary-Source Core Reload Modeling with VERA

The CASL reactor simulation package VERA has been adapted to provide high-fidelity simulation capabilities for modeling source range detector response during subcritical reactor configurations. New features include the activation and shuffling of secondary-source assemblies, use of burned fuel neutron emission data from the ORIGEN depletion solver to the MPACT deterministic neutron transport solver, allowance of user-defined sources in MPACT based on material composition, ability to solve the subcritical source-driven system with neutron multiplication using the MPACT diffusion solver, and transfer of the calculated fission source from MPACT to the continuous-energy Monte Carlo solver Shift for final detector response evaluation using the CADIS methodology for variance reduction. These new capabilities were benchmarked against Watts Bar Unit 1 plant operating data for the first few fuel loading steps and were found to demonstrate excellent agreement with the measured data.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Integrating Data From In Vitro New Approach Methodologies for Developmental Neurotoxicity

Abstract In vivo developmental neurotoxicity (DNT) testing is resource intensive and lacks information on cellular processes affected by chemicals. To address this, DNT new approach methodologies (NAMs) are being evaluated, including: the microelectrode array neuronal network formation assay; and high-content imaging to evaluate proliferation, apoptosis, neurite outgrowth, and synaptogenesis. This work addresses 3 hypotheses: (1) a broad screening battery provides a sensitive marker of DNT bioactivity; (2) selective bioactivity (occurring at noncytotoxic concentrations) may indicate functional processes disrupted; and, (3) a subset of endpoints may optimally classify chemicals with in vivo evidence for DNT. The dataset was comprised of 92 chemicals screened in all 57 assay endpoints sourced from publicly available data, including a set of DNT NAM evaluation chemicals with putative positives (53) and negatives (13). The DNT NAM battery provides a sensitive marker of DNT bioactivity, particularly in cytotoxicity and network connectivity parameters. Hierarchical clustering suggested potency (including cytotoxicity) was important for classifying positive chemicals with high sensitivity (93%) but failed to distinguish patterns of disrupted functional processes. In contrast, clustering of selective values revealed informative patterns of differential activity but demonstrated lower sensitivity (74%). The false negatives were associated with several limitations, such as the maximal concentration tested or gaps in the biology captured by the current battery. This work demonstrates that this multi-dimensional assay suite provides a sensitive biomarker for DNT bioactivity, with selective activity providing possible insight into specific functional processes affected by chemical exposure and a basis for further research.

Carstens, Kelly E.↗

Importance of finite-size corrections for accurate ab initio modeling of carrier capture at semiconductor defects: A case study of substitutional C N in GaN

In ab initio studies of carrier-capture processes in defective semiconductor materials, the single-effective-mode formalism and the static-coupling approximation have become the predominant theoretical approaches for determining carrier-capture coefficients. The single-mode formalism relies on accurate nonequilibrium defect energies obtained from density-functional theory (DFT), where required inputs are a series of configurationally displaced, defect-containing supercells obtained using an interpolative ansatz, and where the DFT outputs are corresponding total energies that have traditionally been postprocessed using a long-established ground-state formulation of finite-size corrections and defect-formation energies. This formulation remains commonly used even though the defects that form a configuration-coordinate (CC) diagram typically exist as structures that are displaced from the ground state. To remedy this inconsistency, Kumagai has recently proposed novel methods for implementing finite-size corrections specifically intended for DFT calculations of the defect energies used to construct CC diagrams and implement the single-mode formalism [Y. Kumagai, Phys. Rev. B 107, L220101 (2023)]. Kumagai's approach builds on the latest finite-size-correction methods introduced to describe vertical charge-state transitions for charge-localizing point defects in semiconductors and insulators [T. Gake et al., Phys. Rev. B 101, 020102 (2020); S. Falletta et al., Phys. Rev. B 102, 041115 (2020)]. The newly identified finite-size artifact treated in these studies is the polarization charge induced on a configurationally frozen defect and its subsequent interaction with a vertical transition in charge state. In this work, we evaluate Kumagai's proposed methodology by applying it in a high-precision DFT study of carrier capture by substitutional C N in GaN, a well-characterized and technologically relevant defect and material. We have rigorously calculated C N defect energies across various supercell sizes for each defect configuration and charge state on the hole-capture CC diagram of C N (𝑞=−1), enabling a direct comparison of the slopes of the defect energies versus inverse cell size with those predicted by Kumagai. The most consequential prediction of Kumagai's method is that these slopes distinctly vary as the square of the linear-interpolation parameter used to construct the nonequilibrium defect configurations. Our results quantitatively support this prediction. Moreover, with these new finite-size corrections and multiple-cell-size DFT calculations in place, we find that the classical energy barrier for hole capture by C N (𝑞=−1) in GaN decreases to 0.092–0.127 eV. This finding confirms the recent ≈ 0.1 eV prediction of Reshchikov based on the weak temperature dependence for hole capture observed in photoluminescence experiments [M. A. Reshchikov, J. Appl. Phys. 129, 121101 (2021)]. These results stand in stark contrast to previously calculated barriers of 0.486 and 0.73 eV, which also used the single-mode formalism but were obtained by instead using ground-state-based finite-size corrections. Our reduced classical barrier for capture increases the temperature-dependent hole-capture coefficient of a C N (𝑞=−1) defect by more than two to four orders of magnitude for temperatures of 100–600 K, compared to the previous 0.486 eV results. While other defects may not be as dramatically affected as here, we suggest that incorporating proper finite-size corrections for the vertical-transition-like states embedded within CC diagrams is an essential, yet previously unrecognized, component of accurate modeling of carrier-capture when using the single-effective-mode formalism.

dielectric properties↗

Improving I/O-aware Workflow Scheduling via Data Flow Characterization and trade-off Analysis

The scientific computing paradigm has transitioned from compute-intensive to I/O-intensive and memory-intensive in the past decade, especially when data-driven science has become common practice. Numerous empirical I/O-aware scheduling optimizations have been developed by incorporating I/O capacity and bandwidth as constraints into scheduling. Unfortunately, there is a lack of data flow (I/O) characterization tool and an understanding of trade-offs between concurrency, locality, and I/O bandwidth. To bridge the gap, this work 1) presents a set of descriptors to characterize, organize, and visualize I/O profiles, including flow size, I/O bandwidth, and operation count, which group data flows by I/O types, tasks, and files; 2) proposes an I/O Roofline model-based trade-off analysis to find the optimal trade-off between flow operational intensity, concurrency, and flow performance. The I/O descriptors generate useful insights into complicated I/O behaviors, suggesting distinct concurrency, storage, and scheduling to be used by types, tasks, and files. The proposed trade-off analysis guides scheduling decisions that generate resource assignment with the best flow parallelism. We evaluate our I/O-aware scheduling methodology on a highly I/O-intensive workflow–1000 Genomes. The experimental results demonstrate speedups of up to 2.4× compared to the state-of-the- art methods.

Guo, Luanzheng [BATTELLE (PACIFIC NW LAB)]↗

Model Form Error Correction for a Black-Box Thermal Battery Heat Transfer Simulation

Thermal batteries are crucial for supplying power to high-consequence engineering applications such as rockets. Computational simulations have been developed to predict thermal battery behavior, but these simulations often suffer from modeling errors, including model form uncertainty. Addressing this uncertainty can be achieved by quantifying either the model discrepancy in the output or the model form error (MFE) in the governing equation. MFE is particularly valuable as it can be better extrapolated beyond observed outputs, which is essential for predictions involving changes in external system loading, system configuration and geometry, or output quantities. This paper employs a state estimation approach to estimate MFE using experimental data and then utilizes machine learning (ML) to model its relationship with state variables. A nonintrusive technique is used to estimate MFE in a black-box thermal battery heat transfer simulation. The trained machine learning model for MFE is then applied to correct simulation predictions under extrapolated initial conditions and battery configurations. In conclusion, the methodology's performance is evaluated using additional experimental data, demonstrating its effectiveness in improving prediction accuracy.

Batteries↗

Mastering HPC Runtime Prediction: From Observing Patterns to a Methodological Approach

The continual expansion of high-performance computing (HPC) brings with it an increasing need for efficiency. Heavy investment in energy, hardware, and software infrastructure to support peta- and exascale computing requires the optimization of existing systems and, wherever possible, the discernment and adoption of best-practices towards these goals. Such is the case for runtime prediction. When a job is submitted to an HPC system, an estimate of its runtime is provided by the user in the form of "requested wallclock". Error in this user-provided estimate can lead to jobs being prematurely killed by the scheduler, increased wait time on the queue, and decreased system utilization. More than fifteen years of research has been directed at mitigating these effects by using data-driven runtime predictions. Codified here is a set of commonalities and insights emerging from this body of work, which we present as recommendations and best practices. These practices are combined into a methodological approach described and evaluated on an 11-million-job dataset from the National Renewable Energy Laboratory's petascale HPC system, Eagle. This dataset and the accompanying codebase have been released to the public domain for the benefit of the wider HPC research community.

high performance computing↗

eLog analysis for accelerators: status and future outlook

This work demonstrates electronic logbook (eLog) systems leveraging modern AI-driven information retrieval capabilities at the accelerator facilities of Fermilab, Jefferson Lab, Lawrence Berkeley National Laboratory (LBNL), SLAC National Accelerator Laboratory. We evaluate contemporary tools and methodologies for information retrieval with Retrieval Augmented Generation (RAGs), focusing on operational insights and integration with existing accelerator control systems. The study addresses challenges and proposes solutions for state-of-the-art eLog analysis through practical implementations, demonstrating applications and limitations. We present a framework for enhancing accelerator facility operations through improved information accessibility and knowledge management, which could potentially lead to more efficient operations.

Accelerator Physics↗

Adapting Existing Energy Planning, Simulation, and Operational Models for Resilience Analysis

Resilience is a topic receiving much attention in relation to energy systems, with particular attention being paid to the supply of electricity. As a result, research communities have proposed a plethora of candidate indicators and metrics for resilience, most of which remain immature at different scales and segments within the energy system. Given the complexity of resilience analyses and mitigation strategies, there is limited value in attempting to identify a single resilience metric, as no one metric can quantify resilience or its associated value for all stakeholders. Instead, a necessary focus of the research community should lie in implementing, testing, and validating resilience metrics and analysis approaches in energy sector models, which will be invaluable for informing resilience planning and investment decisions. Recognizing that implementing, testing, and validating resilience metrics are challenges that need to be addressed, the National Renewable Energy Laboratory (NREL) dedicated staff and time to researching how to effectively integrate resilience considerations into energy sector models and tools, as part of the Laboratory Directed Research and Development (LDRD) program. The overarching goal of the effort was to evaluate the data needs, methodologies, and outcomes - including consequences and/or changes in investment or operational decisions due to avoided consequences - based on resilience analysis in a range of existing tools. In particular, we selected five models originally built at NREL to explore non-resilience energy research questions to implement and exercise resilience metrics and analysis approaches.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Selecting and Implementing Resilience Metrics in Existing Energy Sector Models [Slides]

Resilience is a topic receiving much attention in relation to energy systems, with particular attention being paid to the supply of electricity. As a result of the growing interest in energy sector resilience, research communities have proposed a plethora of candidate resilience indicators and metrics, most of which remain immature at different scales and segments within the energy system. A necessary focus of the research community lies in implementing, testing, and validating resilience metrics and analysis approaches in energy sector models, which will be invaluable for informing resilience planning and investment decisions. Recognizing these challenges that need to be addressed, we explore how to effectively integrate resilience considerations into energy sector models and tools. The overarching goal of the effort was to evaluate the data needs, methodologies, and outcomes - including consequences and/or changes in investment or operational decisions due to avoided consequences - based on resilience analysis in a range of existing tools. In particular, we selected five models originally built at NREL to explore non-resilience energy research questions to implement and exercise resilience metrics and analysis approaches. To demonstrate the importance of perspective, we selected models that represent different segments of the energy sector, geographic scales, and modeling approaches. A second important aspect of our effort was the development of generalized power interruption scenarios. These scenarios were intended to help establish a framework for simulating the effects of real-world threats in terms of their impacts on system components and, in turn, power interruption.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

All-Source Competitive Solicitations: State and Electric Utility Practices

This report provides an overview of principles, practices, and emerging issues in all-source competitive solicitations. It reviews the history of electric utility all-source solicitations and recent results; provides an overview of goals, design tradeoffs, and stages; and examines solicitation design and implementation options and issues, including methodological issues around bid evaluation. The report draws on a review of regulatory documents, resource plans, solicitation materials, independent evaluator reports, and scholarly literature. While the report focuses on solicitations by investor-owned utilities for bulk power system needs, it also briefly discusses solicitations for non-wires alternatives for distribution system needs, as well as nascent practices for integrating both types of procurements.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Post-closure Nuclear Criticality Safety Evaluations for Disposition of Criticality Control Overpacks at the Waste Isolation Pilot Plant

The Waste Isolation Pilot Plant (WIPP) is a geological repository in southern New Mexico that provides for disposal of transuranic (TRU) wastes from atomic energy defense activities. The Sandia National Laboratories (Sandia) Report, Consideration of Nuclear Criticality When Disposing of Transuranic Waste at the Waste Isolation Pilot Plant, addresses nuclear criticality safety based on the projected inventory characteristics for the initial compliance certification application of WIPP in 1996. As the inventory, waste forms, and disposal package designs change, revised or new analyses are necessary to demonstrate acceptability for these configurations within the WIPP safety basis and compliance with 10,000-year post-closure standards of the US Environmental Protection Agency (EPA). Saylor and Scaglione evaluated criticality control overpacks (CCOs) in 2017 based on conservative assumptions for post-closure repository structural conditions with resulting effects on containers and container spacing, The Saylor and Scaglione evaluation of CCOs addressed a single waste configuration that represents the Surplus Plutonium Disposition Program’s dilute and dispose waste form and composition. This initial CCO study demonstrated that 50 grams of boron carbide (B 4 C) per CCO is sufficient to ensure post-closure criticality safety based on a well-mixed waste composition, and Oak Ridge National Laboratory (ORNL) subsequently determined that this amount of B 4 C does not require constraints on moisture or plastic present as moderator. The Saylor and Scaglione analysis conservatively assumes repository room closure that eliminates all space between fissile gram equivalent (FGE) 239 Pu masses. The close-packed array was selected based on limited availability of repository salt creep modeling results at that time. In 2019, Brickner provided additional evaluations for pipe overpack containers (POCs), building on the conservative basis provided by Saylor and Scaglione. Brickner’s 2019 analysis made use of new geomechanical data for post-closure spacing that rely on advances in repository modeling as documented in the work by Reedlunn and Bean. This current CCO evaluation for generic waste materials expands on earlier work performed at ORNL and includes evaluation of CCOs across a much broader range of possible waste compositions and geometries. This evaluation is intended to provide input for the required feature, event and process (FEP) screening to determine if post-closure criticality must be included as an event in the 10,000-year regulatory evaluation. As such, the approach to modeling post-closure criticality presented in this report has been coordinated with the Sandia team responsible for FEP screening. The resulting analysis supports disposition of fissile materials in the CCO containing up to 380 FGE 239 Pu and expands conditions acceptable for disposal of fissile material in CCOs. This evaluation builds on the methodology of Saylor and Scaglione and Brickner, using the most recently available geomechanical data for CCO spacing under salt creep compaction scenarios provided by Reedlunn and Bean. The broad range of fissile material configurations analyzed in this report are intended to account for configurations that may occur during the post-closure disposal time period, and it also includes waste configurations that are not physically possible to support analysis of conditions that influence neutron fluence.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Quantifying Thermal Output of Energetic Materials (LDRD Final Report)

We present the results of an LDRD project, funded by the Nuclear Deterrence IA, to develop capabilities for quantitative assessment of pyrotechnic thermal output. The thermal battery igniter is used as an exemplar system. Experimental methodologies for thermal output evaluation are demonstrated here, which can help designers and engineers better specify pyrotechnic components , provide thermal output guidelines for new formulations, and generate new metrics for assessing component performance and margin given a known failure condition. A heat-transfer analysis confirms that the dominant mode of energy transfer from the pyrotechnic output plume to the heat pellet is conduction via deposition of hot titanium particles. A simple lumped-parameter model of titanium particle heat transfer and a detailed multi-phase model of deposition heat transfer are discussed. Pyrotechnic function, as defined by "go/no-go" standoff testing of a heat pellet, is correlated with experimentally measured igniter plume temperature, titanium metal particle temperature, and energy deposition. Three high-speed thermal diagnostics were developed for this task. A three-color imaging pyrometer, acquiring 100k images per second on three color channels, is deployed for measurement of titanium particle temperatures. Complimentary measurements of the overall igniter plume emission ("color") temperature were conducted using a transmission-grating spectrograph in line-imaging mode. Heat flux and energy deposition to a cold wall at the heat-pellet location were estimated using an eroding thermocouple probe, with a frequency response of ~5 kHz. Ultimate "go/no-go" function in the igniter/heat-pellet system was correlated with quantitative thermal metrics, in particular surface energy deposition and plume color temperature. Titanium metal-particle and plume color temperatures both experience an upper bound approximated by the 3245-K boiling point of TiO 2 . Average metal-particle temperatures remained nearly constant for all standoff distances at T = 2850 K, ± 300 K, while plume color temperature and heat flux decay with standoff—suggesting that heat-pellet failure results from a drop in metal-particle flux and not particle temperature. At 50% likelihood of heat-pellet failure, peak time-resolved plume color temperatures drop well below TiO 2 boiling to ~2000 - 2200 K, near the TiO 2 melting point. Estimates of peak heat flux decline from up to 1 GW/m 2 for near-field standoffs to below 320 MW/m 2 at 50% failure likelihood.

36 MATERIALS SCIENCE↗

Coupling of the Electricity and Transportation Sectors - Part II: Risk Assessment

This comprehensive report explores the intricate interplay through “sector coupling” between the Transportation Sector, Energy Sector, and the critical infrastructure challenges faced by the United States. Aligned with the ambitious federal goal of reducing greenhouse gas emissions, the report analyzes the present vulnerabilities in the fossil fuel supply chain, highlighting instances where the dependence on this industry has been susceptible to local and global disruptions. With a focus on risk assessment, this report establishes a framework to compare the fossil fuel-based transportation sector with the burgeoning electrified sector, considering the evolving technologies in electric vehicles (EVs) and the nascent charging infrastructure. This study delves into the historical reliability of fossil fuel-based transportation and identifies opportunities for strengthening sector coupling between transportation and the electric sector. Assessments of the gasoline-diesel supply chain provide insights into both opportunities and threats, offering a roadmap for creating a more reliable and resilient electrified transportation system. We modeled sectoral coupling scenarios for the current internal combustion engine (ICE)-based and future EV-dominant landscapes, leveraging qualitative sector attributes to identify relative strengths and weaknesses in Part 1 of the report. In this report (Part 2) we continue to understand the role of the electricity sector on transportation and develop a semi-quantitative methodology is employed to evaluate and compare the risks associated with the fossil fueled and electric transportation sector during emergency scenarios, drawing from real-world events like hurricanes and geopolitical disruptions. Different operational scenarios for the fossil fuel and electrified sectors have been developed to understand the risks associated with them. This report concludes with recommendations for the architectural designs of electric charging infrastructure, underlining the need for informed decisions in the transition towards a sustainable and resilient transportation future.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Method for Coupled Electromagnetic and Circuit Simulations to Evaluate Surge Arrester Performance in Protecting Equipment Against E1 HEMP

Surge arrester behavioral modeling for realistic systems embedded in an E1 high-altitude electromagnetic pulse environment inherently encompasses three interconnected complications: (1) the need to account for signal propagation across two domains, electromagnetics and electrical; (2) the need to include both linear and nonlinear circuit components in the analysis; and (3) the need to understand that the over-current and over-voltage mitigation performance is dependent not only on the properties of the surge arrester and protected load but also on the topology of the overall electrical network. This study presents a framework to address these challenges in a systematic manner to consider the effectiveness of protective measures for a common class of equipment in power generation facilities. Full-wave simulations were carried out to derive circuit-domain (i.e., lumped element–based) equivalent models for the excitation waveform and the physical components of the system. Then, these equivalent models were imported to a circuit solver and combined with a high-frequency surge arrester model to evaluate mitigation performance. The methodology outlined is general enough such that it can be applied for other electromagnetic interference problems that involve E2/E3 HEMP or microwave emissions.

42 ENGINEERING↗

Energy Efficiency Field Study: Influence of Key Measures in Home Rules States

The goal of the Energy Efficiency Field Study: Influence of Key Measures in Home Rule States project is to empower and support the states of Utah and Arizona in the successful implementation of their building energy codes. Employing the Department of Energy (DOE) Residential Building Energy Code Field Study Data Collection & Methodology, the research team evaluated real-world implementation status against a baseline, with a particular focus on the unique challenges presented by the dry, hot climates of Utah and Arizona.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Build-to-Replace: A New Paradigm for Reducing Advanced Reactor O&M Costs

Nuclear energy is a carbon free source of reliable, resilient, and dispatchable energy that has the potential to feature prominently in a future energy mix. To this end, many new reactor designs are being developed to help reduce cost and improve safety. Operating and maintenance (O&M) costs can make up a significant portion of lifecycle costs. Traditional approaches for nuclear plant design O&M is to perform significant inspections and testing of plant equipment to extend the life of equipment as long as possible. This is contrasted with approaches used in other industries where equipment is replaced when it is no longer functional in lieu of spending time and resources on maintenance. This research investigated the “build-to-replace” approach for new nuclear power plants. A methodology was developed to evaluate the effectiveness of the “build-to-replace” approach. Several scenarios were developed and analyzed using the approach. Modest reductions in O&M costs were obtained in some cases.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

eLog Analysis for Accelerators: Status and Future Outlook

This work demonstrates electronic logbook (eLog) systems leveraging modern AI-driven information retrieval capabilities at the accelerator facilities of Fermilab, Jefferson Lab, Lawrence Berkeley National Laboratory (LBNL), SLAC National Accelerator Laboratory. We evaluate contemporary tools and methodologies for information retrieval with Retrieval Augmented Generation (RAGs), focusing on operational insights and integration with existing accelerator control systems. The study addresses challenges and proposes solutions for state-of-the-art eLog analysis through practical implementations, demonstrating applications and limitations. We present a framework for enhancing accelerator facility operations through improved information accessibility and knowledge management, which could potentially lead to more efficient operations.

Hellert, Thorsten [LBNL, ALS]↗

Resilience Metrics for Solar Photovoltaics

This workshop presentation proposes the development of solar photovoltaic (PV) system resilience metrics and a methodology and framework for evaluation of PV resilience metrics. PV resilience metrics are needed to establish a consistent basis for reporting, evaluation, and data collection by industry, evaluate performance of PV systems that have been subject to natural hazards, correlating resilience to system attributes, and predicting resilience for any PV system. PV resilience metrics can guide improved system design, standards, and insurance coverage. Establishing consistent metrics can foster data collection on impacts of natural hazards on PV systems.

14 SOLAR ENERGY↗