Search NASA⌕ Search

SEARCH · Search NASA

Results for “Evaluation Procedure”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

CyberMESA: Evaluation Procedures and Metrics for Charging Infrastructure Cybersecurity

A report detailing the cybersecurity evaluation and assessment procedures for EV charging infrastructure. This report is authored by three national lab contributors. INL, PNNL, NRL. The grid integration of Electric Vehicle Charging Infrastructure (EVCI) is a large and complex system of systems (SoS) made up of components from many manufacturers and integrated by various companies responsible for their operation and maintenance. This complexity makes it challenging to implement security standards like IEC 62443 across the entire infrastructure. This document aims to aid in the vulnerability assessments of individual devices, such as Electric Vehicle Supply Equipment (EVSE), to support vendors in adopting and implementing security standards such as UL 2900, NIST SP 800-53 and Common Criteria (CC) (ISO/IEC 15408). This document serves as a guide to help evaluate the cybersecurity posture of EVCI assets. It aims to provide a consistent method for evaluating EVCI, enabling cybersecurity research teams to systematically test a wide range of electric vehicle (EV) assets. The target audiences include cybersecurity research teams, vendor development teams, automotive OEMs, and third-party evaluators.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

The separatrix electron density in JET, ASDEX upgrade and alcator C-Mod H-mode plasmas: A common evaluation procedure and correlation with engineering parameters

The separatrix electron density is an important parameter for core-edge scenario integration in tokamak devices, as it influences plasma confinement, divertor detachment and disruption avoidance. This quantity has been measured in H-mode discharges on JET, ASDEX Upgrade and Alcator C-Mod by applying the same fitting function to Thomson scattering measurements, and by employing the same analysis technique based on scrape-off layer power balance. To estimate the power crossing the separatrix, the inter-ELM time derivative of the plasma energy d W /d t has been experimentally evaluated and found to be approximately a constant fraction of the absorbed heating power. Correlations between n e,sep and engineering parameters have been investigated, revealing that n e,sep scales with the divertor neutral pressure p 0,div in a similar manner across all devices. Additionally, when n e,sep is normalized to the obtained n e,sep dependency, no clear correlation with the plasma current is found. These observations are in agreement with the 2-point model, which suggests that the upstream separatrix density is mainly set by the recycling at the divertor target.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2024

New procedure for evaluation of U(3) coupling and recoupling coefficients

A simple method to calculate Wigner coupling coefficients and Racah recoupling coefficients for U(3) in two group–subgroup chains is presented. While the canonical U(3) coupling and recoupling coefficients are applicable to any system that respects U(3) symmetry, the U(3) coupling coefficients are more specific to nuclear structure studies. This new procedure precludes the use of binomial coefficients and alternating sums which were used in the 1973 formulation of Draayer and Akiyama, and in so doing provides a faster and more accurate determination of any and all required results. The resolution of the outer multiplicity is based on the null space concept of the U(3) generators proposed by Alex et al., whereas the inner multiplicity in the angular momentum subgroup chain is obtained from the dimension of the null space of the SO(3) raising operator. It is anticipated that a C++ library will ultimately be available for determining generic coupling and recoupling coefficients associated with both the canonical and the physical group–subgroup chains of U(3).

Cross-Coupling Reaction↗
DOE OSTI2023

Consistent Nuclear Data Evaluations for Criticality Safety [Slides]

This presentation covers consistent nuclear data evaluations for criticality safety. Topics include the evaluation procedure, n+ 139 La evaluation, the work in progress for the n+ 233 U evaluation (emphasis on capture), and a concluding Summary.

07 ISOTOPE AND RADIATION SOURCES↗
DOE OSTI2023

Consistent Nuclear Data Evaluations for Criticality Safety

Evaluations of nuclear data are based on statistical analysis of available experimental data and their uncertainties plus model calculations and their uncertainties. As the models are currently rather limited, the evaluations are heavily biassed toward experimental data, with the caveat that a thorough analysis is also required to understand possible discrepancies between data sets. Hence, as new experimental data become available, they are incorporated into the evaluation procedure. Recent measurements of the 233 U capture to fission cross section ratio at the Los Alamos Neutron Science Center have prompted a re-evaluation of the capture cross section in the resonance and fast regions up to 250 keV. We will discuss the challenges of including the new fast neutron experimental data in an evaluation that is consistent with the resonance region. We will also discuss our consistent evaluation procedure based on the Hauser-Feshbach statistical model for nuclear reactions and its application to the evaluations of 239 Pu and 139 La neutron-induced reactions.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2024

Report on the AAPM grand challenge on deep generative modeling for learning medical image statistics

Abstract Background The findings of the 2023 AAPM Grand Challenge on Deep Generative Modeling for Learning Medical Image Statistics are reported in this Special Report. Purpose The goal of this challenge was to promote the development of deep generative models for medical imaging and to emphasize the need for their domain‐relevant assessments via the analysis of relevant image statistics. Methods As part of this Grand Challenge, a common training dataset and an evaluation procedure was developed for benchmarking deep generative models for medical image synthesis. To create the training dataset, an established 3D virtual breast phantom was adapted. The resulting dataset comprised about 108 000 images of size 512 512. For the evaluation of submissions to the Challenge, an ensemble of 10 000 DGM‐generated images from each submission was employed. The evaluation procedure consisted of two stages. In the first stage, a preliminary check for memorization and image quality (via the Fréchet Inception Distance [FID]) was performed. Submissions that passed the first stage were then evaluated for the reproducibility of image statistics corresponding to several feature families including texture, morphology, image moments, fractal statistics, and skeleton statistics. A summary measure in this feature space was employed to rank the submissions. Additional analyses of submissions was performed to assess DGM performance specific to individual feature families, the four classes in the training data, and also to identify various artifacts. Results Fifty‐eight submissions from 12 unique users were received for this Challenge. Out of these 12 submissions, 9 submissions passed the first stage of evaluation and were eligible for ranking. The top‐ranked submission employed a conditional latent diffusion model, whereas the joint runners‐up employed a generative adversarial network, followed by another network for image superresolution. In general, we observed that the overall ranking of the top 9 submissions according to our evaluation method (i) did not match the FID‐based ranking, and (ii) differed with respect to individual feature families. Another important finding from our additional analyses was that different DGMs demonstrated similar kinds of artifacts. Conclusions This Grand Challenge highlighted the need for domain‐specific evaluation to further DGM design as well as deployment. It also demonstrated that the specification of a DGM may differ depending on its intended use.

Radiology, Nuclear Medicine & Medical Imaging↗
DOE OSTI2025

Consistent $\overline{ν}$ evaluation for minor U isotopes with $\tt{CGMF}$

Following several successful prompt $\overline{ν}$ evaluations using $\tt{CGMF}$, including consistent evaluations for minor Pu isotopes, we detail in this report our efforts to perform a consistent $\overline{ν}$ evaluation for minor U isotopes during FY25. Although we have not yet produced a finalized evaluation, we present the progress that we have made towards such an evaluation for 232,233,234,236,237,239 U prompt $\overline{ν}$. Our milestone explicitly calls out evaluations for 233 U, 234 U, and 236 U, however, to better constrain the model with reliable experimental $\overline{ν}$ data, we also include 235 U and 238 U in the evaluation procedure. Then, we additionally produce evaluations for 232 U, 237 U and 239 U $\overline{ν}$ as a byproduct. Elsewhere, we will report our efforts on a stand-alone 233 U $\overline{ν}$ evaluation. This report is organized in the following manner. In Sec. 2, we briefly outline the updates to CGMF that were needed to be able to calculate all of these minor U fission reactions. The experimental data overview is given in Sec. 3. The evaluation methodology and results are presented in Secs. 4 and 5, respectively. Finally, we conclude and outline work for FY26 in Sec. 6.

07 ISOTOPE AND RADIATION SOURCES↗
DOE OSTI2025

Initial Design Curves for Alloy 709 for an Improved Creep-fatigue Design Method

Creep-fatigue (CF) interaction damage is the primary damage mode for high-temperature structural components subjected to cyclic loading. Over the past several decades, researchers within the American Society of Mechanical Engineers (ASME) Boiler and Pressure Vessel Code (BPVC), Section III, Division 5, have focused on developing elevated temperature code rules to ensure conservative structural designs that mitigate CF failure in high-temperature reactors. The existing CF evaluation methodologies in the Code are based on the creep and fatigue damage diagram approach, which is complex and often excessively conservative. The alternative CF evaluation approach proposed here is intended to significantly simplify the evaluation procedure while reducing conservatism in high-temperature component design analysis. This alternative CF evaluation method integrates the elastic–perfectly plastic (EPP) analysis approach with the simplified model test (SMT) CF design concept, leveraging the advantages of both methods. This report presents the preliminary analysis and the approach for developing CF design curves for Alloy 709, utilizing fatigue and CF data generated for the 100,000-hr Code Case to support its qualification to ASME Section III, Division 5 for Class A construction of high temperature reactors. This study is to support the incorporation of Alloy 709 in this alternative CF evaluation method. Recommendations for the remaining work needed to complete the effort are also provided.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Test and Evaluation of Systems with Embedded Machine Learning Components

As Machine Learning (ML) continues to advance, it is being integrated into more systems. Often, the ML component represents a significant portion of the system that reduces the burden on the end user or significantly improves task performance. However, the ML component represents an unknown complex phenomenon that is learned from collected data without the need to be explicitly programmed. Despite the improvement in task performance, the models are often black boxes. Evaluating the credibility and the vulnerabilities of ML models poses a gap in current test and evaluation practice. For high consequence applications, the lack of testing and evaluation procedures represents a significant source of uncertainty and risk. To help reduce that risk, here we present considerations to evaluate systems embedded with an ML component within a red-teaming inspired methodology. We focus on (1) cyber vulnerabilities to an ML model, (2) evaluating performance gaps, and (3) adversarial ML vulnerabilities.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

The joys and jitters of high‐temperature calorimetry

Abstract High‐temperature calorimetry (HTC) originated in the 20th century as a niche method to enable measurements not easily accomplished with acid solution calorimetry, combustion calorimetry, vapor pressure, or EMF methods. Over time, HTC has evolved into a versatile approach to accurately quantify formation, phase transition, surface and interfacial enthalpies of a wide range of materials including minerals and refractory inorganic compounds. This evolution has been the result of numerous adjustments to experimental setups and procedures, followed by rigorous testing. The commercial availability and the scientific success of this technique have led to an increase in the number of laboratories applying HTC. However, the knowledge acquired by researchers over the past 70 years is scattered throughout the literature or only available as laboratory internal documentation and personal experience. This publication is a collaborative effort among several leading HTC laboratories to summarize and unify current state‐of‐the‐art HTC techniques and procedures. The text starts by summarizing various HT techniques that are commonly used for readers with an interest in HTC in general. It is then directed toward HTC users and includes a brief section on data evaluation procedures as well as a comprehensive compilation of reference data utilizing molten sodium molybdate and lead borate solvents. Finally, for experienced HTC users, an in‐depth discussion of some common difficulties and a discussion of uncertainties are presented.

Scharrer, Manuel [Navrotsky Eyring Center for Mate↗
DOE OSTI2024

Experimental and Analytical Verification of ASME Section IiII Division 5 Creep-Fatigue Design Rules

The continuous advancement of structural materials and the growing demands for more reliable and economical structural components in high-temperature reactor applications have necessitated the development of comprehensive design methodologies and design rules. Mechanical degradation of structural components at elevated temperatures subjected to cyclic deformation is controlled by the creep-fatigue damage. Over the past few decades, diligent research efforts have been dedicated to refining the development of elevated temperature design rules in the American Society of Mechanical Engineers (ASME) Boiler and Pressure Vessel Code (BPVC), Section III, Division 5 and to develop conservative design rules that can effectively guard against the risk of creep-fatigue failure. In ASME Section III, Division 5, for a design to pass the creep-fatigue acceptance criteria, creep damage and fatigue damage are evaluated separately, and these damages must not violate the bi-linear creep-fatigue interaction diagram, i.e., the so-called D-diagram. The creep-fatigue damage evaluation procedure assumes that the effects of the actual cyclic loading sequence can be bounded by assuming that the individual loading cycles are uniformly distributed throughout the component design life. In this study, creep-fatigue experiments with variable amplitudes and loading sequencies were designed and performed on Alloy 617 at high temperatures. The results were analyzed to evaluate the loading history effect on creep-fatigue damage accumulation and to verify the assumptions for the creep-fatigue evaluation design rules.

36 - MATERIALS SCIENCE↗
DOE OSTI2025

Online collection of LC effluent as droplets for automatic injection into ICP-MS

A sample introduction technique was developed to allow for online, dropwise injection of effluent into a mass spectrometer (MS). This allowed for the coupling of chromatography systems that were not driven by pumps without altering the set-up or separation performance. This capability combined the benefits of coupling separation and measurement while also enabling accurate chromatographic evaluation that would generally be performed offline. The incorporation of a flowing rinse into the system made dropwise resolution possible for any liquid capable of forming drops under ambient conditions. The technique was demonstrated utilizing gas pressurized extraction chromatography (GPEC) and inductively coupled plasma-time-of-flight mass spectrometry (ICP-TOFMS) to illustrate the qualitative applications for rapid separation development and procedure evaluation. This method's quantitative applications were evaluated using single and double isotope dilution mass spectrometry (IDMS) with an external mass bias correction to measure analytes across entire elutions including volumes as small as single drops. In conclusion, the total neodymium values afforded by both single and double IDMS were within the uncertainty of the calculated value for evaluation of full elution peaks and for most of the single drops analyzed that reached above 10k cps Nd-144.

GPEC↗
DOE OSTI2025

$\mathcal{R}$ -matrix analysis of η + nat Cl reactions relevant to molten-salt reactor designs [Abstract]

Performed with support from the U.S. Nuclear Criticality Safety Program in an effort to provide improved chlorine cross section and corresponding covariance data, the R-matrix analysis of neutron induced reactions for two stable chlorine isotopes, 35,37 Cl, was performed in the energy range of thermal up to 1.2 MeV. Starting from the repository of the ENDF/B-VIII.0 library and following recent measurement campaigns, this work represents a significant improvement in the evaluation of the ( η , p ) reaction channel. The evaluation methodology uses the $\mathcal{R}$ -matrix code SAMMY to generate a set of Reich-Moore resonance parameters. As predicted by recently measured 35 Cl( η , p ) data, the presented evaluation features a dramatic increase in the magnitude of the ( η , p ) reaction channel over the ENDF/B-VIII.0 and previous nuclear data ENDF/B released libraries. Together with details of the evaluation procedure, the impact of the updates in the outgoing proton emissions on reactivity coefficients for different molten-salt reactor designs is presented and discussed.

charged-particle↗
DOE OSTI2025

Comparative evaluation and selection of heat exchangers using multicriteria decision-making

Here, this study presents a well-structured method for comparing and selecting Heat Exchanger (HE) technologies for Integrated Energy Systems (IES). The decision to select a HE for a particular IES configuration can vary greatly depending not only on engineering requirements but also on customer’s specific demand. In other words, the HE selection for IES requires a multicriteria decision-making approach, taking into account diverse technical, economic, and safety aspects, as well as the relative priorities considered by energy users. This study employs a HE evaluation approach combining multicriteria decision-making techniques widely used in various industries: quality function deployment (QFD) and analytic hierarchy process (AHP) techniques. Of particular interest is the use of the proposed method to select a high-temperature HEs that couples advanced nuclear reactors and industrial processes. To build a practical basis for comparing HEs within the proposed framework, efforts were made to identify the various HEs requirements for IES purposes. In addition, leveraging the insights obtained from the literature review and the market survey of commercial HE suppliers, a knowledge base was built to facilitate the comparison of each requirement across various HE designs. Also, evaluation metrics were identified for HE requirements with robust rational to enhance the quality of decisions made throughout the proposed evaluation process. The evaluation procedure and knowledge base described in this study can provide a useful basis for those interested in screening the appropriate HE designs for various IES scenarios.

Analytic Hierarchy Process (AHP)↗
DOE OSTI2024

Evaluations for Nuclear Criticality Safety Program 12 C, 139 La, minor actinides, 235 U [Slides]

For light nuclei, preliminary work extends the evaluation from 6.5 MeV to ~ 10 MeV. For 139 La, the team delivered full evaluation in fast region to ORNL, including covariances. For sup>235 U, RPI data simulations, the team performed simulations and showed some improvement for neutrons below 5 MeV. Some of the changes needed for more improvement might not be supported by the current format. Some of the changes above 12 MeV to account for the angular distribution of preequilibrium neutrons require a change in the PFNS evaluation procedure.

235U re-evaluation↗
DOE OSTI2024

A Data-Driven Framework for Power System Event Type Identification via Safe Semi-Supervised Techniques

Herein this paper investigates the use of phasor measurement unit (PMU) data with deep learning techniques to construct real-time event identification models for transmission networks. Increasing penetration of distributed energy resources represents a great opportunity to achieve decarbonization, as well as challenges in systematic situational awareness. When high-resolution PMU data and sufficient manually recorded event labels are available, the power event identification problem is defined as a statistical classification problem that can be solved by numerous cutting-edge classifiers. However, in real grids, collecting tremendous high-quality event labels is quite expensive. Utilities frequently have a large number of event records without in-depth details (i.e., unlabeled events). To bridge this gap, we propose a novel semi-supervised learning-based method to improve the performance of event classifiers trained with a limited number of labeled events by exploiting the information from massive unlabeled events. In other words, compared to existing data-driven methods, our method requires only a small portion of labeled data to achieve a similar level of accuracy. Meanwhile, this work discusses and addresses the performance degradation caused by class distribution mismatch between the training set and the real applications. Based on the proposed safe learning mechanism, our model does not directly use all unlabeled events during model training, but selectively uses them through a comprehensive evaluation procedure. Numerical studies on a sizable PMU dataset have been used to validate the performance of the proposed method.

42 ENGINEERING↗
DOE OSTI2024

ENDF/B-VIII.1 Evaluation Updates for 234,236 U [Slides]

This presentation goes over the general evaluation procedure. Additionally covered are the fission and capture updates, reaction rates, correlation studies and finally a summary that provides closing remarks.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2024

Method Development and Implementation for Characterizing Uncertainties in Tank Leak Volumes for Composite Analysis.

The purpose of this environmental calculation file (ECF) is to provide a summary of methodology, inputs, assumptions, and results of a Special Analysis (SA) titled “Method Development and Implementation for Characterizing Uncertainties in Tank Leak Volumes for the Updated Composite Analysis.” This SA is one of the three SAs conducted in Fiscal Year (FY) 2024 for the Composite Analysis (CA) for the Hanford Site (DOE/RL-2019-52, Composite Analysis for Low-Level Waste Disposal in the Hanford Site Central Plateau (FY 2020)), and it is performed following the Unreviewed Composite Analysis Question Evaluation procedure, UCAQ-24-01-E (UCAQ-24-01-E, Rev. 0).

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗