Search NASA⌕ Search

SEARCH · Search NASA

Results for “evaluation process”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 415 records · Page 23

Monte Carlo performance studies for the site selection of the Cherenkov Telescope Array

The Cherenkov Telescope Array (CTA) represents the next generation of ground-based instruments for very-high-energy (VHE) gamma-ray astronomy, aimed at improving on the sensitivity of current-generation experiments by an order of magnitude and providing coverage over four decades of energy. The current CTA design consists of two arrays of tens of imaging atmospheric Cherenkov Telescopes, comprising Small, Medium and Large-Sized Telescopes, with one array located in each of the Northern and Southern Hemispheres. To study the effect of the site choice on the overall CTA performance and support the site evaluation process, detailed Monte Carlo simulations have been performed. These results show the impact of different site-related attributes such as altitude, night-sky background and local geomagnetic field on CTA performance for the observation of VHE gamma rays.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Geochemical Monitoring Considerations for the FutureGen 2.0 Project

Geochemical monitoring is an essential component of a suite of monitoring technologies designed to evaluate CO2 mass balance and detect possible loss of containment at the FutureGen 2.0 geologic sequestration site near Jacksonville, IL. This presentation gives an overview of the potential geochemical approaches and tracer technologies that were considered, and describes the evaluation process by which the most cost-effective and robust of these were selected for implementation

54 ENVIRONMENTAL SCIENCES↗

Incorporating cumulative effects into environmental assessments of mariculture: Limitations and failures of current siting methods

Assessing and evaluating the cumulative impacts of multiple marine aquaculture facilities has proved difficult in environmental assessment. A retrospective review of 23 existing mariculture farms in southwestern New Brunswick was conducted to determine whether cumulative interactions would have justified site approvals. Based on current scientific evidence of cumulative effects, six new criteria were added to a set of far-field impacts and other existing criteria were expanded to include regional and cumulative environmental impacts in Hargrave's [Hargrave BT. A traffic light decision system for marine finfish aquaculture siting. Ocean Coast Manag 2002; 45:215-35.] Traffic Light Decision Support System (DSS) presently used in Canadian aquaculture environmental assessments. Before mitigation, 19 of the 23 sites failed the amended set of criteria and after considering mitigation, 8 sites failed. Site and ecosystem indices yielded varying site acceptability scores; however, many sites would not have been approved if siting decisions had been made within a regional management framework and cumulative impact criteria were considered in the site evaluation process.

54 ENVIRONMENTAL SCIENCES↗

Evaluation of Neutron-induced Cross Sections and their Related Covariances with Physical Constraints

Nuclear data, along with numerical methods and the associated calculation schemes, continue to play a key role in reactor design, reactor core operating parameters calculations, fuel cycle management and criticality safety calculations. Due to the intensive use of Monte-Carlo calculations reducing numerical biases, the final accuracy of neutronic calculations increasingly depends on the quality of nuclear data used. This paper gives a broad picture of all ingredients treated by nuclear data evaluators during their analyses. After giving an introduction to nuclear data evaluation, we present implications of using the Bayesian inference to obtain evaluated cross sections and related uncertainties. In particular, a focus is made on systematic uncertainties appearing in the analysis of differential measurements as well as advantages and drawbacks one may encounter by analyzing integral experiments. The evaluation work is in general done independently in the resonance and in the continuum energy ranges giving rise to inconsistencies in evaluated files. For future evaluations on the whole energy range, we call attention to two innovative methods used to analyze several nuclear reaction models and impose constraints. Finally, we discuss suggestions for possible improvements in the evaluation process to master the quantification of uncertainties. These are associated with experiments (microscopic and integral), nuclear reaction theories and the Bayesian inference.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Trustworthiness modeling and evaluation for a nearly autonomous management and control system

The Nearly Autonomous Management and Control (NAMAC) system supports the advanced reactor operation by recommending control actions to operators based on real-time measurements and digital twins (DTs) learning from the knowledge base. To enable the safe and reliable use of autonomous technologies, NAMAC and its recommendations should be trustworthy to operators and regulators at both the design and operation stages. This study proposes a NAMAC trustworthiness modeling and evaluation framework supported by trustworthiness ontologies and evidence-based approaches. The development-time and run-time ontologies are separately constructed and then converted to Bayesian networks to quantitatively evaluate the NAMAC trustworthiness. This evaluation is demonstrated by collecting and characterizing evidence from NAMAC practices, such as the development and assessment of the NAMAC system, data coverage assessment, and the training and optimizations of neural-network-based DTs. Our proposed approach can aggregate various trustworthiness attributes of complex artificial-intelligence-supported systems for safety-critical applications. It also considers the interaction between different DTs and extends beyond the trustworthiness evaluation of a single DT. In conclusion, the evidence-based method enhances the transparency of the trustworthiness modeling and evaluation processes and helps identify uncertainties and subjectivity involved in the processes.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Real-Time Detection of Hydrogen and Ammonia Isotopologues for Impurity Removal and Recovery of Tritium

To accommodate gas measurements for impurity removal and recovery of tritium, a silver-coated optical or waveguide is employed for collecting Raman scattered signals to determine relative hydrogen and ammonia isotopologue populations in real time. The data and results presented here demonstrate an analytical methodology for the analysis of four ammonia and three hydrogen isotopologues in a hydrogen–deuterium exchange reaction by gas phase Raman spectroscopy. Standard chemometric modeling techniques effectively unravel the signatures of the isotopologues involved observed here; however, a sophisticated quantum chemical approach supports the spectral assignments. An interpretation of the data presented here can emphasize the practicality and reliability of the gaseous monitoring system in complex chemical environments for the hydrogen fuel economy as well as the more distant energy source from a facility that handles tritium. There are still considerable concerns about the measurement of tritium in isotope separation and radiological impurities from gas processing. A common impurity in gas processing is ammonia, which can form readily in the presence of nitrogen and tritium. Substituted ammonia (NQ 3 ), where Q = H, D, or T, is traditionally removed through getters or diffusers along with other non-hydrogen contaminants. A preferable analytical approach is noninvasive and can be deployed for real-time process evaluation in radiological environments.

Ammonia↗

The Water Balance Representation in Urban‐PLUMBER Land Surface Models

Abstract Urban Land Surface Models (ULSMs) simulate energy and water exchanges between the urban surface and atmosphere. However, earlier systematic ULSM comparison projects assessed the energy balance but ignored the water balance, which is coupled to the energy balance. Here, we analyze the water balance representation in 19 ULSMs participating in the Urban‐PLUMBER project using results for 20 sites spread across a range of climates and urban form characteristics. As observations for most water fluxes are unavailable, we examine the water balance closure, flux timing, and magnitude with a score derived from seven indicators expecting better scoring models to capture the latent heat flux more accurately. We find that the water budget is only closed in 57% of the model‐site combinations assuming closure when annual total incoming fluxes (precipitation and irrigation) fluxes are within 3% of the outgoing (all other) fluxes. Results show the timing is better captured than magnitude. No ULSM has passed all water balance indicators for any site. Models passing more indicators do not capture the latent heat flux more accurately refuting our hypothesis. While output reporting inconsistencies may have negatively affected model performance, our results indicate models could be improved by explicitly verifying water balance closure and revising runoff parameterizations. By expanding ULSM evaluation to the water balance and related to latent heat flux performance, we demonstrate the benefits of evaluating processes with direct feedback mechanisms to the processes of interest.

Jongen, H. J.↗

Fission Product Yield Modeling and Evaluation

Although independent and cumulative fission product yields have been a part of evaluated libraries for decades, there have been few updates over the years. The fission product yield sub-library in the ENDF/B-VIII.0 library is still largely based on the evaluation of England and Rider from the mid-90’s, with only more recent updates to the energy dependence of 239 Pu below 2 MeV and fixes to isomeric states and missing fission products. Over the past several years, there have been a wealth of new measurements of independent and cumulative fission product yields, particularly those with short half-lives, and there have been significant improvements in the modeling of prompt and delayed fission observables. Here, we describe recent progress in the improvement of fission product yield calculations, using the BeoH code and the underlying Hauser Fesh-bach Fission Fragment Decay (HF 3 D) model, developed at Los Alamos National Laboratory. We will describe our recent calculations for consistent prompt and delayed fission observables for major and minor actinides, including new work investigating isomeric ratios. We will detail the ongoing evaluation process for energy-dependent fission product yields from thermal up to 20 MeV incident neutron energy and some validation work that has been performed for these new fission product yield calculations. Additionally, we will discuss future perspectives of this work, highlighting the need for additional data.

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗

Production and use of nuclear parameter covariance data: an overview of challenging cross cutting scientific issues

Nuclear data users’ requirements for uncertainty data started already in the seventies, when several fast reactor projects did use extensively “statistical data adjustments” to meet data improvement for core and shielding design. However, it was only ~20–30 years later that a major effort started to produce scientifically based covariance data and in particular since ~2005. Most work has been done since then with spectacular achievements and enhanced understanding both of the uncertainty evaluation process and of the data utilization in V&V. This paper summarizes some key developments and still open challenges.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Templates of expected measurement uncertainties for average prompt and total fission neutron multiplicities

In this paper, we provide templates of measurement uncertainty sources expected to appear for average prompt- and total-fission neutron multiplicities, $ \overline\nu_p $ and $ \overline\nu_t $, for the following measurement types: absolute manganese-bath experiments for $ \overline\nu_t $, absolute and ratio liquid-scintillator measurements for $ \overline\nu_p $. These templates also suggest a typical range of these uncertainties and their correlations based on a survey of available experimental data, associated literature, and feedback from experimentalists. In addition, the information needed to faithfully include the associated experimental data into the nuclear-data evaluation process is provided.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Correlation of Measured Surface Contaminants as a Function of Ion Beam Current in GSD Ion Implanters

An investigation into measured differences in surface contaminant levels when evaluating several ion implant tools and/or tool types. For a given species and energy, beam current appears to have a strong effect on final contaminant levels. Ideally one evaluates process integrity at machine set-up conditions that approximate or exceed the worst case conditions required for regular, volume wafer production. Some contaminants may exhibit a 'threshold' effect where they are easily observed with sufficient beam current, but not present at all for lower beam currents. Knowing the characteristics of the measurement process is essential in obtaining reliable results with a clear interpretation and better facilitates cross-site or cross-platform comparisons.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

A multi-dataset data-collection strategy produces better diffraction data

Theoretical analysis and experimental validation prove that a multi-dataset data-collection strategy produces better diffraction data. The readiness test is a simple and sensitive method for X-ray data-collection system evaluation and a benchmark. A multi-dataset (MDS) data-collection strategy is proposed and analyzed for macromolecular crystal diffraction data acquisition. The theoretical analysis indicated that the MDS strategy can reduce the standard deviation (background noise) of diffraction data compared with the commonly used single-dataset strategy for a fixed X-ray dose. In order to validate the hypothesis experimentally, a data-quality evaluation process, termed a readiness test of the X-ray data-collection system, was developed. The anomalous signals of sulfur atoms in zinc-free insulin crystals were used as the probe to differentiate the quality of data collected using different data-collection strategies. The data-collection results using home-laboratory-based rotating-anode X-ray and synchrotron X-ray systems indicate that the diffraction data collected with the MDS strategy contain more accurate anomalous signals from sulfur atoms than the data collected with a regular data-collection strategy. In addition, the MDS strategy offered more advantages with respect to radiation-damage-sensitive crystals and better usage of rotating-anode as well as synchrotron X-rays.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

AI ATAC 1: An Evaluation of Prominent Commercial Malware Detectors

This work presents an evaluation of six prominent commercial endpoint malware detectors, a network malware detector, and a file-conviction algorithm from a cyber technology vendor. The evaluation was administered as the first of the Artificial I ntelligence Applications t o Autonomous Cybersecurity (AI ATAC) prize challenges, funded by / completed in service of the US Navy. The experiment employed 100K files (50/50% benign/malicious) with a stratified distribution of file types, including ~1K zero-day program executables (increasing experiment size two orders of magnitude over previous work). We present an evaluation process of delivering a file to a fresh virtual machine donning the detection technology, waiting 90s to allow static detection, then executing the file and waiting another period for dynamic detection; this allows greater fidelity in the observational data than previous experiments, in particular, resource and time-to-detection statistics. To execute all 800K trials (100K files × 8 tools), a software framework is designed to choreograph the experiment into an automated, time-synced, and reproducible workflow with substantial parallelization. Software with base classes for this framework are provided. A cost-benefit model was configured to integrate the tools’ detection statistics into a comparable quantity by simulating costs of use. This provides a ranking methodology for cyber competitions and a lens for reasoning about the varied statistical results. The results provide insights on state of commercial malware detection.

Bridges, Robert↗

Parallel I/O Evaluation Techniques and Emerging HPC Workloads: A Perspective

Emerging workloads such as artificial intelligence, big data analytics and complex multi-step workflows alongside future exascale applications are anticipated future HPC workloads, which will result in a more diverse I/O system workload and even less predictable I/O behavior and access patterns. Along with the ever increasing gap between the compute and storage performance capabilities, the in-depth understanding of extreme-scale I/O behavior and the I/O performance modeling and prediction are essential tools of the large-scale I/O evaluation process for addressing the needs of extreme-scale hybrid workloads. In this survey article, we focus on the state-of-the-art of the I/O behavior and performance analysis process for HPC systems in a 5-year time window and identify future research challenges.

Neuwirth, Sarah↗

On the Use of Energy Storage Technologies for Regulation Services in Electric Power Systems with Significant Penetration of Wind Energy

Energy produced by intermittent renewable resources is sharply increasing in the United States. At high penetration levels, volatility of wind power production could cause additional problems for the power system balancing functions such as regulation. This paper reports some partial results of a project work, recently conducted by the Pacific Northwest National Laboratory (PNNL) for Bonneville Power Administration (BPA). The project proposes to mitigate additional intermittency with the help of Wide Area Energy Management System (WAEMS) that would provide a two-way simultaneous regulation service for the BPA and California ISO systems by using a large energy storage facility. The paper evaluates several utility-scale energy storage technology options for their usage as regulation resources. The regulation service requires a participating resource to quickly vary its power output following the rapidly and frequently changing regulation signal. Several energy storage options have been analyzed based on thirteen selection criteria. The evaluation process resulted in the selection of flywheels, pumped hydro electric power (or conventional hydro electric power) plant and sodium sulfur or nickel cadmium batteries as candidate technologies for the WAEMS project. A cost benefit analysis should be conducted to narrow the choice to one technology.

17 WIND ENERGY↗

Trade-off Analysis of Operational Technologies to Advance Cyber Resilience through Automated and Autonomous Response to Threats

The advancement of cyber resilience requires a preliminary stage of characterizing the trade-off space of mitigation options and how these might affect the stability and determinism of an operational technology (OT). This first step will set the stage for the proper cyber-secure and cyber-resilient design and confirm the affects that can be considered and approved by the OT and the security groups. To provide a baseline for this discussion, this paper provides a consideration of the cyberphysical interactions, possible mitigation steps against certain attacks and their corresponding affects that lend to the security design planning and evaluation process. As an integral part of the proposed scheme this work introduces the concept of systemwide fuzzer, i.e., a tool that manipulates the system state in an effort to determine mitigation response sequences that minimize detriments and maximize benefit in accordance with specified operational requirements.

97 MATHEMATICS AND COMPUTING↗

Instrumentation to Monitor Transient Developing Periodic Flow in Newtonian Slurries

This paper describes measurement techniques developed and applied to characterize solids mobilization and mixing of Newtonian slurries that are subjected to transient, periodic, developing flows. Metrics to characterize mobilization and mixing are the just suspended velocity (UJS) and the cloud height (HC). Two ultrasonic instruments to characterize pulse jet mixing of slurries were developed and deployed to measure related metrics: the thickness of the settled bed (used to determine mobilization) and the concentration within the cloud as a function of elevation [C(Z)]. A second method, continuous sample extraction, characterization, and reinsertion was successfully used to measure average density and characterize the concentration within the cloud. Testing focused on mixing vessels using intermitent jet mixers oriented vertically downward. Descriptions of the instruments and instrument performance are presented. These techniques were an effective approach to characterize mixing phenomena, determine mixing energy required to fully mobilize vessel contents, and to determine mixing times for process evaluation.

concentration profile↗

Instrumentation to Monitor Transient Periodic Developing Flow in Non-Newtonian Slurries

Staff at Pacific Northwest National Laboratory have conducted mixing and mobilization experiments with non-Newtonian slurries that exhibit Bingham plastic and shear thinning behavior and shear strength. This paper describes measurement techniques applied to identify the interface between flowing and stationary regions of non-Newtonian slurries that are subjected to transient, periodic, developing flows. Techniques were developed to identify the boundary between the flowing and stationary regions, time to mix, characteristic velocities of the flow field produced by the symmetrically spaced nozzles, and the velocity of the upwell formed in the center of the tank by the intersection of flow from four symmetrically spaced nozzles that impinge upon the tank floor. Descriptions of the instruments and instrument performance are presented. These techniques were an effective approach to characterize mixing phenomena, determine mixing energy required to fully mobilize vessel contents and to determine mixing times for process evaluation.

Non-Newtonian Slurries↗