Search NASA⌕ Search

SEARCH · Search NASA

Results for “evaluation process”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15

Prioritizing Acquisition Pathways in the State Level Concept

The International Atomic Energy Agency's (IAEA) Department of Safeguards has launched a project to further develop the State-level concept for the planning, implementation, and evaluation of safeguards activities. In order to further evolve the safeguards system an emphasis is placed on integrating inspection-related activities and the State evaluation process to draw safeguards conclusions in the most efficient way. The credible implementation of acquisition pathway analysis is central to the success of the IAEA's State-level concept. NNSA's Office of Nuclear Safeguards and Security (NA-241) The Next Generation Safeguards Initiative (NGSI) is sponsoring Los Alamos National Laboratory (LANL) to produce a study that will examine the use of acquisition pathway analysis in: (1) Developing a State-specific, State-level approach (SLA) and Annual Implementation Plan (AIP); (2) Maximizing the utility of the physical model; and (3) Supporting resource allocation decisions through a pathway prioritization. To deal with the challenge of developing an effective and efficient SLA, this study looks at: (1) Prioritizing proliferation pathways based on an assessment of a State's capabilities and assumed proliferation strategies; and (2) Relevant State behavior (e.g., transparency, cooperation, etc.) while avoiding subjective judgments about States themselves. The study makes use of case studies and concrete examples in order to illustrate how new concepts and approaches will be implemented, and how they may differ from more traditional safeguards approaches.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Databases applicable to quantitative hazard/risk assessment-Towards a predictive systems toxicology

The Workshop on The Power of Aggregated Toxicity Data addressed the requirement for distributed databases to support quantitative hazard and risk assessment. The authors have conceived and constructed with federal support several databases that have been used in hazard identification and risk assessment. The first of these databases, the EPA Gene-Tox Database was developed for the EPA Office of Toxic Substances by the Oak Ridge National Laboratory, and is currently hosted by the National Library of Medicine. This public resource is based on the collaborative evaluation, by government, academia, and industry, of short-term tests for the detection of mutagens and presumptive carcinogens. The two-phased evaluation process resulted in more than 50 peer-reviewed publications on test system performance and a qualitative database on thousands of chemicals. Subsequently, the graphic and quantitative EPA/IARC Genetic Activity Profile (GAP) Database was developed in collaboration with the International Agency for Research on Cancer (IARC). A chemical database driven by consideration of the lowest effective dose, GAP has served IARC for many years in support of hazard classification of potential human carcinogens. The Toxicological Activity Profile (TAP) prototype database was patterned after GAP and utilized acute, subchronic, and chronic data from the Office of Air Quality Planning and Standards. TAP demonstrated the flexibility of the GAP format for air toxics, water pollutants and other environmental agents. The GAP format was also applied to developmental toxicants and was modified to represent quantitative results from the rodent carcinogen bioassay. More recently, the authors have constructed: 1) the NIEHS Genetic Alterations in Cancer (GAC) Database which quantifies specific mutations found in cancers induced by environmental agents, and 2) the NIEHS Chemical Effects in Biological Systems (CEBS) Knowledgebase that integrates genomic and other biological data including dose-response studies in toxicology and pathology. Each of the public databases has been discussed in prior publications. They will be briefly described in the present report from the perspective of aggregating datasets to augment the data and information contained within them.

60 APPLIED LIFE SCIENCES↗

Evaluating causal‐based feature selection for fuel property prediction models

Abstract In‐silico screening of novel biofuel molecules based on chemical and fuel properties is a critical first step in the biofuel evaluation process due to the significant volumes of samples required for experimental testing, the destructive nature of engine tests, and the costs associated with bench‐scale synthesis of novel fuels. Predictive models are limited by training sets of few existing measurements, often containing similar classes of molecules that represent just a subset of the potential molecular fuel space. Software tools can be used to generate every possible molecular descriptor for use as input features, but most of these features are largely irrelevant and training models on datasets with higher dimensionality than size tends to yield poor predictive performance. Feature selection has been shown to improve machine learning models, but correlation‐based feature selection fails to provide scientific insight into the underlying mechanisms that determine structure–property relationships. The implementation of causal discovery in feature selection could potentially inform the biofuel design process while also improving model prediction accuracy and robustness to new data. In this study, we investigate the benefits causal‐based feature selection might have on both model performance and identification of key molecular substructures. We found that causal‐based feature selection performed on par with alternative filtration methods, and that a structural causal model provides valuable scientific insights into the relationships between molecular substructures and fuel properties.

Nguyen, Bernard↗

Placement of the dam for the no. 2 kambaratinskaya HPP by large-scale blasting: some observations

Results of complex instrument observations of large-scale blasting during construction of the dam for the No. 2 Kambaratinskaya HPP on the Naryn River in the Republic of Kirgizia are analyzed. The purpose of these observations was: to determine the actual parameters of the seismic process, evaluate the effect of air and acoustic shock waves, and investigate the kinematics of the surface formed by the blast in its core region within the mass of fractured rocks.

13 HYDRO ENERGY↗

Monte Carlo performance studies for the site selection of the Cherenkov Telescope Array

The Cherenkov Telescope Array (CTA) represents the next generation of ground-based instruments for very-high-energy (VHE) gamma-ray astronomy, aimed at improving on the sensitivity of current-generation experiments by an order of magnitude and providing coverage over four decades of energy. The current CTA design consists of two arrays of tens of imaging atmospheric Cherenkov Telescopes, comprising Small, Medium and Large-Sized Telescopes, with one array located in each of the Northern and Southern Hemispheres. To study the effect of the site choice on the overall CTA performance and support the site evaluation process, detailed Monte Carlo simulations have been performed. These results show the impact of different site-related attributes such as altitude, night-sky background and local geomagnetic field on CTA performance for the observation of VHE gamma rays.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Geochemical Monitoring Considerations for the FutureGen 2.0 Project

Geochemical monitoring is an essential component of a suite of monitoring technologies designed to evaluate CO2 mass balance and detect possible loss of containment at the FutureGen 2.0 geologic sequestration site near Jacksonville, IL. This presentation gives an overview of the potential geochemical approaches and tracer technologies that were considered, and describes the evaluation process by which the most cost-effective and robust of these were selected for implementation

54 ENVIRONMENTAL SCIENCES↗

Incorporating cumulative effects into environmental assessments of mariculture: Limitations and failures of current siting methods

Assessing and evaluating the cumulative impacts of multiple marine aquaculture facilities has proved difficult in environmental assessment. A retrospective review of 23 existing mariculture farms in southwestern New Brunswick was conducted to determine whether cumulative interactions would have justified site approvals. Based on current scientific evidence of cumulative effects, six new criteria were added to a set of far-field impacts and other existing criteria were expanded to include regional and cumulative environmental impacts in Hargrave's [Hargrave BT. A traffic light decision system for marine finfish aquaculture siting. Ocean Coast Manag 2002; 45:215-35.] Traffic Light Decision Support System (DSS) presently used in Canadian aquaculture environmental assessments. Before mitigation, 19 of the 23 sites failed the amended set of criteria and after considering mitigation, 8 sites failed. Site and ecosystem indices yielded varying site acceptability scores; however, many sites would not have been approved if siting decisions had been made within a regional management framework and cumulative impact criteria were considered in the site evaluation process.

54 ENVIRONMENTAL SCIENCES↗

Evaluation of Neutron-induced Cross Sections and their Related Covariances with Physical Constraints

Nuclear data, along with numerical methods and the associated calculation schemes, continue to play a key role in reactor design, reactor core operating parameters calculations, fuel cycle management and criticality safety calculations. Due to the intensive use of Monte-Carlo calculations reducing numerical biases, the final accuracy of neutronic calculations increasingly depends on the quality of nuclear data used. This paper gives a broad picture of all ingredients treated by nuclear data evaluators during their analyses. After giving an introduction to nuclear data evaluation, we present implications of using the Bayesian inference to obtain evaluated cross sections and related uncertainties. In particular, a focus is made on systematic uncertainties appearing in the analysis of differential measurements as well as advantages and drawbacks one may encounter by analyzing integral experiments. The evaluation work is in general done independently in the resonance and in the continuum energy ranges giving rise to inconsistencies in evaluated files. For future evaluations on the whole energy range, we call attention to two innovative methods used to analyze several nuclear reaction models and impose constraints. Finally, we discuss suggestions for possible improvements in the evaluation process to master the quantification of uncertainties. These are associated with experiments (microscopic and integral), nuclear reaction theories and the Bayesian inference.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Trustworthiness modeling and evaluation for a nearly autonomous management and control system

The Nearly Autonomous Management and Control (NAMAC) system supports the advanced reactor operation by recommending control actions to operators based on real-time measurements and digital twins (DTs) learning from the knowledge base. To enable the safe and reliable use of autonomous technologies, NAMAC and its recommendations should be trustworthy to operators and regulators at both the design and operation stages. This study proposes a NAMAC trustworthiness modeling and evaluation framework supported by trustworthiness ontologies and evidence-based approaches. The development-time and run-time ontologies are separately constructed and then converted to Bayesian networks to quantitatively evaluate the NAMAC trustworthiness. This evaluation is demonstrated by collecting and characterizing evidence from NAMAC practices, such as the development and assessment of the NAMAC system, data coverage assessment, and the training and optimizations of neural-network-based DTs. Our proposed approach can aggregate various trustworthiness attributes of complex artificial-intelligence-supported systems for safety-critical applications. It also considers the interaction between different DTs and extends beyond the trustworthiness evaluation of a single DT. In conclusion, the evidence-based method enhances the transparency of the trustworthiness modeling and evaluation processes and helps identify uncertainties and subjectivity involved in the processes.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Real-Time Detection of Hydrogen and Ammonia Isotopologues for Impurity Removal and Recovery of Tritium

To accommodate gas measurements for impurity removal and recovery of tritium, a silver-coated optical or waveguide is employed for collecting Raman scattered signals to determine relative hydrogen and ammonia isotopologue populations in real time. The data and results presented here demonstrate an analytical methodology for the analysis of four ammonia and three hydrogen isotopologues in a hydrogen–deuterium exchange reaction by gas phase Raman spectroscopy. Standard chemometric modeling techniques effectively unravel the signatures of the isotopologues involved observed here; however, a sophisticated quantum chemical approach supports the spectral assignments. An interpretation of the data presented here can emphasize the practicality and reliability of the gaseous monitoring system in complex chemical environments for the hydrogen fuel economy as well as the more distant energy source from a facility that handles tritium. There are still considerable concerns about the measurement of tritium in isotope separation and radiological impurities from gas processing. A common impurity in gas processing is ammonia, which can form readily in the presence of nitrogen and tritium. Substituted ammonia (NQ 3 ), where Q = H, D, or T, is traditionally removed through getters or diffusers along with other non-hydrogen contaminants. A preferable analytical approach is noninvasive and can be deployed for real-time process evaluation in radiological environments.

Ammonia↗

The Water Balance Representation in Urban‐PLUMBER Land Surface Models

Abstract Urban Land Surface Models (ULSMs) simulate energy and water exchanges between the urban surface and atmosphere. However, earlier systematic ULSM comparison projects assessed the energy balance but ignored the water balance, which is coupled to the energy balance. Here, we analyze the water balance representation in 19 ULSMs participating in the Urban‐PLUMBER project using results for 20 sites spread across a range of climates and urban form characteristics. As observations for most water fluxes are unavailable, we examine the water balance closure, flux timing, and magnitude with a score derived from seven indicators expecting better scoring models to capture the latent heat flux more accurately. We find that the water budget is only closed in 57% of the model‐site combinations assuming closure when annual total incoming fluxes (precipitation and irrigation) fluxes are within 3% of the outgoing (all other) fluxes. Results show the timing is better captured than magnitude. No ULSM has passed all water balance indicators for any site. Models passing more indicators do not capture the latent heat flux more accurately refuting our hypothesis. While output reporting inconsistencies may have negatively affected model performance, our results indicate models could be improved by explicitly verifying water balance closure and revising runoff parameterizations. By expanding ULSM evaluation to the water balance and related to latent heat flux performance, we demonstrate the benefits of evaluating processes with direct feedback mechanisms to the processes of interest.

Jongen, H. J.↗

Fission Product Yield Modeling and Evaluation

Although independent and cumulative fission product yields have been a part of evaluated libraries for decades, there have been few updates over the years. The fission product yield sub-library in the ENDF/B-VIII.0 library is still largely based on the evaluation of England and Rider from the mid-90’s, with only more recent updates to the energy dependence of 239 Pu below 2 MeV and fixes to isomeric states and missing fission products. Over the past several years, there have been a wealth of new measurements of independent and cumulative fission product yields, particularly those with short half-lives, and there have been significant improvements in the modeling of prompt and delayed fission observables. Here, we describe recent progress in the improvement of fission product yield calculations, using the BeoH code and the underlying Hauser Fesh-bach Fission Fragment Decay (HF 3 D) model, developed at Los Alamos National Laboratory. We will describe our recent calculations for consistent prompt and delayed fission observables for major and minor actinides, including new work investigating isomeric ratios. We will detail the ongoing evaluation process for energy-dependent fission product yields from thermal up to 20 MeV incident neutron energy and some validation work that has been performed for these new fission product yield calculations. Additionally, we will discuss future perspectives of this work, highlighting the need for additional data.

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗

Production and use of nuclear parameter covariance data: an overview of challenging cross cutting scientific issues

Nuclear data users’ requirements for uncertainty data started already in the seventies, when several fast reactor projects did use extensively “statistical data adjustments” to meet data improvement for core and shielding design. However, it was only ~20–30 years later that a major effort started to produce scientifically based covariance data and in particular since ~2005. Most work has been done since then with spectacular achievements and enhanced understanding both of the uncertainty evaluation process and of the data utilization in V&V. This paper summarizes some key developments and still open challenges.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Templates of expected measurement uncertainties for average prompt and total fission neutron multiplicities

In this paper, we provide templates of measurement uncertainty sources expected to appear for average prompt- and total-fission neutron multiplicities, $ \overline\nu_p $ and $ \overline\nu_t $, for the following measurement types: absolute manganese-bath experiments for $ \overline\nu_t $, absolute and ratio liquid-scintillator measurements for $ \overline\nu_p $. These templates also suggest a typical range of these uncertainties and their correlations based on a survey of available experimental data, associated literature, and feedback from experimentalists. In addition, the information needed to faithfully include the associated experimental data into the nuclear-data evaluation process is provided.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Correlation of Measured Surface Contaminants as a Function of Ion Beam Current in GSD Ion Implanters

An investigation into measured differences in surface contaminant levels when evaluating several ion implant tools and/or tool types. For a given species and energy, beam current appears to have a strong effect on final contaminant levels. Ideally one evaluates process integrity at machine set-up conditions that approximate or exceed the worst case conditions required for regular, volume wafer production. Some contaminants may exhibit a 'threshold' effect where they are easily observed with sufficient beam current, but not present at all for lower beam currents. Knowing the characteristics of the measurement process is essential in obtaining reliable results with a clear interpretation and better facilitates cross-site or cross-platform comparisons.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

A multi-dataset data-collection strategy produces better diffraction data

Theoretical analysis and experimental validation prove that a multi-dataset data-collection strategy produces better diffraction data. The readiness test is a simple and sensitive method for X-ray data-collection system evaluation and a benchmark. A multi-dataset (MDS) data-collection strategy is proposed and analyzed for macromolecular crystal diffraction data acquisition. The theoretical analysis indicated that the MDS strategy can reduce the standard deviation (background noise) of diffraction data compared with the commonly used single-dataset strategy for a fixed X-ray dose. In order to validate the hypothesis experimentally, a data-quality evaluation process, termed a readiness test of the X-ray data-collection system, was developed. The anomalous signals of sulfur atoms in zinc-free insulin crystals were used as the probe to differentiate the quality of data collected using different data-collection strategies. The data-collection results using home-laboratory-based rotating-anode X-ray and synchrotron X-ray systems indicate that the diffraction data collected with the MDS strategy contain more accurate anomalous signals from sulfur atoms than the data collected with a regular data-collection strategy. In addition, the MDS strategy offered more advantages with respect to radiation-damage-sensitive crystals and better usage of rotating-anode as well as synchrotron X-rays.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

AI ATAC 1: An Evaluation of Prominent Commercial Malware Detectors

This work presents an evaluation of six prominent commercial endpoint malware detectors, a network malware detector, and a file-conviction algorithm from a cyber technology vendor. The evaluation was administered as the first of the Artificial I ntelligence Applications t o Autonomous Cybersecurity (AI ATAC) prize challenges, funded by / completed in service of the US Navy. The experiment employed 100K files (50/50% benign/malicious) with a stratified distribution of file types, including ~1K zero-day program executables (increasing experiment size two orders of magnitude over previous work). We present an evaluation process of delivering a file to a fresh virtual machine donning the detection technology, waiting 90s to allow static detection, then executing the file and waiting another period for dynamic detection; this allows greater fidelity in the observational data than previous experiments, in particular, resource and time-to-detection statistics. To execute all 800K trials (100K files × 8 tools), a software framework is designed to choreograph the experiment into an automated, time-synced, and reproducible workflow with substantial parallelization. Software with base classes for this framework are provided. A cost-benefit model was configured to integrate the tools’ detection statistics into a comparable quantity by simulating costs of use. This provides a ranking methodology for cyber competitions and a lens for reasoning about the varied statistical results. The results provide insights on state of commercial malware detection.

Bridges, Robert↗

Parallel I/O Evaluation Techniques and Emerging HPC Workloads: A Perspective

Emerging workloads such as artificial intelligence, big data analytics and complex multi-step workflows alongside future exascale applications are anticipated future HPC workloads, which will result in a more diverse I/O system workload and even less predictable I/O behavior and access patterns. Along with the ever increasing gap between the compute and storage performance capabilities, the in-depth understanding of extreme-scale I/O behavior and the I/O performance modeling and prediction are essential tools of the large-scale I/O evaluation process for addressing the needs of extreme-scale hybrid workloads. In this survey article, we focus on the state-of-the-art of the I/O behavior and performance analysis process for HPC systems in a 5-year time window and identify future research challenges.

Neuwirth, Sarah↗