Search NASA⌕ Search

SEARCH · Search NASA

Results for “program evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,261 records · Page 70

Speeding-up fuzzing through directional seeds

Abstract Fuzzing is an automated process for discovering inputs in a program that may trigger unexpected behavior. Today, fuzzing has become a standard practice for the discovery of bugs and security vulnerabilities. However, the main issue with such practices is that the exploration of the input space of programs can often be prohibitively expensive. Therefore, several alternative fuzzing strategies have been introduced during the last few years. Some fuzzing techniques rely on human expertise to provide a plausible set of initial input examples, namely, seeds. However, the process of handcrafting seeds for fuzzing purposes often becomes strenuous for humans as it requires a deeper understanding of the Program-Under-Test (PUT). Also, the use of known inputs to programs often does not trigger vulnerable program behavior or may not reach potentially vulnerable code locations. To address those issues, we propose a seed generation framework that enables Human-In-The-Loop (HITL) directed fuzzing where the human assumes a more active role in the creation of seeds that can penetrate and assess desired locations of the PUT. Our proposed framework uses Symbolic Execution (SE) to generate seeds that exercise paths to target program locations. Moreover, our framework enables the visualization of the explored execution paths in the binary of the PUT for the generated seeds. We evaluated our approach on a set of 12 carefully designed C programs with diverse characteristics that mimic real-world programs. The experimental results show the effectiveness of the proposed approach in improving the performance of standard fuzzing tools such as the American Fuzzy Lop ("Image missing" <#comment/> ). Specifically, our solution can generate seeds that substantially enhance the performance of the fuzzer, achieving speedups ranging from $$1.46\times $$ 1.46 × to $$68.53\times $$ 68.53 × for branch conditions, $$1.39\times $$ 1.39 × to $$254.62\times $$ 254.62 × for branch depths, $$14,879.59\times $$ 14 , 879.59 × to $$30,295.88\times $$ 30 , 295.88 × for branch widths over traditional seeds. Additionally, the speedup increases with the number of target function ranging from $$12,260\times $$ 12 , 260 × to $$22,856.07\times $$ 22 , 856.07 × over traditional seeds while only requiring less than 15 seconds on average for the seed generation step.

97 MATHEMATICS AND COMPUTING↗

IRIS-MEMFLOW: Data Flow-Enabled Portable Memory Orchestration in IRIS Runtime for Diverse Heterogeneity

Task-based programming models and execution paradigms provide a means to decompose a computation by expressing it as a graph in which each node represents a specific computation operating on memory objects and the edges define the dependencies in the execution flow. In this execution model, independent nodes in the graph can be executed concurrently in different computing devices, making it suitable for heterogeneous systems in which computing devices with different architectures coexist. However, careful memory orchestration across heterogeneous devices is needed because copies of the same memory object may reside in multiple devices during execution. Manually ensuring such an orchestration is quite challenging. Not only must an application developer guard against race conditions, but they must also optimize data movement between the host and devices because unnecessary data movement significantly impacts performance. To mitigate these challenges, we enhance the IRIS heterogeneous runtime and introduce IRIS-MEMFLOW–a data flow–enabled portable memory abstraction for seamlessly orchestrating memory in diverse heterogeneous computing environments. By using data-flow analysis, IRIS-MEMFLOW guards against race conditions while multiple heterogeneous devices access memory objects. IRIS-MEMFLOW also optimizes data movement between the host and devices without manual intervention. As a result, IRIS provides improved programming productivity, performance, and portability for multidevice heterogeneous executions in high-performance computing and cloud systems that run diverse architectures from different vendors. The efficacy of IRIS-MEMFLOW is evaluated through experiments that show its capability in terms of programming productivity, multidevice heterogeneity, portability, and low overhead versus the state of the art.

Monil, M. A. H. [ORNL] (ORCID:0000000334194037)↗

Demonstrate Thermal Property Measurement on Irradiated Fuel in IMCL

In order to assist in the post-irradiated measurement of thermal conductivity, the Advanced Fuels Campaign (AFC) of the DOE’s Nuclear Technology Research and Development (NTRD) program has invested in the design and build of a thermal conductivity microscope (TCM) system [3] based upon thermoreflectance methods. The TCM was installed into the Thermal Properties Cell (TPC) in the Irradiated Materials Characterization Laboratory at the Idaho National Laboratory’s (INL) Materials and Fuels Complex (MFC) in December 2018. In addition to the TCM, a Netzsch Laser Flash analyzer (LFA) instrument (model LFA427HC) was designed and built via vendor contract and installed into the TPC in April 2019. These instruments were specifically designed for the measurement of thermal conductivity and diffusivity on irradiated fuels and materials. The TPC began radiological operations on September 12, 2019. In order to demonstrate the successful installation of this new measurement capability the U-Zr fuel system, specifically U-10 wt.% Zr, was chosen as the first material to be evaluated due to its importance to the NTRD program. The results of the first four measurements conducted in the TPC on the LFA and the TCM are given in this report.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Ongoing quality control in digital radiography: Report of AAPM Imaging Physics Committee Task Group 151

Quality control (QC) in medical imaging is an ongoing process and not just a series of infrequent evaluations of medical imaging equipment. The QC process involves designing and implementing a QC program, collecting and analyzing data, investigating results that are outside the acceptance levels for the QC program, and taking corrective action to bring these results back to an acceptable level. The QC process involves key personnel in the imaging department, including the radiologist, radiologic technologist, and the qualified medical physicist (QMP). The QMP performs detailed equipment evaluations and helps with oversight of the QC program, the radiologic technologist is responsible for the day-to-day operation of the QC program. The continued need for ongoing QC in digital radiography has been highlighted in the scientific literature. The charge of this task group was to recommend consistency tests designed to be performed by a medical physicist or a radiologic technologist under the direction of a medical physicist to identify problems with an imaging system that need further evaluation by a medical physicist, including a fault tree to define actions that need to be taken when certain fault conditions are identified. The focus of this final report is the ongoing QC process, including rejected image analysis, exposure analysis, and artifact identification. These QC tasks are vital for the optimal operation of a department performing digital radiography.

60 APPLIED LIFE SCIENCES↗

Deployment and Overview of RAVEN Capabilities for a Probabilistic Risk Assessment Demo for a PWR Station Blackout

Starting in 2012, Idaho National Laboratory (INL) has been engaged to provide tools and methodologies to support a new approach to safety assessment and management of safety related issues for Nuclear Power Plants (NPPs). This activity is placed under the Risk Informed Safety Margin Characterization (RISMC) [2] umbrella that is one of the technical paths of the Department Of Energy (DOE) Light Water Reactor Sustainability (LWRS) Program. RISMC takes a broader approach to risk evaluation by generating more comprehensive information. This information is used to gain a more accurate estimation of risk margins and to highlight feasible improvements that seek the optimal point between risk mitigation and economical viability of the nuclear energy option. This is, of course, done without taking any judgmental approach with respect to risk, which is a regulatory body task, and the economical viability, which is up to the single states and the open electricity market. RISMC is therefore composed of methodologies and tools. The augmented information that RISMC seeks to generate, as enabling decision tool, is not holistic with respect all possible metrics and operational aspects of a power plant; it is rather channeled toward the improvement of safety and the associated economical impact. While these are indeed two very broad metrics, they still allow a focus within the development of the underlying tools that, in a resource constrained environment (DOE founding, computational, mathematical) maximize the benefit of the program to the nuclear industry.

99 GENERAL AND MISCELLANEOUS↗

Proposed Updates to Pu Evaluation for ENDF/B-VIII.0β 2 [Slides]

This presentation shows current status of in ENDF/B-VIII.0 and ENDF/B-VIII.0β 1 Pu evaluations. With a focus on the Pu thermal solutions (PST) and sanity check on fast metal assemblies (PMF). Pu ENDFβ 1 file in the low-energy region included updates in RRR (up to 2.5 keV), TNC and PFNS. Discussed are improvements over ENDF/B-VIII.0 in the C/E benchmarks (PST 81 cases) with preliminary ν p and cross section covariance generation for the resolved resonance energy range up to 2.25 keV. Highlighted are proposed updates for ENDFβ 2 with an extension of the RRR evaluation up to 5 keV, inclusion of Mosby’s data including proper resolution function (thanks to Marian J.), and a particular focus on η energy dependence from thermal up to 10 eV with the impact of the capture-to-fission ratio at 0.29 eV. This presentation concludes with an updated ν p and cross section covariance generation for the resolved resonance energy range up to 5 keV. And additional validation to test performance at about 2 eV and in the keV region.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

A Study on Vitrification for LLW Radioactive Wastes - 16235

Ash and ion exchange resin wastes to be vitrified were considered among various radioactive wastes in the Japanese nuclear industry. The appropriate glass composition for the waste is calculated using the computer program. The glass composition is systematically studied using a ternary diagram, considering viscosity, electrical conductivity, and durability. The optimized glass composition based on calculated parameters of vitrification process and the convenience of mixing wastes is selected for crucible experiment. Since differences between calculated values and measured values may occur upon evaluation of glass formulations using glass formulation computer simulation program, the calculated glass formulations should be verified through experiments on a laboratory scale for more meticulous development of glass formulations. For the follow-up development of glass formulations, several glass formulations are planned to be developed. The candidate glasses for treatment of ash and ion exchange resin were melted and fabricated using reagents, respectively. The chemicals were weighed out to produce the desired batch compositions and mixed thoroughly and then put into clay crucibles for melting. Next, the crucibles were introduced into an electric furnace at 1,150 deg. C in the ambient atmosphere and pressure with occasional stirring by a quartz rod. A hold time of 1 hour was introduced to promote homogenization. Finally, the melted material was poured on a graphite plate to be rapidly cooled. The viscosities of all fabricated glasses were in the desired range. After rapid cooling, the micro-structure of the glasses was analyzed using the SEM. They exhibited amorphous structure with good homogeneity. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

A Review of Candidates for a Validation Data Set for High-Assay Low-Enrichment Uranium Fuels

Many advanced reactor concept designs rely on high-assay low-enriched uranium (HALEU) fuel, enriched up to approximately 19.75% 235 U by weight. Efforts are underway by the US government to increase HALEU production in the United States to meet anticipated needs. However, very few data exist for validation of computational models that include HALEU, beyond a few fresh fuel benchmark specifications in the International Reactor Physics Experiment Evaluation Project. Nevertheless, there are other data with potential value available for developing into quality benchmarks for use in data- and software-validation efforts. This paper reviews the available evaluated HALEU fuel benchmarks and some of the potentially relevant benchmarks for fresh highly enriched uranium. It then introduces experimental data for HALEU fuel irradiated at Idaho National Laboratory, from relatively recent irradiation programs at the Advanced Test Reactor. Such data should be evaluated and, if valuable, collected into detailed benchmark specifications to meet the needs of HALEU-based reactor designers.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Evaluation of Non-electric Market Options for a Light-water Reactor in the Midwest. Light Water Reactor Sustainability program

This study has addressed the technical feasibility and economic viability of LWR hybrid system operations based on realistic market around a specific reactor site in the Upper Midwest United States within the Great Lakes Region and near an industrial center that could benefit from more direct use of nuclear energy. The diverse industrial user and the electricity grid to optimize the revenue of the nuclear plant, depending on specific day-ahead electricity-grid capacity commitments and reserve capacity agreement requirements. For this market arrangement to work, the non-grid user is sold electricity without paying grid service fees (i.e., being considered a house load). This mode of energy sharing may require approval of governing utility commissions, depending on whether the hybrid operations can affect grid supply and manufacturing, agriculture, and transportation systems in this region provides several advantages to converting a nuclear plant into a hybrid plant that produces hydrogen and other feedstock commodities, such as polyethylene or formic acid, for example. Large-scale hydrogen production can essentially service several refineries within 20-30 miles of the nuclear plant. This would results in a measurable reduction of air-pollutant emissions reduction in the region. In addition, a large, consistent supply of hydrogen would draw new industries to the area—especially other steel-reduction and ammonia plants. For example, the nation’s first synthetic-fuels plant could also be sited near this hydrogen plant to convert CO 2 collected from the several ethanol plants in the region into methanol-based chemical feedstock and biofuels. With these perspectives in mind, this study has evaluated the business case for the following hybrid plant options.

08 HYDROGEN↗

Creation of the VADER Code in SCALE [Abstract]

The VADER (Validation Analysis Data Evaluation Resource) is a new module in SCALE 6.3 that has been derived from the legacy USLSTATS program. VADER is a tool that allows the determination of bias and bias uncertainty for criticality safety computational methods. The older USLSTATS program, written in Java, existed outside of SCALE and provided tools to calculate only the confidence band with administrative margin (sometimes called USL-1) and the single-sided uniform width closed interval (USL-2). For normality testing it only offered a crude chi- squared normality test that had no user-configurable options and presented a simple pass/no-pass functionality.

97 MATHEMATICS AND COMPUTING↗

Blind QC trend presentation

Blind testing is used to evaluate performance of the radiobioassay laboratory. DOE-STD-1112-2019 requires a radiobioassay program to perform blind testing at a documented frequency including accuracy, false positive, false negative, and sensitivity evaluations. INL trends accuracy determinations over time for bias, agreement, and precision. Trends have been identified for certain isotopes in urine and feces that have not been fully explained. This presentation will review those identified trends and discuss possible causes and solutions.

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗

Automated Resonance Fitting for Nuclear Data Evaluation

Global and national efforts to deliver high-quality nuclear data to users have a wide-ranging impact, affecting applications in national security, reactor operations, basic science, medicine, and more. Cross section evaluation is a major part of this effort, combining theory and experimentation to produce recommended values and uncertainties for reaction probabilities. Resonance region evaluation is a specialized type of nuclear data evaluation that can require significant manual effort and months of time from expert scientists. In this article, non-convex non-linear optimization methods are combined with concepts of inferential statistics to infer a resonance model from experimental data in an automated manner that is not dependent on prior evaluation(s). This methodology aims to enhance the workflow of a resonance evaluator by minimizing time, effort, and the potential for bias from prior assumptions, while enhancing reproducibility and documentation, thereby addressing well-known challenges in the field.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

End-User Evaluation of SHARP for Analysis of Sodium-Cooled Fast Reactors

The DOE Nuclear Energy Advanced Modeling and Simulation (NEAMS) program is developing the SHARP toolkit to support growing reactor analysis needs in other programs. Although SHARP includes physics modules—especially the computational fluid dynamics code Nek5000 and the structural mechanics tools in Diablo—that have an existing user-base in other fields, most of the analysis and validation efforts for nuclear reactor applications have been performed by members of SHARP’s own development team. The SHARP development team includes engineers and computational scientists from a diverse set of backgrounds, including nuclear engineering. However, before the SHARP tools can be adopted by the Advanced Reactor Technology (ART) program to support the analysis of sodium-cooled fast reactors (SFRs), it would be beneficial for an outside set of analysts and engineers to begin using SHARP and providing feedback to both programs. The authors of this report were charged with learning to use SHARP, applying SHARP to SFR analyses of interest to ART, evaluating the tools, and providing a set of recommendations and requirements to guide future development efforts by the NEAMS program. The authors are engineers (nuclear, mechanical, and civil) by training; all have experience in modeling and simulation for nuclear energy applications; all have either supported ART directly or report to a supervisor who does. This report is a formal summary of the findings of this team of engineers—the potential end-users of SHARP for ART activities. In an informal way, this effort also opened up communication lines between the SHARP developers and ART engineers, which will continue beyond the scope of this effort.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Applying Methodology for Evaluating and Validating TSLs to Materials of Interest to NCSP [Slides]

This presentation covers the topic of applying methodology for evaluation validation of TSLs to material of interest to the Nuclear Criticality Safety Program (NCSP). The talk covers recent efforts in validating thermal neutron scattering cross sections. The presentation also proposes a methodology for not only validating thermal scattering files that utilizes all available experimental data, but also for evaluating new libraries as demonstrated on Polystyrene and Lucite

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Risk Model for EM Decision Support Toolsets

The Government Office of Accountability (GAO) has published several reports identifying the need for the Department of Energy (DOE) Office of Environmental Management (EM) to address mounting costs for DoE's cleanup program. DOEEM could greatly benefit from independent decision tool-sets/models that would allow them to evaluate options and inform business decision at the enterprise level considering site-specific life cycle costs and system plans. Program goals: Develop a tool-set that enables EM to independently evaluate alternatives, assess outcomes from different contracting strategies, and inform critical decisions for the enterprise. Project goals: Adaption of a Risk Model for integration with complimentary tool-sets for project level decision making. Operational Events: Discrete event model that evaluates operational variables (e.g. capacity, throughput, maintenance constraints) and identify bottlenecks. Identifying and Bounding Project Risk: Identify risks that impact confidence in meeting goals (e.g. production). Life cycle Cost: Evaluate impacts of staffing levels, inventory, and capital investments on life cycle costs. Methods and approach: Monte Carlo Analysis is being executed to generate results: Input derives from Risk Register Data; Tied to Projected and Target Schedules; Incorporates float duration within the model. Assumes associated risk mitigation actions being completed within a timeline of five fiscal years. Metrics include: Confidence in Meeting Production Goal; Confidence in Safety Standards; Confidence in Continuous Operation; Other Metrics can be added as appropriate regarding specific site needs. The adapted risk model can be used as a stand alone decision tool or can be integrated complementary tool-sets (i.e. process and cost models) for project-specific decisions. These support tool-sets can then be integrated with others for site- and complex- level evaluations. Future work includes designing an adaptable and modular framework that would allow integration of multiple tool-sets for holistic and/or targeted evaluation of alternative strategies for decision making that could lead to risk and cost reduction across the enterprise.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Preliminary Feasibility of Printing, Microstructure Analysis and Mechanical Performance of a Down Selected Ni Alloy

This report is submitted as completion of a Milestone 3 deliverable under work package ORNL CT-23OR1304051 in support of the Advanced Materials and Manufacturing Technologies (AMMT) program. The AMMT program is aiming at the faster incorporation of new materials and manufacturing technologies into complex nuclear-related systems. An integrated approach, combining advanced characterization, high-throughput and accelerated testing, modeling and simulation including machine learning and artificial intelligence will be employed. While 316H (Fe-16-18Cr-10-14Ni-2-3Mo-0.04-0.1C) has been identified as a key alloy to be integrated into the AMMT accelerated alloy qualification approach due its relevance for many current and future nuclear energy reactors, many other alloys could be considered for the advanced fabrication of innovate high-performance nuclear components. ANL, INL, ORNL and PNNL are collaborating on identifying the most promising alloy candidates relevant for the AMMT program. A selection criteria matrix was established to evaluate the alloys considering their relative importance and technological readiness levels for nuclear energy applications, with a focus on laser powder bed fusion (LPBF). Due to the broad range of potential candidate alloys, ORNL and INL focused on Ni-based alloys, while ANL and PNNL mainly evaluated Fe-based alloys. PNNL previously published materials scorecards reports on several key alloys and this report is providing a broader overview of Ni-based candidate alloys, expending beyond alloys well-known to the nuclear community. Of particular interest are alloys that are currently commercially available in powder form due to the growing demand from other industries that have invested heavily in additive manufacturing. Among these alloys, Haynes 282 (Fe-20Cr-20Co-8Mo) was selected due to its superior strength at high temperature compared to the code-qualified alloy 617 (Ni-20-24Cr-10-15Co-8-10Mo). To assess the integration of this new alloy into the AMMT digital manufacturing framework, we performed the rapid optimization of alloy 282 printing parameters on a Renishaw 250 machine, the fabrication of sufficient materials for extensive characterization and mechanical testing both at ORNL and INL, and added the printing data into the digital platform via the Peregrine software. A detailed analysis of the LPBF 718 alloy was also conducted, with creep specimens being tested at 600-650°C and characterized by advanced electron microscopy. The alloy superior mechanical strength and great printability associated with the extensive database that has already been generated highlight the promising potential of LPBF 718 as a candidate alloy for the AMMT program. INL, ANL and PNNL have generated similar reports and all the information will be compiled into a final M2 milestone report to provide the AMMT leadership team with clear recommendations on the down selection of reactor materials, as well as establish a roadmap for the qualification of these selected alloys.

36 MATERIALS SCIENCE↗

Data Testing of Polyethylene Thermal Scattering Law with New Thermal Epithermal eXperiments (TEX) Plutonium Baseline Benchmark, PU-MET-MIXED-002

Five plutonium baseline experiments completed in September of 2018 from the Thermal Epithermal eXperiments (TEX) program have been accepted by the International Criticality Safety Benchmark Evaluation Project as PU-MET-MIXED-002 and will be included in the 2020 version of the handbook. The experiments were made up of stacked layers of plutonium Zero Power Physics Reactor (ZPPR) plates moderated by polyethylene (PE, chemical formula C2H4) to varying degrees to create configurations with five different neutron spectra, including one fast configuration, one thermal configuration, and three mixed configurations. Calculations of the benchmark show overprediction of k eff when using the most recent release of the Evaluated Nuclear Data File Version B (ENDF/B) library release (VIII.0) cross sections, particularly when compared to the previous ENDF/B-VII.1 results. One potential source of overprediction was hypothesized to be the new Molecular Dynamics (MD) generated PE Thermal Scattering Law (TSL). The overprediction was shown via calculation to not be caused by the new ENDF/B-VIII.0 thermal scattering law, and in fact the overprediction was mitigated by the new PE TSL.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

SU-F-T-226: QA Management for a Large Institution with Multiple Campuses for FMEA

Purpose: To redesign our radiation therapy QA program with the goal to improve quality, efficiency, and consistency among a growing number of campuses at a large institution. Methods: A QA committee was established with at least one physicist representing each of our six campuses (22 linacs). Weekly meetings were scheduled to advise on and update current procedures, to review end-to-end and other test results, and to prepare composite reports for internal and external audits. QA procedures for treatment and imaging equipment were derived from TG Reports 142 and 66, practice guidelines, and feedback from ACR evaluations. The committee focused on reaching a consensus on a single QA program among all campuses using the same type of equipment and reference data. Since the recommendations for tolerances referenced to baseline data were subject to interpretation in some instances, the committee reviewed the characteristics of all machines and quantified any variations before choosing between treatment planning system (i.e. treatment planning system commissioning data that is representative for all machines) or machine-specific values (i.e. commissioning data of the individual machines) as baseline data. Results: The configured QA program will be followed strictly by all campuses. Inventory of available equipment has been compiled, and additional equipment acquisitions for the QA program are made as needed. Dosimetric characteristics are evaluated for all machines using the same methods to ensure consistency of beam data where possible. In most cases, baseline data refer to treatment planning system commissioning data but machine-specific values are used as reference where it is deemed appropriate. Conclusion: With a uniform QA scheme, variations in QA procedures are kept to a minimum. With a centralized database, data collection and analysis are simplified. This program will facilitate uniformity in patient treatments and analysis of large amounts of QA data campus-wide, which will ultimately facilitate FMEA.

43 PARTICLE ACCELERATORS↗