Search NASA⌕ Search

SEARCH · Search NASA

Results for “Program Verification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

Supplement to M&V Guidelines: Measurement and Verification for Performance-Based Contracts Version 4.0

Measurement and verification (M&V) are key to determining and confirming the continued operation of, and savings associated with, performance-based contracts. The Federal Energy Management Program (FEMP) updates these guidelines to reflect the evolution of M&V to incorporate industry best practices and ensure that savings from these performance-based projects are properly planned, communicated, and realized. FEMP released M&V Guidelines: Measurement and Verification for Federal Energy Projects Version 3.0 in 2008. This document was developed with input from industry-government working groups, previous M&V guideline authors, and national laboratory subject matter experts. The document provided the methods and guidelines, with a focus on federal energy savings performance contracts (ESPCs). When FEMP released M&V Guidelines: Measurement and Verification for Performance-Based Contracts Version 4.0 in 2015, FEMP expanded the intended audience to include anyone (energy managers, procurement officers, and contractors) involved in implementing performance-based contracts. The streamlined M&V Guidelines Version 4.0 provided the procedures and guidelines needed to quantify savings resulting from installing energy-efficient equipment, water conservation, improved operation and maintenance (O&M), renewable energy, and cogeneration projects with a performance-based contract; however, it removed some of the associated details on topics such as developing regression models and sampling plans. The details and information provided in M&V Guidelines v. 3.0 are still pertinent to M&V for performance-based contracts. The objective is to keep FEMP M&V version 4.0 condensed, providing the reference document for specifying M&V methods and procedures and a resource for developing project-specific M&V plans; this supplement provides additional details. The content of this supplement has been updated to include pertinent revisions between M&V version 3.0 and M&V version 4.0 by providing details and updating the content to ensure relevancy.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

FAST-1.2 User Installation and Verification Guide: Developed Under NQA-1-2017

The purpose of this document is to provide the user information about the installation of Fuel Analysis for Steady state and Transient (FAST)-1.2 on their computers or servers. General information about the code and supported operating systems is described in Section 1.0. Self-service oriented FAST-1.2 software licensing steps are described in Section 2.0. An installation verification test suite is provided with FAST-1.2 and described in Section 3.0. A convenience script for converting Fuel Rod Analysis Program – Constant (FRAPCON) to FAST inputs is discussed in Section 4.0. FAST-1.2 was developed and released under a software quality assurance program based upon NQA-1-2017 at Pacific Northwest National Laboratory (PNNL). FAST-1.2 is the latest baseline code. The installation verification test suite contains both steady state and transient Anticipated Operation Occurrences (AOOs), accident conditions, such as Reactivity Initiated Accidents (RIAs) and Loss of Coolant Accidents (LOCAs).

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Quantifying Operational Drivers of Multimodal Biometric Verification in Aerial Surveillance

Multimodal biometric verification is increasingly applied across operational contexts ranging from close-range security cameras and building-mounted surveillance to long-range ground sensors and unmanned aerial system (UAS) imagery. Variations in acquisition conditions—such as image resolution, viewing geometry, and motion artifacts—pose significant challenges for cross-domain algorithmic generalization. This study evaluates two independent multimodal biometric verification systems developed under the Intelligence Advanced Research Projects Activity (IARPA) Biometric Recognition and Identification at Altitude and Range (BRIAR) program, comparing performance on close-range and aerial datasets. Close-range video served as a baseline to quantify the decline in verification performance on aerial footage. The dataset included six UAS platforms, spanning small quadcopters at 10m altitude to medium-sized fixed-wing aircraft at 360m. Mixed-effects logistic regression identified image resolution (head and body pixel counts), head height, sensor characteristics, and algorithm selection as primary determinants of verification success, whereas demographic attributes and mission gait were not significant predictors. Activity type and collection site influenced performance in close-range data but had negligible impact on UAS imagery. These results clarify modality-specific strengths and limitations and highlight opportunities to enhance cross-domain biometric verification.

Peluso, Alina [ORNL] (ORCID:0000000328950406)↗

Fiscal Year 2023 Software Quality Assurance Activities for the ARC Software

The Argonne Reactor Code (ARC) software suite [1-17] has been developed by Argonne researchers for fast reactor design and analysis since the 1970s. With the ARC software suite, a user can quickly build a model of a proposed or existing fast spectrum reactor and carry out fuel cycle, nominal thermal analysis and flow requirements, and assess, as is appropriate, whether the core design and constraint system yield an acceptable mechanical behavior. For transient reactor analysis with SAS4A [18], the ARC software suite can be used to generate reactivity coefficients and kinetics parameters at any modeled fuel cycle time point which forms part of the input to SAS4A. The ARC suite was consistently being developed until the 1990s and followed a software QA program which was an appropriate standard for the time. In the 1990s, the DOE funding to fast reactor research and development was all but eliminated and the ARC software was put into maintenance mode. In the early 2000s, the software quality assurance (SQA) program for ARC was still in place to define an official version, but by 2005 it all but was abandoned as there were insufficient staff to fill the work roles. Since 2005, there has been a considerable increase in research and design work on fast spectrum reactors. The ARC software as a whole has since been exported to many universities and commercial companies and ANL support has been given to the various projects over the years [19-23]. Further, MC 2 -3, PERSENT, and DASSH were all developed after 2005 without any adherence to a software standard. In recent time, the DOE VTR project [22] paid for verification work to be done on the ARC software as part of the goal of making it NQA-1 complaint. The VTR project was not considered the appropriate pathway to fund and maintain a SQA program for the ARC software and while software developments (DASSH) were made and several manuals were updated and software verification work was carried out, the ARC software is not NQA-1 compliant. More recently the Advanced Reactor Development Program (ARDP [23]) has funded the creation of manuals for some ARC utility programs and funded additional software verification work on DIF3D [6, 7] and MC 2 -3 [2-5] for the purpose of commercial grade dedication. Because of the VTR and ARDP projects, software verification work was completed on MC 2 -3 and DIF3D, and detailed reports were created for each piece of software, which discuss the inputs and outputs from the codes that are covered by the verification work and link various analytic, code-to-code, and hand calculation based verification work presented in the report with verification test problems provided with the software. This is a key part of the commercial grade dedication work and constitutes the bulk of the cost to get the ARC software to commercial grade. The ARC software suite is a valuable asset as a fast reactor design and analysis tool set that has been reasonably well verified and validated with various fast reactor benchmark problems and experiments over decades. Some or all of the ARC software suite has been utilized for designing the IFR [20], PGSFR [21], VTR [22], and Natrium [23] reactors and we can expect it to continue to be used for advanced fast reactor design and/or confirmatory calculation purposes in the future. Due to increased interest by commercial companies and regulatory bodies, it is becoming more important to make the ARC software suite complete and ready-to-use in terms of its SQA pedigree and commercial grade dedication needs. This report discusses the achievements made towards building a new SQA program for the ARC software and dealing with outstanding identified QA gaps.

97 MATHEMATICS AND COMPUTING↗

Ba 1−x Sr x FeO 3−δ as an improved oxygen storage material for chemical looping air separation: a computational and experimental study

Chemical looping air separation (CLAS) is a promising technology to generate oxygen-rich gas streams to enable efficient carbon dioxide capture during fossil fuel combustion or gasification. CLAS relies on the capture and release of oxygen from the atmosphere using the redox properties of an oxygen-selective solid oxide carrier. This study investigates the redox characteristics of Ba 1−x Sr x FeO 3−δ (0.0 ≤ x ≤ 0.417, 0.0 ≤ δ ≤ 0.5) using a combination of density functional theory (DFT) calculations and experimental verification using X-ray diffraction, thermogravimetric analysis, and oxygen-temperature-programmed desorption. The DFT computed energies of the Ba 1−x Sr x FeO 3−δ perovskites reveal a composition-dependent transition from hexagonal to cubic phases as the Sr-concentration or oxygen vacancy concentration increases. Oxygen vacancy formation energies of the cubic perovskites are found to be lower than those of their hexagonal counterparts. A low oxygen diffusion barrier of ∼1 eV combined with the thermodynamic preference of Ba 1−x Sr x FeO 3−δ compositions that form in a cubic phase suggests them as promising candidates for oxygen storage applications. The experimental results corroborate this finding by identifying Ba 0.75 Sr 0.25 FeO 3−δ in the cubic phase as an optimal composition offering low-temperature oxygen storage capacities comparable to that of the state-of-the-art Sr 0.75 Ca 0.25 FeO 3−δ perovskite oxygen storage material at 325 °C and 350 °C.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Assessing the Reliability of Relevant Tweets and Validation Using Manual and Automatic Approaches for Flood Risk Communication

While Twitter has been touted as a preeminent source of up-to-date information on hazard events, the reliability of tweets is still a concern. Our previous publication extracted relevant tweets containing information about the 2013 Colorado flood event and its impacts. Using the relevant tweets, this research further examined the reliability (accuracy and trueness) of the tweets by examining the text and image content and comparing them to other publicly available data sources. Both manual identification of text information and automated (Google Cloud Vision, application programming interface (API)) extraction of images were implemented to balance accurate information verification and efficient processing time. The results showed that both the text and images contained useful information about damaged/flooded roads/streets. This information will help emergency response coordination efforts and informed allocation of resources when enough tweets contain geocoordinates or location/venue names. This research will identify reliable crowdsourced risk information to facilitate near real-time emergency response through better use of crowdsourced risk communication platforms.

54 ENVIRONMENTAL SCIENCES↗

GHEP WIBT (Guidelines for Home Energy Professionals Weatherization Installer Badges Toolkit) [SWR-20-69]

The National Renewable Energy Laboratory (NREL) and the U.S. Department of Energy's (DOE) Weatherization Assistance Program (WAP) are collaborating with the home energy retrofit industry to support the development of skilled workers. The Installer Badges Toolkit provides a flexible, customizable, and voluntary approach to training and skills recognition for WAP implementers, utility programs, private-sector workers, and contractors. In Fiscal Year 2018, DOE, along with the Crew Leader scheme committee, determined the Retrofit Installer Technician (RIT) Job Task Analysis (JTA) could be eliminated and its tasks inserted in the Crew Leader JTA. The RIT tasks became the basis of the Installer Badges. The Badges Toolkit was updated in 2020 to add licensing and copyright agreements. Users must cite the copyright information when using or distributing copies of the Badges Toolkit in any way. The technical content has remained unchanged from previous versions of the Badges Toolkit. The Toolkit for home retrofits consists of 25 Badges, each representing different energy efficiency tasks that an installer could perform on a home. Each Badge defines the desired outcome, criteria to verify, applicable material requirements, and references to Standard Work Specifications (SWS) or other relevant standards. The Badges provide a consistent approach to training by ensuring that installers in different regions are learning the same skills nationwide. Organizations can also customize the Toolkit by choosing only those Badges that are relevant to their program. The Badges Toolkit includes five pieces: "How to Use the Badges Toolkit" provides a brief overview of how a Grantee, Subgrantee, or training provider may approach using the toolkit. The "Badges Toolkit: Worksheet" includes what to consider when determining whether and how to best incorporate the Badges into a weatherization assistance program. The "Crew Leader Job Task Analysis Spreadsheet" indicates how the Badges align with specific areas of the JTA. The "Installer Badges Passport" features separate pages for each Badge, which include places for the installer and the supervisor/trainer to record the number of times a task has been successfully completed. The "Installer Badges Verification Criteria" includes sample inspection checklists for each Badge. These can be modified as needed based on approved variance requests or more stringent requirements. They also provide a basis for consistent inspections and awarding of Badges. Note: All elements of the Badges Toolkit are designed for use by potential program implementers. They are not off-the-shelf products intended for immediate deployment. Program implementers must review and modify as needed, revise verification criteria to match local requirements, complete worksheets, and otherwise define the parameters of their own badging program.

Desai, Jal↗

A Formalization of Core Why3 in Coq

Intermediate verification languages like Why3 and Boogie have made it much easier to build program verifiers, transforming the process into a logic compilation problem rather than a proof automation one. Why3 in particular implements a rich logic for program specification with polymorphism, algebraic data types, recursive functions and predicates, and inductive predicates; it translates this logic to over a dozen solvers and proof assistants. Accordingly, it serves as a backend for many tools, including Frama-C, EasyCrypt, and GNATProve for Ada SPARK. But how can we be sure that these tools are correct? The alternate foundational approach, taken by tools like VST and CakeML, provides strong guarantees by implementing the entire toolchain in a proof assistant, but these tools are harder to build and cannot directly take advantage of SMT solver automation. As a first step toward enabling automated tools with similar foundational guarantees, we give a formal semantics in Coq for the logic fragment of Why3. We show that our semantics are useful by giving a correct-by-construction natural deduction proof system for this logic, using this proof system to verify parts of Why3's standard library, and proving sound two of Why3's transformations used to convert terms and formulas into the simpler logics supported by the backend solvers.

97 MATHEMATICS AND COMPUTING↗

Source Term Reduction for Advanced and Small Modular Boiling Water Reactors

The United States Department of Energy (US DOE) is currently supporting the development of various advanced and small modular reactor (SMR) designs. Several of these designs have commenced license application with the US Nuclear Regulatory Commission (US NRC). These reactors have improved safety features that may significantly reduce radiological source terms in the event of design and beyond-design basis accidents. Specifically, some reactors feature a smaller containment volume relative to the available fission product depositional surface area, which supports increased fission product retention in the containment vessel. Pressurized water reactors (PWR) and boiling water reactors (BWR) with this feature include the integral pressurized water reactor (iPWR) and the BWRX-300 design by General Electric. A prior research program supported by the US DOE quantified the source term reduction associated with light water iPWRs and developed iPWR-specific theoretical models for fission product deposition rates. This program included a sequence of research projects that started with a feasibility study, development of theoretical models that predict higher deposition rates, and finally, development of empirical data for verification and validation of the theoretical models. The current project, which is a feasibility study, is the first step in a similar program to quantify the source term reduction associated with small and advanced light water BWRs.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

User Manual for MC 2 -3 Gamma Library Generation

This report provides the documentation for the revised procedure to generate the MC 2 -3 gamma library with the latest versions of PreGAMMA and GenGAMMA which have recently been updated to fix the program errors and inconsistent data processing for some isotopes identified in a recent verification and validation study of the MC 2 -3 gamma library. A few associated errors associated with gamma processing were also identified and fixed in the MC 2 -3 code. Addressing the changes in MC 2 -3, the procedure to generate the PMATRX and GAMISO datasets is discussed as well. The input data of PreGAMMA and GenGAMMA are discussed in detail using sample input data. In addition, the structure and formats of the MC 2 -3 gamma library are provided in detail.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Chapter 17: Residential Behavior Evaluation Protocol. The Uniform Methods Project: Methods for Determining Energy Efficiency Savings for Specific Measures, September 2011 - August 2020

This document has been updated in August 2020. This document was developed for the U.S. Department of Energy Uniform Methods Project (UMP). The UMP provides model protocols for determining energy and demand savings that result from specific energy-efficiency measures implemented through state and utility programs. In most cases, the measure protocols are based on a particular option identified by the International Performance Verification and Measurement Protocol; however, this work provides a more detailed approach to implementing that option. Each chapter is written by technical experts in collaboration with their peers, reviewed by industry experts, and subject to public review and comment. The protocols are updated on an as-needed basis. The UMP protocols can be used by utilities, program administrators, public utility commissions,evaluators, and other stakeholders for both program planning and evaluation. To learn more about the UMP, visit the website, https://energy.gov/eere/about-us/ump-home, or download the UMP introduction document at http://www.nrel.gov/docs/fy17osti/68557.pdf.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Baseline Characterization Database Verification Report ? NBG-17 Billet V104

The purpose of this report is to present data collected in the Baseline Graphite Characterization Program, which is directly tasked with supporting the Idaho National Laboratory’s (INL’s) research and development efforts on the Advanced Reactor Technologies (ART) Program. This program populates a comprehensive database that reflects the baseline properties of nuclear-grade graphite regarding individual grade, billet, and position within individual billets. The physical- and mechanical-property information being collected will be transferred to the Nuclear Data Management and Analysis System (NDMAS), and that database will help populate the handbook of property data available to member nations of the Generation-IV International Forum. Transfer of these data from the applicable technical lead to the dissemination databases available to other end users requires a full review of the test procedures and data-collection efforts through an analysis of the multiple summary spreadsheets and values being collected. This report represents the analysis for NBG-17 Billet V104 and facilitates release of associated data to the NDMAS custodians. Millions of raw data points have been collected during testing and quantification analyses for these billets. The summary scalar property values and supplementary traceability data are collected into comprehensive spreadsheets. Data sets are composed of single billets of graphite for any given grade, organized by mechanical test-specimen type, and further subdivided into individual spreadsheet tabs according to the specific test or evaluation being performed. A direct analysis of properties was not conducted, and this report does not provide information on the validity or performance characteristics of the graphite itself. Rather, this report is intended as a verification of the completeness of actual data collected in accordance with PLN-3467, “Baseline Graphite Characterization Plan: Electromechanical Testing,” [1] and PLN-3348 “Graphite Mechanical Testing” [2] and their representation of the measurement and test results with sole regard to the graphite billets under evaluation.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Code and Solution Verification Assessment of the CTF Thermal Hydraulic Subchannel Code

CTF is a thermal-hydraulics subchannel code jointly developed by Oak Ridge National Laboratory and North Carolina State University. Over the past seven years, the Consortium for Advanced Simulation of Light Water Reactors (CASL) has made a significant investment in developing CTF so it can be used to model light water reactors, including nominal operating conditions, departure from nucleate boiling analysis, and transients ranging from loss of flow to reactivity insertion accidents. In addition to implementing new modeling capabilities and developing the user input and output interface, extensive work has been performed to improve the code’s quality assurance program, resulting in a development process that conforms with NQA-1 requirements. The CASL program follows the Predictive Capability Maturity Model (PCMM) approach for assessing code quality, which emphasizes performing code verification(ensuring the code converges to the correct answer) and solution verification (ensuring the code converges for the intended application). Code and solution verification are used to identify uncertainty errors introduced by numerical approximations in the code and are important for demonstrating that the model is coded without error, which is an important aspect of the Best Estimate plus Uncertainty method. This paper presents a comprehensive overview of the code and solution verification testing that has been performed on CTF. A top-down approach is taken in which the intended CTF applications are presented, followed by the code features required for their modeling. These features are then linked to the applicable code and solution verification tests that demonstrate proper functioning. Past testing efforts are summarized, and new tests are added to help close gaps in the presented test matrix. Rather than performing “one-off” exercises, these tests are added to the automated CTF regression test suite to ensure continual code quality.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

A Review of Cardiac Radioablation (CR) for Arrhythmias: Procedures, Technology, and Future Opportunities

Cardiac radioablation (CR), a new treatment for cardiac arrhythmias such as ventricular tachycardia and atrial fibrillation, has had promising clinical outcomes to date. There is consequent desire for rapid clinical adoption. However, CR presents unique challenges to radiation therapy, and it is paramount that clinical adoption be performed safely and effectively. Recent reviews comprehensively detail patient selection, clinical history, treatment outcomes, and treatment toxicities but only briefly mention the technical aspects of CR. To address this knowledge gap, this review collates currently available knowledge regarding CR technology choice and procedural details to help inform and guide clinics considering implementing their own CR program, to aid technique standardization, and to highlight areas that require further development or verification.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Verification of the Serpent-Griffin Workflow using the SNAP 8 Experimental Reactor

The Systems for Nuclear Auxiliary Power (SNAP) program accumulated extensive experimental measurements over a span of 15 years. This work builds upon previous studies which validated Serpent against experimental data for various criticality configurations of the SNAP 8 Experimental Reactor (S8ER). A 2-stage sequence is applied here with Serpent used for the generation of few-group cross sections and Griffin as the transport eigenvalue solver. Sensitivity studies are performed to qualify the effect and uncertainty of various parameters, comparing against reference models for the S8ER. The results from this work will then be expanded to create a generalized methodology for the Serpent-Griffin 2-stage approach for microreactor applications.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Spatio-temporal impacts of a utility’s efficiency portfolio on the distribution grid

Energy Efficiency has historically focused on delivering savings to offset growth in energy supply. Today’s growing emphasis on decarbonization of the energy supply is driving renewables adoption and increased interest in electrification. As a result, energy efficiency is being assessed not just in its ability to offset load growth, but also for its ability to alleviate location-specific constraints on transmission and distribution infrastructure. This work demonstrates that advanced measurement and verification modeling techniques can be used to estimate the spatio-temporal grid impact of a portfolio of energy efficiency programs. It extends measurement-based methods to an entire Demand Side Management portfolio and uses a single model to predict annual as well as seasonal building energy use with near-zero bias. In addition, new metrics are introduced to assess grid level impacts of energy efficiency. The results show that the efficiency program portfolio delivers savings of over 12% at the territory-wide proxy level, with substation and feeder level savings ranging from 0.4% to 26%, and ~5%-42% respectively. Overall, these savings impacted 1.0%–1.4% of the energy used at these locations in the grid. This work provides a methodology with potential to connect efficiency with distribution planning, carrying implications for non-wires alternatives and targeted delivery of efficiency programs.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Reference document for LANL stack sampling and ANSI N13.1 (Article) Gielow RL and McNamee MR 1993. Numerical Flue Gas Flow Modeling for Continuous Emissions Monitoring Applications. EPRI CEM Users Group Meeting. Baltimore. RP1961-13

American National Standard N13.1 “sets forth guidelines and performance criteria for sampling the emissions of airborne radioactive substances in the air discharge ducts and stacks of nuclear facilities. Emphasis is on extractive sampling from a location in a stack or duct where the contaminant is well mixed. At such a location, sampling may be conducted at a single point. This standard provides performance-based criteria for the use of air sampling probes, transport lines, sample collectors, sample monitoring instruments, and gas flow measuring methods. This standard also covers sampling program objectives, quality assurance issues, developing air sampling action levels, system optimization, and system performance verification. Workplace, containment, and environmental air monitoring are not addressed. Specific sample analysis methods and the reporting or interpreting of results are also not addressed.” (HPS 2011).

61 RADIATION PROTECTION AND DOSIMETRY↗

Verification of the ENDF/B-VII.1 Based MC 2 -3 Library Rev.1

The MC 2 -3 code, developed by Argonne National Laboratory under the DOE-NE NEAMS program, is a multigroup cross section generation code for fast reactor applications. Last year, the ENDF/B-VII.0 (E70) MC 2 -3 library, which has been extensively used, verified, and validated over a long period, was intensively reverified and updated to support the commercial grade dedication (CGD) requirement of the TerraPower Natrium project. This year, the ENDF/B-VII.1 (E71) MC 2 -3 library, the preliminary version of which was generated several years ago, was regenerated and rigorously verified to support the Natrium project as well as the completion of verification of the E71 library. The E71 library was verified using the process developed during the verification of the E70 library, including comparisons of cross sections with the NJOY-generated cross sections, comparisons of the resolved resonance cross sections with those using the PEDNF library, and comparison of total cross sections with the sum of partial cross sections. Additional verifications were conducted to ensure that the benchmark problem solutions with the E71 library are reasonable compared to the corresponding Monte Carlo solutions. Furthermore, the E71 gamma library was generated, which includes data for prompt gamma, delayed gamma, and delayed beta as well as neutron and gamma heating. The gamma library was verified at the level of individual isotopes. The EBR-II core solutions from MC 2 -3/ DIF3D and MCNP were compared, demonstrating that those solutions in terms of k-effective and assembly powers were in good agreement.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗