Search NASA⌕ Search

SEARCH · Search NASA

Results for “program verification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,369 records · Page 76

Comparing Free-Free and Shaker Table Model Correlation Methods Using Jim Beam

Finite element model correlation as part of a spacecraft program has always been a challenge. For any NASA mission, the coupled system response of the spacecraft and launch vehicle can be determined analytically through a Coupled Loads Analysis (CLA), as it is not possible to test the spacecraft and launch vehicle coupled system before launch. The value of the CLA is highly dependent on the accuracy of the frequencies and mode shapes extracted from the spacecraft model. NASA standards require the spacecraft model used in the final Verification Loads Cycle to be correlated by either a modal test or by comparison of the model with Frequency Response Functions (FRFs) obtained during the environmental qualification test. Due to budgetary and time constraints, most programs opt to correlate the spacecraft dynamic model during the environmental qualification test, conducted on a large shaker table. For any model correlation effort, the key has always been finding a proper definition of the boundary conditions. This paper is a correlation case study to investigate the difference in responses of a simple structure using a free-free boundary, a fixed boundary on the shaker table, and a base-drive vibration test, all using identical instrumentation. The NAVCON Jim Beam test structure, featured in the IMAC round robin modal test of 2009, was selected as a simple, well recognized and well characterized structure to conduct this investigation. First, a free-free impact modal test of the Jim Beam was done as an experimental control. Second, the Jim Beam was mounted to a large 20,000 lbf shaker, and an impact modal test in this fixed configuration was conducted. Lastly, a vibration test of the Jim Beam was conducted on the shaker table. The free-free impact test, the fixed impact test, and the base-drive test were used to assess the effect of the shaker modes, evaluate the validity of fixed-base modeling assumptions, and compare final model correlation results between these boundary conditions.

Modal Test↗

Verification of RESRAD-RDD. (Version 2.01)

In this report, the results generated by RESRAD-RDD version 2.01 are compared with those produced by RESRAD-RDD version 1.7 for different scenarios with different sets of input parameters. RESRAD-RDD version 1.7 is spreadsheet-driven, performing calculations with Microsoft Excel spreadsheets. RESRAD-RDD version 2.01 revamped version 1.7 by using command-driven programs designed with Visual Basic.NET to direct calculations with data saved in Microsoft Access database, and re-facing the graphical user interface (GUI) to provide more flexibility and choices in guideline derivation. Because version 1.7 and version 2.01 perform the same calculations, the comparison of their results serves as verification of both versions. The verification covered calculation results for 11 radionuclides included in both versions: Am-241, Cf-252, Cm-244, Co-60, Cs-137, Ir-192, Po-210, Pu-238, Pu-239, Ra-226, and Sr-90. At first, all nuclide-specific data used in both versions were compared to ensure that they are identical. Then generic operational guidelines and measurement-based radiation doses or stay times associated with a specific operational guideline group were calculated with both versions using different sets of input parameters, and the results obtained with the same set of input parameters were compared. A total of 12 sets of input parameters were used for the verification, and the comparison was performed for each operational guideline group, from A to G, sequentially. The verification shows that RESRAD-RDD version 1.7 and RESRAD-RDD version 2.01 generate almost identical results; the slight differences could be attributed to differences in numerical precision with Microsoft Excel and Visual Basic.NET. RESRAD-RDD version 2.01 allows the selection of different units for use in reporting calculation results. The results of SI units were obtained and compared with the base results (in traditional units) used for comparison with version 1.7. The comparison shows that RESRAD-RDD version 2.01 correctly reports calculation results in the unit specified in the GUI.

54 ENVIRONMENTAL SCIENCES↗

Validation of ORIGEN for VVER-440 Spent Fuel with Application to Fork Detector Safeguards Measurements

The US Department of Energy National Nuclear Security Administration and the European Atomic Energy Community (Euratom) are collaborating with the Radiation and Nuclear Safety Authority in Finland to assess spent fuel verification methods for potential application to measurements at the planned spent fuel encapsulation plant and geological repository prior to final disposal in Finland. The fork detector (FDET) used to measure the neutron and gamma radiation from a given spent fuel assembly is an existing technology widely used by the International Atomic Energy Agency (IAEA) and Euratom for the safeguards verification of spent fuel operator declaration. Recently, an FDET data analysis software, referred to as the ORIGEN module, was developed and incorporated into the IAEA/Euratom Integrated Review and Analysis Program. This module uses the ORIGEN burnup code to calculate the nuclide concentrations and the neutron and gamma source terms in the spent fuel based on operator declarations. Then, to predict the expected FDET signals for a given fuel assembly, the module combines the source terms calculated by ORIGEN with FDET response functions that were pre-generated using MCNP models. The inspector can compare the calculated signals to the measured values in real time to identify possible anomalies in fuel assembly’s operator declaration, integrity, or measurement. In this work, the capability of the ORIGEN module was extended from application to typical light water reactor fuels to use for VVER-440 assembly types. The accuracy of ORIGEN for this type of fuel assembly calculations was assessed by comparing calculated nuclide concentrations against destructive assay measurements for VVER-440 spent fuel. The performance of the ORIGEN module for FDET safeguards verification in routine inspections was assessed using FDET measurement data for 13 spent VVER-440 assemblies that were measured at the Loviisa Nuclear Power Plant in Finland, by comparing the calculated signals to the measured quantities. The results show that the calculated FDET neutron and gamma detector signals are generally within 12% of the measurements except for one assembly. Thus, these results are applicable to future safeguards verification in the planned Finland encapsulation plant, such as for passive neutron albedo reactivity safeguards measurements.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

Simulator verification techniques study. Integrated simulator self test system concepts

Software and hardware requirements for implementing hardware self tests are presented in support of the development of training and procedures development simulators for the space shuttle program. Self test techniques for simulation hardware and the validation of simulation performance are stipulated. The requirements of an integrated simulator self system are analyzed. Readiness tests, fault isolation tests, and incipient fault detection tests are covered.

Montoya, G.↗

Orbital transfer rocket engine technology program: Soft wear ring seal technology

Liquid oxygen (LOX) compatibility tests, including autogenous ignition, promoted ignition, LOX impact tests, and friction and wear tests on different PV products were conducted for several polymer materials as verification for the implementation of soft wear ring seals in advanced rocket engine turbopumps. Thermoplastics, polyimide based materials, and polyimide-imide base materials were compared for oxygen compatibility, specific wear coefficient, wear debris production, and heat dissipation mechanisms. A thermal model was generated that simulated the frictional heating input and calculated the surface temperature and temperature distribution within the seal. The predictions were compared against measured values. Heat loads in the model were varied to better match the test data and determine the difference between the measured and the calculated coefficients of friction.

Lariviere, Brian W.↗

Ongoing Fixed Wing Research within the NASA Langley Aeroelasticity Branch

The NASA Langley Aeroelasticity Branch is involved in a number of research programs related to fixed wing aeroelasticity and aeroservoelasticity. These ongoing efforts are summarized here, and include aeroelastic tailoring of subsonic transport wing structures, experimental and numerical assessment of truss-braced wing flutter and limit cycle oscillations, and numerical modeling of high speed civil transport configurations. Efforts devoted to verification, validation, and uncertainty quantification of aeroelastic physics in a workshop setting are also discussed. The feasibility of certain future civil transport configurations will depend on the ability to understand and control complex aeroelastic phenomena, a goal that the Aeroelasticity Branch is well-positioned to contribute through these programs.

Bartels, Robert↗

SU-F-T-463: Light-Field Based Dynalog Verification

Purpose: To independently verify leaf positions in so-called dynalog files for a Varian iX linac with a Millennium 120 MLC. This verification provides a measure of confidence that the files can be used directly as part of a more extensive intensity modulated radiation therapy / volumetric modulated arc therapy QA program. Methods: Initial testing used white paper placed at the collimator plane and a standard hand-held digital camera to image the light and shadow of a static MLC field through the paper. Known markings on the paper allow for image calibration. Noise reduction was attempted with removal of ‘inherent noise’ from an open-field light image through the paper, but the method was found to be inconsequential. This is likely because the environment could not be controlled to the precision required for the sort of reproducible characterization of the quantum noise needed in order to meaningfully characterize and account for it. A multi-scale iterative edge detection algorithm was used for localizing the leaf ends. These were compared with the planned locations from the treatment console. Results: With a very basic setup, the image of the central bank A leaves 15–45, which are arguably the most important for beam modulation, differed from the planned location by [0.38±0.28] mm. Similarly, for bank B leaves 15–45 had a difference of [0.42±0.28] mm Conclusion: It should be possible to determine leaf position accurately with not much more than a modern hand-held camera and some software. This means we can have a periodic and independent verification of the dynalog file information. This is indicated by the precision already achieved using a basic setup and analysis methodology. Currently, work is being done to reduce imaging and setup errors, which will bring the leaf position error down further, and allow meaningful analysis over the full range of leaves.

60 APPLIED LIFE SCIENCES↗

An Overview of NASA's Program of Future M&S VV&A Outreach and Training Activities

NASA's Exploration Systems Mission Directorate (ESMD) is implementing a management approach for modeling and simulation (M&S) that will provide decision-makers information on the model s fidelity, credibility, and quality. The Integrated Modeling & Simulation Verification, Validation and Accreditation (IM&S W&A) process will allow the decision-maker to understand the risks involved in using a model s results for mission-critical decisions. The W&A Technical Working Group (W&A TWG) has been identified to communicate this process throughout the agency. As the W&A experts, the W&A NVG will be the central resource for support of W&A policy, procedures, training and templates for documentation. This presentation will discuss the W&A Technical Working Group s outreach approach aimed at educating M&S program managers, developers, users and proponents on the W&A process, beginning at MSFC with the CLV program.

Caine, Lisa↗

Application of HFE to the design and V and V of a computerized procedure system: benefits and challenges - 234

The application of Human Factors Engineering (HFE) practices to the Human Machine Interface design and subsequent Verification and Validation (V and V) is a widely applied practice when talking about the design of complete control rooms or important control room modernizations, but not so often applied to the design of computerized operator support systems. In order to overcome the challenges faced on designing a Computerized Operation Support System (COSS) that meets the process efficiency requirements and integrates seemingly with hybrid plant operation concept, the involvement of a HFE team early in the COSS design and implementation process along with operation, Instrumentation and Control (I and C) and cybersecurity experts will guarantee the project success. This paper documents the HFE process applied during the design and evaluation of a Computerized Procedure System (CPS) and how final product was shaped to ensure that the transition from paper to computerized procedures will help in meeting Delivering the Nuclear Promise (DNP) goals, improving plant efficiency. The HFE program included the following activities: 1. A review of existing operating experience 2. An analysis of functions and tasks associated to the use and maintenance of CPS 3. A design verification of the system to meet guidelines prescribed in the NUREG-0700 (Rev.2), requirements of the ISG-05 and cybersecurity criteria (NEI 08-09, IEC-62646, EPRI 1015313, these among others). 4. An integrated system validation in a full scope simulator The application of HFE practices in the design and implementation of COSS helps not only to ensure that efficiency and safety improvement requirements are met, but also to evaluate the potential return of the investment, that such tools should bring. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

The Status and Promise of Advanced M&V: An Overview of “M&V 2.0” Methods, Tools, and Applications

Advanced measurement and verification (M&V) of energy efficiency savings, often referred to as M&V 2.0 or advanced M&V, is currently an object of much industry attention. Thus far, however, there has been a lack of clarity about what techniques M&V 2.0 includes, how those techniques differ from traditional approaches, what the key considerations are for their use, and what value propositions M&V 2.0 presents to different stakeholders. The objective of this paper is to provide background information and frame key discussion points related to advanced M&V. The paper identifies the benefits, methods, and requirements of advanced M&V and outlines key technical issues for applying these methods. It presents an overview of the distinguishing elements of M&V 2.0 tools and of how the industry is addressing needs for tool testing, consistency, and standardization, and it identifies opportunities for collaboration. In this paper, we consider two key features of M&V 2.0: (1) automated analytics that can provide ongoing, near-real-time savings estimates, and (2) increased data granularity in terms of frequency, volume, or end-use detail. Greater data granularity for large numbers of customers, such as that derived from comprehensive implementation of advanced metering infrastructure (AMI) systems, leads to very large data volumes. This drives interest in automated processing systems. It is worth noting, however, that automated processing can provide value even when applied to less granular data, such as monthly consumption data series. Likewise, more granular data, such as interval or end-use data, delivers value with or without automated processing, provided the processing is manageable. But it is the combination of greater data detail with automated processing that offers the greatest opportunity for value. Using M&V methods that capture load shapes together with automated processing1 can determine savings in near-real time to provide stakeholders with more timely and detailed information. This information can be used to inform ongoing building operations, provide early input on energy efficiency program design, or assess the impact of efficiency by location and time of day. Stakeholders who can make use of such information include regulators, energy efficiency program administrators, program evaluators, contractors and aggregators, building owners, the investment community, and grid planners. Although each stakeholder has its own priorities and challenges related to savings measurement and verification, the potential exists for all to draw from a single set of efficiency valuation data. Such an integrated approach could provide a base consistency across stakeholder uses.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

FISPACT-II: An Advanced Simulation System for Activation, Transmutation and Material Modelling

Fispact-II is a code system and library database for modelling activation-transmutation processes, depletion-burn-up, time dependent inventory and radiation damage source terms caused by nuclear reactions and decays. The Fispact-II code, written in object-style Fortran, follows the evolution of material irradiated by neutrons, alphas, gammas, protons, or deuterons, and provides a wide range of derived radiological output quantities to satisfy most needs for nuclear applications. It can be used with any ENDF-compliant group library data for nuclear reactions, particle-induced and spontaneous fission yields, and radioactive decay (including but not limited to TENDL-2015, ENDF/B-VII.1, JEFF-3.2, JENDL-4.0u, CENDL-3.1 processed into fine-group-structure files, GEFY-5.2 and UKDD-16), as well as resolved and unresolved resonance range probability tables for self-shielding corrections and updated radiological hazard indices. The code has many novel features including: extension of the energy range up to 1 GeV; additional neutron physics including self-shielding effects, temperature dependence, thin and thick target yields; pathway analysis; and sensitivity and uncertainty quantification and propagation using full covariance data. The latest ENDF libraries such as TENDL encompass thousands of target isotopes. Nuclear data libraries for Fispact-II are prepared from these using processing codes PREPRO, NJOY and CALENDF. These data include resonance parameters, cross sections with covariances, probability tables in the resonance ranges, PKA spectra, kerma, dpa, gas and radionuclide production and energy-dependent fission yields, supplemented with all 27 decay types. All such data for the five most important incident particles are provided in evaluated data tables. The Fispact-II simulation software is described in detail in this paper, together with the nuclear data libraries. The Fispact-II system also includes several utility programs for code-use optimisation, visualisation and production of secondary radiological quantities. Included in the paper are summaries of results from the suite of verification and validation reports available with the code.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Reproducibility Practice in High-Performance Computing: Community Survey Results

The integrity of science and engineering research is grounded in assumptions of rigor and transparency on the part of those engaging in such research. HPC community effort to strengthen rigor and transparency take the form of reproducibility efforts. In a recent survey of the SC conference community, we collected information about the SC Reproducibility Initiative activities. Here, we present the survey results in this paper. Results show that the reproducibility initiative activities have contributed to higher levels of awareness on the part of SC conference technical program participants, and hint at contributing to greater scientific impact for the published papers of the SC conference series. Stringent point-of-manuscript-submission verification is problematic for reasons we point out, as are inherent difficulties of computational reproducibility in HPC. Future efforts should better decouple the community educational goals from goals that specifically strengthen a research work's potential for long-term impact through reuse 5-10 years down the road.

97 MATHEMATICS AND COMPUTING↗

SU-G-JeP1-07: Development of a Programmable Motion Testbed for the Validation of Ultrasound Tracking Algorithms

Purpose: To develop an advanced testbed that combines a 3D motion stage and ultrasound phantom to optimize and validate 2D and 3D tracking algorithms for real-time motion management during radiation therapy. Methods: A Siemens S2000 Ultrasound scanner utilizing a 9L4 transducer was coupled with the Washington University 4D Phantom to simulate patient motion. The transducer was securely fastened to the 3D stage and positioned to image three cylinders of varying contrast in a Gammex 404GS LE phantom. The transducer was placed within a water bath above the phantom in order to maintain sufficient coupling for the entire range of simulated motion. A programmed motion sequence was used to move the transducer during image acquisition and a cine video was acquired for one minute to allow for long sequence tracking. Images were analyzed using a normalized cross-correlation block matching tracking algorithm and compared to the known motion of the transducer relative to the phantom. Results: The setup produced stable ultrasound motion traces consistent with those programmed into the 3D motion stage. The acquired ultrasound images showed minimal artifacts and an image quality that was more than suitable for tracking algorithm verification. Comparisons of a block matching tracking algorithm with the known motion trace for the three features resulted in an average tracking error of 0.59 mm. Conclusion: The high accuracy and programmability of the 4D phantom allows for the acquisition of ultrasound motion sequences that are highly customizable; allowing for focused analysis of some common pitfalls of tracking algorithms such as partial feature occlusion or feature disappearance, among others. The design can easily be modified to adapt to any probe such that the process can be extended to 3D acquisition. Further development of an anatomy specific phantom better resembling true anatomical landmarks could lead to an even more robust validation. This work is partially funded by NIH grant R01CA190298.

60 APPLIED LIFE SCIENCES↗

Behavior of fuel with zirconium alloy cladding in reactivity-initiated accident and loss-of-coolant accident - 2016-0090

Along with our colleagues at the Japan Atomic Energy Research Institute (JAERI) and Japan Atomic Energy Agency (JAEA), we have performed extensive research programs for more than 2 decades and have developed a better understanding of fuel behavior under accident conditions. Data and findings from these research programs have provided the technical basis directly and indirectly for regulatory criteria in Japan and other countries. This paper reviews and summarizes the major outcomes from the research programs performed at JAERI and JAEA facilities and identifies further research needs. The programs aim to generate data and models to (1) evaluate the adequacy of present safety criteria and safety margins; (2) create a database for the future regulation of higher-burnup UO{sub 2} and mixed-oxide (MOX) fuels, new cladding, and pellets; (3) provide adequately mechanistic computer codes for regulatory application; (4) promote a better understanding of phenomena that appear in high-burnup regions and MOX fuels, such as rim effect and an effect of plutonium agglomerates in MOX fuels, and to evaluate those effects on fuel behavior in accident conditions; and (5) to assess fuel behaviors with higher fuel duty, such as plant power uprates, longer operating cycles, and water chemistry changes. The programs comprise reactivity-initiated accident studies, including pulse-irradiation experiments in the Nuclear Safety Research Reactor, cladding mechanical tests, and the development and verification of RANNS; loss-of-coolant accident tests, including integral thermal shock tests, oxidation rate measurements, and cladding mechanical tests; development and verification of a computer code FEMAXI-6 that simulates high-burnup fuel behavior under normal operating and abnormal transient conditions; and studies on phenomena specific to high-burnup regions, including thermal property measurements, experimental and analytical simulation of rim structure formation, cladding mechanical tests on effects of hydrides, etc. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

C++ Implementation of IAPWS Water Properties

For the calculations of water-involved systems, such as safety analysis of light water reactors, it is essential to provide accurate water properties. The International Association for the Properties of Water and Steam is an international non-profit association of national organizations concerned with the properties of water and steam. It provides internationally accepted formulations of water/steam properties for scientific and industrial applications. The purpose of this work is to provide a stand-alone software package in C++ programming language to provide accurate and efficient water/steam properties evaluation, based on the latest IAPWS releases. The discussion on related IAPWS releases, code implementations and verifications are provided in details.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Exploration of Domain Aware Machine Learning for Grid Analytics: Transfer-Learnt Energy Models to Assist Buildings Control with Sparse Field Data

Buildings are a primary consumer of energy in the United States and are also increasingly being perceived as providers of grid services such as load shifting, shedding and modulation. High fidelity models of building energy consumption are needed to set appropriate baselines for measurement and verification (M&V) of controllers designed for energy efficient operation of buildings and to enable buildings to provide grid services via. participation in demand response programs. State-of-the-art building energy modeling techniques either rely on Physics based models, or extensive instrumentation of the building envelope to gather “big” data to train machine learning based models such as deep neural networks. While Physics based models are often limited by their accuracy, it is not always feasible to gather a significant amount of field data required to train machine learning based models with sufficient accuracy. In this paper, we explore the use of transfer learning-based strategies to address unsatisfactory accuracy of models for estimating building energy consumption when available field data for training is sparse or of unacceptable quality. In particular, we transfer knowledge in the form of data and parameters, from Physics based simulation frameworks to the field to improve the model accuracy, thus resulting in a Physics-informed Machine Learning framework. We evaluated the efficacy of our approach on field data collected from six commercial buildings and our results indicate that the proposed transfer learning based models provide comparative (and in some cases better) accuracy than state-of-the-art machine learning and deep learning solutions, with just one month of field data.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Toward Trustworthy Autonomous Science: A Two-Year Community Roadmap

One year ago, the AISLE roadmap argued that autonomous laboratories operated as isolated islands and proposed a grassroots network organized around five critical dimensions. The field has since moved faster than that roadmap anticipated: multi-agent systems have produced experimentally validated hypotheses, self-driving laboratories have grown more interoperable and orchestrated, reasoning-trained and domain foundation models have raised the capability ceiling, and the Genesis Mission has placed autonomous experimentation at the center of U.S. federal science strategy, with industry emerging as a primary actor. Progress has met a sobering counter-current, including a corrected flagship discovery result, benchmarks showing that agents which rival experts on closed-ended questions still complete only a fraction of open-ended research, and fabricated citations surfacing at leading venues. We read this as the defining tension of the field: producing a candidate discovery is no longer the hard part, but verifying it is, and this asymmetry now limits autonomous science more than raw model capability. Accordingly, we update the roadmap around seven dimensions, revisiting the original five and elevating two former cross-cutting concerns, trust, verification, and reproducibility, and safety, security, and governance, to first-class status. We assess the original milestones (M1 through M14) as achieved, partially achieved, reframed, or open, add four new milestones (M15 through M18) for the elevated dimensions, and scope the path forward to a two-year horizon, with the first year concentrating on interfaces, protocol adoption, and the scaffolding of verification, and the second targeting federation, zero-trust coordination, and governance. Throughout, we position the grassroots network as the interoperability fabric that lets national programs, international initiatives, and commercial platforms connect rather than re-silo.

99 GENERAL AND MISCELLANEOUS↗

STDN ranging equipment

Final results of the Spaceflight Tracking and Data Network (STDN) Ranging Equipment program are summarized. Basic design concepts and final design approaches are described. Theoretical analyses which define requirements and support the design approaches are presented. Design verification criteria are delineated and verification test results are specified.

Jones, C. E.↗