Search NASA⌕ Search

SEARCH · Search NASA

Results for “Verification study”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16

SU-GG-T-49: Real Time Dose Verification for Novel Shielded Balloon Brachytherapy

Purpose: The validation of a novel approach for reducing skindoses to an acceptable level during Accelerated Partial Breast Irradiation (APBI) when the balloon-to-skin distance is inadequate (less than 7 mm) is reported. The study uses a real time dose verification method for a metallic shielded balloon applicator using scintillation fiber technology. Method and Materials: Partial shielding of the radiationdose to the skin using iron or other ferrous powder could enable the extension of APBI to some patients. With small external and pre-determined magnetic fields (<few Gauss), the metallic elements deposition can be controlled on the inner surface of a balloon. Geant4 simulations were used to generate an attenuation dose curve for various radiation lengths after cross-calibration with dedicated data acquired at Jefferson Lab. Some powder was then injected into various inflated MammoSite and rectal balloons within realistic breast and torso phantoms of differing sizes. The dose on the external surface of the skin was measured from a 6.1 Ci {sup 192}Ir of a GammaMed 12i afterloader unit, with a MOSFET,ion chamber and scintillating fiber array detectors. Results: Realistic Monte Carlo simulation studies for the amount and distribution of the required shielding material were compared to dedicated phantom data. A decrease of the skindose was measured to an acceptable level (~350-450 cGy) during standard breast Brachytherapy treatments with relatively weak magnetic fields. Additional measurements provided negligible corrections (< few %) on the saline water density from the suspended ironpowder.Conclusion: This project opens the possibility to increasing the survival expectancy and minimizing negative side effects during brachytherapy treatments, as well as improving cosmetic outcome for all APBI patients. The proposed method may also be used in other procedures for brain, heart, rectal, or vaginal cancers.

61 RADIATION PROTECTION AND DOSIMETRY↗

Fluoride salt static freezing study

Molten salt reactor designs such as the FHR must consider the safety implications of freezing, requiring the development of thermal hydraulics models that account for freezing behavior. Pipe models that couple heat transfer, fluid dynamics, and phase change physics will require verification and validation. A static freezing study is being conducted to provide an initial set of validation data with LiF-BeF{sub 2} (FLiBe). The study will also be performed with LiF-NaF-KF (FLiNaK) in order to quantify the distortion that arises from using FLiNaK as a non-toxic surrogate salt for thermal-hydraulic studies. In order to develop the numerical model, accurate inputs for the thermal hydraulic properties of the two salts of interest need to be measured near the freezing point. For this reason, a series of three experiments including Differential Scanning Calorimetry (DSC) measurements, the Density Measurement Experiment, and the Static Freezing Experiment are being conducted to determine these thermo-physical properties at temperatures near the freezing point. The Static Freezing Experiment is also designed to determine the degree of supercooling that FLiBe and FLiNaK experience. Supercooling is a temperature depression below the freezing point that the liquid experiences before freezing initiates. Increased supercooling in a liquid flowing through a pipe leads to increased dendritic freezing and an increased likelihood of pipe blockage and freeze-shut. Based on previous research on supercooling in water and non-fluoride salts, supercooling is likely affected most strongly by cooling rate and sample size (as well as salt purity). No data has been generated previously on supercooling in fluoride salts such as FLiBe and FLiNaK. The results of this set of DSC, Density Measurement and Static Freezing experiments will be used in an ongoing fluoride salt freezing study being conducted to develop pipe freezing models for molten salts to be used in safety analysis. The thermal hydraulic properties measured in this study will serve as inputs for all future models. With the supercooling behavior of both salts quantified, it can be assessed whether supercooling must be included in future thermal hydraulic models. The validated Static Freezing Experiment model can then serve as the framework for a pipe freezing model and eventually a 1D system code.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

On the use of computed radiography plates for quality assurance of intensity modulated radiation therapy dose distributions

Purpose: As traditional film is phased out in most radiotherapy centers, computed radiography (CR) systems are increasingly being purchased as a replacement. CR plates can be used for patient imaging, but may also be used for a variety of quality assurance (QA) purposes and can be calibrated in terms of dose. This study looks at their suitability for verification of intensity modulated radiation therapy (IMRT) dose distributions. Methods: A CR plate was calibrated in terms of the relative dose and the stability of response over 1 year was studied. The effect of exposing the CR plate to ambient light and of using different time delays before scanning was quantified. The CR plate was used to verify the relative dose distributions for ten IMRT patients and the results were compared to those obtained using a two dimensional (2D) diode array. Results: Exposing the CR plate to 10 s of ambient light between irradiation (174 cGy) and scanning erased approximately 80% of the signal. Changes in delay time between irradiation and scanning also affected the measurement results. The signal on the plate was found to decay at a rate of approximately 3.6 cGy/min in the first 10 min after irradiation. The use of a CR plate for IMRT patient-specific QA resulted in a significantly lower distance to agreement (DTA) and gamma pass rate than when using a 2D diode array for the measurement. This was primarily due to the over-response of the CR phosphor to low energy scattered radiation. For the IMRT QA using the CR plate, the average gamma pass rate was 97.3%. For the same IMRT QA using a diode array, the average gamma pass rate was 99.7%. The gamma criteria used were 4% dose difference and 4 mm DTA for head and neck treatments and 3% dose difference and 3 mm DTA for prostate treatments. The gamma index tolerance was 1. The lowest 10% of the dose distribution was excluded from all gamma and DTA analyses. Conclusions: Although the authors showed that CR plates can be used for patient specific IMRT QA, the practical problems such as the over-response to low energy scatter and signal fading with light exposure and time mean that alternative detectors such as radiochromic film or diode arrays will be a more sensible choice for most radiotherapy departments.

60 APPLIED LIFE SCIENCES↗

Analysis of 125 Xe electron–photon coincidence decay

In this study, as part of the verification component of the Comprehensive Nuclear-Test-Ban Treaty (CTBT), environmental gas samples originating from nuclear fission are analyzed for the presence of 131 mXe, 133 mXe, 133 Xe, and 135 Xe. In this work, the non-traditional radioxenon isotope 125 Xe was investigated. The isotope was produced as an isotopically pure sample via neutron activation of 124 Xe at the University of Texas at Austin Nuclear Engineering Teaching Lab’s TRIGA MARK II Reactor. The sample was then measured using a HPGe detector as well as an ARSA-style β–γ coincidence detector. Potential sources and sensitivities for production of 125 Xe are also considered for relevance to the CTBT verification mission.

CTBT↗

Application of spectroscopic evidence to diffuse layer model (DLM) parameter estimation for cation adsorption onto ferrihydrite in single- and bi-solute systems

The diffuse layer model (DLM) is one of the most frequently used surface complexation models (SCM) for predicting cation adsorption onto ferrihydrite. However, the DLM with its existing database sometimes fails to predict cation adsorption, especially in multi-solute systems. Notably, the failure is often attributed to inaccurate selection of the surface complexes and/or underestimation of the site density for DLM formulation. DLM simulations of batch adsorption data conducted with cadmium, copper, lead, and zinc on ferrihydrite in CO2 free systems demonstrates the ability of the DLM to fit single-solute data reasonably well but highlights its limitations with respect to predicting bi-solute data. Modifications to the DLM were made in two steps. First, spectroscopic evidence was used to guide cation complexation reactions at the ferrihydrite surface. Second, surface characteristics (reactive site density, specific surface area, and acidity constants) of ferrihydrite were updated according to recent literature. The results from this study suggest that when spectroscopic verification is employed and surface site density is increased, a simple two-site DLM can predict cation adsorption on ferrihydrite in single-solute systems for pH data above 3.5 and in most of the bi-solute systems tested.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Development and Verification of an Improved Wake-Added Turbulence Model in FAST.Farm

We introduce a generalized wake-added turbulence (WAT) model in the multiphysics, multiturbine simulation tool FAST.Farm. The WAT model introduces additional small-scale turbulence that represents the breakdown of vortical structures and shear layers in the wake. The article describes the development, implementation, calibration, and verification of the model. The novelties of the model include support for wake asymmetry, buildup of WAT across the wind farm, and secondary effects of wake-induced turbulence (e.g., wake meandering) driven by smaller-scale turbulence structures that arise from wake breakdown. Large-eddy simulations were run to support the calibration of the WAT parameters and verification of the model. Previous studies hypothesized that the lack of WAT modeling was the source of underprediction of fatigue loads, in particular for cases at low turbulence intensities and/or stable atmospheric boundary layers. This study confirms that the newly implemented WAT model enhances the loads predictions in these cases.

17 WIND ENERGY↗

An Open-Source Python Package for CFD Solution Verification

Informed decision-making using computational fluid dynamics (CFD) results requires quantifying the errors and uncertainties of a simulation. Verification, validation, and uncertainty quantification (VVUQ) methods were developed to address this need and have matured. However, these VVUQ analyses are often non-trivial and require CFD analysts and practitioners to have specific skill sets. This has led to the uneven adoption of VVUQ analyses, in part, based on the availability of software tools to aid CFD analysts and practitioners. Solution verification, a procedure to evaluate the accuracy of a simulation by estimating potential errors arising from the computational model and computing the uncertainties without comparing to results from a physical system, is one of the lagging VVUQ analyses as the absence of software has forced CFD analysts and practitioners to develop their own codes or piece together incomplete software from across the internet. This work presents an opensource Python package, CFDverify, to lower the barrier of entry and fill in the technological gap in solution verification. CFDverify also provides a streamlined framework to remove some potential errors in post-processing CFD results. The hope is that CFDverify can improve the quality and quantity of CFD solution verification in scientific and research studies and attract interest in developing a communal tool. This paper describes the design, features, and an example use of CFDverify.

Weinmeister, Justin [ORNL] (ORCID:0000000160090237↗

TU-C-17A-04: BEST IN PHYSICS (THERAPY) - A Supervised Framework for Automatic Contour Assessment for Radiotherapy Planning of Head- Neck Cancer

Purpose: Precise contour delineation of tumor targets and critical structures from CT simulations is essential for accurate radiotherapy (RT) treatment planning. However, manual and automatic delineation processes can be error prone due to limitations in imaging techniques and individual anatomic variability. Tedious and laborious manual verification is hence needed. This study develops a general framework for automatically assessing RT contours for head-neck cancer patients using geometric attribute distribution models (GADMs). Methods: Geometric attributes (centroid and volume) were computed from physician-approved RT contours of 29 head-neck patients. Considering anatomical correlation between neighboring structures, the GADM for each attribute was trained to characterize intra- and interpatient structure variations using principal component analysis. Each trained GADM was scalable and deformable, but constrained by the principal attribute variations of the training contours. A new hierarchical model adaptation algorithm was utilized to assess the RT contour correctness for a given patient. Receiver operating characteristic (ROC) curves were employed to evaluate and tune system parameters for the training models. Results: Experiments utilizing training and non-training data sets with simulated contouring errors were conducted to validate the framework performance. Promising assessment results of contour normality/abnormality for the training contour-based data were achieved with excellent accuracy (0.99), precision (0.99), recall (0.83), and F-score (0.97), while corresponding values of 0.84, 0.96, 0.83, and 0.9 were achieved for the non-training data. Furthermore, the areas under the ROC curves were above 0.9, validating the accuracy of this test. Conclusion: The proposed framework can reliably identify contour normality/abnormality based upon intra- and inter-structure constraints derived from clinically-approved contours. It also allows physicians to analytically determine the system parameters to fit various clinic requirements (e.g. as-low-as-possible false positives). It has great potential for improving RT work flow. More geometric attributes and training sets will be investigated to improve framework performance in the future.

60 APPLIED LIFE SCIENCES↗

MFIX-DEM Phi: Performance and Capability Improvements Towards Industrial Grade Open-source DEM Framework with Integrated Uncertainty Quantification

Two major challenges hinder the effective use and adoption of multiphase computational fluid dynamics tools by the industry. The first is the need for significant computational resources, which is inversely proportional to the accuracy of solutions due to computational intensity of the algorithms. The second barrier is assessing the prediction credibility and confidence in the simulation results. In this project, a multi-tiered approach has been proposed under four broad activities to overcome these challenges while addressing all of the objectives outlined in FOA-0001238 through Phases 1 and 2 of the project. The present report consists of the results for only Phase 1, which was the funded performance period. From the start the project, all of the objectives outlined in FOA were addressed through four major activity tasks in an integrated and balanced fashion to improve adoption of MFIX suite of solvers for industrial use. The first task aimed to improve the performance of MFIX-DEM specifically targeting to acquire the peak performance on Intel Xeon and Xeon Phi based systems, which are expected to be one of the primary high-performance computing platforms both affordable and available for the industrial users in the next two to five years. However, due to a number of changes in course of the project, the scope of the performance improvements related task was significantly reduced to avoid duplicate work. Hence, more emphasis was placed on the other three tasks as discussed below. The second task aimed at physical modeling enhancements through implementation of polydispersity capability and validation of heat transfer models in MFIX. An extended verification and validation (V&V) study was performed for the new polydispersity feature implemented in MFIX-DEM both for granular and coupled gas-solid flows. The features of the polydispersity capability and results for an industrially relevant problem were disseminated through journal papers (one published and one under review at the time of writing of the final technical report). As part of the validation efforts, another industrially relevant problem of interest based on rotary drums was studied for several modes of heat transfer and results were presented in conferences. Third task was aimed towards an important and unique contribution of the project, which was to develop a unified uncertainty quantification framework by integrating MFIX-DEM with a graphical user interface (GUI) driven uncertainty quantification (UQ) engine, i.e., MFIX-GUI and PSUADE. The goal was to enable a user with only modest knowledge of statistics to effectively utilize the UQ framework offered with MFIX-DEM Phi to perform UQ analysis routinely. For Phase 1, a proof-of-concept demonstration of the proposed framework was completed and shared. Direct industry involvement was one of the key virtues of this project, which was performed through forth task. For this purpose, even at the proposal stage, the project team received strong interest in the proposed capabilities from two major corporations, which were further expanded throughout Phase 1 and a new collaboration with another major corporation from chemical industry was also initiated. The level of interest received and continued collaboration for the project during Phase 1 clearly shows the relevance and potential impact of the project for the industrial users.

42 ENGINEERING↗

SCALE Modeling of the Fast Spectrum Heat Pipe Reactor

As part of the severe accident analysis collaboration with Sandia National Laboratories (SNL) and the Nuclear Regulatory Commission (NRC), SCALE models were developed for a fast-spectrum heat pipe reactor. These models were based on the Idaho National Laboratory (INL) Design A concept, which is an alternative design to the Los Alamos National Laboratory (LANL) Special Purpose Reactor (SPR), also known as the Megapower reactor. The model contains 1,134 heat pipes, surrounded by hexagonal fuel elements, with a potassium working fluid; the fuel is UO 2 with 19.75 wt% 235 U enrichment. The model contains axial beryllium oxide (BeO) reflectors above and below the active fuel region along with a radial alumina reflector containing 12 B 4 C control drums. The center of the core is left unfueled to make room for two shutdown control rods, one annular and one solid. The active region of the core was discretized into twenty axial and five radial zones to analyze spatial variations in power and burnup. Infinite lattice unit cell sensitivity studies were used to perform verification between the SCALE and INL models. The eigenvalue results agreed well with the reported results to within roughly 50 percent mille (pcm). Full-core model verification was performed by analyzing system eigenvalues with differing configurations of control drum and shutdown rod positions. These full core results all had eigenvalue differences less than 310 pcm. Control drum and shutdown rod worths were also compared, with differences of 3.2% or less. Using the verified model, the isotopic inventory and decay heat, as well as temperature feedback coefficients, were calculated and provided to SNL as input to the MELCOR severe accident code to analyze potential releases from this class of reactor. The results of the MELCOR analysis are provided in a different report.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Utilization of GIS technology to support development of flow and contaminant fate and transport models at US DOE sites - 15457

U.S. Department of Energy (DOE) sites have accumulated years of data and millions of spatial and temporal records related to the hydrological cycle, contaminant transport, and parameters of remediation technologies. In addition, numerical models which use field monitoring data to help understand flow and transport produce gigabytes of computed spatial and temporal data for each computation node. There is a need therefore for an advanced spatial data structure that can be used to address the management, processing, and analysis of spatial and temporal numerical modeling data derived from multiple sources. This can be accomplished using a geo-database. The development of an ArcSDE geo-database facilitates the centralized storage, backup, accessibility, organization, and management of model configuration and computed simulation data, putting it into a structured, coherent, and logical computer-supported system. GIS data processing and automation would enable faster and hence more complex analyses of field test data. The Applied Research Center (ARC) at Florida International University (FIU) has provided analysis of flow and transport for several watersheds at DOE's Oak Ridge Reservation (ORR), including East Fork Poplar Creek (EFPC), Upper EFPC in the Y-12 National Security Complex area (Y-12 NSC) and White Oak Creek (WOC). Integrated surface and subsurface flow, fate and transport models were developed to provide analysis of contaminant patterns within each watershed. In addition, digital monitoring data available from the Oak Ridge Environmental Information System (OREIS) related to mercury (Hg) contamination and remediation within these watersheds was used for calibration and verification of the model. Experimental studies were also carried out which provided kinetic and equilibrium data about important parameters related to Hg transport, speciation and methylation/demethylation kinetics within the watershed. Geographic Information Systems (GIS) technology was employed to support the modeling work through storage and geo-processing of spatial and temporal data required by the models and to produce hydrogeological maps for visualization. An ArcGIS geo-database was developed for centralized storage and management of experimental and computed model data and its capabilities were extended over the years using tools such as ModelBuilder combined with Python scripting to automate repetitive tasks, perform statistical analyses and generate maps and reports. The hydrologic geo-database model developed possesses a structure that enables linkage with scalable hydrologic modeling tools/applications to model hydrologic systems, and in this case, enables the testing of the potential impacts of various remediation scenarios on the ORR watersheds. The ArcSDE geo-database can also be used to automate and simplify the process of calling stored GIS and time series data. This geo-database can serve as a tool for contaminant flow and transport analyses which require large amounts of high-quality spatial and temporal data in order to ensure reliability and validity of modeling results. The existing geo-database structure developed for the hydrological modeling at ORR was designed to be replicable for application at other DOE sites. An investigation of downloadable free/open source GIS software along with required security protocols to facilitate online querying of the database was also conducted to determine methods by which project-derived data can be more easily shared with other project stakeholders such as DOE personnel and site contractors. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Chemical Decontamination Performance of Radioactive Metal Surface Using HyBRID Process

The metal oxides formed on the surface of the primary coolant system of a NPP (Nuclear Power Plant) contain radioactive components, and thus the oxides are generally need to be removed by means of chemical decontamination to reduce the exposure of workers during the decommissioning of a NPP. The commercial application of chemical decontamination technology has expanded significantly in recent years at NPPs. From initial applications to components and small subsystems, to the current examination of full system decontamination, the entire technology has become sophisticated. Dilute chemical decontamination solutions have been developed because too aggressive solution is deemed to cause the undesirable corrosion damage to the base metal as well as generate a large volume of decontamination waste. KAERI (Korea Atomic Energy Research Institute) has been developing a new multi-step chemical decontamination process for the primary coolant system of a NPP. This process does not contain any organic chemicals in decontamination solution. The HyBRID (Hydrazine Based Reductive metal Ion Decontamination) process which contains hydrazine as a strong reductant and cupric ion as a catalyst has been developed to be applied as a reductive decontamination step. Instead of usual NP (Nitric acid Permanganate) process, slightly altered SP (Sulfuric acid Permanganate) process is used as a pre-oxidative decontamination step in conjunction with HyBRID process. The preliminary results have proven the effectiveness of this process for the system decontamination. The present study is concerned with the verification of chemical decontamination efficiency for radioactively contaminated surfaces. Therefore, the decontamination performance of radioactive specimen taken from the commercial NPPs using HyBRID coupled with SP process was investigated.

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗

SU-E-T-439: Fundamental Verification of Respiratory-Gated Spot Scanning Proton Beam Therapy

Purpose: The spot-scanning proton beam irradiation with respiratory gating technique provides quite well dose distribution and requires both dosimetric and geometric verification prior to clinical implementation. The purpose of this study is to evaluate the impact of gating irradiation as a fundamental verification. Methods: We evaluated field width, flatness, symmetry, and penumbra in the gated and non-gated proton beams. The respiration motion was distinguished into 3 patterns: 10, 20, and 30 mm. We compared these contents between the gated and non-gated beams. A 200 MeV proton beam from PROBEAT-III unit (Hitachi Co.Ltd) was used in this study. Respiratory gating irradiation was performed by Quasar phantom (MODUS medical devices) with a combination of dedicated respiratory gating system (ANZAI Medical Corporation). For radiochromic film dosimetry, the calibration curve was created with Gafchromic EBT3 film (Ashland) on FilmQA Pro 2014 (Ashland) as film analysis software. Results: The film was calibrated at the middle of spread out Bragg peak in passive proton beam. The field width, flatness and penumbra in non-gated proton irradiation with respiratory motion were larger than those of reference beam without respiratory motion: the maximum errors of the field width, flatness and penumbra in respiratory motion of 30 mm were 1.75% and 40.3% and 39.7%, respectively. The errors of flatness and penumbra in gating beam (motion: 30 mm, gating rate: 25%) were 0.0% and 2.91%, respectively. The results of symmetry in all proton beams with gating technique were within 0.6%. Conclusion: The field width, flatness, symmetry and penumbra were improved with the gating technique in proton beam. The spot scanning proton beam with gating technique is feasible for the motioned target.

60 APPLIED LIFE SCIENCES↗

Development of a Safeguards Verification Method and Instrument to Detect Pin Diversion from Pressurized Water Reactor (PWR) Spent Fuel Assemblies Phase I Study

A novel methodology to detect diversion of spent fuel from Pressurized Water Reactors (PWR) has been developed in order to address a long unsolved safeguards verification problem for international safeguards community such as International Atomic Energy Agency (IAEA) or European Atomic Energy Community (EURATOM). The concept involves inserting tiny neutron and gamma detectors into the guide tubes of a spent fuel assembly and measuring the signals. The guide tubes form a quadrant symmetric pattern in the various PWR fuel product lines and the neutron and gamma signals from these various locations are processed to obtain a unique signature for an undisturbed fuel assembly. Signatures based on the neutron and gamma signals individually or in a combination can be developed. Removal of fuel pins from the assembly will cause the signatures to be visibly perturbed thus enabling the detection of diversion. All of the required signal processing to obtain signatures can be performed on standard laptop computers. Monte Carlo simulation studies and a set of controlled experiments with actual commercial PWR spent fuel assemblies were performed and validated this novel methodology. Based on the simulation studies and benchmarking measurements, the methodology developed promises to be a powerful and practical way to detect partial defects that constitute 10% or more of the total active fuel pins. This far exceeds the detection threshold of 50% missing pins from a spent fuel assembly, a threshold defined by the IAEA Safeguards Criteria. The methodology does not rely on any operator provided data like burnup or cooling time and does not require movement of the fuel assembly from the storage rack in the spent fuel pool. A concept was developed to build a practical field device, Partial Defect Detector (PDET), which will be completely portable and will use standard radiation measuring devices already in use at the IAEA. The use of the device will not require any information provided by the operator or any prior knowledge of the spent fuel assembly. The device can also be operated without any movement of the spent fuel from its storage position. Based on parametric studies conducted via computer simulation, the device should be able to detect diversion of as low as ten percent of the missing or replaced fuel from an assembly regardless of the location of the missing fuel within the assembly, of the cooling time, initial fuel enrichment or burnup levels. Conditions in the spent fuel pool such as clarity of the water or boron content are also not issues for this device. The shape of the base signature is principally dependent on the layout of the guide tubes in the various types of PWR fuel assemblies and perturbations in the form of replaced fuel pins will distort this signature. These features of PDET are all unique and overcome limitation and disadvantages presented by currently used devices such as the Fork detector or the Cerenkov Viewing Device. Thus, this device when developed and tested could fill an important need in the safeguards area for partial defect detection, a technology that the IAEA has been seeking for the past few decades.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Verification of the astrometric performance of the Korean VLBI network, using comparative SFPR studies with the VLBA AT 14/7 mm

The Korean VLBI Network (KVN) is a new millimeter VLBI dedicated array with the capability to simultaneously observe at multiple frequencies, up to 129 GHz. The innovative multi-channel receivers present significant benefits for astrometric measurements in the frequency domain. The aim of this work is to verify the astrometric performance of the KVN using a comparative study with the VLBA, a well-established instrument. For that purpose, we carried out nearly contemporaneous observations with the KVN and the VLBA, at 14/7 mm, in 2013 April. The KVN observations consisted of simultaneous dual frequency observations, while the VLBA used fast frequency switching observations. We used the Source Frequency Phase Referencing technique for the observational and analysis strategy. We find that having simultaneous observations results in superior compensation for all atmospheric terms in the observables, in addition to offering other significant benefits for astrometric analysis. We have compared the KVN astrometry measurements to those from the VLBA. We find that the structure blending effects introduce dominant systematic astrometric shifts, and these need to be taken into account. We have tested multiple analytical routes to characterize the impact of the low-resolution effects for extended sources in the astrometric measurements. The results from the analysis of the KVN and full VLBA data sets agree within 2σ of the thermal error estimate. We interpret the discrepancy as arising from the different resolutions. We find that the KVN provides astrometric results with excellent agreement, within 1σ, when compared to a VLBA configuration that has a similar resolution. Therefore, this comparative study verifies the astrometric performance of the KVN using SFPR at 14/7 mm, and validates the KVN as an astrometric instrument.

79 ASTRONOMY AND ASTROPHYSICS↗

Exploring the Psychometrics of Common Post-Scenario Human Factors Questionnaires of Workload, Situation Awareness, and Perceived Difficulty

Abstract: The United States (U.S.) Department of Energy (DOE) Light Water Reactor Sustainability (LWRS) program has the primary mission of sustaining operation of the existing commercial nuclear power plants (NPPs) through a multi-pathway approach in conducting research and development (R&D). In this effort, the role of human factors engineering (HFE) has been an integral in ensuring new digital upgrades that are part of the overall main control room modernization strategy for various U.S. NPPs optimize human-system performance and do not introduce new human failure modes. In this process, testing and evaluation of concept (i.e., prototype) human machine interfaces (HMIs) are done in operator-in-the-loop studies at various stages of the HFE modification process, such as during design and verification and validation (V&V) [1]. During these studies, licensed operators go through select scenarios using a testbed, such as a full-scale simulator or at a NPP’s training simulator, to identify potential usability issues and provide general design feedback regarding the new digital HMIs. Human-system performance is measured and evaluated through a range of objective and self-report measures that capture aspects of plant performance, task performance, workload, situation awareness, and anthropometric and ergonomic concerns [2]. The use of post-scenario questionnaires is an acceptable method for gathering measures of workload and situation awareness. To this end, the NASA-Task Load Index (TLX) [e.g., 3, 4, & 5] and Situation Awareness Rating Technique (SART) [e.g., 6 & 7] are common standardized questionnaires used for evaluating workload and situation awareness, respectively. When combined, these questionnaires consist of a total of 15 questions, each using a different rating scale. Debriefs are also done through interviews with operators to gather design insight after each scenario. Since operator- and training simulator-time is limited, a concern during this post-scenario period of operator-in-the-loop studies is the limited time available to run scenarios, administer post-scenario questionnaires, and debrief within the allotted simulator time. To address this potential problem, this paper explores the psychometric characteristics of NASA-TLX, SART, and a common one-question post-scenario usability questionnaire (i.e., the single ease question – SEQ [8]) in effort to inform future development of a condensed questionnaire that captures aspects of workload and situation awareness. This exploratory work uses data from four different operator-in-the-loop studies completed under prior LWRS operator-in-the-loop studies. Findings from this paper should support future development of a consolidated questionnaire that may be used in operator-in-the-loop studies, when time is compressed, that conforms to the HFE scientific and regulatory requirements set for NPP control room modernization.

99 GENERAL AND MISCELLANEOUS↗

Software Verification Toolkit (SVT): Survey on Available Software Verification Tools and Future Direction

Writing software is difficult. However, writing complex, well tested and designed, and functionally correct software is incredibly difficult. An entire field of study is devoted to the validation and verification of software to address this problem, and in this paper we analyze the landscape of currently available third party software. We have divided our analyses into three separate subsections with regards to software validation: formal methods, static analysis, and test generation. Formal verification is the most complex method in which to validate software correctness, but also the most thorough as it truly validates the mathematical validity of the source code. Static analysis generally is relegated to abstract syntax tree traversal techniques to find errors related to faulty software such as memory leaks or stack overflow issues. Automatic test generation is similar in implementation to static analysis, but pushes a bit further in verifying the boundedness of function inputs and outputs with regards to annotated or parsed criteria. The crux of this report is to analyze and describe the software tools that implement these techniques to validate and verify software. Pros and cons related to installation, utilization, and capabilities of the frameworks are described, and reproducible examples are provided with a focus on usability. The initial survey concluded that the most interesting tools of note are Z3, Isabelle/HOL, and TLA+ with regards to formal verification; and Infer, Frama-C, and SonarQube with regards to static analysis. With these tools in mind, a final conjecture is provided that describes future avenues of utilizing these tools for developing a verification framework to assist in validating existing software at Sandia National Laboratories.

97 MATHEMATICS AND COMPUTING↗