Search NASA⌕ Search

SEARCH · Search NASA

Results for “Software Reliability Analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 397 records · Page 22

VA EDH Advanced Software Pipeline Framework Report: Enhancing Automation and Scalability

The VA Environmental Determinants of Health (EDH) Advanced Software Pipeline Framework is designed to enhance the efficiency, scalability, and security of geospatial data processing workflows. This framework integrates modern data orchestration and containerization technologies, including Prefect for workflow automation, Docker for containerization, and PostgreSQL/PostGIS for geospatial data storage and analysis. It ensures standardized, reproducible, and automated data processing, supporting VA objectives related to substance use risk assessment and recovery research. The pipeline addresses key scalability and performance challenges through horizontal and vertical scaling, high-performance computing (HPC) integration, parallel processing, task caching, and dynamic resource allocation. These optimizations improve throughput and reduce latency, allowing the system to efficiently manage large and complex datasets. Additionally, security and compliance measures—such as data encryption (SSL), Role-Based Access Control (RBAC), and adherence to GDPR and HIPAA standards—safeguard sensitive information throughout data transmission and storage. A key implementation of this framework includes the automation of shelter list geolocation workflows, ensuring that up-to-date data is readily available for VA decision-making. Lessons learned from this project include the transition from in-memory processing to incremental storage writes, improving resource management and reliability. Future enhancements aim to expand automation, integrate AI-driven anomaly detection, and incorporate high-performance computing resources. This framework provides a scalable, secure, and adaptable solution for managing geospatial datasets, reinforcing the VA’s ability to support clinical and strategic initiatives through data-driven decision-making.

97 MATHEMATICS AND COMPUTING↗

Effect of Heat and Electricity Storage and Reliability on Microgrid Viability:A Study of Commercial Buildings in California and New York States

In past work, Berkeley Lab has developed the Distributed Energy Resources Customer Adoption Model (DER-CAM). Given end-use energy details for a facility, a description of its economic environment and a menu of available equipment, DER-CAM finds the optimal investment portfolio and its operating schedule which together minimize the cost of meeting site service, e.g., cooling, heating, requirements. Past studies have considered combined heat and power (CHP) technologies. Methods and software have been developed to solve this problem, finding optimal solutions which take simultaneity into account. This project aims to extend on those prior capabilities in two key dimensions. In this research storage technologies have been added as well as power quality and reliability (PQR) features that provide the ability to value the additional indirect reliability benefit derived from Consortium for Electricity Reliability Technology Solutions (CERTS) Microgrid capability. This project is intended to determine how attractive on-site generation becomes to a medium-sized commercial site if economical storage (both electrical and thermal), CHP opportunities, and PQR benefits are provided in addition to avoiding electricity purchases. On-site electrical storage, generators, and the ability to seamlessly connect and disconnect from utility service would provide the facility with ride-through capability for minor grid disturbances. Three building types in both California and New York are assumed to have a share of their sensitive electrical load separable. Providing enhanced service to this load fraction has an unknown value to the facility, which is estimated analytically. In summary, this project began with 3 major goals: (1) to conduct detailed analysis to find the optimal equipment combination for microgrids at a few promising commercial building hosts in the two favorable markets of California and New York; (2) to extend the analysis capability of DER-CAM to include both heat and electricity storage; and (3) to make an initial effort towards adding consideration of PQR into the capabilities of DER-CAM.

25 ENERGY STORAGE↗

Electric Power quality Analysis in research reactor: Impacts on nuclear safety assessment and electrical distribution reliability

The increased requirements on supervision, control, and performance in modern power systems make power quality monitoring a common practise for utilities. Large databases are created and automatic processing of the data is required for fast and effective use of the available information. Aim of the work presented in this paper is the development of tools for analysis of monitoring power quality data and in particular measurements of voltage and currents in various level of electrical power distribution. The study is extended to evaluate the reliability of the electrical system in nuclear plant. Power Quality is a measure of how well a system supports reliable operation of its loads. A power disturbance or event can involve voltage, current, or frequency. Power disturbances can originate in consumer power systems, consumer loads, or the utility. The effect of power quality problems is the loss power supply leading to severe damage to equipments. So, we try to track and improve system reliability. The assessment can be focused on the study of impact of short circuits on the system, harmonics distortion, power factor improvement and effects of transient disturbances on the Electrical System during motor starting and power system fault conditions. We focus also on the review of the Electrical System design against the Nuclear Directorate Safety Assessment principles, including those extended during the last Fukushima nuclear accident. The simplified configuration of the required system can be extended from this simple scheme. To achieve these studies, we have used a demo ETAP power station software for several simulations. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

A flux-matched gyrokinetic analysis of DIII-D L-mode turbulence

Previous nonlinear gyrokinetic simulations of specific DIII-D L-mode cases have been found to significantly underpredict the ion heat transport and associated density and temperature fluctuation levels by up to almost one of order of magnitude in the outer-core domain, i.e., roughly in the last third of the minor radius. Since then, this so-called shortfall issue has been subject to various speculations on possible reasons and furthermore motivation for a number of dedicated comparisons for L-mode plasmas in comparable machines. However, only a rather limited number of simulations and gyrokinetic codes has been applied to the original scenario, thus calling for further dedicated investigations in order to broaden the scientific basis. The present work contributes along these lines by employing another well-established gyrokinetic code in a numerically and physically comprehensive manner. Contrary to the previous studies, only a mild underprediction is observed at the outer radial positions which can furthermore be overcome by varying the ion temperature gradient within the error bars associated with the experimental measurement. The significance and reliability of these simulations are demonstrated by benchmarks, numerical convergence tests, and furthermore by extensive validation studies. The latter involve cross-phase and cross-power spectra analyses of various fluctuating quantities and confirm a high degree of realism. The code discrepancies come as a surprise since the involved software packages had been benchmarked repeatedly and very successfully in the past. Further collaborative effort in identifying the underlying difference is hence required.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Opportunities in AI/ML for the Rubin LSST Dark Energy Science Collaboration

The Vera C. Rubin Observatory's Legacy Survey of Space and Time (LSST) will produce unprecedented volumes of heterogeneous astronomical data (images, catalogs, and alerts) that challenge traditional analysis pipelines. The LSST Dark Energy Science Collaboration (DESC) aims to derive robust constraints on dark energy and dark matter from these data, requiring methods that are statistically powerful, scalable, and operationally reliable. Artificial intelligence and machine learning (AI/ML) are already embedded across DESC science workflows, from photometric redshifts and transient classification to weak lensing inference and cosmological simulations. Yet their utility for precision cosmology hinges on trustworthy uncertainty quantification, robustness to covariate shift and model misspecification, and reproducible integration within scientific pipelines. This white paper surveys the current landscape of AI/ML across DESC's primary cosmological probes and cross-cutting analyses, revealing that the same core methodologies and fundamental challenges recur across disparate science cases. Since progress on these cross-cutting challenges would benefit multiple probes simultaneously, we identify key methodological research priorities, including Bayesian inference at scale, physics-informed methods, validation frameworks, and active learning for discovery. With an eye on emerging techniques, we also explore the potential of the latest foundation model methodologies and LLM-driven agentic AI systems to reshape DESC workflows, provided their deployment is coupled with rigorous evaluation and governance. Finally, we discuss critical software, computing, data infrastructure, and human capital requirements for the successful deployment of these new methodologies, and consider associated risks and opportunities for broader coordination with external actors.

Aubourg, Eric [APC, Paris] (ORCID:000000025592023X↗

Integration of Advanced Probabilistic Analysis Techniques with Multi-Physics Models

An integrated simulation platform that couples probabilistic analysis-based tools with model-based simulation tools can provide valuable insights for reactive and proactive responses to plant operating conditions. The objective of this work is to demonstrate the benefits of a partial implementation of the Small Modular Reactor (SMR) Probabilistic Risk Assessment (PRA) Detailed Framework Specification through the coupling of advanced PRA capabilities and accurate multi-physics plant models. Coupling a probabilistic model with a multi-physics model will aid in design, operations, and safety by providing a more accurate understanding of plant behavior. This represents the first attempt at actually integrating these two types of analyses for a control system used for operations, on a faster than real-time basis. This report documents the development of the basic communication capability to exchange data with the probabilistic model using Reliability Workbench (RWB) and the multi-physics model using Dymola. The communication pathways from injecting a fault (i.e., failing a component) to the probabilistic and multi-physics models were successfully completed. This first version was tested with prototypic models represented in both RWB and Modelica. First, a simple event tree/fault tree (ET/FT) model was created to develop the software code to implement the communication capabilities between the dynamic-link library (dll) and RWB. A program, written in C#, successfully communicates faults to the probabilistic model through the dll. A systems model of the Advanced Liquid-Metal Reactor–Power Reactor Inherently Safe Module (ALMR-PRISM) design developed under another DOE project was upgraded using Dymola to include proper interfaces to allow data exchange with the control application (ConApp). A program, written in C+, successfully communicates faults to the multi-physics model. The results of the example simulation were successfully plotted.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Field Experience Detecting PV Underperformance in Real Time Using Existing Instrumentation

Maintenance at large-scale photovoltaic plants employs a mix of preventative and corrective maintenance practices. Large outages, such as an inverter tripping offline, are often easy to detect. More subtle sub-inverter faults and failures can accumulate and go unnoticed for months or years. A software-based fault detection method has been developed to analyze commonly measured data from large-scale PV plants for more timely detection of subtle underperformance. The method has been demonstrated on eight datasets from large-scale plants with high accuracy of detection. Results are validated using aerial infrared scanning. String outages are detected with a true positive rate of 73 percent and tracker issues are detected with a true positive rate of 88 percent. The developed method can be uniformly applied to photovoltaic plants across a range of scales and configurations to assess performance, quickly detect underperformance, and determine the source and location of failures. The results inform and improve operations and maintenance at PV plants, ultimately aiding in improved affordability, reliability, availability, and resiliency of solar electricity.

14 SOLAR ENERGY↗

Use of Dual Frequency Identification Sonar to Determine Adult Chinook Salmon (Oncorhynchus tshawytscha) Escapement in the Secesh River, Idaho ; Annual Report, January 2008 – December 2008.

Chinook salmon in the Snake River basin were listed as threatened under the Endangered Species Act in 1992 (NMFS 1992). The Secesh River represents the only stream in the Snake River basin where natural origin (wild) salmon escapement monitoring occurs at the population level, absent a supplementation program. As such the Secesh River has been identified as a long term salmon escapement and productivity monitoring site by the Nez Perce Tribe Department of Fisheries Resources Management. Salmon managers will use this data for effective population management and evaluation of the effect of conservation actions on a natural origin salmon population. The Secesh River also acts as a reference stream for supplementation program comparison. Dual frequency identification sonar (DIDSON) was used to determine adult spring and summer Chinook salmon escapement in the Secesh River in 2008. DIDSON technology was selected because it provided a non-invasive method for escapement monitoring that avoided listed species trapping and handling incidental mortality, and fish impedance related concerns. The DIDSON monitoring site was operated continuously from June 13 to September 14. The first salmon passage was observed on July 3. DIDSON site total estimated salmon escapement, natural and hatchery fish, was 888 fish {+-} 65 fish (95% confidence interval). Coefficient of variation associated with the escapement estimate was 3.7%. The DIDSON unit was operational 98.1% of the salmon migration period. Adult salmon migration timing in the Secesh River occurred over 74 days from July 3 to September 14, with 5,262 total fish passages observed. The spawning migration had 10%, median, and 90% passage dates of July 8, July 16, and August 12, respectively. The maximum number of net upstream migrating salmon was above the DIDSON monitoring site on August 27. Validation monitoring of DIDSON target counts with underwater optical cameras occurred for species identification. A total of 860 optical camera identified salmon passage observations were identical to DIDSON target counts. However, optical cameras identified eight jack salmon (3 upstream, 5 downstream) less than 55 cm in length that DIDSON did not count as salmon because of the length criteria employed ({ge} 55 cm). Precision of the DIDSON technology was evaluated by comparing estimated net upstream salmon escapement and associated 95% confidence intervals between two DIDSON sonar units operated over a five day period. The DIDSON 1 salmon escapement was 145.7 fish ({+-} 2.3), and the DIDSON 2 escapement estimate was 150.5 fish ({+-} 5). The overlap in the 95% confidence intervals suggested that the two escapement estimates were not significantly different from each other. Known length salmon carcass trials were conducted in 2008 to examine the accuracy of manually measured lengths, obtained using DIDSON software, on high frequency files at a 5 m window length. Linear regression demonstrated a highly significant relationship between known lengths and manually measured salmon carcass lengths (p < 0.0001). A positive bias in manual length measurement of 6.8% to 8% existed among the two observers in the analysis. Total Secesh River salmon escapement (natural origin and hatchery) in 2008 was 912 fish. Natural origin salmon escapement in the entire Secesh River drainage was 847 fish. The estimated natural origin spawner abundance was 836 fish. Salmon spawner abundance in 2008 increased by three fold compared to 2007 abundance levels. The 10 year geometric mean natural origin spawner abundance was 538 salmon and was below the recommended viable population threshold level established by the ICTRT (2007). One additional Snake River basin salmon population was assessed for comparison of natural origin salmon spawner abundance. The Johnson Creek/EFSF Salmon River population had a 10 year geometric mean natural origin spawner abundance of 254 salmon. Salmon spawner abundance levels in both streams were below viable population thresholds. DIDSON technology has been used in the Secesh River to determine salmon escapement over the past five years. The results suggest that DIDSON technology is reliable and can be used to generate accurate and precise estimates of salmon escapement if appropriate methods are used.

13 HYDRO ENERGY↗

On the Limits of EM Based Detection of Control Logic Injection Attacks In Noisy Environments

The difficulty in applying traditional security mechanisms in Industrial Control System (ICS) environments makes a large portion of these mission-critical assets vulnerable to cyber attacks. Therefore, there is a dire need for the development of novel security mechanisms specifically designed to protect such critical systems. Recently a lot of attention has been given to mechanisms that exploit the EM emanations of devices for defense purposes. Such practices may lead to the development of robust external and non-intrusive anomaly detection systems. Nevertheless, the majority of current work in the area neglects to consider the implications of real-life environments, particularly environmental noise. In this work, we explore the limits of EM-based anomaly detection towards identifying injection attacks in control logic software in noisy environments. Our study conducted upon both synthetically generated and real signals identified that indeed environmental noise might significantly degrade the accuracy of the anomaly detection process. Experiments done upon synthetic data indicated that assuming that signals are captured with high sampling rates, even minor code injections can be detected with above-90% accuracy in noisy environments where SNR is up to -2dB. This is true even if naive detection methods are considered. Moreover, experiments done using a real-life testbed attest that even single-instruction injections can be detected with near-perfect accuracy in relatively clean environments. Finally, noise-elimination techniques can drastically improve the reliability of the detection mechanism even in noisy environments.

97 MATHEMATICS AND COMPUTING↗

Radiation Dose–Dependent Hippocampal Atrophy Detected With Longitudinal Volumetric Magnetic Resonance Imaging

Purpose: After radiation therapy (RT) to the brain, patients often experience memory impairment, which may be partially mediated by damage to the hippocampus. Hippocampal sparing in RT planning is the subject of recent and ongoing clinical trials. Calculating appropriate hippocampal dose constraints would be improved by efficient in vivo measurements of hippocampal damage. In this study we sought to determine whether brain RT was associated with dose-dependent hippocampal atrophy. Methods and Materials: Hippocampal volume was measured with magnetic resonance imaging (MRI) in 52 patients who underwent fractionated, partial brain RT for primary brain tumors. Study patients had high-resolution, 3-dimensional volumetric MRI before and 1 year after RT. Images were processed using software with clearance from the US Food and Drug Administration and Conformité Européene marking for automated measurement of hippocampal volume. Automated results were inspected visually for accuracy. Tumor and surgical changes were censored. Mean hippocampal dose was tested for correlation with hippocampal atrophy 1 year after RT. Average hippocampal volume change was also calculated for hippocampi receiving high (>40 Gy) or low (<10 Gy) mean RT dose. A multivariate analysis was conducted with linear mixed-effects modeling to evaluate other potential predictors of hippocampal volume change, including patient (random effect), age, hemisphere, sex, seizure history, and baseline volume. Statistical significance was evaluated at α = 0.05. Results: Mean hippocampal dose was significantly correlated with hippocampal volume loss (r=−0.24, P=.03). Mean hippocampal volume was significantly reduced 1 year after high-dose RT (mean −6%, P=.009) but not after low-dose RT. In multivariate analysis, both RT dose and patient age were significant predictors of hippocampal atrophy (P<.01). Conclusions: The hippocampus demonstrates radiation dose–dependent atrophy after treatment for brain tumors. Quantitative MRI is a noninvasive imaging technique capable of measuring radiation effects on intracranial structures. This technique could be investigated as a potential biomarker for development of reliable dose constraints for improved cognitive outcomes.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Annotation of DOM metabolomes with an ultrahigh resolution mass spectrometry molecular formula library

Current approaches to analyzing metabolomic data often rely on matching MS/MS fragmentation data to sparse libraries or databases. This approach results in limited identification of features, often with less than 10% of the dataset being annotated. A complementary approach is to assign molecular formula to features based on accurate mass measurements, but the platforms commonly used for metabolomics do not have the needed accuracy or resolving power to do this robustly, particularly for larger molecules. Using our newly modified analysis tool, CoreMS, we generated a library of molecular formula from pooled samples analyzed with LC-21T FT-ICR MS. This library successfully annotated approximately 53.2% of features identified from the exometabolome of marine diatom Phaeodactylum tricornutum – a nearly ten-fold increase over the 5.9% annotation rate achieved using a conventional MS/MS library matching approach. Using this FT-ICR MS library approach, we were able to differentiate differences in the exometabolome of P. tricornutum in iron replete and iron limited conditions, with 668 metabolites being differentially expressed (p < 0.05, 2 x intensity difference) under these conditions. The traditional MS/MS fragmentation-based annotation approach only annotated 61 of these metabolites, while our novel pipeline annotated 450 metabolites and revealed 12 metabolites that were significantly more abundant under low iron conditions. Our results demonstrate the utility of ultrahigh resolution mass spectrometry for generating more comprehensive and confident molecular annotations.

21T-FTICR-MS, CoreMS↗

POWTEX visits POWGEN

The high-intensity time-of-flight (TOF) neutron diffractometer POWTEX for powder and texture analysis is currently being built prior to operation in the eastern guide hall of the research reactor FRM II at Garching close to Munich, Germany. Because of the world-wide 3 He crisis in 2009, the authors promptly initiated the development of 3 He-free detector alternatives that are tailor-made for the requirements of large-area diffractometers. Herein is reported the 2017 enterprise to operate one mounting unit of the final POWTEX detector on the neutron powder diffractometer POWGEN at the Spallation Neutron Source located at Oak Ridge National Laboratory, USA. As a result, presented here are the first angular- and wavelength-dependent data from the POWTEX detector, unfortunately damaged by a 50 g shock but still operating, as well as the efforts made both to characterize the transport damage and to successfully recalibrate the voxel positions in order to yield nonetheless reliable measurements. Also described is the current data reduction process using the PowderReduceP2D algorithm implemented in Mantid [Arnold et al. (2014). Nucl. Instrum. Methods Phys. Res. A , 764 , 156–166]. The final part of the data treatment chain, namely a novel multi-dimensional refinement using a modified version of the GSAS-II software suite [Toby & Von Dreele (2013). J. Appl. Cryst. 46 , 544–549], is compared with a standard data treatment of the same event data conventionally reduced as TOF diffraction patterns and refined with the unmodified version of GSAS-II . This involves both determining the instrumental resolution parameters using POWGEN's powdered diamond standard sample and the refinement of a friendly-user sample, BaZn(NCN) 2 . Although each structural parameter on its own looks similar upon comparing the conventional (1D) and multi-dimensional (2D) treatments, also in terms of precision, a closer view shows small but possibly significant differences. For example, the somewhat suspicious proximity of the a and b lattice parameters of BaZn(NCN) 2 crystallizing in Pbca as resulting from the 1D refinement (0.008 Å) is five times less pronounced in the 2D refinement (0.038 Å). Similar features are found when comparing bond lengths and bond angles, e.g. the two N—C—N units are less differently bent in the 1D results (173 and 175°) than in the 2D results (167 and 173°). The results are of importance not only for POWTEX but also for other neutron TOF diffractometers with large-area detectors, like POWGEN at the SNS or the future DREAM beamline at the European Spallation Source.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Employing MACS/ViBRANT as a Surrogate MARVEL Reactor for Startup Reactivity Tuning and Supervisory Control Processes

Advanced nuclear reactors are a key part of the future of nuclear energy both in the United States and globally. They offer unique benefits for various energy-demanding applications, including use in remote locations, compact size, modular manufacturing, remote monitoring, low and/or variable power rating operation, and reliance on novel technologies to enhance operational safety. To achieve economic feasibility, advanced reactors must significantly reduce their workforces in comparison with the current fleet. Achieving this reduction will occur through reducing staff workloads using technology to achieve autonomous or semi-autonomous operations, demonstrated by comprehensive testing and validation activities. These operations will require both software and hardware platforms during the design and testing phases. While simulations are useful during the design phase, their performance can significantly deviate during actual deployment on hardware. This report presents the outcomes of a collaborative technical initiative between the U.S. Department of Energy (DOE) Microreactor Program (MRP) and Advanced Sensors and Instrumentation (ASI) Program. The collaboration utilized the Microreactor Automated Control System (MACS) hardware platform to bridge the gap between theoretical reactor design and actual startup and control operations. Two key use cases were investigated: facilitating the startup testing period and demonstrating supervisory control. The first use case details the key Microreactor Applications Research Validation and Evaluation (MARVEL) reactor startup physics testing activities conducted using the MACS platform. These activities included drum worth measurements, shutdown margin assessment, temperature feedback analysis, and scram time evaluation, as well as unique testing that would apply to the MARVEL reactor to demonstrate the testing methodologies in a low-risk environment. The MACS platform, serving as a surrogate representation of the MARVEL reactor, proved instrumental in performing these tests. The exercise revealed aspects that led to optimized processes, refined hardware design, and enhanced base software capabilities. By maturing methods and technologies in this manner, the initiative promises to reduce wasted time in the actual on-site reactor deployment effort, thereby saving significant time and resources. The second use case focuses on the development and implementation of supervisory control methods aimed at managing core tilt, which can result from asymmetrical operations or manufacturing imperfections in fuel rods or reactivity control devices. A key objective was to assess and compare the use of artificial intelligence (AI) for supervisory control. The effort aimed to define the role of supervisory control to enhance performance without risking control instability. This effort explored three distinct approaches: rules-based (RB) methods, optimization techniques, and reinforcement learning (RL) algorithms. Each approach was evaluated for its ease of implementation, its usability, and its effectiveness in responding to asymmetries in neutron flux. Comparative analysis of these approaches provided valuable insights into their applicability and effectiveness, offering a robust framework for advanced reactor operations. Together, these two use cases highlight the potential of hardware test beds to help streamline the design, operation, and control of advanced nuclear reactors. This collaborative effort underscores the importance of continued innovation and experimentation in achieving the next generation of safe, reliable, and economically viable nuclear energy solutions.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗

Experience Report for WOPR

One of the purposes of the SQA effort at LLNL is to attempt to determine the 'goodness' of the research codes used for various scientific applications. Typically these are two and three dimensional multi-physics simulation and modeling codes. These legacy research codes are used for applciations such as atmospheric dispersion modeling and analysis and prediction of the performance of engineered systems. These codes are continually subjected to automated regression test suites consisting of verified and validated expected results. Code is managed in repositories. Experience level of developers is high in the knowledge domain, platforms, and languages used. Code size of the multi-physics code used in this study was 578,242 lines excluding comment and blank lines or 5538.7 function points. Languages were 70% C++, 20% C, and 10% Fortran. The code has 130 users and a development team of 14 and an embedded SQE. The code has achieved 100% prime feature test coverage, 73.6% functional test coverage, and 71.5% statement test coverage. The average cyclomatic complexity of the code was 6.25. The codes have evolved over 10 years. Research codes are challenging because there is a desire to balance agility with discipline as well as compliance with DOE standards. Agility is important to allow experimentation with new algorithms and addition of the latest physics features. Discipline is important to increase the quality of the codes. Automation of processes and defect prevention/detection are deployed throughout the software development process. Since resarch codes are a small segment of the software industry, not much information exists in terms of reliability studies on these types of codes. This paper describes attempts to determine the goodness of these research codes. Goodness defined as both correctness of the codes and their fault densities. Correctness is determined by user interviews, peer review; feature based automated testing, and coverage measurement. This paper focuses on the fault density aspect of goodness and reliability of the codes in particular. The approach taken was to use multiple fault density prediction methods and compare results to actual experimentation and other industry studies on fault density. As a result of the predictions and experiments our confidence in the prediction methods was increased and our confidence in the goodness of the code from a fault density perspective was given more context. A large unintended benefit of these experiments was to find defects hidden for years in the codes when using the Monte Carlo reliability testing results to develop heuristic based bug driven tests.

99 GENERAL AND MISCELLANEOUS↗

Spectral proper orthogonal decomposition of active wake mixing dynamics in a stable atmospheric boundary layer

Recent advancements in the use of active wake mixing (AWM) to reduce wake effects on downstream turbines open new avenues for increasing power generation in wind farms. However, a better understanding of the fluid dynamics underlying AWM is still needed to make wake mixing a reliable strategy for wind farm flow control. In this work, a spectral proper orthogonal decomposition (SPOD) is used to analyze the dynamics of coherent flow structures that are induced in the wake through blade pitch actuation. The data are generated using the ExaWind software suite to perform large eddy simulations of an NREL 2.8 MW turbine operating in a stable atmospheric boundary layer. SPOD tracks the modal behavior of flow structures from their generation in the turbine induction field through their growth in the near-wake region and to their subsequent evolution and energy transfers in the far wake. SPOD is shown to be a useful tool in the context of AWM because it translates the wavenumber and frequency inputs to the turbine controller to structures in the wake. A decomposition of the radial shear stress flux in the wake is also developed using SPOD to measure the contribution of coherent flow structures to mean flow turbulent entrainment and wake recovery. The effectiveness of AWM is connected to its ability to excite inherent structures in the wake of the turbine that arise using baseline controls. The effects of AWM on blade loading are also analyzed by connecting the axial force along the blade to the SPOD analysis of the turbine induction field. Lastly, the performance of different AWM strategies is demonstrated in a two-turbine array.

17 WIND ENERGY↗

sympl (v. 0.4.0) and climt (v. 0.15.3) – towards a flexible framework for building model hierarchies in Python

sympl (System for Modelling Planets) andclimt (Climate Modelling and Diagnostics Toolkit) are anattempt to rethink climate modelling frameworks from the ground up. The aimis to use expressive data structures available in the scientific Pythonecosystem along with best practices in software design to allow scientists toeasily and reliably combine model components to represent the climate systemat a desired level of complexity and to enable users to fully understandwhat the model is doing. sympl is a framework which formulates the model in terms of astate that gets evolved forward in time or modified within a specifictime by well-defined components. sympl's design facilitates buildingmodels that are self-documenting, are highly interoperable, and providefine-grained control over model components and behaviour. symplcomponents contain all relevant information about the input they expect andoutput that they provide. Components are designed to be easily interchanged,even when they rely on different units or array configurations.sympl provides basic functions and objects which could be used inany type of Earth system model. climt is an Earth system modelling toolkit that contains scientificcomponents built using sympl base objects. These include both purePython components and wrapped Fortran libraries. climt providesfunctionality requiring model-specific assumptions, such as stateinitialization and grid configuration. climt's programming interfacedesigned to be easy to use and thus appealing to a wide audience. Model building, configuration and execution are performed through a Pythonscript (or Jupyter Notebook), enabling researchers to build an end-to-endPython-based pipeline along with popular Python data analysis andvisualization tools.

97 MATHEMATICS AND COMPUTING↗

SU-E-T-269: Quality Assurance of Spine Volumetric Modulated Arc Therapy with Flattening Filter Free Beams Using Gafchromic EBT3 Films

Purpose: We implemented the Gafchromic film-based patient specific QA of volumetric modulated arc therapy (VMAT) with flattening-filter free (FFF) beams for spine metastases and validated the accuracy of fast arc delivery. Methods: EBT3 films and a homemade cylindrical QA phantom were employed for dosimetric verification of VMATs. For 14 FFF VMAT plans (10 with 10-MV FFF beams and 4 with 6-MV FFF beams), the doses were recalculated on the phantom and delivered by a TrueBeam STx accelerator equipped with a high-definition 120 leaf MLC. The EBT3 films were scanned using an Epson 10000XL scanner through the FilmQA Pro software. All the irradiated film images were converted to dose map using a calibration response curve. The resulting dose map of film measurement was compared with treatment plan and evaluated using gamma analysis with dose tolerance of 2% within 2 mm. In addition, the point-dose measurement in the phantom using an ion chamber was evaluated as a reference in a ratio of measured and planned doses. Results: The gamma pass rates averaged over all FFF plans for composite-field measurements were 96.0 ± 3.6% (88.9%–99.5%). When adopting a tolerance level of 3% - 3 mm, the gamma pass rates were improved with the ranges from 98% to 100%. In addition, dose profiles and dose distributions showed that spinal cord was protected by the rapid dose fall-off and by delivering the treatment with high precision. In point-dose measurements, the average differences between the measured and planned doses were 0.5% ± 1.0% of the prescription dose. Conclusion: We demonstrated that Gafchromic EBT3 film would be an effective patient-specific QA tool, especially for VMAT of spine SBRT with treatment of small fields and highly gradient dose distributions. The results of film QA verified that the dosimetric accuracy of spine SBRT utilizing RapidArc with FFF beams in our institution is reliable.

60 APPLIED LIFE SCIENCES↗

PROVIDING PLANT DATA ANALYTICS THROUGH A SEAMLESS DIGITAL ENVIRONMENT

As technology continues to evolve and become more integrated into a worker’s daily routine in the Nuclear Power industry the need for easy access to data becomes a priority. Not only does the need for data increase but the amount of data collected increases. In most cases the data is collected and stored in various software applications, many of which are legacy systems, which do not offer any other option to access the data except through the application’s user interface. Furthermore the data gets grouped in “silos” according to work function and not necessarily by subject. Hence, in order to access all the information needed for a particular task or analysis one may have to access multiple applications to gather all the data needed. The industry and the research community have identified the need for a digital architecture and more importantly the need for a Seamless Digital Environment. An SDE provides a means to access multiple applications, gather the data points needed, conduct the analysis requested, and present the result to the user with minimal or no effort by the user. In addition, the nuclear utilities have identified the need for research focused on data analytics. The effort should develop and evaluate use cases for data mining and analytics for employing information from plant sensors and database for use in developing improved business analytics. Idaho National Laboratory is leading such effort, which is conducted in close collaboration with vendors, nuclear utilities, Institute of Nuclear Power Operations, and Electric Power Research Institute. The goal of the study is to research potential approaches to building an analytics solution for equipment reliability, on a small scale, focusing on either a single piece of equipment or a single system. The analytics solution will likely consist of a data integration layer, predictive and machine learning layer and the user interface layer that will display the output of the analysis in a straight forward, easy to consume manner. This paper will describe the study and the initial results.

47 OTHER INSTRUMENTATION↗