Search NASA⌕ Search

SEARCH · Search NASA

Results for “Software behavior computation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 379 records · Page 21

Signal Decomposition for Intrusion Detection in Reliability Assessment in Cyber Resilience (Summary Report)

The complexity of assuring cyber resilience for physical process interactions in connected systems such as energy grids increases dramatically as the coupling between processes becomes more direct and responsive. An example of this growing complexity is provided by Integrated Energy Systems (IES), in which various processes such as nuclear heat generation and commodity production are being directly coupled for increased responsiveness to highly variable signals such as market pricing or electricity demand. As such, the potential attack surface of the coupled processes is larger than the two processes independently. Securing these complex systems requires two-fold monitoring: cybersecure monitoring for potential malicious incursion, and physics monitoring for system tampering. Physics monitoring includes analyzing the behavior of the signals within the system for anomalous behavior. This analysis has been shown to be insufficient if approached by only data-driven machine learning and artificial intelligence (MLAI) techniques or only low-level model comparison. Previous efforts at Purdue University suggested combining high-fidelity models with MLAI algorithms as a basis for a software tool for detecting anomalies in physical processes. This work built on that suggestion, developing an advanced library for signal decomposition and analysis using both MLAI and high-fidelity physics algorithms for greatly improved anomaly detection, especially false data injection. This software can be used as part of a secure imbedded intelligence (SEI) system designed under Consequence-driven Cyber-informed Engineering (CCE) for complex coupled systems. This library established a foundation for online and posteriori analysis of digital signals for the purpose of detecting potential malicious tampering in digital signals representing physical processes. Demonstrations carried out throughout the development highlight the effective use of characterization algorithms to detect signal perturbations, particularly triangle attack-style perturbations, in three wide-ranging applications: seismic monitoring, nuclear thermal hydraulics system simulation, and custom manufacturing.

97 MATHEMATICS AND COMPUTING↗

GDSA - Modeling and Integration – ORNL: PFLOTRAN modeling

This report summarizes work done at Oak Ridge National Laboratory (ORNL) related to post-closure criticality consequence analysis of dual-purpose canister (DPC) direct disposal in unsaturated alluvium. PFLOTRAN software was used to model the behavior of a breached DPC with low water infiltration rates and unsaturated conditions in alluvial deposits such that a low-power criticality event occurs with a focus on thermal hydrological constraints on criticality timing and power output. This summary describes initial exploration of those thermal hydrological processes and of the long-term average power output from a criticality event that could be sustained without driving water out of the DPC package and thereby terminating the criticality event. The objectives are (1) to identify, for different groundwater infiltration rates, the time at which the DPC fills with water sufficiently to potentially initiate criticality; (2) to bound the power output that could be produced by a criticality event that would thermally drive water out of the package at various percolation rates; and (3) provide an estimate of how the size of a package breach affects the water infiltration and therefore the possibility timing of criticality.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

WISP: Watching grid Infrastructure Stealthily through Proxies (Final Technical Report)

The complex interdependencies of cyber systems (sensors and communications), physical grids and associated electricity market operations make protecting electric power grids a significant challenge. The energy sector is constantly under new, targeted, advanced and dangerous cyber-attacks that have the potential to result in the loss of human life. These threats are further exacerbated by our need to modernize the grid. One focus of cyber security research in smart grids is the securing of the SCADA system through advanced intrusion detection systems (IDS) and bad data detection algorithms in state estimation. These methods either require full knowledge of the system topology and parameters or fail to understand the physical behaviors under attack. WISP (Watching grid Infrastructure Stealthily through Proxies) is designed to provide additional protection to the power grid using only publicly available data. In particular, WISP exploits the spatio-temporal nature of the real time locational marginal prices (LMPs), in conjunction with other information such as bids, weather, outages and load data to analyze anomalous power pricing behaviors and then correlate those observations to localize regions of interest and identify potential cyber events. WISP is non-intrusive as the tool is deployed as a service in the Cloud or on premise and provides reliable information to system operators for enhanced situational awareness, without impeding energy delivery functions. The WISP technology comprises three modules: the data-driven anomaly detection core, the vulnerability and risk analysis and the root cause analysis. The data-driven anomaly detection core performs the tasks of feature selection, anomaly detection and attack region localization. The vulnerability and risk analysis module provides system level information of the vulnerable variables and times, assisting the operators in selecting monitoring and protection nodes. The root cause analysis module takes the detection results and identifies potential operational conditions that contribute to the detected anomalies. In Phase I, we have demonstrated the feasibility and effectiveness of WISP. We developed a realistic electricity market simulator capable of generating normal and attack market data under various operational conditions. We developed a series of cyber-attack detection and analysis algorithms and evaluated them under multiple data sources. Finally, we integrated all modules into an end-to-end software, providing functions for data management, data analytics and visualization. Specifically, we have achieved: (i) real-time data acceptance from external utility interfaces with >99% acceptance rate; (ii) high performance anomaly detection algorithms with >98% detection accuracy and <0.1% false alarm rate; and (iii) ultra-low computing delay <50 milliseconds. Additionally, our team developed algorithms to identify the vulnerable variables in electricity market operations and root cause analysis functions to identify major contributors to the price spikes. These ancillary modules are necessary when deploying WISP in real world industry environment. In Phase II, we have demonstrated the effectiveness of WISP software on realistic largescale power systems. We performed red team testing for the Phase I WISP software and identified software vulnerabilities and implemented corresponding mitigation solutions. We adapted the electricity market simulator for the Texas synthetic 2000-bus system and generated datasets for the false data injection attacks. We created database and visualization interfaces for the Texas system and the ISO New England system. We performed software optimization in terms of operation efficiency, computing speed and detection accuracy. Finally, we tested the software on the Texas system and the ISO New England system and evaluated the detection performance. Overall, we achieved above 89% detection rate, below 3% false alarm rate and below 37 seconds of end-to-end detection delay.

24 POWER TRANSMISSION AND DISTRIBUTION↗

SU-F-T-213: Commissioning Results of the Prototype Active Scanning Irradiation System of Korea Heavy Ion Medical Accelerator

Purpose: A prototype actives scanning beam delivery system was designed, manufactured and installed as a part of the Korea Heavy Ion Medical Accelerator Project. The prototype system includes the most components for steering, modulating, detecting incident beam to patient. The system was installed in MC-50 cyclotron beam line and tested to extract the normal operation conditions. Methods: The commissioning process was completed by using 45 MeV of proton beam. To measure the beam position accuracy along the scanning magnet power supply current, 25 different spots were scanning and measured. The scanning results on GaF film were compared with the irradiation plan. Also, the beam size variation and the intensity reduction using range shifter were measured and analyzed. The results will be used for creating a conversion factors for asymmetric behavior of scanning magnets and a dose compensation factor for longitudinal direction. Results: The results show asymmetry operations on both scanning × and y magnet. In case of scanning magnet × operation, the current to position conversion factors were measured 1.69 mm/A for positive direction and 1.74 mm/A for negative direction. The scanning magnet y operation shows 1.38mm/A and 1.48 mm/A for both directions. The size of incoming beam which was 18 mm as sigma becomes larger up to 55 mm as sigma while using 10 mm of the range shifter plate. As the beam size becomes large, the maximum intensity of the was decreased. In case of using 10 mm of range shifter, the maximum intensity was only 52% compared with no range shifter insertion. Conclusion: For the appropriate operation of the prototype active scanning system, the commissioning process were performed to measure the beam characteristics variation. The obtained results would be applied on the irradiation planning software for more precise dose delivery using the active scanning system.

43 PARTICLE ACCELERATORS↗

Benchmark Modeling and Simulation of the FFTF LOFWOS Test #13 Using SAM

The Fast Flux Test Facility (FFTF) was a 400 MW thermal powered, oxide-fueled, liquid sodium cooled test reactor, built to assist development and testing of advanced fuels and materials for fast breeder reactors. In July 1986, a series of unprotected Loss of Flow Without Scram (LOFWOS) transients were performed in FFTF as part of the Passive Safety Testing (PST) program. The LOFWOS Test #13, which was initiated at 50% power and 100% flow with the pump pony motors left off, has been chosen as a benchmark case by IAEA to support collaborative efforts within international partnerships on the validation of simulation tools and models in the area of sodium fast reactor passive safety in an IAEA Coordinated Research Project (CRP), launched in October 2018. The System Analysis Module (SAM) is an advanced and modern system analysis tool under development at Argonne National Laboratory for advanced non-LWR safety analysis. It utilizes the object-oriented application framework MOOSE to leverage the modern software environment and advanced numerical methods. The capabilities of SAM are being extended to enable the transient modeling, analysis, and design of various advanced nuclear reactor systems. To participate the IAEA CRP and enhance the SAM validation base for advanced reactor transient safety analysis, benchmark simulations of the FFTF LOFWOS Test #13 are performed using the SAM code. In this first phase of the validation effort, the thermal-hydraulic behavior of the reactor system is the focus and the reactor kinetics is not considered in the SAM FFTF model. Instead, the results of Argonne’s neutronics calculations are directly used, including the power shape of the active core region and the power history during the transient. The simulation results of FFTF at steady state agreed well with the measured data from the test. During the transient, reasonably good agreement were also obtained. Future work to improve the model will focus on introducing the reactivity predictions into the model, as well as better understanding or resolving the current discrepancies with the measured data.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Methodology for assessing the safety of Hydrogen Systems: HyRAM 1.1 technical reference manual

The HyRAM software toolkit provides a basis for conducting quantitative risk assessment and consequence modeling for hydrogen infrastructure and transportation systems. HyRAM is designed to facilitate the use of state-of-the-art science and engineering models to conduct robust, repeatable assessments of hydrogen safety, hazards, and risk. HyRAM is envisioned as a unifying platform combining validated, analytical models of hydrogen behavior, a stan- dardized, transparent QRA approach, and engineering models and generic data for hydrogen installations. HyRAM is being developed at Sandia National Laboratories for the U. S. De- partment of Energy to increase access to technical data about hydrogen safety and to enable the use of that data to support development and revision of national and international codes and standards. This document provides a description of the methodology and models contained in the HyRAM version 1.1. HyRAM 1.1 includes generic probabilities for hydrogen equipment fail- ures, probabilistic models for the impact of heat flux on humans and structures, and computa- tionally and experimentally validated analytical and first order models of hydrogen release and flame physics. HyRAM 1.1 integrates deterministic and probabilistic models for quantifying accident scenarios, predicting physical effects, and characterizing hydrogen hazards (thermal effects from jet fires, overpressure effects from deflagrations), and assessing impact on people and structures. HyRAM is a prototype software in active development and thus the models and data may change. This report will be updated at appropriate developmental intervals.

97 MATHEMATICS AND COMPUTING↗

CRNT4SBML: a Python package for the detection of bistability in biochemical reaction networks

Motivation: Signaling pathways capable of switching between two states are ubiquitous within living organisms. They provide the cells with the means to produce reversible or irreversible decisions. Switchlike behavior of biological systems is realized through biochemical reaction networks capable of having two or more distinct steady states which are dependent on initial conditions. Investigation of whether a certain signaling pathway can confer bistability involves a substantial amount of hypothesis testing. The cost of direct experimental testing can be prohibitive. Therefore, constraining the hypothesis space is highly bene?cial. One such methodology is based on Chemical Reaction Network Theory which uses computational techniques to rule out pathways that are not capable of bistability regardless of kinetic constant values and molecule concentrations. Although useful, these methods are complicated from both pureandcomputationalmathematicsperspectives.Thus,theiradoptionisverylimitedamongstbiologists. Results: We brought Chemical Reaction Network Theory approaches closer to experimental biologists by automating all the necessary steps in CRNT4SMBL. The input is based on SBML format which is the community standard for biological pathway communication. The tool parses SBML and derives C-graph representations of the biological pathway with mass action kinetics. Next steps involve an ef?cient search for potential saddle-node bifurcation points using an optimization technique. This type of bifurcation is important as it has the potential of acting as a switching point between two steady states. Finally, if any bifurcation points are present, numerical continuation analysis extends the equilibria branches for generating the diagram. Presence of an S-shaped bifurcation diagram indicates that the pathway acts as a bistable switch for the given optimization parameters. Availability: CRNT4SBML is available via the Python Package Index. The documentation can be found at https://crnt4sbml.readthedocs.io. CRNT4SBML is licensed under the Apache Software License 2.0. Contact: vladislav.petyuk@pnnl.gov

Reyes, Brandon C.↗

Assessment of Physicochemical Properties of Electrical Arc Furnace Slag and Their Effects on Foamability

The composition of slags of an electric arc furnace (EAF) in a commercial melt shop was systematically analyzed with a focus on slag foaming. Basic behavior of FeO in an EAF slag was confirmed using fundamental thermodynamics. Monoxide ([Mg,Fe,Mn]O = M’O) and spinel ([Mg,Fe]Al{sub 2}O{sub 4}) phases in EAF slag were confirmed by X-ray diffraction analysis, and these results were interpreted in the context of equilibrium cooling calculation using FactSage™ software. Furthermore, the distribution of MgO with respect to the M’O-saturation limit at different basicity ratios (=CaO/SiO{sub 2}=C/S) and temperatures was evaluated. In particular, the relationship between MgO and FeO for C/S ratios ranging from 1.3 to 1.6 was considered with reference to phase equilibria. Foam height was affected by slag viscosity (η) and gas generation according to changes in C/S ratio and FeO content. Foaming index (Σ) decreased with the increasing C/S ratio and FeO content. The measured foam heights were relatively higher than the calculated values, and the result indicates that the effect of M’O on slag foaming in commercial process is remarkable. Therefore, slag chemistry should be optimized based on thermodynamic considerations and thermophysical properties to achieve good foaming characteristics.

36 MATERIALS SCIENCE↗

Surface rheology and interface stability.

We have developed a mature laboratory at Sandia to measure interfacial rheology, using a combination of home-built, commercially available, and customized commercial tools. An Interfacial Shear Rheometer (KSV ISR-400) was modified and the software improved to increase sensitivity and reliability. Another shear rheometer, a TA Instruments AR-G2, was equipped with a du Nouey ring, bicone geometry, and a double wall ring. These interfacial attachments were compared to each other and to the ISR. The best results with the AR-G2 were obtained with the du Nouey ring. A Micro-Interfacial Rheometer (MIR) was developed in house to obtain the much higher sensitivity given by a smaller probe. However, it was found to be difficult to apply this technique for highly elastic surfaces. Interfaces also exhibit dilatational rheology when the interface changes area, such as occurs when bubbles grow or shrink. To measure this rheological response we developed a Surface Dilatational Rheometer (SDR), in which changes in surface tension with surface area are measured during the oscillation of the volume of a pendant drop or bubble. All instruments were tested with various surfactant solutions to determine the limitations of each. In addition, foaming capability and foam stability were tested and compared with the rheology data. It was found that there was no clear correlation of surface rheology with foaming/defoaming with different types of surfactants, but, within a family of surfactants, rheology could predict the foam stability. Diffusion of surfactants to the interface and the behavior of polyelectrolytes were two subjects studied with the new equipment. Finally, surface rheological terms were added to a finite element Navier-Stokes solver and preliminary testing of the code completed. Recommendations for improved implementation were given. When completed we plan to use the computations to better interpret the experimental data and account for the effects of the underlying bulk fluid.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Development of a bayesian belief network model for the software reliability assessment of nuclear digital I and C safety systems - 206

Since the digital instrumentation and control systems are expected to play an important role for the safety systems in nuclear power plants (NPPs), the need has emerged to not only establish a basis for incorporating software behavior into digital I and C system reliability models, but also to quantify the failure probability of the software used in NPP digital protection systems. In this study, a Bayesian belief network (BBN) model is developed to quantitatively assess software reliability by estimating the number of faults in a software program considering its software development life cycle (SDLC). The model structure and parameters are established based on the information applicable to NPP safety-related systems and the evidence used to construct and quantify the BBN model was collected from three stages of expert elicitation. The software failure probability is estimated from the number of residual defects in a software program at the end of SDLC phase. As a case study, the BBN model was applied to quantify the software reliability of a typical digital protection software having the size of 50 function points and having the Medium development and validation and verification (V and V) qualities. The developed model can be applied to estimate the failure probability for both developing and deployed safety-related NPP software, and such results can be used to evaluate the quality of the digital I and C systems in addition to estimating potential reactor risk due to software failure. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Time Dependent Data Mining in RAVEN

RAVEN is a generic software framework to perform parametric and probabilistic analysis based on the response of complex system codes. The goal of this type of analyses is to understand the response of such systems in particular with respect their probabilistic behavior, to understand their predictability and drivers or lack of thereof. Data mining capabilities are the cornerstones to perform such deep learning of system responses. For this reason static data mining capabilities were added last fiscal year (FY 15). In real applications, when dealing with complex multi-scale, multi-physics systems it seems natural that, during transients, the relevance of the different scales, and physics, would evolve over time. For these reasons the data mining capabilities have been extended allowing their application over time. In this writing it is reported a description of the new RAVEN capabilities implemented with several simple analytical tests to explain their application and highlight the proper implementation. The report concludes with the application of those newly implemented capabilities to the analysis of a simulation performed with the Bison code.

97 MATHEMATICS AND COMPUTING↗

StructuredFuzzer: Fuzzing Structured Text-Based Control Logic Applications

Rigorous testing methods are essential for ensuring the security and reliability of industrial controller software. Fuzzing, a technique that automatically discovers software bugs, has also proven effective in finding software vulnerabilities. Unsurprisingly, fuzzing has been applied to a wide range of platforms, including programmable logic controllers (PLCs). However, current approaches, such as coverage-guided evolutionary fuzzing implemented in the popular fuzzer American Fuzzy Lop Plus Plus (AFL++), are often inadequate for finding logical errors and bugs in PLC control logic applications. They primarily target generic programming languages like C/C++, Java, and Python, and do not consider the unique characteristics and behaviors of PLCs, which are often programmed using specialized programming languages like Structured Text (ST). Furthermore, these fuzzers are ill suited to deal with complex input structures encapsulated in ST, as they are not specifically designed to generate appropriate input sequences. This renders the application of traditional fuzzing techniques less efficient on these platforms. To address this issue, this paper presents a fuzzing framework designed explicitly for PLC software to discover logic bugs in applications written in ST specified by the IEC 61131-3 standard. The proposed framework incorporates a custom-tailored PLC runtime and a fuzzer designed for the purpose. We demonstrate its effectiveness by fuzzing a collection of ST programs that were crafted for evaluation purposes. We compare the performance against a popular fuzzer, namely, AFL++. The proposed fuzzing framework demonstrated its capabilities in our experiments, successfully detecting logic bugs in the tested PLC control logic applications written in ST. On average, it was at least 83 times faster than AFL++, and in certain cases, for example, it was more than 23,000 times faster.

47 OTHER INSTRUMENTATION↗

Implementation of a feature selection algorithm in FARM to identify important state variables and time-invariant matrices

The FARM (Feasible Actuator Range Modifier) software module is a component of the RAVEN-based FORCE framework for analysis of Integrated Energy Systems (IES). FARM aids the HERON software module in the evaluation of the optimal dispatch for the different IES components. Set-point trajectories are required to meet limits on both production variables (i.e., the variables to be optimized such as the electrical power, the hydrogen production rate, etc.) and process variables tied to the service life of equipment (e.g., steam flowrate, vessel pressure, turbine firing temperature, etc.). To evaluate the feasibility of HERON generated set-points and to do so in an acceptable time, FARM employs reduced order models to represent the dynamic behavior of the systems to be dispatched. These surrogate models take the form of a linear dynamic system with sets of Linear Parameter Varying (LPV) matrices that are mapped to the system operating space. These matrices are derived from the trajectories of system state variables and system output variables during transients. The accuracy of LPV matrices depends on the selection of state variables. In previous reports, state variables were selected by adopting a complicated workflow requiring multiple software licenses and an advanced level of user expertise. In this report, a new workflow that automates the state variable selection process is presented. It significantly reduces the frequency of user interventions and does not require multiple software licenses. Each module in the new workflow is described in detail, and the input / output examples in each step of the workflow are provided. It was demonstrated that this workflow can greatly reduce the complexity of the state variable selection process, and that the updated FARM-Gamma and FARM-Delta validators can benefit from this workflow when solving the power dispatch problem of a representative IES test case. Finally, some code improvements that can further enhance the efficiency are suggested.

42 ENGINEERING↗

Testing Dual Rotary Filters - 12373

The Savannah River National Laboratory (SRNL) installed and tested two hydraulically connected SpinTek{sup R} Rotary Micro-filter units to determine the behavior of a multiple filter system and develop a multi-filter automated control scheme. Developing and testing the control of multiple filters was the next step in the development of the rotary filter for deployment. The test stand was assembled using as much of the hardware planned for use in the field including instrumentation and valving. The control scheme developed will serve as the basis for the scheme used in deployment. The multi filter setup was controlled via an Emerson DeltaV control system running version 10.3 software. Emerson model MD controllers were installed to run the control algorithms developed during this test. Savannah River Remediation (SRR) Process Control Engineering personnel developed the software used to operate the process test model. While a variety of control schemes were tested, two primary algorithms provided extremely stable control as well as significant resistance to process upsets that could lead to equipment interlock conditions. The control system was tuned to provide satisfactory response to changing conditions during the operation of the multi-filter system. Stability was maintained through the startup and shutdown of one of the filter units while the second was still in operation. The equipment selected for deployment, including the concentrate discharge control valve, the pressure transmitters, and flow meters, performed well. Automation of the valve control integrated well with the control scheme and when used in concert with the other control variables, allowed automated control of the dual rotary filter system. Experience acquired on a multi-filter system behavior and with the system layout during this test helped to identify areas where the current deployment rotary filter installation design could be improved. Completion of this testing provides the necessary information on the control and system behavior that will be used in deployment on actual waste. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Simplified inelastic constitutive models for ASME Section III, Division 5 design by inelastic analysis

This report describes the development of simplified, universal constitutive model that captures the high temperature monotonic and cyclic behavior of a range of commonly-used high temperature materials. The goal of the work is to provide a simple, universal constitutive model to replace the current bespoke models for Grade 91, 316H, and Alloy 617 included in Nonmandatory Appendix HBB-Z of the ASME Boiler & Pressure Vessel Code, and to extend this model to cover Alloy 800H. We initiated this work in response to feedback from reactor vendors and other Code users requesting simplified models, compared to the current models, that are easier to implement and use in commercial finite element analysis software. This report describes the completion of this effort by developing a model to correct the defects in standard model forms presently used for high temperature material modeling, described in past work, developing and implementing new numerical methods to train this model against test data, and then actually training the model for the four materials. The report provides a complete mathematical description of the model along with the tabulated material coefficients for the four materials. The final step will be to formulate an ASME Code change to introduce the new models into the Code.

36 MATERIALS SCIENCE↗

Vacuum arc behavior and its voltage characteristics in drawing process controlled by composite magnetic fields along axial and transverse directions

In this research, drawing vacuum arc (VA) experiments were conducted using composite contacts under currents ranging from 5 kA to 20 kA root mean square (rms). The new type of contact comprised an axial magnetic field (AMF) configuration and a transverse magnetic field (TMF) configuration. The TMF plate was in the center, surrounded by the AMF plate. The contact generated both AMFs and TMFs simultaneously. VA appearances and arc voltages were recorded, and the VA was modeled as a conductor for electromagnetic force analysis in ANSYS software. The results showed that the coaxiality of operating mechanisms significantly influenced arc behavior just as the arc was ignited. When arc brightness did not increase after ignition, there was a voltage drop accompanied with diffusion of the VA. As to VA development, when an arc was ignited on an AMF plate, it spread on the plate and rotated. Over time the arc current increased, the constricting arc forms, and the arc column rotated on the TMF plate under the action of Ampere's force. With regard to the influence of a magnetic field on a VA at different stages, in the initial drawing arc stage the TMF was dominant, and the arc started to rotate under the action of Ampere's force. Afterwards, the AMF was dominant, with a steadily burning arc. As for contact melting, in the initial arcing period, a contracted short arc caused severe melting and erosion of the contact plate. When the ignition spot or root was close to the slot of plate, the electromagnetic force pushed the arc toward slot and contact edge, resulting in local erosion of the slot region.

42 ENGINEERING↗

A comprehensive evaluation of various sensitivity analysis methods: A case study with a hydrological model

Sensitivity analysis (SA) is a commonly used approach for identifying important parameters that dominate model behaviors. We use a newly developed software package, a Problem Solving environment for Uncertainty Analysis and Design Exploration (PSUADE), to evaluate the effectiveness and efficiency of ten widely used SA methods, including seven qualitative and three quantitative ones. All SA methods are tested using a variety of sampling techniques to screen out the most sensitive (i.e., important) parameters from the insensitive ones. The Sacramento Soil Moisture Accounting (SAC-SMA) model, which has thirteen tunable parameters, is used for illustration. The South Branch Potomac River basin near Springfield, West Virginia in the U.S. is chosen as the study area. The key findings from this study are: (1) For qualitative SA methods, Correlation Analysis (CA), Regression Analysis (RA), and Gaussian Process (GP) screening methods are shown to be not effective in this example. Morris One-At-a-Time (MOAT) screening is the most efficient, needing only 280 samples to identify the most important parameters, but it is the least robust method. Multivariate Adaptive Regression Splines (MARS), Delta Test (DT) and Sum-Of-Trees (SOT) screening methods need about 400–600 samples for the same purpose. Monte Carlo (MC), Orthogonal Array (OA) and Orthogonal Array based Latin Hypercube (OALH) are appropriate sampling techniques for them; (2) For quantitative SA methods, at least 2777 samples are needed for Fourier Amplitude Sensitivity Test (FAST) to identity parameter main effect. McKay method needs about 360 samples to evaluate the main effect, more than 1000 samples to assess the two-way interaction effect. OALH and LPτ (LPTAU) sampling techniques are more appropriate for McKay method. For the Sobol' method, the minimum samples needed are 1050 to compute the first-order and total sensitivity indices correctly. These comparisons show that qualitative SA methods are more efficient but less accurate and robust than quantitative ones.

58 GEOSCIENCES↗

Accelerating Hanford Site Cleanup through Operations Research Modeling - 20238

The Hanford Site cleanup effort will require the integration of dozens of unique facilities and processes, many of which will be first-of-a-kind in implementation and design. Each facility will be governed by its own set of operating logic, configured with a unique array of unit operations, and subject to a set of constraints that will affect its behavior. The collection of facilities have multiple points of interface, making the operations of any one facility potentially significant to the operations of other up- or downstream processes. It is therefore highly desirable to accurately predict these operations, as it allows for Site officials to identify and preempt bottlenecks and vulnerabilities before they unexpectedly inhibit the cleanup mission. With the quantity and complexity of the processes that will be on Site, building a pen-and-paper or even a spreadsheet-assisted model of the cleanup mission quickly becomes overwhelming in scope and inaccurate in execution. The Engineering organization for the Site's Tank Operations Contract (TOC) has therefore implemented the use of operations research (OR) modeling to simulate and predict future operations of Site facilities. These models are created using a discrete event simulation tool that allows for the development of detailed, versatile, and robust models. Not only can these models account for complex logical behaviors, but they can also simulate process details down to the level of vessel sizing, labor utilization, equipment reliability, and resource availability. To date, the TOC has developed OR models for several facilities on Site, including for single-shell tank (SST) farms, double-shell tank (DST) farms, the Effluent Treatment Facility (ETF), and the waste transfer system. These models have focused on identifying bottlenecks and operational constraints, and have been used to quantify the effects of implementing process changes. This latter point is particularly valuable, as it allows for several alternatives to be studied in a virtual setting before committing resources to making a change in the field. The decision to develop OR models has gained tremendous support from the Site's stakeholders and the U.S. Department of Energy (DOE) management, and has prompted the use of the tool to support additional internal and external initiatives. Recently, an initiative was proposed to use the models to help identify and provide quantitative backing for risks and opportunities for the TOC. This application of OR could not only help inform how the TOC manages its risks (e.g. quantities and types of spare parts), but could also help drive process improvements whose benefits might otherwise be hard to quantify. The models have also been used to drive the TOC's cloud computing, artificial intelligence (AI), and machine learning (ML) initiatives. These initiatives will not only improve the ability of the TOC to more rapidly respond to the needs of its customers, but it will also aid in the ability of the TOC to analyze and improve the processes it studies. Partnership with two external software development and consulting companies (Lanner and Ynformed) has furthered not only the application of AI and ML within the TOC, but has also spurred the development of new/improved software tools and platforms used by the companies. These partnerships have proven to be mutually beneficial and productive, and have set a precedent for the types of gains that can be made by exploring such options. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗