Sandia's Uncertainty Calculator: A case study in the graded approach to software quality assurance.
Abstract not provided.
SEARCH · Search NASA
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Abstract not provided.
Explore the source record for details and available documents.
Abstract not provided.
The modernization of existing and new nuclear power plants with digital instrumentation and control systems (DI&C) is a recent and highly trending topic. However, there lacks strong consensus on best-estimate reliability methodologies by both the United States (U.S.) Nuclear Regulatory Commission (NRC) and the industry. This has resulted in hesitation for further modernization projects until a more unified methodology is realized. In this work, we develop an approach called Orthogonal-defect Classification for Assessing Software Reliability (ORCAS) to quantify probabilities of various software failure modes in a DI&C system. The method utilizes accepted industry methodologies for software quality assurance that are also verified by experimental or mathematical formulations. In essence, the approach combines a semantic failure classification model with a reliability growth model to predict (and quantify) the potential failure modes of a DI&C software system. The semantic classification model is used to address the question: How do latent defects in software contribute to different software failure root causes? The use of reliability growth models is then used to address the question: Given the connection between latent defects and software failure root causes, how can we quantify the reliability of the software? A case study was conducted on a representative I&C platform (ChibiOS) running a smart sensor acquisition software developed by Virginia Commonwealth University (VCU). The testing and evidence collection guidance in ORCAS was applied, and defects were uncovered in the software. Qualitative evidence, such as condition coverage, was used to gauge the completeness and trustworthiness of the assessment while quantitative evidence was used to determine the software failure probabilities. The reliability of the software was then estimated and compared to existing operational data of the sensor device. It is demonstrated that by using ORCAS, a semantic reasoning framework can be developed to justify software reliability (or unreliability) while still leveraging the strength of the existing methods.
The modernization of existing and new nuclear power plants with digital instrumentation and control systems (DI&C) is a recent and highly trending topic. However, there lacks strong consensus on best-estimate reliability methodologies by both the United States (U.S.) Nuclear Regulatory Commission (NRC) and the industry. This has resulted in hesitation for further modernization projects until a more unified methodology is realized. In this work, we develop an approach called Orthogonal-defect Classification for Assessing Software Reliability (ORCAS) to quantify probabilities of various software failure modes in a DI&C system. The method utilizes accepted industry methodologies for software quality assurance that are also verified by experimental or mathematical formulations. In essence, the approach combines a semantic failure classification model with a reliability growth model to predict (and quantify) the potential failure modes of a DI&C software system. The semantic classification model is used to address the question: How do latent defects in software contribute to different software failure root causes? The use of reliability growth models is then used to address the question: Given the connection between latent defects and software failure root causes, how can we quantify the reliability of the software? A case study was conducted on a representative I&C platform (ChibiOS) running a smart sensor acquisition software developed by Virginia Commonwealth University (VCU). The testing and evidence collection guidance in ORCAS was applied, and defects were uncovered in the software. Qualitative evidence, such as condition coverage, was used to gauge the completeness and trustworthiness of the assessment while quantitative evidence was used to determine the software failure probabilities. The reliability of the software was then estimated and compared to existing operational data of the sensor device. It is demonstrated that by using ORCAS, a semantic reasoning framework can be developed to justify if the software is reliable (or unreliable) while still leveraging the strength of the existing methods.
The goal of the Field Laboratory for Emerging Stacked Unconventional Plays (ESUP) in Central Appalachia project was to investigate and characterize the resource potential for multi-play production of emerging unconventional reservoirs in Central Appalachia. Project activities included drilling, logging and coring of a vertical characterization well drilled to basement to approximately 15,000 feet in depth. The data from drilling and well logs as well recovered core samples were used by the research team to support characterization of the geology and potential pay zones within the Nora Gas Field of southwestern Virginia and the greater Central Appalachian Basin. This project was led by Dr. Nino Ripepi of the Virginia Center for Coal and Energy Research (VCCER) in close collaboration with EnerVest Operating LLC (EnerVest). VCCER is housed in the Department of Mining and Minerals Engineering at Virginia Tech and was created by an Act of the Virginia General Assembly on March 30, 1977, as an interdisciplinary study, research, information, and resource facility for the Commonwealth of Virginia. EnerVest is a top tier, low-cost oil and natural gas company with a long history of traditional operating relationships with institutional investors as well as public and private companies. This report summarizes two major research activities: 1) Log and Core Analysis and 2) Numerical Modeling. Core analysis comprises the characterization efforts of the ESUP Field Laboratory and includes a discussion of the well logs run in the deep characterization wells, an initial analysis of those, the number, size and location of cores recovered, core testing and analysis done to date as well as plans for future analysis. Numerical modeling is comprised of seven major modeling efforts, including (1) Multiphysics shale transport modeling work, (2) the developed in-house compositional simulator studies, (3) reservoir modeling studies using GEM software, (4) fracture modeling work using EFRAC3D software and (5) numerical modeling efforts with ABAQUS software, (6) Numerical modeling efforts using FLAC3D and PFC3D, and (7) Automatic Machine Learning (AutoML) Studies.
An open source test system is developed that permits the dynamic modeling of centrally-managed wholesale power markets operating over highvoltage transmission grids. In default mode, the test system models basic operations in the Electric Reliability Council of Texas (ERCOT): namely, centrally-managed day-ahead and real-time markets operating over successive days, with congestion handled by locational marginal pricing. These basic operational features characterize all seven U.S. energy regions organized as centrally-managed wholesale power markets. Modeled participants include dispatchable generators, load-serving entities, and non-dispatchable generation such as unrmed wind and solar power. Users can congure a broad variety of parameters to study basic market and grid features under alternative system conditions. Users can also easily extend the test system's Java/Python software classes to study modied or newly envisioned market and grid features. Finally, the test system is integrated with a high-level simulation framework that permits it to function as a software component within larger systems, such as multi-country systems or integrated transmission and distribution systems. Finally, detailed test cases with 8-bus and 200-bus transmission grids are reported to illustrate these test system capabilities.
The electric power system is intrinsically a cyber‐physical system (CPS) with power flowing inthe physical system and information flowing in the cyber‐network. Testbeds arecrucial for understanding the cyber‐physical interactions and provideenvironments for prototyping novel applications. This study proposes afour‐layer architecture for CPS testbeds with emphases on communication networkemulation and networked physical components. A configurable software‐definednetwork is employed to bridge physical components with wide‐area applicationsfor closed‐loop control. In order to distribute physically coupled devices intomultiple software simulations, this study proposes a data broker setup based ona distributed messaging environment to achieve low‐latency data streaming. Thedecoupled design with data streaming allows for building testbed components asmodules and running them in a distributed manner. Case studies verify the databroker setup for low‐latency sensing and actuation, as well as the communicationemulation setup for the desired network latency. Also illustrated is a replayattack scenario using synchrophasors in the Western Electricity CoordinatingCouncil (WECC) 181‐bus system for demonstrating the closed‐loop cyber‐physicalsimulation capability of the testbed.
Purpose: To introduce a new skin dose mapping software system for interventional fluoroscopy dose assessment and to analyze the benefits and limitations of patient-phantom matching. Methods: In this study, a new software system was developed for visualizing patient skin dose during interventional fluoroscopy procedures. The system works by translating the reference point air kerma to the location of the patient's skin, which is represented by a computational model. In order to orient the model with the x-ray source, geometric parameters found within the radiation dose structured report (RDSR) are used along with a limited number of in-clinic measurements. The output of the system is a visual indication of skin dose mapped onto an anthropomorphic model at a resolution of 5 mm. In order to determine if patient-dependent and patient-sculpted models increase accuracy, peak skin dose was calculated for each of 26 patient-specific models and compared with doses calculated using an elliptical stylized model, a reference hybrid model, a matched patient-dependent model and one patient-sculpted model. Results were analyzed in terms of a percent difference using the doses calculated using the patient-specific model as the true standard. Results: Anthropometric matching, including the use of both patient-dependent and patient-sculpted phantoms, was shown most beneficial for left lateral and anterior-posterior projections. In these cases, the percent difference using a reference model was between 8 and 20%, using a patient-dependent model between 7 and 15%, and using a patient-sculpted model between 3 and 7%. Under the table tube configurations produced errors less than 5% in most situations due to the flattening affects of the table and pad, and the fact that table height is the main determination of source-to-skin distance for these configurations. In addition to these results, several skin dose maps were produced and a prototype display system was placed on the in-clinic monitor of an interventional fluoroscopy system. Conclusions: The skin dose mapping program developed in this work represents a new tool that, as the RDSR becomes available through automated export or real-time streaming, can provide the interventional physician information needed to modify behavior when clinically appropriate. The program is nonproprietary and transferable, and also functions independent to the software systems already installed on the control room workstation. The next step will be clinical implementation where the workflow will be optimized along with further analysis of real-time capabilities.
Geant4 is the leading detector simulation toolkit used in high energy physics to design detectors and to optimize calibration and reconstruction software. It employs a set of carefully validated physics models to simulate interactions of particles with matter across a wide range of interaction energies. These models, especially the hadronic ones, rely largely on directly measured cross-sections and phenomenological predictions with physically motivated parameters estimated by theoretical calculation or measurement. Because these models are tuned to cover a very wide range of possible simulation tasks, they may not always be optimized for a given process or a given material. This raises several critical questions, e.g. how sensitive Geant4 predictions are to the variations of the model parameters, or what uncertainties are associated with a particular tune of a Geant4 physics model, or a group of models, or how to consistently derive guidance for Geant4 model development and improvement from a wide range of available experimental data. We have designed and implemented a comprehensive, modular, user-friendly software toolkit to study and address such questions. It allows one to easily modify parameters of one or several Geant4 physics models involved in the simulation, and to perform collective analysis of multiple variants of the resulting physics observables of interest and comparison against a variety of corresponding experimental data. Based on modern event-processing infrastructure software, the toolkit offers a variety of attractive features, e.g. flexible run-time configurable workflow, comprehensive bookkeeping, easy to expand collection of analytical components. Design, implementation technology, and key functionalities of the toolkit are presented and illustrated with results obtained with Geant4 key hadronic models.
A software for structural studies on a Huber-5042 diffractometer with a point detector and closed-cycle Displex DE-202 helium cryostat has been developed. The software package includes programs for the preliminary stage of experiment, planning, data collection, profile analysis of reflections, etc. The measurement of reflections in the 2θ angular range from 0° to 152° is provided, which is unique for Eulerian goniometers. Tools for enhancing data collection are demonstrated. Accurate experimental data are obtained for a test CaF{sub 2} crystal (sp. gr. Fm3̄m, Z = 4, resolution sinθ/λ{sub max} ≈ 1.354 Å{sup −1}, 121 reflections, 16 parameters in refinement, R/wR = 0.31/0.34%, Δρ{sub min}/Δρ{sub max} = −0.08/+0.07 e/Å{sup 3}).
A realistic simulation of the Neutrino Factory detectors is required in order to fully understand the sensitivity of such a facility to the remaining parameters and degeneracies of the neutrino mixing matrix. Here described is the status of a modular software framework being developed to accommodate such a study. The results of initial studies of the reconstruction software and expected efficiency curves in the context of the golden channel are given.
SF-25-046 Biomass resources are widely available in United States, however to utilize the resources we need to assess the bioenergy pathways per their economic and environmental performance. The framework combines several developments in the research field and integrates into a software easy to use and expand upon to study various bioenergy pathways.The software code is developed in Python language and works with an Excel based dashboard.
SciDAC-2 Project The Secret Life of Quarks: National Computational Infrastructure for Lattice Gauge Theory, from March 15, 2011 through March 14, 2012. The objective of this project is to construct the software needed to study quantum chromodynamics (QCD), the theory of the strong interactions of sub-atomic physics, and other strongly coupled gauge field theories anticipated to be of importance in the energy regime made accessible by the Large Hadron Collider (LHC). It builds upon the successful efforts of the SciDAC-1 project National Computational Infrastructure for Lattice Gauge Theory, in which a QCD Applications Programming Interface (QCD API) was developed that enables lattice gauge theorists to make effective use of a wide variety of massively parallel computers. This project serves the entire USQCD Collaboration, which consists of nearly all the high energy and nuclear physicists in the United States engaged in the numerical study of QCD and related strongly interacting quantum field theories.
Sensors are the key information source for fault detection and diagnostics (FDD) in buildings. However, sensors are often not properly designed, installed, calibrated, located, and maintained, which negatively impacts FDD performance. Several sensor-related FDD topics have been widely studied, covering a wide range of fault types and applications. However, it is difficult to get a clear picture of the technical development of sensor-related topics in FDD. A systematic review of sensor topics is needed to summarize the existing research in a logical way, draw conclusions on the current development, and predict the future development of sensors in building FDD. To address this gap, we conducted a comprehensive literature review of more than 100 FDD-sensor-related papers. In this article, we subdivide the FDD tasks into building-level, system-level, and component-level FDD, and review sensor-related topics in each category. Our major conclusions are: (a) current data-driven FDD research focuses more on FDD algorithms than sensors, (b) sensor “hardware” research topics are less studied than sensor “software” topics, (c) very few papers focus on sensor engineering as an integral aspect of FDD development, and (d) some important sensor topics, such as sensor cost-effectiveness and sensor schema/layout/location, are not well studied. Finally, we discuss the need for a systematic framework of FDD sensors and models to integrate sensor design/selection, sensor data analysis/mining, feature selection, physics-based or data-driven algorithm development, sensor fault detection, sensor calibration, and sensor maintenance. Finally, expert interviews are conducted to validate the above findings and conclusions.
Whisper is computational software designed to assist the nuclear criticality safety analyst with validation studies with the MCNP ® Monte Carlo radiation transport package. Standard approaches to validation rely on the selection of benchmarks based upon expert judgment. Whisper uses sensitivity/uncertainty (S/U) methods to select relevant benchmarks to a particular application or set of applications being analyzed. Using these benchmarks, Whisper computes a calculational margin. Whisper attempts to quantify the margin of subcriticality (MOS) from errors in software and uncertainties in nuclear data. The combination of the Whisper-derived calculational margin and MOS comprise the baseline upper subcritical limit (USL), to which an additional margin may be applied by the nuclear criticality safety analyst as appropriate to ensure subcriticality. A series of critical mass curves for plutonium, similar to those found in Figure 31 of LA-10860-MS, have been generated using MCNP6.1.1 and the iterative parameter study software, WORM_Solver. The baseline USL for each of the data points of the curves was then computed using Whisper 1.1. The USL was then used to determine the equivalent mass for plutonium metal-water system. ANSI/ANS-8.1 states that it is acceptable to use handbook data, such as the data directly from the LA-10860-MS, as it is already considered validated (Section 4.3 4) “Use of subcritical limit data provided in ANSI/ANS standards or accepted reference publications does not require further validation.”). This paper attempts to take a novel approach to visualize traditional critical mass curves and allows comparison with the amount of mass for which the k eff is equal to the USL (calculational margin + margin of subcriticality). However, the intent is to plot the critical mass data along with USL, not to suggest that already accepted handbook data should have new and more rigorous requirements for validation.
Explore the source record for details and available documents.
No abstract prepared.