Search NASA⌕ Search

SEARCH · Search NASA

Results for “system verification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Achieving Runtime State Verification Assurance in Critical Cyber-Physical Infrastructures

Industrial Cyber-Physical Systems (ICPS) are an essential backbone of national critical infrastructures. They help monitor and control crucial cyber-enabled services such as energy generation. Commonly ICPS monitors the physical process through Supervisory Control and Data Acquisition (SCADA) systems. The SCADA ecosystem takes critical real-time and future system operational decisions based on the runtime state behavior of field sensors. Traditional SCADA systems use legacy and insecure communication protocols such as the Modbus protocol that lack adequate security mechanisms to provide robust runtime state behavior assurance of constrained field sensors. Therefore, constrained field sensors are commonly vulnerable to standard semantic attacks that gradually change the behavior state of infected devices. This paper discusses process integrity assurance techniques necessary to enhance the security of behavior-based protocols such as the Modbus protocol. The Runtime State Verification (RSV) protocol proposed in this paper aims to address semantic attacks in the SCADA ecosystem by integrating behavior-based Mandatory Results Automata (MRA) and a Hyperledger Fabric (HLF) network. The RSV protocol provides high process integrity assurance through enhanced behavior-based MRA suitable for the constrained field devices. A proof of concept of the RSV protocol has been evaluated in an emulated water-tube boiler. Preliminary evaluations of the RSV protocol aimed to measure the efficiency of the proposed protocol by monitoring an Combustion Efficiency (CE) process necessary to preserve optimal combustion, thus minimizing costs and future maintenance of water-tube boilers. We analyze the overall network overhead and latency of the proposed RSV protocol by evaluating the HLF network performance and comparing the proposed RSV protocol with the state-ofart BloSPAI protocol. Through the preliminary evaluations of the proposed RSV protocol, this paper demonstrates that the proposed RSV protocol overcomes the shortcomings and network overhead of the BloSPAI protocol by integrating behavior-based authentication through novel MRAs and HLF networks.

Rivera, Abel Gomez↗
DOE OSTI2023

Development of ASTM International D8405—Standard Test Method for Evaluating PM 2.5 Sensors or Sensor Systems Used in Indoor Applications

Sensors and sensor systems for monitoring fine particles with aerodynamic diameters smaller than 2.5 µm can provide real-time feedback on indoor air quality and thus can help guide actions to manage indoor air pollutant concentrations. Standardized verification of the performance and accuracy of sensors and sensor systems is crucial for predicting the efficacy of such monitoring. A new ASTM International standard test method (ASTM D8405) was created for this need and is the most exacting laboratory protocol published to date for evaluating indoor air quality sensors and sensor systems measuring particles smaller than 2.5 µm in diameter. ASTM D8405 subjects sensors and sensor systems to five test phases: (1) an initial particle concentration ramp; (2) exposure to various temperature and humidity conditions; (3) exposure to interfering particles; (4) temperature cycling; and (5) a final particle concentration ramp to assess drift. This paper discusses the development of the standard test method, key aspects of the testing process, example evaluation results, and a comparison of this standard test method against peer evaluation protocols.

47 OTHER INSTRUMENTATION↗
DOE OSTI2020

Local Truncation Error-Informed Code Verification

The method of manufactured solutions (MMS) has become increasingly popular in conducting code verification studies on predictive codes, such as nuclear power system codes and computational fluid dynamic codes. The reason for the popularity of this approach is that it can be used when an analytical solution is not available. Using MMS, code developers are able to verify that their code is free of coding errors that impact the observed order of accuracy. While MMS is still an excellent tool for code verification, it does not identify coding errors that are of the same order as the numerical method. This paper presents a method that combines MMS with modified equation analysis (MEA), which calculates the local truncation error (LTE) to identify coding error up to and including the order of the numerical method. This method is referred to as modified equation analysis methd of manufactured solutions (MEAMMS). MEAMMS is then applied to a custom-built code, which solves the shallow water equations, to test the performance of the code verification method. MEAMMS is able to detect all coding errors that impact the implementation of the numerical scheme. To show how MEAMMS is different than MMS, they are both applied to the same first-order numerical method test problem with a first-order coding error. When there are first-order coding errors, only MEAMMS is able to identify them. Finally, this shows that MEAMMS is able to identify a larger set of coding errors while still being able to identify the coding errors MMS is able to identify.

42 ENGINEERING↗
DOE OSTI2025

Verification of the REBUS Software

Ongoing design activities at Argonne National Laboratory are requiring a thorough verification of the Argonne Reactor Computation codes be performed. REBUS is central to this system. The driver for this effort requires the Triangular-Z and hexagonal-Z core geometry options of REBUS to be verified. Previous work identified the REBUS features required to be verified to support current design activities, features of which are generally applicable to hexagonal-Z fast reactor designs. The scope of this verification effort includes verifying REBUS’s ability to correctly intepret the user input model, verifying that the features identified yield the intended results, and verifying the correctness of the REBUS output tables. The REBUS software verification relies heavily upon the accuracy of the embedded DIF3D software, the verification of which was completed and documented elsewhere. Given that DIF3D produces an accurate solution, the primary focus of the verification in the REBUS software is to ensure that it properly uses the DIF3D solution and that the depletion system (Bateman equations) are correctly implemented. This manuscript reiterates the verification tasks and displays results with respect to the features needed for current design activities. Analytic solutions of the Batemen equations are displayed and the results calculated with REBUS are displayed demonstrating the accuracy. Since coupled Bateman and neutron diffusion/transport solutions are extremely difficult to obtain, much of the focus is placed on how REBUS uses a given DIF3D solution assuming the accuracy of the DIF3D solution. The verification effort identified no issues that are debilitating or otherwise impactful to the design usage of REBUS, and thus REBUS version 11.0, release 3012 is considered verified. It is important to note that several outputs of REBUS are identified to be inaccurate, such as burnup in MWD/MT. Most of the relevant ones for VTR are generally accurate with 10-20% errors which is not impactful as all regular REBUS users are aware of this issue and know how to hand calculate the results. The REBUS manual further makes it clear that these values are consistent with the methodology being used by REBUS and thus the “errors” are more of an inconsistent definition with respect to what a user would expect given a definition in literature. Other issues that were identified included unclear documentation and software bugs all of which were inconsequential to the final results.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2023

HYBRID Modeling Validation and Verification Status Matrix

The HYBRID modeling repository is a premier resource for integrated energy systems modeling. HYBRID models have been developed since 2015 to describe the physical operation of tightly coupled thermal systems including power generators, thermal transport systems, thermal storage, thermal-to-electric conversion systems, and other thermal applications. Due to the increased size of the repository, a concise summary matrix of available models is desired. This matrix will consolidate not only the list of available models but also indicate original information sources, publications that have model examples, and level of validation and verification that exists for the models. Validation and verification (V&V) levels begin from simplified algebraic relationship and advance to dynamic data validation. Moving forward, as new models are contributed to HYBRID, their V&V level will be included, updating this matrix.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2021

Direct Uranium Isotopic Analysis of Swipe Surfaces by Microextraction-ICP-MS

The ability to directly measure uranium isotope ratios on environmental swipes has been achieved through a solution-based microextraction process and represents a significant advancement toward the development of a rapid method to analyze international nuclear safeguard samples. Here, a microextraction probe is lowered and sealed onto the swipe surface, and analytes within the sampling site (~8 mm2) are dissolved and extracted into a flowing solvent of 2% nitric acid (HNO 3 ). The mobilized species are subsequently directed into an inductively coupled plasma-mass spectrometer (ICP-MS) for accurate and precise isotope ratio determination. This work highlights the novelty of the sampling mechanism, particularly with the direct coupling of the microextraction probe to the ICP-MS and measurement of uranium isotope ratios. The preliminary method detection limit for the microextraction-ICP-MS method, utilizing a quadrupole-based MS, was determined to be ~50 pg of 238 U. Additionally, precise and accurate isotope ratio measurements were achieved on uranium reference materials for both the major ( 235 U/ 238 U) and minor ( 234 U/ 238 U and 236 U/ 238 U) ratios. While the present work is focused on directly measuring uranium isotopic systems on swipe surfaces for nuclear safeguards and verification applications, the benefits would extend across many applications in which direct solid sampling is sought for elemental and isotopic analysis.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

Revisiting Theoretical Limits for One-Degree-of-Freedom Wave Energy Converters

This work revisits the theoretical limits of one-degree-of-freedom wave energy converters. This paper considers the floating sphere used in the Ocean Energy Systems Task 10 Wave Energy Converter modeling and verification effort for analysis. Analytical equations are derived to determine bounds on the motion amplitude, time-averaged power, and power-take-off (PTO) force. A unique result was found that shows the time-averaged power absorbed by a wave energy converter can be defined solely by the inertial properties and radiation hydrodynamic coefficients. In addition, a unique expression for the PTO force amplitude was derived that has provided upper and lower bounds when resistive control is used to maximize power generation. For complex conjugate control, this same expression can only provide a lower bound, as there is theoretically no upper bound. These bounds are used to compare the performance of a floating sphere if it were to extract energy using surge or heave motion. The analysis shows that because of the differences in hydrodynamic coefficients of each oscillating mode, there will be different frequency ranges that provide better power capture efficiency. The influence of a motion constraint on power absorption while also utilizing a nonideal power take-off is examined and found to reduce the losses associated with bidirectional energy flow. The expression to calculate the time-averaged power with a nonideal PTO is modified by the mechanical-to-electrical efficiency and the ratio of the PTO spring and damping coefficients. The PTO spring and damping coefficients were separated in the expression, which allows for limits to be set on the possible values of PTO coefficients to ensure a net flow of power to the grid.

50 EE - Wind and Water Power Program - Water (EE-4↗
DOE OSTI2020

New Predictive Capabilities for Nuclear Weapons in Composite Fires

The prevalence of flammable carbon-based composite airframe materials and their use in high-temperature nuclear weapon re-entry systems requires analysts to address the abnormal thermal environment hazards associated with composite material fires. These fires tend to burn very differently than conventional fuel fires, usually burning less intensely, but much longer. This could lead to challenges in understanding margins in classic safety themes. The technical challenges in modeling the phenomena associated with these new types of fires are considerable, but new models have been developed. Their predictions have been compared with well-documented measurements of a vertical porous burner fire, known as a "wall fire" (a "wall-fire" validation simulation is reflected in the figures below). These measurements were conducted at FMGlobal, a mutual insurance company with a strong fire risk management program, as part of an ongoing collaboration between Sandia and FMGlobal. To date, the "wall-fire" scenario has been set up and initial model assessments with grid refinement studies have been conducted focusing on mesh resolutions suitable for full weapon system simulations. This work will continue with further verification and validation tasks assessing the predictions of the new model. Future work will address specific aspects of the wall models that are lacking in their predictive ability.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗
DOE OSTI2020

Autonomous Inspection of Geologic Repositories: Current State of the Art and Future Directions

Geological repositories for nuclear waste, including spent nuclear fuel, present a significant challenge for traditional International Atomic Energy Agency (IAEA) safeguards tools due to their inaccessibility and demanding operational conditions. The IAEA has been working closely with Member State organizations currently involved in repository construction and planning, including Euratom, the Finnish and Swedish regulatory authorities, and relevant facility operators. However, the verification challenge remains unsolved, and there persists an out- standing need for tools and approaches that will help the IAEA verify that no nuclear material is diverted from a repository environment. The challenge is also not static. Activities must encompass verification of the design, prior to and during the construction/operation phase, and post backfill. Throughout these various phases, it is imperative that the IAEA maintains a continuity of knowledge (CoK) of all material including information on material inventory and flow. This paper highlights these challenges and outlines how they might be addressed by using remote or autonomous vehicles. Specifically, we discuss the current state of the art in robotic autonomy for known or partially known environment mapping and patrolling, as well as shared autonomy, where humans collaborate with closed loop autonomation to complete tasks. We explore the feasibility of using rovers for these verification tasks, along with the challenges associated with system implementation. Hardware and software suggestions are provided based on the adoption of similar technologies in other comparable areas and ability to close technical gaps. Lastly, human-robotic interactions are considered based on the challenges of the environment of the repository and effective deployment and continued operation of the robot system.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2020

Autonomous Monitoring of Nuclear Repositories: Current State of the Art and Future Directions

Geological repositories for nuclear waste, including spent nuclear fuel, present a significant challenge for traditional International Atomic Energy Agency (IAEA) safeguards tools due to their inaccessibility and demanding operational conditions. The IAEA has been working closely with Member State organizations currently involved in repository construction and planning, including Euratom, the Finnish and Swedish regulatory authorities, and relevant facility operators. However, the verification challenge remains unsolved, and there persists an out- standing need for tools and approaches that will help the IAEA verify that no nuclear material is diverted from a repository environment. The challenge is also not static. Activities must encompass verification of the design, prior to and during the construction/operation phase, and post backfill. Throughout these various phases, it is imperative that the IAEA maintains a continuity of knowledge (CoK) of all material including information on material inventory and flow. This paper highlights these challenges and outlines how they might be addressed by using remote or autonomous vehicles. Specifically, we discuss the current state of the art in robotic autonomy for known or partially known environment mapping and patrolling, as well as shared autonomy, where humans collaborate with closed-loop autonomation to complete tasks. We explore the feasibility of using rovers for these verification tasks, along with the challenges associated with system implementation. Hardware and software suggestions are provided based on the adoption of similar technologies in other comparable areas and ability to close technical gaps. Lastly, human-robotic interactions are considered based on the challenges of the environment of the repository and effective deployment and continued operation of the robot system.

geologic repository, safeguards, IAEA, Robotics↗
DOE OSTI2025

Verification of the PERSENT Software

Ongoing commercial design activities require a thorough verification of the Argonne Reactor Computation codes be performed. DIF3D is central to this system and substantial work has been done to verify its accuracy on several identified commercial needs. This manuscript details the verification work done on PERSENT which relies upon the DIF3D code for its forward and adjoint flux solution. Previous work identified the PERSENT features required to be verified to support commercial design activities, features of which are generally applicable to hexagonal-Z fast reactor designs. The scope of this verification effort includes verifying PERSENT’s ability to correctly calculate four key quantities: perturbation worth distributions, kinetics parameters, sensitivity coefficients, and cross section uncertainty quantification. This manuscript provides the verification tasks and their results with respect to these quantities needed for commercial design activities. For the perturbation worth distributions, hand calculations are deployed to verify the PERSENT calculated results. Similarly, hand calculation of the PERSENT computed kinetics parameters is also used to verify the PERSENT results. In both of these, the input to PERSENT is manipulated to ensure the hand calculation exactly matches the equations PERSENT is calculating. The sensitivity coefficients involve calculating the derivatives of a parameter (such as reactivity worth), with respect to the cross section data. Direct finite difference calculations with DIF3D are used to verify the PERSENT calculated results. For the uncertainty quantification, manufactured input to PERSENT is used to allow an exact hand calculation to reproduce the PERSENT calculated results. The work detailed in this report verified that significant issues were identified for earlier versions of PERSENT for sensitivity coefficients which were corrected in this work and thus version 12.1.0 of PERSENT must be used to reproduce all of the verified work in this report.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2022

Phase II testing of Xenon International on Mount Schauinsland, Germany

Station RN33 on Mount Schauinsland near Freiburg, Germany, is part of the International Monitoring System monitoring radioxenon in air ( 131m Xe, 133 Xe, 133m Xe, and 135 Xe) for verification of the Comprehensive Nuclear Test Ban Treaty. Here, we present data from phase II testing of a new system, Xenon International at RN33, July 14th, 2021 to Jan 22nd, 2022, together with SPALAX data from the same time period. Radioxenon could be detected in 473 of 719 samples, among them many multiple isotope detections. Activity concentrations of spiked and selected environmental samples were verified by laboratory reanalysis. Finally, the sensitivity of Xenon International for radioxenons is up to one order of magnitude better for the metastable isotopes than that of the SPALAX, with a shorter sampling duration of 6 h.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗
DOE OSTI2025

Machine learning-assisted identification of potential sources of bias in measurements of prompt-fission neutron spectra

Unrecognized sources of uncertainty (USU) can bias the reported mean and/or covariance of experimental nuclear data. These biases, in turn, can propagate through evaluated nuclear data to application simulations or may poorly inform nuclear theory that is fitted to the experimental data. Such unknown sources of bias must be tied to the inherent physical constituents of the measurements such as the characteristics of a detector response or a background reduction technique. Here, in this article, a sparse Bayesian learning model is used to support experts in their efforts to identify and characterize USU in experimental prompt fission neutron spectra (PFNS) for spontaneous fissioning of 252 Cf by linking observed biases to features of the measurement system. Three different bias components were found. The first acts as a verification case for the algorithm as it identifies a bias coming from a well-known source related to the use of 6 Li in the neutron detection system. The second two cases demonstrate how this method can benefit the evaluation of experimental nuclear data by identifying, quantifying, and relating unknown biases to potential causes.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2025

An Advanced Microscopic Energy Consumption Model for Automated Vehicle:Development, Calibration, Verification

The automated vehicle (AV) equipped with the Adaptive Cruise Control (ACC) system is expected to reduce the fuel consumption for the intelligent transportation system. This paper presents the Advanced ACC-Micro (AA-Micro) model, a new energy consumption model based on micro trajectory data, calibrated and verified by empirical data. Utilizing a commercial AV equipped with the ACC system as the test platform, experiments were conducted at the Columbus 151 Speedway, capturing data from multiple ACC and Human-Driven (HV) test runs. The calibrated AA-Micro model integrates features from traditional energy consumption models and demonstrates superior goodness of fit, achieving an impressive 90% accuracy in predicting ACC system energy consumption without overfitting. A comprehensive statistical evaluation of the AA-Micro model's applicability and adaptability in predicting energy consumption and vehicle trajectories indicated strong model consistency and reliability for ACC vehicles, evidenced by minimal variance in RMSE values and uniform RSS distributions. Conversely, significant discrepancies were observed when applying the model to HV data, underscoring the necessity for specialized models to accurately predict energy consumption for HV and ACC systems, potentially due to their distinct energy consumption characteristics.

Ma, Ke↗
DOE OSTI2020

Multiphysics Coupling of PROTEUS-NODAL and SAM for Molten Salt Reactor Simulation

The purpose of this report is to document the new features and capabilities that have been implemented in the PROTEUS-NODAL code and the coupling procedure of PROTEUS-NODAL with SAM to analyze MSRs. This report is organized as follows. Section 2 presents the variational nodal P 1 solver for cylindrical geometries and its verification test results. Section 3 discusses the transient analysis capability implemented in the P 1 solvers of PROTEUS-NODAL. The solution methods for the coupled system of TFSP and precursor drift equations, the coarse mesh finite difference (CMFD) acceleration, the kinetics parameter evaluation method, and the thermal feedback are discussed. The verification test results against the SP 3 solutions are also discussed. Section 4 describes the coupling scheme of PROTEUS-NODAL and SAM under the MOOSE framework for MSR applications. The developed MOOSE applications named “TreeFrog” and “TreeKangaroo” are discussed. Verification test results for the coupled system are also discussed by comparing the MSFR steady state solution with that obtained from a manually coupled PROTEUS-NODAL and ANSYS CFX computational fluid dynamics (CFD) calculations and the MSFR transient analysis results with the open literature solutions and the PROTEUS-NODAL solutions obtained with the standalone thermal-hydraulics solver. Section 5 provides conclusions and future works.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2025

Low-Cost Sulfur Thermal Storage for Solar Industrial Process Heat Applications

Industrial process heat (IPH) is one of the largest energy demands in U.S., representing about 10% of all domestic energy consumption. Fuel costs to generate this industrial process heat are generally a top three cost for industry, a major component in American manufacturing competitiveness. Roughly 60% of US IPH demand (about 6,500 TBtu annually) falls in the medium-temperature range of 100–250 °C. While concentrated solar thermal (CST) technologies can provide a cost-effective source of heat in this temperature range, solar intermittency limits their adoption in industries that operate 24/7. Element 16 Technologies, Inc. developed a low-cost sulfur thermal energy storage (TES) technology to bridge this gap by capturing excess solar heat during the day and dispatching it reliably during non-solar hours. The core innovation is the use of sulfur, an abundant, industrial waste byproduct that costs ten times less than molten salt used in commercial TES systems. The overall goal of the project was to advance the design and development of molten sulfur TES to a manufacturing-relevant prototype stage for solar industrial process heat applications, while establishing and validating a realistic pathway to commercial success. Key tasks included corrosion and mechanical durability testing to identify cost-effective materials, design investigations using physics-based simulation tools, techno-economic evaluations of system lifetime costs, and pilot-scale testing for performance verification. Corrosion testing of steel alloys under cyclic molten sulfur conditions showed that austenitic stainless steels in the 300 series performed particularly well, with no structural degradation of welds or joints. Thermal cyclic testing of pilot sulfur TES units up to 1.5 MWh quantified charge/discharge rates, heat losses, round-trip efficiency and validated the system's capability to operate effectively under intermittent charging conditions. A techno-economic model, informed by sulfur TES performance model validated using pilot test data, showed that hybrid solar+sulfur TES+NG boiler systems are economically competitive with incumbent natural gas boilers for multiple locations in the southwest US. In summary, this project established molten sulfur TES as a technically viable pathway to improve economic competitiveness of American manufacturing by lowering the cost of solar industrial process heat.

14 SOLAR ENERGY↗
DOE OSTI2025

Kinetic Plasma Simulation Capabilities in the MOOSE Framework: Verification of Particle-Particle Collisions

High-fidelity simulations of complex plasma systems allow researchers to gain key insights into and understanding of these systems. To facilitate massively parallel high-fidelity plasma simulations, finite-element-based particle-in-cell capabilities are being developed within the open-source Multiphysics Object-Oriented Simulation Environment (MOOSE) based framework called Software for Advanced Large-scale Analysis of MAgnetic confinement for Numerical Design, Engineering & Research (SALAMANDER). While SALAMANDER’s primary objective is modeling edge plasmas and plasma-facing components in fusion devices, the particle-in-cell capabilities being developed are general and will support modeling low-temperature plasmas as well. Previously, collisionless magnetostatic simulation capabilities have been verified with the two-stream and Dorey-Guest-Harris instabilities, and single particle motion. Collisions were implemented using the direct simulation Monte Carlo method, and verification of this capability will be presented here several verification problems: relaxation of a randomly initialized gas to a Maxwellian distribution, Fourier heat flow, and comparison of reaction rates to both analytic calculations and those calculated using a multi-term Boltzmann solver.

70 - PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2024

Harness the Power of AI and CI/CD to Fuel Scientific Discovery

The "Harness the Power of AI and CI/CD to Fuel Scientific Discovery" project aims to enhance and automate critical scientific computing systems used in large-scale experiments like CMS at LHC and DUNE at Fermilab. By leveraging GlideinWMS and HEPCloud, this initiative focuses on developing containerized CI/CD pipelines, integrating AI for code quality improvement, and automating security verifications. Participants will gain hands-on experience with distributed computing systems and implement secure communications, contributing to real-world scientific progress and the open-source community.

Nurcellari, Tea↗