Results for “verification” — Page 24

NASA NTRS2019

Verification Benchmarks and Validation of MAT261 for High Energy Dynamic Impact Applications

Advanced computational methods for composite structures can enable smarter testing and potentially certification by analysis. These methods, known as progressive damage and failure analysis (PDFA) methods, can predict lamina level mechanics including failure and subsequent propagation. When introduced into a commercial off the shelf finite element solver such as ABAQUS, LS-DYNA, or ANSYS, it enables end users to effectively exercise PDFA methods; however, it requires an understanding of the assumed mechanics and underlying coded response. In this paper, verification benchmarks developed under the NASA Advanced Composite Consortium for a class of PDFA methods known as continuum damage mechanics approaches are applied to the native LS-DYNA material model MAT261. As a result of the verification, an instability was discovered and subsequently corrected with an engineering solution. The results of the preliminary MAT261 simulations for high energy dynamic impact and the engineering solution are compared and a discussion about the significance is presented.

Molitor, Matthew↗

NASA NTRS2021

Constraining the Neutron Star Mass–Radius Relation and Dense Matter Equation of State with NICER. III. Model Description and Verification of Parameter Estimation Codes

We describe the X-ray pulse profile models we use and how we use them to analyze Neutron Star Interior Composition Explorer(NICER)observations of rotation-powered millisecond pulsars to obtain information about the mass–radius relation of neutron stars and the equation of state of the dense matter in their cores. Here we detail our modeling of the observed profile of PSR J0030+0451 that we analyzed in Miller et al. and Riley et al. and describe a cross-verification of computations of the pulse profiles of a star with R/M 3, in case stars this compact need to be considered in future analyses. We also present our early cross-verification efforts of the parameter estimation procedures used by Miller et al. and Riley et al. by analyzing two distinct synthetic data sets. Both codes yielded credible regions in the mass–radius plane that are statistically consistent with one another, and both gave posterior distributions for model parameter values consistent with the values that were used to generate the data. We also summarize the additional tests of the parameter estimation procedure of Miller et al. that used synthetic pulse profiles and the NICER pulse profile of PSR J0030+0451. We then illustrate how the precision of mass and radius estimates depends on the pulsar’s spin rate and the size of its hot spot by analyzing four different synthetic pulse profiles. Finally, we assess possible sources of systematic error in the estimates made using this technique, some of which may warrant further investigation.

Slavko Bogdanov↗

NASA NTRS2020

First-Order Runtime Verification using BDDs

Runtime Verification (RV) expedites the analyses of execution traces for detecting system errors and for statistical and quality analysis. Having started modestly, with checking temporal properties that are based on propositional (yes/no) values, the current practice of RV often involves properties that are parametrized by the data observed in the input trace. The specifications are based on various formalisms, such as automata, temporal logics, rule systems, and stream processing. Checking execution traces that are data intensive against a specification that imposes strong dependencies between the data, poses a nontrivial challenges; in particular if runtime verification has to be performed online, while many events that carry data appear within small time proximities. Towards achieving this goal, it was recently suggested to represent relations over the observed data values, based on BDDs, where data elements are enumerated and then converted into bit vectors. This representation provided a very simple and natural extension of an RV algorithm from propositional to first-order LTL, but more importantly, was shown to contribute to the memory compactness and to the speed, as was demonstrated using a corresponding implementation. We extend here the capabilities of BDD-based RV with the ability to express timing constraints, where the monitored events include (integer) clock values. We show how to efficiently operate on BDDs that represent both relations on (enumerations of) values and time dependencies, as required by the addition of the time constraints. We demonstrate our algorithm with an efficient implementation and provide experimental results.

Peled, Doron↗

NASA NTRSDate not supplied

Toward Verification of the γ-Reθt Transition Model in OVERFLOW and FUN3D

The results of an ongoing assessment of the transition modeling capability in NASA's OVERFLOW and FUN3D programs are presented, with a focus on the Langtry-Menter γ-Reθt transition model in combination with the shear-stress transport (SST) turbulence model. While the effect of numerics and boundary conditions on the accuracy and iterative convergence of RANS solutions for fully turbulent flows has been well documented, especially in the context of canonical flow configurations, the same cannot be said for transport-equation-based transition models coupled with RANS-based turbulence models. Given the criticality of transition modeling for new aircraft design and optimization, there has been a renewed focus on the accuracy of such transition models and their inconsistent implementation across different flow solvers as seen from the AIAA and NATO-AVT workshops. In this work, we aim to establish the verification of such models via these two well established CFD codes with different numerics. The goal is to produce high-quality data, such as grids, solutions, and other auxiliary data, that may be utilized for code verification by others in the CFD community. As a first step, the work reported here is focused on the Langtry-Menter transition model as applied to two simple 2D configurations, namely the flat plate, and the NLF-0416, respectively. The paper also highlights how the boundary conditions and baseline turbulence model can affect the solutions from the SST-based Langtry-Menter transition model. A preliminary evaluation of the automatic mesh adaption capabilities of these solvers and potential benefits for flow configurations involving a mix of laminar, transitional, and fully turbulent flows is also reported.

CFD Modeling↗

NASA NTRS2023

From Natural Language Requirements to the Verification of Programmable Logic Controllers: Integrating FRET into PLCverif

PLCverif is an actively developed project at CERN, enabling the formal verification of Programmable Logic Controller (PLC) programs in critical systems. In this paper, we present our work on improving the formal requirements specification experience in PLCverif through the use of natural language. To this end, we integrate NASA’s FRET, a formal requirement elicitation and authoring tool, into PLCverif. FRET is used to specify formal requirements in structured natural language, which automatically translates into temporal logic formulae. FRET’s output is then directly used by PLCverif for verification purposes. We discuss practical challenges that PLCverif users face when authoring requirements and the FRET features that help alleviate these problems. We present the new requirement formalization workflow and report our experience using it on two critical CERN case studies.

FRET↗

NASA NTRS2023

Autonomy Verification & Validation Roadmap and Vision 2045

Advanced capabilities planned for the next generation of autonomous and increasingly autonomous air vehicles will include non-traditional components based on artificial intelligence, machine learning, and complex optimization and planning algorithms. These complex components will be used to provide enhanced safety and high-level decision-making functions. However, there are serious barriers to the deployment of autonomous aircraft in the National Airspace System (NAS). Current civil aviation certification processes are based on the concept that the correct behavior of a system or a component must be completely specified and verified prior to operation. This report from the Autonomy Verification and Validation (V&V) Roadmap and Vision 2045 project presents the most recent effort to build a comprehensive list of verification challenges and needs for autonomous aircraft, a roadmap to meet those autonomy V&V needs, the services they can enable, and point to the certification gaps they fill. To accomplish these goals, we assembled a team of world-class researchers from the aerospace industry (Boeing, Collins Aerospace, and GeneralElectric) and academia (University of Michigan, University of Texas, and Massachusetts Institute of Technology) with deep expertise in autonomy, aerospace systems, and assurance of Artificial Intelligence/machine learning systems.

Software Assurance↗

NASA NTRSDate not supplied

From Natural Language Requirements to the Verification of Programmable Logic Controllers: Integrating FRET into PLCverif

PLCverif is an actively developed project at CERN, enabling the formal verification of Programmable Logic Controller (PLC) programs in critical systems. In this paper, we present our work on improving the formal requirements specification experience in PLCverif through the use of natural language. To this end, we integrate NASA’s FRET, a formal requirement elicitation and authoring tool, into PLCverif. FRET is used to specify formal requirements in structured natural language, which automatically translates into temporal logic formulae. FRET’s output is then directly used by PLCverif for verification purposes. We discuss practical challenges that PLCverif users face when authoring requirements and the FRET features that help alleviate these problems. We present the new requirement formalization workflow and report our experience using it on two critical CERN case studies.

FRET↗

NASA NTRS2022

Europa Clipper Payload Verification and Validation: Test and Analysis Program Design

NASA’s Europa Clipper mission – which is planned to launch in the mid-2020s – is designed to investigate the habitability of the jovian moon Europa with a state-of-the-art suite of over 10 sensors and instruments. Now past its project critical design review, Europa Clipper is starting the execution of its verification and validation (V&V) program. The payload V&V function in particular is responsible for designing and coordinating a thorough test and analysis program that will confirm the proper functioning and performance of our payload instruments. Given the large number of instruments to manage, we have developed a suite of standardized tests and analyses that are designed to cover all of the common interfaces across instruments, while allowing for flexibility to support the unique needs of individual instruments. This suite of activities, coordinated and/or performed by the payload team, forms the bulk of our payload verification and validation campaign. This paper provides a detailed summary of the full set of V&V activities in that suite, covering the four categories of activities: analysis of lower-level evidence, analysis via simulation, testing in the system testbeds, and testing in assembly, test, and launch operations (ATLO). We will describe the purpose of each activity type, how the activities are developed, and the review process for each type of activity. We then define the complete list of activities written for each instrument and how subtleties specific to certain instruments are managed. The discussion will provide a comprehensive understanding of the activities in the payload V&V purview and how various interfaces with different levels of the project are managed. This paper also describes key metrics the payload team uses to track V&V progress and some insights into the teaming design and division of labor we use to ensure consistency and completeness across the entire payload suite. Finally, the paper will offer a snapshot of the status of the Payload V&V program prior to instrument delivery and offer insights into the upcoming phase of instrument delivery and the start of ATLO.

Lee, Dennis↗

NASA NTRSDate not supplied

Verification Testing and Veg-05 Tomato Crop Production on the International Space Station

VEG-05 is an experiment to better define best practices for crop production and handling in space. Light can impact the growth habit, yield, nutritional composition, microbial levels, and flavor within crops and VEG-05 used the Veggie facilities on the International Space Station to grow ‘Red Robin’ dwarf tomatoes under different spectral compositions to assess these characteristics. Prior to launch, both a science verification test (SVT), and an experiment verification test (EVT) were conducted. SVT, and a previous fertilizer test, grew plants in both plant pillows and PONDS units and tested different fertilizer treatments, with each test under one of the light conditions. EVT used only plant pillows with the highest fertilizer composition tested, and two Veggie units were utilized. One Veggie had light settings consisting of equal levels of red: blue light while the second Veggie had a 90:10 ratio of red: blue light, both with the addition of ~10% green. For SVT, under the equal red: blue light treatment, fruit ripening in plant pillows was delayed. For EVT we saw fruit ripening earlier, especially in the red-rich treatment. In SVT we had mostly daily watering, and this led to excess water in plant pillows which leaked and caused fungus to grow. We reduced this excess in EVT, however, wilting events occurred. Regardless, more than 10 fruit were produced from each plant on average, with the high red treatment producing slightly heavier fruit. Microbial testing from fruit indicated that fruit were safe for consumption. VEG-05 flight operations ran December 2022 and March 2023, with considerable challenges in watering and unexpectedly low humidity on ISS during critical periods. Only 12 ripe fruit formed, and all were returned. Fruit and other samples are currently being analyzed. This research was co-funded by NASA’s Human Research Program and Space Biology.

Gioia Donna Massa↗

NASA NTRSDate not supplied

Verification Testing and VEG-05 Tomato Crop Production on the International Space Station

VEG-05 is an experiment to better define best practices for crop production and handling in space. Light can impact the growth habit, yield, nutritional composition, microbial levels, and flavor within crops and VEG-05 used the Veggie facilities on the International Space Station to grow ‘Red Robin’ dwarf tomatoes under different spectral compositions to assess these characteristics. Prior to launch, both a science verification test (SVT), and an experiment verification test (EVT) were conducted. SVT, and a previous fertilizer test, grew plants in both plant pillows and PONDS units and tested different fertilizer treatments, with each test under one of the light conditions. EVT used only plant pillows with the highest fertilizer composition tested, and two Veggie units were utilized. One Veggie had light settings consisting of equal levels of red: blue light while the second Veggie had a 90:10 ratio of red: blue light, both with the addition of ~10% green. For SVT, under the equal red: blue light treatment, fruit ripening in plant pillows was delayed. For EVT we saw fruit ripening earlier, especially in the red-rich treatment. In SVT we had mostly daily watering, and this led to excess water in plant pillows which leaked and caused fungus to grow. We reduced this excess in EVT, however, wilting events occurred. Regardless, more than 10 fruit were produced from each plant on average, with the high red treatment producing slightly heavier fruit. Microbial testing from fruit indicated that fruit were safe for consumption. VEG-05 flight operations ran December 2022 and March 2023, with considerable challenges in watering and unexpectedly low humidity on ISS during critical periods. Only 12 ripe fruit formed, and all were returned. Fruit and other samples are currently being analyzed. This research was co-funded by NASA’s Human Research Program and Space Biology.

Gioia D. Massa↗

NASA NTRSDate not supplied

A Formal Verification Framework for Runtime Assurance

The simplex architecture is an instance of Runtime Assurance (RTA) where a trusted component takes control of a safety-critical system when an untrusted component violates a safety property. This paper presents a formalization of the simplex RTA framework in the language of hybrid programs. A feature of this formal verification framework is that, for a given system, a specific instantiation can be created and its safety properties are guaranteed by construction. Instantiations may be kept at varying levels of generality, allowing for black box components, such as ML/AI-based controllers, to be modeled. The framework is written in the Prototype Verification System (PVS) using Plaidypvs, an embedding of differential dynamic logic in PVS. As a proof of concept, the framework is illustrated on an automatic vehicle braking system.

Runtime assurance↗

NASA NTRSDate not supplied

Thermoplastic Composite Lunar Tower Truss Structure: Design Development and Verification Plans

The National Aeronautics and Space Administration (NASA) Space Technology and Mission Directorate (STMD) is advancing thermoplastic composite (TPC) technologies for exploration missions. The Technology Development for Exploration Applications (TDEA) project goals are to develop and mature TPC materials, designs, analyses tools and techniques, and mature manufacturing processes. This includes development of manufacturing and joining approaches relevant to space environments. To these ends TDEA endeavors toward demonstrating a TPC truss structure for a lunar tower configuration. The design, predicated on robotic assembly, uses open section truss elements fused to a joint splice plate, without a structural adhesive. This presentation details the TDEA lunar truss structure design development approach including design heritage, the requirements established, the mechanical design and analyses, and thermal analyses demonstrating structural requirements conformance, as well as planned building block verification efforts either underway or planned. The mechanical analyses show the most severe environment is a moon-quake the truss dynamic responses. The thermal analyses show the extreme cold for on-orbit welding, the window for less severe on-orbit welding, as well as the large thermal gradients on the truss. The building block approach shown includes ultrasonic welding and lap shear coupon testing on various truss element thicknesses and layups. Knockdown factor determinations due to lunar dust contamination (simulated) and effects of welding in a vacuum are presented. The most highly loaded truss joint configuration sub-element verification test matrix is outlined. Lastly, plans to build, inspect, and test a 2-bay truss representative unit cell that is 1.5 meters by 1.5 meters by 3.0 meters tall are detailed.

Lunar Tower↗

NASA NTRSDate not supplied

A Formal Verification Framework for Runtime Assurance

The simplex architecture is an instance of Runtime Assurance (RTA) where a trusted component takes control of a safety-critical system when an untrusted component violates a safety property. This paper presents a formalization of the simplex RTA framework in the language of hybrid programs. A feature of this formal verification framework is that, for a given system, a specific instantiation can be created and its safety properties are guaranteed by construction. Instantiations may be kept at varying levels of generality, allowing for black box components, such as ML/AI-based controllers, to be modeled. The framework is written in the Prototype Verification System (PVS) using Plaidypvs, an embedding of differential dynamic logic in PVS. As a proof of concept, the framework is illustrated on an automatic vehicle braking system.

Runtime assurance↗

NASA NTRSDate not supplied

The Roman Space Telescope Optical System: Status, Test, and Verification Update

The Nancy Grace Roman Space Telescope (“Roman”) is NASA’s next flagship observatory. Launching in 2026, Roman will explore the nature of dark energy as well as expand the census of exoplanets in our galaxy via microlensing. Roman’s large field of view, agile survey capabilities, and excellent stability enable these scientific objectives, yet present unique challenges for the design, test, and verification of its optical system. Roman recently completed a comprehensive thermal vacuum test of the Spacecraft bus + Integrated Payload Assembly (SCIPA), followed by integrating the Outer Barrel Assembly (OBA), Solar Array Sunshield (SASS), and Deployable Aperture Cover (DAC) with SCIPA to complete the Observatory. This paper will present an overview of the thermal vacuum optical testing as well as a status of the optical system performance and verification.

Matthew Bolcar↗

DOE OSTI2024

Demonstration and Verification of Thermo-Mechanical Bowing in a Limited Free-Bow SFR Concept Using MOOSE

Core bowing due to thermal gradients and irradiation induced swelling and creep introduces significant reactivity feedback effects in liquid metal-cooled fast spectrum reactors. During startup, normal operations, and transient events, differential thermal and flux gradients cause expansion, creep, and swelling, which results in bowing in preferential directions depending on local material properties and load-pad and restraint-ring design. The bowing phenomenon produces negative reactivity during accident conditions provided the restraint system has been properly designed to optimally guide the deformation outwards in the active core region. Under the Department of Energy Nuclear Energy Advanced Modeling and Simulation program, a Multiphysics Object Oriented Simulation Environment (MOOSE)-based multiphysics approach to model core bowing is being developed. The present work expands on previous modeling of simpler International Atomic Energy Agency (IAEA) verification problems with these tools by modeling IAEA Verification Problem 4, which involves a symmetric sector of a reactor core with ducted assemblies undergoing differential thermal expansion due to thermal gradients bowing outward with duct-to-duct contact. This model is available on the National Reactor Innovation Center Virtual Test Bed repository. This example was verified against benchmark participant results, which includes bowing deformation evaluation and duct-to-duct interactions at load pads with mechanical contact.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗

NASA NTRSDate not supplied

Formal Verification of Termination Criteria for First-Order Recursive Functions

This paper presents a formalization of several termination criteria for first-order recursive functions. The formalization, which is developed in the Prototype Verification System (PVS), includes the specification and proof of equivalence of semantic termination, Turing termination, size change principle, calling context graphs, and matrix-weighted graphs. These termination criteria are defined on a computational model that consists of a basic functional language called PVS0, which is an embedding of recursive first-order functions. Through this embedding, the native mechanism for checking termination of recursive functions in PVS could be soundly extended with semi-automatic termination criteria such as calling contexts graphs. As a proof of concept, this paper illustrates how such an extension can be implemented using proof strategies based on computational reflection.

Formal Verification↗

DOE OSTI2025

Optimizing a detection system for fissile material in nuclear disarmament verification

In arms control treaties, verification plays a crucial role in detecting non-compliance, deterring future violations, and building trust between state parties. Neutron interrogation that induces fission reactions in fissile isotopes and measures the resulting fission neutrons, could be employed for this purpose. This study aims to develop a system which can determine the presence of fissile material while intrinsically protecting information. In this paper, we focus on optimizing the system for discriminating between an enriched uranium block from a depleted uranium (DU) block. The system was built and we report on benchmark measurements with DU and 16% enriched uranium blocks. Furthermore, the Excalibur (Experiment for Calibration with Uranium) neutron source, a neutron spectrometer (redBubble Technology Industries (BTI) N-Probe), and superheated droplet detectors were used for these measurements. MCNP simulations provided insights into detector responses to fissile materials with varying isotopic compositions, confirming that the system functioned as designed.

Active neutron interrogation↗

NASA NTRS1994

A Tool for Automatic Verification of Real-Time Expert Systems

The creation of an automated, user-driven tool for expert system development, validation, and verification is curretly onoging at NASA's Jet Propulsion Laboratory. In the new age of faster, better, cheaper missions, there is an increased willingness to utilize embedded expert systems for encapsulating and preserving mission expertise in systems which combine conventional algorithmic processing and artifical intelligence. The once-questioned role of automation in spacecraft monitoring is now becoming one of increasing importance.

real-time expert systems automated utilities knowl↗