Search NASA⌕ Search

SEARCH · Search NASA

Results for “Verification.”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 991 records · Page 55

Constraining the Neutron Star Mass–Radius Relation and Dense Matter Equation of State with NICER. III. Model Description and Verification of Parameter Estimation Codes

We describe the X-ray pulse profile models we use and how we use them to analyze Neutron Star Interior Composition Explorer(NICER)observations of rotation-powered millisecond pulsars to obtain information about the mass–radius relation of neutron stars and the equation of state of the dense matter in their cores. Here we detail our modeling of the observed profile of PSR J0030+0451 that we analyzed in Miller et al. and Riley et al. and describe a cross-verification of computations of the pulse profiles of a star with R/M 3, in case stars this compact need to be considered in future analyses. We also present our early cross-verification efforts of the parameter estimation procedures used by Miller et al. and Riley et al. by analyzing two distinct synthetic data sets. Both codes yielded credible regions in the mass–radius plane that are statistically consistent with one another, and both gave posterior distributions for model parameter values consistent with the values that were used to generate the data. We also summarize the additional tests of the parameter estimation procedure of Miller et al. that used synthetic pulse profiles and the NICER pulse profile of PSR J0030+0451. We then illustrate how the precision of mass and radius estimates depends on the pulsar’s spin rate and the size of its hot spot by analyzing four different synthetic pulse profiles. Finally, we assess possible sources of systematic error in the estimates made using this technique, some of which may warrant further investigation.

Slavko Bogdanov↗

First-Order Runtime Verification using BDDs

Runtime Verification (RV) expedites the analyses of execution traces for detecting system errors and for statistical and quality analysis. Having started modestly, with checking temporal properties that are based on propositional (yes/no) values, the current practice of RV often involves properties that are parametrized by the data observed in the input trace. The specifications are based on various formalisms, such as automata, temporal logics, rule systems, and stream processing. Checking execution traces that are data intensive against a specification that imposes strong dependencies between the data, poses a nontrivial challenges; in particular if runtime verification has to be performed online, while many events that carry data appear within small time proximities. Towards achieving this goal, it was recently suggested to represent relations over the observed data values, based on BDDs, where data elements are enumerated and then converted into bit vectors. This representation provided a very simple and natural extension of an RV algorithm from propositional to first-order LTL, but more importantly, was shown to contribute to the memory compactness and to the speed, as was demonstrated using a corresponding implementation. We extend here the capabilities of BDD-based RV with the ability to express timing constraints, where the monitored events include (integer) clock values. We show how to efficiently operate on BDDs that represent both relations on (enumerations of) values and time dependencies, as required by the addition of the time constraints. We demonstrate our algorithm with an efficient implementation and provide experimental results.

Peled, Doron↗

Toward Verification of the γ-Reθt Transition Model in OVERFLOW and FUN3D

The results of an ongoing assessment of the transition modeling capability in NASA's OVERFLOW and FUN3D programs are presented, with a focus on the Langtry-Menter γ-Reθt transition model in combination with the shear-stress transport (SST) turbulence model. While the effect of numerics and boundary conditions on the accuracy and iterative convergence of RANS solutions for fully turbulent flows has been well documented, especially in the context of canonical flow configurations, the same cannot be said for transport-equation-based transition models coupled with RANS-based turbulence models. Given the criticality of transition modeling for new aircraft design and optimization, there has been a renewed focus on the accuracy of such transition models and their inconsistent implementation across different flow solvers as seen from the AIAA and NATO-AVT workshops. In this work, we aim to establish the verification of such models via these two well established CFD codes with different numerics. The goal is to produce high-quality data, such as grids, solutions, and other auxiliary data, that may be utilized for code verification by others in the CFD community. As a first step, the work reported here is focused on the Langtry-Menter transition model as applied to two simple 2D configurations, namely the flat plate, and the NLF-0416, respectively. The paper also highlights how the boundary conditions and baseline turbulence model can affect the solutions from the SST-based Langtry-Menter transition model. A preliminary evaluation of the automatic mesh adaption capabilities of these solvers and potential benefits for flow configurations involving a mix of laminar, transitional, and fully turbulent flows is also reported.

CFD Modeling↗

From Natural Language Requirements to the Verification of Programmable Logic Controllers: Integrating FRET into PLCverif

PLCverif is an actively developed project at CERN, enabling the formal verification of Programmable Logic Controller (PLC) programs in critical systems. In this paper, we present our work on improving the formal requirements specification experience in PLCverif through the use of natural language. To this end, we integrate NASA’s FRET, a formal requirement elicitation and authoring tool, into PLCverif. FRET is used to specify formal requirements in structured natural language, which automatically translates into temporal logic formulae. FRET’s output is then directly used by PLCverif for verification purposes. We discuss practical challenges that PLCverif users face when authoring requirements and the FRET features that help alleviate these problems. We present the new requirement formalization workflow and report our experience using it on two critical CERN case studies.

FRET↗

Autonomy Verification & Validation Roadmap and Vision 2045

Advanced capabilities planned for the next generation of autonomous and increasingly autonomous air vehicles will include non-traditional components based on artificial intelligence, machine learning, and complex optimization and planning algorithms. These complex components will be used to provide enhanced safety and high-level decision-making functions. However, there are serious barriers to the deployment of autonomous aircraft in the National Airspace System (NAS). Current civil aviation certification processes are based on the concept that the correct behavior of a system or a component must be completely specified and verified prior to operation. This report from the Autonomy Verification and Validation (V&V) Roadmap and Vision 2045 project presents the most recent effort to build a comprehensive list of verification challenges and needs for autonomous aircraft, a roadmap to meet those autonomy V&V needs, the services they can enable, and point to the certification gaps they fill. To accomplish these goals, we assembled a team of world-class researchers from the aerospace industry (Boeing, Collins Aerospace, and GeneralElectric) and academia (University of Michigan, University of Texas, and Massachusetts Institute of Technology) with deep expertise in autonomy, aerospace systems, and assurance of Artificial Intelligence/machine learning systems.

Software Assurance↗

From Natural Language Requirements to the Verification of Programmable Logic Controllers: Integrating FRET into PLCverif

PLCverif is an actively developed project at CERN, enabling the formal verification of Programmable Logic Controller (PLC) programs in critical systems. In this paper, we present our work on improving the formal requirements specification experience in PLCverif through the use of natural language. To this end, we integrate NASA’s FRET, a formal requirement elicitation and authoring tool, into PLCverif. FRET is used to specify formal requirements in structured natural language, which automatically translates into temporal logic formulae. FRET’s output is then directly used by PLCverif for verification purposes. We discuss practical challenges that PLCverif users face when authoring requirements and the FRET features that help alleviate these problems. We present the new requirement formalization workflow and report our experience using it on two critical CERN case studies.

FRET↗

Europa Clipper Payload Verification and Validation: Test and Analysis Program Design

NASA’s Europa Clipper mission – which is planned to launch in the mid-2020s – is designed to investigate the habitability of the jovian moon Europa with a state-of-the-art suite of over 10 sensors and instruments. Now past its project critical design review, Europa Clipper is starting the execution of its verification and validation (V&V) program. The payload V&V function in particular is responsible for designing and coordinating a thorough test and analysis program that will confirm the proper functioning and performance of our payload instruments. Given the large number of instruments to manage, we have developed a suite of standardized tests and analyses that are designed to cover all of the common interfaces across instruments, while allowing for flexibility to support the unique needs of individual instruments. This suite of activities, coordinated and/or performed by the payload team, forms the bulk of our payload verification and validation campaign. This paper provides a detailed summary of the full set of V&V activities in that suite, covering the four categories of activities: analysis of lower-level evidence, analysis via simulation, testing in the system testbeds, and testing in assembly, test, and launch operations (ATLO). We will describe the purpose of each activity type, how the activities are developed, and the review process for each type of activity. We then define the complete list of activities written for each instrument and how subtleties specific to certain instruments are managed. The discussion will provide a comprehensive understanding of the activities in the payload V&V purview and how various interfaces with different levels of the project are managed. This paper also describes key metrics the payload team uses to track V&V progress and some insights into the teaming design and division of labor we use to ensure consistency and completeness across the entire payload suite. Finally, the paper will offer a snapshot of the status of the Payload V&V program prior to instrument delivery and offer insights into the upcoming phase of instrument delivery and the start of ATLO.

Lee, Dennis↗

Verification Testing and Veg-05 Tomato Crop Production on the International Space Station

VEG-05 is an experiment to better define best practices for crop production and handling in space. Light can impact the growth habit, yield, nutritional composition, microbial levels, and flavor within crops and VEG-05 used the Veggie facilities on the International Space Station to grow ‘Red Robin’ dwarf tomatoes under different spectral compositions to assess these characteristics. Prior to launch, both a science verification test (SVT), and an experiment verification test (EVT) were conducted. SVT, and a previous fertilizer test, grew plants in both plant pillows and PONDS units and tested different fertilizer treatments, with each test under one of the light conditions. EVT used only plant pillows with the highest fertilizer composition tested, and two Veggie units were utilized. One Veggie had light settings consisting of equal levels of red: blue light while the second Veggie had a 90:10 ratio of red: blue light, both with the addition of ~10% green. For SVT, under the equal red: blue light treatment, fruit ripening in plant pillows was delayed. For EVT we saw fruit ripening earlier, especially in the red-rich treatment. In SVT we had mostly daily watering, and this led to excess water in plant pillows which leaked and caused fungus to grow. We reduced this excess in EVT, however, wilting events occurred. Regardless, more than 10 fruit were produced from each plant on average, with the high red treatment producing slightly heavier fruit. Microbial testing from fruit indicated that fruit were safe for consumption. VEG-05 flight operations ran December 2022 and March 2023, with considerable challenges in watering and unexpectedly low humidity on ISS during critical periods. Only 12 ripe fruit formed, and all were returned. Fruit and other samples are currently being analyzed. This research was co-funded by NASA’s Human Research Program and Space Biology.

Gioia Donna Massa↗

Verification Testing and VEG-05 Tomato Crop Production on the International Space Station

VEG-05 is an experiment to better define best practices for crop production and handling in space. Light can impact the growth habit, yield, nutritional composition, microbial levels, and flavor within crops and VEG-05 used the Veggie facilities on the International Space Station to grow ‘Red Robin’ dwarf tomatoes under different spectral compositions to assess these characteristics. Prior to launch, both a science verification test (SVT), and an experiment verification test (EVT) were conducted. SVT, and a previous fertilizer test, grew plants in both plant pillows and PONDS units and tested different fertilizer treatments, with each test under one of the light conditions. EVT used only plant pillows with the highest fertilizer composition tested, and two Veggie units were utilized. One Veggie had light settings consisting of equal levels of red: blue light while the second Veggie had a 90:10 ratio of red: blue light, both with the addition of ~10% green. For SVT, under the equal red: blue light treatment, fruit ripening in plant pillows was delayed. For EVT we saw fruit ripening earlier, especially in the red-rich treatment. In SVT we had mostly daily watering, and this led to excess water in plant pillows which leaked and caused fungus to grow. We reduced this excess in EVT, however, wilting events occurred. Regardless, more than 10 fruit were produced from each plant on average, with the high red treatment producing slightly heavier fruit. Microbial testing from fruit indicated that fruit were safe for consumption. VEG-05 flight operations ran December 2022 and March 2023, with considerable challenges in watering and unexpectedly low humidity on ISS during critical periods. Only 12 ripe fruit formed, and all were returned. Fruit and other samples are currently being analyzed. This research was co-funded by NASA’s Human Research Program and Space Biology.

Gioia D. Massa↗

A Formal Verification Framework for Runtime Assurance

The simplex architecture is an instance of Runtime Assurance (RTA) where a trusted component takes control of a safety-critical system when an untrusted component violates a safety property. This paper presents a formalization of the simplex RTA framework in the language of hybrid programs. A feature of this formal verification framework is that, for a given system, a specific instantiation can be created and its safety properties are guaranteed by construction. Instantiations may be kept at varying levels of generality, allowing for black box components, such as ML/AI-based controllers, to be modeled. The framework is written in the Prototype Verification System (PVS) using Plaidypvs, an embedding of differential dynamic logic in PVS. As a proof of concept, the framework is illustrated on an automatic vehicle braking system.

Runtime assurance↗

Thermoplastic Composite Lunar Tower Truss Structure: Design Development and Verification Plans

The National Aeronautics and Space Administration (NASA) Space Technology and Mission Directorate (STMD) is advancing thermoplastic composite (TPC) technologies for exploration missions. The Technology Development for Exploration Applications (TDEA) project goals are to develop and mature TPC materials, designs, analyses tools and techniques, and mature manufacturing processes. This includes development of manufacturing and joining approaches relevant to space environments. To these ends TDEA endeavors toward demonstrating a TPC truss structure for a lunar tower configuration. The design, predicated on robotic assembly, uses open section truss elements fused to a joint splice plate, without a structural adhesive. This presentation details the TDEA lunar truss structure design development approach including design heritage, the requirements established, the mechanical design and analyses, and thermal analyses demonstrating structural requirements conformance, as well as planned building block verification efforts either underway or planned. The mechanical analyses show the most severe environment is a moon-quake the truss dynamic responses. The thermal analyses show the extreme cold for on-orbit welding, the window for less severe on-orbit welding, as well as the large thermal gradients on the truss. The building block approach shown includes ultrasonic welding and lap shear coupon testing on various truss element thicknesses and layups. Knockdown factor determinations due to lunar dust contamination (simulated) and effects of welding in a vacuum are presented. The most highly loaded truss joint configuration sub-element verification test matrix is outlined. Lastly, plans to build, inspect, and test a 2-bay truss representative unit cell that is 1.5 meters by 1.5 meters by 3.0 meters tall are detailed.

Lunar Tower↗

A Formal Verification Framework for Runtime Assurance

The simplex architecture is an instance of Runtime Assurance (RTA) where a trusted component takes control of a safety-critical system when an untrusted component violates a safety property. This paper presents a formalization of the simplex RTA framework in the language of hybrid programs. A feature of this formal verification framework is that, for a given system, a specific instantiation can be created and its safety properties are guaranteed by construction. Instantiations may be kept at varying levels of generality, allowing for black box components, such as ML/AI-based controllers, to be modeled. The framework is written in the Prototype Verification System (PVS) using Plaidypvs, an embedding of differential dynamic logic in PVS. As a proof of concept, the framework is illustrated on an automatic vehicle braking system.

Runtime assurance↗

The Roman Space Telescope Optical System: Status, Test, and Verification Update

The Nancy Grace Roman Space Telescope (“Roman”) is NASA’s next flagship observatory. Launching in 2026, Roman will explore the nature of dark energy as well as expand the census of exoplanets in our galaxy via microlensing. Roman’s large field of view, agile survey capabilities, and excellent stability enable these scientific objectives, yet present unique challenges for the design, test, and verification of its optical system. Roman recently completed a comprehensive thermal vacuum test of the Spacecraft bus + Integrated Payload Assembly (SCIPA), followed by integrating the Outer Barrel Assembly (OBA), Solar Array Sunshield (SASS), and Deployable Aperture Cover (DAC) with SCIPA to complete the Observatory. This paper will present an overview of the thermal vacuum optical testing as well as a status of the optical system performance and verification.

Matthew Bolcar↗

A Spectral Verification of the HELIOS-2 Lattice Physics Code

Core modeling of the Advanced Test Reactor (ATR) at INL is currently undergoing a significant update through the Core Modeling Update Project1. The intent of the project is to bring ATR core modeling in line with today’s standard of computational efficiency and verification and validation practices. The HELIOS-2 lattice physics code2 is the lead code of several reactor physics codes to be dedicated to modernize ATR core analysis. This presentation is concerned with an independent verification of the HELIOS-2 spectral representation including the slowing down and thermalization algorithm and its data dependency. Here, we will describe and demonstrate a recently developed simple cross section generation algorithm based entirely on analytical multigroup parameters for both the slowing down and thermal spectrum. The new capability features fine group detail to assess the flux and multiplication factor dependencies on cross section data sets using the fundamental infinite medium as an example.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Safeguards Verification Measurements using Laser Ablation, Absorbance Ratio Spectrometry in Gaseous Centrifuge Enrichment Plants

Laser Ablation Absorbance Ratio Spectrometry (LAARS) is a new verification measurement technology under development at the US Department of Energy’s (DOE) Pacific Northwest National Laboratory (PNNL). LAARS uses three lasers to ablate and then measure the relative isotopic abundance of uranium compounds. An ablation laser is tightly focused on uranium-bearing solids producing a small plume containing uranium atoms. Two collinear wavelength-tuned spectrometry lasers transit through the plume and the absorbance of U-235 and U-238 isotopes are measured to determine U-235 enrichment. The measurement has high relative precision and detection limits approaching the femtogram range for uranium. It is independent of chemical form and degree of dilution with nuisance dust and other materials. High speed sample scanning and pinpoint characterization allow measurements on millions of particles/hour to detect and analyze the enrichment of trace uranium in samples. The spectrometer is assembled using commercially available components at comparatively low cost, and features a compact and low power design. Future designs can be engineered for reliable, autonomous deployment within an industrial plant environment. Two specific applications of the spectrometer are under development: 1) automated unattended aerosol sampling and analysis and 2) on-site small sample destructive assay measurement. The two applications propose game-changing technological advances in gaseous centrifuge enrichment plant (GCEP) safeguards verification. The aerosol measurement instrument, LAARS-environmental sampling (ES), collects aerosol particles from the plant environment in a purpose-built rotating drum impactor and then uses LAARS-ES to quickly scan the surface of the impactor to measure the enrichments of the captured particles. The current approach to plant misuse detection involves swipe sampling and offsite analysis. Though this approach is very robust it generally requires several months to obtain results from a given sample collection. The destructive assay instrument, LAARS-destructive assay (DA), uses a simple purpose-built fixture with a sampling planchet to collect adsorbed UF6 gas from a cylinder valve or from a process line tap or pigtail. A portable LAARS-DA instrument scans the microgram quantity of uranium collected on the planchet and the assay of the uranium is measured to ~0.15% relative precision. Currently, destructive assay samples for bias defect measurements are collected in small sample cylinders for offsite mass spectrometry measurement.

Enrichment Monitoring↗

NGSI: IAEA Verification of UF6 Cylinders

The International Atomic Energy Agency (IAEA) is often ignorant of the location of declared, uranium hexafluoride (UF6) cylinders following verification, because cylinders are not typically tracked onsite or off. This paper will assess various methods the IAEA uses to verify cylinder gross defects, and how the task could be ameliorated through the use of improved identification and monitoring. The assessment will be restricted to current verification methods together with one that has been applied on a trial basis—short-notice random inspections coupled with mailbox declarations. This paper is part of the NNSA Office of Nonproliferation and International Security’s Next Generation Safeguards Initiative (NGSI) program to investigate the concept of a global monitoring scheme that uniquely identifies and tracks UF6 cylinders.

cylinder monitoring tracking IAEA↗

Safeguards Verification Measurements using Laser Ablation, Absorbance Ratio Spectrometry in Gaseous Centrifuge Enrichment Plants

Laser Ablation Absorbance Ratio Spectrometry (LAARS) is a new verification measurement technology under development at the US Department of Energy (DOE) Pacific Northwest National Laboratory (PNNL). LAARS uses three lasers to ablate and then measure the relative isotopic abundance of uranium compounds. An ablation laser is tightly focused on uranium-bearing solids, producing a small atomic uranium vapor plume. Two collinear wavelength-tuned spectrometry lasers transit through the plume and the absorbance of U-235 and U-238 isotopes are measured to determine U-235 enrichment. The measurement is independent of chemical form and degree of dilution with nuisance dust and other materials. LAARS has high relative precision and detection limits approaching the femtogram range for U-235. The sample is scanned and assayed point-by-point at rates reaching 1 million measurements/hour, enabling LAARS to detect and analyze uranium in trace samples. The spectrometer is assembled using primarily commercially available components and features a compact design and automated analysis.Two specific gaseous centrifuge enrichment plant (GCEP) applications of the spectrometer are currently under development: 1) LAARS-Environmental Sampling (ES), which collects and analyzes aerosol particles for GCEP misuse detection and 2) LAARS-Destructive Assay (DA), which enables onsite enrichment DA sample collection and analysis for protracted diversion detection. The two applications propose game-changing technological advances in GCEP safeguards verification.

Uranium Enrichment Laser Safeguards↗

Systems Approach to Arms Control Verification

Using the decades of experience of developing concepts and technologies for verifying bilateral and multilateral arms control agreements, a broad conceptual systems approach is being developed that takes into account varying levels of information and risk. The IAEA has already demonstrated the applicability of a systems approach by implementing safeguards at the State level, with acquisition path analysis as the key element. In order to test whether such an approach could also be implemented for arms control verification, an exercise was conducted in November 2014 at the JRC ITU Ispra. Based on the scenario of a hypothetical treaty between two model nuclear weapons states aimed at capping their nuclear arsenals at existing levels, the goal of this exercise was to explore how to use acquisition path analysis in an arms control context. Our contribution will present the scenario, objectives and results of this exercise, and attempt to define future workshops aimed at further developing verification measures that will deter or detect treaty violations.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗