Search NASA⌕ Search

SEARCH · Search NASA

Results for “Design verification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 595 records · Page 33

Applying Formal Methods to Safety-Critical Systems

How do you know a proof is correct? Traditionally, mathematical proofs are socially verified – at least one human, following a set of implicit rules of natural language and logic, determines if the proof is believable. If the proof becomes overly tedious and/or is essential to some safety- or mission-critical application, it becomes necessary to determine the soundness to a higher standard. 'Formal methods' refer to mathematically rigorous techniques and tools that enable specification, design, and verification of hardware and software systems. The specification used in formal methods are statements in a mathematical logic while the formal verifications are deductions in that logic. Formal methods can be difficult or time/resource intensive, but offer a higher level of assurance than standard verification through testing or handwritten proofs. This talk will introduce formal methods, motivated by applications of interest to NASA, including uncrewed aircraft operations in the national airspace, urban air environments, and wildfire areas. The audience will be given a crash course in mechanically verified proofs in the Prototype Verification System (PVS), an interactive theorem prover.

Formal Methods↗

Exploring Requirements for Software that Learns: A Research Preview

Context & motivation: The development of software that learns has revolutionized how many systems perform. For the most part, these systems are neither safety- nor mission-critical. However, as technology and aspirations advance, there is an increased desire and need for Machine Learning (ML) software in safety- and mission-critical systems, e.g., driverless cars or autonomous space robotics. Problem: In these domains, reliability is crucial and systems have to undergo much scrutiny in terms of both the developed artefacts and the adopted development process. Central to the development of such systems is the elicitation and definition of software requirements that are used to guide the design and verification process. The addition of software components that learn, and the associated capability for unforeseen behavior, makes defining detailed software requirements especially difficult. Principal ideas/results: In this paper, we identify unique characteristics of software requirements that are specific to ML components. To this end, we collect and examine requirements from both academic and industrial sources. Contribution: To the best of our knowledge, this is the first work that presents real-life, industrial patterns of requirements for ML components. Furthermore, this paper identifies key characteristics and provides a foundation for developing a taxonomy of requirements for software that learns.

Probabilistic requirements↗

A PPE Use Case on Configuration Management Approach for MBSE

Systems engineers worldwide have been working to implement Model-based Systems Engineering (MBSE) environments, tools, and methodologies. MBSE is a formalized application of modeling to support systems engineering, including requirements, design, analysis, verification, and validation activities over the project’s lifecycle[1]; MBSE captures the system data into a digital environment. Significant benefits of MBSE includes a reduction in the time in performing systems engineering activities and an improvement higher fidelity data production. As more Systems Engineers are using MBSE, the models it produces are becoming the source of truth for Systems Engineering artifacts. As we move towards using these models as the source of truth, a more rigorous Configuration Management (CM) infrastructure is needed. Many of the MBSE tools provide CM options but utilizing them efficiently and effectively can be challenging. More rigorous methods and tools are needed to assist with keeping track of changes in the model, making sure inadvertent changes to baseline data did not occur, visibility of changes in the different model versions, and the impacts of changes to the models. System engineers and configuration management personnel from the Power and Propulsion Element (PPE) project at NASA Glenn Research Center have been working to develop a modeling construct that allows models to be the source of truth and maintain a configuration managed baseline. This paper presents a process that leverages the existing CM tools and describes how PPE used this process to manage changes more rigorously. It will describe the process behind building the model architecture that utilizes the MBSE tool capabilities and the configuration management process. It will contain some of the advantages and disadvantages of the architecture that the PPE project had settled upon utilizing, as well as some enhanced capabilities that the PPE MBSE team has developed.

MBSE↗

Systems Engineering with a Focus on Failure Prevention

A discussion of Systems Engineering principles as related to failure prevention methodologies and technologies. The presentation outlines requirements development, design reviews, verification and validation, and finally risk management prectices.

Systems Engineering, Failure Prevention↗

In-Space Modular Assembly: An Approach for Reliable, Affordable, Precision Space Apertures

In-space assembly will revolutionize the creation, upgrade, and evolution of future space systems. In-space assembly represents an alternative deployment strategy that is not constrained by the requirement of using a single launch vehicle and enables a greater freedom of design for the initial emplacement of assets and their evolution over time. In-space assembly enables assets, such as observatories and science platforms, to become persistent, evolving over time like their terrestrial counterparts. Also, in-space assembly provides a direct path for utilization of in-space manufactured components designed exclusively for the operational environment. To highlight the advantages of an in-space assembly approach, the modular assembly of a 3 m to 4 m precision optical aperture based on thin meniscus technology coupled with structurally efficient TriTruss modules is presented. The 3 m to 4 m aperture stows compactly within two standard ride share slots (0.61 m by 0.71 m by 0.97 m). Placing instruments and the robotic system used for assembly in an adjacent ride share slot enables a capable observatory to be placed into service via modest ride share opportunities. Further, recent hardware assembly tests of similar modules and progress toward hardware tests to validate the overall architecture via diffraction limited testing will be summarized.

Design↗

In-Space Modular Assembly: An Approach for Reliable, Affordable, Precision Space Apertures

In-space assembly will revolutionize the creation, upgrade, and evolution of future space systems. In-space assembly represents an alternative deployment strategy that is not constrained by the requirement of using a single launch vehicle and enables a greater freedom of design for the initial emplacement of assets and their evolution over time. In-space assembly enables assets, such as observatories and science platforms, to become persistent, evolving over time like their terrestrial counterparts. Also, in-space assembly provides a direct path for utilization of in-space manufactured components designed exclusively for the operational environment. To highlight the advantages of an in-space assembly approach, the modular assembly of a 3 m to 4 m precision optical aperture based on thin meniscus technology coupled with structurally efficient TriTruss modules is presented. The 3 m to 4 m aperture stows compactly within two standard ride share slots (0.61 m by 0.71 m by 0.97 m). Placing instruments and the robotic system used for assembly in an adjacent ride share slot enables a capable observatory to be placed into service via modest ride share opportunities. Further, recent hardware assembly tests of similar modules and progress toward hardware tests to validate the overall architecture via diffraction limited testing will be summarized.

Design↗

Lunar Flashlight Science Ground and Flight Measurements and Operations Using a Multi-band Laser Reflectometer

The Lunar Flashlight cubesat mission was designed and flown to collect new data on the abundance and distribution of water ice frost in lunar permanently shadowed regions (PSRs) using active laser spectroscopy. Key advantages of active spectroscopy are that it can collect surface reflectance data in locations and conditions where passive spectroscopy cannot operate, specifically nightside locations where no indirect lighting is available, and in the deepest parts of PSRs where indirect lighting may be too faint for passive spectroscopy. Lunar Flashlight launched in 2022 but because of a propulsion system failure, did not make it to the Moon to conduct its science investigation. However, Lunar Flashlight proved to be an extremely successful technology demonstration mission, meeting or exceeding all its technology-focused mission goals, including demonstrating its instrument functionality. This paper describes the extensive ground and test campaigns to characterize the Lunar Flashlight laser reflectometer instrument and its planned utility for science observations, along with recommendations for future instrument design, development, verification, and use.

Moon↗

Icarus Application to Dragonfly Heatshield

Icarus, an in-house material response solver developed at NASA Ames, is applied to perform 2-D bondline-temperature analysis on the heatshield surface of the latest Dragonfly entry system design for a mission to Titan. Two axisymmetric domains are used: the near-shoulder region and the entire heatshield. The heatshield consists of a PICA TPS bonded to a layered system of Aluminum honeycomb wrapped by an M55J carbon-fiber facesheet. The backshell, which is also included for more accurate analysis, consists of similar materials layered. Icarus simulations using both domains indicate that the in-plane thermal conductivity property of the M55J facesheet is observed to play a dominant role in bondline temperature. Similarly, the maximum bondline temperature is found around the PICA-tile-interface region instead of the near-shoulder region or the stagnation point based on the current trajectory using the orthotropic properties of M55J. Therefore, these findings indicate the significance of 2-D or higher-dimensional material modeling analysis in fully understanding how bondline temperature behaves across the heatshield and obtaining a basis for TPS design locations. Verification at different radial locations ahead of the shoulder, where thermal conduction is close to 1-D, between Icarus (2-D), Icarus (1-D), and FIAT is performed and good agreement is observed. With the entire heatshield domain, the total mass loss of the aeroshell materials is approximately 3% of their initial mass potentially due to thermal decomposition of phenolic resins inside PICA under the current high-heating environment.

TPS material modeling↗

The IAEA Coordinated Research Program on HTGR Reactor Physics, Thermal-hydraulics and Depletion Uncertainty Analysis: Description of the Benchmark Test Cases and Phases

The continued development of High Temperature Gas Cooled Reactors (HTGRs) requires verification of design and safety features with reliable high fidelity physics models and robust, efficient, and accurate codes. The uncertainties in the HTR analysis tools are today typically assessed with sensitivity analysis and then a few important input uncertainties (typically based on a PIRT process) are varied in the analysis to find a spread in the parameter of importance. However, one wish to apply a more fundamental approach to determine the predictive capability and accuracies of coupled neutronics/thermal-hydraulics and depletion simulations used for reactor design and safety assessment. Today there is a broader acceptance of the use of uncertainty analysis even in safety studies and it has been accepted by regulators in some cases to replace the traditional conservative analysis. Finally, there is also a renewed focus in supplying reliable covariance data (nuclear data uncertainties) that can then be used in uncertainty methods. Uncertainty and sensitivity studies are therefore becoming an essential component of any significant effort in data and simulation improvement. In order to address uncertainty in analysis and methods in the HTGR community the IAEA launched a Coordinated Research Project (CRP) on the HTGR Uncertainty Analysis in Modelling early in 2012. The project is built on the experience of the OECD/NEA Light Water Reactor (LWR) Uncertainty Analysis in Best-Estimate Modelling (UAM) benchmark activity, but focuses specifically on the peculiarities of HTGR designs and its simulation requirements. Two benchmark problems were defined with the prismatic type design represented by the MHTGR-350 design from General Atomics (GA) while a 250 MW modular pebble bed design, similar to the INET (China) and indirect-cycle PBMR (South Africa) designs are also included. In the paper more detail on the benchmark cases, the different specific phases and tasks and the latest status and plans are presented.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Model-based Co-Simulation of Heat Pump Water Heater with Phase Change Materials Thermal Energy Storage

The study analysis the behavior of a new developed heat pump water heater technology which integrates a phase change materials storage with a standard heat pump water heater to maximize the performance parameters of the Unified Energy Factor (UEF) and First Hour Rating (FHR). A model-based control development co-simulation platform is developed to include equipment models, such as heat pump, standard water tank, phase change materials storage tank, and integrate them with control model to support controls design, analysis, verification, and validation. Simulation results are compared with lab test results to validate the accuracy of developed co-simulation platform

Sun, Jian↗

Predicting deviations in ex-core detector response in Krsko NPP during an earthquake with Monte-Carlo neutron transport methods

To study the response of ex-core detectors during an earthquake, an approach using Monte Carlo code MCNP was developed. As a first step to predict the response of the ex-core detectors a detailed MCNP model of the Krsko reactor core was created. A detailed MCNP core model was used to calculate 3D power distributions inside the core. Calculated power distributions were verified by comparison to the CORD-2 calculations, which is currently used for core design calculation verification of the Krsko nuclear power plant. Due to the outside the core position of the neutron detectors, the hybrid code ADVANTG is used to generate weight windows to speed up neutron transport outside the reactor core. To be able to use ADVANTG, fixed neutron source had to be reconstructed from the criticality core calculation. It was found that the power range ex-core detector movement has a negligible effect on the value of the thermal neutron flux at the active part of the detector. However, the 5 cm radial movement of the intermediate-range detector leads to 7 % - 8 % change in thermal neutron flux within the active intermediate-range detector region. The analysis continued with the evaluation of the effect of core barrel movement on the ex-core detector response. It was determined that the 2 mm core barrel radial oscillation can lead to ∼ 4% change in thermal neutron flux within the active detector region. It was evaluated that reactor core movement inside the baffle can lead up to ∼ 1.9% and ∼ 1.3% deviation in power-range and intermediate-range detector signal respectively. Analysis showed that the mechanical movement of ex-core neutron detectors could not explain the fluctuations in the ex-core detector signal. However, combined core barrel and reactor core inside baffle oscillations could be a probable reason for the observed fluctuations in the ex-core detector signal during an earthquake. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

MFANS 2024 - Dimensional Analysis Made Easy

There is a significant impact of dimensional errors in systems. Dimensional analysis is difficult due to the large size of systems. SA4U and Scalpel are practical programs which can have an impact beyond traditional software as they are able to perform precise dimensional analysis and repair C++ source code.

97 MATHEMATICS AND COMPUTING↗

Swarm Verification

Reportedly, supercomputer designer Seymour Cray once said that he would sooner use two strong oxen to plow a field than a thousand chickens. Although this is undoubtedly wise when it comes to plowing a field, it is not so clear for other types of tasks. Model checking problems are of the proverbial "search the needle in a haystack" type. Such problems can often be parallelized easily. Alas, none of the usual divide and conquer methods can be used to parallelize the working of a model checker. Given that it has become easier than ever to gain access to large numbers of computers to perform even routine tasks it is becoming more and more attractive to find alternate ways to use these resources to speed up model checking tasks. This paper describes one such method, called swarm verification.

grid computing↗

Europa Clipper Payload Verification and Validation: Test and Analysis Program Design

NASA’s Europa Clipper mission – which is planned to launch in the mid-2020s – is designed to investigate the habitability of the jovian moon Europa with a state-of-the-art suite of over 10 sensors and instruments. Now past its project critical design review, Europa Clipper is starting the execution of its verification and validation (V&V) program. The payload V&V function in particular is responsible for designing and coordinating a thorough test and analysis program that will confirm the proper functioning and performance of our payload instruments. Given the large number of instruments to manage, we have developed a suite of standardized tests and analyses that are designed to cover all of the common interfaces across instruments, while allowing for flexibility to support the unique needs of individual instruments. This suite of activities, coordinated and/or performed by the payload team, forms the bulk of our payload verification and validation campaign. This paper provides a detailed summary of the full set of V&V activities in that suite, covering the four categories of activities: analysis of lower-level evidence, analysis via simulation, testing in the system testbeds, and testing in assembly, test, and launch operations (ATLO). We will describe the purpose of each activity type, how the activities are developed, and the review process for each type of activity. We then define the complete list of activities written for each instrument and how subtleties specific to certain instruments are managed. The discussion will provide a comprehensive understanding of the activities in the payload V&V purview and how various interfaces with different levels of the project are managed. This paper also describes key metrics the payload team uses to track V&V progress and some insights into the teaming design and division of labor we use to ensure consistency and completeness across the entire payload suite. Finally, the paper will offer a snapshot of the status of the Payload V&V program prior to instrument delivery and offer insights into the upcoming phase of instrument delivery and the start of ATLO.

Lee, Dennis↗

Simulation verification techniques study: Simulation self test hardware design and techniques report

The final results are presented of the hardware verification task. The basic objectives of the various subtasks are reviewed along with the ground rules under which the overall task was conducted and which impacted the approach taken in deriving techniques for hardware self test. The results of the first subtask and the definition of simulation hardware are presented. The hardware definition is based primarily on a brief review of the simulator configurations anticipated for the shuttle training program. The results of the survey of current self test techniques are presented. The data sources that were considered in the search for current techniques are reviewed, and results of the survey are presented in terms of the specific types of tests that are of interest for training simulator applications. Specifically, these types of tests are readiness tests, fault isolation tests and incipient fault detection techniques. The most applicable techniques were structured into software flows that are then referenced in discussions of techniques for specific subsystems.

Source record↗