Search NASA⌕ Search

SEARCH · Search NASA

Results for “consistency checking”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11

Smart Aerospace eCommerce: Using Intelligent Agents in a NASA Mission Services Ordering Application

This paper describes how intelligent agent technology was successfully prototyped and then deployed in a smart eCommerce application for NASA. An intelligent software agent called the Intelligent Service Validation Agent (ISVA) was added to an existing web-based ordering application to validate complex orders for spacecraft mission services. This integration of intelligent agent technology with conventional web technology satisfies an immediate NASA need to reduce manual order processing costs. The ISVA agent checks orders for completeness, consistency, and correctness, and notifies users of detected problems. ISVA uses NASA business rules and a knowledge base of NASA services, and is implemented using the Java Expert System Shell (Jess), a fast rule-based inference engine. The paper discusses the design of the agent and knowledge base, and the prototyping and deployment approach. It also discusses future directions and other applications, and discusses lessons-learned that may help other projects make their aerospace eCommerce applications smarter.

Moleski, Walt↗

Assessing Requirements Quality through Requirements Coverage

In model-based development, the development effort is centered around a formal description of the proposed software system the model. This model is derived from some high-level requirements describing the expected behavior of the software. For validation and verification purposes, this model can then be subjected to various types of analysis, for example, completeness and consistency analysis [6], model checking [3], theorem proving [1], and test-case generation [4, 7]. This development paradigm is making rapid inroads in certain industries, e.g., automotive, avionics, space applications, and medical technology. This shift towards model-based development naturally leads to changes in the verification and validation (V&V) process. The model validation problem determining that the model accurately captures the customer's high-level requirements has received little attention and the sufficiency of the validation activities has been largely determined through ad-hoc methods. Since the model serves as the central artifact, its correctness with respect to the users needs is absolutely crucial. In our investigation, we attempt to answer the following two questions with respect to validation (1) Are the requirements sufficiently defined for the system? and (2) How well does the model implement the behaviors specified by the requirements? The second question can be addressed using formal verification. Nevertheless, the size and complexity of many industrial systems make formal verification infeasible even if we have a formal model and formalized requirements. Thus, presently, there is no objective way of answering these two questions. To this end, we propose an approach based on testing that, when given a set of formal requirements, explores the relationship between requirements-based structural test-adequacy coverage and model-based structural test-adequacy coverage. The proposed technique uses requirements coverage metrics defined in [9] on formal high-level software requirements and existing model coverage metrics such as the Modified Condition and Decision Coverage (MC/DC) used when testing highly critical software in the avionics industry [8]. Our work is related to Chockler et al. [2], but we base our work on traditional testing techniques as opposed to verification techniques.

Rajan, Ajitha↗

Formal Verification Toolkit for Requirements and Early Design Stages

Efficient flight software development from natural language requirements needs an effective way to test designs earlier in the software design cycle. A method to automatically derive logical safety constraints and the design state space from natural language requirements is described. The constraints can then be checked using a logical consistency checker and also be used in a symbolic model checker to verify the early design of the system. This method was used to verify a hybrid control design for the suit ports on NASA Johnson Space Center's Space Exploration Vehicle against safety requirements.

Badger, Julia M.↗

Reference Management Methodologies for Large Structural Models at Kennedy Space Center

There have been many challenges associated with modeling some of NASA KSC's largest structures. Given the size of the welded structures here at KSC, it was critically important to properly organize model struc.ture and carefully manage references. Additionally, because of the amount of hardware to be installed on these structures, it was very important to have a means to coordinate between different design teams and organizations, check for interferences, produce consistent drawings, and allow for simple release processes. Facing these challenges, the modeling team developed a unique reference management methodology and model fidelity methodology. This presentation will describe the techniques and methodologies that were developed for these projects. The attendees will learn about KSC's reference management and model fidelity methodologies for large structures. The attendees will understand the goals of these methodologies. The attendees will appreciate the advantages of developing a reference management methodology.

Jones, Corey↗

A Scala DSL for RETE-Based Runtime Verification

Runtime verification (RV) consists in part of checking execution traces against formalized specifications. Several systems have emerged, most of which support specification notations based on state machines, regular expressions, temporal logic, or grammars. The field of Artificial Intelligence (AI) has for an even longer period of time studied rule-based production systems, which at a closer look appear to be relevant for RV, although seemingly focused on slightly different application domains, such as for example business processes and expert systems. The core algorithm in many of these systems is the Rete algorithm. We have implemented a Rete-based runtime verification system, named LogFire (originally intended for offline log analysis but also applicable to online analysis), as an internal DSL in the Scala programming language, using Scala's support for defining DSLs. This combination appears attractive from a practical point of view. Our contribution is in part conceptual in arguing that such rule-based frameworks originating from AI may be suited for RV.

matching problem↗

Development of a Composite Material Aerodynamic Demise Model for the Object Reentry Survival Analysis Tool (ORSAT)

The reentry demise of fiber-reinforced polymer (FRP) composites is an increasing concern for modern spacecraft at end of life. Unlike traditional materials such as metals, shredding of the material by aerodynamic forces appears to be a major component of the reentry demise mechanism. This paper will describe a new mechanical, strength-based, material demise model for the Object Reentry Survival Analysis Tool (ORSAT) Version 7.1. The model is based on laboratory in-situ and residual strength tests of several FRP materials performed during the NASA Orbital Debris Program Office’s Phase II Composite Material Demise test campaign. To test the residual strength of partially charred FRP materials, the authors tested 107 rectangular shaped samples of different thicknesses that were previously exposed to high-enthalpy flow at the University of Texas at Austin’s Inductively Coupled Plasma Torch facility. Tests were performed under normal atmospheric conditions at NASA Johnson Space Center’s Experimental Impact Laboratory using a Chatillon TCD1000 tensile test machine configured with a three-point bending jig. Mean fracture load, residual strength, delamination, and flexural modulus were measured for each test. An engineering model of aeromechanical demise for each material was developed by correlating the measured residual strength of the samples with the duration and magnitude of the applied heat flux and the mass loss and char progression. This model has been implemented in ORSAT 7.1 for the built-in, charring carbon fiber/epoxy and charring glass fiber/epoxy material models. The new model was verified by calculating the demise of hundreds of FRP composite fragments of various shapes and sizes and checking the calculations for consistency, with specific focus on material characterization in one-dimension. Further tests are planned in hypersonic flow facilities to validate the assumptions used in the model.

Priscilla A. Mendoza↗

Development of a Composite Material Aerodynamic Demise Model for the Object Reentry Survival Analysis Tool (ORSAT)

The reentry demise of fiber-reinforced polymer (FRP) composites is an increasing concern for modern spacecraft at end of life. Unlike traditional materials such as metals, shredding of the material by aerodynamic forces appears to be a major component of the reentry demise mechanism. This paper will describe a new mechanical, strength-based, material demise model for the Object Reentry Survival Analysis Tool (ORSAT) Version 7.1. The model is based on laboratory in-situ and residual strength tests of several FRP materials performed during the NASA Orbital Debris Program Office’s Phase II Composite Material Demise test campaign. To test the residual strength of partially charred FRP materials, the authors tested 107 rectangular shaped samples of different thicknesses that were previously exposed to high-enthalpy flow at the University of Texas at Austin’s Inductively Coupled Plasma Torch facility. Tests were performed under normal atmospheric conditions at NASA Johnson Space Center’s Experimental Impact Laboratory using a Chatillon TCD1000 tensile test machine configured with a three-point bending jig. Mean fracture load, residual strength, delamination, and flexural modulus were measured for each test. An engineering model of aeromechanical demise for each material was developed by correlating the measured residual strength of the samples with the duration and magnitude of the applied heat flux and the mass loss and char progression. This model has been implemented in ORSAT 7.1 for the built-in, charring carbon fiber/epoxy and charring glass fiber/epoxy material models. The new model was verified by calculating the demise of hundreds of FRP composite fragments of various shapes and sizes and checking the calculations for consistency, with specific focus on material characterization in one-dimension. Further tests are planned in hypersonic flow facilities to validate the assumptions used in the model.

Priscilla A. Mendoza↗

Verification and Validation of the Stakeholder Tool for Assessing Radioactive Transportation (START) – 22323

The U.S. Department of Energy (DOE) Office of Integrated Waste Management is planning for the eventual transportation, storage, and disposal of spent nuclear fuel (SNF) and high-level radioactive waste (HLW) from nuclear power plant and DOE sites. The Stakeholder Tool for Assessing Radioactive Transportation (START) is a web-based, geospatial decision-support tool developed for evaluating routing options and other aspects of transporting SNF and HLW, covering rail, truck, barge, and intermodal infrastructure and operations in the continental United States. The verification and validation (V&V) process is intended to independently assess START to provide confidence in the ability of START to accurately provide intended results. The V&V process checks the START tool using a variety of methods, ranging from independent hand calculations to comparison of START performance and results to those of other codes. The V&V activity was conducted independently from the START development team with opportunities to provide feedback and collaborate throughout the process. The V&V analyzed attributes of transportation routes produced by START, including route distance and both population and population density captured within buffer zones around routes. Population in the buffer zone, population density in the buffer zone, and route distance were all identified as crucial outputs of the START code and were subject to V&V tasks. Some of the improvements identified through the V&V process were standardizing the underlying population data in START, changing the projection of the population raster data, and changes to the methodology used for population density to improve its applicability for expected users. This collaboration also led to suggested improvements to some of the underlying shape file segments within START. A formal series of test routes went through the V&V process from START version 3.2.1 following the implementation of the recommended improvements to START. The V&V of the buffer zone population and distance reported in START were achieved by utilizing a custom workflow developed in QGIS. This platform was chosen because it is fully independent of START. The buffer zone population and route distances in START showed excellent agreement to independent V&V test results. Over 200 route test cases were run; in all cases, the percent difference in the population within the buffer zone was less than +/- 5%, and the majority of cases were below +/- 1%. These cases were also duplicated in ArcMap, which is Environmental Systems Research Institute’s (ESRI) GIS desktop application. The ArcMap results also show good agreement; however, they cannot be considered independent of START because START also uses ESRI software. The V&V tasks are currently addressing population density and estimated radiation dose in START as well as implementing further automation of the V&V process to allow larger suites of test routes to be run more easily and quickly by less experienced GIS users. These improvements to the V&V process will make it a valuable tool for the development team and the stakeholders so that each new iteration of START can easily be checked for quality and consistency. This paper and presentation will describe the V&V process, findings and implications, and ongoing V&V activities.

START, DOE, Transporation, dose, GIS↗

The design and proof of correctness of a fault-tolerant circuit

The flowing achievements are presented in view graph form: (1) a formal statement of interactive consistency conditions in the Boyer-Moore logic; (2) a formal statement of the oral messages (OM) algorithm in the Boyer-Moore logic; (3) a mechanically checked proof that OM satisfies the interactive consistency conditions; (4) a mechanically checked proof of the optimality result--no algorithm can tolerate fewer faults than OM yet still achieve interactive consistency; (5) the use of OM in a functional specification for a fault-tolerant device; (6) a formal description of the design of the device; (7) a mechanically checked proof that the device design satisfies the specification; and (8) an implementation of the design in programmable logic arrays.

Bevier, William R.↗

MPST Software: grl_pef_check

This innovation is a tool used to verify and validate spacecraft sequences at the predicted events file (PEF) level for the GRAIL (Gravity Recovery and Interior Laboratory, see http://www.nasa. gov/mission_pages/grail/main/index. html) mission as part of the Multi-Mission Planning and Sequencing Team (MPST) operations process to reduce the possibility for errors. This tool is used to catch any sequence related errors or issues immediately after the seqgen modeling to streamline downstream processes. This script verifies and validates the seqgen modeling for the GRAIL MPST process. A PEF is provided as input, and dozens of checks are performed on it to verify and validate the command products including command content, command ordering, flight-rule violations, modeling boundary consistency, resource limits, and ground commanding consistency. By performing as many checks as early in the process as possible, grl_pef_check streamlines the MPST task of generating GRAIL command and modeled products on an aggressive schedule. By enumerating each check being performed, and clearly stating the criteria and assumptions made at each step, grl_pef_check can be used as a manual checklist as well as an automated tool. This helper script was written with a focus on enabling the user with the information they need in order to evaluate a sequence quickly and efficiently, while still keeping them informed and active in the overall sequencing process. grl_pef_check verifies and validates the modeling and sequence content prior to investing any more effort into the build. There are dozens of various items in the modeling run that need to be checked, which is a time-consuming and errorprone task. Currently, no software exists that provides this functionality. Compared to a manual process, this script reduces human error and saves considerable man-hours by automating and streamlining the mission planning and sequencing task for the GRAIL mission.

Call, Jared A.↗

A Joint Search for Muon Neutrino Disappearance with the Short-Baseline Neutrino Program Using the SPINE Deep Learning-Based Reconstruction Package

We present the status of a joint search for muon neutrino disappearance in the Booster Neutrino Beam at Fermilab using the Short-Baseline Neutrino (SBN) Program's two-detector configuration, SBND and ICARUS. Charged-current interactions consistent with muon neutrinos and containing only a muon and at least one proton in the final state are reconstructed and selected using the SPINE deep learning-based particle reconstruction package. To exploit proton multiplicity information and enhance sensitivity to modeling effects, the selected sample is partitioned into exclusive channels with exactly one reconstructed proton and with more than one reconstructed proton. Comprehensive systematic uncertainties from the neutrino flux, interaction, and detector response are incorporated into the analysis, and the coverage of these systematic uncertainty models is validated using data from both detectors, including checks of near-far consistency in key kinematic and topology-sensitive observables. This analysis is intended for inclusion in SBN's first oscillation result.

Mueller, Justin [Fermilab]↗

Interaction of the equatorial midnight pressure bulge and thermospheric zonal winds

The zonal component of the thermospheric neutral wind in the equatorial region is found to flow eastward all night, having a minimum near midnight. The data, obtained by Spencer et al. on the Dynamics Explorer-2 (DE-2) satellite, and reported more recently by Wharton et al., indicate that the minimum feature is significant. The minimum is illustrated by a 4th order Fourier series fit to the data points reported by Wharton et al. A table gives the amplitudes and phases of the four harmonic components used with the estimated error for each amplitude. It is asked whether this behavior is due to the local passage of the equatorial midnight pressure bulge associated with the midnight temperature anomaly. If so, it is to be expected that other data characterizing the midnight temperature anomaly should show consistency with this observation, especially in view of the large changes observed in the zonal velocity in the midnight sector. Consistency in momentum conservation may be checked using available data from previous independent experiments. Such data, taken under similar conditions of solar activity, was substituted into the momentum equation and found to be consistent using a priori estimates of the effect of viscosity.

Herrero, F. A.↗

Dynamical dark energy from lattice quantum gravity

We study the behavior of the vacuum in Euclidean dynamical triangulations (EDT). Algorithmic improvements and better lattice spacing determinations allow us to test the properties of the emergent de Sitter geometries of our simulations to higher precision than previously possible. Although the agreement with de Sitter is good, the improved precision reveals deviations that can be interpreted as nontrivial vacuum dynamics, well described by a cosmological constant that runs with scale. The simulations show that the dominant running is quadratic and that the scale can be identified with the Hubble rate. Several key cross-checks support this picture, including consistent results across multiple lattice spacings and the fact that the null energy condition is not violated. The parameters of the running are fully determined by simulations, enabling predictions when extrapolated to the scales relevant for our Universe. This leads to a model for dark energy that is compatible with current observations, but which predicts deviations from the Standard Model of cosmology at the 𝒪⁡(10 −3 ) level in observables that could be tested with future improvements in precision measurements.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

SCO#1197 Addendum #4 OSR Characterization Database (Test Report)

A test plan was developed and approved in June of 2022. Testing was successfully performed to verify the functions of Version 2.0 of the OSR Characterization database. Checks verified that data remains consistent to tests previously performed using Microsoft Access® 2003, 2010 and 2016.

97 MATHEMATICS AND COMPUTING↗

Decision-directed adaptive recursive estimators - Divergence prevention.

A method is proposed for dealing with the divergence phenomenon problem encountered in applications of minimum-variance recursive estimators when the error covariance calculated by the estimator becomes inconsistent with the actual error covariance. The proposed method differs from previous ones in that the state model and statistics are accepted as given. The form of the optimal estimator is used, but a constant check is made on the consistency of the calculated and actual error covariances. The method is independent of the source of error, whether it be inaccuracies in the system model, incorrect values of the a priori and random process statistics, approximations required in the case of nonlinear systems, or computational roundoff. Several simulated examples, in which inconsistencies in the calculated and actual error covariances exist, show a significant improvement in the performance of the estimator when the given procedure is applied.

Nahi, N. E.↗

Tube flare inspection tool

Flare angle and symmetry of tube ends can be checked by simple tool that consists of two stainless steel pins bonded to rubber plug. Primary function of tool is to inspect tubes before they are installed, thereby eliminating expense and inconvenience of repairing leaks caused by imperfect flares. Measuring hole tapers, countersink angles, and bearing race angles are other possible uses. Tool is used with optical comparator. Axis of tool is alined with centerline of tube. Shadow of seated pins on comparator screen allows operator to verify flare angle is within tolerance.

Meunier, G. E.↗

User's guide for the Solar Backscattered Ultraviolet (SBUV) instrument first year ozone-S data set

Total-ozone and ozone vertical profile results for Solar Backscattered Ultraviolet/Total Ozone Mapping Spectrometer (SBUV/TOMS) Nimbus 7 operation from November 1978 to November 1979 are available. The algorithm used have been thoroughly tested, the instrument performance has been examined in details, and the ozone results have been compared with Dobson, Umkehr, balloon, and rocket observations. The accuracy and precision of the satellite ozone data are good to at least within the ability of the ground truth to check and are self-consistent to within the specifications of the instrument. The 'SBUV User's Guide' describes the SBUV experiment and algorithms used. Detailed information on the data available on computer tape is provided including how to order tapes from the National Space Science Data Center.

Fleig, A. J.↗

State estimation applications in aircraft flight-data analysis: A user's manual for SMACK

The evolution in the use of state estimation is traced for the analysis of aircraft flight data. A unifying mathematical framework for state estimation is reviewed, and several examples are presented that illustrate a general approach for checking instrument accuracy and data consistency, and for estimating variables that are difficult to measure. Recent applications associated with research aircraft flight tests and airline turbulence upsets are described. A computer program for aircraft state estimation is discussed in some detail. This document is intended to serve as a user's manual for the program called SMACK (SMoothing for AirCraft Kinematics). The diversity of the applications described emphasizes the potential advantages in using SMACK for flight-data analysis.

Bach, Ralph E., Jr.↗