Search NASA⌕ Search

SEARCH · Search NASA

Results for “program verification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,693 records · Page 94

Verification and Validation of Flight-Critical Systems

For the first time in many years, the NASA budget presented to congress calls for a focused effort on the verification and validation (V&V) of complex systems. This is mostly motivated by the results of the VVFCS (V&V of Flight-Critical Systems) study, which should materialize as a a concrete effort under the Aviation Safety program. This talk will present the results of the study, from requirements coming out of discussions with the FAA and the Joint Planning and Development Office (JPDO) to technical plan addressing the issue, and its proposed current and future V&V research agenda, which will be addressed by NASA Ames, Langley, and Dryden as well as external partners through NASA Research Announcements (NRA) calls. This agenda calls for pushing V&V earlier in the life cycle and take advantage of formal methods to increase safety and reduce cost of V&V. I will present the on-going research work (especially the four main technical areas: Safety Assurance, Distributed Systems, Authority and Autonomy, and Software-Intensive Systems), possible extensions, and how VVFCS plans on grounding the research in realistic examples, including an intended V&V test-bench based on an Integrated Modular Avionics (IMA) architecture and hosted by Dryden.

Brat, Guillaume↗

External Contamination Integration of Visiting Vehicles on the International Space Station

The International Space Station (ISS) is an on-orbit platform for science utilization in low Earth orbit. The induced contamination environment can impact performance, mission success, and science utilization. Cargo and crew vehicles visiting the ISS represent significant sources of contamination. The Space Environments Team of the ISS Program Office has developed visiting vehicle requirements and methodologies to address the increasingly complex challenge of integrating multiple visiting vehicles while maintaining overall ISS contamination control requirements. The external contamination control requirements are summarized and the integration and verification process is described along with required data deliverables. Contamination characterization data deliverables address vacuum-exposed materials, thrusters, vacuum venting, and particulate releases. Visiting vehicle external contamination analyses are conducted by the ISS Space Environments Team to certify compliance with external contamination control requirements. Unpressurized cargo contamination analyses are also performed to characterize induced contamination to payloads while in transit to ISS. Efforts to confirm the visiting vehicle contamination modeling and analysis process based on on-orbit data are discussed.

outgassing↗

The US Support Program to IAEA Safeguards Priority of Containment and Surveillance

The United States Support Program (USSP) priority for containment and surveillance (US) focuses on maintaining or improving the reliability and cost-effectiveness of C/S systems for IAEA safeguards, expanding the number of systems that are unattended and remotely monitored, and developing verification methods that help streamline the on-site inspection process. Existing IAEA C/S systems have evolved to become complex, integrated systems, which may include active seals, nondestructive assay (NDA) instruments, video cameras, and other sensors. These systems operate autonomously. They send analytical data to IAEA headquarters where it can be reviewed. These systems present challenges to the goals of improved system performance, standardization, reliability, maintainability, documentation, and cost effectiveness. One critical lesson from past experiences is the need for cooperation and common objectives among the IAEA, the developer, and the facility operator, to create a successful, cost effective system. Recent USSP C/S activities include Rokkasho Reprocessing Plant safeguard systems, production of a new shift register, numerous vulnerability assessments of C/S systems, a conduit monitoring system which identifies tampering of IAEA conduit deployed in the field, fiber optic seal upgrades, unattended monitoring system software upgrades, next generation surveillance system which will upgrade existing camera systems, and support of the IAEA's development of the universal nondestructive assay data acquisition platform.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

ICARUS: new voyage to sterile neutrino search in the Short Baseline Program

The ICARUS collaboration operated the 760-ton T600 detector in a successful three-year physics run at the underground LNGS laboratories studying neutrino oscillations with the CNGS neutrino beam from CERN, and searching for atmospheric neutrino interactions. ICARUS performed a sensitive search for LSND-like anomalous νe appearance in the CNGS beam, which contributed to the constraints on the allowed parameters to a narrow region around $Δm^2=1 e\text{V}^2$, where all the experimental results can be coherently accommodated at 90% C.L. After a significant overhaul at CERN, the T600 detector has been installed at Fermilab. In 2020 cryogenic commissioning began with detector cool down, liquid Argon filling and recirculation. ICARUS has started operations and is presently in its commissioning phase with the aim of collecting its first neutrino events from the Booster Neutrino Beam and the NuMI off-axis beam. The main goal of the first year of ICARUS data taking will then be the definitive verification of the recent claim by NEUTRINO-4 short baseline reactor experiment both in the $ν_μ$ channel with the BNB and in the $ν_e$ with NuMI. After the first year of operations, ICARUS will commence its search for evidence of a sterile neutrino jointly with the SBND near detector, within the Short Baseline Neutrino (SBN) program. The ICARUS exposure to the NuMI beam will also give the possibility for other physics studies such as light dark matter searches and neutrino-Argon cross section measurements. The proposed contribution addresses ICARUS achievements, its status and plans for the new run at Fermilab and the ongoing developments of the analysis tools needed to fulfill its physics program.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

RELAP5-3D Restart and Backup Verification Testing

Existing testing methodology for RELAP5-3D employs a set of test cases collected over two decades to test a variety of code features and run on a Linux or Windows platform. However, this set has numerous deficiencies in terms of code coverage, detail of comparison, running time, and testing fidelity of RELAP5-3D restart and backup capabilities. The test suite covers less than three quarters of the lines of code in the relap directory and just over half those in the environmental library. Even in terms of code features, many are not covered. Moreover, the test set runs many problems long past the point necessary to test the relevant features. It requires standard problems to run to completion. This is unnecessary for features can be tested in a short-running problem. For example, many trips and controls can be tested in the first few time steps, as can a number of fluid flow options. The testing system is also inaccurate. For the past decade, the diffem script has been the primary tool for checking that printouts from two different RELAP5-3D executables agree. This tool compares two output files to verify that all characters are the same except for those relating to date, time and a few other excluded items. The variable values printed on the output file are accurate to no more than eight decimal places. Therefore, calculations with errors in decimal places beyond those printed remain undetected. Finally, fidelity of restart is not tested except in the PVM sub-suite and backup is not specifically tested at all. When a restart is made from any midway point of the base-case transient, the restart must produce the same values. When a backup condition occurs, the code repeats advancements with the same time step. A perfect backup can be tested by forcing RELAP5 to perform a backup by falsely setting a backup condition flag at a user-specified-time. Comparison of the calculations of that run and those produced by the same input w/o the spurious condition should be identical. Backup testing is more difficult the other kinds of testing described above because it requires additional coding to implement. The testing system constructed and described in this document resolves all of these issues. A matrix of test features and short-running cases that exercise them is presented. A small information file that contains sufficient data to verify calculations to the last decimal place and bit is produced. This testing system is used to test base cases (called null testing) as well as restart and backup cases. The programming that implements these new capabilities is presented.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Core conversion of the Portuguese research reactor to LEU fuel

Core conversion of the Portuguese Research Reactor (RPI) to LEU fuel is being performed within IAEA's Technical Cooperation project POR/4/016, with financial support from the US and Portugal. CERCA was selected as manufacturer of the LEU assemblies by the IAEA after an international call for bids. CERCA provided a comprehensive package to the RPI which included the mechanical verification of the design of the assemblies, their manufacture and arrangements for a joint inspection of the finished assemblies. The LEU fuel assemblies were manufactured within 8 months upon final approval of the design. The safety analyses for the core conversion to LEU fuel were made with the assistance of the RERTR program and were submitted for review by the IAEA and by Portuguese authorities in January 2007. Revised documents were submitted in June 2007 addressing the issues raised during review. Regulatory approval was received in early August and core conversion was done in early September. All measured safety parameters are within the defined acceptance limits. Operation at full power is expected by the end of October. (author)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Integrated Modeling and Simulation Capability For Full Scale Multi-Physics Simulation and Visualization of Microreactor Concept

Microreactors are small mobile transportable nuclear reactors with thermal power less than 20 MWt that are designed to meet the needs of remote areas, military installations, emergency operations, and disaster relief zones. These reactor are concepts that are intended to be factory-manufacturable, easily transportable, and will allow for semi- or full-autonomous operation. To assist with development of microreactors, modeling and experimentation need to be performed with verification and validation to gain confidence in the models and tools. The objective of this study is apply advanced modeling and simulation capabilities being developed by the DOE Office of Nuclear Energy Nuclear Energy Advanced Modeling and Simulation (NEAMS) program to perform integrated modeling and simulation capability for multiphysics simulation of the microreactor concepts. This activity will provide an opportunity to exercise the codes to provide both gain experience and to provide feedback to the developers.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Command system output bit verification

An automatic test was developed to test the ability of the deep space station (DSS) command subsystem and exciter to generate and radiate, from the exciter, the correct idle bit sequence for a given flight project or to store and radiate received command data elements and files without alteration. This test, called the command system output bit verification test, is an extension of the command system performance test (SPT) and can be selected as an SPT option. The test compares the bit stream radiated from the DSS exciter with reference sequences generated by the SPT software program. The command subsystem and exciter are verified when the bit stream and reference sequences are identical. It is a key element of the acceptance testing conducted on the command processor assembly (CPA) operational program (DMC-0584-OP-G) prior to its transfer from development to operations.

Odd, C. W.↗

The effect of nonlinearities on the dynamic response of a large Shuttle payload

The STS Centaur was designed to be a high energy upper stage for use with the Space Shuttle. Two versions were designed and under development when the program was cancelled. The first version, designated G-prime, was designed for planetary missions. The second version, designated G, was designed to place spacecraft in geosynchronous orbit. As a part of the STS Centaur finite-element model verification effort, test articles of both versions were subjected to a series of static tests. In addition the Centaur G-prime test article was subjected to a series of dynamic tests including a modal survey. Both the static and dynamic tests showed that nonlinearities existed in the Centaur and its support system. The support system included flight-like latches. The nonlinearities were particularly apparent in tests that loaded the forward support structure of the Centaur. These test results were used to aid in the development of two improved finite-element models. The first was a linear model, while the second contained nonlinear elements at the boundaries. Results from both models were compared with the transient response obtained from a step-relaxation or twang test. The linear model was able to accurately match the low frequency response found in the test data. However, only the nonlinear model was able to match higher frequency response that was present in some of the test data. In addition the nonlinear model was able to predict other nonlinear behavior such as the dynamic 'jump' that occurs in systems with nonlinear stiffness.

Sullivan, Timothy L.↗

Controls and guidance: Space

The Space Controls and Guidance Research and Technology Program is directed toward enabling the next generation of space transportation systems, large future spacecraft, and space systems such as the Space Station to have large communication antennas and high precision segmented reflector astrophysical telescopes. The new generation of transportation vehicles has demanding requirements to provide for an order of magnitude reduction in cost as well as an increase in capability. The future orbital facilities have demanding control requirements for pointing and stabilization, momentum management, build-up and growth accomodation, and disturbance management. To address these advanced requirements, the research and development program is designed to provide the generic technology base to support the implementation of advanced guidance, navigation, and control. The area of computational controls will be stressed in order to develop cost effective, high speed, high fidelity control system simulation and analysis and synthesis tools. The trust of this work will be to develop methods and software to enable analysis and real-time hardware-in-the-loop simulation of complex spacecraft for control design certification. To address future orbital facilities requirements, an advanced technology program is underway in system identification, distributed control, integrated controls/structures design methods, and advanced sensors and actuators. Because the behavior of large, light weight per unit area deployable/assembled spacecraft is greatly influenced by the ground environment, the testing and verification activity is both ground- and space-based.

Dibattista, John D.↗

Coupled structural/thermal/electromagnetic analysis/tailoring of graded composite structures

Described here are the accomplishments of a 5-year program to develop a methodology for coupled structural, thermal, electromagnetic analysis tailoring of graded component structures. The capabilities developed over the course of the program are the analyzer module and the tailoring module for the modeling of graded materials. Highlighted accomplishments for the past year include the addition of a buckling analysis capability, the addition of mode shape slope calculation for flutter analysis, verification of the analysis modules using simulated components, and verification of the tailoring module.

Hartle, M. S.↗

What Sensing Tells Us: Towards a Formal Theory of Testing for Dynamical Systems

Just as actions can have indirect effects on the state of the world, so too can sensing actions have indirect effects on an agent's state of knowledge. In this paper, we investigate "what sensing actions tell us", i.e., what an agent comes to know indirectly from the outcome of a sensing action, given knowledge of its actions and state constraints that hold in the world. To this end, we propose a formalization of the notion of testing within a dialect of the situation calculus that includes knowledge and sensing actions. Realizing this formalization requires addressing the ramification problem for sensing actions. We formalize simple tests as sensing actions. Complex tests are expressed in the logic programming language Golog. We examine what it means to perform a test, and how the outcome of a test affects an agent's state of knowledge. Finally, we propose automated reasoning techniques for test generation and complex-test verification, under certain restrictions. The work presented in this paper is relevant to a number of application domains including diagnostic problem solving, natural language understanding, plan recognition, and active vision.

McIlraith, Sheila↗

Cryo-Vacuum Testing of the Integrated Science Instrument Module for the James Webb Space Telescope

With delivery of the science instruments for the James Webb Space Telescope (JWST) to Goddard Space Flight Center (GSFC) expected in 2012, current plans call for the first cryo-vacuum test of the Integrated Science Instrument Module (ISIM) to be carried out at GSFC in early 2013. Plans are well underway for conducting this ambitious test, which will perform critical verifications of a number of optical, thermal, and operational requirements of the IS 1M hardware, at its deep cryogenic operating temperature. We describe here the facilities, goals, methods, and timeline for this important Integration & Test milestone in the JWST program.

Kimble, Randy A.↗

Monitoring with Data Automata

We present a form of automaton, referred to as data automata, suited for monitoring sequences of data-carrying events, for example emitted by an executing software system. This form of automata allows states to be parameterized with data, forming named records, which are stored in an efficiently indexed data structure, a form of database. This very explicit approach differs from other automaton-based monitoring approaches. Data automata are also characterized by allowing transition conditions to refer to other parameterized states, and by allowing transitions sequences. The presented automaton concept is inspired by rule-based systems, especially the Rete algorithm, which is one of the well-established algorithms for executing rule-based systems. We present an optimized external DSL for data automata, as well as a comparable unoptimized internal DSL (API) in the Scala programming language, in order to compare the two solutions. An evaluation compares these two solutions to several other monitoring systems.

log analysis↗

Is Structured Agile an Oxymoron? Tales from Implementing and Executing Agile in a US Government Environment

To paraphrase a famous quote, "No plan survives contact with the reality." Software (SW) development is often a classic example of this: whatever the plan was for a particular development, it often does not survive contact with technical realities, budget realities, program realities and schedule realities. Traditionally, SW development has followed a waterfall methodology with requirements being rigorously specified before the design, which was completed before the coding and unit testing started, which were in turn finished before validation and verification started. This model of SW engineering derives much from the HW engineering of large systems, and has been the standard methodology used in US government software acquisitions and systems for decades, with highly variable results. US Government SW requirements are built around Waterfall concepts, which assume that the plan will survive contact with reality, or at least that modifications to the plan are relatively small, and relatively few.Because of the inefficiencies and difficulties inherent in Waterfall, the commercial SW world started using a different SW development methodology called Agile more than 20 years ago. Agile believes that a plan should evolve and learn rapidly in response to the realities encountered. At its core, there are a few key elements of Agile:- A small team of people which is highly flexible and adaptive. The team collaborates and interoperates through sophisticated development architectures and release environments- An iterative, incremental development and release approach which is based upon the concept that knowledge comes from experience within the team, and that the team makes decisions based upon what it knows- A team culture which prizes transparency, inspection and adaptation. These values are necessary so that the team experience and decision making is transparent and responsive to the realities encountered during development and testingSo, how to use Agile in a US Government environment? GMSEC (Goddard Mission Services Evolution Center) develops satellite ground system software for NASA and other US Government agencies. The SW developed by the team contains a large code base of many applications used within satellite mission operations centers. It spans the full gamut of SW development types: from SW which is in a classic maintenance and sustainment mode, to new developments with a fairly well understood scope and approach, to new developments whose scope and approach are quite unclear and which require significant research and prototyping. Team members move between all of these different types of SW development. Waterfall was inadequate to the programmatic and technical needs of the team, as well as the various types of SW development being done. The software plan was not surviving contact with the technical and programmatic realities experienced by the team. To address this, the team started a small pilot project in 2016 to test the use of Agile within a small subset of the team for a new web services application. In early 2018, the use of Agile was expanded to the whole team and all the software, but we had to fulfill the NASA SW development requirements. And we needed to do this while still remaining true to the key Agile elements of transparency, inspection and adaption. In order to do this, the team worked very closely with the Software Process Improvement (SPI) team at NASA Goddard, as well as NASA engineering manageme

Beech, Theresa W.↗

A Survey of ISS and Visiting Vehicle Returned Surfaces for Environmental Characterization and Computer Model Development

The Orbital Debris Engineering Model (ORDEM) developed by the NASA Orbital Debris Program Office (ODPO) is a data-driven model — extensive radar, optical, laboratory, and in situ measurement data sets have been used to build the model since its earliest versions. A salient aspect of professional software development is the verification and validation (V&V) process. Verification answers the question “Is the model built correctly?” while validation addresses the question “Did we build the correct model?” Less extensive, reserved, or independent data sets serve the validation requirement. Due to the dynamic nature of the orbital debris environment, it is critical to use contemporaneous data sources that represent the current environment to support ORDEM development and validation. ORDEM has utilized in situ data collected from Space Shuttle and Hubble Space Telescope surface inspections, now over a decade old. This historical dataset is fundamental for providing baseline in situ measurement data for sizes between 10 to 300 microns, but new data sources are being evaluated using returned surfaces from or near the International Space Station (ISS). This paper reviews a general microscopic survey of ISS soft goods, the Pressurized Mating Adapter 2 (PMA-2) blanket, and a limited-scope feasibility study conducted on the Space Exploration Technologies Corporation (SpaceX) Dragon capsule’s Thermal Protection System (TPS) material. The PMA-2 blanket, exposed to the space environment between 09 July 2013 and 25 February 2015, is an approximately 3.7 m2-area blanket composed of a betacloth outer layer and multiple ballistic fabric inner layers. The SpaceX Cargo Dragon capsule regularly visited the ISS from 2012 through 2020 and potentially provides a timely and well-characterized source of data for modeling purposes. The capsule’s lateral surfaces use SpaceX Proprietary Ablative Material (SPAM) TPS material, a syntactic foam, for thermal management during all mission phases. Seven SPAM extracted samples have been analyzed to date. This paper will provide an overview of the characterization completed for impact features by size, depth, impactor diameter, and the impactor residues chemical analyses, allowing a differentiation between micrometeoroids and orbital debris and a categorization by mass density and density class. Impactor diameter is estimated using damage equations generated from ground-based hypervelocity impact testing. The orbital debris impactors are compared to the current ORDEM 3.2 model of the environment at ISS altitudes. We briefly discuss the meteoroid impactors, including constituents and mass densities, in the general context of current models.

Phillip Anz-meador↗

A Survey of ISS and Visiting Vehicle Returned Surfaces for Environmental Characterization and Computer Model Development

The Orbital Debris Engineering Model (ORDEM) developed by the NASA Orbital Debris Program Office (ODPO) is a data-driven model — extensive radar, optical, laboratory, and in situ measurement data sets have been used to build the model since its earliest versions. A salient aspect of professional software development is the verification and validation (V&V) process. Verification answers the question “Is the model built correctly?” while validation addresses the question “Did we build the correct model?” Less extensive, reserved, or independent data sets serve the validation requirement. Due to the dynamic nature of the orbital debris environment, it is critical to use contemporaneous data sources that represent the current environment to support ORDEM development and validation. ORDEM has utilized in situ data collected from Space Shuttle and Hubble Space Telescope surface inspections, now over a decade old. This historical dataset is fundamental for providing baseline in situ measurement data for sizes between 10 to 300 microns, but new data sources are being evaluated using returned surfaces from or near the International Space Station (ISS). This paper reviews a general microscopic survey of ISS soft goods, the Pressurized Mating Adapter 2 (PMA-2) blanket, and a limited-scope feasibility study conducted on the Space Exploration Technologies Corporation (SpaceX) Dragon capsule’s Thermal Protection System (TPS) material. The PMA-2 blanket, exposed to the space environment between 09 July 2013 and 25 February 2015, is an approximately 3.7 m2-area blanket composed of a betacloth outer layer and multiple ballistic fabric inner layers. The SpaceX Cargo Dragon capsule regularly visited the ISS from 2012 through 2020 and potentially provides a timely and well-characterized source of data for modeling purposes. The capsule’s lateral surfaces use SpaceX Proprietary Ablative Material (SPAM) TPS material, a syntactic foam, for thermal management during all mission phases. Seven SPAM extracted samples have been analyzed to date. This paper will provide an overview of the characterization completed for impact features by size, depth, impactor diameter, and the impactor residues chemical analyses, allowing a differentiation between micrometeoroids and orbital debris and a categorization by mass density and density class. Impactor diameter is estimated using damage equations generated from ground-based hypervelocity impact testing. The orbital debris impactors are compared to the current ORDEM 3.2 model of the environment at ISS altitudes. We briefly discuss the meteoroid impactors, including constituents and mass densities, in the general context of current models.

Phillip Anz-Meador↗