Search NASA⌕ Search

SEARCH · Search NASA

Results for “System Level Verification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15

Board Level Proton Testing Book of Knowledge for NASA Electronic Parts and Packaging Program

This book of knowledge (BoK) provides a critical review of the benefits and difficulties associated with using proton irradiation as a means of exploring the radiation hardness of commercial-off-the-shelf (COTS) systems. This work was developed for the NASA Electronic Parts and Packaging (NEPP) Board Level Testing for the COTS task. The fundamental findings of this BoK are the following. The board-level test method can reduce the worst case estimate for a board's single-event effect (SEE) sensitivity compared to the case of no test data, but only by a factor of ten. The estimated worst case rate of failure for untested boards is about 0.1 SEE/board-day. By employing the use of protons with energies near or above 200 MeV, this rate can be safely reduced to 0.01 SEE/board-day, with only those SEEs with deep charge collection mechanisms rising this high. For general SEEs, such as static random-access memory (SRAM) upsets, single-event transients (SETs), single-event gate ruptures (SEGRs), and similar cases where the relevant charge collection depth is less than 10 μm, the worst case rate for SEE is below 0.001 SEE/board-day. Note that these bounds assume that no SEEs are observed during testing. When SEEs are observed during testing, the board-level test method can establish a reliable event rate in some orbits, though all established rates will be at or above 0.001 SEE/board-day. The board-level test approach we explore has picked up support as a radiation hardness assurance technique over the last twenty years. The approach originally was used to provide a very limited verification of the suitability of low cost assemblies to be used in the very benign environment of the International Space Station (ISS), in limited reliability applications. Recently the method has been gaining popularity as a way to establish a minimum level of SEE performance of systems that require somewhat higher reliability performance than previous applications. This sort of application of the method suggests a critical analysis of the method is in order. This is also of current consideration because the primary facility used for this type of work, the Indiana University Cyclotron Facility (IUCF) (also known as the Integrated Science and Technology (ISAT) hall), has closed permanently, and the future selection of alternate test facilities is critically important. This document reviews the main theoretical work on proton testing of assemblies over the last twenty years. It augments this with review of reported data generated from the method and other data that applies to the limitations of the proton board-level test approach. When protons are incident on a system for test they can produce spallation reactions. From these reactions, secondary particles with linear energy transfers (LETs) significantly higher than the incident protons can be produced. These secondary particles, together with the protons, can simulate a subset of the space environment for particles capable of inducing single event effects (SEEs). The proton board-level test approach has been used to bound SEE rates, establishing a maximum possible SEE rate that a test article may exhibit in space. This bound is not particularly useful in many cases because the bound is quite loose. We discuss the established limit that the proton board-level test approach leaves us with. The remaining possible SEE rates may be as high as one per ten years for most devices. The situation is actually more problematic for many SEE types with deep charge collection. In cases with these SEEs, the limits set by the proton board-level test can be on the order of one per 100 days. Because of the limited nature of the bounds established by proton testing alone, it is possible that tested devices will have actual SEE sensitivity that is very low (e.g., fewer than one event in 1 × 10(exp 4) years), but the test method will only be able to establish the limits indicated above. This BoK further examines other benefits of proton board-level testing besides hardness assurance. The primary alternate use is the injection of errors. Error injection, or fault injection, is something that is often done in a simulation environment. But the proton beam has the benefit of injecting the majority of actual SEEs without risk of something being missed, and without the risk of simulation artifacts misleading the SEE investigation.

Guertin, Steven M.↗

Ka-band Phase Measurement System for SWOT Mission

The KaRIn (Ka-band radar interferometer) instrument for SWOT (surface water ocean topography) mission faces unique challenges in terms of phase stability and group delay stability requirements to achieve centimeter level accuracy for height measurements. Conventional altimetry assumes nadir point return and measures a single range. SWOT will require additional angle of arrival information to provide swath coverage. Errors in differential phase and common group delay can both act as primary sources of systematic errors in determining the height using interferometric data. The ground support equipment (GSE) necessary for the performance requirements verification gets a fraction of the error allocation from the instrument. A phase measurement system capable of measuring millidegrees and working with pulsed excitation is developed and the preliminary results are described in this paper.

Esteban-Fernandez, Daniel↗

Laser Metrology in the Micro-Arcsecond Metrology Testbed

The Space Interferometer Mission (SIM), scheduled for launch in 2009, is a space-born visible light stellar interferometer capable of micro-arcsecond-level astrometry. The Micro-Arcsecond Metrology testbed (MAM) is the ground-based testbed that incorporates all the functionalities of SIM minus the telescope, for mission-enabling technology development and verification. MAM employs a laser heterodyne metrology system using the Sub-Aperture Vertex-to-Vertex (SAVV) concept. In this paper, we describe the development and modification of the SAVV metrology launchers and the metrology instrument electronics, precision alignments and pointing control, locating cyclic error sources in the MAM testbed and methods to mitigate the cyclic errors, as well as the performance under the MAM performance metrics.

interferometry↗

Europa Clipper Payload Verification and Validation: Test and Analysis Program Design

NASA’s Europa Clipper mission – which is planned to launch in the mid-2020s – is designed to investigate the habitability of the jovian moon Europa with a state-of-the-art suite of over 10 sensors and instruments. Now past its project critical design review, Europa Clipper is starting the execution of its verification and validation (V&V) program. The payload V&V function in particular is responsible for designing and coordinating a thorough test and analysis program that will confirm the proper functioning and performance of our payload instruments. Given the large number of instruments to manage, we have developed a suite of standardized tests and analyses that are designed to cover all of the common interfaces across instruments, while allowing for flexibility to support the unique needs of individual instruments. This suite of activities, coordinated and/or performed by the payload team, forms the bulk of our payload verification and validation campaign. This paper provides a detailed summary of the full set of V&V activities in that suite, covering the four categories of activities: analysis of lower-level evidence, analysis via simulation, testing in the system testbeds, and testing in assembly, test, and launch operations (ATLO). We will describe the purpose of each activity type, how the activities are developed, and the review process for each type of activity. We then define the complete list of activities written for each instrument and how subtleties specific to certain instruments are managed. The discussion will provide a comprehensive understanding of the activities in the payload V&V purview and how various interfaces with different levels of the project are managed. This paper also describes key metrics the payload team uses to track V&V progress and some insights into the teaming design and division of labor we use to ensure consistency and completeness across the entire payload suite. Finally, the paper will offer a snapshot of the status of the Payload V&V program prior to instrument delivery and offer insights into the upcoming phase of instrument delivery and the start of ATLO.

Lee, Dennis↗

Mission Operations and Command Assurance: Automating an Operations TQM Task

A long-term program is in progress at JPL to reduce cost and risk of mission operations through defect prevention and error management. A major element of this program, Mission Operations and Command Assurance (MO&QA), provides a system level function on flight projects to instill quality in mission operations. MO&CA embodies the Total Quality Management (TQM) principle of Continuous Process Inprovement (CPI) and uses CPI in applying automation to mission operations to reduce risk and costs. MO&CA has led efforts to apply and has implemented automation in areas that impact the daily flight project environment including Incident Surprise Anomoly tracking and reporting; command data verification, tracking, and reporting; and command support data usage. MO&CA's future work in automation will take into account that future missions systems must be designed to avoid increasing error through the introduction of automation, while adapting to the demands of smaller flight teams.

automation↗

Verification Testing and Veg-05 Tomato Crop Production on the International Space Station

Production of fresh, nutritious, and tasty produce for astronauts during spaceflight may provide health-promoting, bioavailable nutrients and enhance the dietary experience as we move into longer-duration missions. Growing and caring for plants may also reduce the psychological stresses associated with spaceflight and enhance connections to Earth. Requirements to consistently grow a diversity of crops under spaceflight environmental conditions remain poorly defined. The VEG-05 experiment is part of a series of experiments with pick-and-eat salad crops to better define best practices for crop production and handling in space. VEG-05 and predecessor experiments VEG-04A and VEG-04B, use the Veggie vegetable production facilities on the International Space Station to grow salad crops under different spectral compositions. In VEG-04A and B, mizuna mustard was cultivated with two different red: blue light treatments, and in VEG-05 we are cultivating ‘Red Robin’ dwarf cherry tomatoes under the same light spectra. Light can impact the growth habit, yield, nutritional composition, microbial levels, and even flavor attributes within crops, and our team will assess these characteristics for this crop during VEG-05. Prior to launch and installation on ISS in late 2022, both a science verification test (SVT), and an experiment verification test (EVT) were conducted at Kennedy Space Center in ISS Environment Simulator Chambers. Science verification testing, and a previous fertilizer test, grew plants in both plant pillows and PONDS (Passive Orbital Nutrient Delivery System) units and tested two different fertilizer treatments in both sets of hardware, with each test under only one of the light conditions. Because of challenges validating the PONDS hardware on ISS, and with good crop production in plant pillows, the EVT moved forward using only plant pillows with the highest fertilizer composition tested during SVT, and two Veggie units were utilized. One Veggie had light settings consisting of equal levels of red: blue light (150 µmol/m2/s for each color) plus green light (30 µmol/m2/s) while the second Veggie had a 90:10 ratio of red: blue light (270 µmol/m2/s red and 30 µmol/m2/s blue) plus green, so each unit provided 330 µmol/m2/s of photosynthetically active radiation to the tomato crops on average. Our original plan, based on prior ground testing, was to grow the crop for 104 days and harvest at 80, 90 and 104 days after initiation. For SVT, under the equal red: blue light treatment, fruit ripening in plant pillows was delayed and fruit were not ripe by day 80, so actual harvest days were days 90, 97, and 104. For EVT we saw fruit ripening earlier, especially in the high red treatment, and so we harvested at days 83, 90, and 99 days after initiation. In SVT we had mostly daily watering, and this led to excess water in plant pillows, which leaked out. This excess water also caused fungus to grow on one leaf and a couple of plant stems. To reduce this excess moisture, we throttled back the watering for EVT, and used the root mat reservoir more frequently. This led to watering only every other day, reducing crew time needed for plant care, however, two wilting events occurred during this EVT, at days 51 and 75. Plants recovered from these wilting events, but these events may have influenced the rate of fruit ripening and flower formation. Regardless, more than 10 fruit were produced from each plant on average, with the high red treatment producing slightly heavier fruit. Microbial testing from fruit during SVT indicated that fruit were safe for consumption with microbial levels below detection limits. VEG-05 flight and ground operations are expected to run between December 2022 and March 2023. This research was co-funded by the Human Research Program and Space Biology (MTL#1075) in the ILSRA 2015 NRA call.

Gioia D. Massa↗

Large area sheet task: Advanced Dendritic Web Growth Development

A melt level control system was implemented to provide stepless silicon feed rates from zero to rates exactly matching the silicon consumed during web growth. Bench tests of the unit were successfully completed and the system mounted in a web furnace for operational verification. Tests of long term temperature drift correction techniques were made; web width monitoring seems most appropriate for feedback purposes. A system to program the initiation of the web growth cycle was successfully tested. A low cost temperature controller was tested which functions as well as units four times as expensive.

Duncan, C. S.↗

Dynamic Radioisotope Power Systems Development Status and Path to Flight

Dynamic power conversion offers the potential to produce Radioisotope Power Systems (RPS) that generate higher power outputs and utilize the Pu-238 radioisotope more efficiently. Additionally, dynamic power conversion offers the potential of producing generators with minimal degradation resulting in more power at the end of the mission, when the power is needed. Dynamic power conversion technologies being developed for space applications include the Stirling and Brayton thermodynamic cycle machines. Machines can be built based on these cycles while eliminating wear mechanisms of the moving components, enabling long design life necessary for space missions. The Dynamic Radioisotope Power Systems (DRPS) project at NASA Glenn Research Center (Glenn Research Center) is pursuing the realization of this type of power source on a flight mission. The project currently has three convertor development contracts that will deliver prototype hardware in 2020. This hardware will undergo a gamut of experimental performance verification efforts at NASA GRC. In parallel, the project has also initiated generator design efforts based on these underlying convertor options, and is also on track to build an in-house version of a generator for laboratory system-level testing. The project is also funding control electronics technology, which are necessary to convert alternating current from the dynamic devices to direct current for use by a spacecraft. A lunar mission is being targeted as the first use of this new technology, as DRPS enables a wide range of high-return scientific missions on the moon, while the mission being short in duration (2 years rather than 10 years for an outer planets mission).

Salvatore M Oriti↗

Dynamic Radioisotope Power Systems Status and Path to Flight

Dynamic power conversion offers the potential to produce Radioisotope Power Systems (RPS) that generate higher power outputs and utilize the Pu-238 radioisotope more efficiently. Additionally, dynamic power conversion offers the potential of producing generators with minimal degradation resulting in more power at the end of the mission, when the power is needed. Dynamic power conversion technologies being developed for space applications include the Stirling and Brayton thermodynamic cycle machines. Machines can be built based on these cycles while eliminating wear mechanisms of the moving components, enabling long design life necessary for space missions. The Dynamic Radioisotope Power Systems (DRPS) project at NASA Glenn Research Center (Glenn Research Center) is pursuing the realization of this type of power source on a flight mission. The project currently has three convertor development contracts that will deliver prototype hardware in 2020. This hardware will undergo a gamut of experimental performance verification efforts at NASA GRC. In parallel, the project has also initiated generator design efforts based on these underlying convertor options, and is also on track to build an in-house version of a generator for laboratory system-level testing. The project is also funding control electronics technology, which are necessary to convert alternating current from the dynamic devices to direct current for use by a spacecraft. A lunar mission is being targeted as the first use of this new technology, as DRPS enables a wide range of high-return scientific missions on the moon, while the mission being short in duration (2 years rather than 10 years for an outer planets mission).

Salvatore Oriti↗

String Potentiometers for Supersonic Split-Line Thrust Vector Amplification Factor Verification

The static fire of NASA’s Mars Ascent Vehicle (MAV) first stage Solid Rocket Motor (SRM1) Demonstration Motor-1 (DM-1) occurred at Edwards Air Force Base (AFB) on April 7, 2023. Among other objectives, this test successfully demonstrated the Thrust Vector Control (TVC) system, including the Technology Readiness Level (TRL) of the Supersonic Split-Line (SSSL) nozzle. An essential characteristic of the SSSL is the thrust vector amplification factor (TVAF) it exhibits; however, empirically quantifying this behavior is difficult due to the limitations of measuring the internal nozzle gas dynamics of a Solid Rocket Motor (SRM) during burn. Using four string potentiometers mounted inside the test chamber connected to the nozzle and motor case and a thrust measurement system (TMS), the TVAF can be derived from the known nozzle and motor geometry. Increasing the accuracy of the TVAF is essential for certain groups working on the MAV including the Guidance, Navigation, and Control (GN&C) group, who prior to DM-1, solely relied on Computational Fluid Dynamics (CFD) data in their Monte Carlo simulations for TVAF. The methodology shown in this paper can be generally applied to any test article implementing a SSSL nozzle, presuming string potentiometers are a viable option and the facility is conducive of their implementation.

Supersonic Split-Line↗

Mission operations and command assurance - Automating an operations TQM task

A long-term program is in progress at JPL to reduce cost and risk of mission operations through defect prevention and error management. A major element of this program, Mission Operations and Command Assurance (MO&CA), provides a system level function on flight projects to instill quality in mission operations. MO&CA embodies the total quality management TQM principle of continuous process improvement (CPI) and uses CPI in applying automation to mission operations to reduce risk and costs. MO&CA has led efforts to apply and has implemented automation in areas that impact the daily flight project work environment including Incident Surprise Anomaly tracking and reporting; command data verification, tracking and reporting; and command support data usage. MO&CA's future work in automation will take into account that future mission operations systems must be designed to avoid increasing error through the introduction of automation, while adapting to the demands of smaller flight teams.

Welz, Linda↗

Hierarchical specification of the SIFT fault tolerant flight control system

The specification and mechanical verification of the Software Implemented Fault Tolerance (SIFT) flight control system is described. The methodology employed in the verification effort is discussed, and a description of the hierarchical models of the SIFT system is given. To meet the objective of NASA for the reliability of safety critical flight control systems, the SIFT computer must achieve a reliability well beyond the levels at which reliability can be actually measured. The methodology employed to demonstrate rigorously that the SIFT computer meets as reliability requirements is described. The hierarchy of design specifications from very abstract descriptions of system function down to the actual implementation is explained. The most abstract design specifications can be used to verify that the system functions correctly and with the desired reliability since almost all details of the realization were abstracted out. A succession of lower level models refine these specifications to the level of the actual implementation, and can be used to demonstrate that the implementation has the properties claimed of the abstract design specifications.

Melliar-Smith, P. M.↗

Verification and Validation in a Rapid Software Development Process

The high cost of software production is driving development organizations to adopt more automated design and analysis methods such as rapid prototyping, computer-aided software engineering (CASE) tools, and high-level code generators. Even developers of safety-critical software system have adopted many of these new methods while striving to achieve high levels Of quality and reliability. While these new methods may enhance productivity and quality in many cases, we examine some of the risks involved in the use of new methods in safety-critical contexts. We examine a case study involving the use of a CASE tool that automatically generates code from high-level system designs. We show that while high-level testing on the system structure is highly desirable, significant risks exist in the automatically generated code and in re-validating releases of the generated code after subsequent design changes. We identify these risks and suggest process improvements that retain the advantages of rapid, automated development methods within the quality and reliability contexts of safety-critical projects.

Callahan, John R.↗

Internal Versus External DSLs for Trace Analysis: Extended Abstract

This tutorial explores the design and implementation issues arising in the development of domain-specific languages for trace analysis. It introduces the audience to the general concepts underlying such special-purpose languages building upon the authors' own experiences in developing both external domain specific languages and systems, such as EAGLE, HAWK, RULER and LOGSCOPE, and the more recent internal domain-specific language and system TRACECONTRACT within the SCALA language.

domain specific language (DSL)↗

System Validation on the Europa Clipper mission in Early Implementation Phase

NASA’s next flag-ship mission - Europa Clipper, will embark on a journey to Jupiter’s icy moon Europa in 2024 to assess its environment and habitability with a highly capable spacecraft. Post Jupiter-Orbit-Insertion, the spacecraft will be commanded to perform intricate, yet meticulously planned Europa flybys to perform science investigations using a suite of instruments, while withstanding Jupiter’s harsh radiation environment. The success of this mission is dependent on a well-coordinated project and its elements such as the flight hardware and software, the ground support and mission operations teams, procedures and other cross-cutting elements. The Europa Clipper project needs to ensure that these elements are realized at a reasonable confidence level prior to launch and other mission critical events. System Validation test and analysis activities exercise and confirm the integrity of the system of all project elements in the expected flight environment with reasonable stressing conditions. These activities go beyond system design requirements verification and are driven by validation objectives that describe the end-to-end functional and operational capabilities required during nominal and off-nominal flight-like scenarios and critical events. The challenges associated with validating that the Europa Clipper project as a whole can function and perform correctly to meet the intended mission objectives with the as-delivered capabilities of all of its elements are daunting. This paper discusses the systematic methodology established in the early implementation phase of the Europa Clipper project for developing System Validation activities and their validation objectives, and addressing any validation-related challenges on the project. Approaches include decomposition of mission objectives using activity timelines in the Mission Design plan for developing nominal scenarios, use of fault trees for exploring off-nominal cases and system boundaries, and use of Model-based Systems Engineering (MBSE) tools for planning and prioritizing these activities.

Wang, Xu↗

Rapid Cycle Amine 4.0 System Development

Carbon dioxide (CO2) and humidity control is a key function of the spacesuit Portable Life Support Subsystem (PLSS). The latest spacesuit design utilizes a pressure swing bed containing a solid amine sorbent to scrub CO2 and humidity produced by the crewmember from the ventilation loop. The solid amine sorbent removes CO2 and humidity from the ventilation loop through a chemisorption mechanism. Simultaneously, CO2 and humidity are desorbed to vacuum via the two-bed pressure swing system during operation. This continuous regeneration allows for longer Extravehicular Activity (EVA) times while minimizing maintenance, consumables, and power usage. This concept has been in development for over 20 years, during which many prototypes and design iterations have been fabricated and evaluated. This paper discusses the recent Rapid Cycle Amine (RCA) design, development, and testing that has been done to advance the technology. The most recent fabrication is the RCA 3.0. It was delivered to NASA Johnson Space Center in 2015 and has since been tested at the component level and at the integrated PLSS level. The purpose of the component level testing was to understand CO2 removal capacity, end-of-life performance, and establish a baseline performance prior to integrated testing. The RCA 3.0 was integrated into the Exploration Extravehicular Mobility Unit (xEMU) PLSS for a comprehensive Design Verification Test (DVT) series. The integrated testing provided the benefit of characterizing the impact performance degradation has on the system. Many of the RCA requirements were developed through analysis, based on the limitations of the PLSS and, in some cases, assumptions about the system and flow behavior. Integrated testing was an opportunity to validate those requirements and assumptions. While the RCA 3.0 was being tested, the next design iteration, RCA 4.0, was under development. The RCA 4.0 preliminary design phase began in late-2019 and shortly after the Preliminary Design Review, the critical design phase began in 2021. The design work has concluded with the completion of a Pre-Manufacturing Review in 2022. This paper provides an overview of the RCA 4.0 system design, summarizes the results of integrated RCA 3.0 testing, and discusses the pertinence of driving requirements such as mass, volume, and power consumption.

Kelsey Bloom↗

Large area mapping of soil moisture using the ESTAR passive microwave radiometer

Investigations designed to study land surface hydrologic-atmospheric interactions, showing the potential of L band passive microwave radiometry for measuring surface soil moisture over large areas, are discussed. Satisfying the data needs of these investigations requires the ability to map large areas rapidly. With aircraft systems this means a need for more beam positions over a wider swath on each flightline. For satellite systems the essential problem is resolution. Both of these needs are currently being addressed through the development and verification of Electronically Scanned Thinned Array Radiometer (ESTAR) technology. The ESTAR L band radiometer was evaluated for soil moisture mapping applications in two studies. The first was conducted over the semiarid rangeland Walnut Gulch watershed located in south eastern Arizona (U.S.). The second was performed in the subhumid Little Washita watershed in south west Oklahoma (U.S.). Both tests showed that the ESTAR is capable of providing soil moisture with the same level of accuracy as existing systems.

Jackson, T. J.↗

COFS 2: 3-D dynamics and controls technology

The Control of Flexible Structures (COFS) 2 project is a complex and ambitious undertaking which will address several critical technology areas. Among them are modeling, structural dynamics, controls, and ground testing issues which are not only germane to this effort, but to other large space structure programs being contemplated. This effort requires the early integration of controls and structural dynamics considerations in order to achieve mission success. Several technology advances must be achieved in the areas of system modelling, control synthesis and methodology, sensor/actuator development, and ground testing techniques for system evaluation and on-orbit performance prediction and verification. This project offers a unique opportunity for the integration of several disciplines to produce technology advances which will benefit many future programs. In addition, the opportunities available to participate in the various levels in the phase of this project, e.g., analytical development and modelling, ground testing, and flight testing, permit for the involvement of a significant number of interested researchers and organizations from government, universities and industry.

Pyle, Jon S.↗