Search NASA⌕ Search

SEARCH · Search NASA

Results for “requirements verification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16

Postures and Motions Library Development for Verification of Ground Crew Human Systems Integration Requirements

Spacecraft and launch vehicle ground processing activities require a variety of unique human activities. These activities are being documented in a Primitive motion capture library. The Library will be used by the human factors engineering in the future to infuse real to life human activities into the CAD models to verify ground systems human factors requirements. As the Primitive models are being developed for the library the project has selected several current human factors issues to be addressed for the SLS and Orion launch systems. This paper explains how the Motion Capture of unique ground systems activities are being used to verify the human factors analysis requirements for ground system used to process the STS and Orion vehicles, and how the primitive models will be applied to future spacecraft and launch vehicle processing.

Jackson, Mariea Dunn↗

Verification of Maximal Oxygen Uptake in Active Military Personnel During Treadmill Running

Figueiredo, PS, Looney, DP, Pryor, JL, Doughty, EM, McClung, HL, Vangala, SV, Santee, WR, Beidleman, BA, and Potter, AW. Verification of maximal oxygen uptake in active military personnel during treadmill running. J Strength Cond Res 36(4): 1053–1058, 2022—It is unclear whether verification tests are required to confirm “true” maximal oxygen uptake ($\dot{V}_{o2}$max) in modern warfighter populations. Our study investigated the prevalence of $\dot{V}_{o2}$max attainment in U.S. Army soldiers performing a traditional incremental running test. In addition, we examined the utility of supramaximal verification testing as well as repeated trials for familiarization for accurate $\dot{V}_{o2}$max assessment. Sixteen U.S. Army soldiers (1 woman, 15men; age, 21±2 years; height, 1.73±0.06m; body mass, 71.6±10.1 kg) completed 2 laboratory visits, each with an incremental running test (modified Astrand protocol) and a verification test (110% maximal incremental test speed) on a motorized treadmill. We evaluated $\dot{V}_{o2}$max attainment during incremental testing by testing for the definitive $\dot{V}_{o2}$ plateau using a linear least-squares regression approach. Peak oxygen uptake ($\dot{V}_{o2}$peak) was considered statistically equivalent between tests if the 90% confidence interval around the mean difference was within 62.1 ml·kg -1 ·min -1 . Oxygen uptake plateaus were identified in 14 of 16 volunteers for visit 1 (87.5%) and all 16 volunteers for visit 2 (100%). Peak oxygen uptake was not statistically equivalent, apparent from the mean difference in $\dot{V}_{o2}$peak measures between the incremental test and verification test on visit 1 (2.3 ml·kg -1 ·min -1 , [1.3–3.2]) or visit 2 (1.1 ml·kg -1 ·min -1 [0.2–2.1]). Interestingly, $\dot{V}_{o2}$peak was equivalent, apparent from the mean difference in $\dot{V}_{o2}$peak measures between visits for the incremental tests (0.0ml·kg -1 ·min -1 [-0.8to 0.9]) but not the verification tests (-1.2 ml·kg -1 ·min -1 [-2.2 to -0.2]). Modern U.S. Army soldiers can attain $\dot{V}_{o2}$max by performing a modified Astrand treadmill running test. Additional familiarization and verification tests for confirming $\dot{V}_{o2}$max in healthy active military personnel may be unnecessary.

60 APPLIED LIFE SCIENCES↗

A Tailored Concept of Operations for NASA LSP Integrated Operations

An integral part of the Systems Engineering process is the creation of a Concept of Operations (ConOps) for a given system, with the ConOps initially established early in the system design process and evolved as the system definition and design matures. As Integration Engineers in NASA's Launch Services Program (LSP) at Kennedy Space Center (KSC), our job is to manage the interface requirements for all the robotic space missions that come to our Program for a Launch Service. LSP procures and manages a launch service from one of our many commercial Launch Vehicle Contractors (LVCs) and these commercial companies are then responsible for developing the Interface Control Document (ICD), the verification of the requirements in that document, and all the services pertaining to integrating the spacecraft and launching it into orbit. However, one of the systems engineering tools that have not been employed within LSP to date is a Concept of Operations. The goal of this project is to research the format and content that goes into these various aerospace industry ConOps and tailor the format and content into template form, so the template may be used as an engineering tool for spacecraft integration with future LSP procured launch services.

Systems↗

Tailoring a ConOps for NASA LSP Integrated Operations

An integral part of the Systems Engineering process is the creation of a Concept of Operations (ConOps) for a given system, with the ConOps initially established early in the system design process and evolved as the system definition and design matures. As Integration Engineers in NASA's Launch Services Program (LSP) at Kennedy Space Center (KSC), our job is to manage the interface requirements for all the robotic space missions that come to our Program for a Launch Service. LSP procures and manages a launch service from one of our many commercial Launch Vehicle Contractors (LVCs) and these commercial companies are then responsible for developing the Interface Control Document (ICD), the verification of the requirements in that document, and all the services pertaining to integrating the spacecraft and launching it into orbit. However, one of the systems engineering tools that have not been employed within LSP to date is a Concept of Operations. The goal of this paper is to research the format and content that goes into these various aerospace industry ConOps and tailor the format and content into template form, so the template may be used as an engineering tool for spacecraft integration with future LSP procured launch services. This tailoring effort was performed as the authors final Masters Project in the Spring of 2016 for the Stevens Institute of Technology and modified for publication with INCOSE (Owens, 2016).

Knowledge↗

The role of failure/problems in engineering: A commentary of failures experienced - lessons learned

The written version of a series of seminars given to several aerospace companies and three NASA centers are presented. The results are lessons learned through a study of the problems experienced in 35 years of engineering. The basic conclusion is that the primary cause of problems has not been mission technologies, as important as technology is, but the neglect of basic principles. Undergirding this is the lack of a systems focus from determining requirements through design, verification, and operations phases. Many of the concepts discussed are fundamental to total quality management (TQM) and can be used to augment this product enhanced philosophy. Fourteen principles are addressed with problems experienced and are used as examples. Included is a discussion of the implication of constraints, poorly defined requirements, and schedules. Design guidelines, lessons learned, and future tasks are listed. Two additional sections are included that deal with personal lessons learned and thoughts on future thrusts (TQM).

Ryan, R. S.↗

HDL to verification logic translator

The increasingly higher number of transistors possible in VLSI circuits compounds the difficulty in insuring correct designs. As the number of possible test cases required to exhaustively simulate a circuit design explodes, a better method is required to confirm the absence of design faults. Formal verification methods provide a way to prove, using logic, that a circuit structure correctly implements its specification. Before verification is accepted by VLSI design engineers, the stand alone verification tools that are in use in the research community must be integrated with the CAD tools used by the designers. One problem facing the acceptance of formal verification into circuit design methodology is that the structural circuit descriptions used by the designers are not appropriate for verification work and those required for verification lack some of the features needed for design. We offer a solution to this dilemma: an automatic translation from the designers' HDL models into definitions for the higher-ordered logic (HOL) verification system. The translated definitions become the low level basis of circuit verification which in turn increases the designer's confidence in the correctness of higher level behavioral models.

Gambles, J. W.↗

Space shuttle engineering and operations support. Avionics system engineering

The shuttle avionics integration laboratory (SAIL) requirements for supporting the Spacelab/orbiter avionics verification process are defined. The principal topics are a Spacelab avionics hardware assessment, test operations center/electronic systems test laboratory (TOC/ESL) data processing requirements definition, SAIL (Building 16) payload accommodations study, and projected funding and test scheduling. Because of the complex nature of the Spacelab/orbiter computer systems, the PCM data link, and the high rate digital data system hardware/software relationships, early avionics interface verification is required. The SAIL is a prime candidate test location to accomplish this early avionics verification.

Broome, P. A.↗

A Mode-Shape-Based Fault Detection Methodology for Cantilever Beams

An important goal of NASA's Internal Vehicle Health Management program (IVHM) is to develop and verify methods and technologies for fault detection in critical airframe structures. A particularly promising new technology under development at NASA Langley Research Center is distributed Bragg fiber optic strain sensors. These sensors can be embedded in, for instance, aircraft wings to continuously monitor surface strain during flight. Strain information can then be used in conjunction with well-known vibrational techniques to detect faults due to changes in the wing's physical parameters or to the presence of incipient cracks. To verify the benefits of this technology, the Formal Methods Group at NASA LaRC has proposed the use of formal verification tools such as PVS. The verification process, however, requires knowledge of the physics and mathematics of the vibrational techniques and a clear understanding of the particular fault detection methodology. This report presents a succinct review of the physical principles behind the modeling of vibrating structures such as cantilever beams (the natural model of a wing). It also reviews two different classes of fault detection techniques and proposes a particular detection method for cracks in wings, which is amenable to formal verification. A prototype implementation of these methods using Matlab scripts is also described and is related to the fundamental theoretical concepts.

Tejada, Arturo↗

Structural Verification of the Redesigned Space Shuttle Bipod Foam Closeout

This document outlines the structural verification approach for the Space Shuttle External Tank Forward Bipod Foam Closeout. Due to the Space Shuttle Columbia accident, debris has become a major concern. The intent of the structural verification is to ensure that any debris shed from the bipod is within acceptable limits. Since cohesive failure due to internal defects was identified as the most likely cause of the STS-107 bipod ramp foam failure, verification for this failure mode receives particular emphasis. However, all failure modes for TPS are considered and appropriate verification rationale is developed for each failure mode. Figure 1 depicts the structural verification of a production design where analysis and test are the primary methods of verification. It can be seen that the successful completion of structural verification is dependent on three main areas: 1. Production process control and quality assurance must ensure that test articles and/or analytical models are representative of (or conservatively envelope) production hardware in terms of geometry, materials and processing. Variability and defects must be considered. 2. Flight environments must be sufficiently characterized to bound driving environments for all failure modes. Applied environments, either test or analytical, must be representative of flight environments and have a load factor that satisfies design requirements. 3. Structural verification must include all failure modes. A comprehensive list of failure modes and the underlying failure mechanisms has been generated based on flight and test experience. Verification tests and / or analyses must address each failure mode. ET TPS Verification is accomplished by a combination of analysis, test, and similarity.

Poole, Eric L.↗

Loads and Structural Dynamics Requirements for Spaceflight Hardware

The purpose of this document is to establish requirements relating to the loads and structural dynamics technical discipline for NASA and commercial spaceflight launch vehicle and spacecraft hardware. Requirements are defined for the development of structural design loads and recommendations regarding methodologies and practices for the conduct of load analyses are provided. As such, this document represents an implementation of NASA STD-5002. Requirements are also defined for structural mathematical model development and verification to ensure sufficient accuracy of predicted responses. Finally, requirements for model/data delivery and exchange are specified to facilitate interactions between Launch Vehicle Providers (LVPs), Spacecraft Providers (SCPs), and the NASA Technical Authority (TA) providing insight/oversight and serving in the Independent Verification and Validation role. In addition to the analysis-related requirements described above, a set of requirements are established concerning coupling phenomena or other interaction between structural dynamics and aerodynamic environments or control or propulsion system elements. Such requirements may reasonably be considered structure or control system design criteria, since good engineering practice dictates consideration of and/or elimination of the identified conditions in the development of those subsystems. The requirements are included here, however, to ensure that such considerations are captured in the design space for launch vehicles (LV), spacecraft (SC) and the Launch Abort Vehicle (LAV). The requirements in this document are focused on analyses to be performed to develop data needed to support structural verification. As described in JSC 65828, Structural Design Requirements and Factors of Safety for Spaceflight Hardware, implementation of the structural verification requirements is expected to be described in a Structural Verification Plan (SVP), which should describe the verification of each structural item for the applicable requirements. The requirement for and expected contents of the SVP are defined in JSC 65828. The SVP may also document unique verifications that meet or exceed these requirements with Technical Authority approval.

George James↗

Dynamic verification of very large space structures

The dynamic verification of spacecraft relies heavily on ground-based tests. These tests usually simulate flight environments or validate analytical models used in establishing design loads and in designing control algorithms. They also provide security against failures resulting from unanticipated or unmodeled hardware behavior. Future orbital antennas, space stations, and solar power systems are likely to be of sizes difficult to test using current ground test technology. In addition to size, other factors such as low natural frequencies, lightweight construction, and the presence of many structural joints, cause significant sensitivity of the test process to the earth-gravity environment. Yet, accuracy requirements on the verification process will be more stringent because of modern flexible-structure control approaches. This paper describes some of the problems and discusses research on potential solutions. The importance of an integrated ground test, analysis, and flight test program is emphasized. An ongoing research program of this type focusing on a 60-meter, deployable, truss-beam test article is described.

Hanks, B. R.↗

Using a Large Language Model as a Building Block to Generate Usable Validation and Verification Suite for OpenMP

In the HPC area, both hardware and software move quickly. Often new hardware is developed and deployed, the corresponding software stack, including compilers and other tools, are under active development while leading edge software developers are working to port and tune their applications, all at the same time. While the software ecosystem is in flux, one of the key challenges for users is obtaining insight into the state of implementation of key features in the programming languages and models their applications are using – whether they have been implemented, and whether the implementation conforms to the specification, especially for newly implemented features (less tested by widespread use). OpenMP is one of the most prominent shared memory programming models used for on-node programming in HPC. With the shift towards accelerators (such as GPUs and FPGAs) and heterogeneous programming OpenMP features are getting more complex. It is natural to ask whether generative AI approaches, and large language models (LLMs) in particular, can help in producing validation and verification test suites to allow users better and faster insights into the availability and correctness of OpenMP features of interest. In this work, we explore the use of ChatGPT-4 to generate a suite of tests for OpenMP features. We have chosen a set of directives and clauses, a total of 78 combinations, which first appeared in OpenMP 3.0 (released in May 2008) but are also relevant for accelerators. We prompted ChatGPT to generate tests in the C and Fortran languages, for both host (CPU) and device (accelerator). On the Summit super-computer using the GNU implementation, we found that, of the 78 generated tests 67 C tests and 43 Fortran tests compiled successfully and fewer than those executed to completion. On further analysis we show that not all generated tests are valid. We document the process, results, and provide detailed analysis regarding the quality of tests generated. With the aim of providing input to a production quality validation and verification suite, we manually implement the corrections required to make the tests valid according to the current OpenMP specification. We quantify this effort as small, medium, or large, and record the lines of code changed to correct the invalid tests. With the corrected tests we validate recent implementations from HPE, AMD, and GNU on the Frontier supercomputer. Our experiment and subsequent analysis show that although LLMs are capable of producing HPC specific codes, they are limited by their understanding of the deeper semantics and restrictions of programming models such as OpenMP. Unsurprisingly more commonly used features have better support, while some OpenMP 3.0 directives such as sections and tasking are not universally supported on accelerators. We demonstrate that successful compilation and execution to completion are inadequate metrics for evaluating generated code and that, at this time, commodity LLMs require expert intervention for code verification. This points to gaps in the training data that is currently available for HPC. We demonstrate that with "small" effort 37% of generated invalid C tests and 63% of generated invalid Fortran tests could be corrected. This improves productivity of test generation as we circumvent writing from scratch and the common programming errors associated with it.

Pophale, Swaroop [ORNL] (ORCID:0000000185446367)↗

Space fabrication demonstration system: Executive summary

The results of analysis and tests conducted to define the basic 1-m beam configuration required, and the design, development, fabrication, and verification tests of the machine required to automatically produce these beams are presented.

Source record↗

Shuttle Tethered Aerothermodynamics Research Facility (STARFAC)

The Earth's atmosphere from 90 km to 200 km provides the last aerothermodynamics frontier. Present NASA programs which require but also can provide an understanding of the aerodynamics and aerothermodynamics of the free molecule and transition flows that exist at these altitudes are the Aeroassisted OTV, Entry Research Vehicle and the Tethered Satellite. Each of these programs provides a unique opportunity to do flight research in the rarefied upper atmosphere. However, the Tethered Satellite Program provides, because of its capability to obtain global, in-situ, steady state data, the greatest potential to: (1)define the performance of aerodynamic shapes as a function of environmental characteristics (free molecule, transition, slip flow regimes); (2)define the characteristics of the upper atmosphere and the global variability of properties such as composition temperature, pressure and density. Such data are required to accomplish the systematic development and verification of analytical prediction techniques required to support advance configuration designs.

Siemers, P. M.↗

Observations on CFD Verification and Validation from the AIAA Drag Prediction Workshops

The authors provide observations from the AIAA Drag Prediction Workshops that have spanned over a decade and from a recent validation experiment at NASA Langley. These workshops provide an assessment of the predictive capability of forces and moments, focused on drag, for transonic transports. It is very difficult to manage the consistency of results in a workshop setting to perform verification and validation at the scientific level, but it may be sufficient to assess it at the level of practice. Observations thus far: 1) due to simplifications in the workshop test cases, wind tunnel data are not necessarily the “correct” results that CFD should match, 2) an average of core CFD data are not necessarily a better estimate of the true solution as it is merely an average of other solutions and has many coupled sources of variation, 3) outlier solutions should be investigated and understood, and 4) the DPW series does not have the systematic build up and definition on both the computational and experimental side that is required for detailed verification and validation. Several observations regarding the importance of the grid, effects of physical modeling, benefits of open forums, and guidance for validation experiments are discussed. The increased variation in results when predicting regions of flow separation and increased variation due to interaction effects, e.g., fuselage and horizontal tail, point out the need for validation data sets for these important flow phenomena. Experiences with a recent validation experiment at NASA Langley are included to provide guidance on validation experiments.

Computational Fluid Dynamics↗

Test Cases for a Rectangular Supercritical Wing Undergoing Pitching Oscillations

Steady and unsteady measured pressures for a Rectangular Supercritical Wing (RSW) undergoing pitching oscillations have been presented. From the several hundred compiled data points, 27 static and 36 pitching oscillation cases have been proposed for computational Test Cases to illustrate the trends with Mach number, reduced frequency, and angle of attack. The wing was designed to be a simple configuration for Computational Fluid Dynamics (CFD) comparisons. The wing had an unswept rectangular planform plus a tip of revolution, a panel aspect ratio of 2.0, a twelve per cent thick supercritical airfoil section, and no twist. The model was tested over a wide range of Mach numbers, from 0.27 to 0.90, corresponding to low subsonic flows up to strong transonic flows. The higher Mach numbers are well beyond the design Mach number such as might be required for flutter verification beyond cruise conditions. The pitching oscillations covered a broad range of reduced frequencies. Some early calculations for this wing are given for lifting pressure as calculated from a linear lifting surface program and from a transonic small perturbation program. The unsteady results were given primarily for a mild transonic condition at M = 0.70. For these cases the agreement with the data was only fair, possibly resulting from the omission of viscous effects. Supercritical airfoil sections are known to be sensitive to viscous effects (for example, one case cited). Calculations using a higher level code with the full potential equations have been presented for one of the same cases, and with the Euler equations. The agreement around the leading edge was improved, but overall the agreement was not completely satisfactory. Typically for low-aspect-ratio rectangular wings, transonic shock waves on the wing tend to sweep forward from root to tip such that there are strong three-dimensional effects. It might also be noted that for most of the test, the model was tested with free transition, but a few points were taken with an added transition strip for comparison. Some unpublished results of a rigid wing of the same airfoil and planform that was tested on the pitch and plunge apparatus mount system (PAPA) showed effects of the lower surface transition Strip on flutter at the lower subsonic Mach numbers. Significant effects of a transition strip were also obtained on a wing with a thicker supercritical section on the PAPA mount system. Both of these flutter tests on the PAPA resulted in very low reduced frequencies that may be a factor in this influence of the transition strip. However, these results indicate that correlation studies for RSW may require some attention to the estimation of transition location to accurately treat viscous effects. In this report several Test Cases are selected to illustrate trends for a variety of different conditions with emphasis on transonic flow effects. An overview of the model and tests is given and the standard formulary for these data is listed. Sample data points are presented in both tabular and graphical form. A complete tabulation and plotting of all the Test Cases is given. Only the static pressures and the real and imaginary parts of the first harmonic of the unsteady pressures are available. All the data for the test are available in electronic file form. The Test Cases are also available as separate electronic files.

Bennett, Robert M.↗

Improved Verification for Aerospace Systems

Aerospace systems are subject to many stringent performance requirements to be verified with low risk. This report investigates verification planning using conditional approaches vice the standard classical statistical methods, and usage of historical surrogate data for requirement validation and in verification planning. The example used in this report to illustrate the results of these investigations is a proposed mission assurance requirement with the concomitant maximum acceptable verification risk for the NASA Constellation Program Orion Launch Abort System (LAS). This report demonstrates the following improvements: 1) verification planning using conditional approaches vice classical statistical methods results in plans that are more achievable and feasible; 2) historical surrogate data can be used to bound validation of performance requirements; and, 3) incorporation of historical surrogate data in verification planning using conditional approaches produces even less costly and more reasonable verification plans. The procedures presented in this report may produce similar improvements and cost savings in verification for any stringent performance requirement for an aerospace system.

Powell, Mark A.↗

Characterization of Carbon Dioxide Washout Measurement Techniques in the Mark-III Space Suit

Providing adequate carbon dioxide (CO2) washout is essential to the reduction of risk in performing suited operations. Long term CO2 exposure can lead to symptoms such as headache, lethargy, dizziness, and in severe cases can lead to unconsciousness and death. Thus maintaining adequate CO2 washout in both ground testing and during in flight EVAs is a requirement of current and future suit designs. It is necessary to understand the inspired CO2 of suit wearers such that future requirements for space suits appropriately address the risk of inadequate washout. Testing conducted by the EVA Physiology Laboratory at the NASA Johnson Space Center aimed to characterize a method for noninvasively measuring inspired oronasal CO2 under pressurized suited conditions in order to better inform requirements definition and verification techniques for future CO2 washout limits in space suits. Prior work conducted by the EPL examined several different wearable, respirator style, masks that could be used to sample air from the vicinity surround the nose and mouth of a suited test subject. Previously published studies utilized these masks, some being commercial products and some novel designs, to monitor CO2 under various exercise and flow conditions with mixed results for repeatability and/or consistency between subjects. Based on a meta-analysis of those studies it was decided to test a nasal cannula as it is a commercially available device that is placed directly in the flow path of the user as they breathe. A nasal cannula was used to sample air inhaled by the test subjects during both rest and exercise conditions. Eight subjects were tasked with walking on a treadmill or operating an arm ergometer to reach target metabolic rates of 1000, 2000, and 3000 BTU/hr. Suit pressure was maintained at 4.3 psid for all tests, with supply flow rates of 6, 4, and 2 actual cubic feet per minute depending on the test condition. Each test configuration was conducted twice with subjects breathing either through their nose only, or however they felt comfortable. By restricting breathing through a single orifice, we are able to more accurately define exactly what flow stream the sampled CO2 is taken from. Oronasal CO2 was monitored using real time infrared gas analyzers fed via sample tubes connected to the nasal cannula within the suit. Two additional sampling tubes were placed at the head and chin of the test subject, in an effort to capture CO2 concentrations across the entire flow stream of the Mark-III vent system (flow path is head to neck). Metabolic rate was calculated via the exhaust CO2 concentration and used to adjust subject workload on either the treadmill or arm ergometer until the target was reached. Forward work will aim to characterize the historically accepted minimum ppCO2 in suit during EVA by repeating this study in the Extravehicular Mobility Unit (EMU) space suit. This will help to define washout requirements for future suits, be they NASA (e.g. Z-2) or Commercial Crew designed. Additionally it is important to determine the functional consequences of CO2 exposure during EVA. Severe CO2 symptoms are a result of very high concentration, acute exposures. While long term, low concentration exposures have been shown to result in slight cognitive decline, symptoms resolve upon quickly returning to nominal concentrations and it remains unknown the impact that minor deficits in cognitive performance can have on EVA performance.

Norcross, J.↗