Search NASA⌕ Search

SEARCH · Search NASA

Results for “FLEET TEST AND EVALUATION”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Transport Canada aging aircraft activities

A description is given of recent initiatives undertaken in Canada to address the problems of aging passenger airplanes. In addition to participation in and support of U.S. aging aircraft programs, independent activities were undertaken in such areas as regulatory control of nondestructive testing, aging fleet evaluations, and measures to address the airworthiness of aging Canadian-manufactured airplanes.

Civil aviation↗

Fleet retrofit report

Flight tests are evaluated of an avionics system which aids the pilot in making two-segment approaches for noise abatement. The implications are discussed of equipping United's fleet of Boeing 727-200 aircraft with two-segment avionics for use down to Category 2 weather operating minima. The experience is reported of incorporating two-segment approach avionics systems on two different aircraft. The cost of installing dual two-segment approach systems is estimated to be $37,015 per aircraft, including parts, labor, and spares. This is based on the assumption that incremental out-of-service and training costs could be minimized by incorporating the system at airframe overhaul cycle and including training in regular recurrent training. Accelerating the modification schedule could add up to 50 percent to the modification costs. Recurring costs of maintenance of the installation are estimated to be of about the same magnitude as the potential recurrent financial benefits due to fuel savings.

Source record↗

Bootstrapping Multi-Agent Unmanned Aerial Vehicle (UAV) System Integration Using Ground-Based Assets: Lessons Learned

The highly dynamic nature of UAVs imposes significant challenges when conducting initial testing ranging from safety risks posed by high-capacity lithium batteries and spinning propellers to rigorous timing demands on controllers and the consequences of failures mid-air. Flight testing of a single vehicle is time and labor intensive due to these challenges and more, and the complexity increases exponentially with the number of vehicles. While simulations and hardware-in-the-loop bench testing can provide adequate environments for preliminary validation, differences in system deployment architecture, software interfaces, and hardware infrastructure between simulation and a fleet of real UAVs create a sizable gap that must be navigated carefully during system integration. In support of the Autonomy Teaming and TRAjectories for Complex Trusted Operational Reliability (ATTRACTOR) project, which had the goal of establishing a basis of certification of trust and trustworthiness in multi-agent autonomous systems, this gap was tackled from two directions. First, a novel mixed-reality simulation environment was engineered to blur the transition from simulation to flight hardware. Second, a fleet of Unmanned Surface Vehicles (USVs) was developed as a test and evaluation platform that more closely represented the final aerial fleet while eliminating many of the risks associated with air vehicles. This paper delves into the second element, analyzing the efficacy of the USV platform in performing system integration testing for the UAV system. In this paper we present the USV fleet and its role in reducing the aforementioned gaps in deployment architecture, software interfaces, and hardware infrastructure when moving from simulation to flight. An overview of the hardware and software onboard the vehicles will be provided along with supporting infrastructure. The system integration process will be documented including results in supporting both the overarching design reference mission (DRM) of ATTRACTOR and individual research efforts conducted during the project. Finally, we will discuss some of the practical lessons learned regarding the testing, deployment, and operation of multi-agent autonomous systems.

Matthew P Vaughan↗

Bootstrapping Multi-Agent Unmanned Aerial Vehicle (UAV) System Integration Using Ground-Based Assets: Lessons Learned

In support of the Autonomy Teaming and TRAjectories for Complex Trusted Operational Reliability (ATTRACTOR) project, a fleet of unmanned ground vehicles (UGVs) was developed as a test and evaluation (T\&E) platform to reduce system integration gaps between simulation and live flight hardware. While simulation and hardware-in-the-loop bench testing provide adequate environments for preliminary validation, differences in system deployment architecture, software interfaces, and hardware infrastructure increase the risks to safety, property, and the project. Given ATTRACTOR’s goal of establishing a basis of certification of trust and trustworthiness in multi-agent autonomous systems, bridging these gaps was critical to successful project execution and feasibility assessment. In this paper we present the UGV fleet and its role in speeding up system integration, smoothing the transition from simulation to flight, and providing researchers an easy-to-use hardware test bed. An overview of the hardware and software on-board the vehicles is provided along with supporting infrastructure. The system integration process is documented including results in supporting both the overarching design reference mission (DRM) of ATTRACTOR and individual research efforts conducted since the creation of the fleet. Finally, we discuss the practical lessons learned regarding the testing, deployment, and operation of multi-agent autonomous systems.

Matthew P. Vaughan↗

Qualitative Data Coding of User Experience with an Urban Air Mobility Fleet Manager Interface

The NASA Aeronautics Research Mission Directorate created the High Density Vertiplex (HDV) project to integrate and evaluate a prototype Urban Air Mobility (UAM) ecosystem. Part of the HDV testing environment included a prototype operator user interface called the Fleet Manager Interface (FMI). In 2023, HDV conducted flight testing with the FMI during which a user experience (UX) study was performed to assess the quality of UX and elicit design recommendations. As a result, a large database of open-ended, qualitative responses was generated and then coded using a new qualitative data coding technique called Directive String Coding, which used a blended coding approach to generate actionable heuristics that stakeholders (e.g., researchers, UI designers, software developers) could use to answer specific research questions and make future design decisions. The key themes that arose from the coded responses showed that the UX was pleasant, system notifications should be more salient, and information across multiple screens should be integrated into a central display. As the Fleet Manger operational role is still being defined, it is vital to increase our understanding of the tools and capabilities needed for such a role. The results from HDV work will eventually feed into standards for vertiport operations that will enable safe and scalable UAM operations in the United States.

high density vertiplex↗

Qualitative Data Coding of User Experience with an Urban Air Mobility Fleet Manager Interface

The NASA Aeronautics Research Mission Directorate created the High Density Vertiplex (HDV) project to integrate and evaluate a prototype Urban Air Mobility (UAM) ecosystem. Part of the HDV testing environment included a prototype operator user interface called the Fleet Manager Interface (FMI). In 2023, HDV conducted flight testing with the FMI during which a user experience (UX) study was performed to assess the quality of UX and elicit design recommendations. As a result, a large database of open-ended, qualitative responses was generated and then coded using a new qualitative data coding technique called Directive String Coding, which used a blended coding approach to generate actionable heuristics that stakeholders (e.g., researchers, UI designers, software developers) could use to answer specific research questions and make future design decisions. The key themes that arose from the coded responses showed that the UX was pleasant, system notifications should be more salient, and information across multiple screens should be integrated into a central display. As the Fleet Manger operational role is still being defined, it is vital to increase our understanding of the tools and capabilities needed for such a role. The results from HDV work will eventually feed into standards for vertiport operations that will enable safe and scalable UAM operations in the United States.

high density veriplex↗

Wake Velocimetry of a Sphere-Cone Model in a Mach 10 Air Freestream using FLEET

Velocity measurements in the wake behind a sphere-cone-shaped vehicle wind tunnel model in a Mach 10 hypersonic air flow using femtosecond laser electronic excitation tagging (FLEET) are reported in this work. The FLEET measurements were performed at 1 kHz using a femtosecond laser centered at 800 nm and an ultrahigh-speed intensified camera system. The results reported here are for a single freestream condition corresponding to approximately Re ∞ /L = 3.6∙10 6 m -1 . The performance of the velocimetry instrument was evaluated in the quiescent test section at conditions relevant to the wake measurements. For velocity measurements in the wake, the FLEET measurement volume was translated to several radial locations from the model centerline in the vertical direction and at a streamwise location corresponding to approximately 12 mm from the payload. Reverse flow with mean velocities ranging from -12 m/s to -48 m/s were observed in the recirculating region of the wake, whereas hypersonic velocities in the range of 1079 m/s to 1183 m/s were observed in the free shear layer. A velocity uncertainty methodology is also outlined and applied for the reported measurements. The velocity data reported in this work is expected to play a significant role in the validation of computational codes modeling the hard-to-predict separated hypersonic wake.

FLEET↗

Wake Velocimetry of a Sphere-Cone Model in a Mach 10 Air Freestream using FLEET

Velocity measurements in the wake behind a sphere-cone-shaped vehicle wind tunnel model in a Mach 10 hypersonic air flow using femtosecond laser electronic excitation tagging (FLEET) are reported in this work. The FLEET measurements were performed at 1 kHz using a femtosecond laser centered at 800 nm and an ultrahigh-speed intensified camera system. The results reported here are for a single freestream condition corresponding to approximately Re ∞ /L = 3.6∙10 6 m -1 . The performance of the velocimetry instrument was evaluated in the quiescent test section at conditions relevant to the wake measurements. For velocity measurements in the wake, the FLEET measurement volume was translated to several radial locations from the model centerline in the vertical direction and at a streamwise location corresponding to approximately 12 mm from the payload. Reverse flow with mean velocities ranging from -12 m/s to -48 m/s were observed in the recirculating region of the wake, whereas hypersonic velocities in the range of 1079 m/s to 1183 m/s were observed in the free shear layer. A velocity uncertainty methodology is also outlined and applied for the reported measurements. The velocity data reported in this work is expected to play a significant role in the validation of computational codes modeling the hard-to-predict separated hypersonic wake.

FLEET↗

Composite Overwrapped Pressure Vessels (COPV) Stress Rupture Test

One of the major concerns for the aging Space Shuttle fleet is the stress rupture life of composite overwrapped pressure vessels (COPVs). Stress rupture life of a COPV has been defined as the minimum time during which the composite maintains structural integrity considering the combined effects of stress levels and time. To assist in the evaluation of the aging COPVs in the Orbiter fleet an analytical reliability model was developed. The actual data used to construct this model was from testing of COPVs constructed of similar, but not exactly same materials and pressure cycles as used on Orbiter vessels. Since no actual Orbiter COPV stress rupture data exists the Space Shuttle Program decided to run a stress rupture test to compare to model predictions. Due to availability of spares, the testing was unfortunately limited to one 40" vessel. The stress rupture test was performed at maximum operating pressure at an elevated temperature to accelerate aging. The test was performed in two phases. The first phase, 130 F, a moderately accelerated test designed to achieve the midpoint of the model predicted point reliability. The more aggressive second phase, performed at 160 F was designed to determine if the test article will exceed the 95% confidence interval of the model. This paper will discuss the results of this test, it's implications and possible follow-on testing.

Russell, Richard↗

Composite Overwrapped Pressure Vessels (COPV) Stress Rupture Test: Part 2

One of the major concerns for the aging Space Shuttle fleet is the stress rupture life of composite overwrapped pressure vessels (COPVs). Stress rupture life of a COPY has been defined as the minimum time during which the composite maintains structural integrity considering the combined effects of stress levels and time. To assist in the evaluation of the aging COPVs in the Orbiter fleet an analytical reliability model was developed. The actual data used to construct this model was from testing of COPVs constructed of similar, but not exactly same materials and pressure cycles as used on Orbiter vessels. Since no actual Orbiter COPV stress rupture data exists the Space Shuttle Program decided to run a stress rupture test to compare to model predictions. Due to availability of spares, the testing was unfortunately limited to one 40" vessel. The stress rupture test was performed at maximum operating pressure at an elevated temperature to accelerate aging. The test was performed in two phases. The first phase, 130 F, a moderately accelerated test designed to achieve the midpoint of the model predicted point reliability. A more aggressive second phase, performed at 160 F, was designed to determine if the test article will exceed the 95% confidence interval ofthe model. In phase 3, the vessel pressure was increased to above maximum operating pressure while maintaining the phase 2 temperature. After reaching enough effectives hours to reach the 99.99% confidence level of the model phase 4 testing began when the temperature was increased to greater than 170 F. The vessel was maintained at phase 4 conditions until it failed after over 3 million effect hours. This paper will discuss the results of this test, it's implications and possible follow-on testing.

Russell, Richard↗

Simulator results of an F-14A airplane utilizing an aileron-rudder interconnect during carrier approaches and landings

A piloted simulator study was conducted to evaluate an aileron rudder interconnect (ARI) control system for the F-14A airplane in the landing configuration. Effects on pilot performance and handling characteristics were investigated. Two ARI configurations were tested and compared to the standard F-14 fleet control system. A nonlinear aerodynamic model of the F-14 was used in conjunction with a six degree of freedom motion base simulator. The evaluation task, which utilized three subject pilots, consistent of a night carrier approach and landing. Both ARI configurations produced improved pilot performance and pilot ratings when compared to the standard control system. Sideslip due to adverse yaw as considerably reduced by the ARI systems and heading control was more stable and precise. Lateral deviation from centerline was reduced during the approach and lateral touchdown dispersion on the carrier deck was reduced with the ARI control systems.

Kelly, W. W.↗

Microwave and Millimeter Wave Nondestructive Evaluation of the Space Shuttle External Tank Insulating Foam

The Space Shuttle Columbia s catastrophic failure has been attributed to a piece of external fuel tank insulating SOFI (Spray On Foam Insulation) foam striking the leading edge of the left wing of the orbiter causing significant damage to some of the protecting heat tiles. The accident emphasizes the growing need to develop effective, robust and life-cycle oriented methods of nondestructive testing and evaluation (NDT&E) of complex conductor-backed insulating foam and protective acreage heat tiles used in the space shuttle fleet and in future multi-launch space vehicles. The insulating SOFI foam is constructed from closed-cell foam. In the microwave regime this foam is in the family of low permittivity and low loss dielectric materials. Near-field microwave and millimeter wave NDT methods were one of the techniques chosen for this purpose. To this end several flat and thick SOFI foam panels, two structurally complex panels similar to the external fuel tank and a "blind" panel were used in this investigation. Several anomalies such as voids and disbonds were embedded in these panels at various locations. The location and properties of the embedded anomalies in the "blind" panel were not disclosed to the investigating team prior to the investigation. Three frequency bands were used in this investigation covering a frequency range of 8-75 GHz. Moreover, the influence of signal polarization was also investigated. Overall the results of this investigation were very promising for detecting the presence of anomalies in different panels covered with relatively thick insulating SOFI foam. Different types of anomalies were detected in foam up to 9 in thick. Many of the anomalies in the more complex panels were also detected. When investigating the blind panel no false positives were detected. Anomalies in between and underneath bolt heads were not easily detected. This paper presents the results of this investigation along with a discussion of the capabilities of the method used.

Shrestha, S.↗

Space Shuttle Orbiter Fleet Leader Orbital Maneuvering Engine SN 002A injector replacement

During testing of the Fleet Leader Orbital Maneuvering Engine (OME) Serial Number (SN) 002A at the White Sands Test Facility (WSTF) in 1983 the injector was inadvertently damaged. After testing was completed in 1985, there was a concern that the performance of the engine and its response to specific test conditions might not be sufficiently representative of flight engines to provide valid test results. To correct this damage, the engine was returned to the manufacturer to replace the injector. The task assigned was to evaluate the damage and generate a unique process to repair the Fleet Leader OME while providing minimum impact to the overall life condition of the engine. In addition to successfully performing the repair operation, the as received condition of the engine and its components were documented for Fleet Leader reference. The engine is currently at WSTF where it has accumulated 11,341 seconds of firing time to date, 2615 seconds of which have occurred since the engine repair.

Riccio, Joseph R.↗

Cyber Physical Security (CPS) Extension to Air Traffic Management (ATM) Testbed

The Air Traffic Management (ATM) Testbed is being developed at NASA to enable benefit, impact, safety and cost assessments for accelerating the deployment of Concept and Technologies (C&T) in the National Airspace System (NAS). Today, C&T introduction into the NAS takes decades. The primary reason for this is an inability to assess the operational impact of the interaction between the proposed C&T and operationally deployed systems (Realistic Technologies) in terms of NAS-wide safety, traffic flow efficiency, roles and workload of controllers and traffic managers, and impact on airline fleet operations. Transition of C&T to operations requires mathematical modeling and simulation, Human-in-the-Loop (HITL) testing and shadow-mode evaluation driven by operational data. Whereas interaction with the operational system during testing and stages of deployment is not permissible due to safety concerns, it is certainly possible to create a simulation environment that closely mimics the NAS using the same operational systems/hardware for enabling such assessments. This presentation focuses on a proposed Cyber Physical Security extension to the ATM Testbed for creating a modeling and simulation architecture to study how well the Air Traffic Management system will perform and analyze effectiveness of mitigating security measures against particular cyber-attack scenarios.

Datta, Koushik↗

Flight problem evaluation for Space Shuttle Orbiter

The flight problems experienced with the reusable Space Shuttle Orbiter have decreased during subsequent flights of each vehicle. By comparison to first flights of previous vehicles, the problems encountered on the initial flight of each new vehicle entering the fleet decreased. This improvement in turn has reduced the turnaround time between flights significantly and thus greatly enhanced the increased Space Shuttle launch frequency. The reusable manned space vehicle concept necessitated the development of a flight problem recognition and resolution system which would enable a thorough and timely vehicle turnaround flow. Flight evaluation, testing, and repair of manned spacecraft to enhance reliability and to ensure mission success is a unique activity. Real-time recognition of the flight problem, prompt isolation of the cause, and timely implementation of the corrective action are the keys to maintaining an operational fleet. Examples of flight problems that have been encountered as well as the corrective actions implemented during the first 24 Space Shuttle missions are presented. The corrective actions taken to preclude problem recurrence include modifications of hardware designs, manufacturing processes, flight software, test methods, and operational procedures.

Mechelay, Joseph E.↗

Usability Evaluation of Fleet Management Interface for High Density Vertiplex Environments

To meet the rising demand for an Advanced Air Mobility (AAM) (i.e. urban and rural unmanned aircraft systems) ecosystem, the NASA Aeronautics Research Mission Directorate (ARMD) is hosting a series of simulations and flight tests under the High Density Vertiplex sub-project (HDV) to prototype and study the effectiveness AAM capabilities under various operational contexts. HDV aims to develop an integrated automation architecture to support terminal area flight operations. The HDV simulations and flight tests address safety, integration, and operational challenges, while integrated systems and software demonstrate design readiness, robustness, and interoperability. During the initial HDV simulation in 2021, a prototype traffic management tool developed by NASA called the Fleet Management Interface (FMI) was tested. FMI was designed to introduce an advanced level of human-automation interaction to aid both Ground Control Station Operators (GCSOs) and Fleet Managers (FMs) in remotely managing flights under their ownership. In a human-in-the-loop simulation, a usability study was conducted with the FMI to identify optimal approaches for displaying information to human operators using subjective measures of usability, workload, situation awareness, risk, and trust, along with qualitative feedback. This study consisted of task analysis in which GCSO and FM subjects used an Urban Air Mobility (UAM) environment to develop and execute a plan for two different traffic scenarios of remotely controlled vehicles. In each scenario, a remotely controlled vehicle completed a takeoff, active flight, and landing sequence while simulated traffic flew in the background at a rate of 20 operations per hour. In the first scenario, the controlled vehicle flew a nominal route with takeoff and landing at the same vertiport. In the second scenario, the controlled vehicle started on the nominal route, then diverted to an unplanned location mid-flight. Results showed that self- reported performance, usability, trust, and situation awareness ratings of FMI were moderately to strongly high. There were small differences between scenarios, with Scenario 2 being perceived as more unstable, complex, variable, risky, and potentially harmful than Scenario 1. Furthermore, participants described improvements that could be made to create a better user experience. For example, users suggested customizable interfaces to accommodate information display preferences, and the ability to review routes before assigning them. The results from this study will inform future development of the FMI with the end goal of creating a reference automation tool for airspace management procedures in AAM. The FMI could serve to reduce dependency on traditional air navigation services through increased automation in high density vertiplex environments.

Fleet manager↗

Usability Evaluation of Fleet Management Interface for High Density Vertiplex Environments

To meet the rising demand for an Advanced Air Mobility (i.e. urban and rural unmanned aircraft systems) ecosystem, NASA Aeronautics Research Mission Directorate (ARMD) is hosting a series of simulations and flight tests under the High Density Vertiplex sub-project (HDV). HDV aims to develop an integrated automation architecture to support terminal area flight operations. The HDV simulations and flight tests address safety, integration, and operational challenges, while integrated systems and software demonstrate design readiness, robustness, and interoperability. During the initial HDV simulation in 2021, a prototype traffic management tool developed by NASA called Fleet Management Interface (FMI) was tested. FMI was designed to introduce an advanced level of human-automation interaction to aid both Ground Control Station Operators (GCSOs) and Fleet Managers (FMs) in remotely managing flights under their ownership. In a human-in-the-loop simulation, a usability study was conducted with FMI to identify optimal approaches for displaying information for human operators using subjective measures of usability, workload, situation awareness, risk, and trust, along with qualitative feedback. This study consisted of task analysis in which GCSO and FM subjects used an Urban Air Mobility (UAM) environment to develop and execute a plan for two different traffic scenarios of remotely controlled vehicles. In each scenario, a controlled vehicle completed a takeoff, active flight, and landing sequence while automated traffic flew in the background at a rate of 20 operations per hour. In the first scenario, the controlled vehicle flew a nominal route with takeoff and landing at the same vertiport. In the second scenario, the controlled vehicle started on the nominal route, then diverted to an unplanned location mid-flight. Results showed that self-reported performance, usability, trust, and situation awareness ratings of FMI were moderately to strongly high. There were small differences between scenarios, with Scenario 2 being perceived as more unstable, complex, variable, risky, and potentially harmful than Scenario 1. Furthermore, participants described improvements that could be made to create a better user experience. For example, users would like greater configurability of the interface based on their personal information requirements, and they would like the opportunity to review routes before assigning them. The results from this study will inform future development of the FMI with the end goal of creating a reference automation tool for airspace management procedures in AAM. The FMI could be introduced as a potential way to reduce dependency on traditional air navigation services through increased automation in high density vertiplex environments.

vertiplex↗

Space Shuttle Orbiter waste collection system conceptual study

The analyses and studies conducted to develop a recommended design concept for a new fecal collection system that can be retrofited into the space shuttle vehicle to replace the existing troublesome system which has had limited success in use are summarized. The concept selected is a cartridge compactor fecal collection subsystem which utilizes an airflow collection mode combined with a mechanical compaction and vacuum drying mode that satisfies the shuttle requirements with respect to size, weight, interfaces, and crew comments. A follow-on development program is recommended which is to result in flight test hardware retrofitable on a shuttle vehicle. This permits NASA to evaluate the system which has space station applicablity before committing production funds for the shuttle fleet and space station development.

Abbate, M.↗