Search NASA⌕ Search

SEARCH · Search NASA

Results for “Certification by Analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 451 records · Page 25

Recommendations for UAS Crew Ratings. Pilot Ratings and Authorization Requirements for UAS

This position paper is intended to recommend the minimum certificate and rating requirements for a pilot to operate an Unmanned Aircraft System (UAS) in the National Airspace System. The paper will recommend the minimum requirements based on the Knowledge, Skills, and Abilities (KSA) required of a UAS pilot and show how those compare to the KSAs required by regulation for manned-aircraft pilots. The paper will provide substantiation based on studies conducted using analyses, simulation and flight experience. The paper is not yet complete; only initial working material is included. The material provided describes the body of work completed thus far and the plan for remaining tasks to complete the recommendation. The HSI Pilot KSA document provides an analysis of the knowledge, skills, and abilities required for UAS operation in the NAS. It is the source document used for the position paper.

Source record↗

Design, Certification, and Deployment of the Colorimetric Water Quality Monitoring Kit (CWQMK)

In August 2009, an experimental water quality monitoring kit based on Colorimetric Solid Phase Extraction (CSPE) technology was delivered to the International Space Station (ISS) aboard STS-128/17A. The kit, called the Colorimetric Water Quality Monitoring Kit (CWQMK), was developed by a team of scientists and engineers from NASA s Habitability and Environmental Factors Division in the Space Life Sciences Directorate at Johnson Space Center, the Wyle Integrated Science and Engineering Group in Houston, Texas, the University of Utah, and Iowa State University. The CWQMK was flown and deployed as a Station Development Test Objective (SDTO) experiment on ISS. The goal of the SDTO experiment was to evaluate the acceptability of CSPE technology for routine water quality monitoring on ISS. This paper provides an overview of the SDTO experiment, as well as a detailed description of the CWQMK hardware and a summary of the testing and analysis conducted to certify the CWQMK for use on ISS. The results obtained from the SDTO experiment are also reported and discussed in detail.

Gazda, Daniel B.↗

SRMS History, Evolution and Lessons Learned

Early in the development of the Space Shuttle, it became clear that NASA needed a method of deploying and retrieving payloads from the payload bay. The Shuttle Remote Manipulator System (SRMS) was developed to fill this need. The 50 foot long robotic arm is an anthropomorphic design consisting of three electromechanical joints, six degrees of freedom, and two boom segments. Its composite boom construction provided a light weight solution needed for space operations. Additionally, a method of capturing payloads with the arm was required and a unique End Effector was developed using an electromechanical snare mechanism. The SRMS is operated using a Displays and Controls Panel and hand controllers located within the aft crew compartment of the shuttle. Although the SRMS was originally conceived to deploy and retrieve payloads, its generic capabilities allowed it to perform many other functions not originally conceived of. Over the years it has been used for deploying and retrieving constrained and free flying payloads, maneuvering and supporting EVA astronauts, satellite repair, International Space Station construction, and as a viewing aid for on-orbit International Space Station operations. After the Columbia accident, a robotically compatible Orbiter Boom Sensor System (OBSS) was developed and used in conjunction with the SRMS to scan the Thermal Protection System (TPS) of the shuttle. These scans ensure there is not a breach of the TPS prior to shuttle re-entry. Ground operations and pre mission simulation, analysis and planning played a major role in the success of the SRMS program. A Systems Engineering Simulator (SES) was developed to provide a utility complimentary to open loop engineering simulations. This system provided a closed-loop real-time pilot-driven simulation giving visual feedback, display and control panel interaction, and integration with other vehicle systems, such as GN&C. It has been useful for many more applications than traditional training. Evolution of the simulations, guided by the Math Model Working Group, showed the utility of input from multiple modeling groups with a structured forum for discussion.There were many unique development challenges in the areas of hardware, software, certification, modeling and simulation. Over the years, upgrades and enhancements were implemented to increase the capability, performance and safety of the SRMS. The history and evolution of the SRMS program provided many lessons learned that can be used for future space robotic systems.

Jorgensen, Glenn↗

Event Report for The Ethical Artificial Intelligence Quantification Workshop

Artificial Intelligence (AI) is a powerful emerging technology area which requires special attention to using it ethically. AI ethics is still an emerging field, and the partners for this workshop and report seek to move AI ethics discussion ahead by experimenting with ways to measure AI ethics criteria. The following document describes the outcomes and learnings from The Ethical Artificial Intelligence Quantification Workshop held at the National Institute for Aerospace (NIA), Hampton, Virginia on May 12th, 2022. The purpose of the workshop was for participants to evaluate and experiment-with the methodology and process presented by AIEthics.World in cooperation with Intel Corporation. The meeting participants learned about the Ethical AI Certification and Maturity Model™ and applied the methodology to selected notional AI systems. The workshop facilitated the evaluation of the maturity of the AI system according to ethical considerations relevant to NASA, NIA and other participants. The workshop consisted of three main phases. The first phase focused on understanding and summarizing NASA’s ethical approaches, mission and values based on published documentation, discussions and individual insights & opinions of participants. This information was prioritized, weighted, ordered, and quantified in phase two, to formulate an alignment between human values (ethics) and their applicability to AI systems during all lifecycle phases. The first two phases were summarized as a form of ethical genealogy for artificial intelligence, specific to NASA’s ethical approaches. In the third and last phase of the workshop the participants evaluated notional examples of artificial intelligence to qualify and quantify its ability to adhere to the organizational ethics approaches, using the Ethical AI Certification and Maturity Model™. The workshop uses the concept of genealogy, in the traditional sense: the study and traceability of lines of ancestors in the process of evolutionary development from earlier forms. However, as it is applied to an Ethical AI definition, it is providing the insights to the necessary and mandatory traceability of content, data, metrics, telemetry, elements, and structures which are used in the AI’s lifecycle to foster and measure AI ethics in all steps of its lifecycle. The Ethical Artificial Intelligence Quantification Workshop provided NASA with the opportunity to apply the Ethical AI Certification and Maturity Model™, in combination with existing and well-known decision-making and quality control methods to identify the metrics and measurements for an Ethical AI and assess its ethical condition and quality aligned with NASA ethics approaches. The result of the workshop is the capacity for NASA to apply the maturity model assessment to its AI Systems as desired and if necessary, publish the ability of these AI Systems to adhere to the organizational ethical goals. AI ethics frameworks need to be customized for each application domain, for example, individual NASA Mission Directorates. General principles that work in one area such as AI/Machine Learning-based text analysis (the ethics of information-extraction) may need to be adapted for another such as sense-and-avoid decision-making in a flight environment. The workshop was conducted among approximately twenty NASA subject matter experts, so the elements noted above should be considered examples, not definitive NASA ethical AI principles, genealogy, etc. Generating a definitive AI ethics framework for an organization as diverse as NASA would require far more discussion, debate, review, etc. However, the workshop provided valuable insight into mechanisms and processes for quantifying AI ethical qualities.

Artificial Intelligence↗

Summary and analysis of performance and stability characteristics of the refan JT8D-109 engine

The refan JT8D-109 performance and stability characteristics are reported as determined from sea level testing, altitude testing, and DC-9 flight testing. The test results are summarized as follows: (1) TSFC at SLS achieved design goal of 12.66 percent reduction. (2) TSFC at altitude average cruise power 0.5 percent higher than design goal, (3) TSFC at altitude maximum cruise power 1.7-3.7 percent higher than design goal, (4) ground starting consistent with JT8D-9 base engine, (5) successful flight starts without starter assist, (6) transient surge margin equivalent to JT8D-9, (7) stable engine operation with inlet distortion, and (8) stable engine operation during snap acceleration and deceleration. A flight idle setting is required for acceptable aborted-landing go-around acceleration time due to increase in low-rotor moment of inertia, and a performance improvement program should be conducted as part of any future certification program.

Sanberg, K. G.↗

COFS 1: Beam dynamics and control technology overview

The Control of Flexible Structures (COFS) 1 Project provides the invaluable opportunity to test, validate, and measure the effectiveness of theories, structural concepts, control systems, and flight certification processes for future missions through a research program focusing on multiple issues in large flexible structures, dynamics, and controls. The COFS 1 Project consists of a series of ground and flight activities building progressively from modeling and dynamic characterization of large space systems to the more complex issues of flexible-body control. The program objectives are to: determine the degree to which theory and ground testing can predict flight performance of next-generation low-frequency structures; evaluate structural fidelity of representative next-generation large deployable precision structure; assess math modeling requirements for large lightweight complex systems on which ground test results are questionable; determine degree to which scale model analysis and tests can be correlated to full-scale performance; evaluate system identification and state estimation algorithms on complex lightweight structures in the space environment; evaluate and verify controls/structures modeling capability; evaluate control laws and control systems; and evaluate damping effects in micro-g environment.

Allen, John L.↗

Configuring the Orion Guidance, Navigation, and Control Flight Software for Automated Sequencing

The Orion Crew Exploration Vehicle is being designed with greater automation capabilities than any other crewed spacecraft in NASA s history. The Guidance, Navigation, and Control (GN&C) flight software architecture is designed to provide a flexible and evolvable framework that accommodates increasing levels of automation over time. Within the GN&C flight software, a data-driven approach is used to configure software. This approach allows data reconfiguration and updates to automated sequences without requiring recompilation of the software. Because of the great dependency of the automation and the flight software on the configuration data, the data management is a vital component of the processes for software certification, mission design, and flight operations. To enable the automated sequencing and data configuration of the GN&C subsystem on Orion, a desktop database configuration tool has been developed. The database tool allows the specification of the GN&C activity sequences, the automated transitions in the software, and the corresponding parameter reconfigurations. These aspects of the GN&C automation on Orion are all coordinated via data management, and the database tool provides the ability to test the automation capabilities during the development of the GN&C software. In addition to providing the infrastructure to manage the GN&C automation, the database tool has been designed with capabilities to import and export artifacts for simulation analysis and documentation purposes. Furthermore, the database configuration tool, currently used to manage simulation data, is envisioned to evolve into a mission planning tool for generating and testing GN&C software sequences and configurations. A key enabler of the GN&C automation design, the database tool allows both the creation and maintenance of the data artifacts, as well as serving the critical role of helping to manage, visualize, and understand the data-driven parameters both during software development and throughout the life of the Orion project.

Odegard, Ryan G.↗

Supporting Hazard Analysis for Wildfire Response Using fmdtools and MIKA

The System Wide Safety (SWS) Safety Demonstrator (SD) Series drives development of an increasingly capable In-Time Aviation Safety Management System (IASMS) focusing on humanitarian applications, starting with wildfire response (SD-1). The goals of this report are to (1) provide an early hazard analysis and mitigation evaluation of wildfire response to support these efforts and (2) provide a demonstration of capabilities of the Fault Model Design Tools (fmdtools) and Manager for Intelligent Knowledge Access (MIKA) tools. fmdtools provides a modeling, simulation, and resiliency analysis framework in which a wildfire response model, the System Modeling and Analysis of Resiliency in Scalable Traffic Management for Emergency Response Operations (SMARt-STEReO), is built. MIKA is an intelligent knowledge manager with several capabilities, including assisting in hazard analysis by extracting and analyzing hazards from historical incident reports. The following topics are covered in the report: Understanding Wildfire Hazard Dynamics. We provide a description and simulated examples of how hazards occur in the SMARt-STEReO model of wildfire response and their effect on its outcome. This provides a common mental model and focuses the analysis presented in the remainder of the report. Wildfire Hazard Identification. MIKA identifies wildfire hazards from three relevant datasets: the ICS-209-PLUS, SAFECOM, and SAFENET. Hazards are manually organized into a taxonomy and MIKA analyzes each hazard’s effects, likelihood, severity, and risk. Evaluating Mitigation Strategies. The SMARt-STEReO wildfire response model built in fmdtools evaluates a subset of identified hazards. Specifically, we simulate the effect of communications faults and equipment faults on operator safety, the effect of changing winds and flammability, and a scenario with multiple ignition points and heavy smoke. Tool Limitations and Usage Considerations. We provide a discussion of appropriate tool use cases as well as limitations and considerations for usage. The tool findings are used to synthesize recommendations for wildfire response operations, which can be captured as part of an IASMS. Key recommendations are as follows: Hazards are identified from a broad spectrum of sources including aircraft subsystems, operational sources, and ground crew operations. Highest risk operational environment hazards identified are Evacuations. The highest risk manned aerial operations hazard categorized is Jumper Operations Mishap. Ground crew hazards that are highest risk are Burns, Cargo Operations Overhead, Dehydration, Entrapment, Falling Objects, Heart Attacks, Heat Exhaustion, Inadequate Training or Certification, Vehicle Breakdown, and Vehicle Collision. Modelled containment failures arise from a mismatch between the difficulty of the firefighting scenario and the capacity (e.g., speed, effectiveness, awareness) of the response. In firefighting scenarios where containment is possible (e.g., because the fire does not spread too quickly), these mismatches can occur because of a change in environmental conditions (e.g., wind, flammability, etc) or because of planning, equipment, or communications faults. Improvements to communications increase the capacity of the firefighting response by reducing the time needed to respond to the fire. While surveillance does not increase this capacity by itself, it increases operator safety by increasing state awareness, enabling firefighters to evade approaching fires. Increasing both has a synergistic effect. In general, these performance and resilience increases generalize over fault scenarios as well as unforeseen changes to circumstances (i.e., wind, aridity, etc.). However, these improvements need to be designed so as not to make the system prone to persistent large-scale communications outages, which can reduce performance.

Hazard analysis↗

Noise Scaling and Community Noise Metrics for the Hybrid Wing Body Aircraft

An aircraft system noise assessment was performed for the hybrid wing body aircraft concept, known as the N2A-EXTE. This assessment is a result of an effort by NASA to explore a realistic HWB design that has the potential to substantially reduce noise and fuel burn. Under contract to NASA, Boeing designed the aircraft using practical aircraft design princip0les with incorporation of noise technologies projected to be available in the 2020 timeframe. NASA tested 5.8% scale-mode of the design in the NASA Langley 14- by 22-Foot Subsonic Tunnel to provide source noise directivity and installation effects for aircraft engine and airframe configurations. Analysis permitted direct scaling of the model-scale jet, airframe, and engine shielding effect measurements to full-scale. Use of these in combination with ANOPP predictions enabled computations of the cumulative (CUM) noise margins relative to FAA Stage 4 limits. The CUM margins were computed for a baseline N2A-EXTE configuration and for configurations with added noise reduction strategies. The strategies include reduced approach speed, over-the-rotor line and soft-vane fan technologies, vertical tail placement and orientation, and modified landing gear designs with fairings. Combining the inherent HWB engine shielding by the airframe with added noise technologies, the cumulative noise was assessed at 38.7 dB below FAA Stage 4 certification level, just 3.3 dB short of the NASA N+2 goal of 42 dB. This new result shows that the NASA N+2 goal is approachable and that significant reduction in overall aircraft noise is possible through configurations with noise reduction technologies and operational changes.

Burley, Casey L.↗

Composite Overwrapped Pressure Vessels (COPV): Developing Flight Rationale for the Space Shuttle Program

Introducing composite vessels into the Space Shuttle Program represented a significant technical achievement. Each Orbiter vehicle contains 24 (nominally) Kevlar tanks for storage of pressurized helium (for propulsion) and nitrogen (for life support). The use of composite cylinders saved 752 pounds per Orbiter vehicle compared with all-metal tanks. The weight savings is significant considering each Shuttle flight can deliver 54,000 pounds of payload to the International Space Station. In the wake of the Columbia accident and the ensuing Return to Flight activities, the Space Shuttle Program, in 2005, re-examined COPV hardware certification. Incorporating COPV data that had been generated over the last 30 years and recognizing differences between initial Shuttle Program requirements and current operation, a new failure mode was identified, as composite stress rupture was deemed credible. The Orbiter Project undertook a comprehensive investigation to quantify and mitigate this risk. First, the engineering team considered and later deemed as unfeasible the option to replace existing all flight tanks. Second, operational improvements to flight procedures were instituted to reduce the flight risk and the danger to personnel. Third, an Orbiter reliability model was developed to quantify flight risk. Laser profilometry inspection of several flight COPVs identified deep (up to 20 mil) depressions on the tank interior. A comprehensive analysis was performed and it confirmed that these observed depressions were far less than the criterion which was established as necessary to lead to liner buckling. Existing fleet vessels were exonerated from this failure mechanism. Because full validation of the Orbiter Reliability Model was not possible given limited hardware resources, an Accelerated Stress Rupture Test of a flown flight vessel was performed to provide increased confidence. A Bayesian statistical approach was developed to evaluate possible test results with respect to the model credibility and thus flight rationale for continued operation of the Space Shuttle with existing flight hardware. A non-destructive evaluation (NDE) technique utilizing Raman Spectroscopy was developed to directly measure the overwrap residual stress state. Preliminary results provide optimistic results that patterns of fluctuation in fiber elastic strains over the outside vessel surface could be directly correlated with increased fiber stress ratios and thus reduced reliability.

Kezirian, Michael T.↗

EVA Swab Kit: Tools and Techniques for Collecting Aseptic Samples from Crewed Space Missions

Introduction: When we send humans to search for life on other planets, we'll need to know what we brought with us versus what may already be there. To ensure our crewed spacecraft meet planetary protection requirements—and to protect our science from human contamination—we'll need to assess and verify whether micro-organisms may be leaking/venting from our spacesuits. This requires collecting samples under Extravehicular Activity (EVA) conditions. Detailed, systematic research on forward contamination from robotic spacecraft has been steadily progressing since the Viking missions, but systematic studies of contamination from space suits has not been conducted in many years. The modern EMU (Extravehicular Mobility Unit) suit used by NASA is designed to leak at rates as high as 100 cc/min. Before humans land on Mars there is a critical need to understand the types and quantities of microbes that could be introduced via space suits. The Human Forward Contamination Assessment team at NASA’s Johnson Space Center (JSC) has developed a prototype EVA swab tool [1,2,3,4] designed for use in space to sample cleaned and uncleaned space suits to determine the present day microbial load and eventually the rate of leakage. The ability to assess microbial leakage early in advanced space suit and life support system design cycles will help avoid costly hardware redesign later. Test Objectives: The primary objective of EMU testing was to characterize the type of micro-organisms typically found on or near selected suit pressure joints under suit differential pressure conditions. Most human-borne microbes can fit through a 0.5 to 1.0 µm gap. Knowing which joints are more likely to leak will inform hardware design decisions. Knowing which types of micro-organisms may leak from EVA suits provides a basis for subsequent studies to characterize the viability of those organisms under destination conditions, as well as how far they might spread through natural or human-influenced processes. That data, in turn, will inform exploration mission operations and hardware design. The secondary objective of testing was to evaluate the interface between a fully suited test subject and the EVA swab tool at vacuum. Bulky EVA suits can restrict movement and limit visibility through the helmet visor. Fully suited testing is important for identifying tool design issues prior to flight. At exploration destinations, such as Mars, suited crew may be required to periodically sample their suits as part of an environmental monitoring protocol. Suit Microbial Sampling Results: This report details results of microbial swabs collected from current flight suit configurations worn by crew members assigned to upcoming ISS expedition missions as well as swabs collected from prototype suits intended for use on the Orion spacecraft. These tests were intended to characterize the types of contaminants found on flight suits under current, typical handling conditions. No attempt was made to change suit handling procedures, provide additional sterilization, or to limit typical potential contaminant sources. Using culture based techniques, we cultivated 235 CFU (colony forming units) comprised of 26 bacterial species and one fungal species on the outside of the suits. The fungal species and 14 of the bacterial species were unique to the suit surfaces and were not detected in any of the background samples collected within the chambers. We sequenced 755,434 ribosomal fragments on all of the suit surfaces from swab samples. 557,016 of these sequences represent DNA that survived at least 4 hours at vacuum. These sequences formed 2,464 OTU's (Operational Taxonomic Units, 97% similarity) showing low diversity in the samples. The most abundant sequences that survived vacuum belong to the genera Staphyloccocus, Ralstona, Bacillus and Rhodobacter all of which are common to the human microbiome. [5] See Danko et al., (2021) for more complete details of these first analyses. Further analysis of EVA suit materials with respect to the efficacy of various cleaning protocols and engineered containment solutions is planned to inform suit design for NASA’s Artemis Moon to Mars program crew testing. Swab Tool Function Results: The kit was demonstrated for fit and function in suited subject vacuum tests to determine how well the tool worked as an aseptic microbial sampling device as well as to identify any design elements that could be upgraded for EVA task specific improvement. It was found that sample acquisition efficacy could be enhanced by redesign of the sample canister to end-effector interface. Several modifications of the sample caddy assemblies to optimize EVA safety and functionality were also identified. Consequently, fabrication of the redesigned sample canister to end-effector assembly interfaces and and the sample caddy assemblies are required. Fabrication of sixteen flight sample canister assemblies (8 per each of two EVA Swab Kits) and two sample caddy assemblies are in process to be followed by hardware testing and certification to produce two flight-certified EVA Swab Kits for transport to ISS no earlier than summer of 2022. Sampling Strategy: The International Space Station is an ideal testbed for systematic studies of contamination from crewed vehicles since it has been continuously occupied for 20 years and exposed to non-terrestrial conditions. We will sample the exterior of the ISS during EVA using a purpose-built swab tool capable of maintaining sterility while undergoing temperature changes from -151 to +121°C under hard vacuum. Prior to each EVA, the project team will work with ISS mission managers to identify precise sampling locations, which will vary by EVA based on the translation paths and worksites scheduled for that particular EVA. Ideally, translation path handrails and areas near ECLSS (Environmental Control and Life Support System) external vent openings on a spacecraft would be assessed. There are currently more than a dozen ECLSS external vents on the ISS. Some are connected to systems that vent waste products, while others are intended to equalize cabin pressure. As EVA opportunity allows, microbial samples from any of these external vents would provide a valuable data point, though some will be more useful than others. Four criteria have been identified to help prioritize sampling sites near vents: • EVA Accessibility: To minimize cost, it is desired to piggy-back onto a planned EVA. Therefore, the sampling location must be readily accessible by an EVA crew • Type of Vented Products: Vent products that have been in direct contact with crew, such as cabin air, are more likely to contain microorganisms than vent products associated with isolated systems, such as experiment module combustion products. • Mass of Vented Products: Higher-flow vents are more likely to contain detectible levels of microbial contaminants than lower-flow vents. • Local Environment: Sample locations with relatively benign local conditions, such as warm surfaces shielded from direct ultraviolet (UV) radiation exposure, may be more likely to support microbial growth than locations with harsher local environmental conditions. Because EVA accessibility is the most important criteria, the proposal team worked with an astronaut and flight controllers using the Dynamic Onboard Ubiquitous Graphics (DOUG) tool. The DOUG virtual environment allows an operator to “fly” around the current ISS vehicle configuration to assess EVA translation paths, attach points, and keep-out zones. While analysis on station or rapid return to Earth would be preferable, samples collected from the exterior of the ISS have already been exposed to temperature variations between -157 and +121 °C as well as hard vacuum. Therefore, they should be fairly stable and robust. We hypothesize that samples collected from the ISS exterior could be stored for up to 6 months at -80°C without degradation. Sample canisters will be returned to Earth while frozen at -80°C for analysis, and sterilized canisters can be re-flown back to ISS to support additional sampling opportunities Relevance to NASA Exploration Objectives: These data will allow us to identify new or improved methods, technologies, and procedures for spacecraft sterilization and leakage mitigation to minimize the amount of contamination introduced to the environment by human explorers. This work is funded by NASA research grant: NNH18ZDA001N-PPR References: [1] Bell, M.S. et al. (2015) LPS XLVI, Abst. #1832 [2] Rucker et al. (2018) 42nd COSPAR (PPP.3) [3] Bell, M.S. et al. (2019) Mars Extant Life Conference, Abst. #5096.[4] Bell, M.S. et al., (2020) 43rd COSPAR (BO.2).[5] Danko D, et.al.,(2021)Front.Microbiol.12:608478.

Mary Suzanne Bell↗

Performance of a Checkerboard Liner With Uncertain Impedances

The current fleet of large commercial aircraft has successfully achieved FAA noise certifications because of, in part, the successful application of uniform passive duct liner treatments to control engine system noise. One goal of NASA's engine system noise reduction program is to develop technologies to improve the sound absorbing properties of duct liner treatments so that they remain effective in modern turbo fan engines. One such technology being studied is checkerboard or periodic axially and circumferentially segmented liners. A preliminary assessment of the potential of this technology was conducted by applying uncertainties associated with manufacturing, installation, source structure, and tonal frequency to a liner developed using deterministic design methods and generating a measure of improvement with respect to a uniform liner subjected to the same uncertainties. Deterministic design and analysis of the candidate checkerboard liner showed that it obtains a 1.5 dB per duct aspect ratio improvement in liner attenuation over a similarly designed uniform liner. When uncertainties in liner impedances, source structure, and frequency are considered, the performance of the checkerboard liner drops off dramatically. The final results of this paper show that the candidate checkerboard liner has a less than 25 percent chance of outperforming the uniform liner when moderate levels of uncertainty are considered. It is important to note that this study did not include the effects of mean flow on liner performance and, more important to note, that as a gradient based optimization process was used to design the checkerboard liner, it is almost certain that a global optimal design was not found for the candidate checkerboard liner. Had it been possible to find a better deterministically performing checkerboard liner, the probability that this candidate liner would outperform the uniform liner would certainly have been higher.

Robinson, J. H.↗

Developing Approaches for Certification of Uninspectable Fracture Critical AM Components

Introduction - Human-rated spaceflight hardware is subject to the Fracture Control requirements in NASA-STD5019, which are intended to control the risk of component failure due to undetected cracks or defects. - All hardware in this mission class is classified for Fracture Control – Exempt, Non-fracture Critical, or Fracture Critical - Fracture Critical: A classification that identifies a part where failure due to the presence of a crack is a catastrophic hazard ➔ Pressure vessels, engine components, primary structure, etc. - Axiom 1: Material and manufacturing process produce structures and components with cracks or defects. - Axiom 2: The presence of a crack or defect of sufficient size reduces the strength and life of the structure. - Damage Tolerance: demonstration that a component can survive the service life (with a safety factor) in the presence of an undetected flaw or damage. - Components are manufactured from aerospace quality materials using controlled processes. - Components are inspected for damage (cracks, flaws, defects, etc.). - Components are shown by test or analysis to be tolerant to undetected flaws.

Will Tilson↗

Argument-Based Airworthiness Assurance of Small UAS

Presently, there are three avenues by which Unmanned Aircraft System (UAS) operations are authorized in the U.S. National Airspace System (NAS): obtaining either (i) a certificate of authorization (COA), or (ii) a special airworthiness certificate (SAC) in either the experimental, or the restricted category, or (iii) an exemption from an airworthiness certificate together with a civil COA. The first is meant primarily for public entities, such as NASA; the remaining two are the only available means for civil UAS operations. Recently, the Federal Aviation Administration (FAA) has also proposed a regulatory framework targeted for certain small UAS, specifically those weighing 55 pounds or less, although final rulemaking remains pending. We have previously shown how an assurance case can aggregate heterogeneous reasoning and safety evidence, with application to UAS safety. In this paper, we describe how assurance cases can serve as a common framework to justify overall system safety, unifying both operational aspects and airworthiness, in particular system design assurance. We also show how this approach can coexist with, and augment, existing safety analysis processes and best-practices, by transforming the artifacts they produce into structured assurance arguments. To illustrate the applicability and utility of our approach, we have been applying it for the design assurance of an unmanned rotorcraft system, intended for precision agriculture operations, as part of the NASA Unmanned Aircraft System (UAS) Integration in the National Airspace System (NAS) project.

Rotocraft↗

Generic Techniques for the Calibration of Robots with Application of the 3-D Fixtures and Statistical Technique on the PUMA 500 and ARID Robots

A relatively simple, inexpensive, and generic technique that could be used in both laboratories and some operation site environments is introduced at the Robotics Applications and Development Laboratory (RADL) at Kennedy Space Center (KSC). In addition, this report gives a detailed explanation of the set up procedure, data collection, and analysis using this new technique that was developed at the State University of New York at Farmingdale. The technique was used to evaluate the repeatability, accuracy, and overshoot of the Unimate Industrial Robot, PUMA 500. The data were statistically analyzed to provide an insight into the performance of the systems and components of the robot. Also, the same technique was used to check the forward kinematics against the inverse kinematics of RADL's PUMA robot. Recommendations were made for RADL to use this technique for laboratory calibration of the currently existing robots such as the ASEA, high speed controller, Automated Radiator Inspection Device (ARID) etc. Also, recommendations were made to develop and establish other calibration techniques that will be more suitable for site calibration environment and robot certification.

Tawfik, Hazem↗

Digital Twins and Living Models at NASA

The idea of a “digital twin” was born at NASA in the 1960s as a “living model” of the Apollo mission. In response to Apollo 13’s oxygen tank explosion and subsequent damage to the main engine, NASA employed multiple simulators to evaluate the failure and extended a physical model of the vehicle to include digital components. This “digital twin” was the first of its kind, allowing for a continuous ingestion of data to model the events leading to up to the accident for forensic analysis and exploration of next steps. Fast forward half a century and NASA, along with others in the aerospace community, continues to develop and utilize high-fidelity digital models of physical systems and components as well as the extreme environments in which they operate. NASA aims to travel further and stay longer in space as we realize the Artemis program, taking us from the moon to Mars by establishing a sustainable presence on the Moon to prepare for missions to Mars. We will no longer be able to rely on constant connectivity with an asset nor be in-the-loop for on-demand human intervention in the event of an anomaly. Further, the importance of digital twins is increasing as we seek alternatives for certification of structures so large that they cannot be fully evaluated in existing test facilities and autonomous systems that are not deterministic. The idea of a digital twin is not a new one. What is new is the scale, ordinality, and non-deterministic nature of the models that are critical to achieving NASA’s goals. Their number and autonomy from each other as well as the reference system is suggestive of a changing ecosystem, returning us the idea of a living model.

Digital Twin↗

A Probabilistic Framework for the Validation and Certification of Computer Simulations

The paper presents a methodology for quantifying, propagating, and managing the uncertainty in the data required to initialize computer simulations of complex phenomena. The purpose of the methodology is to permit the quantitative assessment of a certification level to be associated with the predictions from the simulations, as well as the design of a data acquisition strategy to achieve a target level of certification. The value of a methodology that can address the above issues is obvious, specially in light of the trend in the availability of computational resources, as well as the trend in sensor technology. These two trends make it possible to probe physical phenomena both with physical sensors, as well as with complex models, at previously inconceivable levels. With these new abilities arises the need to develop the knowledge to integrate the information from sensors and computer simulations. This is achieved in the present work by tracing both activities back to a level of abstraction that highlights their commonalities, thus allowing them to be manipulated in a mathematically consistent fashion. In particular, the mathematical theory underlying computer simulations has long been associated with partial differential equations and functional analysis concepts such as Hilbert spares and orthogonal projections. By relying on a probabilistic framework for the modeling of data, a Hilbert space framework emerges that permits the modeling of coefficients in the governing equations as random variables, or equivalently, as elements in a Hilbert space. This permits the development of an approximation theory for probabilistic problems that parallels that of deterministic approximation theory. According to this formalism, the solution of the problem is identified by its projection on a basis in the Hilbert space of random variables, as opposed to more traditional techniques where the solution is approximated by its first or second-order statistics. The present representation, in addition to capturing significantly more information than the traditional approach, facilitates the linkage between different interacting stochastic systems as is typically observed in real-life situations.

Ghanem, Roger↗

Integrated Modeling and Simulation Verification, Validation, and Accreditation Strategy for Exploration Systems Mission Directorate

Models and simulations (M&S) are critical resources in the exploration of space. They support program management, systems engineering, integration, analysis, test, and operations and provide critical information and data supporting key analyses and decisions (technical, cost and schedule). Consequently, there is a clear need to establish a solid understanding of M&S strengths and weaknesses, and the bounds within which they can credibly support decision-making. Their usage requires the implementation of a rigorous approach to verification, validation and accreditation (W&A) and establishment of formal process and practices associated with their application. To ensure decision-making is suitably supported by information (data, models, test beds) from activities (studies, exercises) from M&S applications that are understood and characterized, ESMD is establishing formal, tailored W&A processes and practices. In addition, to ensure the successful application of M&S within ESMD, a formal process for the certification of analysts that use M&S is being implemented. This presentation will highlight NASA's Exploration Systems Mission Directorate (ESMD) management approach for M&S W&A to ensure decision-makers receive timely information on the model's fidelity, credibility, and quality.

Hale, Joseph P.↗