Results for “evaluation methodology” — Page 21

NASA NTRS2006

Solid Oxide Fuel Cell APU Feasibility Study for a Long Range Commercial Aircraft Using UTC ITAPS Approach: Aircraft Propulsion and Subsystems Integration Evaluation - Volume 1

The objective of this contract effort was to define the functionality and evaluate the propulsion and power system benefits derived from a Solid Oxide Fuel Cell (SOFC) based Auxiliary Power Unit (APU) for a future long range commercial aircraft, and to define the technology gaps to enable such a system. The study employed technologies commensurate with Entry into Service (EIS) in 2015. United Technologies Corporation (UTC) Integrated Total Aircraft Power System (ITAPS) methodologies were used to evaluate system concepts to a conceptual level of fidelity. The technology benefits were captured as reductions of the mission fuel burn and emissions. The baseline aircraft considered was the Boeing 777-200ER airframe with more electric subsystems, Ultra Efficient Engine Technology (UEET) engines, and an advanced APU with ceramics for increased efficiency. In addition to the baseline architecture, four architectures using an SOFC system to replace the conventional APU were investigated. The mission fuel burn savings for Architecture-A, which has minimal system integration, is 0.16 percent. Architecture-B and Architecture-C employ greater system integration and obtain fuel burn benefits of 0.44 and 0.70 percent, respectively. Architecture-D represents the highest level of integration and obtains a benefit of 0.77 percent.

Srinivasan, Hari↗

NASA NTRS2022

Event Report for The Ethical Artificial Intelligence Quantification Workshop

Artificial Intelligence (AI) is a powerful emerging technology area which requires special attention to using it ethically. AI ethics is still an emerging field, and the partners for this workshop and report seek to move AI ethics discussion ahead by experimenting with ways to measure AI ethics criteria. The following document describes the outcomes and learnings from The Ethical Artificial Intelligence Quantification Workshop held at the National Institute for Aerospace (NIA), Hampton, Virginia on May 12th, 2022. The purpose of the workshop was for participants to evaluate and experiment-with the methodology and process presented by AIEthics.World in cooperation with Intel Corporation. The meeting participants learned about the Ethical AI Certification and Maturity Model™ and applied the methodology to selected notional AI systems. The workshop facilitated the evaluation of the maturity of the AI system according to ethical considerations relevant to NASA, NIA and other participants. The workshop consisted of three main phases. The first phase focused on understanding and summarizing NASA’s ethical approaches, mission and values based on published documentation, discussions and individual insights & opinions of participants. This information was prioritized, weighted, ordered, and quantified in phase two, to formulate an alignment between human values (ethics) and their applicability to AI systems during all lifecycle phases. The first two phases were summarized as a form of ethical genealogy for artificial intelligence, specific to NASA’s ethical approaches. In the third and last phase of the workshop the participants evaluated notional examples of artificial intelligence to qualify and quantify its ability to adhere to the organizational ethics approaches, using the Ethical AI Certification and Maturity Model™. The workshop uses the concept of genealogy, in the traditional sense: the study and traceability of lines of ancestors in the process of evolutionary development from earlier forms. However, as it is applied to an Ethical AI definition, it is providing the insights to the necessary and mandatory traceability of content, data, metrics, telemetry, elements, and structures which are used in the AI’s lifecycle to foster and measure AI ethics in all steps of its lifecycle. The Ethical Artificial Intelligence Quantification Workshop provided NASA with the opportunity to apply the Ethical AI Certification and Maturity Model™, in combination with existing and well-known decision-making and quality control methods to identify the metrics and measurements for an Ethical AI and assess its ethical condition and quality aligned with NASA ethics approaches. The result of the workshop is the capacity for NASA to apply the maturity model assessment to its AI Systems as desired and if necessary, publish the ability of these AI Systems to adhere to the organizational ethical goals. AI ethics frameworks need to be customized for each application domain, for example, individual NASA Mission Directorates. General principles that work in one area such as AI/Machine Learning-based text analysis (the ethics of information-extraction) may need to be adapted for another such as sense-and-avoid decision-making in a flight environment. The workshop was conducted among approximately twenty NASA subject matter experts, so the elements noted above should be considered examples, not definitive NASA ethical AI principles, genealogy, etc. Generating a definitive AI ethics framework for an organization as diverse as NASA would require far more discussion, debate, review, etc. However, the workshop provided valuable insight into mechanisms and processes for quantifying AI ethical qualities.

Artificial Intelligence↗

NASA NTRS2001

Use of GC/MS and Microtome Techniques as Methods to Evaluate ODC Free Cleaner Diffusion and Evaporation in Insulation and Phenolic Case Material

Because of the 1990 Clean Air Act Amendment (CAAA) many chlorinated solvents used in the aerospace industry are being phased out. Replacement of the ODC (ozone-depleting chemicals) with less volatile, non-ozone depleting cleaners has been extensively studied over the past seven years at Thiokol Propulsion, a Division of Cordant Technologies, Inc. The down selection of ODC replacement cleaners has been based on several factors including the diffusion evaporation of the cleaners in selected substrates. Methodologies were developed to evaluate the cleaner content in substrates. Methods of cutting thin slices of material (microtoming) were combined with GC/MS (gas chromatography/mass spectroscopy) analysis. Substrates evaluated in this study include potential solid rocket motor materials: ASNBR (asbestos-filled nitrile butadiene rubber) and CFEPDM (carbon-filled ethylene propylene dimonomer) insulation and glass (GCP), carbon (CCP) and silica (SCP) cloth phenolic substrates with fibers either parallel (0 deg) or perpendicular (90 deg) to the surface. Residue profiles indicate both cleaner and substrate composition affect the diffusion and subsequent evaporation of the cleaner from the substrate surface.

Biegert, L. L.↗

NASA NTRS1975

The total assessment profile, volume 1

A methodology is described for the evaluation of societal impacts associated with the implementation of a new technology. Theoretical foundations for the methodology, called the total assessment profile, are established from both the economic and social science perspectives. The procedure provides for accountability of nonquantifiable factors and measures through the use of a comparative value matrix by assessing the impacts of the technology on the value system of the society.

Leininger, G.↗

NASA NTRS2001

An Evaluation of Alternative Designs for a Grid Information Service

The Globus information service wasn't working well. There were many updates of data from Globus daemons which saturated the single server and users couldn't retrieve information. We created a second server for NASA and Alliance. Things were great on that server, but a bit slow on the other server. We needed to know exactly how the information service was being used. What were the best servers and configurations? This viewgraph presentation gives an overview of the evaluation of alternative designs for a Grid Information Service. Details are given on the workload characterization, methodology used, and the performance evaluation.

Smith, Warren↗

NASA NTRSDate not supplied

Evolution of the Next Exploration Toilet Through Human-in-the-Loop (HITL) Testing

Human waste collection in space is a unique and necessary function that all crewmembers must perform. The variability in how each crewmember uses the toilet to urinate and defecate introduces complexities and challenges with regards to overall hardware design. Because of this variability, it is important to consider crew inputs in all aspects of a toilet design especially with regards to crew interfaces that could impact overall waste collection. Access to crew feedback is essential to the design process and should be considered early and often through the various design phases. In 2020, NASA started a project for the Human Landing System (HLS) program to develop a Government Furnished Equipment (GFE) toilet option. The project is known as the Lavatory On-Orbit (LOO). During the early development of the LOO, the project team conducted several crew evaluations to collect and summarize valuable crew feedback on system design, function, and overall usability to influence the next design iteration. Because every person could use the system differently in space, it was extremely important to collect and analyze the data in a very methodical manner to appropriately influence the design based on the evaluation results. Establishing a standard process ensures consistent data collection from one evaluation to another, helps to maintain privacy for each test subject’s inputs and removes any potential bias from test subject to test subject. To date, the team has completed four rounds of crew evaluations with multiple crewmembers on prototypes for the different LOO subsystems. This paper will summarize the methodology used to conduct the evaluations as well as how data was collected and analyzed. The paper will also provide details on each of the evaluations and how the design was updated based on the results.

toilet↗

NASA NTRSDate not supplied

Evolution of the Next Exploration Toilet Through Human-in-the-Loop (HITL) Testing

Human waste collection in space is a unique and necessary function that all crewmembers must perform. The variability in how each crewmember uses the toilet to urinate and defecate introduces complexities and challenges with regards to overall hardware design. Because of this variability, it is important to consider crew inputs in all aspects of a toilet design especially with regards to crew interfaces that could impact overall waste collection. Access to crew feedback is essential to the design process and should be considered early and often through the various design phases. In 2020, NASA started a project for the Human Landing System (HLS) program to develop a Government Furnished Equipment (GFE) toilet option. The project is known as the Lavatory On-Orbit (LOO). During the early development of the LOO, the project team conducted several crew evaluations to collect and summarize valuable crew feedback on system design, function, and overall usability to influence the next design iteration. Because every person could use the system differently in space, it was extremely important to collect and analyze the data in a very methodical manner to appropriately influence the design based on the evaluation results. Establishing a standard process ensures consistent data collection from one evaluation to another, helps to maintain privacy for each test subject’s inputs and removes any potential bias from test subject to test subject. To date, the team has completed four rounds of crew evaluations with multiple crewmembers on prototypes for the different LOO subsystems. This paper will summarize the methodology used to conduct the evaluations as well as how data was collected and analyzed. The paper will also provide details on each of the evaluations and how the design was updated based on the results.

toilet↗

NASA NTRS1979

Analysis and Evaluation of Processes and Equipment in Tasks 2 and 4 of the Low-cost Solar Array Project

To facilitate the task of objectively comparing competing process options, a methodology was needed for the quantitative evaluation of their relative cost effectiveness. Such a methodology was developed and is described, together with three examples for its application. The criterion for the evaluation is the cost of the energy produced by the system. The method permits the evaluation of competing design options for subsystems, based on the differences in cost and efficiency of the subsystems, assuming comparable reliability and service life, or of competing manufacturing process options for such subsystems, which include solar cells or modules. This process option analysis is based on differences in cost, yield, and conversion efficiency contribution of the process steps considered.

Wolf, M.↗

NASA NTRS1996

A Progressive Damage Methodology for Residual Strength Predictions of Center-Crack Tension Composite Panels

An investigation of translaminate fracture and a progressive damage methodology was conducted to evaluate and develop a residual strength prediction capability for laminated composites with through penetration notches. This is relevant to the damage tolerance of an aircraft fuselage that might suffer an in-flight accident such as an uncontained engine failure. An experimental characterization of several composite materials systems revealed an R-curve type of behavior. Fractographic examinations led to the postulate that this crack growth resistance could be due to fiber bridging, defined here as fractured fibers of one ply bridged by intact fibers of an adjacent ply. The progressive damage methodology is currently capable of predicting the initiation and growth of matrix cracks and fiber fracture. Using two difference fiber failure criteria, residual strength was predicted for different size panel widths and notch lengths. A ply discount fiber failure criterion yielded extremely conservative results while an elastic-perfectly plastic fiber failure criterion showed that the fiber bridging concept is valid for predicting residual strength for tensile dominated failure loads. Furthermore, the R-curves predicted by the model using the elastic-perfectly plastic fiber criterion compared very well with the experimental R-curves.

Coats, Timothy William↗

NASA NTRSDate not supplied

Functional Volume Assessment of an Early Version of the Mars Transit Habitat

During the summer of 2020, the NASA Mars Architecture Team (MAT) conducted a functional volume assessment of the Transit Habitat (TH). The TH has evolved substantially since that time and the current TH does not share the same internal configuration, but the insights gained from the assessment remain relevant. In virtually all architectures involving chemical, electric, or nuclear propulsion, the majority of the crew mission is spent aboard the TH. The Earth to Mars transit durations may vary from architecture to architecture, but all are on the order of hundreds of days, regardless of whether an opposition or conjunction class trajectory is selected, and regardless of whether the propulsion system is chemical, electric, or nuclear. Thus, the TH must provide capabilities appropriate to a very long duration. So, despite significant changes in the current Mars architecture over the past few years, this evaluation still provides useful recommendations in the form of habitability guidance that can be applied to current and future TH concepts. This assessment had six primary objectives: provide a sanity check to the BOC-derived TH layout; understand if we can fit the hardware and functional tasks in the volume; provide a high-level assessment of how aggressive the layout is; generate a list of challenges or assumptions necessary to make it work; generate a list of future work to refine understanding; and identify proposed requirements. All of this information is critical to drive habitat sizing studies and key architecture decisions. It was clear that a human-in-the-loop (HITL) evaluation of some kind would be necessary, but several challenges were immediately identified. The most information could be gleaned from a Desert Research and Technology Studies (DRATS) type of mission operations test (MOT), but the TH concept was too low fidelity to construct the type of prototype necessary to conduct a MOT, nor were their financial resources to do so. The next best option – and really the one most appropriate for the BOC’s stage of maturity – is a Virtual Reality (VR) walk-through evaluation. However, NASA was in a shutdown state due to the COVID-19 pandemic and the VR labs were inaccessible. As a result, a tabletop evaluation was created, using .jpg imagery from the ECM CAD model along with Excel-based datasheets. High-level crew living and working functions within the habitat were identified for evaluation. Questionnaires using Likert scales assessed acceptability of habitat functions and sim quality – the degree to which the function was represented in CAD. This enabled the evaluation to be conducted by personnel working remotely. Each function was evaluated individually along with several overarching habitability parameters and vehicle subsystems. The results of this evaluation are discussed, including methodological challenges and rating challenges. Acceptability results are discussed for functions that the participants were able to rate and participant comments for functions that could not be related are also described. Final conclusions are described, including challenges or assumptions needed to make the TH design acceptable, future work needed to refine understanding of the TH, and proposed habitat requirements based on test data.

Transit Habitat↗

NASA NTRS1996

Integrated Modeling Methodology Validation Using the Micro-Precision Interferometer Testbed

This paper validates the integrated modeling methodology used for design and performance evaluation of complex opto-mechanical systems, particularly spaceborne interferometers. The methodology integrates structural modeling, optical modeling, and control system design into a common environment, the Integrated Modeling of Optical Systems (IMOS) software package.

opto-mechanical↗

NASA NTRS2003

Exploration of Advanced Probabilistic and Stochastic Design Methods

The primary objective of the three year research effort was to explore advanced, non-deterministic aerospace system design methods that may have relevance to designers and analysts. The research pursued emerging areas in design methodology and leverage current fundamental research in the area of design decision-making, probabilistic modeling, and optimization. The specific focus of the three year investigation was oriented toward methods to identify and analyze emerging aircraft technologies in a consistent and complete manner, and to explore means to make optimal decisions based on this knowledge in a probabilistic environment. The research efforts were classified into two main areas. First, Task A of the grant has had the objective of conducting research into the relative merits of possible approaches that account for both multiple criteria and uncertainty in design decision-making. In particular, in the final year of research, the focus was on the comparison and contrasting between three methods researched. Specifically, these three are the Joint Probabilistic Decision-Making (JPDM) technique, Physical Programming, and Dempster-Shafer (D-S) theory. The next element of the research, as contained in Task B, was focused upon exploration of the Technology Identification, Evaluation, and Selection (TIES) methodology developed at ASDL, especially with regards to identification of research needs in the baseline method through implementation exercises. The end result of Task B was the documentation of the evolution of the method with time and a technology transfer to the sponsor regarding the method, such that an initial capability for execution could be obtained by the sponsor. Specifically, the results of year 3 efforts were the creation of a detailed tutorial for implementing the TIES method. Within the tutorial package, templates and detailed examples were created for learning and understanding the details of each step. For both research tasks, sample files and tutorials are attached in electronic form with the enclosed CD.

Marvis, Dimitri N.↗

NASA NTRS2003

Exploration of Advanced Probabilistic and Stochastic Design Methods

The primary objective of the three year research effort was to explore advanced, non-deterministic aerospace system design methods that may have relevance to designers and analysts. The research pursued emerging areas in design methodology and leverage current fundamental research in the area of design decision-making, probabilistic modeling, and optimization. The specific focus of the three year investigation was oriented toward methods to identify and analyze emerging aircraft technologies in a consistent and complete manner, and to explore means to make optimal decisions based on this knowledge in a probabilistic environment. The research efforts were classified into two main areas. First, Task A of the grant has had the objective of conducting research into the relative merits of possible approaches that account for both multiple criteria and uncertainty in design decision-making. In particular, in the final year of research, the focus was on the comparison and contrasting between three methods researched. Specifically, these three are the Joint Probabilistic Decision-Making (JPDM) technique, Physical Programming, and Dempster-Shafer (D-S) theory. The next element of the research, as contained in Task B, was focused upon exploration of the Technology Identification, Evaluation, and Selection (TIES) methodology developed at ASDL, especially with regards to identification of research needs in the baseline method through implementation exercises. The end result of Task B was the documentation of the evolution of the method with time and a technology transfer to the sponsor regarding the method, such that an initial capability for execution could be obtained by the sponsor. Specifically, the results of year 3 efforts were the creation of a detailed tutorial for implementing the TIES method. Within the tutorial package, templates and detailed examples were created for learning and understanding the details of each step. For both research tasks, sample files and tutorials are attached in electronic form with the enclosed CD.

Mavris, Dimitri N.↗

NASA NTRSDate not supplied

ASTM International Conference on Additive Manufacturing – 2022

The In-Situ Project: Correlating In-situ monitoring data and Non-Destructive Evaluation (NDE) methods to characterize defect populations in Laser Powder Bed Fusion (L-PBF) material NDE is critical to enable the safe use of additive manufactured (AM) parts in aerospace applications. However, traditional NDE methods are not fully adaptable to complex AM geometries to appropriately screen for critical defects, and L-PBF processes inherently generate defects. In-situ monitoring techniques can give information about the quality of the build process and indicate process variations that could potentially create defects. Proven, causal correlations between in-situ monitoring indications and resulting defects are needed to inform about the final quality of the part. Thus, the development of a new approach is necessary. NASA started a two-phase study that would investigate techniques for characterizing defect populations in L-PBF material, first in material with induced defects, then in a nominal L-PBF process, by correlating in-situ, NDE, and serial sectioning data. Objectives also include the evaluation of seeded defect methodologies for realistic defect creation, creating a baseline of defect populations in a Qualified Material Process (QMP), characterizing the effect of heat treatment, and correlating defect populations with tensile and fatigue properties. By comparing computed tomography images, in-situ monitoring images, and metallography images, the team has been able to draw preliminary conclusions. They include a better understanding of the limitation of the NDE tools, learning about the “healing” of the samples observed during layer building and a comparison study on different laser power variation samples. Those preliminary conclusions will help dictate the follow-up work that will be presented at the conference.

additive manufacturing↗

NASA NTRS2002

Individual thermal profiles as a basis for comfort improvement in space and other environments

BACKGROUND: The development of individualized countermeasures to address problems in thermoregulation is of considerable importance for humans in space and other extreme environments. A methodology is presented for evaluating minimal/maximal heat flux from the total human body and specific body zones, and for assessing individual differences in the efficiency of heat exchange from these body areas. The goal is to apply this information to the design of individualized protective equipment. METHODS: A multi-compartment conductive plastic tubing liquid cooling/warming garment (LCWG) was developed. Inlet water temperatures of 8-45 degrees C were imposed sequentially to specific body areas while the remainder of the garment was maintained at 33 degrees C. RESULTS: There were significant differences in heat exchange level among body zones in both the 8 degrees and 45 degrees C temperature conditions (p < 0.001). The greatest amount of heat was absorbed/released by the following areas: thighs (8 degrees C: -2.12 +/- 0.14 kcal min(-1); 45 degrees C: +1.58 +/- 0.23); torso (8 degrees C: -2.12 +/- 0.13 kcal min(-1); 45 degrees C: +1.31 +/- 0.27); calves (8 degrees C: -1.59 +/- 0.26 kcal min(-1); 45 degrees C: +1.53 +/- 0.24); and forearms (8 degrees C: -1.67 +/- 0.29 kcal x min(-1); 45 degrees C: +1.45 +/- 0.20). These are primarily zones with relatively large muscle mass and adipose tissue. Calculation of absorption/release heat rates standardized per unit tube length and flow rate instead of zonal surface area covered showed that there was significantly greater heat transfer in the head, hands, and feet (p < 0.001). The areas in which there was considerable between-subject variability in rates of heat transfer and thus most informative for individual profile design were the torso, thighs, shoulders, and calves or forearms. CONCLUSIONS: The methodology developed is sensitive to individual differences in the process of heat exchange and variations in different body areas, depending on their size and tissue mass content. The design of individual thermal profiles is feasible for better comfort of astronauts on long-duration missions and personnel in other extreme environments.

NASA Discipline Life Sciences Technologies↗

NASA NTRS1971

Contamination of planets by nonsterile flight hardware.

The various factors about space missions and spacecraft involved in the study of nonsterile space flight hardware with respect to their effects on planetary quarantine are reviewed. It is shown that methodology currently exists to evaluate the various potential contamination sources and to take appropriate steps in the design of spacecraft ha rdware and mission parameters so that quarantine constraints are met. This work should be done for each program so that the latest knowledge pertaining to various biological questions is utilized, and so that the specific hardware designs of the program can be assessed. The general trend of specific recommendations include: (1) biasing the launch trajectory away from planet to assure against accidental impact of the spacecraft; (2) selecting planetary orbits that meet quarantine requirements - both for accidental impact and for minimizing contamination probabilities due to ejecta; and (3) manufacturing and handling spacecraft under cleanliness conditions assuring minimum bioload.

Wolfson, R. P.↗

NASA NTRS1974

Geological photointerpretation of the Paraguana Peninsula using ERTS-A multispectral photography

A methodology was developed to evaluate multispectral analysis of orbital imagery on the interpretation of geology, coastal geomorphology and sedimentary processes. The images analyzed were obtained during the pass of ERTS satellite over the center region of Venezuela on October 19, 1972. ERTS-1 multispectral images in black and white paper copies and transparencies of the 4 bands and false color composites at scales of 1:1,000,000 and 1:500,000 were interpreted. Lithology and outcrop patterns of the following geological formations have been interpreted: igneous and metamorphic basement of Cocodite and Santa Ana, Jurassic-Cretaceous metamorphics of Pueblo Nuevo, Cantaure Miocene-Pliocene sediments, and Quaternary alluvium, dunes, beach ridges, bars and reefs. A prominent and extensive Paraguana tonal anomaly shaped as an 8 has been discovered at the NW of the Peninsula. Its erosional origin has exposed light toned lower beds at the center, with additional evidence of topographic depression and development of underground drainage of karst origin. Coastal geomorphology, its processes and energy has been interpreted with the help of wind direction analysis (ENE-WSW) at sea level through the orientation of transported materials (water vapor, water and sediments) by clouds, waves, sea current, plumes of suspended sediments associated to river outlets, dunes, sediment sources and shore-line orientation.

Albrizzio, C.↗

NASA NTRS1976

Design of a Mars entry 'aeroshell'

The external shell of the Project Viking capsule, which will provide atmospheric deceleration for the 1976 landing of an unmanned spacecraft on the surface of Mars, is a wide-angle, stiffened cone subject to buckling under entry aerodynamic pressure. Complex, highly optimized structural prototype and flight designs were evolved through the application of relatively advanced buckling analysis methodology. Both designs were evaluated through tests and analysis with improved shell-of-revolution computer programs. Deviations between the analyses and experiments were resolved only by modeling the thin-walled rings as shell branches. The results illustrate the great complexity of shell behavior and the designer's need for reliable analysis tools capable of representing detailed structural behavior with greater accuracy than is current practice.

Leonard, R. W.↗