Search NASA⌕ Search

SEARCH · Search NASA

Results for “evaluation methodology”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 361 records · Page 20

Proposed Objective Odor Control Test Methodology for Waste Containment

The Orion Cockpit Working Group has requested that an odor control testing methodology be proposed to evaluate the odor containment effectiveness of waste disposal bags to be flown on the Orion Crew Exploration Vehicle. As a standardized "odor containment" test does not appear to be a matter of record for the project, a new test method is being proposed. This method is based on existing test methods used in industrial hygiene for the evaluation of respirator fit in occupational settings, and takes into consideration peer reviewed documentation of human odor thresholds for standardized contaminates, industry stardnard atmostpheric testing methodologies, and established criteria for laboratory analysis. The proposed methodology is quantitative, though it can readily be complimented with a qualitative subjective assessment. Isoamyl acetate (IAA - also known at isopentyl acetate) is commonly used in respirator fit testing, and there are documented methodologies for both measuring its quantitative airborne concentrations. IAA is a clear, colorless liquid with a banana-like odor, documented detectable smell threshold for humans of 0.025 PPM, and a 15 PPB level of quantation limit.

Vos, Gordon↗

Evaluation of Fast-Time Wake Vortex Models using Wake Encounter Flight Test Data

This paper describes a methodology for the integration and evaluation of fast-time wake models with flight data. The National Aeronautics and Space Administration conducted detailed flight tests in 1995 and 1997 under the Aircraft Vortex Spacing System Program to characterize wake vortex decay and wake encounter dynamics. In this study, data collected during Flight 705 were used to evaluate NASA's fast-time wake transport and decay models. Deterministic and Monte-Carlo simulations were conducted to define wake hazard bounds behind the wake generator. The methodology described in this paper can be used for further validation of fast-time wake models using en-route flight data, and for determining wake turbulence constraints in the design of air traffic management concepts.

Ahmad, Nashat N.↗

Functional Volume Assessment of an Early Version of the Mars Transit Habitat

During the summer of 2020, the NASA Mars Architecture Team (MAT) assessed the Enhanced Habitation Capability (EHC), the transit spacecraft that was part of what was then the current Mars human exploration architecture, the Basis of Comparison (BOC). This assessment had six primary objectives: provide a sanity check to the BOC-derived EHC layout; understand if we can fit the hardware and functional tasks in the volume; provide a high-level assessment of how aggressive the layout is; generate a list of challenges or assumptions necessary to make it work; generate a list of future work to refine understanding; and identify proposed requirements. The results of this evaluation are discussed, including methodological challenges and rating challenges. Acceptability results are discussed for functions that the participants were able to rate and participant comments for functions that could not be evaluated are also described. Final conclusions are described, including challenges or assumptions needed to make the EHC design acceptable, future work needed to refine understanding of the EHC, and proposed habitat requirements based on test data. While NASA has since moved away from the BOC architecture, this assessment is still useful to inform the design of future Transit Habitats.

Mars Transit Habitat↗

Functional Volume Assessment of an Early Version of the Mars Transit Habitat

During the summer of 2020, NASA assessed the transit habitat concept that was being used in Mars human exploration architecture studies. This assessment had six primary objectives: (1) provide a sanity check to the transit habitat concept layout; (2) understand if we can fit the hardware and functional tasks in the volume; (3) provide a high-level assessment of how aggressive the layout is; (4) generate a list of challenges or assumptions necessary to make it work; (5) generate a list of future work to refine understanding; and (6) identify proposed requirements. The results of this evaluation are discussed, including methodological challenges and rating challenges. Acceptability results are discussed for functions that the participants were able to rate and participant comments for functions that could not be evaluated are also described. Final conclusions are described, including challenges or assumptions needed to make the transit habitat concept design acceptable, future work needed to refine understanding of the transit habitat concept, and proposed habitat requirements based on test data. While NASA has since moved away from this architecture, the assessment is still useful to inform the design of future transit habitats or other deep space crewed vehicles.

Transit Habitat↗

Structural Optimization Methodology for Rotating Disks of Aircraft Engines

In support of the preliminary evaluation of various engine technologies, a methodology has been developed for structurally designing the rotating disks of an aircraft engine. The structural design methodology, along with a previously derived methodology for predicting low-cycle fatigue life, was implemented in a computer program. An interface computer program was also developed that gathers the required data from a flowpath analysis program (WATE) being used at NASA Lewis. The computer program developed for this study requires minimum interaction with the user, thus allowing engineers with varying backgrounds in aeropropulsion to successfully execute it. The stress analysis portion of the methodology and the computer program were verified by employing the finite element analysis method. The 10th- stage, high-pressure-compressor disk of the Energy Efficient Engine Program (E3) engine was used to verify the stress analysis; the differences between the stresses and displacements obtained from the computer program developed for this study and from the finite element analysis were all below 3 percent for the problem solved. The computer program developed for this study was employed to structurally optimize the rotating disks of the E3 high-pressure compressor. The rotating disks designed by the computer program in this study were approximately 26 percent lighter than calculated from the E3 drawings. The methodology is presented herein.

Armand, Sasan C.↗

Cryogenic Quenching Process for Electronic Part Screening

The use of electronic parts at cryogenic temperatures (less than 100 C) for extreme environments is not well controlled or developed from a product quality and reliability point of view. This is in contrast to the very rigorous and well-documented procedures to qualify electronic parts for mission use in the 55 to 125 C temperature range. A similarly rigorous methodology for screening and evaluating electronic parts needs to be developed so that mission planners can expect the same level of high reliability performance for parts operated at cryogenic temperatures. A formal methodology for screening and qualifying electronic parts at cryogenic temperatures has been proposed. The methodology focuses on the base physics of failure of the devices at cryogenic temperatures. All electronic part reliability is based on the bathtub curve, high amounts of initial failures (infant mortals), a long period of normal use (random failures), and then an increasing number of failures (end of life). Unique to this is the development of custom screening procedures to eliminate early failures at cold temperatures. The ability to screen out defects will specifically impact reliability at cold temperatures. Cryogenic reliability is limited by electron trap creation in the oxide and defect sites at conductor interfaces. Non-uniform conduction processes due to process marginalities will be magnified at cryogenic temperatures. Carrier mobilities change by orders of magnitude at cryogenic temperatures, significantly enhancing the effects of electric field. Marginal contacts, impurities in oxides, and defects in conductor/conductor interfaces can all be magnified at low temperatures. The novelty is the use of an ultra-low temperature, short-duration quenching process for defect screening. The quenching process is designed to identify those defects that will precisely (and negatively) affect long-term, cryogenic part operation. This quenching process occurs at a temperature that is at least 25 C colder than the coldest expected operating temperature. This quenching process is the opposite of the standard burn-in procedure. Normal burn-in raises the temperature (and voltage) to activate quickly any possible manufacturing defects remaining in the device that were not already rejected at a functional test step. The proposed inverse burn-in or quenching process is custom-tailored to the electronic device being used. The doping profiles, materials, minimum dimensions, interfaces, and thermal expansion coefficients are all taken into account in determining the ramp rate, dwell time, and temperature.

Sheldon, Douglas J.↗

Modeling and life prediction methodology for Titanium Matrix Composites subjected to mission profiles

Titanium matrix composites (TMC) are being evaluated as structural materials for elevated temperature applications in future generation hypersonic vehicles. In such applications, TMC components are subjected to complex thermomechanical loading profiles at various elevated temperatures. Therefore, thermomechanical fatigue (TMF) testing, using a simulated mission profile, is essential for evaluation and development of life prediction methodologies. The objective of the research presented in this paper was to evaluate the TMF response of the (0/90)2s SCS-6/Timetal-21S subjected to a generic hypersonic flight profile and its portions with a temperature ranging from -130 C to 816 C. It was found that the composite modulus, prior to rapid degradation, had consistent values for all the profiles tested. A micromechanics based analysis was used to predict the stress-strain response of the laminate and of the constituents in each ply during thermomechanical loading conditions by using only constituent properties as input. The fiber was modeled as elastic with transverse orthotropic and temperature dependent properties. The matrix was modeled using a thermoviscoplastic constitutive relation. In the analysis, the composite modulus degradation was assumed to result from matrix cracking and was modeled by reducing the matrix modulus. Fatigue lives of the composite subjected to the complex generic hypersonic flight profile were well correlated using the predicted stress in 0 degree fibers.

Mirdamadi, M.↗

Reliability models for Space Station power system

This paper presents a methodology for the reliability evaluation of Space Station power system. The two options considered are the photovoltaic system and the solar dynamic system. Reliability models for both of these options are described along with the methodology for calculating the reliability indices.

Singh, C.↗

Development of an Information Fusion System for Engine Diagnostics and Health Management

Aircraft gas-turbine engine data are available from a variety of sources including on-board sensor measurements, maintenance histories, and component models. An ultimate goal of Propulsion Health Management (PHM) is to maximize the amount of meaningful information that can be extracted from disparate data sources to obtain comprehensive diagnostic and prognostic knowledge regarding the health of the engine. Data Fusion is the integration of data or information from multiple sources, to achieve improved accuracy and more specific inferences than can be obtained from the use of a single sensor alone. The basic tenet underlying the data/information fusion concept is to leverage all available information to enhance diagnostic visibility, increase diagnostic reliability and reduce the number of diagnostic false alarms. This paper describes a basic PHM Data Fusion architecture being developed in alignment with the NASA C17 Propulsion Health Management (PHM) Flight Test program. The challenge of how to maximize the meaningful information extracted from disparate data sources to obtain enhanced diagnostic and prognostic information regarding the health and condition of the engine is the primary goal of this endeavor. To address this challenge, NASA Glenn Research Center (GRC), NASA Dryden Flight Research Center (DFRC) and Pratt & Whitney (P&W) have formed a team with several small innovative technology companies to plan and conduct a research project in the area of data fusion as applied to PHM. Methodologies being developed and evaluated have been drawn from a wide range of areas including artificial intelligence, pattern recognition, statistical estimation, and fuzzy logic. This paper will provide a broad overview of this work, discuss some of the methodologies employed and give some illustrative examples.

Volponi, Allan J.↗

A Methodology for Writing High Quality Requirement Specifications and for Evaluating Existing Ones

Requirements development and management have always been critical in the implementation of software systems-engineers are unable to build what analysts can not define. It is generally accepted that the earlier in the life cycle potential risks are identified the easier it is to eliminate or manage the conditions that introduce that risk. Problems that are not found until testing are approximately 14 times more costly to fix than if the problem was found in the requirement phase. The requirements specification, as the first tangible representation of the capability to be produced, establishes the basis for all of the project's engineering management and assurance functions. If the quality of the requirements specification is poor it can give rise to risks in all areas of the project. Recently, automated tools have become available to support requirements management. The use of these tools not only provides support in the definition and tracing of requirements, but it also opens the door to effective use of metrics in characterizing and assessing the quality of the requirement specifications.

Rosenberg, Linda↗

Evaluation of Contact Separation Force Testing as a Screening Methodology for Electrical Socket Contacts

During system level testing intermittent and permanent open circuit failures of mated, crimp removable, electrical contact pairs were experienced. The root cause of the failures was determined to be low (but not zero) contact forces applied by the socket contact tines against the engaging pin. The low contact force reduces the effectiveness of the wiping action of the socket tines against the pin. The observed failure mode may be produced when insufficient wiping during mate, demate and small relative movement in use allows for the accumulation of debris or insulating films that electrically separate the contact pair. The investigation identified at least three manufacturing process control problems associated with the socket contacts that enabled shipment of contacts susceptible to developing low contact forces: (1) Improper heat treatment of the socket tines resulting in plastic rather than elastic behavior; (2) Overly thinned socket tines at their base resulting in reduced pin retention forces; (3) Insufficient screening tests to identify parts susceptible to the aforementioned failure mechanisms. The results from an extensive screening program of socket contacts utilizing the industry standard contact separation force test procedures are described herein. The investigation shows this method to be capable of identifying initially weak sockets. However, sockets whose contact retention forces may degrade during use may not be screened out by pin retention testing alone. Further investigations are required to correlate low contact retention forces with increased electrical contact resistance in the presence of insulating films that may accumulate in the use environment.

Christopher Green↗

Overview of Liner Activities in Support of the International Forum for Aviation Research

This paper provides an overview of liner research being conducted by members of the International Forum for Aviation Research (IFAR). The IFAR consists of representatives from a number of national research labs and is established to enable information exchange on aviation research activities. NASA has provided three challenges that explore different aspects of acoustic liner research, and will compile the results from each of the partners into a common database when the challenges are completed. The goal of the first challenge is to compare experimental methods applied at different national labs for acoustic liner evaluation, and to compare impedance eduction methodologies for uniform liners. The second challenge is to evaluate the ability of 3D propagation codes to predict the effects of spanwise variable-impedance liners on the acoustic pressure field. The third challenge is to explore different approaches to simultaneously educe the impedances for each zone of a three-zone liner. Each challenge is intended to be conducted as a blind test. Thus, only representative results achieved by the NASA Liner Physics Team for each of the three challenges are presented herein. When the results from all participants are available, the compiled results are intended to be provided in future reports.

Jones, Michael G.↗

Evolution of the Next Exploration Toilet through Human-in-the-Loop (HITL) Testing

Human waste collection in space is a unique and necessary function that all crewmembers must perform. The variability in how each crewmember uses the toilet to urinate and defecate introduces complexities and challenges with regards to overall hardware design. Because of this variability, it is important to consider crew inputs in all aspects of a toilet design especially with regards to crew interfaces that could impact overall waste collection. Access to crew feedback is essential to the design process and should be considered early and often through the various design phases. In 2020, NASA started a project for the Human Landing System (HLS) program to develop a Government Furnished Equipment (GFE) toilet option. The project is known as the Lavatory On-Orbit (LOO). During the early development of the LOO, the project team conducted several crew evaluations to collect and summarize valuable crew feedback on system design, function, and overall usability to influence the next design iteration. Because every person could use the system differently in space, it was extremely important to collect and analyze the data in a very methodical manner to appropriately influence the design based on the evaluation results. Establishing a standard process ensures consistent data collection from one evaluation to another, helps to maintain privacy for each test subject’s inputs and removes any potential bias from test subject to test subject. To date, the team has completed four crew evaluations on prototypes for the different LOO hardware. This paper will summarize the methodology used to conduct the evaluations as well as how data was collected and analyzed. The paper will also provide details on each of the evaluations and how the design was updated based on the results.

toilet↗

Evolution of the Next Exploration Toilet Through Human-in-the-Loop (HITL) Testing

Human waste collection in space is a unique and necessary function that all crewmembers must perform. The variability in how each crewmember uses the toilet to urinate and defecate introduces complexities and challenges with regards to overall hardware design. Because of this variability, it is important to consider crew inputs in all aspects of a toilet design especially with regards to crew interfaces that could impact overall waste collection. Access to crew feedback is essential to the design process and should be considered early and often through the various design phases. In 2020, NASA started a project for the Human Landing System (HLS) program to develop a Government Furnished Equipment (GFE) toilet option. The project is known as the Lavatory On-Orbit (LOO). During the early development of the LOO, the project team conducted several crew evaluations to collect and summarize valuable crew feedback on system design, function, and overall usability to influence the next design iteration. Because every person could use the system differently in space, it was extremely important to collect and analyze the data in a very methodical manner to appropriately influence the design based on the evaluation results. Establishing a standard process ensures consistent data collection from one evaluation to another, helps to maintain privacy for each test subject’s inputs and removes any potential bias from test subject to test subject. To date, the team has completed four crew evaluations on prototypes for the different LOO hardware. This paper will summarize the methodology used to conduct the evaluations as well as how data was collected and analyzed. The paper will also provide details on each of the evaluations and how the design was updated based on the results.

toilet↗

Cost-benefit analysis of space technology

A discussion of the implications and problems associated with the use of cost-benefit techniques is presented. Knowledge of these problems is useful in the structure of a decision making process. A methodology of cost-benefit analysis is presented for the evaluation of space technology. The use of the methodology is demonstrated with an evaluation of ion thrusters for north-south stationkeeping aboard geosynchronous communication satellites. A critique of the concept of consumers surplus for measuring benefits is also presented.

Hein, G. F.↗

A Formal Approach for Designing and Evaluating Procedures

Operator interaction with modern control systems is a topic of great concern in high-risk industries such as nuclear power and commercial aviation. The issues associated with such systems focus on the ability of the operators (e.g., pilots) to achieve mission goals safely while containing failures. Operators must be able to interact safely and reliably with highly automatic and complex systems across the full spectrum of possible operating conditions, including normal, abnormal, and emergency situations. In environments such as commercial aviation, operator interaction with the machine is specified through a set of standard operating procedures (SOP). A procedure represents a collective agreement on the 'best' way to perform a given task. The intent of this paper is to suggest a formal methodology, for designing and evaluating procedures, that is both reliable and systematic. Our approach involves two major elements: a model of the machine and a list of the operator's task specifications (goals). We use formal modeling paradigms for describing the system and super-imposing on it the operator's tasks. Such paradigms, based on recent frameworks such as Statecharts and Hierarchical Hybrid Machines appear to be adequate methods for analyzing operator interaction with modern control systems. To illustrate this methodology, we model and analyze the sequence of actions for an emergency procedure. The procedure, Irregular Engine Start, for a medium-range aircraft, specifies the sequence of immediate actions that must be performed by the crew to avoid an uncontrolled rise in engine temperature during start-up. A model of engine behavior during a hot start is constructed. It also describes the various actions that can be taken by the crew and the resulting outcomes. The model is then opened up as a tree of all possible action sequences. This action tree allows us to trace the correct sequences necessary to achieve the desired end-goal (secure and shut down of the engine). In conclusion, we argue that the current process of designing and evaluating procedures can be improved. We discuss the implications of this approach for designing and evaluating this and other types of procedures. We conclude with insights about the benefits and limitation of this methodology, and offer suggestions for future research.

Degani, Asaf↗

Fuel Cell Airframe Integration Study for Short-Range Aircraft: Aircraft Propulsion and Subsystems Integration Evaluation - Volume 1

The objective of this study is to define the functionality and evaluate the propulsion and power system benefits derived from a Solid Oxide Fuel Cell (SOFC) based Auxiliary Power Unit (APU) for a future short range commercial aircraft, and to define the technology gaps to enable such a system. United Technologies Corporation (UTC) Integrated Total Aircraft Power System (ITAPS) methodologies were used to evaluate a baseline aircraft and several SOFC architectures. The technology benefits were captured as reductions of the mission fuel burn, life cycle cost, noise and emissions. As a result of the study, it was recognized that system integration is critical to maximize benefits from the SOFC APU for aircraft application. The mission fuel burn savings for the two SOFC architectures ranged from 4.7 percent for a system with high integration to 6.7 percent for a highly integrated system with certain technological risks. The SOFC APU itself produced zero emissions. The reduction in engine fuel burn achieved with the SOFC systems also resulted in reduced emissions from the engines for both ground operations and in flight. The noise level of the baseline APU with a silencer is 78 dBA, while the SOFC APU produced a lower noise level. It is concluded that a high specific power SOFC system is needed to achieve the benefits identified in this study. Additional areas requiring further development are the processing of the fuel to remove sulfur, either on board or on the ground, and extending the heat sink capability of the fuel to allow greater waste heat recovery, resolve the transient electrical system integration issues, and identification of the impact of the location of the SOFC and its size on the aircraft.

Gummalla, Mallika↗

Technology advances for Space Shuttle processing

One of the major initial tasks of the Space Systems Integration and Operations Research Applications (SIORA) Program was the application of automation and robotics technology to all aspects of the Shuttle tile processing and inspection system. The SIORA Program selected a nonlinear systems engineering methodology which emphasizes a team approach for defining, developing, and evaluating new concepts and technologies for the operational system. This is achieved by utilizing rapid prototyping testbeds whereby the concepts and technologies can be iteratively tested and evaluated by the team. The present methodology has clear advantages for the design of large complex systems as well as for the upgrading and evolution of existing systems.

Wiskerchen, M. J.↗