Search NASASearch

SEARCH · Search NASA

Results for “evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

Evaluation of the NASA Artemis Regions of Interest for ISRU Water Mine Potential

The NASA Artemis Campaign has a stated goal to return to the Moon to maintain a sustainable presence; In-Situ Resource Utilization (ISRU) is a key part of sustainability. The regions of interest identified for the Artemis campaign are at Lunar the South Pole where water ice, a valuable resource for ISRU, has been identified. As such, a preliminary evaluation of the ISRU ice mining potential has been performed for of these regions of interest. A set of ground rules for this evaluation were developed to align with current assumptions for customer needs, hardware capabilities, an initially limited infrastructure, and lunar environments/terrain. These ground rules, and the evaluation of six regions of interest, are presented here. The site selections (ISRU and customer assets) and their associated traverses are notional and were intended only to provide a broad preliminary evaluation of the water ISRU potential of the regions. Evaluation of these regions are subject to change as decisions regarding utilization are made. Water ISRU is possible at all regions, though the degree to which each criterion are met is variable. The two regions near Shackleton ranked highest in this evaluation, while the de Gerlache region presented the most difficulties meeting the current criteria. The regions were not explicitly ranked due to the nuances associated with the high number of variables but evaluation summaries of each are presented. It should also be noted that all ISRU ‘mine’ sites in this analysis focused on smaller (few kilometer) size permanently shadowed regions (PSRs). This was necessary to meet proximity requirements between these PSRs and the highly illuminated regions needed for customers and ISRU processing. The areas identified in this study are meant to focus exploration and reconnaissance efforts needed to better evaluate the ISRU potential.

In-situ resource utilization

Evaluation of HVAC & refrigeration system fault behaviors and impacts: A systematic review

Achieving the goals of green buildings critically depends on the fault-free operation of heating, ventilation and air conditioning and refrigeration (HVAC&R) systems. However, faults frequently occur in these systems, causing a range of negative consequences, including increased energy consumption, diminished operational performance, compromised indoor environmental quality, higher operational costs, and shortened system lifespan. The evaluation of fault behaviors and impacts plays a critical role in revealing fault characteristics and consequently supports many research areas, including the design of the high-performance equipment, development of fault detection and diagnostics (FDD) and robust control approaches, as well as the enhancement of maintenance decision-making activities. This paper systematically reviews 112 research publications that reported the analysis and evaluation of fault behaviors and impacts in HVAC&R systems over the past thirty years. Here, we designed a review approach to address five crucial research questions, namely: 1) the objectives of analysis and evaluation of fault behaviors and impacts, 2) data sources, 3) equipment/system types and fault types, 4) evaluation methods including evaluation measures and associated metrics, and 5) challenges and future directions in the research on evaluating of fault behaviors and impacts. In-depth discussions on these questions help bridge the gap between the evaluation of fault behaviors and impacts and their practical applications, such as the development of high-performance systems, fault models, FDD methods, and maintenance decision-making tools within the HVAC&R FDD domain.

Chen, Yimin [Oak Ridge National Laboratory (ORNL),

Consistent $\overline{ν}$ evaluation for minor Pu isotopes with CGMF

This report follows up on the evaluation work done in 2023 where we developed a procedure and performed the first consistent evaluation of the average prompt neutron multiplicity for minor Pu isotopes, including 238,240-242 Pu, using CGMF. Details on the necessary updates to the release version of CGMF, the experimental data and experimental uncertainty quantification that went into the evaluation, and this first evaluation effort are documented in and will not be repeated in this report. Instead, we discuss here the further investigations into the CGMF model space to improve the evaluation results from FY23. Additionally, we note that these evaluation results have been transformed into the ENDF format for mean values and covariances, and validation with critical assemblies has been performed; that work is documented elsewhere. In this short report, we discuss the updated evaluation efforts performed during FY24 in Sec. 2, show results from CGMF for other prompt fission observables in Sec. 3, and then briefly conclude in Sec. 4.

07 ISOTOPE AND RADIATION SOURCES

Evaluation of high-voltage, high-power, solid-state remote power controllers for amps

The Electrical Power Branch at Marshall Space Flight Center has a Power System Development Facility where various power circuit breadboards are tested and evaluated. This project relates to the evaluation of a particular remote power controller (RPC) energizing high power loads. The Facility equipment permits the thorough testing and evaluation of high-voltage, high-power solid-state remote power controllers. The purpose is to evaluate a Type E, 30 Ampere, 200 V dc remote power controller. Three phases of the RPC evaluation are presented. The RPC is evaluated within a low-voltage, low-power circuit to check its operational capability. The RPC is then evaluated while performing switch/circuit breaker functions within a 200 V dc, 30 Ampere power circuit. The final effort of the project relates to the recommended procedures for installing these RPC's into the existing Autonomously Managed Power System (AMPS) breadboard/test facility at MSFC.

Callis, Charles P.

Evaluation of NASA space grant consortia programs

The meaningful evaluation of the NASA Space Grant Consortium and Fellowship Programs must overcome unusual difficulties: (1) the program, in its infancy, is undergoing dynamic change; (2) the several state consortia and universities have widely divergent parochial goals that defy a uniform evaluative process; and (3) the pilot-sized consortium programs require that the evaluative process be economical in human costs less the process of evaluation comprise the effectiveness of the programs they are meant to assess. This paper represents an attempt to assess the context in which evaluation is to be conducted, the goals and limitations inherent to the evaluation, and to recommend appropriate guidelines for evaluation.

Eisenberg, Martin A.

Postflight hardware evaluation 360T025 (RSRM-25, STS-46)

The final report for the Clearfield disassembly evaluation and a continuation of the KSC postflight assessment for the 360T025 (STS-46) Redesign Solid Rocket Motor (RSRM) flight set is presented. All observed hardware conditions were documented on PFOR's and are included in Appendices A through C. Appendices D and E contain the measurements and safety factor data for the nozzle and insulation components. Along with the KSC Ten-Day Postflight Hardware Evaluation Report (TWR-60687), a summary of the 360T025 hardware evaluation is provided. The as-flown hardware configuration is documented in TWR-60470. Disassembly evaluation photograph numbers are logged in TWA-1986. The 360T025 flight set disassembly evaluations described were performed at the RSRM Refurbishment Facility in Clearfield, Utah. The final factory joint demate occurred on 16 Mar. 1993. Detailed evaluations were performed in accordance with the Clearfield PEEP, TWR-50051, Revision A. All observations were compared against limits that are also defined in the PEEP. These limits outline the criteria for categorizing the observations as acceptable, reportable, or critical. Hardware conditions that were unexpected and/or determined to be reportable or critical were evaluated by the applicable CPT and tracked through the PFAR system.

Morgan, Ferral

Postflight hardware evaluation (RSRM-29, STS-54)

This document is the final report for the Clearfield disassembly evaluation and a continuation of the KSC postflight assessment for the RSRM-29 flight set. All observed hardware conditions were documented on PFOR's and are included in Appendices A, B, and C. Appendices D and E contain the measurements and safety factor data for the nozzle and insulation components. This report, along with the KSC Ten-Day Postflight Hardware Evaluation Report (TWR-64221), represents a summary of the RSRM-29 hardware evaluation. Disassembly evaluation photograph numbers are logged in TWA-1990. The RSRM-29 flight set disassembly evaluations described in this document were performed at the RSRM Refurbishment Facility in Clearfield, Utah. The final factory joint demate occurred on September 9, 1993. Detailed evaluations were performed in accordance with the Clearfield PEEP, TWR-50051, Revision A. All observations were compared against limits that are also defined in the PEEP. These limits outline the criteria for categorizing the observations as acceptable, reportable, or critical. Hardware conditions that were unexpected and/or determined to be reportable or critical were evaluated by the applicable CPT and tracked through the PFAR system.

Source record

Extra-Vehicular Activity (EVA) glove evaluation test protocol

One of the most critical components of a space suit is the gloves, yet gloves have traditionally presented significant design challenges. With continued efforts at glove development, a method for evaluating glove performance is needed. This paper presents a pressure-glove evaluation protocol. A description of this evaluation protocol, and its development is provided. The protocol allows comparison of one glove design to another, or any one design to bare-handed performance. Gloves for higher pressure suits may be evaluated at current and future design pressures to drive out differences in performance due to pressure effects. Using this protocol, gloves may be evaluated during design to drive out design problems and determine areas for improvement, or fully mature designs may be evaluated with respect to mission requirements. Several different test configurations are presented to handle these cases. This protocol was run on a prototype glove. The prototype was evaluated at two operating pressures and in the unpressurized state, with results compared to bare-handed performance. Results and analysis from this test series are provided, as is a description of the configuration used for this test.

Hinman-Sweeney, E. M.

Subjective evaluations of integer cosine transform compressed Galileo solid state imagery

This paper describes a study conducted for the Jet Propulsion Laboratory, Pasadena, California, using 15 evaluators from 12 institutions involved in the Galileo Solid State Imaging (SSI) experiment. The objective of the study was to determine the impact of integer cosine transform (ICT) compression using specially formulated quantization (q) tables and compression ratios on acceptability of the 800 x 800 x 8 monochromatic astronomical images as evaluated visually by Galileo SSI mission scientists. Fourteen different images in seven image groups were evaluated. Each evaluator viewed two versions of the same image side by side on a high-resolution monitor; each was compressed using a different q level. First the evaluators selected the image with the highest overall quality to support them in their visual evaluations of image content. Next they rated each image using a scale from one to five indicating its judged degree of usefulness. Up to four preselected types of images with and without noise were presented to each evaluator.

Haines, Richard F.

NASAwide electronic publishing system: Electronic printing and duplicating, stage-2 evaluation report (GSFC)

The NASA Scientific and Technical Information Office was assigned the responsibility to continue with the expansion of the NASAwide networked electronic duplicating effort by including the Goddard Space Flight Center (GSFC) as an additional node to the existing configuration of networked electronic duplicating systems within NASA. The subject of this report is the evaluation of a networked electronic duplicating system which meets the duplicating requirements and expands electronic publishing capabilities without increasing current operating costs. This report continues the evaluation reported in 'NASA Electronic Publishing System - Electronic Printing and Duplicating Evaluation Report' (NASA TM-106242) and 'NASA Electronic Publishing System - Stage 1 Evaluation Report' (NASA TM-106510). This report differs from the previous reports through the inclusion of an external networked desktop editing, archival, and publishing functionality which did not exist with the previous networked electronic duplicating system. Additionally, a two-phase approach to the evaluation was undertaken; the first was a paper study justifying a 90-day, on-site evaluation, and the second phase was to validate, during the 90-day evaluation, the cost benefits and productivity increases that could be achieved in an operational mode. A benchmark of the functionality of the networked electronic publishing system and external networked desktop editing, archival, and publishing system was performed under a simulated daily production environment. This report can be used to guide others in determining the most cost effective duplicating/publishing alternative through the use of cost/benefit analysis and return on investment techniques. A treatise on the use of these techniques can be found by referring to 'NASA Electronic Publishing System -Cost/Benefit Methodology' (NASA TM-106662).

Tuey, Richard C.

Formative and summative evaluation efforts for the Teacher Enhancement Institute conducted at the NASA Langley Research Center, summer 1994

The Teacher Enhancement Institute (TEI) at NASA Langley Research Center was developed in response to Executive Order 12821 which mandates national laboratories to 'assist in the mathematics and science education of our Nation's students, teachers, parents, and the public by establishing programs at their agency to provide for training elementary and secondary school teachers to improve their knowledge of mathematics and science. Such programs, to the maximum extent possible, shall involve partnerships with universities, state and local elementary and secondary school authorities, corporations and community based organizations'. The faculty worked closely with one another and the invited speakers to insure that the sessions supported the objectives. Speakers were informed of the objectives and given guidance concerning form and function for the session. Faculty members monitored sessions to assist speakers and to provide a quality control function. Faculty provided feedback to speakers concerning general objective accomplishment. Participant comments were also provided when applicable. Post TEI surveys asked for specific comments about each TEI session. During the second of the two, two week institutes, daily critiques were provided to the participants for their reflection. This seemed to provide much improved feedback to speakers and faculty because the sessions were fresh in each participant's mind. Between sessions one and two, some changes were made to the program as a result of the formative evaluation process. Those changes, though, were minor in nature and comprised what may be called 'fine tuning' a well conceived and implemented program. After the objectives were written, an assessment instrument was developed to test the accomplishment of the objectives. This instrument was actually two surveys, one given before the TEI and one given after the TEI. In using such a series, it was expected that changes in the participants induced by attendance at TEI may be discovered. Because the institute was limited in time and depth of exposure, attitudinal changes (self-assessment of ability and confidence) were chosen to be surveyed. On the pre-survey, seven general categories of questions were asked. The post-survey repeated three of these categories, providing a pre and post evaluation of the same questions and added a fourth category which asked the participant to self-assess objective accomplishment. The assessment process for TEI was valuable when one looks at the final accomplishments of the TEI. A number of aspects stand out: (1) formative evaluation during project development allowed the goals and objectives to guide the development of the institute; (2) formative evaluation provided positive guidance to presenters in developing and implementing their session; (3) formative evaluation helped presenters to improve or focus their sessions; (4) summative evaluation provided managers a way to gauge the success of the institute; (5) summative evaluation provided a benchmark for future programs to be measured against.

Carlson, Randal D.

Criteria for evaluation of grid generation systems

Many CFD grid generation systems are in use nationally, but few comparative studies have been performed to quantify their relative merits. A study was undertaken to systematically evaluate and select the best CFD grid generation codes available. Detailed evaluation criteria were established as the basis for the evaluation conducted. Descriptions of thirty-four separate criteria, grouped into eight general categories are provided. Benchmark test cases, developed to test basic features of selected codes, are described in detail. Scoring guidelines were generated to establish standards for measuring code capabilities, ensuring uniformity of ratings, and minimizing personal bias among the three code evaluators. Ten candidate codes were identified from government, industry, universities, and commercial software companies. A three phase evaluation was conducted. In Phase 1, ten codes identified were screened through conversations with code authors and other industry experts. Seven codes were carried forward into a Phase 2 evaluation in which all codes were scored according to the predefined criteria. Two codes emerged as being significantly better than the others: RAGGS and GRIDGEN. Finally, these two codes were carried forward into a Phase 3 evaluation in which complex 3-D multizone grids were generated to verify capability.

Ascoli, Edward P.

Computer-Based Tools for Evaluating Graphical User Interfaces

The user interface is the component of a software system that connects two very complex system: humans and computers. Each of these two systems impose certain requirements on the final product. The user is the judge of the usability and utility of the system; the computer software and hardware are the tools with which the interface is constructed. Mistakes are sometimes made in designing and developing user interfaces because the designers and developers have limited knowledge about human performance (e.g., problem solving, decision making, planning, and reasoning). Even those trained in user interface design make mistakes because they are unable to address all of the known requirements and constraints on design. Evaluation of the user inter-face is therefore a critical phase of the user interface development process. Evaluation should not be considered the final phase of design; but it should be part of an iterative design cycle with the output of evaluation being feed back into design. The goal of this research was to develop a set of computer-based tools for objectively evaluating graphical user interfaces. The research was organized into three phases. The first phase resulted in the development of an embedded evaluation tool which evaluates the usability of a graphical user interface based on a user's performance. An expert system to assist in the design and evaluation of user interfaces based upon rules and guidelines was developed during the second phase. During the final phase of the research an automatic layout tool to be used in the initial design of graphical inter- faces was developed. The research was coordinated with NASA Marshall Space Flight Center's Mission Operations Laboratory's efforts in developing onboard payload display specifications for the Space Station.

Moore, Loretta A.

Ergonomic Evaluation of the Foot Restraint Equipment Device (FRED)

Within the scope of the Microgravity Workstation and Restraint Evaluation project, funded by the NASA Headquarters Life Sciences Division, evaluations were proposed to be conducted in ground, KC-135, and/or Shuttle environments to investigate the human factors engineering (HFE) issues concerning confined/unique workstations, including crew restraint requirements. As part of these evaluations, KC-135 flights were conducted to investigate user/ workstation/ restraint integration for microgravity use of the FRED with the RMS workstation. This evaluation was a pre-cursor to Detailed Supplementary Objective (DSO) - 904 on STS-88. On that mission, a small-statured astronaut will be using the FRED restraint while working at the Aft RMS workstation. The DSO will collect video for later posture analyses, as well as subjective data in the form of an electronic questionnaire. This report describes the current FRED KC-135 evaluations. The primary objectives were to evaluate the usability of the FRED and to verify the DSO in-flight setup. The restraint interface evaluation consisted of four basic areas of restraint use: 1) adjustability; 2) general usability and comfort; 3) usability at the RMS workstation; and 4) assembly and disassembly.

Whitmore, Mihriban

Rainfall Product Evaluation for the TRMM Ground Validation Program

Evaluation of the Tropical Rainfall Measuring Mission (TRMM) satellite observations is conducted through a comprehensive Ground Validation (GV) Program. Standardized instantaneous and monthly rainfall products are routinely generated using quality-controlled ground based radar data from four primary GV sites. As part of the TRMM GV program, effort is being made to evaluate these GV products and to determine the uncertainties of the rainfall estimates. The evaluation effort is based on comparison to rain gauge data. The variance between the gauge measurement and the true averaged rain amount within the radar pixel is a limiting factor in the evaluation process. While monthly estimates are relatively simple to evaluate, the evaluation of the instantaneous products are much more of a challenge. Scattegrams of point comparisons between radar and rain gauges are extremely noisy for several reasons (e.g. sample volume discrepancies, timing and navigation mismatches, variability of Z(sub e)-R relationships), and therefore useless for evaluating the estimates. Several alternative methods, such as the analysis of the distribution of rain volume by rain rate as derived from gauge intensities and from reflectivities above the gauge network will be presented. Alternative procedures to increase the accuracy of the estimates and to reduce their uncertainties also will be discussed.

Amitai, E.

Coordinating Multi-Rover Systems: Evaluation Functions for Dynamic and Noisy Environments

This paper addresses the evolution of control strategies for a collective: a set of entities that collectively strives to maximize a global evaluation function that rates the performance of the full system. Directly addressing such problems by having a population of collectives and applying the evolutionary algorithm to that population is appealing, but the search space is prohibitively large in most cases. Instead, we focus on evolving control policies for each member of the collective. The fundamental issue in this approach is how to create an evaluation function for each member of the collective that is both aligned with the global evaluation function and is sensitive to the fitness changes of the member, while relatively insensitive to the fitness changes of other members. We show how to construct evaluation functions in dynamic, noisy and communication-limited collective environments. On a rover coordination problem, a control policy evolved using aligned and member-sensitive evaluations outperfoms global evaluation methods by up to 400%. More notably, in the presence of a larger number of rovers or rovers with noisy and communication limited sensors, the proposed method outperforms global evaluation by a higher percentage than in noise-free conditions with a small number of rovers.

Turner, Kagan

Field Evaluations Test Plan for Validation of Alternative Low-Emission Surface Preparation/Depainting Technologies for Structural Steel

Headquarters National Aeronautics and Space Administration (NASA) chartered the Acquisition Pollution Prevention (AP2) Office to coordinate agency activities affecting pollution prevention issues identified during system and component acquisition and sustainment processes. The primary objectives of the AP2 Office are to: (1) Reduce or eliminate the use of hazardous materials (HazMats) or hazardous processes at manufacturing, remanufacturing, and sustainment locations. (2) Avoid duplication of effort in actions required to reduce or eliminate HazMats through joint center cooperation and technology sharing. To achieve a substrate condition suitable for the application of a coating system, both new and old (in-situ) substrates must undergo some type of surface preparation and/or depainting operation to ensure adhesion of the new coating system. The level of cleanliness or anchor profile desired is typically a function of the type of coating to be applied and the specification being adhered to. In high performance environments, cleanliness and surface profile requirements for carbon steel (the dominant substrate for facilities, structures and equipment) dictates the use of abrasive media. Many of the abrasive media currently used across NASA and Air Force Space Command (AFSPC) installations generate large quantities of fugitive particulate emissions and waste. The high quantities of airborne dust and waste generated from these operations pose significant environmental concern. Efforts to contain emissions and the reduce quantity of waste generated have significant implications on project cost; this is often a deterrent to engaging in maintenance activities. In response to recent technological developments and NASA's and AFSPC's need to undertake environmentally conscious corrosion prevention projects, a review of the industry needs to be undertaken to evaluate surface preparation technologies (materials and processes) for embrace. This project will identify, evaluate and approve alternative surface preparation technologies for use at NASA and AFSPC installations. Materials and processes will be evaluated with the goal of selecting those processes that will improve corrosion protection at critical systems, facilitate easier maintenance activity, extend maintenance cycles, eliminate flight hardware contamination and reduce the amount of hazardous waste generated. This Field Evaluations Test Plan defines the field evaluation and testing requirements for validating alternative surface preparation/depainting technologies and supplements the JTP. The field evaluations will be performed at Stennis Space Center, Mississippi, under the oversight of the Project Engineer. Additional field evaluations may be performed at other NASA centers or AFSPC facilities.

Lewis, Pattie

A Tool for the Automated Design and Evaluation of Habitat Interior Layouts

The objective of space habitat design is to minimize mass and system size while providing adequate space for all necessary equipment and a functional layout that supports crew health and productivity. Unfortunately, development and evaluation of interior layouts is often ignored during conceptual design because of the subjectivity and long times required using current evaluation methods (e.g., human-in-the-loop mockup tests and in-depth CAD evaluations). Early, more objective assessment could prevent expensive design changes that may increase vehicle mass and compromise functionality. This paper describes a new interior design evaluation method to enable early, structured consideration of habitat interior layouts. This interior layout evaluation method features a comprehensive list of quantifiable habitat layout evaluation criteria, automatic methods to measure these criteria from a geometry model, and application of systems engineering tools and numerical methods to construct a multi-objective value function measuring the overall habitat layout performance. In addition to a detailed description of this method, a C++/OpenGL software tool which has been developed to implement this method is also discussed. This tool leverages geometry modeling coupled with collision detection techniques to identify favorable layouts subject to multiple constraints and objectives (e.g., minimize mass, maximize contiguous habitable volume, maximize task performance, and minimize crew safety risks). Finally, a few habitat layout evaluation examples are described to demonstrate the effectiveness of this method and tool to influence habitat design.

Simon, Matthew A.