Search NASA⌕ Search

SEARCH · Search NASA

Results for “evaluation methodology”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14
All sourcesNASA NTRSDOE OSTI
DOE OSTI2026

Seasonal performance evaluation of zero-superheat active refrigerant charge control for variable-speed heat pumps

Heat pumps account for a significant portion of electricity consumption in buildings, making their energy efficiency a critical area of research. Control optimization is recognized as an effective approach for enhancing the efficiency of building HVAC systems. Specifically, since the efficiency of heat pumps increases with reduced superheat and the optimal refrigerant charge level varies with operating conditions, zero-superheat active charge control is a promising strategy to maximize the system’s COP. However, due to its complexity, this control strategy remains in the research phase and has only been tested under limited operating conditions. This paper proposes a methodology to evaluate the seasonal performance improvement of zero-superheat active charge control across a full range of heating conditions in buildings. The methodology includes the development of an optimal controller that utilizes an accumulator to store excess refrigerant and manages the active charge level at zero superheat through subcooling control, as well as the creation of a detailed physics-based heat pump model. Targeted a 3-ton variable-speed heat pump with R410A refrigerant, we selected ten U.S. cities representing different climate regions for seasonal performance evaluation. Our simulations indicate that, depending on the climate conditions, the optimal control strategy could achieve energy savings ranging from 5.8 % to 8.0 % over the entire heating season. These results suggest that zero-superheat active charge control, combined with coordinated compressor and fan speeds, could substantially improve the energy efficiency of heat pump systems while maintaining the required heating capacity.

Guo, Fangzhou↗
NASA NTRS1983

Investigation of indigenous water, salt and soil for solar ponds

The existence of salt-gradient solar ponds in nature is a strong indication that the successful exploitation of this phenomenon must account adequately for the influences of the local setting. Sun, weather and other general factors are treated elsewhere. This paper deals with water, salt, and soil. A general methodology for evaluating and, where feasible, adjusting the effects of these elements is under development. Eight essential solar pond characteristics have been identified, along with a variety of their dependencies upon properties of water, salt and soil. The comprehensive methodology, when fully developed, will include laboratory investigation in such diverse areas as brine physical chemistry, light transmission, water treatment, brine-soil interactions, sealants, and others. With the Salton Sea solar pond investigation as an example, some methods under development will be described.

Marsh, H. E.↗
NASA NTRS1996

UNIX-based operating systems robustness evaluation

Robust operating systems are required for reliable computing. Techniques for robustness evaluation of operating systems not only enhance the understanding of the reliability of computer systems, but also provide valuable feed- back to system designers. This thesis presents results from robustness evaluation experiments on five UNIX-based operating systems, which include Digital Equipment's OSF/l, Hewlett Packard's HP-UX, Sun Microsystems' Solaris and SunOS, and Silicon Graphics' IRIX. Three sets of experiments were performed. The methodology for evaluation tested (1) the exception handling mechanism, (2) system resource management, and (3) system capacity under high workload stress. An exception generator was used to evaluate the exception handling mechanism of the operating systems. Results included exit status of the exception generator and the system state. Resource management techniques used by individual operating systems were tested using programs designed to usurp system resources such as physical memory and process slots. Finally, the workload stress testing evaluated the effect of the workload on system performance by running a synthetic workload and recording the response time of local and remote user requests. Moderate to severe performance degradations were observed on the systems under stress.

Chang, Yu-Ming↗
NASA NTRS1979

The value of improved telecommunications service to hospitals: A preliminary assessment

In view of the rapid rate of development of domestic telecommunication services and the emphasis on private networks, it was sought to determine if hospitals had major requirements which could be aggregated and served by such networks. The value of the information transfer services judged to be most promising over the next twenty years was evaluated, based on expenditures and activity levels in five hospitals and one management services firm and the judgement of their senior staff. An implicit assumption is that services will become affordable once the hospital industry aggregates its requirements. A methodology to evaluate the value of telecommunication services in a hospital was developed and tested.

Potter, J. G.↗
NASA NTRS1990

Evaluation of a proposed expert system development methodology: Two case studies

Two expert system development projects were studied to evaluate a proposed Expert Systems Development Methodology (ESDM). The ESDM was developed to provide guidance to managers and technical personnel and serve as a standard in the development of expert systems. It was agreed that the proposed ESDM must be evaluated before it could be adopted; therefore a study was planned for its evaluation. This detailed study is now underway. Before the study began, however, two ongoing projects were selected for a retrospective evaluation. They were the Ranging Equipment Diagnostic Expert System (REDEX) and the Backup Control Mode Analysis and Utility System (BCAUS). Both projects were approximately 1 year into development. Interviews of project personnel were conducted, and the resulting data was used to prepare the retrospective evaluation. Decision models of the two projects were constructed and used to evaluate the completeness and accuracy of key provisions of ESDM. A major conclusion reached from these case studies is that suitability and risk analysis should be required for all AI projects, large and small. Further, the objectives of each stage of development during a project should be selected to reduce the next largest area of risk or uncertainty on the project.

Gilstrap, Lewey↗
DOE OSTI2023

Uncertainties and Limitations of Experimental Thrust and Pressure Gain Measurements in a Rotating Detonation Combustor

Experimentally measuring the pressure gain through the method of equivalent available pressure is prone to many experimental uncertainties. This study performs a detailed uncertainty analysis of the thrust and pressure gain measurements utilizing data from a H2/air operated rotating detonation combustor with an axial air inlet and a 50% exit constriction. The measured (negative) pressure gain values agree with the results in literature for similar inlet-to-exit area ratios. Specific considerations are given to the uncertainty in thrust measurement introduced by the base drag correction on the inner-body. The assumed unity Mach number utilized in the equivalent available pressure methodology is evaluated experimentally with two different methods using time-averaged measurements at the exhaust plane. A definitive demonstration of gain will be challenging given the assessed uncertainties, but recommendations are given to increase the precision of the equivalent available pressure methodology to estimate pressure gain.

33 ADVANCED PROPULSION SYSTEMS↗
NASA NTRS1986

The effects of expressivity and flight task on cockpit communication and resource management

The results of an investigation to develop a methodology for evaluating crew communication behavior on the flight deck and a flight simulator experiment to test the effects of crew member expressivity, as measured by the Personal Attributes Questionnarie, and flight task on crew communication and flight performance are discussed. A methodology for coding and assessing flight crew communication behavior as well as a model for predicting that behavior is advanced. Although not enough crews were found to provide valid statistical tests, the results of the study tend to indicate that crews in which the captain has high expressivity perform better than those whose captain is low in expressivity. There appears to be a strong interaction between captains and first officers along the level of command dimension of communication. The PAQ appears to identify those pilots who offer disagreements and inititate new subjects for discussion.

Jensen, R. S.↗
DOE OSTI2020

Methodology to assess “no-touch” building audit software using simulated utility data

Building audits are conducted in many commercial buildings to identify opportunities to reduce energy costs and improve building operation. Because audits require significant effort by building engineers, they are usually only affordable for larger commercial buildings. “No-touch” building audit tools have thus been developed to identify potential savings based on a simplified analysis of building energy consumption patterns via high-level energy data such as monthly utility bills. This paper presents a comprehensive and standardized methodology to evaluate the accuracy of no-touch audit tools in detecting and diagnosing building energy problems and quantifying potential energy savings. The test suite is based on output data from a well-characterized set of building energy models, and the methodology is illustrated by applying it to a representative no-touch building audit tool. Results show that the tool estimates building energy end uses with reasonable accuracy but is less accurate in identifying probably causes of high energy.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
NASA NTRS1981

Design requirements for SRB production control system. Volume 3: Package evaluation, modification and hardware

The software package evaluation was designed to analyze commercially available, field-proven, production control or manufacturing resource planning management technology and software package. The analysis was conducted by comparing SRB production control software requirements and conceptual system design to software package capabilities. The methodology of evaluation and the findings at each stage of evaluation are described. Topics covered include: vendor listing; request for information (RFI) document; RFI response rate and quality; RFI evaluation process; and capabilities versus requirements.

Source record↗
DOE OSTI2024

Finite element procedure for thermomechanical and structural integrity analysis of beam intercepting devices subjected to free electron laser

High-energy particles, including photons (x-ray, γ-ray, bremsstrahlung), electrons, and protons, possess the capability to penetrate materials and deposit energy within them. The degree of absorption depends on both the energy and type of particles, as well as the properties of the materials with which they interact. This energy deposition can manifest either at the material's surface or throughout its volume, potentially resulting in various failure modes. The primary aim of this paper is to establish a structured analysis methodology for evaluating the structural integrity of beam-intercepting devices when subjected to high-energy particles. Here, the paper also reviews some of the underlying physics, pertinent to the scope of the thermomechanical analysis, potential failure modes, and introduces verification and validation methodologies. Engineers and researchers can utilize the guidelines presented in this paper to effectively plan the development of beam intercepting devices, thereby ensuring their reliability and performance in the presence of high-energy particle exposure.

Finite element analysis↗
NASA NTRS2009

Evaluation of Fast-Time Wake Vortex Prediction Models

Current fast-time wake models are reviewed and three basic types are defined. Predictions from several of the fast-time models are compared. Previous statistical evaluations of the APA-Sarpkaya and D2P fast-time models are discussed. Root Mean Square errors between fast-time model predictions and Lidar wake measurements are examined for a 24 hr period at Denver International Airport. Shortcomings in current methodology for evaluating wake errors are also discussed.

Proctor, Fred H.↗
NASA NTRS2011

Image Registration for Stability Testing of MEMS

Image registration, or alignment of two or more images covering the same scenes or objects, is of great interest in many disciplines such as remote sensing, medical imaging. astronomy, and computer vision. In this paper, we introduce a new application of image registration algorithms. We demonstrate how through a wavelet based image registration algorithm, engineers can evaluate stability of Micro-Electro-Mechanical Systems (MEMS). In particular, we applied image registration algorithms to assess alignment stability of the MicroShutters Subsystem (MSS) of the Near Infrared Spectrograph (NIRSpec) instrument of the James Webb Space Telescope (JWST). This work introduces a new methodology for evaluating stability of MEMS devices to engineers as well as a new application of image registration algorithms to computer scientists.

Memarsadeghi, Nargess↗
NASA NTRS2014

Evaluating Tradeoffs Between Environmental Impact and Operational Costs for Enroute Air Traffic

The rapid growth of air traffic has drawn attention to aircraft-induced environmental impact. Aviation operations affect the environment mainly through the release of emissions and by the formation of contrails. Recent research has shown that altering aircraft cruise altitudes can reduce aviation environmental impact by reducing Absolute Global Temperature Change Potential, a climate assessment metric that adapts a linear system for modeling the global temperature response to aviation emissions and contrails. However, these methods will increase fuel consumption that leads to higher operational costs imposed on airlines resulting in reluctance to adopt a new routing strategy. This paper evaluates the tradeoff between environmental impact reduction and the corresponding added operational costs for enroute air traffic. The concept of social cost of carbon and the carbon auction price from California's recent cap-and-trade system were used to provide estimates and a methodology to evaluate environmental costs for carbon dioxide emissions and contrail formations. Depending on the specific environmental policy, the strategy is considered favorable when the reduction in environmental costs exceeds the increase in operational costs. The results show how the net environmental bene t varies with different decision-making time horizons, different carbon and fuel costs, and different days. The study provides guidance towards the development of the environmental reduction strategies.

environmental impact↗
DOE OSTI2023

Design methodologies and engineering applications for ecosystem biomimicry: an interdisciplinary review spanning cyber, physical, and cyber-physical systems

Abstract Ecosystem biomimicry is a promising pathway for sustainable development. However, while typical form- and process-level biomimicry is prevalent, system-level ecosystem biomimicry remains a nascent practice in numerous engineering fields. This critical review takes an interdisciplinary approach to synthesize trends across case studies, evaluate design methodologies, and identify future opportunities when applying ecosystem biomimicry to engineering practices, including cyber systems (CS), physical systems (PS), and cyber-physical systems (CPS). After systematically sourcing publications from major databases, the papers were first analyzed at a meta level for their bibliographic context and for statistical correlations among categorical variables. Then, we investigated deeper into the engineering applications and design methodologies. Results indicate that CPS most frequently mimic organisms and ecosystems, while CS and PS frequently mimic populations-communities and molecules-tissues-organ systems, respectively (statistically highly significant). An indirect approach is most often used for mimicry at organizational levels from populations to ecosystems, while a direct approach frequently suits levels from molecules to organisms (highly significant). Dominant themes across engineering applications include symbiotic organism search algorithms for CS and ecological network analysis for CPS, while PS are highly diverse. For design methodologies, this work summarizes and details ten well-documented biomimetic process models among literature, which addresses an outdated concern for a lack of systematic methods for ecosystem biomimicry. In addition to the Biomimetics Standard ISO 18458, these methods include the Natural Step and Techno-Ecological Synergy framework, among others. Further, the analyses revealed future opportunities from less utilized design methods (e.g. interdisciplinary teams tackling indirect, ecosystem-level projects) to well-established engineering concepts ready for technological advancement (e.g. implementing membrane computing for physical applications). For future studies, this review provides a comprehensive reference for ecosystem biomimetic design practices and application opportunities across multiple engineering domains.

42 ENGINEERING↗
NASA NTRS1985

Closed-loop, pilot/vehicle analysis of the approach and landing task

Optimal-control-theoretic modeling and frequency-domain analysis is the methodology proposed to evaluate analytically the handling qualities of higher-order manually controlled dynamic systems. Fundamental to the methodology is evaluating the interplay between pilot workload and closed-loop pilot/vehicle performance and stability robustness. The model-based metric for pilot workload is the required pilot phase compensation. Pilot/vehicle performance and loop stability is then evaluated using frequency-domain techniques. When these techniques were applied to the flight-test data for thirty-two highly-augmented fighter configurations, strong correlation was obtained between the analytical and experimental results.

Schmidt, D. K.↗
DOE OSTI2025

Evaluation of the performance of event reconstruction algorithms in the JSNS 2 experiment using a 252 Cf calibration source

JSNS 2 investigates short-baseline neutrino oscillations using a 24-meter baseline and a 17-tonne Gd-loaded liquid scintillator target. Accurate event-reconstruction algorithms are crucial for analyzing experimental data. The algorithms undergo meticulous validation through calibration with a 252 Cf source. This paper outlines the methodology and evaluates the reconstruction performance, focusing on neutrino interactions up to approximately 50 MeV for sterile neutrino searches. Both 252 Cf and Michel electron events are studied to evaluate reconstruction accuracy. The analysis concludes that the uncertainty of the fiducial volume, with an appropriate correction, is much less than the requirement of JSNS 2 requirement (10%). Furthermore, the energy resolution is measured to be 3.3 ± 0.1% for the Michel electron endpoint and 4.3 ± 0.1% for the n-Gd peak in the central region.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
NASA NTRS2002

Formal verification of human-automation interaction

This paper discusses a formal and rigorous approach to the analysis of operator interaction with machines. It addresses the acute problem of detecting design errors in human-machine interaction and focuses on verifying the correctness of the interaction in complex and automated control systems. The paper describes a systematic methodology for evaluating whether the interface provides the necessary information about the machine to enable the operator to perform a specified task successfully and unambiguously. It also addresses the adequacy of information provided to the user via training material (e.g., user manual) about the machine's behavior. The essentials of the methodology, which can be automated and applied to the verification of large systems, are illustrated by several examples and through a case study of pilot interaction with an autopilot aboard a modern commercial aircraft. The expected application of this methodology is an augmentation and enhancement, by formal verification, of human-automation interfaces.

Aviation↗
NASA NTRS1988

A methodology for automation and robotics evaluation applied to the space station telerobotic servicer

The efforts of a recent study aimed at identifying key issues and trade-offs associated with using a Flight Telerobotic Servicer (FTS) to aid in Space Station assembly-phase tasks is described. The use of automation and robotic (A and R) technologies for large space systems would involve a substitution of automation capabilities for human extravehicular or intravehicular activities (EVA, IVA). A methodology is presented that incorporates assessment of candidate assembly-phase tasks, telerobotic performance capabilities, development costs, and effect of operational constraints (space transportation system (STS), attached payload, and proximity operations). Changes in the region of cost-effectiveness are examined under a variety of systems design assumptions. A discussion of issues is presented with focus on three roles the FTS might serve: (1) as a research-oriented testbed to learn more about space usage of telerobotics; (2) as a research based testbed having an experimental demonstration orientation with limited assembly and servicing applications; or (3) as an operational system to augment EVA and to aid the construction of the Space Station and to reduce the programmatic (schedule) risk by increasing the flexibility of mission operations.

Smith, Jeffrey H.↗