Search NASA⌕ Search

SEARCH · Search NASA

Results for “evaluation methodology”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15

Microbiological concerns and methodological approaches related to bacterial water quality in spaceflight

A number of microbiological issues are of critical importance to crew health and system performance in spacecraft water systems. This presentation reviews an army of these concerns which include factors that influence water treatment and disinfection in spaceflight such as biofilm formation and the physiological responses of bacteria in clean water systems. Factors associated with spaceflight like aerosol formation under conditions of microgravity are also discussed within the context of airborne infections such as Legionellosis. Finally, a spectrum of analytical approaches is reviewed to provide an evaluation of methodological alternatives that have been suggested or used to detect microorganisms of interest in water systems. These range from classical approaches employing colony formation on specific microbiological growth media to direct (i.e. microscopic) and indirect (e.g. electrochemical) methods as well as the use of molecular approaches and gene probes. These techniques are critically evaluated for their potential utility in determining microbiological water quality through the detection of microorganisms under the influence of ambient environmental stress inherent in spaceflight water systems.

Pyle, Barry H.↗

Laboratory testing methods to evaluate the reliability of occupancy sensors for commercial building applications

The energy performance of commercial buildings is greatly influenced by occupants which are highly variable and among the most unpredictable components of a building's operation. While most building control systems use fixed, predetermined occupancy schedules, these fixed occupancy levels can be quite different from actual occupancy. This can cause unnecessary energy consumption, particularly from heating, ventilation, and air conditioning (HVAC) and lighting systems which are responsible for approximately 60% of commercial buildings' energy use. The use of occupancy counting sensor systems integrated with building management system controls is one method that can be used to improve the energy-consuming performance of buildings. However, there is no standardized universal methodology and metrics to evaluate their reliability. The aim of this research is to develop a uniform evaluation methodology to assess the reliability of occupancy counting sensor systems in a controlled laboratory environment. The developed testing methodology includes both “typical” scenarios representing the occupancy scenarios of a typical commercial building, and “failure” testing scenarios which represent a range of potential scenarios that may impact a sensor system's reliability. These methods were then implemented in a case study to evaluate the performance of two novel occupancy counting sensor systems (i.e., door-centric, and camera-based). Results suggest that typical testing results can be used to compare the overall performance of the occupancy counting sensor systems; however, failure testing is also important to understand the weaknesses of the sensor system in order to select the suitable one for the intended use of the commercial building. In addition, the proposed methodology includes a modified confusion matrix which enables the ability to identify if failures are caused by over or under counting occupants and to what extent this occurs over the testing period.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Aerobraking Cost and Risk Decisions

Four missions have successfully employed aerobraking at Venus and Mars to reduce the spacecraft orbit period and achieve the desired orbit geometry. The propellant mass reductions enabled by the aerobraking technique allow the use of smaller launch systems, which translate to significant savings in launch costs for flight projects. However, there is a significant increase in mission risk associated with the use of aerobraking. Flying a spacecraft through a planetary atmosphere hundreds of times during months of around-the-clock operations places the spacecraft in harm's way, and is extraordinarily demanding on the flight team. There is a cost/risk trade that must be evaluated when a project is choosing between a mission baseline that includes aerobraking, or selecting a larger launch vehicle to enable purely propulsive orbit insertion. This paper provides a brief history of past and future aerobraking missions, describes the aerobraking technique, summarizes the costs associated with aerobraking, and concludes with a suggested methodology for evaluating the cost/risk trade when considering the aerobraking approach.

risk analysis↗

Developing a Prototype Methodology to Rank CO2-EOR Wells and Assess Their Reuse Potential for Geologic Carbon Sequestration

This study presents a prototype methodology for evaluating the reuse potential of Class II CO₂-enhanced oil recovery (CO₂-EOR) wells as Class VI wells for geologic carbon sequestration. The approach focuses on assessing wellbore construction materials—casing, cement, tubing, and packers—based on U.S. Environmental Protection Agency (EPA) Class VI well conversion guidelines. Utilizing Python scripts and JSON representations, the methodology automates checks on digitized Texas Railroad Commission (TRRC) data to rank wells based on regulatory and integrity criteria. Key factors include casing integrity, cementing techniques, tubing compatibility, and packer selection. Due to limitations in digitized data, manual verification is required for certain sections. Future enhancements include incorporating non-digitized data via web scraping and machine learning. This research provides a practical framework for well owners and regulators, supporting informed decision-making for sustainable CO₂ storage.

carbon sequestration↗

NETRA: A parallel architecture for integrated vision systems. 1: Architecture and organization

Computer vision is regarded as one of the most complex and computationally intensive problems. An integrated vision system (IVS) is considered to be a system that uses vision algorithms from all levels of processing for a high level application (such as object recognition). A model of computation is presented for parallel processing for an IVS. Using the model, desired features and capabilities of a parallel architecture suitable for IVSs are derived. Then a multiprocessor architecture (called NETRA) is presented. This architecture is highly flexible without the use of complex interconnection schemes. The topology of NETRA is recursively defined and hence is easily scalable from small to large systems. Homogeneity of NETRA permits fault tolerance and graceful degradation under faults. It is a recursively defined tree-type hierarchical architecture where each of the leaf nodes consists of a cluster of processors connected with a programmable crossbar with selective broadcast capability to provide for desired flexibility. A qualitative evaluation of NETRA is presented. Then general schemes are described to map parallel algorithms onto NETRA. Algorithms are classified according to their communication requirements for parallel processing. An extensive analysis of inter-cluster communication strategies in NETRA is presented, and parameters affecting performance of parallel algorithms when mapped on NETRA are discussed. Finally, a methodology to evaluate performance of algorithms on NETRA is described.

Choudhary, Alok N.↗

AviSense: A Real-time System for Detection, Classification, and Analysis of Aviation Signals

Wireless systems are an integral part of aviation. Apart from their apparent use in air-to-ground communication, wireless systems play a crucial role in avionic functions including navigation and landing. An interference-free wireless environment is therefore critical for the uninterrupted operation and safety of an aircraft. Hence, there is an urgency for airport facilities to acquire the capability to continuously monitor aviation frequency bands for real-time detection of interference and anomalies. To meet this critical need, we design and build AviSense, an SDR-based real-time, versatile system for monitoring aviation bands. AviSense detects and characterizes signal activities to enable practical and effective anomaly detection. We identify and tackle the challenges posed by a diverse set of critical aviation bands and technologies. We evaluate our methodology with real-world aviation signal measurements and two custom datasets of anomalous signals. We find that our signal classification capability achieves a true positive rate of ~99%, with few exceptions, and a false positive rate of less than 4%. We also demonstrate that AviSense can effectively distinguish between different types of anomalies. We build and evaluate a prototype implementation of AviSense that supports distributed monitoring.

42 ENGINEERING↗

High-Fidelity Multidisciplinary Sensitivity Analysis Framework for Multipoint Rotorcraft Optimization

A multidisciplinary, gradient-based sensitivity-analysis methodology is evaluated for optimization of rotorcraft configurations. The tightly coupled discipline models include physics-based fluid dynamics and rotorcraft comprehensive analysis. A discretely-consistent adjoint method accounts for sensitivities of the unsteady flow and unstructured, dynamic, over set grids, while sensitivities of structural responses to aerodynamic loads are computed using a complex-variable method. The methodology is applied to optimize the shape of UH-60A Blackhawk helicopter blades for hover and forward flight conditions. The objective of the multipoint design is to simultaneously increase the rotorcraft figure of merit in a hover flight and reduce the rotor power in a forward flight. Trimmed loose-coupling solutions for the baseline configuration are used to initiate the tight-coupling multidisciplinary analysis. Target thrust and rolling and pitching moments are enforced as optimization constraints. The optimized configuration improves the optimization metrics at both design points. The improved performance and all constraints are maintained over many revolutions beyond the optimization interval, satisfying the required flight conditions. Computational cost of the optimization cycle is assessed in a high-performance computing environment and found affordable for design of rotorcraft in general level-flight conditions.

Wang, Li↗

Development of Integrated Safety and Security Models for Comprehensive Reliability and Resiliency Evaluation

The security of the electric grid and supporting energy systems is crucial to national security. One of the complexities in analyzing the security of energy systems is the safety consequences that may result from accidents. For energy systems, the goal is to ensure that they operate as intended and that any consequences are mitigated or prevented. The integration of safety and security is paramount to protecting these systems from attacks and ensuring that large consequences are prevented. This report describes an integrated safety and security methodology to evaluate cybersecurity events that can lead to large consequences. This novel approach first describes how Systems-Theoretic Process Analysis (STPA) provides a digital causal analysis for Bayesian Networks (BNs). The use of STPA causal analysis provides a systematic approach to constructing BNs that adequately model cyber scenarios that result in consequences. When combined with the technical principles described in Risk-Informed Management of Enterprise Systems (RIMES), a comprehensive risk-informed cybersecurity analysis results that allows decision-makers to prioritize systems that most impact risk.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Evaluation of lens distortion errors in video-based motion analysis

In an effort to study lens distortion errors, a grid of points of known dimensions was constructed and videotaped using a standard and a wide-angle lens. Recorded images were played back on a VCR and stored on a personal computer. Using these stored images, two experiments were conducted. Errors were calculated as the difference in distance from the known coordinates of the points to the calculated coordinates. The purposes of this project were as follows: (1) to develop the methodology to evaluate errors introduced by lens distortion; (2) to quantify and compare errors introduced by use of both a 'standard' and a wide-angle lens; (3) to investigate techniques to minimize lens-induced errors; and (4) to determine the most effective use of calibration points when using a wide-angle lens with a significant amount of distortion. It was seen that when using a wide-angle lens, errors from lens distortion could be as high as 10 percent of the size of the entire field of view. Even with a standard lens, there was a small amount of lens distortion. It was also found that the choice of calibration points influenced the lens distortion error. By properly selecting the calibration points and avoidance of the outermost regions of a wide-angle lens, the error from lens distortion can be kept below approximately 0.5 percent with a standard lens and 1.5 percent with a wide-angle lens.

Poliner, Jeffrey↗

Quantitative evaluation of common cause failures in high safety-significant safety-related digital instrumentation and control systems in nuclear power plants

Digital instrumentation and control (DI&C) systems at nuclear power plants (NPPs) have many advantages over analog systems. They are proven to be more reliable, cheaper, and easier to maintain given obsolescence of analog components. However, they also pose new engineering and technical challenges, such as possibility of common cause failures (CCFs) unique to digital systems. Here this paper proposes a Platform for Risk Assessment of DI&C (PRADIC) that is developed by Idaho National Laboratory (INL). A methodology for evaluation of software CCFs in high safety-significant safety-related DI&C systems of NPPs was developed as part of the framework. The framework integrates three stages of a typical risk assessment—qualitative hazard analysis and quantitative reliability and consequence analyses. The quantified risks compared with respective acceptance criteria provide valuable insights for system architecture alternatives allowing design optimization in terms of risk reduction and cost savings. A comprehensive case study performed to demonstrate the framework's capabilities is documented here in this paper. Results show that the PRADIC is a powerful tool capable to identify potential digital-based CCFs, estimate their probabilities, and evaluate their impacts on system and plant safety.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

GGOT total pressure loss control concept evaluation

Total pressure loss is one of the most important parameters in the design of a turbine. This parameter effects not only the turbine performance, but consequently the engine power balance and engine performance. Computational Fluid Dynamics (CFD) can be an effective tool in predicting turbine total pressure loss, and also for performing sensitivity studies to achieve an optimal design with respect to pressure loss. In the present study, the AEROVISC code was used to predict the total pressure loss in the Turbine Technology Team Gas Generator Oxidizer Turbine (GGOT). The objectives in this study are two-fold. It is first necessary to determine an optimal methodology in predicting total pressure loss. The type of grid, grid density and distribution are parameters which may affect the loss prediction. Also, the effect of using a standard K-epsilon turbulence model with wall functions versus a two-layer turbulence model needs to be investigated. The use of grid embedding to resolve areas with high flow gradients needs to be explored. The second objective of the study is to apply the optimal methodology toward evaluating different tip leakage control concepts.

Blumenthal, R. F.↗

Initial TASAR Operations Onboard Alaska Airlines

NASA and Alaska Airlines jointly conducted an operational evaluation of NASA’s Traffic Aware Strategic Aircrew Request (TASAR) concept. Featuring a NASA-developed cockpit automation tool, the Traffic Aware Planner (TAP), and leveraging the emerging “connected aircraft” architecture, TASAR enables pilots to identify route changes compatible with nearby traffic and airspace constraints that improve flight efficiency and are more likely to receive Air Traffic Control approval. TASAR was developed in anticipation of saving fuel and flight time, thereby providing immediate and pervasive benefits to the aircraft operator. Following a previously reported, extensive program of integration and preliminary in-flight testing, the operational evaluation of TASAR in revenue service by Alaska Airlines took place from July 2018 to April 2019. This paper describes the operational evaluation, the methodology for quantifying operational benefits, preliminary benefit results, and other unexpected impacts of TASAR operations during revenue flights. Based on the subset of data available at publication, preliminary estimated benefits averaged about $92 per flight across all flights including those without benefit. Identified factors indicate the estimated benefit per flight was likely a conservative estimate. Benefit categories including home runs, cumulative small gains, and plan validation benefits are illustrated with specific examples observed during the operational evaluation.

Wing, David J.↗

Early season spring small grains direct proportion estimation - Development and evaluation of a Landsat based methodology

The Inventory Technology Development (ITD) project of the Agriculture and Resources Inventory Surveys Through Aerospace Remote Sensing (AgRISTARS) program has developed an accurate, automated technology for early season estimation of spring small grains areal proportion from Landsat MSS data. The design criteria for an early season procedure included estimates available within the first 30 days of the growing season, low data processing/preprocessing requirements and no need for scene-to-scene registration. The prototype estimator which meets the design goals is based on a constrained linear model in which the observed spectral response of an entire scene is modeled as a linear combination of the major constituent elements in the scene. The procedure was evaluated over 100 sample segments collected for crop years 1976 through 1979 in the U.S. Northern Great Plains. Analysis of the test results indicated accuracy that compare favorably with both the automated at-harvest technologies tested during the FY81-82 AgRISTARS Spring Small Grains Pilot experiments and earlier analyst-intensive at-harvest technologies.

Phinney, D. E.↗

LET and Range Characteristics of Proton Recoil Ions in Gallium Nitride (GaN)

A better understanding of the linear energy transfer and the range of proton recoil ions in gallium nitride is necessary to properly evaluate GaN device radiation tolerance. By analyzing the linear energy transfer (LET) and range of recoil heavy ions in GaN we can begin to reproduce the body of knowledge that exists for Si-based devices for this upcoming technology. Although the previous data on older technology has impressive depth and breadth we must be diligent and cautious in the application of these institutional intuitions when applied to emerging technologies such as GaN. As ever increasing materials science advances emerge, a sound methodology for evaluating new technologies must be established in order to apply what we know towards the effort of ensuring radiation tolerance.

gallium nitride (GaN)↗

Evaluation of Systematic Errors on Polarization Parameters from POLDER Instrument Data for Use In CLARREO Pathfinder-VIIRS Intercalibration

One of the CLARREO Pathfinder (CPF) mission’s science objectives is to intercalibrate the reflective solar bands of the NOAA-20 VIIRS instrument against high-accuracy CPF measurements utilizing coincident, co-angled, and co-located footprints acquired over diverse Earth targets. To alleviate the effect of high polarization sensitivity of select VIIRS channels on intercalibration analysis, the CPF team will limit the intercalibration footprints over low-polarized scene types, which will be identified based on an empirical estimation of their degree and angle of polarization (DOP and AOP) using POLDER data. This paper describes the methodology for evaluating systematic errors in the estimation of DOP and AOP for Earth-reflected radiances using POLDER’s polarized bands and investigates their potential impact on CPF-VIIRS intercalibration uncertainty. The systematic errors were found to be less than 0.01 for DOP and less than 2.2 deg. for AOP, which will have a negligible impact on CPF-VIIRS intercalibration uncertainty.

polarization↗

Evaluation of AI-enabled Digital Documented Safety Analysis

The National Reactor Innovation Center (NRIC) is leading a transformative initiative to accelerate advanced reactor deployment by fundamentally reimagining how nuclear safety basis documentation is developed, reviewed, and maintained. Traditional Documented Safety Analysis (DSA) processes for DOE-authorized facilities rely on static, document-centric workflows that consume significant time and resources, exemplified by recent major licensing efforts requiring hundreds of thousands of staff hours and millions of pages of documentation review. These conventional approaches create barriers to the rapid, cost-effective deployment of advanced reactors that America's future energy needs demand. NRIC's DOE Authorization Digital Transformation Project addresses these challenges through an innovative framework that integrates artificial intelligence (AI), digital engineering, and systems-based data management into a cohesive digital ecosystem. This white paper presents NRIC's methodology for evaluating AI-enabled document generation capabilities within this broader digital infrastructure, using the Demonstration of Microreactor Experiments (DOME) facility as a pilot case study. The evaluation will assess an AI tool's ability to generate a Preliminary Documented Safety Analysis (PDSA) through progressive integration stages—from standalone document processing to full digital thread connectivity—while maintaining rigorous verification, validation, and regulatory acceptance standards. By establishing dynamic, traceable connections between design data and safety documentation, NRIC's approach has the potential to reduce both document development time and regulatory review cycles by as much as 50%, while simultaneously improving accuracy, consistency, and traceability. This initiative represents a critical step toward establishing reusable digital infrastructure that reactor developers can leverage to accelerate their path from concept to commercial operation, directly supporting NRIC's mission to demonstrate and deploy advanced nuclear energy technologies.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗

Shape optimization of tibial prosthesis components

NASA technology and optimal design methodologies originally developed for the optimization of composite structures (engine blades) are adapted and applied to the optimization of orthopaedic knee implants. A method is developed enabling the shape tailoring of the tibial components of a total knee replacement implant for optimal interaction within the environment of the tibia. The shape of the implant components are optimized such that the stresses in the bone are favorably controlled to minimize bone degradation, to improve the mechanical integrity of the implant/interface/bone system, and to prevent failures of the implant components. A pilot tailoring system is developed and the feasibility of the concept is demonstrated and evaluated. The methodology and evolution of the existing aerospace technology from which this pilot optimization code was developed is also presented and discussed. Both symmetric and unsymmetric in-plane loading conditions are investigated. The results of the optimization process indicate a trend toward wider and tapered posts as well as thicker backing trays. Unique component geometries were obtained for the different load cases.

Saravanos, D. A.↗

Flexible Foam Protection Materials for Portable Life Support System Packaging Study

This paper discusses the phase I effort in evaluating and selecting a light weight impact protection material for the Constellation Space Suit Element (CSSE) Portable Life Support System (PLSS) conceptual packaging study. A light weight material capable of holding and protecting the components inside the PLSS is required to demonstrate the viability of the flexible PLSS packaging concept. The material needs to distribute, dissipate, and absorb the impact energy of the PLSS falling on the lunar surface. It must also be robust to consistently perform over several Extravehicular Activity (EVA) missions in the extreme lunar thermal vacuum environment. This paper documents the performance requirements for selecting a foam protection material, and the methodologies for evaluating some commercial off-the-shelf (COTS) foam material candidates. It also presents the mechanical properties and impact drop tests results of the foam material candidates. The results of this study suggest that a foam based flexible protection system is a viable solution for PLSS packaging. However, additional works are needed to optimize COTS foam or to develop a composite foam system that will meet all the performance requirements for the CSSE PLSS flexible packaging.

Tang,Henry H.↗