SEARCH · Search NASA
Results for “evaluation methodology”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Power systems for future missions
A comprehensive scenario of future missions was developed and applicability of different power technologies to these missions was assessed. Detailed technology development roadmaps for selected power technologies were generated. A simple methodology to evaluate economic benefits of current and future power system technologies by comparing Life Cycle Costs of potential missions was developed. The methodology was demonstrated by comparing Life Cycle Costs for different implementation strategies of DIPS/CBC technology to a selected set of missions.
xEMU Spacesuit Boot Lunar South Pole Thermal Vacuum Testing
The Exploration Extravehicular Mobility Unit (xEMU) spacesuit lunar boot was evaluated in the Jet Propulsion Lab (JPL) CITADEL thermal vacuum chamber at lunar South Pole conditions. The JPL CITADEL chamber provides a radiation environment and contact plate temperature of 48K, simulating the temperature of a lunar Permanently Shadowed Region (PSR) at the South Pole of the Moon. The main objectives of the test series were: to evaluate the risk lunar PSRs pose to advanced spacesuit boots, validate the xEMU lunar boot thermal model, and develop a test methodology to evaluate lunar spacesuit boots. To simulate the thermal effects of a crewmember’s foot inside the boot, a thermal manikin foot was developed to inject heat into the spacesuit boot. Thermal data was collected through a variety of sensors including thermocouples, thermistors, heat flux sensors, and infrared cameras. A test matrix was developed to investigate the variables of foot contact force, simulated skin temperature, external contact plate temperature, and ventilation flowrate. The JPL CITADEL chamber includes a loadlock (airlock) that afforded the ability to simulate the transition of the boot from a thermally neutral IVA condition to a cold EVA condition within seconds. This paper will document the test design, test objectives, success criteria, test support equipment, spacesuit boot to chamber interfaces, and configuration of the test article. Additionally, this paper will document the high-level results of the testing. More detailed test results will be presented in a different paper.
Finite element methodology for transient conduction/forced-convection thermal analysis
Finite element methodology for steady state thermal analysis of convectively cooled structures has been extended for transient analysis. The finite elements are based on representing the fluid passages by fluid bulk-temperature nodes and fluid-solid interface nodes. The formulation of the finite element equations for a typical flow passage is based on the weighted residual method with upwind weighting functions. Computer implementation of the convective finite element methodology using explicit and implicit time integration algorithms is described. Accuracy and efficiency of the methodology is evaluated by comparisons with analytical solutions and finite-difference lumped-parameter analyses. The comparative analyses demonstrate that finite element conduction/conduction methodology may be used to predict transient temperatures with an accuracy equal or superior to the lumped-parameter finite-difference method.
xEMU Spacesuit Boot Lunar South Pole Thermal Vacuum Testing
The Exploration Extravehicular Mobility Unit (xEMU) spacesuit lunar boot was evaluated in the Jet Propulsion Lab (JPL) CITADEL thermal vacuum chamber at lunar South Pole conditions. The JPL CITADEL chamber provides a radiation environment and contact plate temperature of 48K, simulating the temperature of a lunar Permanently Shadowed Region (PSR) at the South Pole of the Moon. The main objectives of the test series are: to evaluate the risk lunar PSRs pose to advanced spacesuit boots, validate the xEMU lunar boot thermal model, and to develop a test methodology to evaluate lunar spacesuit boots. To simulate the thermal effects of a crewmember’s foot inside the boot, a thermal manikin foot was developed to inject heat into the spacesuit boot. Thermal data was collected through a variety of sensors including thermocouples, thermistors, heat flux sensors, and infrared cameras. A test matrix was developed to investigate the variables of foot contact force, simulated skin temperature, external contact plate temperature, and ventilation flowrate. The JPL CITADEL chamber includes a loadlock (airlock) that afforded the ability to simulate the transition of the boot from a thermally neutral IVA condition to a cold EVA condition within seconds. This paper will document the test design, test objectives, success criteria, test support equipment, spacesuit boot to chamber interfaces, and configuration of the test article. Additionally, this paper will document the high-level results of the testing. More detailed test results will be presented in a different paper.
Evaluating Effectiveness of Modeling Motion System Feedback in the Enhanced Hess Structural Model of the Human Operator
In order to use the Hess Structural Model to predict the need for certain cueing systems, George and Cardullo significantly expanded it by adding motion feedback to the model and incorporating models of the motion system dynamics, motion cueing algorithm and a vestibular system. This paper proposes a methodology to evaluate effectiveness of these innovations by performing a comparison analysis of the model performance with and without the expanded motion feedback. The proposed methodology is composed of two stages. The first stage involves fine-tuning parameters of the original Hess structural model in order to match the actual control behavior recorded during the experiments at NASA Visual Motion Simulator (VMS) facility. The parameter tuning procedure utilizes a new automated parameter identification technique, which was developed at the Man-Machine Systems Lab at SUNY Binghamton. In the second stage of the proposed methodology, an expanded motion feedback is added to the structural model. The resulting performance of the model is then compared to that of the original one. As proposed by Hess, metrics to evaluate the performance of the models include comparison against the crossover models standards imposed on the crossover frequency and phase margin of the overall man-machine system. Preliminary results indicate the advantage of having the model of the motion system and motion cueing incorporated into the model of the human operator. It is also demonstrated that the crossover frequency and the phase margin of the expanded model are well within the limits imposed by the crossover model.
Knowledge-based system verification and validation
The objective of this task is to develop and evaluate a methodology for verification and validation (V&V) of knowledge-based systems (KBS) for space station applications with high reliability requirements. The approach consists of three interrelated tasks. The first task is to evaluate the effectiveness of various validation methods for space station applications. The second task is to recommend requirements for KBS V&V for Space Station Freedom (SSF). The third task is to recommend modifications to the SSF to support the development of KBS using effectiveness software engineering and validation techniques. To accomplish the first task, three complementary techniques will be evaluated: (1) Sensitivity Analysis (Worchester Polytechnic Institute); (2) Formal Verification of Safety Properties (SRI International); and (3) Consistency and Completeness Checking (Lockheed AI Center). During FY89 and FY90, each contractor will independently demonstrate the user of his technique on the fault detection, isolation, and reconfiguration (FDIR) KBS or the manned maneuvering unit (MMU), a rule-based system implemented in LISP. During FY91, the application of each of the techniques to other knowledge representations and KBS architectures will be addressed. After evaluation of the results of the first task and examination of Space Station Freedom V&V requirements for conventional software, a comprehensive KBS V&V methodology will be developed and documented. Development of highly reliable KBS's cannot be accomplished without effective software engineering methods. Using the results of current in-house research to develop and assess software engineering methods for KBS's as well as assessment of techniques being developed elsewhere, an effective software engineering methodology for space station KBS's will be developed, and modification of the SSF to support these tools and methods will be addressed.
AviSense: A Real-time System for Detection, Classification, and Analysis of Aviation Signals
We present AviSense, an SDR-based real-time, versatile system for monitoring aviation bands. AviSense detects and characterizes signal activities to enable practical and effective anomaly detection. We identify and tackle the challenges posed by a diverse set of critical aviation bands and technologies. We evaluate our methodology with real-world aviation signal measurements and demonstrate that we can classify aviation signals as normal with 99% accuracy. We also provide an exhaustive evaluation of our anomalous signal detection capability and show that we can accurately classify anomalous signals with 99% accuracy, with few exceptions. We also demonstrate that AviSense can effectively distinguish between different types of anomalies. We build a prototype implementation of AviSense for distributed monitoring.
Fire toxicology from the National Academy of Sciences (NAS) point of view
At the request of NASA the Subcommittee on Fire Toxicology undertook the tasks of evaluating the state-of-knowledge in fire toxicology and recommending guidelines for establishing standard approaches for testing the toxicity of polymeric materials in fires. The recommended guidelines on methodology for evaluation of toxicity of pyrolysis and combustion products are presented. Flow charts reflecting the organizations responsible for the evaluation tasks are presented to show organizational changes which took place between 1977 and 1978. Also listed are the names, phone numbers and companies in attendance at the meeting.
Advanced automation for in-space vehicle processing
The primary objective of this 3-year planned study is to assure that the fully evolved Space Station Freedom (SSF) can support automated processing of exploratory mission vehicles. Current study assessments show that required extravehicular activity (EVA) and to some extent intravehicular activity (IVA) manpower requirements for required processing tasks far exceeds the available manpower. Furthermore, many processing tasks are either hazardous operations or they exceed EVA capability. Thus, automation is essential for SSF transportation node functionality. Here, advanced automation represents the replacement of human performed tasks beyond the planned baseline automated tasks. Both physical tasks such as manipulation, assembly and actuation, and cognitive tasks such as visual inspection, monitoring and diagnosis, and task planning are considered. During this first year of activity both the Phobos/Gateway Mars Expedition and Lunar Evolution missions proposed by the Office of Exploration have been evaluated. A methodology for choosing optimal tasks to be automated has been developed. Processing tasks for both missions have been ranked on the basis of automation potential. The underlying concept in evaluating and describing processing tasks has been the use of a common set of 'Primitive' task descriptions. Primitive or standard tasks have been developed both for manual or crew processing and automated machine processing.
Evaluating the benefits of government funded R & D aimed at the private sector
Federal funding of technological research and development is discussed with regard to the procedures for an economic analysis with the goals of (1) determining when the public sector should invest in a research and development program, (2) evaluating the likelihood of private sector participation in terms of public sector participation, and (3) considering the major factors in the formulation of a research and development program in terms of defining initiatives. Public sector investments are evaluated, noting procedures for determining whether benefits exceed costs. The role of the public sector research and development planning is described, considering the procedure for private sector implementation decisions and a methodology for evaluating the possibility of private sector commercialization. The economic value of the public sector research and development program is presented with attention given to a specific case of NASA-sponsored research and development aimed toward the commercialization of new public communications services.
Consistent Evaluation of the Prompt-fission Neutron Spectrum and Multiplicity for n+ 235,238 U and n+ 239 Pu
This report was written to satisfy a FY20 NCSP milestone on 235,238 U and 239 Pu. The milestone requires to “finalize a report assessing our methodology to evaluate prompt-fission neutron spectrum (PFNS) and multiplicity consistently”. More specifically, we study whether the code CGMF can reproduce ENDF/B-VIII.0 evaluated PFNS and average prompt-fission neutron multiplicities, $\bar{v}$, for 235,238 U and 239 Pu using one joint parameter set per isotope. If CGMF is shown to be able to reasonably reproduce ENDF/B-VIII.0 within its model-parameter space, this code could be used for future consistent evaluations of PFNS and $\bar{v}$. To answer this question, we explore here the parameter space of CGMF and its impact on calculated values and whether they are close to evaluated and experimental data. We also list experimental data that would enter a future evaluation and statistics method that could be used to obtain evaluated data and covariances. We conclude that values of $\bar{v}$ calculated by CGMF are reasonably close to ENDF/B-VIII.0 data, while more work on modeling the PFNS is needed (parameter optimization and model improvements) to reliably use it for evaluations.
Design Guidelines for Predicting Stress in Cemented Doublets Undergoing Temperature Change, Part 2
This work builds on prior work that developed a methodology for evaluating thermal stress in cemented doublets. The prior studies were limited by a paucity of actual test data, particularly from thermally tested cemented doublets. This follow-on study uses the existing methodology to estimate stresses in cemented doublets that have been tested for a temperature range from –40°C to 85°C and establishes safe stress levels using actual data. We also discuss limitations and concerns that we need to address to improve our understanding of cemented doublet failure.
Space station architectural elements model study
The worksphere, a user controlled computer workstation enclosure, was expanded in scope to an engineering workstation suitable for use on the Space Station as a crewmember desk in orbit. The concept was also explored as a module control station capable of enclosing enough equipment to control the station from each module. The concept has commercial potential for the Space Station and surface workstation applications. The central triangular beam interior configuration was expanded and refined to seven different beam configurations. These included triangular on center, triangular off center, square, hexagonal small, hexagonal medium, hexagonal large and the H beam. Each was explored with some considerations as to the utilities and a suggested evaluation factor methodology was presented. Scale models of each concept were made. The models were helpful in researching the seven beam configurations and determining the negative residual (unused) volume of each configuration. A flexible hardware evaluation factor concept is proposed which could be helpful in evaluating interior space volumes from a human factors point of view. A magnetic version with all the graphics is available from the author or the technical monitor.
Identifying Outliers in AI-based Image Compression
Image compression using artificial intelligence (AI) is becoming increasingly prevalent across various fields, including scientific research. Scientific instruments can generate hundreds of images per second, and effectively compressing these images with high compression ratios is crucial for facilitating scientific discoveries. However, automatically detecting outlier cases, where compression may not have succeeded or where interesting scientific phenomena are present, poses a significant challenge. To address this, we have developed a methodology based on unsupervised machine learning techniques for detecting outlier compressed images. This methodology utilizes metrics such as peak signal-to-noise ratio (PSNR), structural similarity index measure (SSIM), structural texture similarity index measure (STSIM), and deep image and structural texture similarity index (DISTS). We have evaluated our methodology on several unlabeled datasets, including microscopy and x-ray images, and have successfully identified multiple outlier images using our proposed approach. Furthermore, our approach has enabled us to identify image semantics that are valuable for post-experiment analysis by scientists.
BATSE gamma-ray burst line search. 2: Bayesian consistency methodology
We describe a Bayesian methodology to evaluate the consistency between the reported Ginga and Burst and Transient Source Experiment (BATSE) detections of absorption features in gamma-ray burst spectra. Currently no features have been detected by BATSE, but this methodology will still be applicable if and when such features are discovered. The Bayesian methodology permits the comparison of hypotheses regarding the two detectors' observations and makes explicit the subjective aspects of our analysis (e.g., the quantification of our confidence in detector performance). We also present non-Bayesian consistency statistics. Based on preliminary calculations of line detectability, we find that both the Bayesian and non-Bayesian techniques show that the BATSE and Ginga observations are consistent given our understanding of these detectors.
Antimicrobial properties of nanostructured surfaces – demonstrating the need for a standard testing methodology
Bioinspired nanostructured materials that exhibit antimicrobial properties are being synthesized and tested at increasing rates for use in healthcare, manufacturing processes, and diagnostics. Although progress has been made in improving and understanding their bactericidal activity, arguably, the biggest problem currently in the field is the lack of a standard testing methodology that allows for optimal characterization and better comparison of emerging nanostructures. In this work, we examine two forms of nanostructured silicon that vary in their ability to kill certain bacterial species due to different physical mechanisms and derive guidelines for the comparative testing. We perform a comprehensive evaluation of methodologies used extensively in the field (e.g., colony counting and live dead analysis) and the novel application of high-throughput flow cytometry. The data reveal how the techniques are complementary but not always directly equivalent or correlative. Therefore, comparison of results obtained using different methodologies on different materials can be grossly misleading. We report significant variations in bactericidal efficiencies depending on experimental environments (medium type, etc.) and methodologies employed. In addition, we demonstrate how cytometry is yet another powerful complementary tool that can aid the mechanistic understanding of antimicrobial activities of rough surfaces. Besides standardization for comparison, ultimately, evaluation methods need to consider anticipated applications. Then and only then can the true potential (or limitation) of a novel material be determined for its suitability for advancement in a particular field of use.
Port of New York and New Jersey Drayage Electrification Analysis
The National Renewable Energy Laboratory (NREL) evaluated the potential for drayage electrification in the Port of New York and New Jersey (PoNYNJ), with a focus on operators: Harbor Freight Transport (HF), Safeway Trucking (SWT), and International Motor Freight Inc (IMF). This report summarizes the data collection and electrification evaluation of all three drayage operators, includes detailed operational data, and identifies the performance requirements for battery electric tractors (BETs) and corresponding infrastructure operated within the context of PoNYNJ drayage operation. This report also details a methodology to evaluate opportunities, strategies, and challenges associated with future expansions of BETs in meeting PANYNJ emissions goals. The Port Authority has established a goal of achieving Net Zero carbon emissions by 2050 across all facilities, including from tenant and stakeholder sources such as drayage trucks. NREL used real-world performance data collected on the three PoNYNJ drayage operations, along with modeling and analysis tools to compare BET to diesel trucks. From March to July 2021, NREL collected 1Hz vehicle and engine data from 46 drayage trucks at the three operators totaling nearly 121,000 miles of operation, providing enough information to assess vehicle operations for electrification potential. A Future Automotive Systems Technology Simulator (FASTSim) electric truck powertrain model was validated using PoNYNJ data and scenarios were run to evaluate drayage truck electrification requirements over the real-world cycles. The first scenario examined BET viability with minimal changes to existing operations. This assumes the trucks charge when stopped for two hours or longer, have a functional battery size of 375 kWh, and can charge at 270 kilowatts (kW) average which are the specification of the commercially available Freightliner eCascadia. The second scenario looked at what operational, charging infrastructure, and BET technology changes would be needed to fully electrify. Finally, detailed analysis was run on charging rate structure to understand operational costs to the fleets. The studied drayage trucks averaged 5.1 MPG, spent roughly 9% of their energy at idle, and drove an average of 140 miles per day with a maximum daily distance of 573 miles. The FASTSim model results indicate a comparable BET would use 417 kWh of energy per day on average accounting for cargo weight, which is close to the full usable capacity of the eCascadia currently available on the market. Based on the daily average operating data, partial fleet electrification is possible with current technology. However, some specific days of operation would require over 1,600 kWh of energy due to longer distances traveled by the trucks and more intense operation. Trucks used for long distance and intense operation cannot be readily electrified with current technology without operational changes. Full adoption of BETs could reduce CO 2 emissions from these fleets by roughly 75% today, eliminating 76 metric tons of CO 2 (MTCO 2 ) per vehicle each year, which equates to 24,100 MTCO 2 per year for all three operators. Commercially available direct current fast chargers (DCFC) have charge rates up to 350 kW. Based on the average daily modeled energy use for each operator, current industrial rate structures, and the assumption of 350 kW peak charging, full drayage electrification would increase electricity consumption. In addition, peak demand usage would increase with unmanaged charging along with cost of electricity having a direct impact on cost per mile for electric vehicles. The resulting cost per mile for BETs along with comparable cost per mile for conventional diesel trucks are also examined at $\$$4.00 per gallon of diesel. It will be important for PANYNJ and the drayage operators within the PoNYNJ to consider these load impacts to their existing electrical infrastructure and devise operational strategies that avoid coincident charging of vehicles to mitigate demand charges. Despite these electricity cost increases, savings from reductions in diesel consumption will help offset the costs of this increased electricity consumption. However, prices of both electricity and diesel are subject to change based on various factors meaning the realized savings will vary over time. This shows BETs could be cost-competitive on an energy cost per mile basis for all scenarios while diesel is above $\$$3.00/gal. Further, if diesel prices dropped to the 15-year low of $2.33/gal, it would still be cost competitive to operate the EVs with electricity costs of 16.3 ¢/kWh or less.