Search NASA⌕ Search

SEARCH · Search NASA

Results for “evaluation methodology”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 955 records · Page 53

Space Shuttle Debris Impact Tool Assessment Using the Modern Design of Experiments

Complex computer codes are used to estimate thermal and structural reentry loads on the Shuttle Orbiter induced by ice and foam debris impact during ascent. Such debris can create cavities in the Shuttle Thermal Protection System. The sizes and shapes of these cavities are approximated to accommodate a code limitation that requires simple "shoebox" geometries to describe the cavities -- rectangular areas and planar walls that are at constant angles with respect to vertical. These approximations induce uncertainty in the code results. The Modern Design of Experiments (MDOE) has recently been applied to develop a series of resource-minimal computational experiments designed to generate low-order polynomial graduating functions to approximate the more complex underlying codes. These polynomial functions were then used to propagate cavity geometry errors to estimate the uncertainty they induce in the reentry load calculations performed by the underlying code. This paper describes a methodological study focused on evaluating the application of MDOE to future operational codes in a rapid and low-cost way to assess the effects of cavity geometry uncertainty.

DeLoach, Richard↗

Methodology for Prototyping Increased Levels of Automation for Spacecraft Rendezvous Functions

The Crew Exploration Vehicle necessitates higher levels of automation than previous NASA vehicles, due to program requirements for automation, including Automated Rendezvous and Docking. Studies of spacecraft development often point to the locus of decision-making authority between humans and computers (i.e. automation) as a prime driver for cost, safety, and mission success. Therefore, a critical component in the Crew Exploration Vehicle development is the determination of the correct level of automation. To identify the appropriate levels of automation and autonomy to design into a human space flight vehicle, NASA has created the Function-specific Level of Autonomy and Automation Tool. This paper develops a methodology for prototyping increased levels of automation for spacecraft rendezvous functions. This methodology is used to evaluate the accuracy of the Function-specific Level of Autonomy and Automation Tool specified levels of automation, via prototyping. Spacecraft rendezvous planning tasks are selected and then prototyped in Matlab using Fuzzy Logic techniques and existing Space Shuttle rendezvous trajectory algorithms.

Hart, Jeremy J.↗

FCS Technology Investigation Overview

This working paper provides an overview of the Future Communication Study (FCS) technology investigation progress. It includes a description of the methodology applied to technology evaluation; evaluation criteria; and technology screening (down select) results. A comparison of screening results with other similar technology screening activities is provided. Additional information included in this working paper is a description of in-depth studies (including characterization of the L-band aeronautical channel; L-band deployment cost assessment; and performance assessments of candidate technologies in the applicable aeronautical channel) that have been conducted to support technology evaluations. The paper concludes with a description on-going activities leading to conclusion of the technology investigation and the development of technology recommendations.

Budinger, James↗

Ares I-X Launch Abort System, Crew Module, and Upper Stage Simulator Vibroacoustic Flight Data Evaluation, Comparison to Predictions, and Recommendations for Adjustments to Prediction Methodology and Assumptions

The National Aeronautics and Space Administration (NASA) Constellation Program (CxP) has identified a series of tests to provide insight into the design and development of the Crew Launch Vehicle (CLV) and Crew Exploration Vehicle (CEV). Ares I-X was selected as the first suborbital development flight test to help meet CxP objectives. The Ares I-X flight test vehicle (FTV) is an early operational model of CLV, with specific emphasis on CLV and ground operation characteristics necessary to meet Ares I-X flight test objectives. The in-flight part of the test includes a trajectory to simulate maximum dynamic pressure during flight and perform a stage separation of the Upper Stage Simulator (USS) from the First Stage (FS). The in-flight test also includes recovery of the FS. The random vibration response from the ARES 1-X flight will be reconstructed for a few specific locations that were instrumented with accelerometers. This recorded data will be helpful in validating and refining vibration prediction tools and methodology. Measured vibroacoustic environments associated with lift off and ascent phases of the Ares I-X mission will be compared with pre-flight vibration predictions. The measured flight data was given as time histories which will be converted into power spectral density plots for comparison with the maximum predicted environments. The maximum predicted environments are documented in the Vibroacoustics and Shock Environment Data Book, AI1-SYS-ACOv4.10 Vibration predictions made using statistical energy analysis (SEA) VAOne computer program will also be incorporated in the comparisons. Ascent and lift off measured acoustics will also be compared to predictions to assess whether any discrepancies between the predicted vibration levels and measured vibration levels are attributable to inaccurate acoustic predictions. These comparisons will also be helpful in assessing whether adjustments to prediction methodologies are needed to improve agreement between the predicted and measured flight data. Future assessment will incorporate hybrid methods in VAOne analysis (i.e., boundary element methods, BEM and finite element methods, FEM). These hybrid methods will enable the ability to import NASTRAN models providing much more detailed modeling of the underlying beams and support structure of the ARES 1-X test vehicle. Measured acoustic data will be incorporated into these analyses to improve correlation for additional post flight analysis.

Smith, Andrew↗

Space Station Human Factors: Designing a Human-Robot Interface

The experiments described in this paper are part of a larger joint MIT/NASA research effort and focus on the development of a methodology for designing and evaluating integrated interfaces for highly dexterous and multifunctional telerobot. Specifically, a telerobotic workstation is being designed for an Extravehicular Activity (EVA) anthropomorphic space station telerobot called Robonaut. Previous researchers have designed telerobotic workstations based upon performance of discrete subsets of tasks (for example, peg-in-hole, tracking, etc.) without regard for transitions that operators go through between tasks performed sequentially in the context of larger integrated tasks. The experiments presented here took an integrated approach to describing teleoperator performance and assessed how subjects operating a full-immersion telerobot perform during fine position and gross position tasks. In addition, a Robonaut simulation was also developed as part of this research effort, and experimentally tested against Robonaut itself to determine its utility. Results show that subject performance of teleoperated tasks using both Robonaut and the simulation are virtually identical, with no significant difference between the two. These results indicate that the simulation can be utilized as both a Robonaut training tool, and as a powerful design platform for telepresence displays and aids.

Rochlis, Jennifer L.↗

Integrated Design of a Telerobotic Workstation

The experiments described in this paper are part of a larger joint MIT/NASA research effort that focuses on the development of a methodology for designing and evaluating integrated interfaces for highly dexterous and multi-functional telerobots. Specifically, a telerobotic workstation is being designed for an Extravehicular Activity (EVA) anthropomorphic space station telerobot. Previous researchers have designed telerobotic workstations based upon performance of discrete subsets of tasks (for example, peg-in-hole, tracking, etc.) without regard for transitions that operators go through between tasks performed sequentially in the context of larger integrated tasks. The exploratory research experiments presented here took an integrated approach and assessed how subjects operating a full-immersion telerobot perform during the transitions between sub-tasks of two common EVA tasks. Preliminary results show that up to 30% of total task time is spent gaining and maintaining Situation Awareness (SA) of their task space and environment during transitions. Although task performance improves over the two trial days, the percentage of time spent on SA remains the same. This method identifies areas where workstation displays and feedback mechanisms are most needed to increase operator performance and decrease operator workload - areas that previous research methods have not been able to address.

Rochlis, Jennifer L.↗

SMOS/SMAP Synergy for SMAP Level 2 Soil Moisture Algorithm Evaluation

Soil Moisture Active Passive (SMAP) satellite has been proposed to provide global measurements of soil moisture and land freeze/thaw state at 10 km and 3 km resolutions, respectively. SMAP would also provide a radiometer-only soil moisture product at 40-km spatial resolution. This product and the supporting brightness temperature observations are common to both SMAP and European Space Agency's Soil Moisture and Ocean Salinity (SMOS) mission. As a result, there are opportunities for synergies between the two missions. These include exploiting the data for calibration and validation and establishing longer term L-band brightness temperature and derived soil moisture products. In this investigation we will be using SMOS brightness temperature, ancillary data, and soil moisture products to develop and evaluate a candidate SMAP L2 passive soil moisture retrieval algorithm. This work will begin with evaluations based on the SMOS product grids and ancillary data sets and transition to those that will be used by SMAP. An important step in this analysis is reprocessing the multiple incidence angle observations provided by SMOS to a global brightness temperature product that simulates the constant 40 degree incidence angle observations that SMAP will provide. The reprocessed brightness temperature data provide a basis for evaluating different SMAP algorithm alternatives. Several algorithms are being considered for the SMAP radiometer-only soil moisture retrieval. In this first phase, we utilized only the Single Channel Algorithm (SCA), which is based on the radiative transfer equation and uses the channel that is most sensitive to soil moisture (H-pol). Brightness temperature is corrected sequentially for the effects of temperature, vegetation, roughness (dynamic ancillary data sets) and soil texture (static ancillary data set). European Centre for Medium-Range Weather Forecasts (ECMWF) estimates of soil temperature for the top layer (as provided as part of the SMOS ancillary data) were used to correct for surface temperature effects and to derive microwave emissivity. ECMWF data were also used for precipitation forecasts, presence of snow, and frozen ground. Vegetation options are described below. One year of soil moisture observations from a set of four watersheds in the U.S. were used to evaluate four different retrieval methodologies: (1) SMOS soil moisture estimates (version 400), (2) SeA soil moisture estimates using the SMOS/SMAP data with SMOS estimated vegetation optical depth, which is part of the SMOS level 2 product, (3) SeA soil moisture estimates using the SMOS/SMAP data and the MODIS-based vegetation climatology data, and (4) SeA soil moisture estimates using the SMOS/SMAP data and actual MODIS observations. The use of SMOS real-world global microwave observations and the analyses described here will help in the development and selection of different land surface parameters and ancillary observations needed for the SMAP soil moisture algorithms. These investigations will greatly improve the quality and reliability of this SMAP product at launch.

Bindlish, Rajat↗

Binding Causes of Printed Wiring Assemblies with Card-Loks

A document discusses a study that presents the first documented extraction loads, both nominal and worst case, and presents the first comprehensive evaluation of extraction techniques, methodologies, and tool requirements relating to extracting printed wiring assemblies (PWAs) with Card-Loks during EVA (extra vehicular activity). This task was performed for the first time during HST (Hubble Space Telescope) Servicing Mission 4. With impending missions to Mars and to the Moon relying on an astronaut's abilities to perform repair and servicing tasks during EVAs, this study provides some insight into what challenges may be encountered during a repair/replacement of a PWA with Card-Loks. Extraction techniques presented in this study could be applicable to other PWA geometries with similar locking devices. Ground-based extractions also benefit from the techniques and extraction tool requirements presented in the study. The findings highlight techniques that work reliably, efficiently, and provide design requirements for tools necessary for extracting PWAs with Card-Loks on ground.

Raven, Hans↗

Conceptual Development of the DESDynI Mission

The high value of Radar and Lidar data for understanding climate change and earth dynamics led to the prioritization of the Deformation, Ecosystem Structure and Dynamics of Ice (DESDynI) mission as Tier One in the last National Academy of Sciences' Earth Science Decadal Survey. A mission concept that matched those desired objectives underwent pre-Project development and passed several layers of review in late 2010 and early 2011 with the target of a 2017 launch. However, cuts in the proposed FY2012 budget forced a reset of the Radar mission and eliminated the Lidar sciencecraft. The proposed DESDynI- Radar mission may now fulfill a more limited set of objectives with a more modest budget on a longer development timescale. A multitude of options have been studied with varying levels of cost, risk and science value. Flight and Ground system implementations have a direct bearing on many of these factors and will also be addressed. The methodology and status of evaluating these options will be discussed. A key distinguishing characteristic of the projected DESDynI-Radar measurement would be large scale coverage and frequent revisit at fine resolution. This would be enabled via a new Radar technique called SweepSAR. Efforts to develop and field test SweepSAR will also be discussed, as well as other technology developments underway that are associated with this mission

Deformation, Ecosystem Structure and Dynamics of I↗

Tradespace Exploration of Distributed Propulsors for Advanced On-Demand Mobility Concepts

Combustion-based sources of shaft power tend to significantly penalize distributed propulsion concepts, but electric motors represent an opportunity to advance the use of integrated distributed propulsion on an aircraft. This enables use of propellers in nontraditional, non-thrust-centric applications, including wing lift augmentation, through propeller slipstream acceleration from distributed leading edge propellers, as well as wingtip cruise propulsors. Developing propellers for these applications challenges long-held constraints within propeller design, such as the notion of optimizing for maximum propulsive efficiency, or the use of constant-speed propellers for high-performance aircraft. This paper explores the design space of fixed-pitch propellers for use as (1) lift augmentation when distributed about a wing's leading edge, and (2) as fixed-pitch cruise propellers with significant thrust at reduced tip speeds for takeoff. A methodology is developed for evaluating the high-level trades for these types of propellers and is applied to the exploration of a NASA Distributed Electric Propulsion concept. The results show that the leading edge propellers have very high solidity and pitch well outside of the empirical database, and that the cruise propellers can be operated over a wide RPM range to ensure that thrust can still be produced at takeoff without the need for a pitch change mechanism. To minimize noise exposure to observers on the ground, both the leading edge and cruise propellers are designed for low tip-speed operation during takeoff, climb, and approach.

Borer, Nicholas K.↗

Development Status and Performance Comparisons of Environmental Barrier Coating Systems for SiCSiC Ceramic Matrix Composites

Environmental barrier coatings (EBC) and SiCSiC ceramic matrix composites (CMCs) will play a crucial role in future aircraft turbine engine systems, because of their ability to significantly increase engine operating temperatures, reduce engine weight and cooling requirements. This paper presents current NASA EBC-CMC development emphases including: the coating composition and processing improvements, laser high heat flux-thermal gradient thermo-mechanical fatigue - environmental testing methodology development, and property evaluations for next generation EBC-CMC systems. EBCs processed with various deposition techniques including Plasma Spray, Electron Beam - Physical Vapor Deposition, and Plasma Spray Physical Vapor Deposition (PS-PVD) will be particularly discussed. The testing results and demonstrations of advanced EBCs-CMCs in complex simulated engine thermal gradient cyclic fatigue, oxidizing-steam and CMAS environments will help provide insights into the coating development strategies to meet long-term engine component durability goals.

Processing and Properties↗

Initiation and Propagation of Skin/Stiffener Separation in Postbuckled Structures Subjected to Cyclic Loads

A methodology is proposed to evaluate experimentally and numerically the initiation and propagation of skin/stiffener separation in postbuckled panels subjected to cyclic loads. The response mechanisms that characterize skin/stiffener separation were investigated using a three point bend (3PB) test specimen, which is a simple specimen consisting of a laminate representing the skin and a doubler representing the stiffener flange. The 3PB tests were performed under quasi-static and cyclic loads. A fatigue cohesive model was used to analyze the initiation and propagation of skin/stiffener separation in the 3PB. The results indicate that the fatigue cohesive model with model parameters obtained from quasi-static fracture tests can provide accurate predictions of initiation from a pristine state, and the rate of fatigue crack propagation for a variety of mode mixities, load levels, and stress ratios.

Carlos G Davila↗

New Mexico renewable development study

Since the early 1990s, Los Alamos National Laboratory (LANL) has applied electric grid models and simulation software to problems of national significance. This effort continues with a variety of other projects funded by the Department of Energy (DOE), other federal and state agencies and private companies. Critical to the success of these programs is the ability to integrate regional-scale models of the electric grid, to assess the propagation of grid impacts, and to present interactively the effect of potential mitigating actions required to stabilize the grid. All of these capabilities are applied in this study, to accomplish the following goals and objectives: (1) Develop an AC power flow model representing future conditions within New Mexico's electric grid, using commercial tools accepted by the utility industry; (2) Conduct a 'screening' analysis of options for accelerating potential renewable energy development through the addition of a statewide transmission collector system; (3) Estimate total revenue needed, jobs created (temporary and permanent) plus indirect and direct impacts to the state's economy; (4) Evaluate potential cost allocation methodology; and (5) Issue a project report that will provide information for policy direction by state regulators, project developers, and legislators.

14 SOLAR ENERGY↗

Combining Inspection and Unattended Monitoring: Statistical Analysis of Timely Detection

Process monitoring traditionally relies on facility operator measurements. New concepts for future inspection regimes include inspectorate-owned systems that enable unattended monitoring (UM) of all declared material flow \cite{smith_potential}. If such systems can be established as viable alternatives, they may provide an important new capability: a true inspector's estimate of MUF that can achieve the efficiency and effectiveness goals outlined by the IAEA. A rigorous statistical framework for comparing traditional and new methodologies is needed to evaluate this potential and enable inspectorates to optimally balance UM and sampling in the context of timely detection and cost constraints. Recognizing that these are only two among a wide range of safeguards activities that support mass balance evaluation to detect missing material, this paper compares UM to traditional safeguards sampling in terms of detection probabilities as a function of time based on simplistic material loss scenarios, and shows how the detection probabilities can be rather easily combined. Using this approach can help enable tradeoff analysis and optimal resource allocation.

international safeguards↗

Adapting Existing Energy Models for Resilience Analysis

Resilience is a topic receiving much attention in relation to energy systems, with particular attention being paid to the supply of electricity. As a result of the growing interest in energy sector resilience, research communities have proposed a plethora of candidate resilience indicators and metrics, most of which remain immature at different scales and segments within the energy system. A necessary focus of the research community lies in implementing, testing, and validating resilience metrics and analysis approaches in energy sector models, which will be invaluable for informing resilience planning and investment decisions. Recognizing these challenges that need to be addressed, we explore how to effectively integrate resilience considerations into energy sector models and tools. The overarching goal of the effort was to evaluate the data needs, methodologies, and outcomes—including consequences and/or changes in investment or operational decisions due to avoided consequences—based on resilience analysis in a range of existing tools. In particular, we selected five models originally built at NREL to explore non-resilience energy research questions to implement and exercise resilience metrics and analysis approaches. To demonstrate the importance of perspective, we selected models that represent different segments of the energy sector, geographic scales, and modeling approaches. A second important aspect of our effort was the development of generalized power interruption scenarios. These scenarios were intended to help establish a framework for simulating the effects of real-world threats in terms of their impacts on system components and, in turn, power interruption.

ENERGY PLANNING, POLICY, AND ECONOMY↗

Mastering HPC Runtime Prediction: From Observing Patterns to a Methodological Approach: Preprint

The continual expansion of high-performance computing (HPC) brings with it an increasing need for efficiency. Heavy investment in energy, hardware, and software infrastructure to support peta- and exascale computing requires the optimization of existing systems and, wherever possible, the discernment and adoption of best-practices towards these goals. Such is the case for runtime prediction. When a job is submitted to an HPC system, an estimate of its runtime is provided by the user in the form of "requested wallclock''. Error in this user-provided estimate can lead to jobs being prematurely killed by the scheduler, increased wait time on the queue, and decreased system utilization. More than fifteen years of research has been directed at mitigating these effects by using data-driven runtime predictions. Codified here is a set of commonalities and insights emerging from this body of work, which we present as recommendations and best practices. These practices are combined into a methodological approach described and evaluated on an 11-million-job dataset from the National Renewable Energy Laboratory's petascale HPC system, Eagle. This dataset and the accompanying codebase have been released to the public domain for the benefit of the wider HPC research community.

high performance computing↗

TopTemp: Parsing Precipitate Structure from Temper Topology

Technological advances are in part enabled by the development of novel manufacturing processes that give rise to new materials or material property improvements. Development and evaluation of new manufacturing methodologies is labor-, time-, and resource-intensive expensive due to complex, poorly defined relationships between advanced manufacturing process parameters and the resulting microstructures. In this work, we present a topological representation of temper (heat-treatment) dependent material micro-structure, as captured by scanning electron microscopy, called TopTemp. We show that this topological representation is able to support temper classification of microstructures in a data limited setting, generalizes well to previously unseen samples, is robust to image perturbations, and captures domain interpretable features. The presented work outperforms conventional deep learning baselines and is a first step towards improving understanding of process parameters and resulting material properties.

Kassab, Lara↗

Control of the Reduction/Oxidation State of the High Level Waste Form in the Defense Waste Processing Facility at the Savannah River Site - 12451

The Defense Waste Processing Facility at the Savannah River Site treats and immobilizes High Level Waste into a durable borosilicate glass for safe, permanent storage. Among the parameters important to the overall process is the reduction/oxidation state of the glass. Control strategies for the reduction/oxidation state of the glass have been developed and evolved over the last 20 years to provide a current strategy which is both accurate and robust. A description of the methodologies implemented to control, evaluate, and validate the reduction/oxidation state of the glass is discussed along with the impact of future facility changes (made to pursue a more aggressive program to empty High Level Waste tanks at the Savannah River Site) on the reduction/oxidation state of glass. The reduction/oxidation state of the glass is an important parameter to the operation of the Defense Waste Processing Facility. Control, evaluation, and validation of the reduction/oxidation state of the glass is of particular importance for melter operation. Melter feed which is too oxidizing can negatively impact production, while feed which is too reducing can result in catastrophic failure of the melter. Control strategies for the reduction/oxidation state of the glass have been developed and evolved over the last 20 years to provide a current strategy which is both accurate and robust. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗