Search NASA⌕ Search

SEARCH · Search NASA

Results for “evaluation methodology”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,027 records · Page 57

Environmental and economic optima of solar home systems design: A combined LCA and LCC approach

Here, we compare the economic and environmental optimal design of Solar Home Systems (SHSs) and explore the role of economic incentives (such as tariffs and technology costs) in approximating the two optima. To achieve that, we present a methodology for the environmental and economic evaluation of grid-connected SHSs: user-scale electric systems involving a photovoltaic (PV) power system and a battery energy storage system. The proposed methodology is based on a mixed integer linear programming (MILP) optimization, life cycle assessment and life cycle costing. This methodological framework is applied to a case study involving a typical SHS installation in Italy. The results of the environmental optimal design brought to the evaluation of a 3.25 kW PV assisted by 8.66 kWh of nickel cobalt manganese batteries, whereas the costs of the SHS are minimized by a small PV system (less than 1 kW). Results underline that the environmental optimal configurations rely on battery technologies, which entails a significant cost compared to the grid connection. In contrast, the economic optimal design solutions is less impactful than the grid mix both from an environmental and economic points of view. Thanks to a reduction of batteries and PV costs, the environmental impact of the economic optimal design is expected to decrease in the future.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Space Charge Analysis Capabilities for the Evaluation of High Voltage Insulation Materials

Materials development is crucial for the advancement of electric aviation. Current research focusing on novel multifunctional materials is underway to solve the needs for aerospace systems; however, additional testing of these materials to understand their failure modes is equally critical. This project will utilize pulsed electroacoustic (PEA) instrumentation to investigate space charge accumulation of multifunctional composites and other insulation materials critical to robust high power transmission systems. Evaluating the space charge phenomena in dielectric materials will provide unique and fundamentally necessary data to determine the feasibility and lifetime of any high voltage insulation system. When electrical charge is injected into a solid dielectric, charge can accumulate and become trapped, leading to the failure of the insulation via breakdown or arcing events. This study will discuss the pulsed electroacoustic methodology and its use on evaluating various dielectric polymer and composite films.

pulsed electroacoustic↗

User Evaluation of the NASA Technical Report Server Recommendation Service

We present the user evaluation of two recommendation server methodologies implemented for the NASA Technical Report Server (NTRS). One methodology for generating recommendations uses log analysis to identify co-retrieval events on full-text documents. For comparison, we used the Vector Space Model (VSM) as the second methodology. We calculated cosine similarities and used the top 10 most similar documents (based on metadata) as 'recommendations'. We then ran an experiment with NASA Langley Research Center (LaRC) staff members to gather their feedback on which method produced the most 'quality' recommendations. We found that in most cases VSM outperformed log analysis of co-retrievals. However, analyzing the data revealed the evaluations may have been structurally biased in favor of the VSM generated recommendations. We explore some possible methods for combining log analysis and VSM generated recommendations and suggest areas of future work.

Nelson, Michael L.↗

User Evaluation of the NASA Technical Report Server Recommendation Service

We present the user evaluation of two recommendation server methodologies implemented for the NASA Technical Report Server (NTRS). One methodology for generating recommendations uses log analysis to identify co-retrieval events on full-text documents. For comparison, we used the Vector Space Model (VSM) as the second methodology. We calculated cosine similarities and used the top 10 most similar documents (based on metadata) as recommendations . We then ran an experiment with NASA Langley Research Center (LaRC) staff members to gather their feedback on which method produced the most quality recommendations. We found that in most cases VSM outperformed log analysis of co-retrievals. However, analyzing the data revealed the evaluations may have been structurally biased in favor of the VSM generated recommendations. We explore some possible methods for combining log analysis and VSM generated recommendations and suggest areas of future work.

Nelson, Michael L.↗

Training Evaluation: A Case Study of Measuring Impact and ROI

The purpose of this case study was to evaluate the Compliance Officer/Coordinator (CO/CC) training program using Phillips’ approach to training evaluation. INL Learning Performance Consultants (LPCs) applied the ROI Methodology to measure the effectiveness of the CO/CC training program. INL CO/CCs participated in focus groups to provide feedback on their learning, enablers and barriers to applying what they learned, and opportunities to improve the CO/CC learning experience. With collaboration from the CO/CC training program owner, the LPCs demonstrated the business impact and return on investment (ROI) of the CO/CC training program. Included are training program recommendations and lessons learned using the ROI Methodology.

99 GENERAL AND MISCELLANEOUS↗

A methodology for hypersonic transport technology planning

A systematic procedure by which the relative economic value of technology factors affecting design, configuration, and operation of a hypersonic cruise transport can be evaluated is discussed. Use of the methodology results in identification of first-order economic gains potentially achievable by projected advances in each of the definable, hypersonic technologies. Starting with a baseline vehicle, the formulas, procedures and forms which are integral parts of this methodology are developed. A demonstration of the methodology is presented for one specific hypersonic vehicle system.

Repic, E. M.↗

Loads and performance data from a wind-tunnel test of model articulated helicopter rotors with 2 different blade torsional stiffnesses

A passive means of tailoring helicopter rotor blades to improve performance and reduce loads was evaluated. The parameters investigated were blade torsional stiffness, blade section camber, and distance between blade structural elastic axis and blade tip aerodynamic center. This offset was accomplished by sweeping the tip. The investigation was conducted at advance ratios of 0.20, 0.30, and 0.40. Data are presented without analysis; however, cross referencing of performance data and harmonic loads data may be useful to the analyst for validating aeroelastic theories and design methodologies as well as for evaluating passive aeroelastic tailoring or rotor blade parameters.

Yeager, W. T., Jr.↗

The effects of compressive preloads on the compression-after-impact strength of carbon/epoxy

A preloading device was used to examine the effects of compressive prestress on the compression-after-impact (CAI) strength of 16-ply, quasi-isotropic carbon epoxy test coupons. T300/934 material was evaluated at preloads from 200 to 4000 lb at impact energies from 1 to 9 joules. IM7/8551-7 material was evaluated at preloads from 4000 to 10,000 lb at impact energies from 4 to 16 joules. Advanced design of experiments methodology was used to design and evaluate the test matrices. The results showed that no statistically significant change in CAI strength could be contributed to the amount of compressive preload applied to the specimen.

Nettles, A. T.↗

Multiscale Modeling of Reconstructed Tricalcium Silicate using NASA Multiscale Analysis Tool

To study microstructure characteristics of cementitious materials hydrated in space; previously, cement binder formations were processed under microgravity conditions and was further compared against ground-based experiments. For accurate estimation of process-structure-property linkage, particularly on samples hydrated in the microgravity environment, it is desired to have a high-fidelity volumetric representation of the microstructure. However, owing to small sample size and high porosity of the space-returned samples, conventional experimental characterization techniques are not viable. Hence, a deep learning-based reconstruction algorithm was employed to obtain high fidelity 3D volumes from sparse high resolution 2D Scanning Electron Microscopy (SEM) images, as inputs to micromechanics-based modeling. This machine learning-based reconstruction methodology validated against low-order statistical descriptors, captured the microstructural topology of both sample types (ground, 1g and microgravity, μg). Due to the lack of gravity, hydration products of the samples processed in space differed from those processed-on ground. Such AI-generated virtual samples were analyzed in a multiscale recursive micromechanics approach using the NASA Multiscale Analysis Tool (NASMAT). Here, we present a methodology to rapidly integrate and evaluate these AI-generated volumes in NASMAT. The synthesized microstructural volumes are directly employed as Representative Volume Elements (RVEs) to preserve the fidelity (1 pixel = 0.54 m). Invariably, analysis of such largescale problems (5123 voxels) requires huge amount of computational resources. By taking advantage of the NASMAT architecture, we also focused on systematic multiscale integration of these AI-reconstructed virtual volumes to reduce the computational demands. In this work, this methodology is demonstrated on the ground-based, 1g samples. The estimated stiffness value of 15.90 GPa is comparable to experimentally obtained modulus of hydrated tricalcium silicate sample. The workflow presented here paves the way for utilizing the NASMAT tool to perform multiscale analyses of other multi-phase material systems using either 3D virtual datasets synthesized using AI or obtained via micro-CT.

Machine Learning↗

Proliferation resistance: issues, initiatives and evaluation

The vision of a nuclear renaissance has highlighted the issue of proliferation resistance. The prospects for a dramatic growth in nuclear power may depend on the effectiveness of, and the resources devoted to, plans to develop and implement technologies and approaches that strengthen proliferation resistance. The GenIV International Forum (GIF) and others have devoted attention and resources to proliferation resistance. However, the hope of finding a way to make the peaceful uses of nuclear energy resistant to proliferation has reappeared again and again in the history of nuclear power with little practical consequence. The concept of proliferation resistance has usually focused on intrinsic (technological) as opposed to extrinsic (institutional) factors. However, if there are benefits that may yet be realized from reactors and other facilities designed to minimize proliferation risks, it is their coupling with effective safeguards and other nonproliferation measures that likely will be critical. Proliferation resistance has also traditionally been applied only to state threats. Although there are no technologies that can wholly eliminate the risk of proliferation by a determined state, technology can play a limited role in reducing state threats and perhaps in eliminating many non-state threats. These and other issues are not academic. They affect efforts to evaluate proliferation resistance, including the methodology developed by GIF's Proliferation Resistance and Physical Protection (PR&PP) Working Group as well as the proliferation resistance initiatives that are being pursued or may be developed in the future. This paper will offer a new framework for thinking about proliferation resistance issues, including the ways the output of the methodology could be developed to inform the decisions that states, the International Atomic Energy (IAEA) and others will have to make in order to fully realize the promise of a nuclear renaissance.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Evaluation of kinesthetic-tactual displays using a critical tracking task

The study sought to investigate the feasibility of applying the critical tracking task paradigm to the evaluation of kinesthetic-tactual displays. Four subjects attempted to control a first-order unstable system with a continuously decreasing time constant by using either visual or tactual unidimensional displays. Display aiding was introduced in both modalities in the form of velocity quickening. Visual tracking performance was better than tactual tracking, and velocity aiding improved the critical tracking scores for visual and tactual tracking about equally. The results suggest that the critical task methodology holds considerable promise for evaluating kinesthetic-tactual displays.

Jagacinski, R. J.↗

Document Management: A Focused Analysis on the Configuration Management Process at Y-12 National Security Complex

The configuration management process at Y-12 is a crucial process to ensure safe operations and compliance with Department of Energy (DOE) regulations and requirements. This process is evaluated utilizing systems-thinking methodology in order to understand the current operational flow, with the ultimate goal of building an easily understandable, representative model. This model offers insights on key areas of waste and provides a potential solution by modernizing rate limiting steps: a software implementation to update the traditional document management system and make it paperless. Stakeholders of the software implementation are identified in order to define characteristic requirements of an effective product and the anticipated benefit is evaluated. Ultimately, this project is an effort to increase the quality of life for all stakeholders, while improving the capacity, throughput, and effectiveness of a necessary process at Y-12.

42 ENGINEERING↗

Formal Aspects of Human-Automation Interaction

While new versions of automated control systems such as flight guidance systems are introduced at a rapid pace, it is widely recognized that user interaction with these machines is increasingly problematic. One cause for this difficulty that is commonly cited in the literature, is the discrepancy between the machine's behavior and the operator's (e.g., pilot) expectations. This paper discusses a formal approach to the analysis of operator's interaction with complex automated control systems. We focus attention on the issue of interface correctness; that is, on the question whether the display provides adequate information about the machine's configurations (states, modes, and associated parameters) and transitions, so as to enable the operator to successfully perform the specified set of tasks. To perform the analysis several assumptions are made: (1) A complete formal model of the machine's behavior is available (e.g., as a state transition system, or as a hybrid-machine); (2) A specification of operator's tasks is available and can be formally described (e.g., the reliable and predictable transition between activities involved in executing a climb to a new altitude); (3) The pilot is well trained and has a correct 'mental' model of the machine's response-map. By 'comparing' the machine's model with the set of operator's tasks we formally (i.e., mathematically) evaluate two questions: 1) does the machine's output interface (display) enable the operator to determine, unambiguously, what the current configuration (e.g., mode) of the machine is, and 2) does the display enable the operator to determine, unambiguously, what the next configuration of the machine will be, in response to a specified interaction by the operator (e.g., engaging a mode or changing a parameter such as a speed or target altitude). This paper describes a methodology for conducting such an evaluation using examples from automated flight control systems of modem 'glass cockpit' jetliners. Taxonomy of the different types of discrepancies that lead to pilot inability to resolve the current and next configuration of the machine is suggested. Data from incident reports involving 'mode confusion' is used to corroborate these discrepancies. Finally, means for compensating, either by augmenting the display and/or the operator's 'mental model' are briefly mentioned.

Degani, Asaf↗

A Methodology for defining intermediate level waste package characteristics that ensure criticality safety in a geological disposal facility - 14599

Radioactive Waste Management (RWM) is responsible for implementing geological disposal of the UK's higher activity radioactive wastes. These wastes include fissile nuclides and, therefore, demonstration of the criticality safety of the wastes under disposal conditions forms an important component of RWM's disposal system safety case. The basis for ensuring criticality safety of intermediate level waste (ILW) packages is to specify controls on the fissile material content of individual packages through the application of deterministic criticality safety assessments (CSAs). The approach is defined and controlled through RWM's Disposability Assessment process, which aims to ensure that: criticality is prevented during waste package transport to a GDF; the risk of criticality is tolerable and as low as reasonably practicable (ALARP) during GDF operations; and the likelihood and consequences of criticality arising from the evolution of waste packages after GDF closure are low. The most restrictive phase determines the package fissile material limit and, until now, in many cases the GDF post-closure phase has provided the most restrictive limit. Currently, the GDF post-closure limits are derived deterministically using highly stylised and conservative assumptions about fissile material accumulations occurring on very long timescales into the future. RWM, waste producers and regulators do not currently consider this approach to be yielding an appropriate balance of risk. Therefore, RWM is modifying the process for setting fissile material limits on ILW packages by making use of the outcomes of its recent research projects to establish the likelihood of post-closure criticality in a GDF and the consequences of hypothetical post-closure criticality events (presented in companion papers). This paper presents the revised methodology, which is based on the requirement that criticality in a GDF can be demonstrated to be of low and tolerable consequences with regard the performance of a GDF. A probabilistic 'low-likelihood package envelope' is proposed that establishes the packaging and disposal facility conditions under which post-closure criticality is considered to be of low likelihood and low consequence. The bounding conditions for establishing the extent of the package envelope have been evaluated through application of the methodologies and models developed in RWM's Likelihood of Criticality research project. It is expected that the vast majority of ILW packages would meet the package envelope requirements. The methodology also allows the use of other options, such as deterministic CSAs, for waste packages that fall outside the low-likelihood package envelope. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Methodology for Estimating Performance and Cost of Natural Gas Combined Cycle Plants with Carbon Capture

This document describes a methodology that allows developers and evaluators to assess the status of developmental, natural gas combined cycle (NGCC) power plant post-combustion carbon dioxide (CO 2 ) separation technologies with respect to NETL performance and cost metrics. Developmental CO 2 separation technologies that might apply for NGCC post-combustion power generation can be placed into several categories, including, but not limited to membranes, solvents, sorbents, adsorbents, and phase-change technologies. The intent of this product is to provide a consistent methodology for high-level comparison of in-development technology to a standardized baseline.

20 FOSSIL-FUELED POWER PLANTS↗

Evaluation Framework and Analyses for Thermal Energy Storage Integrated with Packaged Air Conditioning

Few third-party guidance documents or tools are available for evaluating thermal energy storage (TES) integrated with packaged air conditioning (AC), as this type of TES is relatively new compared to TES integrated with chillers or hot water systems. To address this gap, researchers at the National Renewable Energy Laboratory conducted a project to improve the ability of potential technology adopters to evaluate TES technologies. Major project outcomes included: development of an evaluation framework to describe key metrics, methodologies, and issues to consider when assessing the performance of TES systems integrated with packaged AC; application of multiple concepts from the evaluation framework to analyze performance data from four demonstration sites; and production of a new simulation capability that enables modeling of TES integrated with packaged AC in EnergyPlus. This report includes the evaluation framework and analysis results from the project.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Processing ultrasonic inspection data from multiple scan patterns for turbine rotor weld build-up evaluations

The study presents a data processing methodology for weld build-up using multiple scan patterns. To achieve an overall high probability of detection for flaws with different orientations, an inspection procedure with three different scan patterns is proposed. The three scan patterns are radial-tangential longitude wave pattern, axial-radial longitude wave pattern, and tangential shear wave pattern. Scientific fusion of the inspection data is implemented using volume reconstruction techniques. The idea is to perform spatial domain forward data mapping for all sampling points. A conservative scheme is employed to handle the case that multiple sampling points are mapped to one grid location. The scheme assigns the maximum value for the grid location to retain the largest equivalent reflector size for the location. The methodology is demonstrated and validated using a realistic ring of weld build-up. Tungsten balls and bars are embedded to the weld build-up during manufacturing process to represent natural flaws. Flat bottomed holes and side drilled holes are installed as artificial flaws. Automatic flaw identification and extraction are demonstrated. Results indicate the inspection procedure with multiple scan patterns can identify all the artificial and natural flaws.

42 ENGINEERING↗

pystorms: A simulation sandbox for the development and evaluation of stormwater control algorithms

Advances in cyber–physical technologies have enabled real-time sensing and adaptive control of stormwater infrastructure. These smart stormwater systems allow for inexpensive, minimally-invasive stormwater control interventions in lieu of new construction. Importantly, however promising the area of smart stormwater control, there still remain barriers – for experts and novices alike – to access shared tools and methods for investigating, developing, and contributing to it. In an effort to make smart stormwater control research more methodical and accessible, we present pystorms, an open-source Python-based simulation sandbox that facilitates the quantitative evaluation and comparison of control strategies. pystorms consists of a collection of real world-inspired smart stormwater control scenarios on which any number of control strategies can be applied and tested via an accompanying Python programming interface and coupled stormwater simulator. pystorms provides a framework for the rigorous and efficient evaluation of smart stormwater control methodologies across diverse watersheds with only a few lines of code.

54 ENVIRONMENTAL SCIENCES↗