A systems methodology for evaluating industrial projects in the context of national strategies
Explore the source record for details and available documents.
Roberts, E. B.↗
SEARCH · Search NASA
Results for “evaluation methodology”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
A review and preliminary evaluation of methodological factors in performance assessments of time-varying aircraft noise effects
The effects of aircraft noise on human performance is considered. Progress is reported in the following areas: (1) review of the literature to identify the methodological and stimulus parameters involved in the study of noise effects on human performance; (2) development of a theoretical framework to provide working hypotheses as to the effects of noise on complex human performance; and (3) data collection on the first of several experimental investigations designed to provide tests of the hypotheses.
Coates, G. D.↗
Report of Workshop on Methodology for Evaluating Potential Lunar Resources Sites
The type and quantity of lunar materials needed to support a space power satellite program was used to define the type and quality of geological information required to certify a site for exploitation. The existing geological, geochemical, and geophysical data are summarized. The difference between these data and the required data for exploitation is used to define program requirements. Most of these requirements involve linear extensions of existing capabilities, fuller utilization of existing data, or expanded use of automated systems.
Williams, R. J.↗
Test methodology for evaluation of fireworthy aircraft seat cushions
Aircraft seat materials were evaluated in terms of their thermal performance. The materials were evaluated using (a) thermogravimetric analysis, (b) differential scanning calorimetry, (c) a modified NBS smoke chamber to determine the rate of mass loss and (d) the NASA T-3 apparatus to determine the thermal efficiency. In this paper, the modified NBS smoke chamber will be described in detail since it provided the most conclusive results. The NBS smoke chamber was modified to measure the weight loss of materials when exposed to a radiant heat source over the range of 2.5 to 7.5 W/cm sq. This chamber has been utilized to evaluate the thermal performance of various heat blocking layers utilized to protect the polyurethane cushioning foam used in aircraft seats. Various kinds of heat blocking layers were evaluated by monitoring the weight loss of miniature seat cushions when exposed to the radiant heat. The effectiveness of aluminized heat blocking systems was demonstrated when compared to conventional heat blocking layers such as neoprene. All heat blocking systems showed good fire protection capabilities when compared to the state-of-the-art, i.e., wool-nylon over polyurethane foam.
Kourtides, D. A.↗
A methodology for evaluation of an interactive multispectral image processing system
Because of the considerable cost of an interactive multispectral image processing system, an evaluation of a prospective system should be performed to ascertain if it will be acceptable to the anticipated users. Evaluation of a developmental system indicated that the important system elements include documentation, user friendliness, image processing capabilities, and system services. The criteria and evaluation procedures for these elements are described herein. The following factors contributed to the success of the evaluation of the developmental system: (1) careful review of documentation prior to program development, (2) construction and testing of macromodules representing typical processing scenarios, (3) availability of other image processing systems for referral and verification, and (4) use of testing personnel with an applications perspective and experience with other systems. This evaluation was done in addition to and independently of program testing by the software developers of the system.
Kovalick, William M.↗
A methodology for evaluating the reliability and risk of structures under complex service environments
The theoretical basis and numerical implementation of NESSUS (Numerical Evaluation of Stochastic Structures Under Stress; Cruse et al., 1988), a computer code for probabilistic structural analyses of aerospace components, are described, with an emphasis on the use of NESSUS for reliability and risk assessment. Topics addressed include the structure of NESSUS, the material-properties model, computational procedures, probabilistic models of fatigue-crack initiation, risk/cost evaluation, fatigue-fracture analyses, and fatigue-crack propagation. Numerical results from typical applications are presented in extensive graphs and briefly characterized; the usefulness of NESSUS predictions for establishing inspection and retirement schedules and for component certification is indicated.
Shiao, Michael C.↗
A methodology for evaluating the reliability and risk of structures under complex service environments
The theoretical basis and numerical implementation of NESSUS (Numerical Evaluation of Stochastic Structures Under Stress), a computer code for probabilistic structural analysis of aerospace components, are described, with an emphasis on the use of NESSUS for reliability and risk assessment. Topics addressed include the structure of probabilistic models of fatigue-crack initiation, risk/cost evaluation, fatigue-fracture analysis, and fatigue-crack initiation. Numerical results from typical applications are presented in graphs and briefly characterized. The usefulness of NESSUS predictions for establishing inspection and retirement schedules and for component certification is indicated.
Shiao, Michael C.↗
Simulated fault injection - A methodology to evaluate fault tolerant microprocessor architectures
A simulation-based fault-injection method for validating fault-tolerant microprocessor architectures is described. The approach uses mixed-mode simulation (electrical/logic analysis), and injects transient errors in run-time to assess the resulting fault impact. As an example, a fault-tolerant architecture which models the digital aspects of a dual-channel real-time jet-engine controller is used. The level of effectiveness of the dual configuration with respect to single and multiple transients is measured. The results indicate 100 percent coverage of single transients. Approximately 12 percent of the multiple transients affect both channels; none result in controller failure since two additional levels of redundancy exist.
Choi, Gwan S.↗
The Traps of Using Conventional Methodology of Evaluation of Powder Diffractograms for Determination of the Lattice Parameters of Nanocrystals
The inherent errors introduced by the algorithm of standard procedures of evaluation of powder diffractograms of nanopowders are shown. The implications of the errors are discussed and illustrated based on the results reported in the literature.
Palosz, Bogdan↗
Influence Map Methodology for Evaluating Systemic Safety Issues
"Raising the bar" in safety performance is a critical challenge for many organizations, including Kennedy Space Center. Contributing-factor taxonomies organize information about the reasons accidents occur and therefore are essential elements of accident investigations and safety reporting systems. Organizations must balance efforts to identify causes of specific accidents with efforts to evaluate systemic safety issues in order to become more proactive about improving safety. This project successfully addressed the following two problems: (1) methods and metrics to support the design of effective taxonomies are limited and (2) influence relationships among contributing factors are not explicitly modeled within a taxonomy.
Source record↗
Contact Thermocouple Methodology and Evaluation for Temperature Measurement in the Laboratory
Laboratory testing of advanced aerospace components very often requires highly accurate temperature measurement and control devices, as well as methods to precisely analyze and predict the performance of such components. Analysis of test articles depends on accurate measurements of temperature across the specimen. Where possible, this task is accomplished using many thermocouples welded directly to the test specimen, which can produce results with great precision. However, it is known that thermocouple spot welds can initiate deleterious cracks in some materials, prohibiting the use of welded thermocouples. Such is the case for the nickel-based superalloy MarM-247, which is used in the high temperature, high pressure heater heads for the Advanced Stirling Converter component of the Advanced Stirling Radioisotope Generator space power system. To overcome this limitation, a method was developed that uses small diameter contact thermocouples to measure the temperature of heater head test articles with the same level of accuracy as welded thermocouples. This paper includes a brief introduction and a background describing the circumstances that compelled the development of the contact thermocouple measurement method. Next, the paper describes studies performed on contact thermocouple readings to determine the accuracy of results. It continues on to describe in detail the developed measurement method and the evaluation of results produced. A further study that evaluates the performance of different measurement output devices is also described. Finally, a brief conclusion and summary of results is provided.
thermocouple↗
First Reprocessing of Southern Hemisphere ADditional OZonesondes (SHADOZ) Profile Records (1998-2015): 1. Methodology and Evaluation
Electrochemical concentration cell ozonesonde measurements are an important source of highly resolved vertical profiles of ozone with long-term data records for deriving ozone trends, model development, satellite validation, and air quality studies. Ozonesonde stations employ a range of operational and data processing procedures, metadata reporting, and instrument changes that have resulted in inhomogeneities within individual station data records. A major milestone is the first reprocessing of seven Southern Hemisphere ADditional OZonesondes (SHADOZ) station ozonesonde records to account for errors and biases in operating/processing procedures. Ascension Island, Hanoi, Irene, Kuala Lumpur, La Reunion, Natal, and Watukosek station records all show an overall increase in ozone after reprocessing. Watukosek shows the largest increase of 9.0 plus or minus 2.1 Dobson Units (DU) in total column ozone; Irene and Hanoi show a 5.5 plus or minus 2.5 DU increase, while remaining sites show statistically insignificant enhancements. Negligible to modest ozone enhancements are observed after reprocessing in the troposphere (up to 8%) and stratosphere (up to 6%), except at La Reunion for which the application of background currents reduces tropospheric ozone (2.1 plus or minus1.3 DU). Inhomogeneities due to ozonesonde/solution-type changes at Ascension, Natal, and La Reunion are resolved with the application of transfer functions. Comparisons with EP-TOMS, Aura's Ozone Monitoring Instrument and Microwave Limb Sounder (MLS) satellite ozone overpasses show an overall improvement in agreement after reprocessing. Most reprocessed data sets show a significant reduction in biases with MLS at the ozone maximum region (50-10 hPa). Changes in radiosonde/ozonesonde system and nonstandard solution types can account for remaining discrepancies observed at several sites when compared to satellites.
Electrochemical concentration cell ozonesonde meas↗
High Spectral Resolution Lidar – Generation 2 (HSRL-2) Retrievals of Ocean Surface Wind Speed: Methodology and Evaluation
Ocean surface wind speed (i.e., wind speed 10 m above sea level) is a critical parameter used by atmospheric models to estimate the state of the marine atmospheric boundary layer (MABL). Accurate surface wind speed measurements in diverse locations are required to improve characterization of MABL dynamics and assess how models simulate large-scale phenomena related to climate change and global weather patterns. To provide these measurements, this study introduces and evaluates a new surface wind speed data product from the NASA Langley Research Center nadir-viewing High Spectral Resolution Lidar – generation 2 (HSRL-2) using data collected as part of the NASA Aerosol Cloud meTeorology Interactions oVer the western ATlantic Experiment (ACTIVATE) mission. The HSRL-2 can directly measure vertically resolved aerosol backscatter and extinction profiles without additional constraints or assumptions, enabling the instrument to accurately derive atmospheric attenuation and directly determine surface reflectance (i.e., surface backscatter). Also, the high horizontal spatial resolution of the HSRL-2 retrievals (0.5 s or ∼ 75 m along track) allows the instrument to probe the fine-scale spatial variability in surface wind speeds over time along the flight track and over breaks in broken cloud fields. A rigorous evaluation of these retrievals is performed by comparing coincident HSRL-2 and National Center for Atmospheric Research (NCAR) Airborne Vertical Atmosphere Profiling System (AVAPS) dropsonde data, owing to the joint deployment of these two instruments on the ACTIVATE King Air aircraft. These comparisons show correlations of 0.89, slopes of 1.04 and 1.17, and y intercepts of −0.13 and −1.05 m s−1 for linear and bisector regressions, respectively, and the overall accuracy is calculated to be 0.15 ± 1.80 m s−1. It is also shown that the dropsonde surface wind speed data most closely follow the HSRL-2 distribution of wave slope variance using the distribution proposed by Hu et al. (2008) rather than the ones proposed by Cox and Munk (1954) and Wu (1990) for surface wind speeds below 7 m s−1, with this category comprising most of the ACTIVATE data set. The retrievals are then evaluated separately for surface wind speeds below 7 m s−1 and between 7 and 13.3 m s−1 and show that the HSRL-2 retrieves surface wind speeds with a bias of ∼ 0.5 m s−1 and an error of ∼ 1.5 m s−1, a finding not apparent in the cumulative comparisons. Also, it is shown that the HSRL-2 retrievals are more accurate in the summer (−0.18 ± 1.52 m s−1) than in the winter (0.63 ± 2.07 m s−1), but the HSRL-2 is still able to make numerous (N=236) accurate retrievals in the winter. Overall, this study highlights the abilities and assesses the performance of the HSRL-2 surface wind speed retrievals, and it is hoped that further evaluation of these retrievals will be performed using other airborne and satellite data sets.
Sanja Dmitrovic↗
SeaWiFS Postlaunch Calibration and Validation Analyses
The effort to resolve data quality issues and improve on the initial data evaluation methodologies of the SeaWiFS Project was an extensive one. These evaluations have resulted, to date, in three major reprocessings of the entire data set where each reprocessing addressed the data quality issues that could be identified up to the time of the reprocessing. Three volumes of the SeaWiFS Postlaunch Technical Report Series (Volumes 9, 10, and 11) are needed to document the improvements implemented since launch. Volume 10 continues the sequential presentation of postlaunch data analysis and algorithm descriptions begun in Volume 9. Chapter 1 of Volume 10 describes an absorbing aerosol index, similar to that produced by the Total Ozone Mapping Spectrometer (TOMS) Project, which is used to flag pixels contaminated by absorbing aerosols, such as, dust and smoke. Chapter 2 discusses the algorithm being used to remove SeaWiFS out-of-band radiance from the water-leaving radiances. Chapter 3 provides an itemization of all significant changes in the processing algorithms for each of the first three reprocessings. Chapter 4 shows the time series of global clear water and deep-water (depths greater than 1,000m) bio-optical and atmospheric properties (normalized water-leaving radiances, chlorophyll, atmospheric optical depth, etc.) based on the eight-day composites as a check on the sensor calibration stability. Chapter 5 examines the variation in the derived products with scan angle using high resolution data around Hawaii to test for residual scan modulation effects and atmospheric correction biases. Chapter 6 provides a methodology for evaluating the atmospheric correction algorithm and atmospheric derived products using ground-based observations. Similarly, Chapter 7 presents match-up comparisons of coincident satellite and in situ data to determine the accuracy of the water-leaving radiances, chlorophyll a, and K(490) products.
Hooker, Stanford B.↗
The smart highway project: Smart highways, smart vehicles, smart engineering
The Smart Highway project is a six mile, limited access roadway being built between Interstate 81 and Blacksburg, Virginia. The initial construction segment will be two miles long and is designed to serve as a test bed and test track for Intelligent Transportation Systems (ITS) research. The Center for Transportation Research (CTR) at Virginia Tech is developing three evaluation tools for its ITS research including DYNAVIMTS (a software framework), and the FLASH Lab (a 1/15th scale model highway and vehicle system). The Smart Highway rounds out the Center's evaluation methodology by allowing full scale operational tests, evaluations, and research under both experimental and conventional traffic conditions. Currently under development is a concept for a fully automated highway using a 'Cooperative Infrastructure Managed System' which involves ultra wide band communication beacons installed in the infrastructure with appropriate sensors, receivers and processors on board the vehicles. The project is part of the research program funded by the National Automated Highway System Consortium. The CTR hopes to develop the automated concept to prototype status by 1997. Other smart transportation and smart engineering concepts are proposed. This presentation will address the goals and objectives of the Smart Highway project, overview its status and importance to the region, and identify some of the transportation technology now under development and planned in the future.
Pethtel, Ray D.↗
Methodology and Tool for the Physical Security Analysis of Micro and Advanced Reactors
This work proposes a dynamic evaluation methodology to relax the conservatism in physical security evaluation, by leveraging an ongoing work in the Light Water Reactor Sustainability pathway. This methodology is implemented in a dynamic risk assessment tool named Event Modeling Risk Assessment using Linked Diagrams (EMRALD). The work extends EMRALD’s capability to support a sandbox feature where analysts can easily create attack scenarios and modify advanced/small modular reactor (A/SMR) security and safety features using templates. This approach saves time and cost since the analysis does not require creating detailed computer-aided design models, as is commonly required in commercial force-on-force software tools. EMRALD is completely free to use at https://emraldapp.inl.gov. We have developed basic templates including physical barriers, intrusion sensors, physical areas, and safety actions, that can be downloaded from EMRALD’s GitHub site: https://github.com/idaholab/EMRALD. These templates use generic data commonly used for training purposes, which do not reflect any actual operating nuclear reactor. Users may adjust the data in the templates with their own dataset and/or create new templates in EMRALD. The proposed methodology combines security and safety by assessing sabotage effects up to the radiological consequence to the public instead of merely the core damage state. This practice follows the industry standard for advanced non-light-water reactors currently proposed for endorsement by the Nuclear Regulatory Commission. The combination of security and safety is expressed in an achievability-consequence chart. EMRALD can be used to generate data for this chart. A hypothetical case study using a representative sodium-cooled fast reactor (SFR) facility is presented in this report to demonstrate this methodology. This case study does not contain any actual nuclear plant information. This work will benefit A/SMR vendors and utilities to implement security by design during the reactor design iteration phase, such that they do not have to perform upgrades and retrofits to the reactor after it is installed to improve its physical protection system. The tool may also be used to analyze domestic or foreign reactor designs to support the International Nuclear Security Techniques for Advanced Reactors (INSTAR) bilateral missions. Future works are planned to implement the methodology on a reference SFR reactor and a reference high-temperature gas-cooled reactor to obtain insights and lessons-learned for the A/SMR community.
97 MATHEMATICS AND COMPUTING↗
Multicriteria screening evaluation of geothermal resources on mine lands for direct use heating
Abstract Direct use of geothermal energy is the oldest and most versatile form of utilizing geothermal energy. In the last decade, this utilization has significantly increased, especially with the installation of geothermal (ground-source) heat pumps. Many current and inactive mine land sites across the U.S. could be redeveloped with clean energy technologies such as direct use geothermal, which would revitalize former mining communities, help with reducing greenhouse gas emissions, and accelerate the transition to a clean energy economy. We present a multicriteria screening framework to evaluate various aspects of direct-use geothermal projects on mine lands. The criteria are divided into three categories: (1) technical potential, (2) demand and benefits, and (3) regulatory and permitting. We demonstrate the framework using publicly available data on a national scale (continental U.S.). Then, using an example of abandoned coal mines in Illinois and focusing on resource potential, we illustrate how this evaluation can be applied at the state or more local scales when a region’s characteristics drive spatial variability estimates. The strength of this approach is the ability to combine seemingly disparate parameters and inputs from numerous sources. The framework is very flexible—additional criteria can be easily incorporated and weights modified if input data support them. Vice versa, the framework can also help identify additional data needed for evaluating those criteria. The multicriteria screening evaluation methodology provides a framework for identifying potential candidates for detailed site evaluation and characterization.
15 GEOTHERMAL ENERGY↗
Wind Tunnel Management and Resource Optimization: A Systems Modeling Approach
Time, money, and, personnel are becoming increasingly scarce resources within government agencies due to a reduction in funding and the desire to demonstrate responsible economic efficiency. The ability of an organization to plan and schedule resources effectively can provide the necessary leverage to improve productivity, provide continuous support to all projects, and insure flexibility in a rapidly changing environment. Without adequate internal controls the organization is forced to rely on external support, waste precious resources, and risk an inefficient response to change. Management systems must be developed and applied that strive to maximize the utility of existing resources in order to achieve the goal of "faster, cheaper, better". An area of concern within NASA Langley Research Center was the scheduling, planning, and resource management of the Wind Tunnel Enterprise operations. Nine wind tunnels make up the Enterprise. Prior to this research, these wind tunnel groups did not employ a rigorous or standardized management planning system. In addition, each wind tunnel unit operated from a position of autonomy, with little coordination of clients, resources, or project control. For operating and planning purposes, each wind tunnel operating unit must balance inputs from a variety of sources. Although each unit is managed by individual Facility Operations groups, other stakeholders influence wind tunnel operations. These groups include, for example, the various researchers and clients who use the facility, the Facility System Engineering Division (FSED) tasked with wind tunnel repair and upgrade, the Langley Research Center (LaRC) Fabrication (FAB) group which fabricates repair parts and provides test model upkeep, the NASA and LARC Strategic Plans, and unscheduled use of the facilities by important clients. Expanding these influences horizontally through nine wind tunnel operations and vertically along the NASA management structure greatly increases the complexity of developing a model that can be used for successfully implementing a standardized management planning tool. The objective of this study was to implement an Integrated Wind Tunnel Planning System to improve the operations within the aeronautics testing and research group, in particular Wind Tunnel Enterprise. The study included following steps: Conducted literature search and expert discussions (NASA and Old Dominion University faculty), Performed environmental scan of NASA Langley wind tunnel operations as foundation for problem definition. Established operation requirements and evaluation methodologies. Examined windtunnel operations to map out the common characteristics, critical components, and system structure. Reviewed and evaluated various project scheduling and management systems for implementation, Evaluated and implemented "Theory of Constraints (TOC)" project scheduling methodology at NASA Langley wind tunnel operations together with NASA staff.
Jacobs, Derya, A.↗