Search NASA⌕ Search

SEARCH · Search NASA

Results for “evaluation methodology”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Analysis of wind tunnel test results for a 9.39-per cent scale model of a VSTOL fighter/attack aircraft. Volume 2: Evaluation of prediction methodologies

An evaluation of current prediction methodologies to estimate the aerodynamic uncertainties identified for the E205 configuration is presented. This evaluation was accomplished by comparing predicted and wind tunnel test data in three major categories: untrimmed longitudinal aerodynamics; trimmed longitudinal aerodynamics; and lateral-directional aerodynamic characteristics.

Lummus, J. R.↗

Evaluation of the HARDMAN comparability methodology for manpower, personnel and training

The methodology evaluation and recommendation are part of an effort to improve Hardware versus Manpower (HARDMAN) methodology for projecting manpower, personnel, and training (MPT) to support new acquisition. Several different validity tests are employed to evaluate the methodology. The methodology conforms fairly well with both the MPT user needs and other accepted manpower modeling techniques. Audits of three completed HARDMAN applications reveal only a small number of potential problem areas compared to the total number of issues investigated. The reliability study results conform well with the problem areas uncovered through the audits. The results of the accuracy studies suggest that the manpower life-cycle cost component is only marginally sensitive to changes in other related cost variables. Even with some minor problems, the methodology seem sound and has good near term utility to the Army. Recommendations are provided to firm up the problem areas revealed through the evaluation.

Zimmerman, W.↗

The cost of energy from utility-owned solar electric systems. A required revenue methodology for ERDA/EPRI evaluations

This methodology calculates the electric energy busbar cost from a utility-owned solar electric system. This approach is applicable to both publicly- and privately-owned utilities. Busbar cost represents the minimum price per unit of energy consistent with producing system-resultant revenues equal to the sum of system-resultant costs. This equality is expressed in present value terms, where the discount rate used reflects the rate of return required on invested capital. Major input variables describe the output capabilities and capital cost of the energy system, the cash flows required for system operation amd maintenance, and the financial structure and tax environment of the utility.

Source record↗

Energy-dependent optimization of the prompt fission neutron spectrum with CGMF

Throughout the course of FY21, significant effort was put into investigating models within the LANL developed Hauser-Feshbach fission fragment decay code, CGMF, to understand and potentially solve the long-standing challenge of a too-soft prompt fission neutron spectrum, PFNS. Several inputs and models to CGMF were investigated, including the discrete nuclear levels, the optical model potential, level densities, and the fission fragment initial conditions. Some of the global models within CGMF led to a slight hardening of the neutron spectrum—particularly the likely incomplete discrete levels in through which γ-rays decay—but none of the changes where large enough for the tail of the PFNS to reproduce experimental data. A significant hardening of the spectrum tail was observed when the fission fragment initial conditions were optimized based on their sensitivities to the PFNS data for thermal incident neutrons. In this way, the parameters for the CGMF mass and total kinetic energy distributions, along with the spin cutoff factor were adjusted to better reproduce the experimental PFNS measurements. This optimization hardened the tail of the PFNS slightly but led to unphysical mass distributions for the fission fragments before neutron emission. It was clear from the above that we do not expect to be able to produce an evaluation-quality PFNS with CGMF in the near future. Challenges at thermal will persist–and possibly worsen–with increasing incident energy, where more models are needed to completely describe the fission. Basic-science research funding exceeding the amount available and scope of our NCSP funds would be needed to tackle this decade-long challenge impacting many fission-fragment event generator. And, in fact, Amy Lovell won LDRD ECR funding to do so over the next few years. Therefore, we focused in FY22 on extending evaluation capabilities beyond thermal incident neutrons, to take into account the incident energy dependence of the PFNS and fission fragment initial condition distributions in CGMF. We chose to set up the evaluation methodology to perform PFNS evaluations with CGMF across incident-neutron energies, in order to have it readily available for future NCSP evaluations when the PFNS from CGMF has improved. In this report, we outline the evaluation methodology, along with the results of the optimization, including full model calculations with CGMF using the evaluated parameters.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Learning User Preferences for Sets of Objects

Most work on preference learning has focused on pairwise preferences or rankings over individual items. In this paper, we present a method for learning preferences over sets of items. Our learning method takes as input a collection of positive examples--that is, one or more sets that have been identified by a user as desirable. Kernel density estimation is used to estimate the value function for individual items, and the desired set diversity is estimated from the average set diversity observed in the collection. Since this is a new learning problem, we introduce a new evaluation methodology and evaluate the learning method on two data collections: synthetic blocks-world data and a new real-world music data collection that we have gathered.

preferences↗

Methodology for Evaluating Commercial Energy Code Updates

This document lays out the Department of Energy’s (DOE’s) methodology for evaluating the cost-effectiveness of energy code and standard proposals and editions. The evaluation is applied to new provisions or editions of ANSI/ASHRAE/IES Standard 90.1 and the International Energy Conservation Code. The methodology follows standard lifecycle cost (LCC) economic analysis procedures. A cost-effectiveness evaluation requires three steps: 1) evaluating the energy and energy cost savings of code changes; 2) evaluating the incremental and replacement costs related to the changes; and 3) determining the cost-effectiveness of energy code changes based on those costs and savings over time.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Applying Methodology for Evaluating and Validating TSLs to Materials of Interest to NCSP [Slides]

This presentation covers the topic of applying methodology for evaluation validation of TSLs to material of interest to the Nuclear Criticality Safety Program (NCSP). The talk covers recent efforts in validating thermal neutron scattering cross sections. The presentation also proposes a methodology for not only validating thermal scattering files that utilizes all available experimental data, but also for evaluating new libraries as demonstrated on Polystyrene and Lucite

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

A Methodology for Evaluating Artifacts Produced by a Formal Verification Process

The goal of this study is to produce a methodology for evaluating the claims and arguments employed in, and the evidence produced by formal verification activities. To illustrate the process, we conduct a full assessment of a representative case study for the Enabling Technology Development and Demonstration (ETDD) program. We assess the model checking and satisfiabilty solving techniques as applied to a suite of abstract models of fault tolerant algorithms which were selected to be deployed in Orion, namely the TTEthernet startup services specified and verified in the Symbolic Analysis Laboratory (SAL) by TTTech. To this end, we introduce the Modeling and Verification Evaluation Score (MVES), a metric that is intended to estimate the amount of trust that can be placed on the evidence that is obtained. The results of the evaluation process and the MVES can then be used by non-experts and evaluators in assessing the credibility of the verification results.

Siminiceanu, Radu I.↗

A New Test Methodology for Evaluating Fire Risk Due to Electrical Faults in Oxygen-Enriched Environments

This paper discusses a new test methodology for assessing the safe use of materials found in spacecraft that may be exposed to electrical faults, as performed at the NASA White Sands Test Facility. “Wire-break” testing, modeled after the Cleveland Open Cup method, identifies the conditions under which pyrolyzed material transitions from a brief flash to a propagating flame. The approach focuses on fuel mass liberated through pyrolysis, mixed with oxygen, and ignited by a piloted ignition (spark due to fusion of wire) to achieve flame propagation with the least energy. The test approach attempts to find energy density thresholds derived using I²t values from current-induced heating of various test materials and wire characteristics. The application of the data provides a useful approach to mitigating fire risks in space systems by correlating threshold data to real-world designs and scaling factors, including oxygen pressure, wire diameter, heat sinking, and contained smoke volume. Several case studies, including Apollo missions and hypothetical scenarios, illustrate practical applications of these thresholds to enhance fire safety design considerations in space environments.

methodology↗

Methodology for Evaluating Energy Savings, Cost-Effectiveness, and Societal Impacts of Commercial Energy Code Changes

This document lays out the Department of Energy’s (DOE’s) methodology for evaluating the cost-effectiveness of energy code and standard proposals and editions. The evaluation is applied to new provisions or editions of ANSI/ASHRAE/IES Standard 90.1 and the International Energy Conservation Code. The methodology follows standard lifecycle cost (LCC) economic analysis procedures. A cost-effectiveness evaluation requires three steps: 1) evaluating the energy and energy cost savings of code changes; 2) evaluating the incremental and replacement costs related to the changes; and 3) determining the cost-effectiveness of energy code changes based on those costs and savings over time.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Development and demonstration of a methodology to evaluate high burnup fuel susceptibility to pulverization under a loss of coolant transient

For economic reasons, the US nuclear industry is renewing efforts to build a technical basis to extend rod average burnup limits above the current regulatory burnup limit of 62 GWd/MTU. The primary driver is to increase pressurized water reactor cycle lengths to 24 months, reducing the number of fresh fuel assemblies and core design constraints, thereby making core energy utilization more efficient. However, fuel pellet fragmentation and pulverization, termed high burnup fuel fragmentation (HBFF), has been observed in the high burnup (>90 GWd/MTU) Halden loss-of-coolant-accident (LOCA) integral test series. The issue gained attention when fuel fragmentation and pulverization were also observed closer to the current US regulatory limit during the US Nuclear Regulatory Commission (NRC) sponsored out-of-core integral test at Studsvik Nuclear in early 2011. This led to NRC concerns with potential changes to fuel and core designs relative to fuel pellet pulverization. In a letter to the NRC Commissioners, the staff specifically identified a need to “…define the boundary of safe operation for key fuel design and operating parameters,” stating that “the staff is challenged to evaluate the acceptability of future fuel design advancements and fuel utilization changes.” As such, it can be concluded that HBFF and potential dispersal into the reactor coolant system introduces additional complications in light-water reactor (LWR) fuel safety evaluations. However, it is not clear how much fuel will be susceptible to HBFF; nor has there been a methodology developed to evaluate fuel susceptibility to HBFF. To that end, this paper proposes an analysis methodology to assess fuel susceptibility to HBFF during LOCA scenarios. The work presented here uses the BISON fuel performance code to evaluate a representative pressurized water reactor fuel rod exposed to a rod average burnup of 75 GWd/MTU. Sensitivity studies investigated the impact of the peak cladding temperature, transient fission gas released, and pre-transient fission gas release on cladding ballooning and burst timing. Subsequently, a methodology to assess fuel susceptibility to HBFF will be developed based on experimental data published in the open literature. The methodology will then be demonstrated by calculating the mass of fuel susceptibility to HBFF. The BISON results conclude that increasing peak cladding temperature drastically decreased time to failure, and decreased balloon size both of which have been confirmed experimentally. Additionally, the effect of pre-transient and transient fission gas release affected cladding balloon size and burst timing. Finally, fuel susceptibility to HBFF significantly decreased as a function of peak cladding temperature.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

The Traps of using Conventional Methodology of Evaluation of Powder Diffractograms for Determination of the Lattice Parameters of Nanocrystals

Inherent errors introduced by the algorithm of standard procedures of evaluation of powder diffractograms when applied for nanopowders are shown. The implications of the errors are discussed in connection with some results reported in the literature. Alternate methodology of evaluation of powder diffractograms of nanocrystals is presented.

Curreri, Peter A.↗

Development of Testing Methodologies to Evaluate Postflight Locomotor Performance

Crewmembers experience locomotor and postural instabilities during ambulation on Earth following their return from space flight. Gait training programs designed to facilitate recovery of locomotor function following a transition to a gravitational environment need to be accompanied by relevant assessment methodologies to evaluate their efficacy. The goal of this paper is to demonstrate the operational validity of two tests of locomotor function that were used to evaluate performance after long duration space flight missions on the International Space Station (ISS).

Mulavara, A. P.↗

Applying Costs, Risks and Values Evaluation (CRAVE) methodology to Engineering Support Request (ESR) prioritization

Given limited budget, the problem of prioritization among Engineering Support Requests (ESR's) with varied sizes, shapes, and colors is a difficult one. At the Kennedy Space Center (KSC), the recently developed 4-Matrix (4-M) method represents a step in the right direction as it attempts to combine the traditional criteria of technical merits only with the new concern for cost-effectiveness. However, the 4-M method was not adequately successful in the actual prioritization of ESRs for the fiscal year 1995 (FY95). This research identifies a number of design issues that should help us to develop better methods. It emphasizes that given the variety and diversity of ESR's one should not expect that a single method could help in the assessment of all ESR's. One conclusion is that a methodology such as Costs, Risks, and Values Evaluation (CRAVE) should be adopted. It also is clear that the development of methods such as 4-M requires input not only from engineers with technical expertise in ESR's but also from personnel with adequate background in the theory and practice of cost-effectiveness analysis. At KSC, ESR prioritization is one part of the Ground Support Working Teams (GSWT) Integration Process. It was discovered that the more important barriers to the incorporation of cost-effectiveness considerations in ESR prioritization lie in this process. The culture of integration, and the corresponding structure of review by a committee of peers, is not conducive to the analysis and confrontation necessary in the assessment and prioritization of ESR's. Without assistance from appropriately trained analysts charged with the responsibility to analyze and be confrontational about each ESR, the GSWT steering committee will continue to make its decisions based on incomplete understanding, inconsistent numbers, and at times, colored facts. The current organizational separation of the prioritization and the funding processes is also identified as an important barrier to the pursuit of cost-effectiveness. Perhaps the greatest barrier is that, at the working level, KSC's culture is so preoccupied with technical concerns that it seems almost oblivious to any cost concerns, let alone cost-effectiveness concerns. It is recommended that we must urgently begin to change that culture and seek a better balance between these two concerns.

Joglekar, Prafulla N.↗

A Human Factors Evaluation of a Methodology for Pressurized Crew Module Acceptability for Zero-Gravity Ingress of Spacecraft

This project aimed to develop a methodology for evaluating performance and acceptability characteristics of the pressurized crew module volume suitability for zero-gravity (g) ingress of a spacecraft and to evaluate the operational acceptability of the NASA crew return vehicle (CRV) for zero-g ingress of astronaut crew, volume for crew tasks, and general crew module and seat layout. No standard or methodology has been established for evaluating volume acceptability in human spaceflight vehicles. Volume affects astronauts'ability to ingress and egress the vehicle, and to maneuver in and perform critical operational tasks inside the vehicle. Much research has been conducted on aircraft ingress, egress, and rescue in order to establish military and civil aircraft standards. However, due to the extremely limited number of human-rated spacecraft, this topic has been un-addressed. The NASA CRV was used for this study. The prototype vehicle can return a 7-member crew from the International Space Station in an emergency. The vehicle's internal arrangement must be designed to facilitate rapid zero-g ingress, zero-g maneuverability, ease of one-g egress and rescue, and ease of operational tasks in multiple acceleration environments. A full-scale crew module mockup was built and outfitted with representative adjustable seats, crew equipment, and a volumetrically equivalent hatch. Human factors testing was conducted in three acceleration environments using ground-based facilities and the KC-135 aircraft. Performance and acceptability measurements were collected. Data analysis was conducted using analysis of variance and nonparametric techniques.

Sanchez, Merri J.↗

Methodology for evaluating modular assembly of large space platforms

This paper presents a methodology for analytically comparing approaches to modular assembly of large space platforms. the methodology combines a physical model of the modules, a life-cycle cost model, and a risk model to capture influential trade-offs.

in-space construction↗

m:N Working Group: Meeting Summary March 2024

From March 26th to 28th, 2024 the m:N UAS working group and its subgroups (Evaluation Methodologies, Exceptions/Interventions, and Initial Operating Capability for Airspace Integration) met at SAIC in Washington, D.C. for an in-person meeting. The subgroups meet virtually throughout the year, and twice a year participants from all the subgroups come together to further identify and discuss challenges and paths forward for incorporating UAS into the airspace. The m:N UAS working group is run by Jay Shively (Adaptive Aerospace) and Andy Thurling (DroneUp) and is comprised of members from government, industry, and academia in an effort to identify and reduce barriers to m:N operations. This includes identifying requirements, use cases, metrics, and the development of white papers to support organizations including the FAA, RTCA, and ASTM. A change from last year, the Large UAS and HAPS sub working groups have disbanded while the sUAS working group continues independently, currently working on a white paper titled Personnel Selection, Roles, and Training for sUAS. For 2024 the m:N sub working groups have been refocused to cover evaluation methodologies, interventions/exceptions, and initial operating capability for airspace integration; with the premise that the outcomes from these subgroups will be white papers. These white papers can inform one another to ultimately become a master whitepaper. Each subgroup lead is called out below: Evaluation Methodologies Subgroup Jay Shively, Adaptive Aerospace Interventions/Exceptions Subgroup Andy Thurling, DroneUp (Lead) Initial Operating Capability for Airspace Integration Subgroup Andy Lacher, NASA (Lead)

m:N operations↗