Search NASA⌕ Search

SEARCH · Search NASA

Results for “evaluation methodology”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 829 records · Page 46

Development of a Technical Standard for Radiological Characterization of DAW - 18062

Throughout its 70+-year history, the U.S. Department of Energy (DOE) and its predecessor agencies have performed a wide mission involving nuclear materials and weapons development, production, testing, and modernization. While the initial mission components relied heavily upon reactor physics and chemistry, the environmental programs have increasingly relied upon development of more accurate and effective measurement methodologies to determine the radiological and chemical properties of the unique waste streams that were generated during the weapons production and testing mission. Over time, the DOE laboratories and former production sites have developed a wide range of site-specific processes and procedures for conducting radiological characterization of dry active waste (DAW) that is managed as low-level radioactive waste. This has resulted in a Complex-wide variability among sites with respect to the methodologies and instrumentation used to characterize individual waste streams. The DAW-type waste was selected for development of a characterization standard since it is a simple, voluminous, and repetitive waste stream with a substantial knowledge base, established experience history at multiple site locations, and the potential for realization of programmatic benefits though standardization. The Energy Facility Contractors Group (EFCOG) Waste Management Working Group (WMWG) has proposed the development of a new DOE Technical Standard for radiological characterization of DAW. The purpose of the proposed new standard is to provide a technical resource that integrates and enhances the utilization of current site-specific methodologies and processes. A Technical Basis Document (TBD) has been prepared to support the development and utilization of the new standard by providing detailed information for use by site personnel when implementing the guidance provided in the standard. It also provides the rationale for and details concerning the recommended technical approaches for radiological characterization of representative DAW-type waste streams. The TBD will be included as an appendix to the proposed standard. Adoption of a standardized approach to DAW characterization will take advantage of multiple applications for a technology that is both mature and stable. The DAW characterization process is repetitive and lends itself to implementation at a wide range of operating locations - resulting in economies of scale, compliance with regulatory requirements, and consistent implementation of procedures which support design, operations, maintenance, and management of facilities, activities and programs. The purpose of the proposed new Technical Standard for DAW Radiological Characterization is to integrate and improve the utilization of current site-specific methodologies and processes and will include a comprehensive evaluation and comparison of current radiological characterization methodologies to determine which ones are most reliable and effective in producing relevant and valid data. In view of the long history and participation by several agencies in the regulation of nuclear programs, existing Voluntary Consensus Standards have also been reviewed for relevancy and applicability to the new proposed standard. The proposed new Standard will be developed in concert with existing scientific and regulatory guidance to produce a document that incorporates the state of current knowledge and site practices with a graded approach to applying those methodologies that are applicable and effective for characterizing a wide range of DAW-type wastes - including, but not limited to, debris, low specific activity (LSA) material, and surface contaminated objects (SCO). Under the leadership of the National Laboratory Subgroup of the EFCOG/WMWG), an EFCOG team will develop the proposed technical standard. This process will incorporate the information gathered during preparation of the TBD, which will serve as a technical resource to support the technical approach for selection of DAW characterization methodologies. Preparation of the TBD included a detailed survey of historical site practices and examination of the characterization approaches and measurement methodologies currently being applied to DAW-type wastes. Future activities include the development and submittal of a Project Justification Statement that will be submitted to the DOE Technical Standards Program for review and comment. The EFCOG/WMWG Team will respond to reviewer comments, as required. Following final concurrence by affected organizations through the DOE Technical Standards Coordination process, the EFCOG/WMWG Team will prepare the draft technical standard and respond to comments generated during RevCom review and final format review by the DOE Technical Standards Management Program. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Online and Offline Analytical Techniques to Quantify Chloride Salts

This report serves as the deliverable for Milestone- M3FT-26AN080502017: Summary of Accomplishments for Online and Offline Analytical Qualification of Chloride Fuel Salts. The qualification of chloride fuel salts is a critical challenge for the development and deployment of molten salt reactors (MSRs), requiring precise control and verification of chemical and isotopic composition to ensure predictable neutronics, manageable radiological behavior, and safe plant operation. Currently, there is no universally accepted standard for fuel salt qualification, particularly for chloride-based systems, which underscores the need for robust, science-based analytical methodologies. This report presents a comprehensive evaluation of both online and offline techniques for quantifying chloride fuel salts, including multielectrode array voltammetry, differential thermal analysis (DTA) probes, inert gas fusion (IGF) analyzers, and gamma spectrometry using the Mirion NAIS-2x2 NaI(Tl) detector. The integration of these methods enables real-time monitoring of actinide concentrations, redox state, and thermophysical properties, as well as high-precision measurement of impurities and isotopic composition. The acquisition of advanced instruments such as the Bruker Leonardo G6 for IGF and the Mirion NaI detector enhances analytical capabilities, supporting the establishment of operational envelopes and impurity thresholds. These approaches provide essential data for neutronic impact evaluation, feedstock documentation, and compliance with nuclear safety standards. The methodologies developed and validated in this report lay the groundwork for future standardized protocols, bridging the gap between laboratory research and commercial reactor operation, and advancing the safe and efficient deployment of chloride-fueled MSRs.

Polke, Amber↗

Technology advances for Space Shuttle processing

One of the major initial tasks of the Space Systems Integration and Operations Research Applications (SIORA) Program was the application of automation and robotics technology to all aspects of the Shuttle tile processing and inspection system. The SIORA Program selected a nonlinear systems engineering methodology which emphasizes a team approach for defining, developing, and evaluating new concepts and technologies for the operational system. This is achieved by utilizing rapid prototyping testbeds whereby the concepts and technologies can be iteratively tested and evaluated by the team. The present methodology has clear advantages for the design of large complex systems as well as for the upgrading and evolution of existing systems.

Wiskerchen, M. J.↗

Solid Oxide Fuel Cell APU Feasibility Study for a Long Range Commercial Aircraft Using UTC ITAPS Approach: Aircraft Propulsion and Subsystems Integration Evaluation - Volume 1

The objective of this contract effort was to define the functionality and evaluate the propulsion and power system benefits derived from a Solid Oxide Fuel Cell (SOFC) based Auxiliary Power Unit (APU) for a future long range commercial aircraft, and to define the technology gaps to enable such a system. The study employed technologies commensurate with Entry into Service (EIS) in 2015. United Technologies Corporation (UTC) Integrated Total Aircraft Power System (ITAPS) methodologies were used to evaluate system concepts to a conceptual level of fidelity. The technology benefits were captured as reductions of the mission fuel burn and emissions. The baseline aircraft considered was the Boeing 777-200ER airframe with more electric subsystems, Ultra Efficient Engine Technology (UEET) engines, and an advanced APU with ceramics for increased efficiency. In addition to the baseline architecture, four architectures using an SOFC system to replace the conventional APU were investigated. The mission fuel burn savings for Architecture-A, which has minimal system integration, is 0.16 percent. Architecture-B and Architecture-C employ greater system integration and obtain fuel burn benefits of 0.44 and 0.70 percent, respectively. Architecture-D represents the highest level of integration and obtains a benefit of 0.77 percent.

Srinivasan, Hari↗

Event Report for The Ethical Artificial Intelligence Quantification Workshop

Artificial Intelligence (AI) is a powerful emerging technology area which requires special attention to using it ethically. AI ethics is still an emerging field, and the partners for this workshop and report seek to move AI ethics discussion ahead by experimenting with ways to measure AI ethics criteria. The following document describes the outcomes and learnings from The Ethical Artificial Intelligence Quantification Workshop held at the National Institute for Aerospace (NIA), Hampton, Virginia on May 12th, 2022. The purpose of the workshop was for participants to evaluate and experiment-with the methodology and process presented by AIEthics.World in cooperation with Intel Corporation. The meeting participants learned about the Ethical AI Certification and Maturity Model™ and applied the methodology to selected notional AI systems. The workshop facilitated the evaluation of the maturity of the AI system according to ethical considerations relevant to NASA, NIA and other participants. The workshop consisted of three main phases. The first phase focused on understanding and summarizing NASA’s ethical approaches, mission and values based on published documentation, discussions and individual insights & opinions of participants. This information was prioritized, weighted, ordered, and quantified in phase two, to formulate an alignment between human values (ethics) and their applicability to AI systems during all lifecycle phases. The first two phases were summarized as a form of ethical genealogy for artificial intelligence, specific to NASA’s ethical approaches. In the third and last phase of the workshop the participants evaluated notional examples of artificial intelligence to qualify and quantify its ability to adhere to the organizational ethics approaches, using the Ethical AI Certification and Maturity Model™. The workshop uses the concept of genealogy, in the traditional sense: the study and traceability of lines of ancestors in the process of evolutionary development from earlier forms. However, as it is applied to an Ethical AI definition, it is providing the insights to the necessary and mandatory traceability of content, data, metrics, telemetry, elements, and structures which are used in the AI’s lifecycle to foster and measure AI ethics in all steps of its lifecycle. The Ethical Artificial Intelligence Quantification Workshop provided NASA with the opportunity to apply the Ethical AI Certification and Maturity Model™, in combination with existing and well-known decision-making and quality control methods to identify the metrics and measurements for an Ethical AI and assess its ethical condition and quality aligned with NASA ethics approaches. The result of the workshop is the capacity for NASA to apply the maturity model assessment to its AI Systems as desired and if necessary, publish the ability of these AI Systems to adhere to the organizational ethical goals. AI ethics frameworks need to be customized for each application domain, for example, individual NASA Mission Directorates. General principles that work in one area such as AI/Machine Learning-based text analysis (the ethics of information-extraction) may need to be adapted for another such as sense-and-avoid decision-making in a flight environment. The workshop was conducted among approximately twenty NASA subject matter experts, so the elements noted above should be considered examples, not definitive NASA ethical AI principles, genealogy, etc. Generating a definitive AI ethics framework for an organization as diverse as NASA would require far more discussion, debate, review, etc. However, the workshop provided valuable insight into mechanisms and processes for quantifying AI ethical qualities.

Artificial Intelligence↗

Development of new baseline models for U.S. medium office buildings based on commercial buildings energy consumption survey data

Building energy estimation for the building sector under various scenarios are needed for building energy regulation and policy making. This often starts with representative baselines (either empirical baseline or modeled baseline). Commercial Buildings Energy Consumption Survey (CBECS) data is a widely used empirical baseline for U.S. commercial buildings, but none of the existing baseline model are developed to represent the CBECS data. This paper aims to develop new baseline models for the U.S. medium office buildings, which can produce modeled baselines consistent with the CBECS data. Here, we introduced the methodology to create baseline models and the criteria to evaluate the performance of baseline models. The methodology consists of three phases: (1) identification of model inputs, (2) model calibration, and (3) model validation with uncertainty analysis. The evaluation index is the coefficient of variation of the root-mean-square deviation (CV(RMSD)) of site energy use intensities (EUIs) between the modeled baseline and empirical baseline. Then 30 new baseline models for two vintages (pre- and post-1980) and 15 climate zones were created. The evaluation shows that the CV(RMSD) is lower than 0.05 for the modeled baselines produced by the new baseline models. As a comparison, the CV(RMSD) is higher than 0.1 for the existing modeled baselines generated by DOE Commercial Reference Building Models. Further analysis shows that the new baseline models are able to capture the uncertainties of the representative features of existing buildings.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Use of GC/MS and Microtome Techniques as Methods to Evaluate ODC Free Cleaner Diffusion and Evaporation in Insulation and Phenolic Case Material

Because of the 1990 Clean Air Act Amendment (CAAA) many chlorinated solvents used in the aerospace industry are being phased out. Replacement of the ODC (ozone-depleting chemicals) with less volatile, non-ozone depleting cleaners has been extensively studied over the past seven years at Thiokol Propulsion, a Division of Cordant Technologies, Inc. The down selection of ODC replacement cleaners has been based on several factors including the diffusion evaporation of the cleaners in selected substrates. Methodologies were developed to evaluate the cleaner content in substrates. Methods of cutting thin slices of material (microtoming) were combined with GC/MS (gas chromatography/mass spectroscopy) analysis. Substrates evaluated in this study include potential solid rocket motor materials: ASNBR (asbestos-filled nitrile butadiene rubber) and CFEPDM (carbon-filled ethylene propylene dimonomer) insulation and glass (GCP), carbon (CCP) and silica (SCP) cloth phenolic substrates with fibers either parallel (0 deg) or perpendicular (90 deg) to the surface. Residue profiles indicate both cleaner and substrate composition affect the diffusion and subsequent evaporation of the cleaner from the substrate surface.

Biegert, L. L.↗

Improved methodology to assess modification and completion of landfill gas management in the aftercare period

Highlights: Black-Right-Pointing-Pointer Performance-based evaluation of landfill gas control system. Black-Right-Pointing-Pointer Analytical framework to evaluate transition from active to passive gas control. Black-Right-Pointing-Pointer Focus on cover oxidation as an alternative means of passive gas control. Black-Right-Pointing-Pointer Integrates research on long-term landfill behavior with practical guidance. - Abstract: Municipal solid waste landfills represent the dominant option for waste disposal in many parts of the world. While some countries have greatly reduced their reliance on landfills, there remain thousands of landfills that require aftercare. The development of cost-effective strategies for landfill aftercare is in society's interest to protect human health and the environment and to prevent the emergence of landfills with exhausted aftercare funding. The Evaluation of Post-Closure Care (EPCC) methodology is a performance-based approach in which landfill performance is assessed in four modules including leachate, gas, groundwater, and final cover. In the methodology, the objective is to evaluate landfill performance to determine when aftercare monitoring and maintenance can be reduced or possibly eliminated. This study presents an improved gas module for the methodology. While the original version of the module focused narrowly on regulatory requirements for control of methane migration, the improved gas module also considers best available control technology for landfill gas in terms of greenhouse gas emissions, air quality, and emissions of odoriferous compounds. The improved module emphasizes the reduction or elimination of fugitive methane by considering the methane oxidation capacity of the cover system. The module also allows for the installation of biologically active covers or other features designed to enhance methane oxidation. A methane emissions model, CALMIM, was used to assist with an assessment of the methane oxidation capacity of landfill covers.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Human reliability-based MC&A models for detecting insider theft.

Material control and accounting (MC&A) safeguards operations that track and account for critical assets at nuclear facilities provide a key protection approach for defeating insider adversaries. These activities, however, have been difficult to characterize in ways that are compatible with the probabilistic path analysis methods that are used to systematically evaluate the effectiveness of a site's physical protection (security) system (PPS). MC&A activities have many similar characteristics to operator procedures performed in a nuclear power plant (NPP) to check for anomalous conditions. This work applies human reliability analysis (HRA) methods and models for human performance of NPP operations to develop detection probabilities for MC&A activities. This has enabled the development of an extended probabilistic path analysis methodology in which MC&A protections can be combined with traditional sensor data in the calculation of PPS effectiveness. The extended path analysis methodology provides an integrated evaluation of a safeguards and security system that addresses its effectiveness for attacks by both outside and inside adversaries.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Battery Pack Life Estimation through Cell Degradation Data and Pack Thermal Modeling for BAS+ Li-Ion Batteries. Cooperative Research and Development Final Report, CRADA Number CRD-12-489

Battery Life estimation is one of the key inputs required for Hybrid applications for all GM Hybrid/EV/EREV/PHEV programs. For each Hybrid vehicle program, GM has instituted multi-parameter Design of Experiments generating test data at Cell level and also Pack level on a reduced basis. Based on experience, generating test data on a pack level is found to be very expensive, resource intensive and sometimes less reliable. The proposed collaborative project will focus on a methodology to estimate Battery life based on cell degradation data combined with pack thermal modeling. NREL has previously developed cell-level battery aging models and pack-level thermal/electrical network models, though these models are currently not integrated. When coupled together, the models are expected to describe pack-level thermal and aging response of individual cells. GM and NREL will use data collected for GM's Bas+ battery system for evaluation of the proposed methodology and assess to what degree these models can replace pack-level aging experiments in the future.

25 ENERGY STORAGE↗

Comprehensive Energy Assessment: EE and RE Project Optimization Modeling for United States Pacific Command (USPACOM) American Recovery and Reinvestment Act (ARRA) FEMP Technical Assistance

This report summarizes a study and corresponding model development conducted in support of the United States Pacific Command (USPACOM) as part of the Federal Energy Management Program (FEMP) American Reinvestment and Recovery Act (ARRA). This research was aimed at developing a mathematical programming framework and accompanying optimization methodology in order to simultaneously evaluate energy efficiency (EE) and renewable energy (RE) opportunities. Once developed, this research then demonstrated this methodology at a USPACOM installation - Camp H.M. Smith, Hawaii. We believe this is the first time such an integrated, joint EE and RE optimization methodology has been constructed and demonstrated.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

The total assessment profile, volume 1

A methodology is described for the evaluation of societal impacts associated with the implementation of a new technology. Theoretical foundations for the methodology, called the total assessment profile, are established from both the economic and social science perspectives. The procedure provides for accountability of nonquantifiable factors and measures through the use of a comparative value matrix by assessing the impacts of the technology on the value system of the society.

Leininger, G.↗

An Evaluation of Alternative Designs for a Grid Information Service

The Globus information service wasn't working well. There were many updates of data from Globus daemons which saturated the single server and users couldn't retrieve information. We created a second server for NASA and Alliance. Things were great on that server, but a bit slow on the other server. We needed to know exactly how the information service was being used. What were the best servers and configurations? This viewgraph presentation gives an overview of the evaluation of alternative designs for a Grid Information Service. Details are given on the workload characterization, methodology used, and the performance evaluation.

Smith, Warren↗

Evolution of the Next Exploration Toilet Through Human-in-the-Loop (HITL) Testing

Human waste collection in space is a unique and necessary function that all crewmembers must perform. The variability in how each crewmember uses the toilet to urinate and defecate introduces complexities and challenges with regards to overall hardware design. Because of this variability, it is important to consider crew inputs in all aspects of a toilet design especially with regards to crew interfaces that could impact overall waste collection. Access to crew feedback is essential to the design process and should be considered early and often through the various design phases. In 2020, NASA started a project for the Human Landing System (HLS) program to develop a Government Furnished Equipment (GFE) toilet option. The project is known as the Lavatory On-Orbit (LOO). During the early development of the LOO, the project team conducted several crew evaluations to collect and summarize valuable crew feedback on system design, function, and overall usability to influence the next design iteration. Because every person could use the system differently in space, it was extremely important to collect and analyze the data in a very methodical manner to appropriately influence the design based on the evaluation results. Establishing a standard process ensures consistent data collection from one evaluation to another, helps to maintain privacy for each test subject’s inputs and removes any potential bias from test subject to test subject. To date, the team has completed four rounds of crew evaluations with multiple crewmembers on prototypes for the different LOO subsystems. This paper will summarize the methodology used to conduct the evaluations as well as how data was collected and analyzed. The paper will also provide details on each of the evaluations and how the design was updated based on the results.

toilet↗

Evolution of the Next Exploration Toilet Through Human-in-the-Loop (HITL) Testing

Human waste collection in space is a unique and necessary function that all crewmembers must perform. The variability in how each crewmember uses the toilet to urinate and defecate introduces complexities and challenges with regards to overall hardware design. Because of this variability, it is important to consider crew inputs in all aspects of a toilet design especially with regards to crew interfaces that could impact overall waste collection. Access to crew feedback is essential to the design process and should be considered early and often through the various design phases. In 2020, NASA started a project for the Human Landing System (HLS) program to develop a Government Furnished Equipment (GFE) toilet option. The project is known as the Lavatory On-Orbit (LOO). During the early development of the LOO, the project team conducted several crew evaluations to collect and summarize valuable crew feedback on system design, function, and overall usability to influence the next design iteration. Because every person could use the system differently in space, it was extremely important to collect and analyze the data in a very methodical manner to appropriately influence the design based on the evaluation results. Establishing a standard process ensures consistent data collection from one evaluation to another, helps to maintain privacy for each test subject’s inputs and removes any potential bias from test subject to test subject. To date, the team has completed four rounds of crew evaluations with multiple crewmembers on prototypes for the different LOO subsystems. This paper will summarize the methodology used to conduct the evaluations as well as how data was collected and analyzed. The paper will also provide details on each of the evaluations and how the design was updated based on the results.

toilet↗

Evaluation of Near Field Atmospheric Dispersion Around Nuclear Facilities Using a Lorentzian Distribution Methodology

Atmospheric dispersion modeling within the near field of a nuclear facility typically applies a building wake correction to the Gaussian plume model, whereby a point source is modeled as a plane source. The plane source results in greater near field dilution and reduces the far field effluent concentration. However, the correction does not account for the concentration profile within the near field. Receptors of interest, such as the maximally exposed individual, may exist within the near field and thus the realm of building wake effects. Furthermore, release parameters and displacement characteristics may be unknown, particularly during upset conditions. Therefore, emphasis is placed upon the need to analyze and estimate an enveloping concentration profile within the near field of a release. This investigation included the analysis of 64 air samples collected over 128 wk. Variables of importance were then derived from the measurement data, and a methodology was developed that allowed for the estimation of Lorentzian-based dispersion coefficients along the lateral axis of the near field recirculation cavity; the development of recirculation cavity boundaries; and conservative evaluation of the associated concentration profile. The results evaluated the effectiveness of the Lorentzian distribution methodology for estimating near field releases and emphasized the need to place air-monitoring stations appropriately for complete concentration characterization. Additionally, the importance of the sampling period and operational conditions were discussed to balance operational feedback and the reporting of public dose.

54 ENVIRONMENTAL SCIENCES↗

Analysis and Evaluation of Processes and Equipment in Tasks 2 and 4 of the Low-cost Solar Array Project

To facilitate the task of objectively comparing competing process options, a methodology was needed for the quantitative evaluation of their relative cost effectiveness. Such a methodology was developed and is described, together with three examples for its application. The criterion for the evaluation is the cost of the energy produced by the system. The method permits the evaluation of competing design options for subsystems, based on the differences in cost and efficiency of the subsystems, assuming comparable reliability and service life, or of competing manufacturing process options for such subsystems, which include solar cells or modules. This process option analysis is based on differences in cost, yield, and conversion efficiency contribution of the process steps considered.

Wolf, M.↗

Development of an Advanced Performance Assessment Modeling Capability for Geologic Disposal of Nuclear Waste: Methodology and Requirements

This report describes the planning and initial development of an advanced disposal system PA modeling capability to facilitate the science-based evaluation of disposal system performance for a range of fuel cycle alternatives in a variety of geologic media and generic disposal system concepts. The advanced modeling capability will provide a PA model framework that facilitates PA model development, execution, and evaluation within a formal PA methodology. The PA model framework will provide a formalized structure that enables (a) representation and implementation of a range of generic geologic disposal system options, (b) representation of subsystem processes and couplings at varying levels of complexity in an integrated disposal system model, (c) flexible, modular representation of multi-physics processes, including the use of legacy codes, (d) evaluation of system- and subsystem-level performance, (e) uncertainty and sensitivity analyses to isolate key subsystem processes and components, (f) data and configuration management functions, and (g) implementation in HPC environments.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗