Search NASA⌕ Search

SEARCH · Search NASA

Results for “evaluation protocol”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5
All sourcesNASA NTRSDOE OSTI
DOE OSTI2019

Aftertreatment protocols for catalyst characterization and performance evaluation: low-temperature oxidation, storage, three-way, and NH3-SCR catalyst test protocols

A set of standardized and realistic aftertreatment catalyst test protocols have been developed by the Advanced Combustion and Emission Control Technical Team in support of the U.S.DRIVE Partnership. The protocols are intended to accelerate the pace of aftertreatment catalyst innovation by enabling the accurate evaluation and comparison of aftertreatment catalyst performance data from various testing and research facilities to maximize the impact of discovery-phase research occurring across the nation. The protocols address a need identified by the Partnership’s industry partners for consistent and accurate metrics for aftertreatment catalyst evaluation and comparison. The protocols consist of a set of standardized requirements and test procedures that sufficiently capture the performance capability of a catalyst technology in a manner that is adaptable in various laboratories. The protocols provide a detailed description of the necessary reactor system, the steps for achieving a desired aged state of the catalyst, all necessary sample pretreatment to be performed prior to testing, and realistic test conditions for evaluating performance. This article details four low-temperature catalyst test protocols applicable to (1) oxidation catalysts, (2) passive storage (and release) catalysts, (3) three-way catalysts, and (4) NH3-SCR catalysts. The catalyst test protocol descriptions are presented in five (5) sections: protocol general guidelines and the four individual catalyst test protocol descriptions. The general guidelines plus the individual protocol description forms the complete low-temperature catalyst test protocol for the application.

Emission control, Three-way catalyst, oxidation, S↗
DOE OSTI2024

Experimental Characterization Test of a Grid-Forming Inverter for Microgrid Applications

Standardized experimental testing protocols for grid forming (GFM) inverters to ensure expected operation under both normal and contingency conditions do not exist. Such protocols increase the confidence of system owner/operators that an inverter deployed in a proposed system will engage in typical behaviors to ensure interoperability with other units and ancillary equipment (e.g. protection equipment). This paper presents systematic and comprehensive test protocols to evaluate the performance of GFM inverters under the following operational configurations: islanded operation, heterogeneous islanded operation (parallel with a synchronous generator), grid-connected operation, and transition operation. A commercial GFM inverter is used to verify the test protocols and to understand the inverter's performance and functionalities. In particular, required configuration and tuning of the inverter will be explained in the full paper to enrich the testing protocol.

black start↗
DOE OSTI2015

SU-E-P-49: Evaluation of Image Quality and Radiation Dose of Various Unenhanced Head CT Protocols

Purpose: To evaluate the diagnostic value of various unenhanced head CT protocols and predicate acceptable radiation dose level for head CT exam. Methods: Our retrospective analysis included 3 groups, 20 patients per group, who underwent clinical routine unenhanced adult head CT examination. All exams were performed axially with 120 kVp. Three protocols, 380 mAs without iterative reconstruction and automAs, 340 mAs with iterative reconstruction without automAs, 340 mAs with iterative reconstruction and automAs, were applied on each group patients respectively. The images were reconstructed with H30, J30 for brain window and H60, J70 for bone window. Images acquired with three protocols were randomized and blindly reviewed by three radiologists. A 5 point scale was used to rate each exam The percentage of exam score above 3 and average scores of each protocol were calculated for each reviewer and tissue types. Results: For protocols without automAs, the average scores of bone window with iterative reconstruction were higher than those without iterative reconstruction for each reviewer although the radiation dose was 10 percentage lower. 100 percentage exams were scored 3 or higher and the average scores were above 4 for both brain and bone reconstructions. The CTDIvols are 64.4 and 57.8 mGy of 380 and 340 mAs, respectively. With automAs, the radiation dose varied with head size, resulting in 47.5 mGy average CTDIvol between 39.5 and 56.5 mGy. 93 and 98 percentage exams were scored great than 3 for brain and bone windows, respectively. The diagnostic confidence level and image quality of exams with AutomAs were less than those without AutomAs for each reviewer. Conclusion: According to these results, the mAs was reduced to 300 with automAs OFF for head CT exam. The radiation dose was 20 percentage lower than the original protocol and the CTDIvol was reduced to 51.2 mGy.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2015

Comparison and uncertainty evaluation of different calibration protocols and ionization chambers for low-energy surface brachytherapy dosimetry

Purpose: A surface electronic brachytherapy (EBT) device is in fact an x-ray source collimated with specific applicators. Low-energy (<100 kVp) x-ray beam dosimetry faces several challenges that need to be addressed. A number of calibration protocols have been published for x-ray beam dosimetry. The media in which measurements are performed are the fundamental difference between them. The aim of this study was to evaluate the surface dose rate of a low-energy x-ray source with small field applicators using different calibration standards and different small-volume ionization chambers, comparing the values and uncertainties of each methodology. Methods: The surface dose rate of the EBT unit Esteya (Elekta Brachytherapy, The Netherlands), a 69.5 kVp x-ray source with applicators of 10, 15, 20, 25, and 30 mm diameter, was evaluated using the AAPM TG-61 (based on air kerma) and International Atomic Energy Agency (IAEA) TRS-398 (based on absorbed dose to water) dosimetry protocols for low-energy photon beams. A plane parallel T34013 ionization chamber (PTW Freiburg, Germany) calibrated in terms of both absorbed dose to water and air kerma was used to compare the two dosimetry protocols. Another PTW chamber of the same model was used to evaluate the reproducibility between these chambers. Measurements were also performed with two different Exradin A20 (Standard Imaging, Inc., Middleton, WI) chambers calibrated in terms of air kerma. Results: Differences between surface dose rates measured in air and in water using the T34013 chamber range from 1.6% to 3.3%. No field size dependence has been observed. Differences are below 3.7% when measurements with the A20 and the T34013 chambers calibrated in air are compared. Estimated uncertainty (with coverage factor k = 1) for the T34013 chamber calibrated in water is 2.2%–2.4%, whereas it increases to 2.5% and 2.7% for the A20 and T34013 chambers calibrated in air, respectively. The output factors, measured with the PTW chambers, differ by less than 1.1% for any applicator size when compared to the output factors that were measured with the A20 chamber. Conclusions: Measurements using both dosimetric protocols are consistent, once the overall uncertainties are considered. There is also consistency between measurements performed with both chambers calibrated in air. Both the T34013 and A20 chambers have negligible stem effect. Any x-ray surface brachytherapy system, including Esteya, can be characterized using either one of these calibration protocols and ionization chambers. Having less correction factors, lower uncertainty, and based on measurements, performed in closer to clinical conditions, the TRS-398 protocol seems to be the preferred option.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2023

High throughput structure–property relationship for additively manufactured 316L/IN625 alloy mixtures leveraging 2-step Bayesian estimation

While the fabrication of graded materials by directed energy deposition (DED) has led to accelerated materials discovery, the ability to rapidly explore sufficiently large material composition spaces is limited due to the time-intensive nature of conventional materials characterization techniques. The present study investigates the viability of small punch test (SPT) protocols for rapidly evaluating DED-fabricated alloy mixtures of stainless steel 316L (316L) and Inconel 625 (IN625). The SPT protocols evaluated in this study include both the recently established two-step Bayesian estimation framework as well as the empirical relationships established in prior literature. It is shown that these protocols are capable of reliably and quantitatively tracking the changes in the mechanical properties of the alloy mixtures studied. Enhancement of mechanical properties was observed with the addition of IN625 to 316L, which is attributed to the austenite stabilization in the matrix and the formation of fine δ - Ni3Nb precipitates. It is shown that CALPHAD-based Scheil model simulations predicted the formation of different precipitate phases for each composition. The novel protocols presented in this paper open new avenues for high throughput material explorations for additive manufacturing.

2-step Bayesian estimation↗
DOE OSTI2013

The evaluation of an analytical protocol for the determination of substances in waste for hazard classification

Highlights: • Knowledge of wastes in substances will be necessary to assess HP1–HP15 hazard properties. • A new analytical protocol is proposed for this and tested by two service laboratories on 32 samples. • Sixty-three percentage of the samples have a satisfactory analytical balance between 90% and 110%. • Eighty-four percentage of the samples were classified identically (Seveso Directive) for their hazardousness by the two laboratories. • The method, in progress, is being normalized in France and is be proposed to CEN. - Abstract: The classification of waste as hazardous could soon be assessed in Europe using largely the hazard properties of its constituents, according to the the Classification, Labelling and Packaging (CLP) regulation. Comprehensive knowledge of the component constituents of a given waste will therefore be necessary. An analytical protocol for determining waste composition is proposed, which includes using inductively coupled plasma (ICP) screening methods to identify major elements and gas chromatography/mass spectrometry (GC–MS) screening techniques to measure organic compounds. The method includes a gross or indicator measure of ‘pools’ of higher molecular weight organic substances that are taken to be less bioactive and less hazardous, and of unresolved ‘mass’ during the chromatography of volatile and semi-volatile compounds. The concentration of some elements and specific compounds that are linked to specific hazard properties and are subject to specific regulation (examples include: heavy metals, chromium(VI), cyanides, organo-halogens, and PCBs) are determined by classical quantitative analysis. To check the consistency of the analysis, the sum of the concentrations (including unresolved ‘pools’) should give a mass balance between 90% and 110%. Thirty-two laboratory samples comprising different industrial wastes (liquids and solids) were tested by two routine service laboratories, to give circa 7000 parameter results. Despite discrepancies in some parameters, a satisfactory sum of estimated or measured concentrations (analytical balance) of 90% was reached for 20 samples (63% of the overall total) during this first test exercise, with identified reasons for most of the unsatisfactory results. Regular use of this protocol (which is now included in the French legislation) has enabled service laboratories to reach a 90% mass balance for nearly all the solid samples tested, and most of liquid samples (difficulties were caused in some samples from polymers in solution and vegetable oil). The protocol is submitted to French and European normalization bodies (AFNOR and CEN) and further improvements are awaited.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

Evaluation of DNA extraction protocols from liquid-based cytology specimens for studying cervical microbiota

Cervical microbiota (CM) are considered an important factor affecting the progression of cervical intraepithelial neoplasia (CIN) and are implicated in the persistence of human papillomavirus (HPV). Collection of liquid-based cytology (LBC) samples is routine for cervical cancer screening and HPV genotyping and can be used for long-term cytological biobanking. We sought to determine whether it is possible to access microbial DNA from LBC specimens, and compared the performance of four different extraction protocols: (ZymoBIOMICS DNA Miniprep Kit; QIAamp PowerFecal Pro DNA Kit; QIAamp DNA Mini Kit; and IndiSpin Pathogen Kit) and their ability to capture the diversity of CM from LBC specimens. LBC specimens from 20 patients (stored for 716 ± 105 days) with CIN values of 2 or 3 were each aliquoted for each of the four kits. Loss of microbial diversity due to long-term LBC storage could not be assessed due to lack of fresh LBC samples. Comparisons with other types of cervical sampling were not performed. We observed that all DNA extraction kits provided equivalent accessibility to the cervical microbial DNA within stored LBC samples. Approximately 80% microbial genera were shared among all DNA extraction protocols. Potential kit contaminants were observed as well. Variation between individuals was a significantly greater influence on the observed microbial composition than was the method of DNA extraction. We also observed that HPV16 was significantly associated with community types that were not dominated by Lactobacillus iners.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2017

Chapter 13: Assessing Persistence and Other Evaluation Issues Cross-Cutting Protocol. The Uniform Methods Project: Methods for Determining Energy Efficiency Savings for Specific Measures

Addressing other evaluation issues that have been raised in the context of energy efficiency programs, this chapter focuses on methods used to address the persistence of energy savings, which is an important input to the benefit/cost analysis of energy efficiency programs and portfolios. In addition to discussing 'persistence' (which refers to the stream of benefits over time from an energy efficiency measure or program), this chapter provides a summary treatment of these issues -Synergies across programs -Rebound -Dual baselines -Errors in variables (the measurement and/or accuracy of input variables to the evaluation).

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2024

A protocol and analysis of year-long simulations of global storm-resolving models and beyond

We propose a protocol to evaluate and analyze year-long simulations of global storm-resolving models (GSRMs). The proposed protocol complements an earlier 40-day simulation protocol under the DYAMOND (DYnamics of the Atmospheric general circulation Modeled On Non-hydrostatic Domains) project to allow the analysis of the seasonal cycle and associated climatic relevant phenomena. This intercomparison aims to reveal how GSRMs, which can simulate mesoscale convective systems (MCSs) in the global domain, reproduce atmospheric large-scale structures related to convection beyond month-long simulations. The intercomparison for one-year simulations is conducted by either atmosphere-only models or atmosphere–ocean coupled models with atmospheric horizontal mesh sizes less than 5 km. We recommend the continuous four seasons from March 2020 to February 2021 as a target period for the intercomparison but with options for many groups to join more flexibly. The output variables are collected at 0.25° resolution, and archives of a small set of native grid variables are encouraged to analyze tropical cyclones and MCSs. Through the proposed global storm-resolving simulation, we will evaluate the climatological distributions of the atmospheric large-scale circulations, such as the Intertropical Convergence Zone (ITCZ), monsoon, midlatitude jets, their time evolution, and the upscale impacts on them. We present sample analyses from a one-year simulation using the 3.5 km mesh Nonhydrostatic Icosahedral Atmospheric Model (NICAM), revealing the realistic zonal contrast of tropical precipitation, no double ITCZ structure, the reasonable midlatitude jet position and intensity but a weak bias of storm track activities, and a warm bias over the Eurasia during boreal winter. We also clarify the cross-scale interaction, such as the effects of cold pools on mean precipitation over the Maritime Continent through the precipitation diurnal cycle and the effects of resolved gravity waves on midlatitude mean flows. The proposed one-year simulation protocol is referred to as the “Sendai Protocol.” This protocol is not unique or definite for evaluating GSRMs; we prospect a hierarchical set of experiments from short-term to multi-year simulations as GSRM intercomparisons.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2016

TH-CD-BRA-11: Implementation and Evaluation of a New 3D Dosimetry Protocol for Validating MRI Guided Radiation Therapy Treatments

Purpose: To develop, evaluate and apply a novel high-resolution 3D remote dosimetry protocol for validation of MRI guided radiation therapy treatments (MRIdian by ViewRay™). We demonstrate the first application of the protocol (including two small but required new correction terms) utilizing radiochromic 3D plastic PRESAGE™ with optical-CT readout. Methods: A detailed study of PRESAGE™ dosimeters (2kg) was conducted to investigate the temporal and spatial stability of radiation induced optical density change (ΔOD) over 8 days. Temporal stability was investigated on 3 dosimeters irradiated with four equally-spaced square 6MV fields delivering doses between 10cGy and 300cGy. Doses were imaged (read-out) by optical-CT at multiple intervals. Spatial stability of ΔOD response was investigated on 3 other dosimeters irradiated uniformly with 15MV extended-SSD fields with doses of 15cGy, 30cGy and 60cGy. Temporal and spatial (radial) changes were investigated using CERR and MATLAB’s Curve Fitting Tool-box. A protocol was developed to extrapolate measured ΔOD readings at t=48hr (the typical shipment time in remote dosimetry) to time t=1hr. Results: All dosimeters were observed to gradually darken with time (<5% per day). Consistent intra-batch sensitivity (0.0930±0.002 ΔOD/cm/Gy) and linearity (R2=0.9996) was observed at t=1hr. A small radial effect (<3%) was observed, attributed to curing thermodynamics during manufacture. The refined remote dosimetry protocol (including polynomial correction terms for temporal and spatial effects, CT and CR) was then applied to independent dosimeters irradiated with MR-IGRT treatments. Excellent line profile agreement and 3D-gamma results for 3%/3mm, 10% threshold were observed, with an average passing rate 96.5%± 3.43%. Conclusion: A novel 3D remote dosimetry protocol is presented capable of validation of advanced radiation treatments (including MR-IGRT). The protocol uses 2kg radiochromic plastic dosimeters read-out by optical-CT within a week of treatment. The protocol requires small corrections for temporal and spatially-dependent behaviors observed between irradiation and readout.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2020

Evaluating kratom alkaloids using PHASE

Kratom is a botanical substance that is marketed and promoted in the US for pharmaceutical opioid indications despite having no US Food and Drug Administration approved uses. Kratom contains over forty alkaloids including two partial agonists at the mu opioid receptor, mitragynine and 7-hydroxymitragynine, that have been subjected to the FDA’s scientific and medical evaluation. However, pharmacological and toxicological data for the remaining alkaloids are limited. Therefore, we applied the Public Health Assessment via Structural Evaluation (PHASE) protocol to generate in silico binding profiles for 25 kratom alkaloids to facilitate the risk evaluation of kratom. PHASE demonstrates that kratom alkaloids share structural features with controlled opioids, indicates that several alkaloids bind to the opioid, adrenergic, and serotonin receptors, and suggests that mitragynine and 7-hydroxymitragynine are the strongest binders at the mu opioid receptor. Subsequently, the in silico binding profiles of a subset of the alkaloids were experimentally verified at the opioid, adrenergic, and serotonin receptors using radioligand binding assays. The verified binding profiles demonstrate the ability of PHASE to identify potential safety signals and provide a tool for prioritizing experimental evaluation of high-risk compounds.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2020

Remote Hardware-in-the-Loop Approach for Microgrid Controller Evaluation

Utilities have been installing microgrids because of the increased resilience and reliability advantages they may provide to the distribution system. A microgrid controller is a critical component in microgrids. It is of great benefit to derisk the installation of microgrid controllers before field deployment. Hardware-in-the-loop (HIL) testing is used by controller developers and utilities to evaluate the controllers under stressful conditions. In this work, a microgrid control function developed by the Synchrophasor Grid Monitoring and Automation (SyGMA) laboratory at the University of California, San Diego is tested in a remote HIL (RHIL) setup. The digital real-time simulation of the detailed microgrid system was operated at the National Renewable Energy Laboratory's Energy Systems Integration Facility. Under such RHIL setup, successful controller operation is contingent on understanding and characterizing the communications channel and in particular network latencies. The novelty of this paper is the proposed use of a RHIL setup that leverages existing power system communications protocols to evaluate the controller in conjunction with the simulation capabilities of a remote facility. The work presented here will provide the complete setup of the HIL evaluation platform, the details of the communications protocols used by the setup for data transfer between the two organizations, test cases developed to evaluate the controller, and the results from the experiments.

controller hardware-in-the-loop↗
DOE OSTI2020

Remote Hardware-in-the-Loop Approach for Microgrid Controller Evaluation

Utilities have been installing microgrids because of the increased resilience and reliability advantages they may provide to the distribution system. A microgrid controller is a critical component in microgrids. It is of great benefit to derisk the installation of microgrid controllers before field deployment. Hardware-in-the-loop (HIL) testing is used by controller developers and utilities to evaluate the controllers under stressful conditions. In this work, a microgrid control function developed by the Synchrophasor Grid Monitoring and Automation (SyGMA) laboratory at the University of California, San Diego is tested in a remote HIL (RHIL) setup. The digital real-time simulation of the detailed microgrid system was operated at the National Renewable Energy Laboratory's Energy Systems Integration Facility. Under such RHIL setup, successful controller operation is contingent on understanding and characterizing the communications channel and in particular network latencies. The novelty of this paper is the proposed use of a RHIL setup that leverages existing power system communications protocols to evaluate the controller in conjunction with the simulation capabilities of a remote facility. The work presented here will provide the complete setup of the HIL evaluation platform, the details of the communications protocols used by the setup for data transfer between the two organizations, test cases developed to evaluate the controller, and the results from the experiments.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2019

Nutrition, risk factors, prevention, and imaging: The 2018 Mario Verani Lecture

Heart disease has been the leading cause of death in the United States since 1918. Cardiac mortality rates have dramatically decreased in this era of advanced medical and interventional therapies. However, this has been aptly described as “mopping up the floor instead of turning off the faucet.” With this recognition, prevention in cardiology is poised to become a central focus. Within prevention, dietary intervention is recognized as the single largest opportunity for improved cardiovascular outcomes, including improvement or elimination of cardiac risk factors, prevention of myocardial infarction, stroke and cardiovascular death, and reduction of plaque burden and myocardial ischemia. Cardiac imaging, particularly nuclear perfusion and coronary computed tomographic angiography, plays a critical role in early diagnosis and serial evaluation of myocardial ischemia and coronary artery disease. These techniques have the potential to help refine research protocols and evaluate their success by providing intermediate markers of improved myocardial blood flow and coronary plaque morphology.

62 RADIOLOGY AND NUCLEAR MEDICINE↗
DOE OSTI2020

Transmission of Images With Ultrasonic Elastic Shear Waves on a Metallic Pipe Using Amplitude Shift Keying Protocol

Transmission of information using ultrasonic elastic waves on existing metallic pipes provides an alternative communication option across physical barriers in a highly partitioned industrial complex, such as a nuclear facility. This work investigates the feasibility of the transmission of digital images over metallic pipes. Ultrasonic communication systems for transmission of images on a nuclear-grade stainless steel pipe were assembled for bench-scale demonstration. Information carriers in this system are refracted shear waves transmitted and received with piezoelectric transducers (PZTs) operating at 2-MHz nominal frequency. The refraction and propagation of ultrasonic shear waves were modeled with COMSOL software. An amplitude shift keying (ASK) communication protocol for image transmission was developed and implemented in the GNURadio software-defined radio (SDR) environment. Digital information was converted to analog ultrasonic signals using Red Pitaya electronic boards. The performance of the ASK protocol is evaluated at the output of every block in the GNURadio program by monitoring the transmission of select characters. Using the ASK communication protocol, the transmission of the 32-KB image was demonstrated at 2-Kbps bitrate across 6-ft-long stainless steel pipe. Finally, preliminary evaluation of ultrasonic communication on the piping of a nuclear facility, such as signal transmission on bent pipes, was performed with COMSOL computer simulations.

42 ENGINEERING↗
DOE OSTI2016

Practical State Machine Replication with Confidentiality

We study how to enable arbitrary randomized algorithms in Byzantine fault-tolerant (BFT) settings. We formalize a randomized BFT protocol and provide a simple and efficient construction that can be built on any existing BFT protocols while adding practically no overhead. We go one step further to revisit a confidential BFT protocol (Yin et al., SOSP '03). We show that their scheme is potentially susceptible to safety and confidentiality attacks. We then present a new protocol that is secure in the stronger model we formalize, by extending the idea of a randomized BFT protocol. Our protocol uses only efficient symmetric cryptography, while Yin et al.'s uses costly threshold signatures. We implemented and evaluated our protocols on microbenchmarks and real-world use cases. We show that our randomized BFT protocol is as efficient as conventional BFT protocols, and our confidential BFT protocol is two to three orders of magnitude faster than Yin et al.'s, which is less secure than ours.

Duan, Sisi↗