Search NASA⌕ Search

SEARCH · Search NASA

Results for “evaluation protocol”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

ETF Grout Expansion: Evaluation of MgO Additions and Struvite Precipitation Protocol for Potential Expansion

The ETF ammonia tolerant grout waste form was developed by the Vitreous State Laboratory (VSL) to stabilize ammonium and thereby prevent emission of ammonia vapor during solidification of an ammonium-rich, concentrated sulfate aqueous waste stream generated at the Hanford Effluent Treatment Facility (ETF). VSL did not observe expansion in samples prepared during the waste form development work. However, Savannah River National Laboratory (SRNL) personnel did encounter expansion, in some cases up to 20+ volume percent expansion in ETF grout samples while preforming work scope to evaluate compositional ranges for ETF brine and of the precipitation and solidification reagent. The work requests can be found in Washington River Protection Services (WRPS) Statement of Work (SOW), Requisitions #: 339922 Revisions 0 and 1, March 11, 2021, and November 2021. Additional evaluation was requested by WRPS SOW Requisitions #: 356730, Revision 1, February 1, 2022, to determine whether differences in the slags or differences in sample preparation protocols used by VSL and SRNL were the cause of the expansion observed in the SRNL samples. G. Chen, WRPS, arranged a materials exchange between VSL and SRNL and coordinated the VSL protocol for grouting and curing 1L of Base Case ETF simulant. Materials were exchanged between VSL and SRNL and both laboratories performed the VSL struvite precipitation-solidification protocol and cured samples for at least 28 days. VSL and SRNL encountered expansion, at varying degrees, in all samples prepared under the material exchange and grouting protocol. Additional material exchange testing between VSL and SRNL and alternative materials evaluation to further investigate the causes of grout expansion and differentiate the effects of various dry materials, grouting procedures, and curing containers was requested by WRPS SOW Requisitions #: 356730, Revision 2, January 10, 2023. Pacific Northwest National Laboratory (PNNL) assembled and distributed materials to both laboratories for testing. Observations from this study indicated variations in MgO additions, water-to-dry mix (dm) ratios and curing containers did not correlate to ETF ammonia grout expansion. In comparison to previous work, SRNL observed the addition rate of NaOH to be a potential factor for the final pH in the struvite precipitation step. In the current testing NaOH was added in bulk (5-10 mL at one time) during the precipitation step. The resulting pH was 7.57-9.15 which is slightly higher than pH observed at a slower addition rate. Additional testing is needed to identify the presence and/or struvite stability in high-pH struvite precipitant ETF ammonia grout samples. Therefore, based on current data, it is unknown if NaOH addition rate is the fundamental cause of grout expansion.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2024

Integrity Enhancing Protocols: Performance and Recommendations for Nuclear Systems

In today’s communication landscape there are multiple technologies and protocols used for communication between end devices. Within security paradigms for these protocols, integrity management is a common goal of system designers. Communication protocols focused on maintaining message integrity can provide assurance that some received data has not been altered or tampered with. While integrity is often coupled with confidentiality in protocol design, this analysis focuses on an evaluation of only integrity protocols. This report outlines various ways message integrity may be preserved with respect to high performance operational technology (OT) systems. It describes a series of experiments and an evaluation framework used to evaluate the performance of the identified integrity approaches regarding common system design goals. Finally, it addresses the testing environment utilized and closes the report with a summary of experimental results.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2015

Metabolic Tumor Volume as a Prognostic Imaging-Based Biomarker for Head-and-Neck Cancer: Pilot Results From Radiation Therapy Oncology Group Protocol 0522

Purpose: To evaluate candidate fluorodeoxyglucose positron emission tomography/computed tomography (FDG-PET/CT) imaging biomarkers for head-and-neck chemoradiotherapy outcomes in the cooperative group trial setting. Methods and Materials: Radiation Therapy Oncology Group (RTOG) protocol 0522 patients consenting to a secondary FDG-PET/CT substudy were serially imaged at baseline and 8 weeks after radiation. Maximum standardized uptake value (SUVmax), SUV peak (mean SUV within a 1-cm sphere centered on SUVmax), and metabolic tumor volume (MTV) using 40% of SUVmax as threshold were obtained from primary tumor and involved nodes. Results: Of 940 patients entered onto RTOG 0522, 74 were analyzable for this substudy. Neither high baseline SUVmax nor SUVpeak from primary or nodal disease were associated with poor treatment outcomes. However, primary tumor MTV above the cohort median was associated with worse local-regional control (hazard ratio 4.01, 95% confidence interval 1.28-12.52, P=.02) and progression-free survival (hazard ratio 2.34, 95% confidence interval 1.02-5.37, P=.05). Although MTV and T stage seemed to correlate (mean MTV 6.4, 13.2, and 26.8 for T2, T3, and T4 tumors, respectively), MTV remained a strong independent prognostic factor for progression-free survival in bivariate analysis that included T stage. Primary MTV remained prognostic in p16-associated oropharyngeal cancer cases, although sample size was limited. Conclusion: High baseline primary tumor MTV was associated with worse treatment outcomes in this limited patient subset of RTOG 0522. Additional confirmatory work will be required to validate primary tumor MTV as a prognostic imaging biomarker for patient stratification in future trials.

62 RADIOLOGY AND NUCLEAR MEDICINE↗
DOE OSTI2017

Deployment Efficiency and Barrier Effectiveness Testing of a Temporary Anti-Personnel (TAP) Barrier System.

This report documents tests conducted by Sandia National Laboratories (SNL) on behalf of the U.S. Department of State to evaluate a temporary anti-personnel (TAP) barrier system developed by Mitigation Technologies. For this, the SNL Denial and Structural Assessment department developed a test protocol for the evaluation of the TAP barrier system on the basis of deployment efficiency and barrier effectiveness against a riotous/mob attack threat. The test protocol was then executed by SNL personnel and the results of the testing are documented.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗
DOE OSTI2026

Identifying neutron sources using recoil and time-of-flight spectroscopy

Identification of neutron sources is central to nuclear physics and its applications, from planetary science to nuclear security, yet direct source discrimination from measured neutron spectra remains fundamentally elusive. Here, we introduce a Bayesian protocol that directly infers source ensembles from measured neutron spectra by combining full-spectrum template matching with probabilistic evidence evaluation. Applying this protocol to recoil and time-of-flight spectroscopy, we recover single- and two-source configurations with strong statistical significance (beyond 4⁢𝜎) at event counts as low as ∼10 3 . These results demonstrate that neutron spectral signatures can be leveraged for robust source identification, opening a new observational window for both fundamental research and operationally driven applications.

neutron physics↗
DOE OSTI2012

Evaluation of flexible and rigid (class solution) radiation therapy conformal prostate planning protocols

Protocols commonly implemented in radiotherapy work areas may be classified as being either rigid (class solution) or flexible. Because formal evaluation of these protocol types has not occurred within the literature, we evaluated the efficiency of a rigid compared with flexible prostate planning protocol by assessing a series of completed 3D conformal prostate plans. Twenty prostate cancer patients with an average age of 70 years (range, 52-77) and sizes comprising 8 small, 10 medium, and 2 large were planned on the Phillips Pinnacle treatment planning system 6 times by radiation therapists with <2 years, 2-5 years, and >5 years of experience using a rigid and flexible protocol. Plans were critiqued using critical organ doses, confirmation numbers, and conformity index. Plans were then classified as being acceptable or not. Plans produced with the flexible protocol were 53% less likely to require modification (OR 0.47, 95% CI: 0.26, 0.84, p = 0.01). Planners with >5 years of experience were 78% more likely to produce plans requiring modification (OR 1.78, 95% CI: 1.12, 2.83, P = 0.02). Plans according to the flexible protocol took longer (112 min) compared with the time taken using a rigid protocol (68 min) (p < 0.001). The results suggest that further studies are needed; however, we propose that all radiation therapy planners should start with the same limitations, and if an acceptable plan is not reached, then flexibility should be given to improve the plan to meet the desired results.

61 RADIATION PROTECTION AND DOSIMETRY↗
DOE OSTI2023

Advances in benchmarking and round robin testing for PEM water electrolysis: Reference protocol and hardware

While the number of publications in the PEM water electrolysis community increases each year, no common ground concerning reference hardware (test cells and test bench) and testing protocols has been yet established. This would, however, be necessary for the comparability of experimental results. First attempts for such reference hardware and procedures have been made in the framework of the Task 30 Electrolysis within the Technology Collaboration Programme on Advanced Fuel Cells (AFC TCP) of the International Energy Agency (IEA). Since then, improvements of both the test hardware (test cell and components) as well as the measurement protocol were identified, and a revised methodology and key results based on a comprehensive measurement series have been obtained. A detailed protocol for testing commercial reference components with a reference laboratory test cell developed in-house by Fraunhofer ISE is presented. For evaluation of the protocol and the hardware, it was tested at three different institutions at the same time. Impedance spectroscopic and polarization data was acquired and analyzed. The obtained differences in performance were calculated to give the community an expectation window to compare own data to. Finally, the importance of a thorough temperature control and the conditioning phase are demonstrated.

08 HYDROGEN↗
DOE OSTI2022

Large-scale application of free energy perturbation calculations for antibody design

Abstract Alchemical free energy perturbation (FEP) is a rigorous and powerful technique to calculate the free energy difference between distinct chemical systems. Here we report our implementation of automated large-scale FEP calculations, using the Amber software package, to facilitate antibody design and evaluation. In combination with Hamiltonian replica exchange, our FEP simulations aim to predict the effect of mutations on both the binding affinity and the structural stability. Importantly, we incorporate multiple strategies to faithfully estimate the statistical uncertainties in the FEP results. As a case study, we apply our protocols to systematically evaluate variants of the m396 antibody for their conformational stability and their binding affinity to the spike proteins of SARS-CoV-1 and SARS-CoV-2. By properly adjusting relevant parameters, the particle collapse problems in the FEP simulations are avoided. Furthermore, large statistical errors in a small fraction of the FEP calculations are effectively reduced by extending the sampling, such that acceptable statistical uncertainties are achieved for the vast majority of the cases with a modest total computational cost. Finally, our predicted conformational stability for the m396 variants is qualitatively consistent with the experimentally measured melting temperatures. Our work thus demonstrates the applicability of FEP in computational antibody design.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2011

Implementing High Performance Remote Method Invocation in CCA

We report our effort in engineering a high performance remote method invocation (RMI) mechanism for the Common Component Architecture (CCA). This mechanism provides a highly efficient and easy-to-use mechanism for distributed computing in CCA, enabling CCA applications to effectively leverage parallel systems to accelerate computations. This work is built on the previous work of Babel RMI. Babel is a high performance language interoperability tool that is used in CCA for scientific application writers to share, reuse, and compose applications from software components written in different programming languages. Babel provides a transparent and flexible RMI framework for distributed computing. However, the existing Babel RMI implementation is built on top of TCP and does not provide the level of performance required to distribute fine-grained tasks. We observed that the main reason the TCP based RMI does not perform well is because it does not utilize the high performance interconnect hardware on a cluster efficiently. We have implemented a high performance RMI protocol, HPCRMI. HPCRMI achieves low latency by building on top of a low-level portable communication library, Aggregated Remote Message Copy Interface (ARMCI), and minimizing communication for each RMI call. Our design allows a RMI operation to be completed by only two RDMA operations. We also aggressively optimize our system to reduce copying. In this paper, we discuss the design and our experimental evaluation of this protocol. Our experimental results show that our protocol can improve RMI performance by an order of magnitude.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2020

Remote Hardware-in-the-Loop Approach for Microgrid Controller Evaluation: Preprint

Utilities have been installing microgrids due to the advancements in the distributed energy resources technologies. Microgrids also improve the resiliency of the system due to their capability to isolate themselves from the grid and run in islanded mode of operation. Microgrid controllers are management systems that can run the microgrids under varied operating condition and enable the smooth operation of microgrids under various system conditions. It is of high value to de-risk the installation of such controllers. Hardware-in-the-loop evaluation is used by controller developers and utilities to evaluate the controllers under stressful conditions to understand the performance and to understand the necessary improvements to the microgrid controller. In this research work, the team has leveraged the existing infrastructure of real-time simulation at the Energy Systems Integration Facility (ESIF) and the capability of the microgrid controller to control assets over the Internet Protocol (IP) to evaluate a university developed microgrid controller in an efficient and cost-effective manner. The full paper will provide the complete setup, the experimental use cases and the results. In this abstract, one use case will be expalined, and the results from the use case is provided.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2023

Access Capabilities Through Ccs Communications Protocol (acccs)

AcCCS is a collection of scripts that leverage open-source code, off-the-shelf hardware, and published protocol specifications to create a flexible and inexpensive test and evaluation device for the Electric Vehicle industry. AcCCS is capable of emulating either an Electric Vehicle (EV) or Electric Vehicle Supply Equipment (EVSE). It provides a flexible set of Python scripts to test and evaluate the various communication protocols between the Electric Vehicle Communication Controller (EVCC) and Supply Equipment Communication Controller (SECC). This capability is useful for cybersecurity researchers, automotive OEMs, and EVSE manufactures.

Rohde, KennethW [Idaho National Laboratory (INL), ↗
DOE OSTI2022

Integration of polyurethane meniscus scaffold during ACL revision is not reliable at 5 years despite favourable clinical outcome

Abstract Purpose The aim of this study was to evaluate the clinical outcome at 5‐year follow‐up of a one‐step procedure combining anterior cruciate ligament (ACL) reconstruction and partial meniscus replacement using a polyurethane scaffold for the treatment of symptomatic patients with previously failed ACL reconstruction and partial medial meniscectomy. Moreover, the implanted scaffolds have been evaluated by MRI protocol in terms of morphology, volume, and signal intensity. Methods Twenty patients with symptomatic knee laxity after failed ACL reconstruction and partial medial meniscectomy underwent ACL revision combined with polyurethane‐based meniscal scaffold implant. Clinical assessment at 2‐ and 5‐year follow‐ups included VAS, Tegner Activity Score, International Knee Documentation Committee (IKDC), Western Ontario and McMaster Universities Osteoarthritis Index (WOMAC), and the Lysholm Score. MRI evaluation of the scaffold was performed according to the Genovese scale with quantification of the scaffold’s volume at 1‐ and 5‐year follow‐ups. Results All scores revealed clinical improvement as compared with the preoperative values at the 2‐ and 5‐year follow‐ups. However, a slight, but significant reduction of scores was observed between 2 and 5 years. Concerning the MRI assessment, a significant reduction of the scaffold’s volume was observed between 1 and 5 years. Genovese Morphology classification at 5 years included two complete resorptions (Type 3) and all the remaining patients had irregular morphology (Type 2). With regard to the Genovese Signal at the 5‐year follow‐up, three were classified as markedly hyperintense (Type 1), 15 as slightly hyperintense (Type 2), and two as isointense (Type 1). Conclusion Simultaneous ACL reconstruction and partial meniscus replacement using a polyurethane scaffold provides favourable clinical outcomes in the treatment of symptomatic patients with previously failed ACL reconstruction and partial medial meniscectomy at 5 years. However, MRI evaluation suggests that integration of the scaffold is not consistent. Level of evidence Level IV.

Pereira, Hélder↗
DOE OSTI2015

SU-F-207-16: CT Protocols Optimization Using Model Observer

Purpose: To quantitatively evaluate the performance of different CT protocols using task-based measures of image quality. This work studies the task of size and the contrast estimation of different iodine concentration rods inserted in head- and body-sized phantoms using different imaging protocols. These protocols are designed to have the same dose level (CTDIvol) but using different X-ray tube voltage settings (kVp). Methods: Different concentrations of iodine objects inserted in a head size phantom and a body size phantom are imaged on a 64-slice commercial CT scanner. Scanning protocols with various tube voltages (80, 100, and 120 kVp) and current settings are selected, which output the same absorbed dose level (CTDIvol). Because the phantom design (size of the iodine objects, the air gap between the inserted objects and the phantom) is not ideal for a model observer study, the acquired CT images are used to generate simulation images with four different sizes and five different contracts iodine objects. For each type of the objects, 500 images (100 x 100 pixels) are generated for the observer study. The observer selected in this study is the channelized scanning linear observer which could be applied to estimate the size and the contrast. The figure of merit used is the correct estimation ratio. The mean and the variance are estimated by the shuffle method. Results: The results indicate that the protocols with 100 kVp tube voltage setting provides the best performance for iodine insert size and contrast estimation for both head and body phantom cases. Conclusion: This work presents a practical and robust quantitative approach using channelized scanning linear observer to study contrast and size estimation performance from different CT protocols. Different protocols at same CTDIvol setting could Result in different image quality performance. The relationship between the absorbed dose and the diagnostic image quality is not linear.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2013

Mobile Pit verification system design based on passive special nuclear material verification in weapons storage facilities

A mobile 'drive by' passive radiation detection system to be applied in special nuclear materials (SNM) storage facilities for validation and compliance purposes has been designed through the use of computational modeling and new radiation detection methods. This project was the result of work over a 1 year period to create optimal design specifications to include creation of 3D models using both Monte Carlo and deterministic codes to characterize the gamma and neutron leakage out each surface of SNM-bearing canisters. Results were compared and agreement was demonstrated between both models. Container leakages were then used to determine the expected reaction rates using transport theory in the detectors when placed at varying distances from the can. A 'typical' background signature was incorporated to determine the minimum signatures versus the probability of detection to evaluate moving source protocols with collimation. This established the criteria for verification of source presence and time gating at a given vehicle speed. New methods for the passive detection of SNM were employed and shown to give reliable identification of age and material for highly enriched uranium (HEU) and weapons grade plutonium (WGPu). The finalized 'Mobile Pit Verification System' (MPVS) design demonstrated that a 'drive-by' detection system, collimated and operating at nominally 2 mph, is capable of rapidly verifying each and every weapon pit stored in regularly spaced, shelved storage containers, using completely passive gamma and neutron signatures for HEU and WGPu. This system is ready for real evaluation to demonstrate passive total material accountability in storage facilities. (authors)

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2014

SU-C-17A-02: Sirius MRI Markers for Prostate Post-Implant Assessment: MR Protocol Development

Purpose: Currently, CT is used to visualize prostate brachytherapy sources, at the expense of accurate structure contouring. MRI is superior to CT for anatomical delineation, but the sources appear as voids on MRI images. Previously we have developed Sirius MRI markers (C4 Imaging) to replace spacers to assist source localization on MRI images. Here we develop an MRI pulse sequence protocol that enhances the signal of these markers to enable MRI-only post-implant prostate dosimetric analysis. Methods: To simulate a clinical scenario, a CIRS multi-modality prostate phantom was implanted with 66 markers and 86 sources. The implanted phantom was imaged on both 1.5T and 3.0T GE scanners under various conditions, different pulse sequences (2D fast spin echo [FSE], 3D balanced steadystate free precession [bSSFP] and 3D fast spoiled gradient echo [FSPGR]), as well as varying amount of padding to simulate various patient sizes and associated signal fall-off from the surface coil elements. Standard FSE sequences from the current clinical protocols were also evaluated. Marker visibility, marker size, intra-marker distance, total scan time and artifacts were evaluated for various combinations of echo time, repetition time, flip angle, number of excitations, bandwidth, slice thickness and spacing, fieldof- view, frequency/phase encoding steps and frequency direction. Results: We have developed a 3D FSPGR pulse sequence that enhances marker signal and ensures the integrity of the marker shape while maintaining reasonable scan time. For patients contraindicated for 3.0T, we have also developed a similar sequence for 1.5T scanners. Signal fall-off with distance from prostate to coil can be compensated mainly by decreasing bandwidth. The markers are not visible using standard FSE sequences. FSPGR sequences are more robust for consistent marker visualization as compared to bSSFP sequences. Conclusion: The developed MRI pulse sequence protocol for Sirius MRI markers assists source localization to enable MRIonly post-implant prostate dosimetric analysis. S.J. Frank is a co-founder of C4 Imaging (manufactures the MRI markers)

60 APPLIED LIFE SCIENCES↗
DOE OSTI2024

NuQKD: A Modular Quantum Key Distribution Simulation Framework for Engineering Applications

Abstract An experimental Quantum Key Distribution (QKD) implementation requires advanced costly hardware, unavailable in most research environments, making protocol testing and performance evaluation complicated. This has been a major motivation for the development of QKD simulation frameworks, to allow researchers to obtain insight before proceeding into practical implementations. Several simulators have been introduced over the recent years. However, only four are publicly available, only one of which models equipment imperfections. Currently, no open‐source simulator includes all following capabilities: channel attenuation modelling, equipment imperfections and effects on key rates, estimation of elapsed time during classical and quantum‐ channel processes, use of truly random binary sequences for qubits and measurement bases, shared ‐bit fraction customization. In this paper, we present NuQKD, an open‐ source modular, intuitive simulator, featuring all the above capabilities. NuQKD establishes communication between two computer terminals, accepts custom user inputs (iterations, raw key size, attacker interception rate etc.) and evaluates the sifted key, Quantum Bit Error Rate (QBER), elapsed communication time, and more. NuQKD capabilities include optical fiber and free ‐space simulation, modeling of equipment/channel imperfections, bitstrings from True Random Number Generators, decoy‐state protocol support, and automated evaluation of performance metrics. We expect NuQKD to enable convenient and accurate representation of actual experimental conditions.

Gkouliaras, Konstantinos↗
DOE OSTI2025

Accelerating technology development to monitor and minimize effects from land‐based wind energy on birds and bats

While wind energy is a key sector of domestic energy production for the United States, operation of wind turbines directly and indirectly adversely affects certain species of birds and bats. The cumulative effect of wind turbine strikes can have both biological and regulatory consequences, and, in some cases, delay permitting and construction or affect ongoing operations. Technology can help quantify and minimize these effects, but the pace of development, acceptance, and adoption of technological solutions is slow. Although adopting cost‐effective technologies may reduce negative effects on wildlife and help achieve both energy production and conservation goals, consensus is lacking among developers, regulators, and the conservation community regarding how to define technology effectiveness and acceptance and how to develop a standardized process for doing so. Removing barriers to technology advancement requires deviating from the status quo. Changes include 1) creating incentives to mitigate impacts, 2) establishing options for research as mitigation, 3) rethinking how research is funded, 4) increasing stakeholder coordination, and 5) increasing the efficiency of research and development. We recommend the creation of a national framework to establish clear criteria and protocols for technology evaluation and adoption.

17 WIND ENERGY↗