Search NASA⌕ Search

SEARCH · Search NASA

Results for “evaluation protocol”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
DOE OSTI2015

Advancing the practice of health impact assessment in Canada: Obstacles and opportunities

Health Impact Assessment (HIA) is recognized as a useful tool that can identify potential health impacts resulting from projects or policy initiatives. Although HIA has become an established practice in some countries, it is not yet an established practice in Canada. In order to enable broader support for HIA, this study provides a comprehensive review and analysis of the peer-reviewed and gray literature on the state of HIA practice. The results of this review revealed that, although there is an abundance of publications relating to HIA, there remains a lack of transparent, consistent and reproducible approaches and methods throughout the process. Findings indicate a need for further research and development on a number of fronts, including: 1) the nature of HIA triggers; 2) consistent scoping and stakeholder engagement approaches; 3) use of evidence and transparency of decision-making; 4) reproducibility of assessment methods; 5) monitoring and evaluation protocols; and, 6) integration within existing regulatory frameworks. Addressing these issues will aid in advancing the more widespread use of HIA in Canada. - Highlights: • Reviewed current state of practice in the field of HIA • Identified key obstacles and opportunities for HIA advancement • Major issues include lack of consistent approach and methodology. • No national regulatory driver hinders opportunity for widespread use of HIA. • Identified research opportunities vital to developing HIA practice in Canada.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2014

SU-E-T-319: The Effect of Slice Thickness On IMRT Planning

Purpose: The accuracy of volume estimated of a treatment planning system is investigated in this study. In addition, the effect of slice thickness on IMRT planning is also studied. Methods: The accuracy in volume determination was investigated using a water phantom containing various objects with known volumes ranging from 1–100cm{sup 3}. The phantom was scanned with different slice thickness (1–10 mm). The CT data sets were sent to Eclipse TPS for contour delineation and volume calculation. The effect of slice thickness on IMRT planning was studied using a commercial phantom containing four different shaped objects. The phantom was scanned with different slice thickness (1–5 mm). IMRT plans were generated for the different CT datasets to calculate TCP, homogeneity (HI) and conformity indices (CI). Results: The variability of volumes with CT slice thickness was significant especially for small volume structures. The minimum and maximum error in the volume estimation is in the range of −2.3% to 92%. On the other hand, with increasing slice thickness, the PTV mean dose and TCP values decreases. Maximum variation of ∼5% was observed in mean dose and ∼2% in TCP with slice thickness change from 1–5 mm. The relative decrease in target volume receiving 95% of prescribed dose is ∼5% slice thickness change from 1–5 mm. HI increases up to 163% and CI decreases by 4% between 1–5 mm slice thickness change, producing highly inhomogeneous and least conformal plan. Conclusion: Accuracy of volume estimation is dependent on CT slice thickness and the contouring algorithm in a TPS. During TPS commissioning and for all clinical protocols, evaluation of volume should be included to provide the limit of accuracy in DVH calculation. A smaller slice thickness provides superior dosimetry with improved TCP values. Thus, the smallest possible slice thickness should be used for IMRT planning.

07 ISOTOPE AND RADIATION SOURCES↗
DOE OSTI2015

TU-AB-201-07: Image Guided Endorectal HDR Brachytherapy Using a Compliant Balloon Applicator

Purpose: High dose rate endorectal brachytherapy is an option to deliver a focal, high-dose radiotherapy to rectal tumors for patients undergoing non-operative management. We investigate a new multichannel, MR compatible applicator with a novel balloon-based design to provide improved treatment geometry. We report on the initial clinical experience using this applicator. Methods: Patients were enrolled on an IRB-approved, dose-escalation protocol evaluating the use of the anorectal (AR-1) applicator (Ancer Medical, Hialeah, FL), a multichannel applicator with two concentric balloons. The inner balloon supports 8 source lumens; the compliant outer balloon expands to separate the normal rectal wall and the source lumens, yet deforms around a firm, exophytic rectal mass, leading to dose escalation to tumor while sparing normal rectum. Under general anesthesia, gold fiducial markers were inserted above and below the tumor, and the AR applicator was placed in the rectum. MRI-based treatment plans were prepared to deliver 15 Gy in 3 weekly fractions to the target volume while sparing healthy rectal tissue, bladder, bowel and anal muscles. Prior to each treatment, CBCT/Fluoroscopy were used to place the applicator in the treatment position and confirm the treatment geometry using rigid registration of the CBCT and planning MRI. After registration of the applicator images, positioning was evaluated based on the match of the gold markers. Results: Highly conformal treatment plans were achieved. MR compatibility of the applicator enabled good tumor visualization. In spite of the non-rigid nature of the applicators and the fact that a new applicator was used at each treatment session, treatment geometry was reproducible to within 2.5 mm. Conclusions: This is the first report on using the AR applicator in patients. Highly conformal plans, confidence in MRI target delineation, in combination with reproducible treatment geometry provide encouraging feedback for continuation with dose escalation in these patients.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2016

SU-F-J-69: The Dosimetric Impact of Interfraction Anorectum and Bladder Variability in Prostate Radiation Therapy

Purpose: In the era of dose escalation and numerous protocols evaluating radiation delivery to the prostate, it is imperative to achieve accurate and standardized daily set up. At the Sylvester Comprehensive Cancer Center, patients are instructed to drink 8 ounces of water 30 minutes prior to RT and follow a low residue diet to ensure that the anorectum is not distended and the bladder is adequately filled. If daily CBCT imaging shows any variation, the patient is removed from the table and drinks water or evacuates their rectum prior to a repeat CBCT. Here we attempt to quantify the efficacy of this procedure. Methods: CBCTs were collected for 5 patients receiving 40 fractions of definitive treatment for prostate cancer. CBCTs were imported into MIM (v6.5.7, Cleveland OH) and the bladder, anorectum, and prostate were contoured. Using the daily registration reviewed by the attending physician, the planning dose was rigidly transferred to the daily CBCT. On days that multiple CBCTs were performed due to inadequate anorectum or bladder preparation, the repeated and final CBCTs were evaluated for variations in V40Gy and V65Gy to both the anorectum and bladder. Results: A high level of variability in doses to the anorectum and bladder was found in the scans that were not utilized for treatment. The aggregate lower quartile for the unused versus used CBCTs was 27.2% vs. 16.83% for V40Gy and 8.53% vs. 5.66% for V65Gy bladder. The upper quartiles showed to be 48.88% vs. 41.92% and 21.05% vs. 20.55%. The combined lower quartile for the unused vs. used CBCTs was 8.24% vs. 5.49% for V40Gy and 0.57% vs. 0.0% for V65Gy anorectum. The upper quartiles were 34.35% vs. 33.25% and 18.37% vs. 16.11%. Conclusion: This study shows that daily imaging is insufficient and that proper bladder and anorectum preparation are essential to deliver proper treatment.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2014

Improvement of cellulose catabolism in Clostridium cellulolyticum by sporulation abolishment and carbon alleviation

Background Clostridium cellulolyticum can degrade lignocellulosic biomass, and ferment the soluble sugars to produce valuable chemicals such as lactate, acetate, ethanol and hydrogen. However, the cellulose utilization efficiency of C. cellulolyticum still remains very low, impeding its application in consolidated bioprocessing for biofuels production. In this study, two metabolic engineering strategies were exploited to improve cellulose utilization efficiency, including sporulation abolishment and carbon overload alleviation. Results The spo0A gene at locus Ccel_1894, which encodes a master sporulation regulator was inactivated. The spo0A mutant abolished the sporulation ability. In a high concentration of cellulose (50 g/l), the performance of the spo0A mutant increased dramatically in terms of maximum growth, final concentrations of three major metabolic products, and cellulose catabolism. The microarray and gas chromatography mass spectrometry (GC-MS) analyses showed that the valine, leucine and isoleucine biosynthesis pathways were up-regulated in the spo0A mutant. Based on this information, a partial isobutanol producing pathway modified from valine biosynthesis was introduced into C. cellulolyticum strains to further increase cellulose consumption by alleviating excessive carbon load. The introduction of this synthetic pathway to the wild-type strain improved cellulose consumption from 17.6 g/l to 28.7 g/l with a production of 0.42 g/l isobutanol in the 50 g/l cellulose medium. However, the spo0A mutant strain did not appreciably benefit from introduction of this synthetic pathway and the cellulose utilization efficiency did not further increase. A technical highlight in this study was that an in vivo promoter strength evaluation protocol was developed using anaerobic fluorescent protein and flow cytometry for C. cellulolyticum. Conclusions In this study, we inactivated the spo0A gene and introduced a heterologous synthetic pathway to manipulate the stress response to heavy carbon load and accumulation of metabolic products. These findings provide new perspectives to enhance the ability of cellulolytic bacteria to produce biofuels and biocommodities with high efficiency and at low cost directly from lignocellulosic biomass.

cellulose catabolism↗
DOE OSTI2026

Application of artificial intelligence methods in the international roughness index prediction of rigid and composite pavements: a systematic review

The International Roughness Index (IRI) is a widely adopted metric for quantifying pavement roughness, directly influencing vehicle safety, ride comfort, and overall roadway performance. In recent years, the use of Machine Learning (ML) models for IRI prediction has gained momentum, with the goal of improving the allocation of maintenance and rehabilitation resources by enabling accurate assessments of pavement conditions. Most prior reviews, however, have concentrated on flexible pavements, leaving a notable gap regarding rigid and composite pavements. To address this gap, the present study conducts a systematic review of Artificial Intelligence (AI) methods applied to IRI prediction for rigid and composite pavements. Literature published between 2004 and 2025 is synthesized to highlight prevailing trends, methodological contributions, and directions for future research. Particular attention is given to the types of models employed, the datasets used for training and validation, and the role of input variables and data-processing strategies. Across the included studies, ensemble learning methods (especially gradient boosting variants such as XGBoost), artificial neural networks, and hybrid architectures frequently achieved high predictive skill, with several models reporting test-set coefficients of determination approaching 0.9–0.96, indicating strong potential for capturing the influence of traffic, pavement structure, and climatic factors. Since these results are obtained from heterogeneous datasets and evaluation protocols, they are interpreted qualitatively rather than as strict cross-study rankings. Analysis of input variables revealed that pavement age and initial IRI were included in 91% (21 of 23) and 78% (18 of 23) of studies, respectively. Climatic variables such as the freezing index appeared in 57% (13 of 23), while traffic-related factors were considered in 65% (15 of 23). The findings underscore the importance of standardized, high-quality datasets, such as those from the Long-Term Pavement Performance (LTPP) program, along with data consistency, model interpretability, computational efficiency, and replicability in enhancing IRI prediction. Future research should focus on incorporating input variable selection techniques to identify the most influential predictors, thereby improving accuracy and robustness. Integrating these approaches with advanced non-linear data-driven models, coupled with robust hyperparameter optimization, holds considerable promise for strengthening the reliability of IRI prediction and supporting resilient pavement management strategies.

42 ENGINEERING↗
DOE OSTI2019

Module OT Laboratory Test Procedure

This document will detail a test procedure, involving bench and emulation testing, for the Module OT device developed for the joint NREL-SNL DOE CEDS project titled "Modular Security Apparatus for Managing Distributed Cryptography for Command & Control Messages on Operational Technology (OT) Networks." The aim of this document is to create the testing and evaluation protocol for the module for lab-level testing; this includes checklists and experiments for information gathering, functional testing, cryptographic implementation, public key infrastructure, key exchange/authentication, encryption, and implementation testing in the emulation environment.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2018

Model Evaluation Report for LNG Dispersion on Fire Dynamics Simulator Version 6.5.3

This report is an assessment of the computational fluid dynamics (CFD) code Fire Dynamics Simulator (FDS), version 6.5.3, using the Model Evaluation Protocol (MEP) for Liquefied Natural Gas (LNG). The MEP consists of model validation and a scientific assessment that encompasses model information and model verification activities. Model validation entails comparison against various field and wind-tunnel trials for LNG and other dense gases with and without obstructions. The results indicate that FDS is generally over-predictive for most of the field scale dense gas releases and cases involving obstructions without requiring a safety factor of 2, however, since there are uncertainties in extrapolating to accident scales a safety factor of 2 (1/2 LFL criteria) may be appropriate. The results of this scientific assessment and prior verification efforts demonstrate the soundness of the numerical techniques and robustness of FDS. The validation results indicate that FDS is suitable for modeling dense gas dispersion with and without obstructions.

03 NATURAL GAS↗
DOE OSTI2022

Model Validation Database for Fires Involving Fuels at Liquefied Natural Gas Facilities

This document provides a description of the model evaluation protocol (MEP) database for fires involving liquefied natural gas (LNG) and processing fuels at LNG facilities. The purpose of the MEP is to provide procedures regarding the assessment of a model's suitability to predict thermal exclusion zones resulting from a fire. The database includes measurements from pool fire, jet fire, and fireball experiments which are provided in a spreadsheet. Users are to enter model results into the spreadsheet which automatically generates statistical performance measures and graphical comparisons with the experimental data. The intent of this document is to provide a description of the experiments and of the procedure required to carry out the validation portion of the MEP. In addition, the statistical performance measures, measurements for comparisons, and parameter variation are provided.

03 NATURAL GAS↗
DOE OSTI2026

Model Validation Database for Fires Involving Fuels at Liquefied Natural Gas Facilities (Version 2)

This document provides a description of the model evaluation protocol (MEP) database for fires involving liquefied natural gas (LNG) and processing fuels at LNG facilities. The purpose of the MEP is to provide procedures regarding the assessment of a model’s suitability to predict thermal exclusion zones resulting from a fire. The database includes measurements from pool fire, jet fire, and fireball experiments which are provided in a spreadsheet. Users are to enter model results into the spreadsheet which automatically generates statistical performance measures and graphical comparisons with the experimental data. The intent of this document is to provide a description of the experiments and of the procedure required to carry out the validation portion of the MEP. In addition, the statistical performance measures, measurements for comparisons, and parameter variation are provided.

03 NATURAL GAS↗
DOE OSTI2026

Taming the Wild West: Assessing Impacts-Relevant Climate Data Products (Final Report)

Impacts-relevant Earth system data refers to observational and ESM data that are downscaled, debiased, validated, and provisioned for use by decision-makers. Impacts-relevant Earth system data is essential for mitigation and adaptation planning across a variety of regions and sectors. A vast number of these data products have emerged in recent years, which has led to confusion among stakeholders and scientists as to the best product to use. With no standard evaluation protocol available for these products, the decision on which product to use was sometimes made because it was pragmatic rather than the best product to use. This project sought to develop foundational capabilities around impacts-relevant data products that would support more informed selection and application of these products. This work has been immensely successful, driving several academic publications and supported the development of a community of practice around impacts-relevant data products.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Evaluating energy justice metrics in early-stage science and technology research using the JUST-R metrics framework

Embedding principles of energy justice throughout all aspects of clean energy technology research and development (R&D) can facilitate a more just energy transition; yet gaps remain in our understanding of how to best integrate energy justice from the earliest R&D stages. The Justice Underpinning Science and Technology Research (JUST-R) metrics framework has been developed to enable early-stage energy researchers to assess and address justice considerations associated with their research, but the impacts of the framework, and others like it, have yet to be evaluated. This study seeks to evaluate the JUST-R metrics framework in terms of its effectiveness and appeal to researchers engaged in early-stage technical R&D using qualitative analyses of documents and workshop transcripts. We find that the metrics framework helps researchers identify problems and potential solutions surrounding the energy justice implications of their work and spurs a change in perspective for researchers, but, simultaneously, there is no evidence of solution follow-through within the evaluation timeframe. Greater institutional support, specialization to research areas, knowledge of energy justice fundamentals, and earlier incorporation of energy justice considerations in research projects arise as factors needed to aid continued use of the framework and pursuit of identified solutions. This evaluation protocol and these findings can serve as a guide for improving other frameworks with similar goals of encouraging sociotechnical engagement in early-stage energy R&D.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2013

First Steps Toward a Quality of Climate Finance Scorecard (QUODA-CF): Creating a Comparative Index to Assess International Climate Finance Contributions

Are climate finance contributor countries, multilateral aid agencies and specialized funds using widely accepted best practices in foreign assistance? How is it possible to measure and compare international climate finance contributions when there are as yet no established metrics or agreed definitions of the quality of climate finance? As a subjective metric, quality can mean different things to different stakeholders, while of donor countries, recipients and institutional actors may place quality across a broad spectrum of objectives. This subjectivity makes the assessment of the quality of climate finance contributions a useful and necessary exercise, but one that has many challenges. This work seeks to enhance the development of common definitions and metrics of the quality of climate finance, to understand what we can about those areas where climate finance information is available and shine a light on the areas where there is a severe dearth of data. Allowing for comparisons of the use of best practices across funding institutions in the climate sector could begin a process of benchmarking performance, fostering learning across institutions and driving improvements when incorporated in internal evaluation protocols of those institutions. In the medium term, this kind of benchmarking and transparency could support fundraising in contributor countries and help build trust with recipient countries. As a feasibility study, this paper attempts to outline the importance of assessing international climate finance contributions while describing the difficulties in arriving at universally agreed measurements and indicators for assessment. In many cases, data are neither readily available nor complete, and there is no consensus on what should be included. A number of indicators are proposed in this study as a starting point with which to analyze voluntary contributions, but in some cases their methodologies are not complete, and further research is required for a robust measurement tool to be created.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2023

Evaluation of preservation protocols for oxygen-sensitive minerals within laminated aquatic sediments

Laminated sediments can record seasonal changes in sedimentation of material from anoxic waters, including minerals of the redox-sensitive elements Fe, Mn, and S that form under varying oxygen levels, mineral saturation conditions, and from microbial metabolism. However, preserving the oxygen-sensitive minerals for identification is challenging when preservation of the spatial arrangement of laminae is also required. In this study, we compare methods for embedding sedimentary materials from anoxic waters and sediments from Brownie Lake, Minnesota, USA for analysis of the speciation for Fe, Mn, and S using synchrotron-based X-ray absorption near edge spectroscopy (XANES). We found that acetone dehydration and resin replacement in a 100% N 2 glovebox successfully preserved the speciation of Fe and Mn minerals within laminated sediments. However, acetone removed some sulfur species from sediments, and epoxies contained sulfur species, which challenged identification of native sulfur species. Results from this study will aid researchers who are interested in spatial analysis of oxygen sensitive sediments, soils, or microbial mats in choosing a preservation method.

58 GEOSCIENCES↗
DOE OSTI2017

A Protocol for Electrochemical Evaluations and State of Charge Diagnostics of a Symmetric Organic Redox Flow Battery

Redox flow batteries have been considered as one of the most promising stationary energy storage solutions for improving the reliability of the power grid and deployment of renewable energy technologies. Among the many flow battery chemistries, nonaqueous flow batteries have the potential to achieve high energy density because of the broad voltage windows of nonaqueous electrolytes. However, significant technical hurdles exist currently limiting nonaqueous flow batteries to demonstrate their full potential, such as low redox concentrations, low operating currents, under-explored battery status monitoring, etc. In an attempt to address these limitations, we report a nonaqueous flow battery based on a highly soluble, redox-active organic nitronyl nitroxide radical compound, 2-phenyl-4,4,5,5-tetramethylimidazoline-1-oxyl-3-oxide (PTIO). This redox materials exhibits an ambipolar electrochemical property with two reversible redox pairs that are moderately separated by a voltage gap of ~1.7 V. Therefore, PTIO can serve as both anolyte and catholyte redox materials to form a symmetric flow battery chemistry, which affords the advantages such as high effective redox concentrations and low irreversible redox material crossover. The PTIO flow battery shows decent electrochemical cyclability under cyclic voltammetry and flow cell conditions; an improved redox concentration of 0.5 M PTIO and operational current density of 20 mA cm-2 were achieved in flow cell tests. Moreover, we show that Fourier transform infrared (FTIR) spectroscopy could measure the PTIO concentrations during the PTIO flow battery cycling and offer reasonably accurate detection of the battery state of charge (SOC) as cross-validated by electron spin resonance measurements. This study suggests FTIR can be used as a reliable online SOC sensor to monitor flow battery status and ensure battery operations stringently in a safe SOC range.

FTIR↗
DOE OSTI2020

dCache – Efficient Message Encoding For Inter-Service Communication in dCache: Evaluation of Existing Serialization Protocols as a Replacement for Java Object Serialization

As a well established, large-scale distributed storage system, dCache is used to manage and serve huge amounts of data collected by high energy physics, astrophysics and photon science experiments. Based on a microservices-like architecture, dCache is built as a modular distributed system, where each component provides a different core functionality. These services communicate by passing serialized messages to each other, a core behavior whose performance properties can consequently affect the entire system.This paper compares and evaluates different data serialization protocols in computer science with the objective of replacing and improving upon Java Object Serialization (JOS), which has increasingly presented itself as no longer being sufficiently performant for encoding messages. The criteria for choosing a new framework are collected, analyzed and formalized. The primary motivation for replacing Java serialization for encoding dCache messages is increasing the general speed of message-passing and thereby reducing the round-trip time for user requests. Emphasis is also placed on schema evolution capabilities and framework usability. Approaches for generalizing (de)serialization speed and size measurements based on data structure complexity are introduced, criteria for measuring documentation, learning curve, maintainability and introduction effort are defined. Finally, several selected serialization protocols are evaluated and compared accordingly, concluding with a recommendation for a suitable JOS replacement.

Morschel, Lea↗
DOE OSTI2021

Achieving Runtime State Verification Assurance in Critical Cyber-Physical Infrastructures

Industrial Cyber-Physical Systems (ICPS) are an essential backbone of national critical infrastructures. They help monitor and control crucial cyber-enabled services such as energy generation. Commonly ICPS monitors the physical process through Supervisory Control and Data Acquisition (SCADA) systems. The SCADA ecosystem takes critical real-time and future system operational decisions based on the runtime state behavior of field sensors. Traditional SCADA systems use legacy and insecure communication protocols such as the Modbus protocol that lack adequate security mechanisms to provide robust runtime state behavior assurance of constrained field sensors. Therefore, constrained field sensors are commonly vulnerable to standard semantic attacks that gradually change the behavior state of infected devices. This paper discusses process integrity assurance techniques necessary to enhance the security of behavior-based protocols such as the Modbus protocol. The Runtime State Verification (RSV) protocol proposed in this paper aims to address semantic attacks in the SCADA ecosystem by integrating behavior-based Mandatory Results Automata (MRA) and a Hyperledger Fabric (HLF) network. The RSV protocol provides high process integrity assurance through enhanced behavior-based MRA suitable for the constrained field devices. A proof of concept of the RSV protocol has been evaluated in an emulated water-tube boiler. Preliminary evaluations of the RSV protocol aimed to measure the efficiency of the proposed protocol by monitoring an Combustion Efficiency (CE) process necessary to preserve optimal combustion, thus minimizing costs and future maintenance of water-tube boilers. We analyze the overall network overhead and latency of the proposed RSV protocol by evaluating the HLF network performance and comparing the proposed RSV protocol with the state-ofart BloSPAI protocol. Through the preliminary evaluations of the proposed RSV protocol, this paper demonstrates that the proposed RSV protocol overcomes the shortcomings and network overhead of the BloSPAI protocol by integrating behavior-based authentication through novel MRAs and HLF networks.

Rivera, Abel Gomez↗