Search NASA⌕ Search

SEARCH · Search NASA

Results for “EVALUATION”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 883 records · Page 49

Preclinical Evaluation of Bioabsorbable Polyglycolic Acid Spacer for Particle Therapy

Purpose: To evaluate the efficacy and safety of a polyglycolic acid (PGA) spacer through physical and animal experiments. Methods and Materials: The spacer was produced with surgical suture material made of PGA, forming a 3-dimensional nonwoven fabric. For evaluation or physical experiments, 150-MeV proton or 320-MeV carbon-ion beams were used to generate 60-mm width of spread-out Bragg peak. For animal experiments, the abdomens of C57BL/6 mice, with or without the inserted PGA spacers, were irradiated with 20 Gy of carbon-ion beam (290 MeV) using the spread-out Bragg peak. Body weight changes over time were scored, and radiation damage to the intestine was investigated using hematoxylin and eosin stain. Blood samples were also evaluated 24 days after the irradiation. Long-term thickness retention and safety were evaluated using crab-eating macaques. Results: No chemical or structural changes after 100 Gy of proton or carbon-ion irradiation were observed in the PGA spacer. Water equivalency of the PGA spacer was equal to the water thickness under wet condition. During 24 days' observation after 20 Gy of carbon-ion irradiation, the body weights of mice with the PGA spacer were relatively unchanged, whereas significant weight loss was observed in those mice without the PGA spacer (P<.05). In mice with the PGA spacer, villus and crypt structure were preserved after irradiation. No inflammatory reactions or liver or renal dysfunctions due to placement of the PGA spacer were observed. In the abdomen of crab-eating macaques, thickness of the PGA spacer was maintained 8 weeks after placement. Conclusions: The absorbable PGA spacer had water-equivalent, bio-compatible, and thickness-retaining properties. Although further evaluation is warranted in a clinical setting, the PGA spacer may be effective to stop proton or carbon-ion beams and to separate normal tissues from the radiation field.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Evaluating lightweight unsupervised online IDS for masquerade attacks in CAN

Vehicular controller area networks (CANs) are susceptible to masquerade attacks by malicious adversaries. In masquerade attacks, adversaries silence a targeted ID and then send malicious frames with forged content at the expected timing of benign frames. As masquerade attacks could seriously harm vehicle functionality and are the stealthiest attacks to detect in CAN, recent work has devoted attention to compare frameworks for detecting masquerade attacks in CAN. However, most existing works report offline evaluations using CAN logs already collected using simulations that do not comply with the domain’s real-time constraints. Here we contribute to advance the state of the art by presenting a comparative evaluation of four different non-deep learning (DL)-based unsupervised online intrusion detection systems (IDS) for masquerade attacks in CAN. Our approach differs from existing comparative evaluations in that we analyze the effect of controlling streaming data conditions in a sliding window setting. In doing so, we use realistic masquerade attacks being replayed from the ROAD dataset. We show that although evaluated IDS are not effective at detecting every attack type, the method that relies on detecting changes in the hierarchical structure of clusters of time series produces the best results at the expense of higher computational overhead. We discuss limitations, open challenges, and how the evaluated methods can be used for practical unsupervised online CAN IDS for masquerade attacks.

Anomaly detection↗

Trustworthiness modeling and evaluation for a nearly autonomous management and control system

The Nearly Autonomous Management and Control (NAMAC) system supports the advanced reactor operation by recommending control actions to operators based on real-time measurements and digital twins (DTs) learning from the knowledge base. To enable the safe and reliable use of autonomous technologies, NAMAC and its recommendations should be trustworthy to operators and regulators at both the design and operation stages. This study proposes a NAMAC trustworthiness modeling and evaluation framework supported by trustworthiness ontologies and evidence-based approaches. The development-time and run-time ontologies are separately constructed and then converted to Bayesian networks to quantitatively evaluate the NAMAC trustworthiness. This evaluation is demonstrated by collecting and characterizing evidence from NAMAC practices, such as the development and assessment of the NAMAC system, data coverage assessment, and the training and optimizations of neural-network-based DTs. Our proposed approach can aggregate various trustworthiness attributes of complex artificial-intelligence-supported systems for safety-critical applications. It also considers the interaction between different DTs and extends beyond the trustworthiness evaluation of a single DT. In conclusion, the evidence-based method enhances the transparency of the trustworthiness modeling and evaluation processes and helps identify uncertainties and subjectivity involved in the processes.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

The role of the anaesthetised guinea-pig in the preclinical cardiac safety evaluation of drug candidate compounds

Despite rigorous preclinical and clinical safety evaluation, adverse cardiac effects remain a leading cause of drug attrition and post-approval drug withdrawal. A number of cardiovascular screens exist within preclinical development. These screens do not, however, provide a thorough cardiac liability profile and, in many cases, are not preventing the progression of high risk compounds. We evaluated the suitability of the anaesthetised guinea-pig for the assessment of drug-induced changes in cardiovascular parameters. Sodium pentobarbitone anaesthetised male guinea-pigs received three 15 minute intravenous infusions of ascending doses of amoxicillin, atenolol, clonidine, dobutamine, dofetilide, flecainide, isoprenaline, levosimendan, milrinone, moxifloxacin, nifedipine, paracetamol, verapamil or vehicle, followed by a 30 minute washout. Dose levels were targeted to cover clinical exposure and above, with plasma samples obtained to evaluate effect/exposure relationships. Arterial blood pressure, heart rate, contractility function (left ventricular dP/dt{sub max} and QA interval) and lead II electrocardiogram were recorded throughout. In general, the expected reference compound induced effects on haemodynamic, contractility and electrocardiographic parameters were detected confirming that all three endpoints can be measured accurately and simultaneously in one small animal. Plasma exposures obtained were within, or close to the expected clinical range of therapeutic plasma levels. Concentration–effect curves were produced which allowed a more complete understanding of the margins for effects at different plasma exposures. This single in vivo screen provides a significant amount of information pertaining to the cardiovascular risk of drug candidates, ultimately strengthening strategies addressing cardiovascular-mediated compound attrition and drug withdrawal. -- Highlights: ► Evaluation of the anaesthetised guinea-pig to determine cardiac liability. ► Haemodynamic, contractility, ECG parameters and plasma exposure all measurable. ► Single small animal model offering extensive evaluation of a drug's CV risk. ► Potential to strengthen drug discovery cardiovascular strategy. ► Potential to halt progression of drugs with CV liability, reducing drug attrition.

60 APPLIED LIFE SCIENCES↗

Quantitative evaluation of waste prevention on the level of small and medium sized enterprises (SMEs)

Waste prevention is a principle means of achieving the goals of waste management and a key element for developing sustainable economies. Small and medium sized enterprises (SMEs) contribute substantially to environmental degradation, often not even being aware of their environmental effects. Therefore, several initiatives have been launched in Austria aimed at supporting waste prevention measures on the level of SMEs. To promote the most efficient projects, they have to be evaluated with respect to their contribution to the goals of waste management. It is the aim of this paper to develop a methodology for evaluating waste prevention measures in SMEs based on their goal orientation. At first, conceptual problems of defining and delineating waste prevention activities are briefly discussed. Then an approach to evaluate waste prevention activities with respect to their environmental performance is presented and benchmarks which allow for an efficient use of the available funds are developed. Finally the evaluation method is applied to a number of former projects and the calculated results are analysed with respect to shortcomings and limitations of the model. It is found that the developed methodology can provide a tool for a more objective and comprehensible evaluation of waste prevention measures.

54 ENVIRONMENTAL SCIENCES↗

Multi-criteria evaluation in strategic environmental assessment for waste management plan, a case study: The city of Belgrade

Highlights: • The paper deals with the specific method of multi-criteria evaluation applied in drafting the SEA for the Belgrade WMP. • MCE of the planning solutions, assessed according to 37 objectives of the SEA and four sets of criteria, was presented in the matrix form. • The results are presented in the form of graphs so as to be easily comprehensible to all the participants in the decision-making process. • The results represent concrete contribution proven in practice. - Abstract: Strategic Environmental Assessment (SEA) is one of the key instruments for implementing sustainable development strategies in planning in general; in addition to being used in sectoral planning, it can also be used in other areas such as waste management planning. SEA in waste management planning has become a tool for considering the benefits and consequences of the proposed changes in space, also taking into account the capacity of space to sustain the implementation of the planned activities. In order to envisage both the positive and negative implications of a waste management plan for the elements of sustainable development, an adequate methodological approach to evaluating the potential impacts must be adopted and the evaluation results presented in a simple and clear way, so as to allow planners to make relevant decisions as a precondition for the sustainability of the activities planned in the waste management sector. This paper examines the multi-criteria evaluation method for carrying out an SEA for the Waste Management Plan for the city of Belgrade (BWMP). The method was applied to the evaluation of the impacts of the activities planned in the waste management sector on the basis of the environmental and socioeconomic indicators of sustainability, taking into consideration the intensity, spatial extent, probability and frequency of impact, by means of a specific planning approach and simple and clear presentation of the obtained results.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Evaluation of CMIP6 GCMs Over the CONUS for Downscaling Studies

Despite the necessity of Global Climate Models (GCMs) sub-selection in downscaling studies, an objective approach for their selection is currently lacking. Building on the previously established concepts in GCMs evaluation frameworks, we develop a weighted averaging technique to remove the redundancy in the evaluation criteria and rank 37 GCMs from the sixth phase of the Coupled Models Intercomparison Project over the contiguous United States. GCMs are rated based on their average performance across 66 evaluation measures in the historical period (1981–2014) after each metric is weighted between zero and one, depending on its uniqueness. The robustness of the outcome is tested by repeating the process with the empirical orthogonal function analysis in which each GCM is ranked based on its sum of distances from the reference in the principal component space. The two methodologies work in contrasting ways to remove the metrics redundancy but eventually develop similar GCMs rankings. A disparity in GCMs' behavior related to their sensitivity to the size of the evaluation suite is observed, highlighting the need for comprehensive multi-variable GCMs evaluation at varying timescales for determining their skillfulness over a region. The sub-selection goal is to use a representative set of skillful models over the region of interest without substantial overlap in their future climate responses and modeling errors in representing historical climate. Additional analyses of GCMs' independence and spread in their future projections provide the necessary information to objectively select GCMs while keeping all aspects of necessity in view.

54 ENVIRONMENTAL SCIENCES↗

Informing Robust Functional Relationship Benchmarks: An Evaluation of the Temperature Sensitivity of Ecosystem Respiration Across the Arctic-Boreal Region

During land model development, simulated carbon dynamics are often benchmarked against observational data sets to evaluate model performance. Functional relationship benchmarks are the relationship between a driving variable (e.g., temperature) and a response variable (e.g., ecosystem respiration) and are a promising tool for assessing model performance by evaluating modeled sensitivities to changing environmental conditions. However, observed functional relationships can be influenced by choices made during data collection and throughout the benchmarking process, impacting the inferred skill of land models. To avoid misrepresenting a model's true performance, it is necessary to systematically evaluate best practices when constructing functional relationship benchmarks. We developed a set of guidelines for constructing functional relationship benchmarks, considering the choice of data set, number of daily observations, temporal extent, and temporal resolution across Alaska and Canada over a 20-year period from 2001 to 2020. The temperature sensitivity of ecosystem respiration from observations, evaluated through an apparent Q 10 , is highly variable both spatially and as a result of the data processing approach applied in the benchmark formation. When benchmarking 13 models from the Warming Permafrost Model Intercomparison Project (WrPMIP), the range in inferred model skill is substantially impacted by the choices applied in constructing functional relationship benchmarks. The inferred performance of a given model is most sensitive to the number of daily observations and temporal extent, followed by choice of benchmark data set and temporal averaging. Results from this analysis can guide the development of consistent and robust functional relationships for future model evaluation studies.

Poe, Jeralyn [Northern Arizona University, Flagsta↗

Evaluating the 239 Pu prompt fission neutron spectrum induced by thermal to 30 MeV neutrons

We present a new evaluation of the 239 Pu prompt fission neutron spectrum (PFNS) induced by thermal to 30 MeV neutrons. Compared to the ENDF/B-VII.1 evaluation, this one includes recently published experimental data as well as an improved and extended model description to predict PFNS. For instance, the pre-equilibrium neutron emission component to the PFNS is considered and the incident energy dependence of model parameters is parametrized more realistically. Experimental and model parameter uncertainties and covariances are estimated in detail. Also, evaluated covariances are provided between all PFNS at different incident neutron energies. In conclusion, selected evaluation results and first benchmark calculations using this evaluation are briefly discussed.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Evaluation of the 235 U resonance parameters to fit the standard recommended values

A great deal of effort has been dedicated to the revision of the standard values in connection with the neutron interaction for some actinides. While standard data compilation are available for decades nuclear data evaluations included in existing nuclear data libraries (ENDF, JEFF, JENDL, etc.) do not follow the standard recommended values. Indeed, the majority of evaluations for major actinides do not conform to the standards whatsoever. In particular, for the n + 235 U interaction the only value in agreement with the standard is the thermal fission cross section. We performed a resonance re-evaluation of the n + 235 U interaction in order to address the issues regarding standard values in the energy range from 10-5 eV to 2250 eV. Recently, 235 U fission cross-section measurements have been performed at the CERN Neutron Time-o-Flight facility (TOF), known as n_TOF, in the energy range from 0.7 eV to 10 keV. The data were normalized according to the recommended standard of the fission integral in the energy range 7.8 eV to 11 eV. As a result, the n_TOF averaged fission cross sections above 100 eV are in good agreement with the standard recommended values. The n_TOF data were included in the 235 U resonance analysis that was performed with the code SAMMY. In addition to the average standard values related to the fission cross section, standard thermal values for fission, capture, and elastic cross sections were also included in the evaluation. Our paper presents the procedure used for re-evaluating the 235 U resonance parameters including the recommended standard values as well as new cross section measurements.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Evaluation of high temperature pressure sensors

It is becoming more important to measure the pressure in high temperature environments in many industrial fields. However, there is no appropriate evaluation system and compensation method for high temperature pressure sensors since most pressure standards have been established at room temperature. In order to evaluate the high temperature pressure sensors used in harsh environments, such as high temperatures above 250 deg. C, a specialized system has been constructed and evaluated in this study. The pressure standard established at room temperature is connected to a high temperature pressure sensor through a chiller. The sensor can be evaluated in conditions of changing standard pressures at constant temperatures and of changing temperatures at constant pressures. According to the evaluation conditions, two compensation methods are proposed to eliminate deviation due to sensitivity changes and nonlinear behaviors except thermal hysteresis.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Coordinated activities on evaluation of collisional data for fusion applications

It is the role of the Atomic and Molecular Data Unit of the International Atomic Energy Agency to review progress in the production, compilation and evaluation of atomic, molecular and plasma-surface interaction (AM/PSI) data for the fusion program and to support the development of internationally recommended libraries of AM/PSI data for fusion. In response to increasing requests from the fusion community the Unit has increased its effort to promote the assessment of data quality by organizing a series of meetings on the relevant issues: 1) Error propagation and sensitivity analysis, 2) Current status of evaluated databases, 3) Uncertainty estimates of theoretical data, 4) Experimental data evaluation, 5) Data evaluation methods and semi-empirical fits and 6) Establishment of an evaluators' network. The discussions and conclusions are summarized here.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Evaluation method of beam instability in laser ion source using solenoid

In a laser ion source using solenoid field confinement, it is known that an ion beam becomes unstable in the certain range of a magnetic field. Although it is essential to quantify the instability when discussing the unstable region of the beam, it is difficult to evaluate the beam instability by peak current or the amount of charge because an irregular change of temporal profile occurs in addition to the shot-by-shot fluctuation of amplitude. In this study, I propose the most appropriate method to evaluate the beam instability using the difference from an average waveform. The validity of the new method was evaluated by comparing three evaluation methods (variation of maximum value, variation of integral of waveforms, and the proposed evaluation method) with the experimentally obtained waveforms with the stable and unstable regions of a solenoid field. The proposed method was verified to best represent the beam instability by laser-induced plasma.

43 PARTICLE ACCELERATORS↗

Economic evaluation of distribution system smart grid investments

This paper investigates economic benefits of smart grid automation investments. A system consisting of 7 substations and 14 feeders is used in the evaluation. Here benefits that can be quantified in terms of dollar savings are considered, termed “hard dollar” benefits. Smart Grid investment evaluations to be considered include investments in improved efficiency, more cost effective use of existing system capacity with automated switches, and coordinated control of capacitor banks and voltage regulators. These Smart Grid evaluations are sequentially ordered, resulting in a series of incremental hard dollar benefits. Hard dollar benefits come from improved efficiency, delaying large capital equipment investments, shortened storm restoration times, and reduced customer energy use. Analyses used in the evaluation involve hourly power flow analysis over multiple years and Monte Carlo simulations of switching operations during storms using a reconfiguration for restoration algorithm. The economic analysis uses the time varying value of the Locational Marginal Price. Algorithms used include reconfiguration for restoration involving either manual or automated switches and coordinated control involving two modes of control. Field validations of phase balancing and capacitor design results are presented. The evaluation shows that investments in automation can improve performance while at the same time lowering costs.

25 ENERGY STORAGE↗

A New Approach to Evaluate and Reduce Uncertainty of Model-Based Biodiversity Projections for Conservation Policy Formulation

Biodiversity projections with uncertainty estimates under different climate, land-use, and policy scenarios are essential to setting and achieving international targets to mitigate biodiversity loss. Evaluating and improving biodiversity predictions to better inform policy decisions remains a central conservation goal and challenge. A comprehensive strategy to evaluate and reduce uncertainty of model outputs against observed measurements and multiple models would help to produce more robust biodiversity predictions. We propose an approach that integrates biodiversity models and emerging remote sensing and in-situ data streams to evaluate and reduce uncertainty with the goal of improving policy-relevant biodiversity predictions. In this work, we describe a multivariate approach to directly and indirectly evaluate and constrain model uncertainty, demonstrate a proof of concept of this approach, embed the concept within the broader context of model evaluation and scenario analysis for conservation policy, and highlight lessons from other modeling communities.

essential biodiversity variables↗

Crash Risks Evaluation of Urban Expressways: A Case Study in Shanghai

We report that proactive traffic safety management systems can reduce crashes by identifying crash precursors, evaluating real-time crash risks, and implementing suitable interventions. The basic prerequisite for developing such a system is to propose a reliable crash risk evaluation model that takes real-time traffic flow data as input. Previous studies have primarily focused on real-time crash prediction using some statistical or machine-learning methods. However, further quantitative evaluation and classification of crash risks have been ignored. In this study, we conduct a systematic crash risk evaluation workflow, including crash risk prediction, crash risk quantification, and crash risk classification. Specifically, the crash risk prediction using an extended logit model is proposed, from which CAS, CSD, UAS, DAS, DTV are identified to be contributing factors of crash risks. Then a crash risk quantification model based on the parameter evaluation of the extended logit model is developed. The crash risks of urban expressways and their spatial-temporal evolution trends are quantified. Finally, the crash risks are classified into high crash risk level, moderate crash risk level, and low crash risk level by the k-means cluster algorithm. Then the threshold boundaries of different crash risk levels are determined. The research results provide a proactive guidance for traffic safety management of urban expressways.

33 ADVANCED PROPULSION SYSTEMS↗

Microscratch testing method for systematic evaluation of the adhesion of atomic layer deposited thin films on silicon

The scratch test method is widely used for adhesion evaluation of thin films and coatings. Usual critical load criteria designed for scratch testing of coatings were not applicable to thin atomic layer deposition (ALD) films on silicon wafers. Thus, the bases for critical load evaluation were established and the critical loads suitable for ALD coating adhesion evaluation on silicon wafers were determined in this paper as L{sub CSi1}, L{sub CSi2}, L{sub CALD1}, and L{sub CALD2}, representing the failure points of the silicon substrate and the coating delamination points of the ALD coating. The adhesion performance of the ALD Al{sub 2}O{sub 3}, TiO{sub 2}, TiN, and TaCN+Ru coatings with a thickness range between 20 and 600 nm and deposition temperature between 30 and 410 °C on silicon wafers was investigated. In addition, the impact of the annealing process after deposition on adhesion was evaluated for selected cases. The tests carried out using scratch and Scotch tape test showed that the coating deposition and annealing temperature, thickness of the coating, and surface pretreatments of the Si wafer had an impact on the adhesion performance of the ALD coatings on the silicon wafer. There was also an improved load carrying capacity due to Al{sub 2}O{sub 3}, the magnitude of which depended on the coating thickness and the deposition temperature. The tape tests were carried out for selected coatings as a comparison. The results show that the scratch test is a useful and applicable tool for adhesion evaluation of ALD coatings, even when carried out for thin (20 nm thick) coatings.

36 MATERIALS SCIENCE↗

Evaluation of the potential utility of flat panel CT for quantifying relative contrast enhancement

Purpose: Certain directed oncologic therapies seek to take advantage of the fact that tumors are typically more susceptible to directed therapeutic agents than normal tissue owing to their extensive networks of poorly formed, leaky vasculature. If differences between the vascularity of normal and tumor tissues could be quantified, patients could be selected for or excluded from directed treatments on the basis of this difference. However, angiographic imaging techniques such as digital subtraction angiography (DSA) yield two-dimensional data that may be inadequate for this task. As a first step, the authors evaluated the feasibility of using a commercial implementation of flat panel computed tomography (FPCT) to quantify differences in enhancement of a simulated tumor compared with normal tissue based on differences in CT number measured in precontrast and postcontrast scans. Methods: To evaluate the FPCT scanner studied, the authors scanned several phantoms containing simulated normal and tumor tissues. In the first experiment, the authors used an anthropomorphic phantom containing inclusions representing normal, tumor, and bone tissue to evaluate the constancy of CT numbers in scans repeated at clinically relevant intervals of 1 and 3 min. The authors then scanned gelatin phantoms containing dilutions of iodinated contrast to evaluate the accuracy of relative contrast enhancement measurements for a clinical FPCT system. Data were analyzed using widely available software. Results: CT numbers measured in identical locations were constant over both scan intervals evaluated. Measured relative contrast enhancement values were accurate compared with known relative contrast enhancement values. Care must be taken to avoid artifacts in reconstructed images when placing regions of interest. Conclusions: Despite its limitations, FPCT in the interventional laboratory can be used to quantify relative contrast enhancement in phantoms. This is accomplished by measuring CT number in simulated tumor and normal tissue on precontrast and postcontrast scans. This information opens the door for refinement of technique in an effort to use such a technique to plan directed therapies.

60 APPLIED LIFE SCIENCES↗