Search NASA⌕ Search

SEARCH · Search NASA

Results for “quantitative evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
NASA NTRS1992

Quantitative Evaluation Of Teleoperator Performance

Report describes experiments on remote manual control of robotic manipulator. Experiments conducted to evaluate quantitatively relative effectiveness of several control modes: various combinations of position control, rate control, remote compliance, and feedback from force and torque sensors. Tasks evaluated: removing thermal blanket, unbolting electrical panel, and handling bundles of electrical wires and electrical connectors on simulated solar Max satellite by means of remotely controlled robot in teleoperation laboratory.

Das, Hari↗
NASA NTRS1975

On the quantitative evaluation of edge detection schemes and their comparison with human performance

A technique for the quantitative evaluation of edge detection schemes is presented. It is used to assess the performance of three such schemes using a specially-generated set of images containing noise. The ability of human subjects to distinguish the edges in the presence of noise is also measured and compared with that of the edge detection schemes. The edge detection schemes are used on a high-resolution satellite photograph with varying degrees of noise added in order to relate the quantitative comparison to real-life imagery.

Fram, J. R.↗
DOE OSTI2020

Quantitative Evaluation of Reliability Improvement: Case Study on a Self-healing Distribution System

In this work, we develop a methodology and tool to quantitatively evaluate the reliability of a self-healing system that considers practical distribution system features such as the distributed energy resources, microgrids, and service restoration strategies. Also, this paper addresses various practical issues when being applied to an actual Duke Energy distribution system, including the design of feasible and practical service restoration strategies that are used to identify the customer interruptions after a fault, and the incorporation of the utility’s historical reliability indices that are used to calibrate the failure rate and repair time of distribution system components such as overhead lines and underground cables. This case study demonstrates the effectiveness of the proposed method.

Dong, Jiaojiao↗
DOE OSTI2020

Quantitative Evaluation of Reliability Improvement: Case Study on a Self-healing Distribution System

In this work, we develop a methodology and tool to quantitatively evaluate the reliability of a self-healing system that considers practical distribution system features such as the distributed energy resources, microgrids, and service restoration strategies. Also, this paper addresses various practical issues when being applied to an actual Duke Energy distribution system, including the design of feasible and practical service restoration strategies that are used to identify the customer interruptions after a fault, and the incorporation of the utility's historical reliability indices that are used to calibrate the failure rate and repair time of distribution system components such as overhead lines and underground cables. This case study demonstrates the effectiveness of the proposed method.

Dong, Jiaojiao↗
DOE OSTI2021

Quantitative Evaluation of Autonomous Driving in CARLA

There has been a great deal of recent advancements in end-to-end imitation and reinforcement learning for self-driving vehicles. Despite this, there is a severe lack of standardized metrics for evaluating the performance of autonomous self-driving agents. Existing metrics are generally lacking in their ability to capture a wide range of driving behaviors and compare the severity of different failure cases. In this work, we introduce the Quantitative Evaluation for Driving metric, or QED, which assigns a quantitative score from 0-100 that captures the quality of driving for any driving agent. Our QED metric assesses different aspects of driving behavior including the ability to stay in the center of the lane, avoid weaving and erratic behavior, follow the speed limit, and avoid collisions, and it can be used under a wide range of driving scenarios. To show the effectiveness of our QED metric, we compare the scores generated by QED against scores assigned by human evaluators on a total of 30 different drivers and 6 different towns in the CARLA driving simulator. In ``easy'' evaluation scenarios, where it is relatively straightforward to distinguish better drivers from worse drivers, QED attains an average Pearson correlation of 0.96 and average Spearman correlation of 0.97 when compared against human evaluators. In ``hard'' evaluation scenarios, where it is far more ambiguous how to rank/score different types of bad driving behavior, QED attains an average Pearson correlation of 0.82 and average Spearman correlation of 0.75 when compared against human evaluators, which are both slighter higher than when we compare human evaluators against each other. While QED may not capture every characteristic that defines good driving, we consider it an important foundation for reproducibility and standardization in the community.

Gao, Shang↗
DOE OSTI2024

A Frequency Domain Methodology for Quantitative Evaluation of Diffuse Wavefield With Applications to Seismic Imaging

Abstract Ambient Noise Imaging (ANI) of subsurface structures relies on seismic interferometry of diffuse seismic wavefields. However, the lack of effective methods to quantify and identify highly diffuse waves hampers applications of ANI, particularly in evaluating seismic attenuation and monitoring structural changes with high temporal resolution. Conventional ANI approaches require data normalization, which effectively suppresses the non‐diffuse component with large amplitude but also results in significant loss of amplitude and phase information in the continuous seismic records. In this study, we propose a frequency domain method to quantitatively evaluate the degree of diffuseness of seismic wavefields by analyzing their statistical characteristics of modal amplitudes for stationarity and randomness. Tests on synthetic waveform and field nodal records show that the proposed method can effectively distinguish between diffuse and non‐diffuse waveforms for either single‐ or three‐component data. As an application, we identify a 60‐s‐long diffuse coda of a local M 2.2 earthquake recorded by a dense nodal array on the San Jacinto Fault Zone, and successfully extract high‐quality dispersion curve andQ‐value without performing data normalization. These results are consistent with those obtained by conventional methods that assess the correlation between coherency and the Green's function, and by modeling ballistic waves generated by road traffic. Our proposed method can advance the imaging of subsurface velocity and attenuation structures as well as monitoring temporal changes for scientific studies and engineering applications.

Geochemistry & Geophysics↗
DOE OSTI2022

Quantitative evaluations of subtropical westerly jet simulations over East Asia based on multiple CMIP5 and CMIP6 GCMs

As a salient feature of the Asian monsoon system, the East Asian subtropical westerly jet (EASWJ) exerts significant impacts on weather and climate changes in China and even throughout East Asia. In this paper, we applied a new self-adaptive algorithm to detect the EASWJ, identify its boundaries, and then represent its characteristics by defining three indices: the intensity index, meridional displacement index, and width index. Compared to the reanalysis data, we carried out a comprehensive, objective, and quantitative EASWJ evaluation using historical experiments from multiple global climate models (GCMs) in the Coupled Model Intercomparison Project Phases 5 and 6 (CMIP5 and CMIP6). The results show that the multimodel ensemble mean (MME) of both CMIP5 and CMIP6 can simulate the characteristics of winter EASWJ well. While for the other three seasons, the MME of both phase models underestimate the 200-hPa zonal wind (U200) strength in the jet coverage area and overestimate the U200 outside the jet area, such simulation results weaken the meridional shear of the wind field. The EASWJ simulations from the CMIP5 GCMs had no consistent intensity or location characteristic tendencies, and most CMIP5 GCMs tended to simulate relatively wide-coverage jets. In contrast, most CMIP6 GCMs are inclined to simulate significantly weaker, wider, and more-northward jets. Compared to the predecessors in CMIP5, about half of CMIP6 GCMs significantly minimized the jet intensity bias, but remarkable errors were still observed in their jet location and coverage representations. Furthermore, the comparative analysis performed by classifying models based on their evaluated simulation results suggested that the simulated performance of the meridional temperature gradient was important for capturing the EASWJ characteristics. Further in-depth study of the causes of model differences is warranted to improve simulation results.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS1989

Infrared radiometric technique for rapid quantitative evaluation of heat flux distribution over large areas

This paper describes a novel approach for rapid, quantitative measurement of spatially distributed heat flux incident on a plane. The technique utilizes the spatial temperature distribution on an opaque thin film at the location of interest, as measured by an imaging infrared radiometer. Knowledge of film radiative properties, plus quantitative estimates of convection cooling permit the steady state energy balance at any location on the film sheet to be solved for the incident heat flux. Absolute accuracies on the order of 10-15 percent have been obtained in tests performed in air. The method is particularly useful for evaluation of spatial heat flux uniformity from distributed heat sources over large areas. It has recently been used in several applications at the Jet Propulsion Laboratory, including flux uniformity measurements from large distributed quartz lamp arrays used during thermal vacuum testing of several spacecraft components, and flux mapping of a low power NdYg laser beam.

Glazer, Stuart↗
DOE OSTI2022

Quantitative evaluation of common cause failures in high safety-significant safety-related digital instrumentation and control systems in nuclear power plants

Digital instrumentation and control (DI&C) systems at nuclear power plants (NPPs) have many advantages over analog systems. They are proven to be more reliable, cheaper, and easier to maintain given obsolescence of analog components. However, they also pose new engineering and technical challenges, such as possibility of common cause failures (CCFs) unique to digital systems. Here this paper proposes a Platform for Risk Assessment of DI&C (PRADIC) that is developed by Idaho National Laboratory (INL). A methodology for evaluation of software CCFs in high safety-significant safety-related DI&C systems of NPPs was developed as part of the framework. The framework integrates three stages of a typical risk assessment—qualitative hazard analysis and quantitative reliability and consequence analyses. The quantified risks compared with respective acceptance criteria provide valuable insights for system architecture alternatives allowing design optimization in terms of risk reduction and cost savings. A comprehensive case study performed to demonstrate the framework's capabilities is documented here in this paper. Results show that the PRADIC is a powerful tool capable to identify potential digital-based CCFs, estimate their probabilities, and evaluate their impacts on system and plant safety.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2024

Bisphenol A degradation by manganese oxides at circumneutral pH: Quantitative evaluation of dissolved Mn(III) species with pyrophosphate

Although trivalent manganese (Mn(III)) species have been recognized as crucial intermediates in the degradation of organic contaminants by Mn oxides, quantitative research on their specific roles remains scarce. Here, our study investigated the degradation processes of an organic pollutant, Bisphenol A (BPA), by dissolved Mn(III) and Mn(III)-bearing oxides, and elucidated the differences of the underlying mechanisms and reaction pathways between several Mn oxides and dissolved Mn(III). Our results indicated that BPA degradation rates with Mn(III)-bearing oxides alone follow the order: δ-MnO 2 >> γ-MnOOH > Mn 3 O 4 . Adding pyrophosphate (PP) significantly enhanced BPA degradation by promoting the formation of Mn(III)-PP complexes and exposing more reactive sites, achieved through destabilizing the crystal structure and mitigating of Mn(II) readsorption, particularly in γ-MnOOH and Mn 3 O 4 . Our kinetic model revealed that heterogeneous degradation by Mn oxides is the predominant reaction pathway, accounting for 61.4 %, 87.8 %, and 73.8 % of the total degraded BPA for δ-MnO 2 , γ-MnOOH, and Mn 3 O 4 , respectively, even in the presence of significant amount of dissolved Mn(III) intermediates due to high PP concentrations. These results offer mechanistic details on BPA degradation by Mn oxides and the influence of ligand concentration, providing helpful insights for optimizing degradation strategies of organic pollutants.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2026

Quantitative Evaluation of Potassium Iodide Implementation Strategies for Emergency Preparedness and Response

This study evaluates the effectiveness of potassium iodide (KI) distribution strategies in mitigating exposure to radioiodine during severe nuclear power plant accidents. This analysis quantitatively compares various KI distribution methods (pre-distributed versus stockpiles), including scenarios with and without KI administration. The results indicate that differences in distribution strategies impact the projected thyroid dose by at least an order of magnitude. The results also indicate that the timing of KI administration is critical, as expected. For scenarios involving delayed releases of significant quantities of radionuclides, evacuation is the most effective protection strategy regardless of KI distribution method. For scenarios involving rapid releases, retrieving KI from stockpiles can have a detrimental effect. Pre-distributed KI is potentially the most effective approach when used as a supplement to evacuation and sheltering. However, these model results are based on idealized conditions for KI distribution and administration; the actual benefits of KI prophylaxis are likely to be less than estimated in this report due to many variables. The results highlight the importance of considering the cost and rigor of different distribution programs and public compliance with emergency instructions. This report includes suggested research to explore KI distribution plans for advanced reactors.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

Nonlinear Impact-Echo Test for Quantitative Evaluation of ASR Damage in Concrete

Nonlinear acoustic methods demonstrate high sensitivity for concrete damage evaluation. Among these methods, nonlinear resonance acoustic methods have been widely used in laboratory tests on small scale test samples. In this study, a nonlinear impact-echo (IE) method for concrete damage evaluation was introduced, in which the IE frequency shift was measured at different impact force levels. The nonlinear IE test and the nonlinear impact resonance acoustic spectroscopy (NIRAS) test share similarities in the experimental setup and analysis method. However, the nonlinear IE test excites a local thickness resonance mode of a member instead of the global resonance vibration. Therefore, the analyzed mode is unaffected by member boundary conditions and is applicable to large concrete structural members. To identify the fundamental IE frequencies, multiple impacts were applied along the members. Once the fundamental IE frequencies were determined, the effectiveness of the nonlinear IE method was evaluated by testing seven concrete beam specimens with varying levels of alkali-silica reaction (ASR) damage. In conclusion, the nonlinear IE test demonstrates high sensitivity to concrete damage and allows for quantitative assessment of the damage state of concrete without a baseline measurement.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Quantitative Evaluation of CO 2 Storage Potential in the Offshore Atlantic Lower Cretaceous Strata, Southeastern United States

The geological storage of CO 2 in the Earth’s subsurface has the potential to significantly offset greenhouse gas emissions for safe, economical, and acceptable public use. Due to legal advantages and vast resource capacity, offshore CO 2 storage provides an attractive alternative to onshore options. Although offshore Lower Cretaceous reservoirs have a vast expected storage capacity, there is a limited quantitative assessment of the offshore storage resource in the southeastern United States. This work is part of the Southeast Offshore Storage Resource Assessment (SOSRA) project, which presents a high-quality potential geological repository for CO 2 in the Mid- and South Atlantic Planning Areas. This is the first comprehensive investigation and quantitative assessment of CO 2 storage potential for the Lower Cretaceous section of the outer continental shelf that includes the Southeast Georgia Embayment and most of the Blake Plateau. An interpretation of 200,000 km of legacy industrial 2D seismic reflection profiles and geophysical well logs (i.e., TRANSCO 1005-1-1, COST GE-1, and EXXON 564-1) were utilized to create structure and thickness maps for the potential reservoirs and seals. We identified and assessed three target reservoirs isolated by seals based on their effective porosity values. The CO 2 storage capacity of these reservoirs was theoretically calculated using the DOE-NETL equation for saline formations. The prospective storage resources are estimated between 450 and 4700 Mt of CO 2 , with an offshore geological efficiency factor of dolomite between 2% and 3.6% at the formation scale.

03 NATURAL GAS↗
NASA NTRS2011

Quantitative Evaluation of MODIS Fire Radiative Power Measurement for Global Smoke Emissions Assessment

Satellite remote sensing is providing us tremendous opportunities to measure the fire radiative energy (FRE) release rate or power (FRP) from open biomass burning, which affects many vegetated regions of the world on a seasonal basis. Knowledge of the biomass burning characteristics and emission source strengths of different (particulate and gaseous) smoke constituents is one of the principal ingredients upon which the assessment, modeling, and forecasting of their distribution and impacts depend. This knowledge can be gained through accurate measurement of FRP, which has been shown to have a direct relationship with the rates of biomass consumption and emissions of major smoke constituents. Over the last decade or so, FRP has been routinely measured from space by both the MODIS sensors aboard the polar orbiting Terra and Aqua satellites, and the SEVIRI sensor aboard the Meteosat Second Generation (MSG) geostationary satellite. During the last few years, FRP has steadily gained increasing recognition as an important parameter for facilitating the development of various scientific studies and applications relating to the quantitative characterization of biomass burning and their emissions. To establish the scientific integrity of the FRP as a stable quantity that can be measured consistently across a variety of sensors and platforms, with the potential of being utilized to develop a unified long-term climate data record of fire activity and impacts, it needs to be thoroughly evaluated, calibrated, and validated. Therefore, we are conducting a detailed analysis of the FRP products from MODIS to evaluate the uncertainties associated with them, such as those due to the effects of satellite variable observation geometry and other factors, in order to establish their error budget for use in diverse scientific research and applications. In this presentation, we will show recent results of the MODIS FRP uncertainty analysis and error mitigation solutions, and demonstrate their implications for biomass burning emissions assessment.

Ichoku, Charles↗