Search NASA⌕ Search

SEARCH · Search NASA

Results for “Performance Evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Performance Evaluation for Transactive Energy Systems Using Double-Auction Market

Transactive coordination and control has recently emerged as a new approach to facilitate large-scale integration of various distributed energy resources into power distribution systems. Various transactive approaches are being developed for problems in power systems involving self-interested asset owners with privacy concerns. However, there has been very limited work on evaluating and comparing their performance. In this paper, a systematic performance evaluation procedure is presented for the comparison among different approaches in terms of their performance under practical conditions such as information uncertainties, individual rationality, network effects, and so on. This procedure is applied to evaluate and compare two existing transactive energy systems using double-auction market, where both quantitative and qualitative performance metrics are proposed. As a result, the detailed case studies also illustrate the performance limitations of existing double-auction-based transactive approaches, and provide useful insights on the necessary design improvements for practical applications.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Seasonal performance evaluation of zero-superheat active refrigerant charge control for variable-speed heat pumps

Heat pumps account for a significant portion of electricity consumption in buildings, making their energy efficiency a critical area of research. Control optimization is recognized as an effective approach for enhancing the efficiency of building HVAC systems. Specifically, since the efficiency of heat pumps increases with reduced superheat and the optimal refrigerant charge level varies with operating conditions, zero-superheat active charge control is a promising strategy to maximize the system’s COP. However, due to its complexity, this control strategy remains in the research phase and has only been tested under limited operating conditions. This paper proposes a methodology to evaluate the seasonal performance improvement of zero-superheat active charge control across a full range of heating conditions in buildings. The methodology includes the development of an optimal controller that utilizes an accumulator to store excess refrigerant and manages the active charge level at zero superheat through subcooling control, as well as the creation of a detailed physics-based heat pump model. Targeted a 3-ton variable-speed heat pump with R410A refrigerant, we selected ten U.S. cities representing different climate regions for seasonal performance evaluation. Our simulations indicate that, depending on the climate conditions, the optimal control strategy could achieve energy savings ranging from 5.8 % to 8.0 % over the entire heating season. These results suggest that zero-superheat active charge control, combined with coordinated compressor and fan speeds, could substantially improve the energy efficiency of heat pump systems while maintaining the required heating capacity.

Guo, Fangzhou↗

Performance Evaluation of Next-Generation Grid Automation and Controls with High PV Penetration

This paper presents a hardware-in-the-loop (BIL) simulation to evaluate the performance of an advanced grid automation architecture, referred to as data-enhanced hierarchical control (DEHC), in achieving voltage regulation and conservation voltage reduction (CVR) in distribution networks with very high photovoltaic (PV) generation. This architecture comprises an advanced distribution management system (ADMS), a distributed energy resource management system (DERMS), and grid-edge devices working synergistically to provide the grid benefits. The HIL setup used for the evaluation includes ADMS, DERMS, and grid-edge devices. The DEHC performance is evaluated in two representative scenarios considering loose and tight constraints of the power factor at the substation. The results show that the DEHC architecture is effective in achieving voltage regulation and CVR and thus enables the grid integration of high levels of PV generation.

ADMS↗

Voltage Regulation Performance Evaluation of Distributed Energy Resource Management via Advanced Hardware-in-the-Loop Simulation

This paper evaluates the performance of coordinated control across advanced distribution management systems (ADMS), distributed energy resources (DERs), and distributed energy resource management systems (DERMS) using an advanced hardware-in-the-loop (HIL) platform. This platform provides a realistic laboratory testing environment, including accurate dynamic modeling of a real-world distribution system from a utility partner, real controllers (ADMS and DERMS), physical power hardware (DERs), and standard communications protocols. One grid service—voltage regulation—is evaluated to show the performance of the coordinated grid automation system. The testing results demonstrate that the coordinated DERMS and ADMS system can effectively regulate system voltages within target operation limits using DERs. The realistic laboratory HIL testing results give utilities confidence in adopting the grid automation systems to manage DERs to achieve system-level control and operation objectives (e.g., voltage regulation). This helps utilities mitigate potential risks (e.g., instability) prior to field deployment.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Design and Performance Evaluation of a Resistive Control Using a Hydraulic PTO System for the TALOS Wave Energy Converter

This study is focused on developing a numerical model to evaluate the performance of a hydraulic PTO system for the TALOS Wave Energy Converter. The WEC device is described and the architecture of the hydraulic PTO system is presented with detail. The WEC is modeled using WEC-Sim, and the PTO is modeled using the Simscape Fluids library from Simulink. The hydraulic PTO is based on a constant pressure configuration that is suitable for WEC passive control. The hydraulic system is composed by a set of rectifying valves and two hydraulic accumulators that reduce the stiffness of the system and also serve as energy storage devices. One of the advantages of this hydraulic PTO architecture is the possibility of controlling the electric generator to operate around the optimal efficiency operating point. The main components of the hydraulic PTO are off-the-shelf devices that are commercially available, which will facility a future deployment of the designed system. The design variables used for this study are the accumulator size, the maximum pressure in the accumulators, the hydraulic motor maximum displacement, and the shaft speed in the electric generator. The performance of the system is evaluated individually, using sinusoidal inputs that replicates regular wave conditions. In addition to this, the numerical model of the PTO is coupled to a WEC-Sim simulation of the TALOS Wave Energy Converter with six PTOs to generate a wave-to-wire model. The main objective of this work is to present a comprehensive design methodology that could serve as a guideline for future research efforts focused on implementing control algorithms on multi degree of freedom WECs.

hydraulic systems↗

Human performance evaluation in dual-axis critical task tracking

A dual axis tracking using a multiloop critical task was set up to evaluate human performance. The effects of control stick variation and display formats are evaluated. A secondary loading was used to measure the degradation in tracking performance.

Ritchie, M. L.↗

Resilient Plant Monitoring System: Design, Analysis, and Performance Evaluation

Resilient monitoring systems are sensor networks that degrade gracefully under malicious attacks on their sensors, causing them to project misleading information. The goal of this paper is to design, analyze, and evaluate the performance of a resilient monitoring system intended to monitor plant conditions (normal or anomalous). The architecture developed consists of four layers: data quality assessment, process variable assessment, plant condition assessment, and sensor network adaptation. Each of these layers is analyzed by either analytical or numerical tools, and the performance of the overall system is evaluated using simulations. The measure of resiliency of the resulting system is evaluated using Kullback Leibler divergence, and is shown to be sufficiently high in all scenarios considered.

97 MATHEMATICS AND COMPUTING↗

The New Sun-Sky-Lunar Cimel CE318-T Multiband Photometer - A Comprehensive Performance Evaluation

This paper presents the new photometer CE318-T, able to perform daytime and night-time photometric measurements using the sun and the moon as light source. Therefore,this new device permits a complete cycle of diurnal aerosol and water vapour measurements valuable to enhance atmospheric monitoring to be extracted. In this study wehave found significantly higher precision of triplets when comparing the CE318-T master instrument and the Cimel AErosol RObotic NET work (AERONET) master (CE318-AERONET) triplets as a result of the new CE318-T tracking system. Regarding the instrument calibration, two new methodologies to transfer the calibration from a reference instrument using only daytime measurements (Sun Ratio and Sun-Moon gain factor techniques) are presented and discussed. These methods allow the reduction of the previous complexities inherent to nocturnal calibration. A quantitative estimation of CE318-T AOD uncertainty by means of error propagation theory during daytime revealed AOD uncertainties (u(sup D)(sub AOD)) for Langley-calibrated instruments similar to the expected values for other reference instruments (0.002-0.009). We have also found u(sup D)(sub AOD) values similar to the values reported in sun photometry for field instruments (approximately 0.015). In the case of the night-time period, the CE318-T-estimated standard combined uncertainty (u(sup N)(sub AOD)) is dependent not only on the calibration technique but also on illumination conditions and the instrumental noise. These values range from 0.011-0.018 for Lunar Langley-calibrated instruments to 0.012-0.021 for instruments calibrated using the Sun Ratio technique. In the case of moon-calibrated instruments using the Sun-Moon gain factor method and sun calibrated using the Langley technique, we found u(sup N)(sub AOD) ranging from 0.016 to 0.017 (up to 0.019 in 440 nm channel), not dependent on any lunar irradiance model. A subsequent performance evaluation including CE318-T and collocated measurements from independent reference instruments has served to assess the CE318-T performance as well as to confirm its estimated uncertainty. Daytime AOD evaluation, performed at Izana station from March to June 2014, encompassed measurements from a reference CE318-T, a CE318-AERONET master instrument, a Precision Filter Radiometer (PFR) and a Precision Spectroradiometer (PSR) prototype, reporting low AOD discrepancies between the four instruments (up to 0.006). The nocturnal AOD evaluation was performed using CE318-T- and starphotometer-collocated measurements and also by means of a day/night coherence transition test using the CE318-T master instrument and the CE318 daytime data from the CE318-AERONET master instrument. Results showed low discrepancies with the star photometer at 870 and 500 nm channels(less tna or equal to 0.013) and differences with AERONET daytime data (1 h after and before sunset and sunrise) in agreement with the estimated u(sup N)(sub AOD) values at all illumination conditions in the case of channels within the visible spectral range, and only for high moon's illumination conditions in the case of near infrared channels. Perceptible water vapour (PWV) validation showed a good agreement between CE318-T and Global Navigation Satellite System (GNSS) PWV values for all illumination conditions, within the expected precision for sun photometry. Finally, two case studies have been included to highlight the ability of the new CE318-T to capture the diurnal cycle of aerosols and water vapour as well as short-term atmospheric variations, critical for climate studies.

Barreto, Africa↗

MoE-Inference-Bench: Performance Evaluation of Mixture of Expert Large Language and Vision Models

Mixture of Experts (MoE) models have enabled the scaling of Large Language Models (LLMs) and Vision Language Models (VLMs) by achieving massive parameter counts while maintaining computational efficiency. However, MoEs introduce several inference-time challenges, including load imbalance across experts and the additional routing computational overhead. To address these challenges and fully harness the benefits of MoE, a systematic evaluation of hardware acceleration techniques is essential. We present MoE-Inference-Bench, a comprehensive study to evaluate MoE performance across diverse scenarios. We analyze the impact of batch size, sequence length, and critical MoE hyperparameters such as FFN dimensions and number of experts on throughput. We evaluate several optimization techniques on Nvidia H100 GPUs, including pruning, Fused MoE operations, speculative decoding, quantization, and various parallelization strategies. Our evaluation includes MoEs from the Mixtral, DeepSeek, OLMoE and Qwen families. The results reveal performance differences across configurations and provide insights for the efficient deployment of MoEs.

Chitty-Venkata, Krishna Teja↗

Performance evaluation of a completely stirred anaerobic reactor treating pig manure at a low range of mesophilic conditions

Highlights: • The biogas process can run stably at 20 °C at extremely low OLR after long-term acclimation of bacteria. • A biogas plant running at 28 °C seems as efficient as that operated at 38 °C at low OLR of 1.3 g ODM L{sup −1} d{sup −1}. • Lower temperature operation is inadvisable for the commercial biogas plant running at rather high OLR. • The estimated sludge yield at 28 °C is higher than that at 38 °C. - Abstract: Many Chinese biogas plants run in the lower range of mesophilic conditions. This study evaluated the performance of a completely stirred anaerobic reactor treating pig manure at different temperatures (20, 28 and 38 °C). The start-up phase of the reactor at 20 °C was very long and extremely poor performance was observed with increasing organic loading rate (OLR). At an OLR of 4.3 g ODM L{sup −1} d{sup −1}, methane production at 28 °C was comparable (3% less) with that at 38 °C, but the risk of acidification was high at 28 °C. At low OLR (1.3 g ODM L{sup −1} d{sup −1}), the biogas process appeared stable at 28 °C and gave same methane yields as compared to the reactor operating at 38 °C. The estimated sludge yield at 28 °C was 0.065 g VSS g{sup −1} COD{sub removed,} which was higher than that at 38 °C (0.016 g VSS g{sup −1} COD{sub removed})

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

SU-F-P-50: Performance Evaluation of Optically Stimulated Luminescence (OSL) NanoDots in Therapy and Imaging In-Vivo Dose Measurement During Patient Treatment

Purpose: This study was designed to evaluate the performance of optically stimulated Luminescence (OSL) nanoDots as in-vivo dosimeter. For the measurements of surface doses as well as scattered plus leakage doses, nanoDots were used during the setup verification as well as during the treatment delivery. Methods: For a total seven patients undergoing radiotherapy by volumetric modulated arc therapy, surface doses from image guidance and scattered plus leakage doses from treatment delivery were measured. Two sets of calibration curves were generated – one for therapy and another for imaging. Two different nanoDots were used for imaging and therapy doses. Imaging nanoDots were placed at the isocenter only at the time of CBCT and therapy nanoDots were placed at 25 cm away from the isocenter (either in cranial or in caudal direction) only at the time of treatment delivery. During the entire course, nanoDots were placed at the same measurement points. NanoDots were read after 15 minutes of their exposure. For the next fraction, nanoDots were corrected for the residual doses from the previous fractions. Results: Measured surface doses during imaging were 0.14±0.32 cGy, 0.11±0.04 cGy, 0.12±0.53 cGy, 0.04±0.02 cGy, 0.13±0.23 cGy, 0.11±0.43 cGy, 0.10±0.04 cGy with overall mean dose of 0.08±0.1 cGy. Measured doses during treatment delivery, indicative of scattered and leakage dose, were 0.84±0.43 cGy, 1.3±0.4 cGy, 1.4±0.4 cGy, 0.18±0.48 cGy, 0.78±0.29 cGy, 0.27±0.08 cGy, 0.78±0.07 cGy with overall mean dose of 0.61±1.3 cGy. Conclusion: This dosimeter can be used as supplementary unit to verify the doses. No change in the prescription is recommended based on nanoDots measurement. This study is on-going therefore we are presenting only mere number of patients. A large volume data will be presented after completion of the study with proper statistical analysis.

60 APPLIED LIFE SCIENCES↗

Skylab program earth resouces experiment package. Volume 4: Sensor performance evaluation (S193 R/S)

The results of the sensor performance evaluation of the 13.9 GHz radiometer/scatterometer, which was part of the earth resources experiment package on Skylab. Findings are presented in the areas of housekeeping parameters, antenna gain and scanning performance, dynamic range, linearity, precision, resolution, stability, integration time, and transmitter output. Supplementary analyses covering performance anomalies, data stream peculiarities, aircraft sensor data comparisons, scatterometer saturation characteristics, and RF heating effects are reported. Results of the evaluation show that instrument performance was generally as expected, but capability degradations were observed to result from three major anomalies. Conclusions are drawn from the evaluation results, and recommendations for improving the effectiveness of a future program are offered. An addendum describes the special evaluation techniques developed and applied in the sensor performance evaluation tasks.

Kenney, G. P.↗

Performance Evaluation of a Cartesian Move Algorithm for the LSMS Family of Cable-Driven Cranes

The Lightweight Surface Manipulation System, or LSMS, is a family of cable-actuated cranes, designed for surface operations on the Moon and Mars. Its structural design focuses on three fundamental traits for space environments: a high payload-to-mass ratio to reduce launch costs, compactness for space travel in reduced cargo bays, and self-erecting capabilities for operations before astronauts arrive. The resulting design confers nonlinear and switched dynamics to the LSMS, making these cranes an interesting challenge for autonomous and teleoperated applications. One of the protocols required for these applications is a Cartesian move algorithm. This algorithm is responsible for placing the end effector of the crane at a desired location, specified in Cartesian coordinates. This paper evaluates the performance of a Cartesian move algorithm developed for the LSMS at the NASA Langley Research Center. To this end, several payload manipulation tasks were performed with LSMS-L35, the smallest version within the LSMS family. The evaluated algorithm can place the end effector with accuracy, as shown in the hardware and simulation tests.

cable-actuated↗

Performability evaluation of the SIFT computer

Performability modeling and evaluation techniques are applied to the SIFT computer as it might operate in the computational evironment of an air transport mission. User-visible performance of the total system (SIFT plus its environment) is modeled as a random variable taking values in a set of levels of accomplishment. These levels are defined in terms of four attributes of total system behavior: safety, no change in mission profile, no operational penalties, and no economic process whose states describe the internal structure of SIFT as well as relavant conditions of the environment. Base model state trajectories are related to accomplishment levels via a capability function which is formulated in terms of a 3-level model hierarchy. Performability evaluation algorithms are then applied to determine the performability of the total system for various choices of computer and environment parameter values. Numerical results of those evaluations are presented and, in conclusion, some implications of this effort are discussed.

Meyer, J. F.↗

Twelve-month, 12 km resolution North American WRF-Chem v3.4 air quality simulation: performance evaluation

We present results from and evaluate the performance of a 12-month, 12 km horizontal resolution year 2005 air pollution simulation for the contiguous United States using the WRF-Chem (Weather Research and Forecasting with Chemistry) meteorology and chemical transport model (CTM). We employ the 2005 US National Emissions Inventory, the Regional Atmospheric Chemistry Mechanism (RACM), and the Modal Aerosol Dynamics Model for Europe (MADE) with a volatility basis set (VBS) secondary aerosol module. Overall, model performance is comparable to contemporary modeling efforts used for regulatory and health-effects analysis, with an annual average daytime ozone (O 3 ) mean fractional bias (MFB) of 12% and an annual average fine particulate matter (PM 2.5 ) MFB of −1%. WRF-Chem, as configured here, tends to overpredict total PM 2.5 at some high concentration locations and generally overpredicts average 24 h O 3 concentrations. Performance is better at predicting daytime-average and daily peak O 3 concentrations, which are more relevant for regulatory and health effects analyses relative to annual average values. Predictive performance for PM 2.5 subspecies is mixed: the model overpredicts particulate sulfate (MFB = 36%), underpredicts particulate nitrate (MFB = −110%) and organic carbon (MFB = −29%), and relatively accurately predicts particulate ammonium (MFB = 3%) and elemental carbon (MFB = 3%), so that the accuracy in total PM 2.5 predictions is to some extent a function of offsetting over- and underpredictions of PM 2.5 subspecies. Model predictive performance for PM 2.5 and its subspecies is in general worse in winter and in the western US than in other seasons and regions, suggesting spatial and temporal opportunities for future WRF-Chem model development and evaluation.

Tessum, C. W. (ORCID:0000000288647436)↗

CoP as an Acid-Stable Active Electrocatalyst for the Hydrogen-Evolution Reaction: Electrochemical Synthesis, Interfacial Characterization and Performance Evaluation

Films of CoP have been electrochemically synthesized, characterized, and evaluated for performance as a catalyst for the hydrogen-evolution reaction (HER). The film was synthesized by cathodic deposition from a boric acid solution of Co 2+ and H 2 PO 2 – on copper substrates followed by operando remediation of exogenous contaminants. The films were characterized structurally and compositionally by scanning-electron microscopy, energy-dispersive X-ray spectroscopy, X-ray photoelectron spectroscopy, and Raman spectrophotometry. The catalytic activity was evaluated by cyclic voltammetry and chronopotentiometry. Surface characterization prior to electrocatalysis indicated that the film consisted of micrometer-sized spherical clusters located randomly and loosely on a slightly roughened surface. The composition of both the clusters and surface consisted of cobalt in the metallic, phosphide, and amorphous-oxide forms (CoO·Co 2 O 3 ) and of phosphorus as phosphide and orthophosphate. The orthophosphate species, produced by air-oxidation, were eliminated upon HER electrocatalysis in sulfuric acid. The operando film purification yielded a functional electrocatalyst with a Co:P stoichiometric ratio of 1:1. After the HER, the surface was densely packed with micrometer-sized, mesa-like particles whose tops were flat and smooth. The CoP eletrodeposit exhibited an 85 mV overvoltage (η) for the HER at a current density of 10 mA cm –2 and was stable under operation in highly acidic solution, with an increase in η of 18 mV after 24 h of continuous operation. In conclusion, the comparative HER catalytic performance of CoP, film or nanoparticles, is as follows: ηPt < ηCoP film = ηCoP NP, ηNi 2 P < ηCoSe 2 < ηMoS 2 < ηMoSe 2 .

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗