Search NASA⌕ Search

SEARCH · Search NASA

Results for “performance metrics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9

The Third SeaWiFS HPLC Analysis Round-Robin Experiment (SeaHARRE-3)

Seven international laboratories specializing in the determination of marine pigment concentrations using high performance liquid chromatography (HPLC) were intercompared using in situ samples and a mixed pigment sample. The field samples were collected primarily from oligotrophic waters, although mesotrophic and eutrophic waters were also sampled to create a dynamic range in chlorophyll concentration spanning approximately two orders of magnitude (0.020 1.366 mg m^{-3}) The intercomparisons were used to establish the following: a) the uncertainties in quantitating individual pigments and higher-order variables (sums, ratios, and indices); b) the reduction in uncertainties as a result of applying quality assurance (QA) procedures; c) the importance of establishing a properly defined referencing system in the computation of uncertainties; d) the analytical benefits of performance metrics, and e) the utility of a laboratory mix in understanding method performance. In addition, the remote sensing requirements for the in situ determination of total chlorophyll a were investigated to determine whether or not the average uncertainty for this measurement is being satisfied.

Hooker, Stanford B.↗

The Development and Application of Cognitive Performance Assessment for Exploration Class Mission EVAs

The objectives of our research are to: 1) Define cognitive performance requirements for future Lunar and Mars mission EVAs, 2) Characterize cognitive performance in subjects conducting simulated EVAs in analog studies, and 3) Develop and test unobtrusive EVA cognitive performance metrics. Our long-term goal is to develop exploration class cognitive performance monitoring capabilities for EVA and to provide data that can inform EVA planning for Lunar and Mars missions.

S R Anderson↗

Numerical Investigation of the Effect of Cooling Airflow inside High-Pressure Turbine using the Source Term Approach

In this study, the Open National Combustion code (OpenNCC) is applied to simulate the airflow inside the high-pressure turbine (HPT) of the energy efficient engine (EEE). The main objective of this study is to compare the characteristics of the HPT performance obtained by using three different approaches (Case 1: the realistic combustion products are considered at the HPT inlet, but the cooling airflows are not included, Case 2: the working fluid is assumed to be a single gas (i.e., air), and the cooling airflows are considered, Case 3: the cooling airflow and the combustion products at the HPT inlet are included). To mimic the cooling airflows at the HPT surface, we use the surface source team approach, in which we impose the source term at a specific area of a cooling airflow hole at the solid surfaces by specifying an injection angle, temperature, turbulent intensity, and mass flowrate of each cooling airflow. For the validation of the model, the data for the EEE model was obtained from the General Electric (GE) test campaign (RDG10), and the full scale warm-air rig test condition representing a test point close to the integrated core/low spool design condition was considered. This validation test was done using the stationary uniform inflow condition (i.e., the reported total temperature and total pressure). Secondly, we considered the Sea-Level Take-off (SLTO) engine condition and separately performed the combustor simulation to obtain a more realistic time-averaged, spatially-nonuniform HPT inflow condition. This work provides a better understanding the effect of the cooling airflow model with different assumptions on the HPT performance. It is found that using different working gas have a minor effect on the performance metric, however the presence of the cooling airflows significantly affects the HPT performance such as the turbine efficiency.

CFD Hot-streaks↗

Design and Simulation of Greatly Improved Future Generation 4H-SiC JFET-R Integrated Circuits for Prolonged 500 °C Operation

This work compares design layouts and circuit simulations of the next two prototype NASA Glenn SiC JFET-R IC fabrication runs designated “IC Gen. 12” and “IC Gen. 13”. Even though both generations employ the same physical JFET gate length and chip size, SPICE simulations predict drastic improvements to IC capabilities and performance metrics for Gen. 13 over Gen. 12. The main factors behind simulated performance differences are thinner n-channel layer leading to reduced operating voltages and switch to stepper-based photolithography that enables roughly 4-fold layout area reductions for functionally identical circuit blocks.

Silicon Carbide↗

Performance Evaluation of a Single-Phase Grid-Forming Inverter Through Hardware Experiments

This study conducts hardware experiments to assess the performance of a commercial single-phase grid-forming (GFM) inverter using a purely hardware-based approach. We adhere to a testing protocol for the GFM inverter and enhance it by exploring the transient performance of GFM inverters across various grid dynamic events. Quantifiable performance metrics are established for each testing scenario to gain insights into the performance of the single-phase GFM inverters. Based on the comprehensive tests, the following observations are summarized: 1) The performance of the single-phase GFM inverter is satisfactory, and it is capable of being the islanding master for residence homes when the main grid is gone. 2) For frequency response, the inverter is able to stay connected but cannot inject the needed active power to support the grid. This may be improved by the manufacturer by using droop control. 3) The GFM inverter exhibits harmful transients in voltage and frequency during islanding operation, which can be enhanced by maintaining the same operating points before and after the breaker is open.

dynamic performance↗

Database Performance Monitoring for DUNE

This report presents the research, design, and implementation of improved PostgreSQL monitoring for DUNE Rucio database services using Checkmk. The project began with a request to improve dashboard visibility for database performance metrics, including connection usage, configured connection limits, lock activity, wait behavior, storage trends, query performance, and saturation alerts. The initial implementation focused on the dune_rucio_prod database on the rucio_prod PostgreSQL instance because connection saturation and lock contention are direct reliability risks for database-backed services. Existing Checkmk PostgreSQL monitoring was investigated, and several gaps were identified. Built-in connection monitoring did not clearly separate active, idle, idle-in-transaction, total, and usage-percent metrics, while the built-in lock monitoring simplified PostgreSQL lock modes into shared and exclusive categories. To address these gaps, two DSG-specific Checkmk local checks were created: one for connection-state monitoring and one for lock-state monitoring. These checks supplement the built-in PostgreSQL checks and provide additional performance data for dashboard graphs, service states, and alerts.

Bowers, Elliot [Cabrillo Coll.]↗

Fine-tuning machine-learned particle-flow reconstruction for new detector geometries in future colliders

We demonstrate transfer learning capabilities in a machine-learned algorithm trained for particle-flow reconstruction in high energy particle colliders. This paper presents a cross-detector fine-tuning study, where we initially pretrain the model on a large full simulation dataset from one detector design, and subsequently fine-tune the model on a sample with a different collider and detector design. Specifically, we use the Compact Linear Collider detector (CLICdet) model for the initial training set and demonstrate successful knowledge transfer to the CLIC-like detector (CLD) proposed for the Future Circular Collider in electron-positron mode. We show that with an order of magnitude less samples from the second dataset, we can achieve the same performance as a costly training from scratch, across particle-level and event-level performance metrics, including jet and missing transverse momentum resolution. Furthermore, we find that the fine-tuned model achieves comparable performance to the traditional rule-based particle-flow approach on event-level metrics after training on 100,000 CLD events, whereas a model trained from scratch requires at least 1 million CLD events to achieve similar reconstruction performance. To our knowledge, this represents the first full-simulation cross-detector transfer learning study for particle-flow reconstruction. These findings offer valuable insights towards building large foundation models that can be fine-tuned across different detector designs and geometries, helping to accelerate the development cycle for new detectors and opening the door to rapid detector design and optimization using machine learning.

43 PARTICLE ACCELERATORS↗

Using convolutional neural networks to detect edge localized modes in DIII-D from Doppler backscattering measurements

In H-mode tokamak plasmas, the plasma is sometimes ejected beyond the edge transport barrier. These events are known as edge localized modes (ELMs). ELMs cause a loss of energy and damage the vessel walls. Understanding the physics of ELMs, and by extension, how to detect and mitigate them, is an important challenge. In this paper, we focus on two diagnostic methods—deuterium-alpha (D α ) spectroscopy and Doppler backscattering (DBS). The former detects ELMs by measuring Balmer alpha emission, while the latter uses microwave radiation to probe the plasma. DBS has the advantages of having a higher temporal resolution and robustness to damage. These advantages of DBS diagnostic may be beneficial for future operational tokamaks, and thus, data processing techniques for DBS should be developed in preparation. In sight of this, we explore the training of neural networks to detect ELMs from DBS data, using D α data as the ground truth. With shots found in the DIII-D database, the model is trained to classify each time step based on the occurrence of an ELM event. The results are promising. When tested on shots similar to those used for training, the model is capable of consistently achieving a high f1-score of 0.93. Furthermore, this score is a performance metric for imbalanced datasets that ranges between 0 and 1. We evaluate the performance of our neural network on a variety of ELMs in different high confinement regimes (grassy ELM, RMP mitigated, and wide-pedestal), finding broad applicability. Beyond ELMs, our work demonstrates the wider feasibility of applying neural networks to data from DBS diagnostic.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Performance Evaluation of Intelligent Solar Control Software Through Hardware-in-the-Loop (CRADA Final Report)

Recent research has highlighted the potential for solar to act as a zero-marginal-cost and zero-emission flexibility resource on the bulk power system when operated with advanced control systems. To increase the performance of these systems, leading technologies, including machine learning (ML) and hierarchical inverter set point allocation, have been developed by Latimer Controls, Inc. to estimate the headroom of large PV plants for grid operation and control; however, these technologies lack comprehensive validation under real-world application scenarios. Latimer Controls, Inc. received two voucher awards for research at a national laboratory from the Department of Energy American Made Solar Prize Round 6. The National Renewable Energy Laboratory (NREL) was selected to collaborate with Latimer staff to conduct a performance evaluation of Latimer PV control software. The NREL team will develop a hardware-in-the-loop (HIL) testbed to perform testing and validation of the Latimer PV control technology in a de-risked yet realistic testbed environment. Latimer and NREL worked together to analyze the test data, draw conclusions from the results, and disseminate the resulting scientific findings. In this CRADA work, we propose to test and validate the real-world application of the Latimer Control solution in an HIL environment. We evaluate the performance of different flexible solar technologies in responding to automatic generation control signals in a closed-loop fashion. In particular, a data-driven potential high limit (PHL) estimation is developed for large solar plants to accurately estimate their headroom so that they have fast and short-time regulation and control capability to participate in grid services and respond to grid signals in real time (e.g., AGC). This PHL estimation algorithm is embedded in a hardware power plant controller (PPC) and tested with an IEEE-39 bus system model developed in RTDS. To account for the varying cloud conditions and diverse inverter dispatches, we developed a 135-MW PV plant with detailed modeling of 27 individual PV modules and inverters using RTDS. The real-world communications used in such big plants, such as ModBus TCP/IP for inverter level and DNP3 for plant level, were developed to emulate the real-world applications in big PV plants. The ML-based PHL estimation method is tested under nine separate weather scenarios against the ‘reference-control’ solution, hereafter referred to as the baseline solution. The baseline method reserves a subset of inverters (reference group) to operate at their PHL at all times and dispatches only the remaining inverters (control group) at curtailed levels to fulfill the flexibility need. Despite being successfully piloted by NREL in California in 2017 and Chile in 2020, there exist two gaps in the state of the art to fully unlock the flexibility of PV plants: a. There is a trade-off between the PHL estimation accuracy and the flexibility range. b. There lacks granularity in the PHL estimation to capture the variation across inverters. The Latimer solution seeks to address these gaps by applying machine learning methods to improve PHL estimation accuracy while accounting for variability at every inverter. Performance metrics were taken from the 2023 Georgia Power CARES utility-scale RFP. The results demonstrate that the ML-based approach outperforms the traditional baseline method in PHL estimation accuracy for 7 of 9 scenarios. The average PHL error across the nine scenarios was 7.40% for the ML-based method, 2.06% less than the 9.46% PHL error average across scenarios that was exhibited by the baseline method. Additionally, the PHL error was below 5% for at least 95% of the testing interval for 3 of 9 tested intervals with the ML approach, whereas it did not achieve this metric for any of the baseline tests. Overall, simulation results indicate the superior performance of an ML-based approach compared to the conventional baseline reference-control approach, showcasing its potential to support grid stability and operational efficiency. This laboratory HIL testing using real PPC, representative power system simulation models in real-time with detailed PV plant and inverter models, and real-world communication protocols gives us confidence that this machine learning based PHL estimation algorithm works well in the hardware PPC and therefore de-risks future field commissioning. The end goal of this project is to advance grid technology to address the grid operation challenges brought by solar plant’s variability and uncertainties in power generation.

14 SOLAR ENERGY↗

Performance Characterization of Digital Optical Data Transfer Systems for Use in the Space Radiation Environment

Radiation effects in photonic and microelectronic components can impact the performance of high-speed digital optical data link in a variety of ways. This segment of the short course focuses on radiation effects in digital optical data links operating in the MHz to GHz regime. (Some of the information is applicable to frequencies above and below this regime) The three basic component level effects that should be considered are Total Ionizing Dose (TID), Displacement Damage Dose (DDD) and Single Event Effects (SEE). In some cases the system performance degradation can be quantified from component level tests, while in others a more holistic characterization approach must be taken. In Section 2.0 of this segment of the Short Course we will give a brief overview of the space radiation environment follow by a summary of the basic space radiation effects important for microelectronics and photonics listed above. The last part of this section will give an example of a typical mission radiation environment requirements. Section 3.0 gives an overview of intra-satellite digital optical data link systems. It contains a discussion of the digital optical data link and it's components. Also, we discuss some of the important system performance metrics that are impacted by radiation effects degradation of optical and optoelectronic component performance. Section 4.0 discusses radiation effects in optical and optoelectronic components. While each component effect will be discussed, the focus of this section is on degradation of passive optical components and SEE in photodiodes (other mechanisms are covered in segment II of this short course entitled "Photonic Devices with Complex and Multiple Failure Modes"). Section 5.0 will focus on optical data link system response to the space radiation environment. System level SEE ground testing will be discussed. Then we give a discussion of system level assessment of data link performance when operating in the space radiation environment.

Reed, Robert A.↗

The Fourth SeaWiFS HPLC Analysis Round-Robin Experiment (SeaHARRE-4)

Ten international laboratories specializing in the determination of marine pigment concentrations using high performance liquid chromatography (HPLC) were intercompared using in situ samples and a mixed pigment sample. Although prior Sea-viewing Wide Field-of-view Sensor (SeaWiFS) High Performance Liquid Chromatography (HPLC) Round-Robin Experiment (SeaHARRE) activities conducted in open-ocean waters covered a wide dynamic range in productivity, and some of the samples were collected in the coastal zone, none of the activities involved exclusively coastal samples. Consequently, SeaHARRE-4 was organized and executed as a strictly coastal activity and the field samples were collected from primarily eutrophic waters within the coastal zone of Denmark. The more restrictive perspective limited the dynamic range in chlorophyll concentration to approximately one and a half orders of magnitude (previous activities covered more than two orders of magnitude). The method intercomparisons were used for the following objectives: a) estimate the uncertainties in quantitating individual pigments and higher-order variables formed from sums and ratios; b) confirm if the chlorophyll a accuracy requirements for ocean color validation activities (approximately 25%, although 15% would allow for algorithm refinement) can be met in coastal waters; c) establish the reduction in uncertainties as a result of applying QA procedures; d) show the importance of establishing a properly defined referencing system in the computation of uncertainties; e) quantify the analytical benefits of performance metrics, and f) demonstrate the utility of a laboratory mix in understanding method performance. In addition, the remote sensing requirements for the in situ determination of total chlorophyll a were investigated to determine whether or not the average uncertainty for this measurement is being satisfied.

Hooker, Stanford B.↗

Prediction of Weather Impacted Airport Capacity using Ensemble Learning

Ensemble learning with the Bagging Decision Tree (BDT) model was used to assess the impact of weather on airport capacities at selected high-demand airports in the United States. The ensemble bagging decision tree models were developed and validated using the Federal Aviation Administration (FAA) Aviation System Performance Metrics (ASPM) data and weather forecast at these airports. The study examines the performance of BDT, along with traditional single Support Vector Machines (SVM), for airport runway configuration selection and airport arrival rates (AAR) prediction during weather impacts. Testing of these models was accomplished using observed weather, weather forecast, and airport operation information at the chosen airports. The experimental results show that ensemble methods are more accurate than a single SVM classifier. The airport capacity ensemble method presented here can be used as a decision support model that supports air traffic flow management to meet the weather impacted airport capacity in order to reduce costs and increase safety.

Weather impact↗

Prelaunch Characterization and Performance of JPSS-3 VIIRS Reflective Solar Bands

The Joint Polar Satellite System 3 (JPSS-3) Visible Infrared Imaging Radiometer Suite (VIIRS) instrument is the fourth in a series (S-NPP VIIRS launched in October 2011, JPSS-1 VIIRS launched in November 2017, and JPSS-2 VIIRS currently undergoing spacecraft integration) of highly advanced polar-orbiting environmental satellites. JPSS-3 VIIRS underwent a comprehensive sensor-level Thermal Vacuum (TV) testing at the Raytheon Technologies El Segundo facility in the fall of 2020. While the test program provided characterization for many spatial, spectral, and radiometric aspects of the VIIRS sensor performance, this paper focuses on the radiometric performance of the 14 reflective solar bands (RSB) that cover the wavelength range from 0.41 to 2.3 μm. Key calibration parameters, such as the instrument gain, signal-to-noise ratio (SNR), dynamic range and radiometric uniformity, were derived in a TV environment for both the primary and redundant electronics at three instrument temperature plateaus: cold, nominal, and hot. This paper shows that all the JPSS-3 VIIRS RSB detectors have been well characterized, with the key performance metrics being comparable to those of the previous VIIRS instruments. Comparison of radiometric performance to sensor requirements, as well as a summary of key sensor testing and performance issues, will also be presented.

JPSS-3↗

Comparing 3D and 2D CFD for Mars Helicopter Ingenuity Rotor Performance Prediction

Single and coaxial rotor performance simulations for the Mars Helicopter Ingenuity rotor are performed for representative Mars atmospheric conditions. Analyses are presented using both a high-fidelity 3D CFD model of the rotor and 2D CFD models of the airfoil sections for comprehensive analyses that use CAMRADII (Comprehensive Analytical Model of Rotorcraft Aerodynamics and Dynamics). When available, the airfoil performance calculations are generated using a numerical approach identical to that used in the high-fidelity 3D model, allowing for a direct comparison between the approaches. Experimental data from a validation campaign to explore higher thrust from an Ingenuity rotor is provided to substantiate a discussion on the simulation fidelity required for both coaxial and single rotor performance predictions. The data is in support of the Sample Recovery Helicopter (SRH) element that serves as the primary backup for tube retrieval as part of the Mars Sample Return (MSR) Campaign. Insights on modeling turbulence at low Reynolds numbers and its influence on the rotor figure of merit are discussed. Key rotor performance metrics are compared. A detailed investigation into differences between 2D and 3D rotor performance predictions, spanwise loading, and rotor stall behavior is included.

Mars Helicopter↗

Development and evaluation of a multi-functional heat pump with embedded thermal storage

We developed and tested a novel multi-functional packaged vertical heat pump designed for multi-family buildings, capable of providing space cooling, space heating, water heating, and energy storage integration. The system employs a 3-speed scroll compressor and supports energy-efficient cooling and heating across different ambient conditions, while utilizing both indoor and outdoor air sources for water heating. Key performance metrics include an integrated energy efficiency ratio of 18.0 for cooling, a heating seasonal performance factor of 10.0, and a coefficient of performance (COP) of 2.1 for heating in cold climates down to −15 ˚C. Additionally, the system delivers an annual water heating COP greater than 4.0, with outstanding performance in combined space cooling and water heating modes, achieving a total COP of 8.8 by recovering condenser waste heat. The heat pump also demonstrated thermal energy storage capabilities, integrating with phase change material systems to store heating and cooling energy. Furthermore, this versatile system offers a promising solution for improving energy efficiency and sustainability in multi-family buildings, providing high-performance heating, cooling, and water heating across a range of climates.

COP↗

Demonstration of Grid Services Using Mixed Grid-Forming and Grid-Following Technologies at the Wheatridge Renewable Energy Facility (Final Technical Report)

This Final Technical Report summarizes the analytical, modeling, and engineering work performed to evaluate grid-forming (GFM) inverter capabilities within a large hybrid renewable energy facility. The project focused on assessing the ability of advanced inverter-based resources to provide essential reliability services through coordinated operation of grid-forming (GFM) and grid-following (GFL) technologies. During Budget Period 1, the project developed a comprehensive framework of GFM performance metrics, including angle support, voltage regulation, frequency response, damping behavior, and current-limiting performance. Extensive electromagnetic transient (EMT) studies and hardware-in-the-loop (HIL) testing were conducted to validate GFM behavior under a range of operating conditions, including weak-grid scenarios, voltage disturbances, and multi-resource interactions. The project also established validated modeling approaches, plant-level control integration strategies, commissioning frameworks, and high-speed measurement infrastructure to support future field demonstration. Although the project concluded prior to field demonstration, the results provide a utility-scale foundation for evaluating, modeling, and deploying grid-forming technologies. The methodologies and tools developed contribute to industry understanding of inverter-based resource behavior and support future power system reliability under increasing renewable penetration.

14 SOLAR ENERGY↗

A Rule Based Approach to ISS Interior Volume Control and Layout

Traditional human factors design involves the development of human factors requirements based on a desire to accommodate a certain percentage of the intended user population. As the product is developed human factors evaluation involves comparison between the resulting design and the specifications. Sometimes performance metrics are involved that allow leniency in the design requirements given that the human performance result is satisfactory. Clearly such approaches may work but they give rise to uncertainty and negotiation. An alternative approach is to adopt human factors design rules that articulate a range of each design continuum over which there are varying outcome expectations and interactions with other variables, including time. These rules are based on a consensus of human factors specialists, designers, managers and customers. The International Space Station faces exactly this challenge in interior volume control, which is based on anthropometric, performance and subjective preference criteria. This paper describes the traditional approach and then proposes a rule-based alternative. The proposed rules involve spatial, temporal and importance dimensions. If successful this rule-based concept could be applied to many traditional human factors design variables and could lead to a more effective and efficient contribution of human factors input to the design process.

Peacock, Brian↗

Coupled Solid Rocket Motor Ballistics and Trajectory Modeling for Higher Fidelity Launch Vehicle Design

Multi-stage launch vehicles with solid rocket motors (SRMs) face design optimization challenges, especially when the mission scope changes frequently. Significant performance benefits can be realized if the solid rocket motors are optimized to the changing requirements. While SRMs represent a fixed performance at launch, rapid design iterations enable flexibility at design time, yielding significant performance gains. The streamlining and integration of SRM design and analysis can be achieved with improved analysis tools. While powerful and versatile, the Solid Performance Program (SPP) is not conducive to rapid design iteration. Performing a design iteration with SPP and a trajectory solver is a labor intensive process. To enable a better workflow, SPP, the Program to Optimize Simulated Trajectories (POST), and the interfaces between them have been improved and automated, and a graphical user interface (GUI) has been developed. The GUI enables real-time visual feedback of grain and nozzle design inputs, enforces parameter dependencies, removes redundancies, and simplifies manipulation of SPP and POST's numerous options. Automating the analysis also simplifies batch analyses and trade studies. Finally, the GUI provides post-processing, visualization, and comparison of results. Wrapping legacy high-fidelity analysis codes with modern software provides the improved interface necessary to enable rapid coupled SRM ballistics and vehicle trajectory analysis. Low cost trade studies demonstrate the sensitivities of flight performance metrics to propulsion characteristics. Incorporating high fidelity analysis from SPP into vehicle design reduces performance margins and improves reliability. By flying an SRM designed with the same assumptions as the rest of the vehicle, accurate comparisons can be made between competing architectures. In summary, this flexible workflow is a critical component to designing a versatile launch vehicle model that can accommodate a volatile mission scope.

Ables, Brett↗