Search NASA⌕ Search

SEARCH · Search NASA

Results for “Performance modeling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 739 records · Page 41

The International Land Model Benchmarking (ILAMB) System: Design, Theory, and Implementation

Abstract The increasing complexity of Earth system models has inspired efforts to quantitatively assess model fidelity through rigorous comparison with best available measurements and observational data products. Earth system models exhibit a high degree of spread in predictions of land biogeochemistry, biogeophysics, and hydrology, which are sensitive to forcing from other model components. Based on insights from prior land model evaluation studies and community workshops, the authors developed an open source model benchmarking software package that generates graphical diagnostics and scores model performance in support of the International Land Model Benchmarking (ILAMB) project. Employing a suite of in situ, remote sensing, and reanalysis data sets, the ILAMB package performs comprehensive model assessment across a wide range of land variables and generates a hierarchical set of web pages containing statistical analyses and figures designed to provide the user insights into strengths and weaknesses of multiple models or model versions. Described here is the benchmarking philosophy and mathematical methodology embodied in the most recent implementation of the ILAMB package. Comparison methods unique to a few specific data sets are presented, and guidelines for configuring an ILAMB analysis and interpreting resulting model performance scores are discussed. ILAMB is being adopted by modeling teams and centers during model development and for model intercomparison projects, and community engagement is sought for extending evaluation metrics and adding new observational data sets to the benchmarking framework.

54 ENVIRONMENTAL SCIENCES↗

Development of an Instrument Performance Simulation Capability for an Infrared Correlation Radiometer for Troposheric Carbon Monoxide Measurements From Geo

We present the progress toward an analytical performance model of a 2.3 micron infrared correlation radiometer (IRCRg) prototype subsystem for a future geostationary space-borne instrument. The prototype is designed specifically to measure carbon monoxide (CO) from geostationary orbit. NASA's Geostationary Coastal and Air Pollution Events (GEO-CAPE) mission, one of the United States Earth Science and Applications Decadal Survey missions, specifies the use of infrared correlation radiometry to measure CO in two spectral regions for this mission. GEO-CAPE will use the robust IRCR measurement technique at geostationary orbit, nearly 50 times farther away than the Terra/MOPITT orbit, to determine hourly changes in CO across a continental domain. The abundance of CO in Earth's troposphere directly affects the concentration of hydroxyl, which regulates the lifetimes of many tropospheric pollutants. In addition, CO is a precursor to ozone formation; CO is used as a tracer to study the transport of global and regional pollutants; and CO is used as an indicator of both natural and anthropogenic air pollution sources and sinks. We have structured our development project to enable rapid evaluation of future spaceborne instrument designs. The project is part of NASA's Instrument Incubator Program. We describe the architecture of the performance model and the planned evaluation of the performance model using laboratory test data.

OsowskiNeil, Doreen↗

Evaluation of CMIP6 models in simulating the statistics of extreme precipitation over Eastern Africa

We report the Eastern Africa region experiences frequent extreme precipitation events that can cause destruction of property and environment, and loss of lives. Thus, there is a need to understand how these events may change in the future and how well the global climate models that are used to make projections can simulate precipitation extremes in this region before they can be used in downscaling or flood and drought impact assessment studies. In this work, we evaluated the ability of sixteen Coupled Model Intercomparison Project Phase 6 (CMIP6) models to simulate present-day precipitation extremes over the Eastern Africa region during the two rainy seasons (March–May and September–November). We used nine extreme precipitation indices (including seven (one) indices of wet (dry) extremes) defined by the Expert Team on Climate Change Detection and Indices. The CMIP6 models were evaluated against two gridded observation datasets: Global Precipitation Climatology Project One-Degree Daily Dataset and Tropical Rainfall Measuring Mission Multi-satellite Precipitation Analysis 3B42. Three model performance metrics (percentage bias, normalized root-mean-square error, and pattern correlation coefficient) were employed to further assess the strengths and weakness of the models. Our results show that the multi-model ensemble mean generally provides a better representation of observed precipitation and related extremes compared to individual models when considering all metrics and seasons. Several consistent biases are evident across CMIP6 models, which tend to overestimate the total-wet day precipitation and consecutive wet days, and underestimate very wet days and maximum 5-day precipitation in both seasons. Furthermore, no single model consistently performs best, model performance varies with the season and index under consideration and is generally independent of horizontal resolution.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Design, Modeling and Performance Optimization of a Novel Rotary Piezoelectric Motor

This work has demonstrated a proof of concept for a torsional inchworm type motor. The prototype motor has shown that piezoelectric stack actuators can be used for rotary inchworm motor. The discrete linear motion of piezoelectric stacks can be converted into rotary stepping motion. The stacks with its high force and displacement output are suitable actuators for use in piezoelectric motor. The designed motor is capable of delivering high torque and speed. Critical issues involving the design and operation of piezoelectric motors were studied. The tolerance between the contact shoes and the rotor has proved to be very critical to the performance of the motor. Based on the prototype motor, a waveform optimization scheme was proposed and implemented to improve the performance of the motor. The motor was successfully modeled in MATLAB. The model closely represents the behavior of the prototype motor. Using the motor model, the input waveforms were successfully optimized to improve the performance of the motor in term of speed, torque, power and precision. These optimized waveforms drastically improve the speed of the motor at different frequencies and loading conditions experimentally. The optimized waveforms also increase the level of precision of the motor. The use of the optimized waveform is a break-away from the traditional use of sinusoidal and square waves as the driving signals. This waveform optimization scheme can be applied to any inchworm motors to improve their performance. The prototype motor in this dissertation as a proof of concept was designed to be robust and large. Future motor can be designed much smaller and more efficient with lessons learned from the prototype motor.

Duong, Khanh A.↗

A Machine Learning-Based Cloud Detection and Thermodynamic Phase Classification Algorithm using Passive Spectral Observations

We trained two Random Forest (RF) machine-learning models for cloud mask and cloud thermodynamic phase detection using spectral observations from VIIRS on Suomi NPP (SNPP). Observations from CALIOP were carefully selected to provide reference labels. The two RF models were trained for all-day and daytime-only conditions using a 4-year collocated VIIRS/CALIOP dataset from 2013 to 2016. Due to the orbit difference, the collocated CALIOP and SNPP VIIRS training samples cover a broad viewing zenith angle range, which is a great benefit to overall model performance. The all-day model uses 3 VIIRS infrared (IR) bands (8.6,11, and 12 μm) and the daytime model uses 5 Near-IR (NIR) and Shortwave-IR (SWIR) bands (0.86, 1.24, 1.38, 1.64 and 2.25 μm) together with the 3 IR bands to detect clear, liquid water, and ice cloud pixels. Up to 7 surface types, namely, ocean/water, forest, cropland, grassland, snow/ice, barren/desert, and shrubland, were considered separately to enhance performance for both models. Detection of cloudy pixels and thermodynamic phase with the two RF models were compared against collocated CALIOP products from 2017. It is shown that, with a conservative screening process that excludes the most challenging cloudy pixels for passive remote sensing, the two RF models have high accuracy rates in comparison with the CALIOP reference for both cloud detection and thermodynamic phase. Other existing SNPP VIIRS and Aqua MODIS cloud mask and phase products are also evaluated, with results showing that the two RF models and the MODIS MYD06 optical property phase product are the top 3 algorithms with respect to lidar observations during the daytime. During the nighttime, the RF all-day model works best for both cloud detection and phase, in particular for pixels over snow/ice surfaces. The present RF models can be extended to other similar passive instruments if training samples can be collected from CALIOP or other lidars. However, the quality of reference labels and potential sampling issues that may impact model performance would need further attention.

cloud detection↗

Accurate and Data‐Efficient Micro X‐ray Diffraction Phase Identification Using Multitask Learning: Application to Hydrothermal Fluids

Traditional analysis of highly distorted micro X‐ray diffraction (μ‐XRD) patterns from hydrothermal fluid environments is a time‐consuming process, often requiring substantial data preprocessing and labeled experimental data. Herein, the potential of deep learning with a multitask learning (MTL) architecture to overcome these limitations is demonstrated. MTL models are trained to identify phase information in μ‐XRD patterns, minimizing the need for labeled experimental data and masking preprocessing steps. Notably, MTL models show superior accuracy compared to binary classification convolutional neural networks. Additionally, introducing a tailored cross‐entropy loss function improves MTL model performance. Most significantly, MTL models tuned to analyze raw and unmasked XRD patterns achieve close performance to models analyzing preprocessed data, with minimal accuracy differences. This work indicates that advanced deep learning architectures like MTL can automate arduous data handling tasks, streamline the analysis of distorted XRD patterns, and reduce the reliance on labor‐intensive experimental datasets.

97 MATHEMATICS AND COMPUTING↗

SAM Photovoltaic Model Technical Reference 2016 Update

This manual describes the photovoltaic performance model in the System Advisor Model (SAM) software, Version 2016.3.14 Revision 4 (SSC Version 160). It is an update to the 2015 edition of the manual, which describes the photovoltaic model in SAM 2015.1.30 (SSC 41). This new edition includes corrections of errors in the 2015 edition and descriptions of new features introduced in SAM 2016.3.14, including: 3D shade calculator Battery storage model DC power optimizer loss inputs Snow loss model Plane-of-array irradiance input from weather file option Support for sub-hourly simulations Self-shading works with all four subarrays, and uses same algorithm for fixed arrays and one-axis tracking Linear self-shading algorithm for thin-film modules Loss percentages replace derate factors. The photovoltaic performance model is one of the modules in the SAM Simulation Core (SSC), which is part of both SAM and the SAM SDK. SAM is a user-friedly desktop application for analysis of renewable energy projects. The SAM SDK (Software Development Kit) is for developers writing their own renewable energy analysis software based on SSC. This manual is written for users of both SAM and the SAM SDK wanting to learn more about the details of SAM's photovoltaic model.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Future Modeling Needs in Pulse Detonation Rocket Engine Design

This paper presents a performance model rocket engine design that takes advantage of pulse detonation to generate thrust. The contents include: 1) Introduction to the Pulse Detonation Rocket Engine (PDRE); 2) PDRE modeling issues and options; 3) Discussion of the PDRE Performance Workshop held at Marshall Space Flight Center; and 4) Identify needs involving an open performance model for Pulse Detonation Rocket Engines. This paper is in viewgraph form.

Meade, Brian↗

A Performance Prediction Model for a Fault-Tolerant Computer During Recovery and Restoration

The modeling and design of a fault-tolerant multiprocessor system is addressed. Of interest is the behavior of the system during recovery and restoration after a fault has occurred. The multiprocessor systems are based on the Algorithm to Architecture Mapping Model (ATAMM) and the fault considered is the death of a processor. The developed model is useful in the determination of performance bounds of the system during recovery and restoration. The performance bounds include time to recover from the fault, time to restore the system, and determination of any permanent delay in the input to output latency after the system has regained steady state. Implementation of an ATAMM based computer was developed for a four-processor generic VHSIC spaceborne computer (GVSC) as the target system. A simulation of the GVSC was also written on the code used in the ATAMM Multicomputer Operating System (AMOS). The simulation is used to verify the new model for tracking the propagation of the delay through the system and predicting the behavior of the transient state of recovery and restoration. The model is shown to accurately predict the transient behavior of an ATAMM based multicomputer during recovery and restoration.

Obando, Rodrigo A.↗

A Multiple Lines of Evidence Approach for Conceptual Site Models in Performance Assessments - 19070

Demonstration of the long-term performance of remediated radioactive waste sites relies on models that evaluate vadose zone and groundwater flow and contaminant transport for thousands of years. Model qualification, verification, and comparisons with data are essential elements to demonstrating the accuracy of long-term performance assessments (PAs). However, comparisons with data are generally limited due to incomplete characterization data and long-time scales. Since PAs support decision making to assure long-term protection of both human health and the environment, a conceptual site model (CSM) is needed to explain the hydrodynamic behavior and account for subsurface heterogeneities in sufficient detail to support confident decisions. In the case of the Waste Management Area (WMA) C PA, where the focus of the effort is on characterizing flow and transport through a thick vadose zone, site-specific data are sparse and larger-scale geologic descriptions are adopted with the risk of losing small scale features that may affect contaminant transport. Features such as horizontal bedding and sloping interfaces between contrasting material types, as well as vertically oriented features such as clastic dikes, may be difficult to delineate from sparse characterization data, but may affect the extent to which contaminants are transported. The PA conducted to identify long-term impacts associated with the closure of the single-shell tank (SST) farm at WMA C adopted an equivalent homogenous medium approach to represent the major stratigraphic units at the site. This approach explicitly represents major stratigraphic units but assigns hydraulic properties that implicitly account for the presence of small-scale heterogeneities and their impact on flow and contaminant transport to the groundwater. The objective of this study is to evaluate the available site-specific and analogue data that can be used to characterize heterogeneity and to assess its impact on fate and transport of contaminants that may lead to different conclusions when compared to the results of the equivalent homogeneous media approach. To this end, a multiple lines of evidence approach was used to construct alternative CSMs based on an evaluation of several types of data. These data include 1) general characteristics and features of the major stratigraphic units from historical descriptions; 2) borehole geologic logs; 3) particle size distribution measurements; 4) moisture content measurements; 5) spectral gamma data; and 6) concentrations of key constituents (i.e., Tc-99) in both the vadose zone and groundwater impacted by past releases. Based on an analysis of the available data, lines of evidence are evaluated for consistency and integrated in a consistent manner into scientifically defensible CSMs. Numerical models are then used to evaluate the impact that the explicit representation of heterogeneities has on contaminant transport. Together, the field data and the numerical modeling results indicate that heterogeneity caused by the small-scale features do not have a significant (i.e. greater than a factor of 2) impact on transport below WMA C relative to peak concentrations and arrival times for potential releases from waste tanks. The results of this study underscore the value of using multiple lines of evidence based on the quantity and quality of available data in developing alternative CSMs and evaluating their relative impact on key transport metrics such as arrival times and peak concentration. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Generation of Mars Helicopter Rotor Model for Comprehensive Analyses

The present research is aimed at providing a performance model for the Mars Helicopter (MH), to understand the complexity of the flow, and identify future regions of improvement. The low density of the Martian atmosphere and the relatively small MH rotor, result in very low chord-based Reynolds number flows. The low density and Reynolds numbers reduce the lifting force and lifting efficiency, respectively. The high drag coefficients in subcritical flow, especially for thicker sections, are attributed to laminar separation from the rear of the airfoil. In the absence of test data, efforts have been made to explore these effects using prior very low Reynolds number research efforts. The rotor chord-based Reynolds number range is observed to be subcritical, which makes boundary layer transition unlikely to occur. The state of the two-dimensional rotor boundary layer in hover is approximated by calculating the instability point, laminar separation point, and the transition location to provide understanding of the flow state in the high Mach-low Reynolds number regime. The results are used to investigate the need for turbulence modeling in Computational Fluid Dynamics (CFD) calculations afterwards. The goal is to generate a performance model for the MH rotor for a free wake analysis, because the computational budget for a complete Navier-Stokes solution for a rotating body-fitted rotor is substantial. In this study, a Reynolds-Averaged Navier-Stokes (RANS) based approach is used to generate the airfoil deck using C81Gen with stitched experimental data for very high angles of attack. A full Grid Resolution Study is performed and over 4,500 cases are completed to create the full airfoil deck. The laminar separation locations are predicted within the accuracy of the approximate method when compared with the CFD calculations. The model is presented through airfoil data tables (c81 files) that are used by comprehensive rotor analysis codes such as CAMRADII, or the mid-fidelity CFD solver RotCFD. Finally, the rotor performance is compared with experimental data from the 25ft Space Simulator at the NASA Jet Propulsion Laboratory (JPL) and shows good correlation for the rotor Figure of Merit over the available thrust range.

Model↗

Final Project Report: PV Stakeholder Engagement Initiatives

The key objectives of this project were to increase meaningful stakeholder engagement in photovoltaic performance modeling and reliability areas. We did this by hosting six workshop over the past three years, giving conference and workshop presentations and contributing to technical standards committees. Our efforts have made positive contributions by increasing the sharing of information and best practices and by creating and sustaining a technical community in PV Performance Modeling. This community has worked together over the past three years and has improved its practice and decreased performance modeling uncertainties.

14 SOLAR ENERGY↗

Technical Report on Waveform Fit Metrics for Global Models

The new WAVEFORMS Initiative in the Ground-based Nuclear Detonation Detection (GNDD) program includes an increased emphasis on the development of Earth models and methods to predict entire seismic and acoustic waveforms more accurately. In general, this increased emphasis is predicated on the need to better characterize seismic events and provide improved model-based discrimination between event types including earthquakes and explosions. More specifically, while current moment tensor inversion methods tend to work well for larger events (M>~4) using tuned 1-D Earth models, the development of state-of-the-art 3-D models and methods is required for the prediction of shorter period waves over large areas for discrimination of smaller events. There is no standard metric for model-based waveform prediction accuracy used in the waveform modeling/inversion community. However, there are several popular waveform misfit definitions; and minimizing the corresponding objective functions is the goal of waveform inversion. Some example misfit definitions employed for adjoint waveform tomography include measures of simple travel time differences (e.g. Tape et al., 2010), cross-correlation travel time differences (e.g. Luo and Schuster, 1991), multi-taper frequency dependent methods (e.g. Lei et al., 2020), time-frequency phase misfit functions (e.g. Fichtner 2010; Rodgers et al., 2022), normalized cross-correlation methods (e.g. Tao et al., 2018), and others. In some cases, these misfit definitions also involve complicated weighting schemes and summations over multiple frequency bands making it difficult to duplicate the misfit measurement with alternative models and datasets. Although each of the misfit definitions mentioned above are useful for developing waveform models, the actual misfit values are not usually meaningful outside of a given project, model, and/or dataset. Therefore, it is difficult to understand and communicate model performance for predicting waveforms and comparing to other models and/or new model iterations with a different dataset. Therefore, there is a need for a generalized method for evaluating overall model performance that is independent from the specific misfit chosen to develop the waveform models that is also intuitive and meaningful. In this report, we describe a new metric we refer to as ‘Percent of Correlated Signal’. The following sections describe and demonstrate the metric with a case study event and a more rigorous test using a random selection of globally distributed events. While the focus here is on global tomography models, the metric is meant to applicable to regional ‘wiggle-for-wiggle’ waveform models/studies as well.

58 GEOSCIENCES↗

CEDAR Electrodynamics Thermosphere Ionosphere (ETI) Challenge for Systematic Assessment of Ionosphere/Thermosphere Models: NmF2, hmF2, and Vertical Drift Using Ground-Based Observations

Objective quantification of model performance based on metrics helps us evaluate the current state of space physics modeling capability, address differences among various modeling approaches, and track model improvements over time. The Coupling, Energetics, and Dynamics of Atmospheric Regions (CEDAR) Electrodynamics Thermosphere Ionosphere (ETI) Challenge was initiated in 2009 to assess accuracy of various ionosphere/thermosphere models in reproducing ionosphere and thermosphere parameters. A total of nine events and five physical parameters were selected to compare between model outputs and observations. The nine events included two strong and one moderate geomagnetic storm events from GEM Challenge events and three moderate storms and three quiet periods from the first half of the International Polar Year (IPY) campaign, which lasted for 2 years, from March 2007 to March 2009. The five physical parameters selected were NmF2 and hmF2 from ISRs and LEO satellites such as CHAMP and COSMIC, vertical drifts at Jicamarca, and electron and neutral densities along the track of the CHAMP satellite. For this study, four different metrics and up to 10 models were used. In this paper, we focus on preliminary results of the study using ground-based measurements, which include NmF2 and hmF2 from Incoherent Scatter Radars (ISRs), and vertical drifts at Jicamarca. The results show that the model performance strongly depends on the type of metrics used, and thus no model is ranked top for all used metrics. The analysis further indicates that performance of the model also varies with latitude and geomagnetic activity level.

Shim, J. S.↗

High-Performance Computational Modeling of Strong Ground Motion for Seismic Response Analysis with Implications for High-Hazard and/or Nuclear Facilities and Critical Infrastructure at the NNSSNLV-015-19, Year 2

Presentation to be given at the FY 2020 SDRD Annual Meeting, to be held Sept. 23-24, on WebEx. There is one video also attached. This presentation is a reduced slide deck of the recently STIPped version, DOE/NV/03624--0875, presented 9-15-20 at the work in progress seminar. High-Performance Computational Modeling of Strong Ground Motion for Seismic Response Analysis with Implications for High-Hazard and/or Nuclear Facilities and Critical Infrastructure at the NNSSNLV-015-19, Year 2

58 GEOSCIENCES↗

Regime-Based Evaluation of Cloudiness in CMIP5 Models

The concept of Cloud Regimes (CRs) is used to develop a framework for evaluating the cloudiness of 12 fifth Coupled Model Intercomparison Project (CMIP5) models. Reference CRs come from existing global International Satellite Cloud Climatology Project (ISCCP) weather states. The evaluation is made possible by the implementation in several CMIP5 models of the ISCCP simulator generating for each gridcell daily joint histograms of cloud optical thickness and cloud top pressure. Model performance is assessed with several metrics such as CR global cloud fraction (CF), CR relative frequency of occurrence (RFO), their product (long-term average total cloud amount [TCA]), cross-correlations of CR RFO maps, and a metric of resemblance between model and ISCCP CRs. In terms of CR global RFO, arguably the most fundamental metric, the models perform unsatisfactorily overall, except for CRs representing thick storm clouds. Because model CR CF is internally constrained by our method, RFO discrepancies yield also substantial TCA errors. Our findings support previous studies showing that CMIP5 models underestimate cloudiness. The multi-model mean performs well in matching observed RFO maps for many CRs, but is not the best for this or other metrics. When overall performance across all CRs is assessed, some models, despite their shortcomings, apparently outperform Moderate Resolution Imaging Spectroradiometer (MODIS) cloud observations evaluated against ISCCP as if they were another model output. Lastly, cloud simulation performance is contrasted with each model's equilibrium climate sensitivity (ECS) in order to gain insight on whether good cloud simulation pairs with particular values of this parameter.

cloud climatology↗

Performance Assessment Modeling and Sensitivity Analyses of Generic Disposal System Concepts

The Used Fuel Disposition Campaign (UFDC) of the U.S. Department of Energy (DOE) Office of Nuclear Energy (NE) is conducting research and development (R&D) on generic deep geologic disposal systems (i.e., repositories) for high-activity nuclear wastes (i.e., used nuclear fuel (UNF) and high-level radioactive waste (HLW)) that exist today or that could be generated in future fuel cycles. This report describes specific activities in FY2014 toward the development of an enhanced generic disposal system modeling and analysis capability that utilizes high performance computing (HPC) environments to simulate important multi-physics phenomena and couplings associated with the potential behavior of a geologic repository for UNF and HLW.

Sevougian, S. David↗