Search NASA⌕ Search

SEARCH · Search NASA

Results for “Performance Model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,423 records · Page 79

Analytical Performance, Loads, and Aeroelastic Stability of a Full-Scale Isolated Proprotor

The prediction of the performance and loads of a full-scale isolated proprotor and the calculation of whirl flutter stability of the rotor installed in a wind tunnel are considered in this study. The comprehensive analysis CAMRAD II is used. The test article is a research proprotor based on the Bell 609 rotor and the wind tunnel test apparatus is the newly developed Tiltrotor Test Rig (TTR) installed in the USAF NFAC 40- by 80-Foot Wind Tunnel. The performance and loads predictions and the stability calculations cover the following operating conditions: hover, cruise, conversion, and helicopter mode. These pre-test analytical results are being obtained to identify test operating limits, ensure a safe wind tunnel test and predict test results. Eventually, the goal is to perform a correlation study, identify shortfalls in the analytical model and introduce improvements to the analytical model. Performance and loads test results to date show that rotor torque (and yoke lag moment) may limit the test envelope. Shake test data based stability analysis shows that the TTR/609 is solidly stable within the test envelope.

Proprotor↗

Taking Climate Model Evaluation to the Next Level

Earth system models are complex and represent a large number of processes, resulting in a persistent spread across climate projections for a given future scenario. Owing to different model performances against observations and the lack of independence among models, there is now evidence that giving equal weight to each available model projection is suboptimal. This Perspective discusses newly developed tools that facilitate a more rapid and comprehensive evaluation of model simulations with observations, process-based emergent constraints that are a promising way to focus evaluation on the observations most relevant to climate projections, and advanced methods for model weighting. These approaches are needed to distil the most credible information on regional climate changes, impacts, and risks for stakeholders and policy-makers.

Eyring, Veronika↗

Classifying Microwave Radiometer Observations Over the Netherlands Into Dry, Shallow-, and Non-Shallow Precipitation Using A Random Forest Model

Spaceborne microwave radiometers represent an important component of the Global Precipitation Measurement (GPM) mission due to their frequent sampling of rain systems. Microwave radiometers measure microwave radiation (brightness temperatures, Tb), which can be converted into precipitation estimates with appropriate assumptions. However, detecting shallow precipitation systems using space-borne radiometers is challenging, especially over land, as their weak signals are hard to differentiate from those associated with dry conditions. This study uses a random forest model (RF) to classify microwave radiometer observations as dry, shallow, or nonshallow over the Netherlands - a region with varying surface conditions and frequent occurrence of shallow precipitation. The RF is trained on five years of data (2016-2020) and tested with two independent years (2015, 2021). The observations are classified using ground-based weather radar echo top heights. Various RF models are assessed, such as using only GPM’s Microwave Imager (GMI) Tb values as input features or including spatially aligned ERA-5 2-meter temperature and freezing level reanalysis and/or Dual Precipitation Radar (DPR) observations. Independent of the input features, the model performs best in summer and worst in winter. The model classifies observations from high-frequency channels (≥85 GHz) with lower Tb-values as non-shallow, higher values as dry, and those in between as shallow. Misclassified footprints exhibit radiometric characteristics corresponding to their assigned class. Case studies reveal dry observations misclassified as shallow are associated with lower Tb-values, likely resulting from the presence of ice particles in non-precipitating clouds. Shallow footprints misclassified as dry are likely related to the absence of ice particles.

Linda Bogerd↗

Results of model intercomparison : predicted vs. measured system performance.

This is a blind modeling study to illustrate the variability expected between PV performance model results. Objectives are to answer: (1) What is the modeling uncertainty; (2) Do certain models do better than others; (3) How can performance modeling be improved; and (4) What are the sources of uncertainty? Some preliminary conclusions are: (1) Large variation seen in model results; (2) Variation not entirely consistent across systems; (3) Uncertainty in assigning derates; (4) Discomfort when components are not included in database - Is there comfort when the components are in the database?; and (5) Residual analysis will help to uncover additional patterns in the models.

14 SOLAR ENERGY↗

When Spreadsheets Become Software - Quality Control Challenges and Approaches - 13360

As part of a preliminary waste acceptance criteria (PWAC) development, several commercial models were employed, including the Hydrologic Evaluation of Landfill Performance model (HELP) [1], the Disposal Unit Source Term - Multiple Species model (DUSTMS) [2], and the Analytical Transient One, Two, and Three-Dimensional model (AT123D) [3]. The results of these models were post-processed in MS Excel spreadsheets to convert the model results to alternate units, compare the groundwater concentrations to the groundwater concentration thresholds, and then to adjust the waste contaminant masses (based on average concentration over the waste volume) as needed in an attempt to achieve groundwater concentrations at the limiting point of assessment that would meet the compliance concentrations while maximizing the potential use of the landfill (i.e., maximizing the volume of projected waste being generated that could be placed in the landfill). During the course of the PWAC calculation development, one of the Microsoft (MS) Excel spreadsheets used to post-process the results of the commercial model packages grew to include more than 575,000 formulas across 18 worksheets. This spreadsheet was used to assess six base scenarios as well as nine uncertainty/sensitivity scenarios. The complexity of the spreadsheet resulted in the need for a rigorous quality control (QC) procedure to verify data entry and confirm the accuracy of formulas. (authors)

54 ENVIRONMENTAL SCIENCES↗

Path to Subsurface Closure: When Real and Predicted Data Don't Match, Central Nevada Test Area (CNTA) - 19560

The Central Nevada Test Area, Nevada, was the site of an underground nuclear test in 1968, which resulted in residual contamination at and near the detonation depth of 975 meters (3200 feet). The environmental corrective action strategy for the site was conducted in accordance with the Federal Facility Agreement and Consent Order and all applicable Nevada Division of Environmental Protection (NDEP) policies and regulations. The corrective action strategy initiated in 1999 included developing a conceptual site model, preparing a numerical flow and transport model, calculating contaminant boundaries, negotiating compliance boundaries with NDEP, performing model validation, and monitoring groundwater. This strategy was executed through the Corrective Action Decision Document/Corrective Action Plan phase, when it was determined that the flow and transport model could not be validated because it failed to adequately predict groundwater elevations in the monitoring/validation (MV) wells (MV-1, MV-2, and MV-3) drilled subsequent to the modeling effort. This led to a change in the corrective action strategy that is now designed to validate the compliance boundary through monitoring and institutional controls, rather than relying predominantly on a numerical flow and transport model. This new approach included enhancements to the monitoring well network and additional monitoring to confirm that data were sufficient to proceed to closure. The corrective action activities were completed in 2015, and the Closure Report, which established the long-term postclosure monitoring program, was approved in 2016. The postclosure monitoring program is designed to (1) assess the effectiveness of the compliance boundary by monitoring for the radionuclides of interest and (2) evaluate the effectiveness of monitoring locations within the groundwater flow system by monitoring water elevations to ensure that monitoring wells are located along the potential migration pathways. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Development of Software to Model AXAF-I Image Quality

This draft final report describes the work performed under the delivery order number 145 from May 1995 through August 1996. The scope of work included a number of software development tasks for the performance modeling of AXAF-I. A number of new capabilities and functions have been added to the GT software, which is the command mode version of the GRAZTRACE software, originally developed by MSFC. A structural data interface has been developed for the EAL (old SPAR) finite element analysis FEA program, which is being used by MSFC Structural Analysis group for the analysis of AXAF-I. This interface utility can read the structural deformation file from the EAL and other finite element analysis programs such as NASTRAN and COSMOS/M, and convert the data to a suitable format that can be used for the deformation ray-tracing to predict the image quality for a distorted mirror. There is a provision in this utility to expand the data from finite element models assuming 180 degrees symmetry. This utility has been used to predict image characteristics for the AXAF-I HRMA, when subjected to gravity effects in the horizontal x-ray ground test configuration. The development of the metrology data processing interface software has also been completed. It can read the HDOS FITS format surface map files, manipulate and filter the metrology data, and produce a deformation file, which can be used by GT for ray tracing for the mirror surface figure errors. This utility has been used to determine the optimum alignment (axial spacing and clocking) for the four pairs of AXAF-I mirrors. Based on this optimized alignment, the geometric images and effective focal lengths for the as built mirrors were predicted to cross check the results obtained by Kodak.

Ahmad, Anees↗

ZeoNet: 3D convolutional neural networks for predicting adsorption in nanoporous zeolites

Zeolites are one of the most widely used materials in the chemical industry due to their nanometer-sized pores that can adsorb and react upon molecules selectively. With hundreds of known framework topologies and hundreds of thousands of computationally predicted structures, the ability to rapidly predict zeolite performance allows researchers to prioritize their efforts on the most promising structures for a given application. Although the accuracy of forcefield-based atomistic simulations has advanced significantly in the past two decades, these simulations can be computationally expensive, especially for long-chain, complex molecules. Here, we present ZeoNet, a representation learning framework using convolutional neural networks (ConvNets) and 3D volumetric representations for predicting adsorption in zeolites. ZeoNet was trained on the task of predicting Henry's constants for adsorption, k H , of n-octadecane in more than 330 000 known and predicted zeolite materials. Employing a 3D grid based on the distances to solvent-accessible surfaces, a volumetric representation that can be generated efficiently, the best-performing ZeoNet achieved a correlation coefficient r 2 = 0.977 and a mean-squared error MSE = 3.8 in ln k H , which corresponds to an error of 9.3 kJ mol -1 in adsorption free energy. In comparison, a model based on hand-designed geometric features has values of r 2 = 0.783 and MSE = 35.7. ZeoNet is also relatively efficient and can process ≈8 structures per second on an Nvidia RTX 2080TI GPU, orders of magnitude faster than forcefield-based simulations. A systematic analysis was conducted to investigate how the choice of ConvNet architectures, the linear dimension (L) and spatial resolution (Δd) of the distance grids, batch size, optimizer, and learning rate impact the model performance. We found that ConvNets based on the ResNet architecture offer the best tradeoff between expressiveness and efficiency. The performance for all models reaches a plateau at L = 30–45 Å and depends less sensitively on grid resolution, with a small benefit around Δd = 0.30–0.45 Å. Finally, saliency maps were visualized to identify which regions of the materials contributed the most to model predictions. It was found, interestingly, that the predictions are driven primarily by the accessible pore volume rather than the region occupied by the framework atoms.

36 MATERIALS SCIENCE↗

In Quest of Calibration Density and Consistency in Hydrologic Modeling: Distributed Parameter Calibration against Streamflow Characteristics

Conventional basin-by-basin approaches to calibrate hydrologic models are limited to gauged basins and typically result in spatially discontinuous parameter fields. Moreover, the consequent low calibration density in space falls seriously behind the need from present-day applications like high resolution river hydrodynamic modeling. In this study we calibrated three key parameters of the Variable Infiltration Capacity (VIC) model at every 1/8° grid-cell using machine learning-based maps of four streamflow characteristics for the conterminous United States (CONUS), with a total of 52,663 grid-cells. This new calibration approach, as an alternative to parameter regionalization, applied to ungauged regions too. A key difference made here is that we tried to regionalize physical variables (streamflow characteristics) instead of model parameters whose behavior may often be less well understood. The resulting parameter fields no longer presented any spatial discontinuities and the patterns corresponded well with climate characteristics, such as aridity and runoff ratio. The calibrated parameters were evaluated against observed streamflow from 704/648 (calibration/validation period) small-to-medium-sized catchments used to derive the streamflow characteristics, 3941/3809 (calibration/validation period) small-to-medium-sized catchments not used to derive the streamflow characteristics as well as five large basins. Comparisons indicated marked improvements in bias and Nash-Sutcliffe efficiency. Model performance was still poor in arid and semiarid regions, which is mostly due to both model structural and forcing deficiencies. Although the performance gain was limited by the relative small number of parameters to calibrate, the study and results here served as a proof-of-concept for a new promising approach for fine-scale hydrologic model calibrations.

54 ENVIRONMENTAL SCIENCES↗

Validation of Artemis I Aerothermal Design Models Using Developmental Flight Instrumentation

The inaugural flight of the Space Launch System (SLS) Block 1 launch vehicle, Artemis I, occurred on November 16, 2022, and featured a full suite of Developmental Flight Instrumentation (DFI) that provided aerothermodynamic measurements to assess thermal design and substantiate aerothermodynamic models. The Block 1 launch vehicle aerothermal instrumentation consisted of approximately 277 aerothermal gauges mounted throughout the Orion Multi-Purpose Crew Vehicle (MPCV), Integrated Spacecraft and Payload Element (ISPE), Core Stage (CS) and Solid Rocket Boosters (SRB) and an additional 179 thermal gauges on the Orion Crew Module (CM). Instrumentation included calorimeters, radiometers, pressure transducers, gas temperature probes, and thermocouples. Data was collected from lift-off through CS Main Engine Cut-Off (MECO). The flight data was invaluable for determining aerothermal model performance and developing flight-derived aerothermal environments for flight reconstruction thermal analysis and future SLS aerothermal models. The data offered critical insights into the aerothermodynamic conditions experienced during the launch and ascent of the SLS vehicle. This study compares the flight derived environments to pre-existing design models. The aerothermal models were constructed using MINIVER, the aerothermal engineering code which predicts aerodynamic heating and acts as an integration tool for incorporating databases from computational fluid dynamics (CFD) simulations and wind tunnel test data. The comparisons reveal the fidelity of the design models, highlighting areas where the design models accurately predicted flight conditions and instances where deviations were observed. Preliminary results suggest that while the design models largely aligned with the observed flight data, there were unique observations that reflected needed areas of model refinement. Aerothermal flight data from Artemis I for the SLS Block 1 vehicle will be further utilized to enhance the accuracy of Block 1B and Block 2 aerothermal models, ensuring improved safety and performance for subsequent Artemis missions.

aerothermodynamics↗

Validation of Artemis I Aerothermal Design Models Using Developmental Flight Instrumentation

The inaugural flight of the Space Launch System (SLS) Block 1 launch vehicle, Artemis I, occurred on November 16, 2022, and featured a full suite of Developmental Flight Instrumentation (DFI) that provided aerothermodynamic measurements to assess thermal design and substantiate aerothermodynamic models. The Block 1 launch vehicle aerothermal instrumentation consisted of approximately 277 aerothermal gauges mounted throughout the Orion Multi-Purpose Crew Vehicle (MPCV), Integrated Spacecraft and Payload Element (ISPE), Core Stage (CS) and Solid Rocket Boosters (SRB) and an additional 179 thermal gauges on the Orion Crew Module (CM). Instrumentation included calorimeters, radiometers, pressure transducers, gas temperature probes, and thermocouples. Data was collected from lift-off through CS Main Engine Cut-Off (MECO). The flight data was invaluable for determining aerothermal model performance and developing flight-derived aerothermal environments for flight reconstruction thermal analysis and future SLS aerothermal models. The data offered critical insights into the aerothermodynamic conditions experienced during the launch and ascent of the SLS vehicle. This study compares the flight derived environments to pre-existing design models. The aerothermal models were constructed using MINIVER, the aerothermal engineering code which predicts aerodynamic heating and acts as an integration tool for incorporating databases from computational fluid dynamics (CFD) simulations and wind tunnel test data. The comparisons reveal the fidelity of the design models, highlighting areas where the design models accurately predicted flight conditions and instances where deviations were observed. Preliminary results suggest that while the design models largely aligned with the observed flight data, there were unique observations that reflected needed areas of model refinement. Aerothermal flight data from Artemis I for the SLS Block 1 vehicle will be further utilized to enhance the accuracy of Block 1B and Block 2 aerothermal models, ensuring improved safety and performance for subsequent Artemis missions.

aerothermodynamics↗

A framework for benchmarking land models

Land models, which have been developed by the modeling community in the past few decades to predict future states of ecosystems and climate, have to be critically evaluated for their performance skills of simulating ecosystem responses and feedback to climate change. Benchmarking is an emerging procedure to measure performance of models against a set of defined standards. This paper proposes a benchmarking framework for evaluation of land model performances and, meanwhile, highlights major challenges at this infant stage of benchmark analysis. The framework includes (1) targeted aspects of model performance to be evaluated, (2) a set of benchmarks as defined references to test model performance, (3) metrics to measure and compare performance skills among models so as to identify model strengths and deficiencies, and (4) model improvement. Land models are required to simulate exchange of water, energy, carbon and sometimes other trace gases between the atmosphere and land surface, and should be evaluated for their simulations of biophysical processes, biogeochemical cycles, and vegetation dynamics in response to climate change across broad temporal and spatial scales. Thus, one major challenge is to select and define a limited number of benchmarks to effectively evaluate land model performance. The second challenge is to develop metrics of measuring mismatches between models and benchmarks. The metrics may include (1) a priori thresholds of acceptable model performance and (2) a scoring system to combine data–model mismatches for various processes at different temporal and spatial scales. The benchmark analyses should identify clues of weak model performance to guide future development, thus enabling improved predictions of future states of ecosystems and climate. The near-future research effort should be on development of a set of widely acceptable benchmarks that can be used to objectively, effectively, and reliably evaluate fundamental properties of land models to improve their prediction performance skills.

Biophysical Processes↗

Bayesian performance evaluation of evapotranspiration models based on eddy covariance systems in an arid region

Abstract. Evapotranspiration (ET) is a major component of the land surface processinvolved in energy fluxes and energy balance, especially in the hydrologicalcycle of agricultural ecosystems. While many models have been developed aspowerful tools to simulate ET, there is no agreement on which model bestdescribes the loss of water to the atmosphere. This study focuses on twoaspects, evaluating the performance of four widely used ET models andidentifying parameters, and the physical mechanisms that havesignificant impacts on the model performance. The four tested models arethe Shuttleworth–Wallace (SW) model, Penman–Monteith (PM) model,Priestley–Taylor and Flint–Childs (PT–FC) model, and advection–aridity (AA)model. By incorporating the mathematically rigorous thermodynamicintegration algorithm, the Bayesian model evidence (BME) approach is adoptedto select the optimal model with half-hourly ET observations obtained at aspring maize field in an arid region. Our results reveal that the SW model has thebest performance, and the extinction coefficient is not merely partitioningthe total available energy into the canopy and surface but also includingthe energy imbalance correction. The extinction coefficient is wellconstrained in the SW model and poorly constrained in the PM model but notconsidered in PT–FC and AA models. This is one of the main reasons that theSW model outperforms the other models. Meanwhile, the good fitting of SWmodel to observations can counterbalance its higher complexity. In addition,the detailed analysis of the discrepancies between observations and modelsimulations during the crop growth season indicate that explicit treatmentof energy imbalance and energy interaction will be the primary way offurther improving ET model performance.

54 ENVIRONMENTAL SCIENCES↗

Performance and power modeling and prediction using MuMMI and 10 machine learning methods

Energy-efficient scientific applications require insight into how high performance computing system features impact the applications' power and performance. This insight can result from the development of performance and power models. Here, in this article, we use the modeling and prediction tool MuMMI (Multiple Metrics Modeling Infrastructure) and 10 machine learning methods to model and predict performance and power consumption and compare their prediction error rates. We use an algorithm-based fault-tolerant linear algebra code and a multilevel checkpointing fault-tolerant heat distribution code to conduct our modeling and prediction study on the Cray XC40 Theta and IBM BG/Q Mira at Argonne National Laboratory and the Intel Haswell cluster Shepard at Sandia National Laboratories. Our experimental results show that the prediction error rates in performance and power using MuMMI are less than 10% for most cases. By utilizing the models for runtime, node power, CPU power, and memory power, we identify the most significant performance counters for potential application optimizations, and we predict theoretical outcomes of the optimizations. Based on two collected datasets, we analyze and compare the prediction accuracy in performance and power consumption using MuMMI and 10 machine learning methods.

97 MATHEMATICS AND COMPUTING↗

Anomaly Detection in Seismic Data with Deep Learning: Application for Instrument Failure Detection and Forecasting

Seismic data quality assessment (QA) is the first and one of the most important steps before conducting any further data analysis. Traditional methods involve checking various metrics, such as spike detection and power spectral density, by setting strict thresholds or comparing data against synthetic benchmarks. However, these approaches often rely on pre-existing knowledge and assumptions about data anomalies, leading to potential misclassification of unusual cases. Here, in this study, we propose a deep autoencoder model, an unsupervised learning approach that evaluates data quality without making assumptions about normal and anomalous data, which can be used to identify deviations in recorded data that may indicate nascent instrument failure. We test the model with the U.S. International Monitoring System (IMS) seismic stations and demonstrate the capability of detecting anomalies on a monthly scale. This could prompt station operators to examine potential problems early, allowing sufficient time for instrument maintenance to prevent data outages. In addition, we use a new manually selected testing dataset to compare our model performance against two supervised machine learning (ML) approaches and a standard QA package, as baseline models. When applied to the dataset containing known data anomalies, performance of the supervised and unsupervised ML approaches is similar, with an accuracy of 88.1% for our model compared to ∼90% for the supervised ML approach and 78.2% for the standard QA package. Our model outperforms the baseline models when applied to new stations, where new types of data anomalies can be station-specific and not included in the training dataset. Finally, we show model transferability by training the model with data from the Global Seismograph Network only and applying it to the IMS network data. The results suggest that our model is generalizable and can be applied to new stations with good accuracy.

Lin, Jiun-Ting [Lawrence Livermore National Labora↗

Model-Scale Aerodynamic Performance Testing of Proposed Modifications to the NASA Langley Low Speed Aeroacoustic Wind Tunnel

Tests were performed on a 1/20th-scale model of the Low Speed Aeroacoustic Wind Tunnel to determine the performance effects of insertion of acoustic baffles in the tunnel inlet, replacement of the existing collector with a new collector design in the open jet test section, and addition of flow splitters to the acoustic baffle section downstream of the test section. As expected, the inlet baffles caused a reduction in facility performance. About half of the performance loss was recovered by addition the flow splitters to the downstream baffles. All collectors tested reduced facility performance. However, test chamber recirculation flow was reduced by the new collector designs and shielding of some of the microphones was reduced owing to the smaller size of the new collector. Overall performance loss in the facility is expected to be a 5 percent top flow speed reduction, but the facility will meet OSHA limits for external noise levels and recirculation in the test section will be reduced.

Booth, Earl R., Jr.↗