Search NASA⌕ Search

SEARCH · Search NASA

Results for “Performance Modeling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,405 records · Page 78

Classifying Microwave Radiometer Observations Over the Netherlands Into Dry, Shallow-, and Non-Shallow Precipitation Using A Random Forest Model

Spaceborne microwave radiometers represent an important component of the Global Precipitation Measurement (GPM) mission due to their frequent sampling of rain systems. Microwave radiometers measure microwave radiation (brightness temperatures, Tb), which can be converted into precipitation estimates with appropriate assumptions. However, detecting shallow precipitation systems using space-borne radiometers is challenging, especially over land, as their weak signals are hard to differentiate from those associated with dry conditions. This study uses a random forest model (RF) to classify microwave radiometer observations as dry, shallow, or nonshallow over the Netherlands - a region with varying surface conditions and frequent occurrence of shallow precipitation. The RF is trained on five years of data (2016-2020) and tested with two independent years (2015, 2021). The observations are classified using ground-based weather radar echo top heights. Various RF models are assessed, such as using only GPM’s Microwave Imager (GMI) Tb values as input features or including spatially aligned ERA-5 2-meter temperature and freezing level reanalysis and/or Dual Precipitation Radar (DPR) observations. Independent of the input features, the model performs best in summer and worst in winter. The model classifies observations from high-frequency channels (≥85 GHz) with lower Tb-values as non-shallow, higher values as dry, and those in between as shallow. Misclassified footprints exhibit radiometric characteristics corresponding to their assigned class. Case studies reveal dry observations misclassified as shallow are associated with lower Tb-values, likely resulting from the presence of ice particles in non-precipitating clouds. Shallow footprints misclassified as dry are likely related to the absence of ice particles.

Linda Bogerd↗

Results of model intercomparison : predicted vs. measured system performance.

This is a blind modeling study to illustrate the variability expected between PV performance model results. Objectives are to answer: (1) What is the modeling uncertainty; (2) Do certain models do better than others; (3) How can performance modeling be improved; and (4) What are the sources of uncertainty? Some preliminary conclusions are: (1) Large variation seen in model results; (2) Variation not entirely consistent across systems; (3) Uncertainty in assigning derates; (4) Discomfort when components are not included in database - Is there comfort when the components are in the database?; and (5) Residual analysis will help to uncover additional patterns in the models.

14 SOLAR ENERGY↗

When Spreadsheets Become Software - Quality Control Challenges and Approaches - 13360

As part of a preliminary waste acceptance criteria (PWAC) development, several commercial models were employed, including the Hydrologic Evaluation of Landfill Performance model (HELP) [1], the Disposal Unit Source Term - Multiple Species model (DUSTMS) [2], and the Analytical Transient One, Two, and Three-Dimensional model (AT123D) [3]. The results of these models were post-processed in MS Excel spreadsheets to convert the model results to alternate units, compare the groundwater concentrations to the groundwater concentration thresholds, and then to adjust the waste contaminant masses (based on average concentration over the waste volume) as needed in an attempt to achieve groundwater concentrations at the limiting point of assessment that would meet the compliance concentrations while maximizing the potential use of the landfill (i.e., maximizing the volume of projected waste being generated that could be placed in the landfill). During the course of the PWAC calculation development, one of the Microsoft (MS) Excel spreadsheets used to post-process the results of the commercial model packages grew to include more than 575,000 formulas across 18 worksheets. This spreadsheet was used to assess six base scenarios as well as nine uncertainty/sensitivity scenarios. The complexity of the spreadsheet resulted in the need for a rigorous quality control (QC) procedure to verify data entry and confirm the accuracy of formulas. (authors)

54 ENVIRONMENTAL SCIENCES↗

Path to Subsurface Closure: When Real and Predicted Data Don't Match, Central Nevada Test Area (CNTA) - 19560

The Central Nevada Test Area, Nevada, was the site of an underground nuclear test in 1968, which resulted in residual contamination at and near the detonation depth of 975 meters (3200 feet). The environmental corrective action strategy for the site was conducted in accordance with the Federal Facility Agreement and Consent Order and all applicable Nevada Division of Environmental Protection (NDEP) policies and regulations. The corrective action strategy initiated in 1999 included developing a conceptual site model, preparing a numerical flow and transport model, calculating contaminant boundaries, negotiating compliance boundaries with NDEP, performing model validation, and monitoring groundwater. This strategy was executed through the Corrective Action Decision Document/Corrective Action Plan phase, when it was determined that the flow and transport model could not be validated because it failed to adequately predict groundwater elevations in the monitoring/validation (MV) wells (MV-1, MV-2, and MV-3) drilled subsequent to the modeling effort. This led to a change in the corrective action strategy that is now designed to validate the compliance boundary through monitoring and institutional controls, rather than relying predominantly on a numerical flow and transport model. This new approach included enhancements to the monitoring well network and additional monitoring to confirm that data were sufficient to proceed to closure. The corrective action activities were completed in 2015, and the Closure Report, which established the long-term postclosure monitoring program, was approved in 2016. The postclosure monitoring program is designed to (1) assess the effectiveness of the compliance boundary by monitoring for the radionuclides of interest and (2) evaluate the effectiveness of monitoring locations within the groundwater flow system by monitoring water elevations to ensure that monitoring wells are located along the potential migration pathways. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Development of Software to Model AXAF-I Image Quality

This draft final report describes the work performed under the delivery order number 145 from May 1995 through August 1996. The scope of work included a number of software development tasks for the performance modeling of AXAF-I. A number of new capabilities and functions have been added to the GT software, which is the command mode version of the GRAZTRACE software, originally developed by MSFC. A structural data interface has been developed for the EAL (old SPAR) finite element analysis FEA program, which is being used by MSFC Structural Analysis group for the analysis of AXAF-I. This interface utility can read the structural deformation file from the EAL and other finite element analysis programs such as NASTRAN and COSMOS/M, and convert the data to a suitable format that can be used for the deformation ray-tracing to predict the image quality for a distorted mirror. There is a provision in this utility to expand the data from finite element models assuming 180 degrees symmetry. This utility has been used to predict image characteristics for the AXAF-I HRMA, when subjected to gravity effects in the horizontal x-ray ground test configuration. The development of the metrology data processing interface software has also been completed. It can read the HDOS FITS format surface map files, manipulate and filter the metrology data, and produce a deformation file, which can be used by GT for ray tracing for the mirror surface figure errors. This utility has been used to determine the optimum alignment (axial spacing and clocking) for the four pairs of AXAF-I mirrors. Based on this optimized alignment, the geometric images and effective focal lengths for the as built mirrors were predicted to cross check the results obtained by Kodak.

Ahmad, Anees↗

ZeoNet: 3D convolutional neural networks for predicting adsorption in nanoporous zeolites

Zeolites are one of the most widely used materials in the chemical industry due to their nanometer-sized pores that can adsorb and react upon molecules selectively. With hundreds of known framework topologies and hundreds of thousands of computationally predicted structures, the ability to rapidly predict zeolite performance allows researchers to prioritize their efforts on the most promising structures for a given application. Although the accuracy of forcefield-based atomistic simulations has advanced significantly in the past two decades, these simulations can be computationally expensive, especially for long-chain, complex molecules. Here, we present ZeoNet, a representation learning framework using convolutional neural networks (ConvNets) and 3D volumetric representations for predicting adsorption in zeolites. ZeoNet was trained on the task of predicting Henry's constants for adsorption, k H , of n-octadecane in more than 330 000 known and predicted zeolite materials. Employing a 3D grid based on the distances to solvent-accessible surfaces, a volumetric representation that can be generated efficiently, the best-performing ZeoNet achieved a correlation coefficient r 2 = 0.977 and a mean-squared error MSE = 3.8 in ln k H , which corresponds to an error of 9.3 kJ mol -1 in adsorption free energy. In comparison, a model based on hand-designed geometric features has values of r 2 = 0.783 and MSE = 35.7. ZeoNet is also relatively efficient and can process ≈8 structures per second on an Nvidia RTX 2080TI GPU, orders of magnitude faster than forcefield-based simulations. A systematic analysis was conducted to investigate how the choice of ConvNet architectures, the linear dimension (L) and spatial resolution (Δd) of the distance grids, batch size, optimizer, and learning rate impact the model performance. We found that ConvNets based on the ResNet architecture offer the best tradeoff between expressiveness and efficiency. The performance for all models reaches a plateau at L = 30–45 Å and depends less sensitively on grid resolution, with a small benefit around Δd = 0.30–0.45 Å. Finally, saliency maps were visualized to identify which regions of the materials contributed the most to model predictions. It was found, interestingly, that the predictions are driven primarily by the accessible pore volume rather than the region occupied by the framework atoms.

36 MATERIALS SCIENCE↗

In Quest of Calibration Density and Consistency in Hydrologic Modeling: Distributed Parameter Calibration against Streamflow Characteristics

Conventional basin-by-basin approaches to calibrate hydrologic models are limited to gauged basins and typically result in spatially discontinuous parameter fields. Moreover, the consequent low calibration density in space falls seriously behind the need from present-day applications like high resolution river hydrodynamic modeling. In this study we calibrated three key parameters of the Variable Infiltration Capacity (VIC) model at every 1/8° grid-cell using machine learning-based maps of four streamflow characteristics for the conterminous United States (CONUS), with a total of 52,663 grid-cells. This new calibration approach, as an alternative to parameter regionalization, applied to ungauged regions too. A key difference made here is that we tried to regionalize physical variables (streamflow characteristics) instead of model parameters whose behavior may often be less well understood. The resulting parameter fields no longer presented any spatial discontinuities and the patterns corresponded well with climate characteristics, such as aridity and runoff ratio. The calibrated parameters were evaluated against observed streamflow from 704/648 (calibration/validation period) small-to-medium-sized catchments used to derive the streamflow characteristics, 3941/3809 (calibration/validation period) small-to-medium-sized catchments not used to derive the streamflow characteristics as well as five large basins. Comparisons indicated marked improvements in bias and Nash-Sutcliffe efficiency. Model performance was still poor in arid and semiarid regions, which is mostly due to both model structural and forcing deficiencies. Although the performance gain was limited by the relative small number of parameters to calibrate, the study and results here served as a proof-of-concept for a new promising approach for fine-scale hydrologic model calibrations.

54 ENVIRONMENTAL SCIENCES↗

Validation of Artemis I Aerothermal Design Models Using Developmental Flight Instrumentation

The inaugural flight of the Space Launch System (SLS) Block 1 launch vehicle, Artemis I, occurred on November 16, 2022, and featured a full suite of Developmental Flight Instrumentation (DFI) that provided aerothermodynamic measurements to assess thermal design and substantiate aerothermodynamic models. The Block 1 launch vehicle aerothermal instrumentation consisted of approximately 277 aerothermal gauges mounted throughout the Orion Multi-Purpose Crew Vehicle (MPCV), Integrated Spacecraft and Payload Element (ISPE), Core Stage (CS) and Solid Rocket Boosters (SRB) and an additional 179 thermal gauges on the Orion Crew Module (CM). Instrumentation included calorimeters, radiometers, pressure transducers, gas temperature probes, and thermocouples. Data was collected from lift-off through CS Main Engine Cut-Off (MECO). The flight data was invaluable for determining aerothermal model performance and developing flight-derived aerothermal environments for flight reconstruction thermal analysis and future SLS aerothermal models. The data offered critical insights into the aerothermodynamic conditions experienced during the launch and ascent of the SLS vehicle. This study compares the flight derived environments to pre-existing design models. The aerothermal models were constructed using MINIVER, the aerothermal engineering code which predicts aerodynamic heating and acts as an integration tool for incorporating databases from computational fluid dynamics (CFD) simulations and wind tunnel test data. The comparisons reveal the fidelity of the design models, highlighting areas where the design models accurately predicted flight conditions and instances where deviations were observed. Preliminary results suggest that while the design models largely aligned with the observed flight data, there were unique observations that reflected needed areas of model refinement. Aerothermal flight data from Artemis I for the SLS Block 1 vehicle will be further utilized to enhance the accuracy of Block 1B and Block 2 aerothermal models, ensuring improved safety and performance for subsequent Artemis missions.

aerothermodynamics↗

Validation of Artemis I Aerothermal Design Models Using Developmental Flight Instrumentation

The inaugural flight of the Space Launch System (SLS) Block 1 launch vehicle, Artemis I, occurred on November 16, 2022, and featured a full suite of Developmental Flight Instrumentation (DFI) that provided aerothermodynamic measurements to assess thermal design and substantiate aerothermodynamic models. The Block 1 launch vehicle aerothermal instrumentation consisted of approximately 277 aerothermal gauges mounted throughout the Orion Multi-Purpose Crew Vehicle (MPCV), Integrated Spacecraft and Payload Element (ISPE), Core Stage (CS) and Solid Rocket Boosters (SRB) and an additional 179 thermal gauges on the Orion Crew Module (CM). Instrumentation included calorimeters, radiometers, pressure transducers, gas temperature probes, and thermocouples. Data was collected from lift-off through CS Main Engine Cut-Off (MECO). The flight data was invaluable for determining aerothermal model performance and developing flight-derived aerothermal environments for flight reconstruction thermal analysis and future SLS aerothermal models. The data offered critical insights into the aerothermodynamic conditions experienced during the launch and ascent of the SLS vehicle. This study compares the flight derived environments to pre-existing design models. The aerothermal models were constructed using MINIVER, the aerothermal engineering code which predicts aerodynamic heating and acts as an integration tool for incorporating databases from computational fluid dynamics (CFD) simulations and wind tunnel test data. The comparisons reveal the fidelity of the design models, highlighting areas where the design models accurately predicted flight conditions and instances where deviations were observed. Preliminary results suggest that while the design models largely aligned with the observed flight data, there were unique observations that reflected needed areas of model refinement. Aerothermal flight data from Artemis I for the SLS Block 1 vehicle will be further utilized to enhance the accuracy of Block 1B and Block 2 aerothermal models, ensuring improved safety and performance for subsequent Artemis missions.

aerothermodynamics↗

A framework for benchmarking land models

Land models, which have been developed by the modeling community in the past few decades to predict future states of ecosystems and climate, have to be critically evaluated for their performance skills of simulating ecosystem responses and feedback to climate change. Benchmarking is an emerging procedure to measure performance of models against a set of defined standards. This paper proposes a benchmarking framework for evaluation of land model performances and, meanwhile, highlights major challenges at this infant stage of benchmark analysis. The framework includes (1) targeted aspects of model performance to be evaluated, (2) a set of benchmarks as defined references to test model performance, (3) metrics to measure and compare performance skills among models so as to identify model strengths and deficiencies, and (4) model improvement. Land models are required to simulate exchange of water, energy, carbon and sometimes other trace gases between the atmosphere and land surface, and should be evaluated for their simulations of biophysical processes, biogeochemical cycles, and vegetation dynamics in response to climate change across broad temporal and spatial scales. Thus, one major challenge is to select and define a limited number of benchmarks to effectively evaluate land model performance. The second challenge is to develop metrics of measuring mismatches between models and benchmarks. The metrics may include (1) a priori thresholds of acceptable model performance and (2) a scoring system to combine data–model mismatches for various processes at different temporal and spatial scales. The benchmark analyses should identify clues of weak model performance to guide future development, thus enabling improved predictions of future states of ecosystems and climate. The near-future research effort should be on development of a set of widely acceptable benchmarks that can be used to objectively, effectively, and reliably evaluate fundamental properties of land models to improve their prediction performance skills.

Biophysical Processes↗

Bayesian performance evaluation of evapotranspiration models based on eddy covariance systems in an arid region

Abstract. Evapotranspiration (ET) is a major component of the land surface processinvolved in energy fluxes and energy balance, especially in the hydrologicalcycle of agricultural ecosystems. While many models have been developed aspowerful tools to simulate ET, there is no agreement on which model bestdescribes the loss of water to the atmosphere. This study focuses on twoaspects, evaluating the performance of four widely used ET models andidentifying parameters, and the physical mechanisms that havesignificant impacts on the model performance. The four tested models arethe Shuttleworth–Wallace (SW) model, Penman–Monteith (PM) model,Priestley–Taylor and Flint–Childs (PT–FC) model, and advection–aridity (AA)model. By incorporating the mathematically rigorous thermodynamicintegration algorithm, the Bayesian model evidence (BME) approach is adoptedto select the optimal model with half-hourly ET observations obtained at aspring maize field in an arid region. Our results reveal that the SW model has thebest performance, and the extinction coefficient is not merely partitioningthe total available energy into the canopy and surface but also includingthe energy imbalance correction. The extinction coefficient is wellconstrained in the SW model and poorly constrained in the PM model but notconsidered in PT–FC and AA models. This is one of the main reasons that theSW model outperforms the other models. Meanwhile, the good fitting of SWmodel to observations can counterbalance its higher complexity. In addition,the detailed analysis of the discrepancies between observations and modelsimulations during the crop growth season indicate that explicit treatmentof energy imbalance and energy interaction will be the primary way offurther improving ET model performance.

54 ENVIRONMENTAL SCIENCES↗

Performance and power modeling and prediction using MuMMI and 10 machine learning methods

Energy-efficient scientific applications require insight into how high performance computing system features impact the applications' power and performance. This insight can result from the development of performance and power models. Here, in this article, we use the modeling and prediction tool MuMMI (Multiple Metrics Modeling Infrastructure) and 10 machine learning methods to model and predict performance and power consumption and compare their prediction error rates. We use an algorithm-based fault-tolerant linear algebra code and a multilevel checkpointing fault-tolerant heat distribution code to conduct our modeling and prediction study on the Cray XC40 Theta and IBM BG/Q Mira at Argonne National Laboratory and the Intel Haswell cluster Shepard at Sandia National Laboratories. Our experimental results show that the prediction error rates in performance and power using MuMMI are less than 10% for most cases. By utilizing the models for runtime, node power, CPU power, and memory power, we identify the most significant performance counters for potential application optimizations, and we predict theoretical outcomes of the optimizations. Based on two collected datasets, we analyze and compare the prediction accuracy in performance and power consumption using MuMMI and 10 machine learning methods.

97 MATHEMATICS AND COMPUTING↗

Anomaly Detection in Seismic Data with Deep Learning: Application for Instrument Failure Detection and Forecasting

Seismic data quality assessment (QA) is the first and one of the most important steps before conducting any further data analysis. Traditional methods involve checking various metrics, such as spike detection and power spectral density, by setting strict thresholds or comparing data against synthetic benchmarks. However, these approaches often rely on pre-existing knowledge and assumptions about data anomalies, leading to potential misclassification of unusual cases. Here, in this study, we propose a deep autoencoder model, an unsupervised learning approach that evaluates data quality without making assumptions about normal and anomalous data, which can be used to identify deviations in recorded data that may indicate nascent instrument failure. We test the model with the U.S. International Monitoring System (IMS) seismic stations and demonstrate the capability of detecting anomalies on a monthly scale. This could prompt station operators to examine potential problems early, allowing sufficient time for instrument maintenance to prevent data outages. In addition, we use a new manually selected testing dataset to compare our model performance against two supervised machine learning (ML) approaches and a standard QA package, as baseline models. When applied to the dataset containing known data anomalies, performance of the supervised and unsupervised ML approaches is similar, with an accuracy of 88.1% for our model compared to ∼90% for the supervised ML approach and 78.2% for the standard QA package. Our model outperforms the baseline models when applied to new stations, where new types of data anomalies can be station-specific and not included in the training dataset. Finally, we show model transferability by training the model with data from the Global Seismograph Network only and applying it to the IMS network data. The results suggest that our model is generalizable and can be applied to new stations with good accuracy.

Lin, Jiun-Ting [Lawrence Livermore National Labora↗

Model-Scale Aerodynamic Performance Testing of Proposed Modifications to the NASA Langley Low Speed Aeroacoustic Wind Tunnel

Tests were performed on a 1/20th-scale model of the Low Speed Aeroacoustic Wind Tunnel to determine the performance effects of insertion of acoustic baffles in the tunnel inlet, replacement of the existing collector with a new collector design in the open jet test section, and addition of flow splitters to the acoustic baffle section downstream of the test section. As expected, the inlet baffles caused a reduction in facility performance. About half of the performance loss was recovered by addition the flow splitters to the downstream baffles. All collectors tested reduced facility performance. However, test chamber recirculation flow was reduced by the new collector designs and shielding of some of the microphones was reduced owing to the smaller size of the new collector. Overall performance loss in the facility is expected to be a 5 percent top flow speed reduction, but the facility will meet OSHA limits for external noise levels and recirculation in the test section will be reduced.

Booth, Earl R., Jr.↗

Prediction of Potential and Actual Evapotranspiration Fluxes Using Six Meteorological Data-Based Approaches for a Range of Climate and Land Cover Types

Evapotranspiration is the major component of the water cycle, so a correct estimate of this variable is fundamental. The purpose of the present research is to assess the monthly scale accuracy of six meteorological data-based models in the prediction of evapotranspiration (ET) losses by comparing the modelled fluxes with the observed ones from eight sites equipped with eddy covariance stations which differ in terms of vegetation and climate type. Three potential ET methods (Penman-Monteith, Priestley-Taylor, and Blaney-Criddle models) and three actual ET models (the Advection-Aridity, the Granger and Gray, and the Antecedent Precipitation Index method) have been proposed. The findings show that the models performances differ from site to site and they depend on the vegetation and climate characteristics. Indeed, they show a wide range of error values ranging from 0.18 to 2.78. It has been not possible to identify a single model able to outperform the others in each biome, but in general, the Advection-Aridity approach seems to be the most accurate, especially when the model calibration in not carried out. It returns very low error values close to 0.38. When the calibration procedure is performed, the most accurate model is the Granger and Gray approach with minimum error of 0.13 but, at the same time, it is the most impacted by this process, and therefore, in a context of data scarcity, it results the less recommended for ET prediction. The performances of the investigated ET approaches have been furthermore tested in case of lack of measured data of soil heat fluxes and net radiation considering using empirical relationships based on meteorological data to derive these variables. Results show that, the use of empirical formulas to derive ET estimates increases the errors up to 200% with the consequent loss of model accuracy.

net radiation↗

Performance of Allison Model 400-C6 Turbojet-Engine Compressor: Over-All Performance Characteristics of Compressor at Equivalent Impeller Speeds of 6000, 7000, and 8500 RPM - I

The Allison model 400-C6 compressor was operated at an inlet pressure of 12 inches of mercury absolute ana ambient inlet temperature at equivalent impeller speeds of 6000, 7000, and 8500 rpm. Additional runs at an equivalent speed of 7000 rpm and ambient inlet temperature were made at inlet pressures from 7 to 22 inches of mercury absolute. The results of this investigation are compared with those of the 533-A-23 compressors. For the speeds investigated, the Allison model 400-C6 compressor had a maximum adiabatic temperature-rise efficiency of 0.768 at an equivalent speed of 7000 rpm; the corresponding equivalent weight flow was 45.0 pounds per second and the pressure ratio was 1.83. At an equivalent impeller speed of 8500 rpm, the maximum equivalent weight flow was 61.6 pounds per second and the peak pressure ratio of 2.38 occurred at an equivalent weight flow of 52.2 pounds per 1 second and an adiabatic temperature-rise efficiency of 0.714. At an equivalent speed of 7000 rpm, increasing the compressor- inlet pressure increased the maximum equivalent weight flow and the pressure ratio.

Kovach, Karl↗