Search NASA⌕ Search

SEARCH · Search NASA

Results for “model performance”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 379 records · Page 21

Experimental and Simulation Analysis of Binary Mixtures of Biomass and Inert Material

A literature review was conducted to identify experiments on various scales of biomass combustion specific to circulating fluidized bed (CFB) combustors. Typical feedstock and inert bed material characteristics for biomass combustion in a CFB were gathered. This information was used to design laboratory-scale, non-reacting experiments on biomass-inert bed material mixtures in a 1-in. cylindrical test rig in the Multiphase Flow Analysis Laboratory (MFAL) in Morgantown, WV. The biomass chosen was a hardwood. Pellets from the hardwood were milled and sieved to obtain three size ranges—small, medium, and large. Three mass loadings of each of the biomass samples were fluidized with glass beads as the inert bed material to study the mixing characteristics under varying fluidizing gas velocities. Hydrodynamic data including pressure drop measurements at select vertical locations and video recordings of the mixture behavior were generated in this effort.

09 BIOMASS FUELS↗

On the applicability of various levels of detail for occupant behavior representation and modeling in building performance simulation

Occupant behavior (OB) is one of the significant sources of uncertainty in building performance simulation. While OB modeling has received increased attention in the past decade, research on the degree of granularity or level of detail (LoD) required for representing occupants is still in the nascent stages. This paper analyzes the modeling and applicability of three LoDs to represent occupants in building performance assessment. A medium-sized prototype office building located in Chicago, Illinois is used as the simulation case study. Ten occupant-centric attributes are adopted to develop the LoDs for OB representation. We first demonstrate the different modeling approaches required for simulating the three fidelity levels. Later, we illustrate the suitability of the developed LoDs in supporting six building performance use cases across different lifecycle stages. Furthermore, this study intends to provide guidance for the building simulation community on appropriate OB representation to support various use cases.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

The Corrected Distortion model for Lagrangian spray simulation of transcritical fuel injection

In this work, we present a detailed implementation and validation of the droplet modeling framework proposed by Dahms and Oefelein (2016) into the engine commercial CFD software CONVERGE using the User Defined Function (UDF) interface. The model accounts for the nonlinear deformation and oscillation experienced by liquid spray droplet injected into high pressure and temperature. Lagrangian spray simulations of Engine Combustion Network (ECN) Spray A are performed. Model validation against standard experimental measurements of liquid velocity, vapor mixture fraction is conducted. To perform more rigorous model validation, new experimental measurements based on Diffused Back Illumination (DBI) are introduced. The new measurements are processed for Projected Liquid Volume (PLV), which offers as close as possible one-to-one model validation for liquid penetration while offering new insights into the spray physics. Comparison with a One-D model based on adiabatic mixing theory by Siebers (1999) and Desantes et al. (2007) are also conducted. Through these model validation exercises, it is shown that the new framework improves liquid-phase penetration predictions, following a tendency for enhanced evaporation, compared to the standard approach for both Reynolds Average Navier Stokes (RANS) and Large Eddy Simulation (LES). Additionally, at the liquid length, maximum mixture fraction values predicted by the new approach are in good agreement those of an adiabatic mixing model. Qualitative analysis of the spray behaviors during the early stage of the injection process reveals that the proposed framework predicts significant increase in droplet evaporation rate with lower drop drag compared to the current standard approach.

42 ENGINEERING↗

Models for Resilience Design Patterns

Resilience plays an important role in supercomputers by providing correct and efficient operation in case of faults, errors, and failures. Resilience design patterns offer blueprints for effectively applying resilience technologies. Prior work focused on developing initial efficiency and performance models for resilience design patterns. This paper extends it by (1) describing performance, reliability, and availability models for all structural resilience design patterns, (2) providing more detailed models that include flowcharts and state diagrams, and (3) introducing the Resilience Design Pattern Modeling (RDPM) tool that calculates and plots the performance, reliability, and availability metrics of individual patterns and pattern combinations.

Kumar, Mohit↗

The Role of Deep Convection and Large-scale Circulation in Driving Model Spread in Low Cloud Feedback and Equilibrium Climate Sensitivity

This project aims to advance the understanding of the processes that drive the large uncertainties in climate change projections, use observations to constrain model physics and reduce the inter-model spread in equilibrium climate sensitivity (ECS). There are three major goals: 1) Characterize the representation of the physical pathways that link deep convection, large-scale circulation and low cloud feedback in CMIP6 model simulations and determine the relative contribution of each pathway to the CMIP6 model spread in low cloud feedback and ECS; 2) Use process-oriented diagnostics and multiple observations to evaluate CMIP6 model performance in capturing the observed cloud-circulation relation and deep convection characteristics including convective transition statistics and the bulk properties of mesoscale convective systems (MCSs). Error decomposition in CMIP6 models will be performed. 3) Conduct E3SM short-range hindcasts following the DOE Cloud-Associated Parameterizations Testbed (CAPT) protocol to pinpoint specific model parameters/processes that are crucial to the representation of deep convection, circulation, clouds and the pathways that connect them. We will modify convective parameters in E3SM and analyze the perturbed physics experiments (PPEs) to isolate model parameters that are critical to the uncertainty of ECS.

54 ENVIRONMENTAL SCIENCES↗

Understanding Solar Photovoltaic System Performance: An Assessment of 75 Federal Photovoltaic Systems

This report presents a performance analysis of 75 photovoltaic systems based on PV system production data collected as part of a FEMP Federal PV Performance Assessment project combined with co-incident insolation, and ambient temperature to analyze how actual performance compares with a performance model. FEMP collaborated with 17 Federal agencies and sub-agencies to collect the information required to analyze the performance of each system. The systems represent a total capacity of 30,714 kW and range in size from 1 kW to 4,043 kW, with an average size of 410 kW, and were installed between 2011 and 2020. The data is analyzed for Key Performance Indicators, Availability, Performance Ratio and Energy Ratio by comparing the measured production data to model production data. The System Advisor Model (SAM) combines a description of the system (such as inverter capacity, de-rating for temperature, balance-of-system efficiency) with environmental parameters (coincident solar and temperature data) to calculate predicted performance. The performance metrics are calculated by lining up the measured production data with the model estimate on an hour-by-hour, day-by-day, or month-by-month basis (depending on the interval resolution of the production data). A report with system description, photo of the system, special assumptions made for the site, graph of measured production and model production, table of key performance indicators, and links to O&M resources that might improve performance was produced and delivered to site and agency staff with a short on-line briefing.

14 SOLAR ENERGY↗

AGR-2 Compact 6-4-1 Post-Irradiation Examination Results

The Advanced Gas Reactor (AGR) Fuel Development and Qualification Program was established to perform research and development on tristructural isotropic (TRISO)-coated particle fuel to support deployment of a high-temperature gas-cooled reactor (HTGR). The work continues as part of the Advanced Reactor Technologies (ART) TRISO Fuel Program. The overarching goal of the program is to provide a baseline fuel qualification data set to support licensing and operation of an HTGR. To achieve these goals, the program includes the elements of fuel fabrication, irradiation, post-irradiation examination (PIE) and safety/heating testing, fuel performance modeling, and fission product transport (INL 2017). Several fuel irradiation experiments have been performed at the Advanced Test Reactor (ATR) at Idaho National Laboratory (INL), and additional irradiations are planned. These experiments are intended to provide data on fuel performance under irradiation, support fuel fabrication process development, qualify fuel for operating and accident conditions, provide irradiated fuel for accident testing, and support development of fuel performance and fission product transport models.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Characterizing the performance of node-aware strategies for irregular point-to-point communication on heterogeneous architectures

Supercomputer architectures are trending toward higher computational throughput due to the inclusion of heterogeneous compute nodes. These multi-GPU nodes increase on-node computational efficiency, while also increasing the amount of data to be communicated and the number of potential data flow paths. In this work, we characterize the performance of irregular point-to-point communication with MPI on heterogeneous compute environments through performance modeling, demonstrating the limitations of standard communication strategies for both device-aware and staging-through-host communication techniques. Presented models suggest staging communicated data through host processes then using node-aware communication strategies for high inter-node message counts. Notably, the models also predict that node-aware communication utilizing all available CPU cores to communicate inter-node data leads to the most performant strategy when communicating with a high number of nodes. Furthermore, model validation is provided via a case study of irregular point-to-point communication patterns in distributed sparse matrix–vector products. Importantly, we include a discussion on the implications model predictions have on communication strategy design for emerging supercomputer architectures.

97 MATHEMATICS AND COMPUTING↗

Development and testing of coarse-grained models for ultrasonic simulations of cast austenitic stainless steel

Ultrasonic inspection of cast austenitic stainless steel (CASS) in the nuclear industry is particularly challenging because of sound field scatter and attenuation caused by the coarse-grained microstructure. Modeling and simulation are important tools in ultrasonic testing, as they can be used to help address key aspects of inspections, such as developing new probe designs, predicting inspection reliability, and testing phased-array focal laws. However, developing a useful and reliable CASS model is challenging due to the many grain interfaces and crystalline orientations that must be captured. We demonstrate a method of creating a realistic CASS model that is usable in CIVA, a commercially available modeling and simulation software platform. Using polished and chemically etched sections, we generate models of a coarse-grained equiaxed specimen and a columnar specimen. We also test an alternative method of generating a coarse-grained model using Voronoi regions. We qualitatively compare sound field scatter and quantitatively compare sound field attenuation and beam partitioning in simulated sound fields to those of laboratory-measured sound fields. Results show that the Voronoi models perform as well as or better than the models based on actual grain morphology. Here we also show that model-to-model randomness in Voronoi grain structure can impact the magnitude of a simulated echo response by a factor of two or more. Although CASS models are potentially a good depiction of reality for a given scenario, they should not be considered representative since CASS morphology can change significantly from specimen to specimen or within the same specimen.

36 MATERIALS SCIENCE↗

Deep Learning Estimation of Daily Ground–Level NO 2 Concentrations from Remote Sensing Data

The limited number of nitrogen dioxide (NO 2 ) surface measurements calls for the development of highly accurate approaches to estimating surface NO 2 concentrations. In this study, we leverage a new satellite instrument, the TROPOspheric Monitoring Instrument (TROPOMI), along with other predictor variables, to estimate daily surface NO 2 concentrations over Texas in 2019. We use the deep convolutional neural network (Deep-CNN), an advanced deep learning algorithm, to obtain estimates and achieve a correlation coefficient (R) of 0.91, an index of agreement (IOA) of 0.95, and a mean absolute bias (MAB) of 1.75 ppb in surface NO 2 estimation. Additionally, we leverage a novel approach, SHapley Additive exPlanations (SHAP), to describe how Deep-CNN understands each predictor variable. The SHAP results show that the Deep-CNN model has an advanced understanding of the dataset, revealing that TROPOMI closely captures levels of NO 2 . In addition, we show the superiority of our Deep-CNN model at estimating surface NO 2 over other well-known machine learning and regression models in the field, including the support vector machines (SVM), random forest (RF), and multiple linear regression (MLR). Although SVM and RF show strong capabilities at estimating surface NO 2 concentrations, their accuracy is inferior to that of the Deep-CNN model, ranking second and third in model accuracy in this study. The MLR, however, shows a poor ability at NO 2 estimation and ranks last among all models. Furthermore, testing the impact of sample size on model performance, we also show that, compared to other models, Deep-CNN needs more samples to trigger its strength at surface NO 2 estimation.

54 ENVIRONMENTAL SCIENCES↗

Use of Event-Time Embeddings via RNN to Discern Novel Event Sequences in EHRs

In highly configurable health information technology (HIT) systems, such as VistA of the Veterans Health Administration, the variations in how the system is used among different healthcare facilities and how the data are recorded can be significant. Despite the successful standardization of care efforts, some of these variations can be indicative of HIT hazards and demand further investigation. In this work, we implemented a recurrent neural network (RNN) architecture to learn clinical provider order sequences and their temporal dynamics while predicting the orders' terminal state. We demonstrate model performance and provide a use case for the model discerning novel event sequences. This model is proposed to find novel event sequences in an operational environment.

Ozmen, Ozgur↗

ChIMES: A Machine-Learned Interatomic Model Targeting Improved Description of Condensed Phase Chemistry in Energetic Materials

In this report we detail completion of a Physics and Engineering Model Level Two Milestone targeting improved reactive interatomic potentials (IAPs) for energetic materials (EM) through machine learning. The specific goals of this milestone were to develop, validate, and document a new reactive molecular dynamics method for EM, based on machine learning by (1) generating databases of first-principles-derived forces, stresses, and energies for HN3 and 3,4-bis(3-nitrofurazan- 4-yl)furoxan (DNTF) (2) generate atomistic force fields from these databases via ML, and (3) benchmark model performance against first principles calculations. These goals were achieved by (1) further developing a machine learned reactive IAP and generation approach (i.e. the Chebyshev Interaction Model for Efficient Simulation or “ChIMES”), for which resulting IAPs can approach the predictive power of quantum-mechanical approaches at a fraction of the computational expense, and (2) applying the ChIMES framework to develop models for HN3 and DNTF. We find that for simple energetic materials like HN3, high accuracy ChIMES models can be obtained through application of a fitting approach that does not use active machine learning. We demonstrate the suitability of ChIMES models for simulations involving EM by using the HN3 model in multiscale shock technique simulations to predict the HN3 Chapman-Jouguet detonation state and investigate chemical evolution out to 1 ns following shock compression. This model is then used in larger direct shock (DS) simulations for a preliminary investigation of how bubbles (i.e. voids) influence material response under shock compression. We find that more complex EM (i.e. DNTF) necessitate a more sophisticated fitting approach, and develop a new active learning method and python tool to meet this challenge. We demonstrate that this fitting approach yields ChIMES models that out-perform commonly used standard reactive IAPs as well as semi-empirical quantum methods, and discuss the systematic improvability of these actively learned ChIMES models. We also describe challenges related to model development for EM such as DNTF, for which few experimental or previous simulation data are available (e.g. which could otherwise inform generation of training data). To overcome this issue, we establish a semi-empirical quantum ChIMES capability which can be used to efficiently map out relevant thermodynamic and configurational space, and generate ChIMES-IAP training data in a multiscale manner. We also show that these semi-empirical quantum ChIMES models can be used to generate predictions for the shock Hugoniot (the Hugoniot is the locus of thermodynamic states found in a shocked material) equation of state, investigate related thermochemistry, and explore carbon condensation following shock compression. This work represents a substantial advance in our atomistic modeling capability for EM that will provide much needed information on the chemistry of detonation for continued development of continuum models based on the Cheetah thermochemical code.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Evaluation of Deep Learning Model Architectures for Point-of-Care Ultrasound Diagnostics

Point-of-care ultrasound imaging is a critical tool for patient triage during trauma for diagnosing injuries and prioritizing limited medical evacuation resources. Specifically, an eFAST exam evaluates if there are free fluids in the chest or abdomen but this is only possible if ultrasound scans can be accurately interpreted, a challenge in the pre-hospital setting. In this effort, we evaluated the use of artificial intelligent eFAST image interpretation models. Widely used deep learning model architectures were evaluated as well as Bayesian models optimized for six different diagnostic models: pneumothorax (i) B- or (ii) M-mode, hemothorax (iii) B- or (iv) M-mode, (v) pelvic or bladder abdominal hemorrhage and (vi) right upper quadrant abdominal hemorrhage. Models were trained using images captured in 27 swine. Using a leave-one-subject-out training approach, the MobileNetV2 and DarkNet53 models surpassed 85% accuracy for each M-mode scan site. The different B-mode models performed worse with accuracies between 68% and 74% except for the pelvic hemorrhage model, which only reached 62% accuracy for all model architectures. These results highlight which eFAST scan sites can be easily automated with image interpretation models, while other scan sites, such as the bladder hemorrhage model, will require more robust model development or data augmentation to improve performance. With these additional improvements, the skill threshold for ultrasound-based triage can be reduced, thus expanding its utility in the pre-hospital setting.

47 OTHER INSTRUMENTATION↗

Dynamic domain kinematic modelling for predicting interflow over leaky impeding layers

Traditional Boussinesq or kinematic simulations of interflow (i.e., lateral subsurface flow) assume no leakage through the impeding layer and require a no-flow boundary condition at the ridge top. However, recent analyses of many interflow-producing landscapes indicate that leaky impeding layers are common, that most interflow percolates well before reaching the toe slope, and therefore, the downslope contributing length is shorter than the hillslope length. In watersheds characterised by perched interflow over a low conductivity layer through permeable topsoil, interflow with percolation may be modelled with a kinematic wave model using a mobile upslope boundary condition defining the hillslope portion contributing interflow to valleys. Here, we developed and applied a dynamic interflow model to simulate interflow using a downslope travel distance concept such that only the active contributing length is modelled at any time. The model defines a variable active area based on the depth of the perched layer, the topographic slope and the ratio of the hydraulic conductivity of topsoil to that of the impeding layer. It incorporates a two-layer soil moisture accounting water balance analysis, a pedo-transfer function, and percolation and evaporation routines to predict interflow rates in continuous and event-based scenarios. We tested the modelling concept on two sets of data (2-year dataset of rainfall observations for the continuous simulation and a multi-day irrigation experiment for the event simulation) from a 121-m-long open interflow collection trench on an experimental hillslope at the Savannah River Site, South Carolina. The continuous model simulation partially represented the observed interflow hydrograph and perched water depth in the experimental hillslope with correlation coefficients of 0.85 and 0.35, respectively. Model performance improved significantly at event-scale analysis. The modelling approach realistically represents interflow dynamics in hillslopes with leaky impeding layers and can be integrated into catchment-scale hydrology models for more detailed hillslope process modelling.

54 ENVIRONMENTAL SCIENCES↗

Evaluation of AGR-3/4 In-pile Silver Release Predictions Against Post-Irradiation Examination Measurements

Fuel performance modeling codes that accurately predict the transport of radionuclides in high-temperature gas-cooled reactors that utilize tristructural isotopic (TRISO) fuel particles are an important aspect of reactor safety analyses. One objective of the Advanced Gas Reactor (AGR)-3/4 experiment was to assess the transport of fission products through fuel particles and their subsequent release into the compact matrix and structural graphite materials. This was accomplished by irradiating uranium oxycarbide (UCO) driver fuel particles and designed-to-fail (DTF) particles to serve as known sources of fission products. The fission product of particular interest when it comes to such transport is silver (Ag-110 m), as it has a 250-day half-life and has relatively high mobility in the TRISO coating layers. Furthermore, to assess the current modeling capabilities and diffusion parameters employed in the fuel performance codes PARFUME and BISON, the fractional release of silver release predicted by the two codes were compared against post-irradiation examination measurements from the AGR-3/4 experiment.

AGR-3/4 Experiment↗

Machine learning for reactor power monitoring with limited labeled data

Real-time reactor power monitoring is critical for a variety of nuclear applications, spanning safety, security, operations, and maintenance. While machine learning methods have shown promise in monitoring reactor power levels, there is limited research on their efficacy in label-starved environments. The goal of this work is to assess the feasibility of classifying nuclear reactor power level using multisource data in scenarios with limited labels. Data were collected using low-resolution multisensors at four nuclear reactor facilities: two large research reactors and two TRIGA reactors. Within each pair, one reactor dataset served as the source and the other as the target in a transfer learning paradigm. Twenty-three supervised models were trained on labeled sequences of magnetic field and acceleration data from each of the target sites. Self-learning and transfer learning methods were applied to the top performing models to assess their classification performance with increasing amounts of labeled data. While reactor power level classification was achieved with a Matthews Correlation Coefficient of up to 0.739 ± 0.003 and 0.622 ± 0.009 with only 400 sequences per power state for the large research reactor and TRIGA target sites, respectively, self-learning and transfer learning leveraging source site data did not improve target classification performance. These findings suggest that alternative methods, such as higher sensitivity sensors, digital twins, or the use of physics-informed models, are required to enable high-performance classification in machine learning approaches to reactor monitoring with a dearth of target ground truth.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Expanded analysis of machine learning models for nuclear transient identification using TPOT

Industries around the world are becoming more and more data driven. The nuclear field is no exception with several different applications being proposed. One popular area of research is the use of machine learning in transient detection. This paper seeks to build upon a previous study which made use of the AutoML package TPOT to train traditional machine learning models to classify transient events occurring with a reactor. Synthetic data was once again collected using a GPWR reactor simulator. Data on 12 different events was collected using 15 different initial conditions. Here, a dataset consisting of over 100,000 data points was compiled and used to train 7 different machine learning models using a pre-defined TPOT dictionary with 12 different preprocessing techniques. Three of the trained models were able to produce validation results in the 90s with the expanded dataset. Once the models were trained, it was possible to look into where during the simulation, misclassifications occurred. Using these three models, analysis was done to determine if TPOT could be used to train models that were effective if important features were missing. The results from this were positive with the newly trained models scoring close to the original models. Finally, to conclude this study, the three high performing models were retrained using different random states to see if there was any major variation when different states were used.

42 ENGINEERING↗

Turbulence modeling to aid tidal energy resource characterization in the Western Passage, Maine, USA

Numerical models combined with field measurements are regularly used to characterize tidal energy resources at potential energetic sites. However, most existing works only focus on the tidal hydrodynamic characteristics, and turbulence parameters are often not reported because of the lack of high-quality turbulence measurements and the limitations of numerical models in resolving turbulent eddies. In this study, we used FVCOM - a hydrostatic primitive equation (HPE) model - to characterize the tidal energy resource in the Western Passage, Maine, USA, by taking care of the essential macro-scale turbulence properties. We observed an excellent model performance using the Mellor-Yamada Level 2.5 Turbulence Model; estimating the spatial and vertical distribution of the turbulent kinetic energy and intensity added a new perspective to the site ranking for tidal energy converter (TEC) deployments. In addition, we also examined the role of channel geometry and bathymetry, such as headlands and underwater sills, in enhancing turbulent eddies around potential TEC siting locations. Ultimately, the detailed analysis of the turbulent flow characteristics has changed the site-ranking results and demonstrated that the regional-scale HPE models could be used for the relative understanding of more or less turbulent sites for a refined resource assessment.

16 TIDAL AND WAVE POWER↗