Search NASA⌕ Search

SEARCH · Search NASA

Results for “simulation evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 793 records · Page 44

Distribution Systems Planning and Analysis Framework for Indian Feeders - Partnership with BSES/BRPL

Integration of distributed energy resources (DER) such as photovoltaics, electric vehicles (EVs) and battery energy storage systems (BESS) is expected to rapidly increase in distribution systems in India. These grid edge resources can have adverse impacts on the grid and can provide additional revenue streams as well. To mitigate these impacts distribution planning and analysis is required. So this paper presents a framework which can be used to complete all steps involved in distribution planning and analysis. This framework uses data in the same format as is readily available with Indian utilities and processes it to generate detailed feeder models and loading profiles. This framework already includes multiple DER use cases such as peak shaving for BESS and EV demand modelling and can be easily extended to simulate a number of additional use cases. All of these use cases can be simulated in parallel for multi-year time series simulations using an integrated command line interface. A suit of grid readiness metrics are then evaluated for each simulation to determine required network upgrades and associated costs.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Distribution Systems Planning and Analysis Framework for Indian Feeders: Preprint

Integration of distributed energy resources (DER) such as photovoltaics, electric vehicles (EVs) and battery energy storage systems (BESS) is expected to rapidly increase in distribution systems in India. These grid edge resources can have adverse impacts on the grid and can provide additional revenue streams as well. To mitigate these impacts distribution planning and analysis is required. So this paper presents a framework which can be used to complete all steps involved in distribution planning and analysis. This framework uses data in the same format as is readily available with Indian utilities and processes it to generate detailed feeder models and loading profiles. This framework already includes multiple DER use cases such as peak shaving for BESS and EV demand modelling and can be easily extended to simulate a number of additional use cases. All of these use cases can be simulated in parallel for multi-year time series simulations using an integrated command line interface. A suit of grid readiness metrics are then evaluated for each simulation to determine required network upgrades and associated costs.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Identification of Mission Sensitivities with Mission Modeling from the One System Organization at Hanford - 13292

The Hanford site in southeast Washington contains approximately 207 million liters of radioactive and hazardous waste stored in 177 underground tanks. The U.S. Department of Energy's Office of River Protection is currently managing the Hanford waste treatment mission, which includes the storage, retrieval, treatment and disposal of the tank waste. Two recent studies, employing the modeling tools managed by the One System organization, have highlighted waste cleanup mission sensitivities. The Hanford Tank Waste Operations Simulator Sensitivity Study evaluated the impact that varying 21 different parameters had on the Hanford Tank Waste Operations Simulator model. It concluded that inaccuracies in the predicted phase partitioning of a few key components can result in significant changes in the waste treatment duration and in the amount of immobilized high-level waste that is produced. In addition, reducing the efficiency with which tank waste is retrieved and staged can increase mission duration. The 2012 WTP Tank Utilization Assessment concluded that flowsheet models need to include the latest low-activity waste glass algorithms or the waste treatment mission duration and the amount of low activity waste that is produced could be significantly underestimated. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Approaches for Autonomous Peer to Peer Communication: For Resilient Community Microgrids

The final phase of the Islandable Communications task of the SECURE project consisted of integrating the islandable communications network into a microgrid simulation at NREL. Initially integration was planned for a microgrid implemented as a mix of simulation and physical hardware. As the project evolved, the microgrid became fully simulated. The simulation environment was structured to break out the communication paths that would pass over a communication network in a field demonstration. The Islandable Communication network was integrated into the simulation environment, allowing both a commercial cellular carrier and a Private LTE network to be evaluated. The microgrid simulation showed differences in performance and behavior when operating over the wireless networks (compared to operating over wired Ethernet in the lab). These differences point to further research opportunities to better understand how microgrid communication carried over real-world or impaired networks affects the microgrid system behavior.

24 POWER TRANSMISSION AND DISTRIBUTION↗

A COMPARATIVE STUDY OF DENSITY FIELD ESTIMATION FOR GALAXIES: NEW INSIGHTS INTO THE EVOLUTION OF GALAXIES WITH ENVIRONMENT IN COSMOS OUT TO z ∼ 3

It is well-known that a galaxy’s environment has a fundamental influence in shaping its properties. We study the environmental effects on galaxy evolution, with an emphasis on the environment defined as the local number density of galaxies. The density field is estimated with different estimators (weighted adaptive kernel smoothing, 10th and 5th nearest neighbors, Voronoi and Delaunay tessellation) for a K{sub s} < 24 sample of ∼190,000 galaxies in the COSMOS field at 0.1 < z < 3.1. The performance of each estimator is evaluated with extensive simulations. We show that overall there is a good agreement between the estimated density fields using different methods over ∼2 dex in overdensity values. However, our simulations show that adaptive kernel and Voronoi tessellation outperform other methods. Using the Voronoi tessellation method, we assign surface densities to a mass complete sample of quiescent and star-forming galaxies out to z ∼ 3. We show that at a fixed stellar mass, the median color of quiescent galaxies does not depend on their host environment out to z ∼ 3. We find that the number and stellar mass density of massive (>10{sup 11} M{sub ⊙}) star-forming galaxies have not significantly changed since z ∼ 3, regardless of their environment. However, for massive quiescent systems at lower redshifts (z ≲ 1.3), we find a significant evolution in the number and stellar mass densities in denser environments compared to lower density regions. Our results suggest that the relation between stellar mass and local density is more fundamental than the color–density relation and that environment plays a significant role in quenching star-formation activity in galaxies at z ≲ 1.

79 ASTRONOMY AND ASTROPHYSICS↗

SU-E-J-66: Evaluation of a Real-Time Positioning Assistance Simulator System for Skull Radiography Using the Microsoft Kinect

Purpose: The purpose of this study is to investigate the feasibility of a low cost, small size positioning assistance simulator system for skull radiography using the Microsoft Kinect sensor. A conventional radiographic simulator system can only measure the three-dimensional coordinates of an x-ray tube using angle sensors, but not measure the movement of the subject. Therefore, in this study, we developed a real-time simulator system using the Microsoft Kinect to measure both the x-ray tube and the subject, and evaluated its accuracy and feasibility by comparing the simulated and the measured x-ray images. Methods: This system can track a head phantom by using Face Tracking, which is one of the functions of the Kinect. The relative relationship between the Kinect and the head phantom was measured and the projection image was calculated by using the ray casting method, and by using three-dimensional CT head data with 220 slices at 512 × 512 pixels. X-ray images were thus obtained by using a computed radiography (CR) system. We could then compare the simulated projection images with the measured x-ray images from 0 degrees to 45 degrees at increments of 15 degrees by calculating the cross correlation coefficient C. Results: The calculation time of the simulated projection images was almost real-time (within 1 second) by using the Graphics Processing Unit(GPU). The cross-correlation coefficients C are: 0.916; 0.909; 0.891; and, 0.886 at 0, 15, 30, and 45 degrees, respectively. As a result, there were strong correlations between the simulated and measured images. Conclusion: This system can be used to perform head positioning more easily and accurately. It is expected that this system will be useful for learning radiographic techniques by students. Moreover, it could also be used for predicting the actual x-ray image prior to x-ray exposure in clinical environments.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Earth System Model Aerosol–Cloud Diagnostics (ESMAC Diags) package, version 2: assessing aerosols, clouds, and aerosol–cloud interactions via field campaign and long-term observations

Abstract. Poor representations of aerosols, clouds, and aerosol–cloud interactions (ACIs) in Earth system models (ESMs) have long been the largest uncertainties in predicting global climate change. Huge efforts have been made to improve the representation of these processes in ESMs, and the key to these efforts is the evaluation of ESM simulations with observations. Most well-established ESM diagnostics packages focus on the climatological features; however, they lack process-level understanding and representations of aerosols, clouds, and ACIs. In this study, we developed the Earth System Model Aerosol–Cloud Diagnostics (ESMAC Diags) package to facilitate the routine evaluation of aerosols, clouds, and ACIs simulated the Energy Exascale Earth System Model (E3SM) from the US Department of Energy (DOE). This paper documents its version 2 functionality (ESMAC Diags v2), which has substantial updates compared with version 1 (Tang et al., 2022a). The simulated aerosol and cloud properties have been extensively compared with in situ and remote-sensing measurements from aircraft, ship, surface, and satellite platforms in ESMAC Diags v2. It currently includes six field campaigns and two permanent sites covering four geographical regions: the eastern North Atlantic, the central US, the northeastern Pacific, and the Southern Ocean. These regions produce frequent liquid- or mixed-phase clouds, with extensive measurements available from the DOE Atmospheric Radiation Measurement user facility and other agencies. ESMAC Diags v2 generates various types of single-variable and multivariable diagnostics, including percentiles, histograms, joint histograms, and heatmaps, to evaluate the model representation of aerosols, clouds, and ACIs. Select examples highlighting the capabilities of ESMAC Diags are shown using E3SM version 2 (E3SMv2). In general, E3SMv2 can reasonably reproduce many observed aerosol and cloud properties, with biases in some variables such as aerosol particle and cloud droplet sizes and number concentrations. The coupling of aerosol and cloud number concentrations may be too strong in E3SMv2, possibly indicating a bias in processes that control aerosol activation. Furthermore, the liquid water path response to a perturbed cloud droplet number concentration behaves differently in E3SMv2 and observations, which warrants further study to improve the cloud microphysics parameterizations in E3SMv2.

54 ENVIRONMENTAL SCIENCES↗

A Versatile Simulated Data Transport Layer for in Situ Workflows Performance Evaluation

In situ processing does not only allow scientific applications to face the explosion in data volume and velocity but also to address the time constraints of many simulation-analysis workflows by providing scientists with early insights about their applications at runtime. Multiple frameworks implement the concept of a data transport layer (DTL) to enable such in situ workflows. These tools are very versatile, directly or indirectly access the data generated on the same node, another node of the same compute cluster, or a completely distinct node, and allow data publishers and subscribers to run on the same computing resources or not. This versatility puts on researchers the onus of taking key decisions related to resource allocation and how to transport data to ensure the most efficient execution of their in situ workflows. However, domain scientists and workflow practitioners lack the appropriate tools to assess the respective performance of particular design and deployment options. In this paper we introduce a versatile simulated DTL designed to provide researchers with insights on the respective performance of different execution scenarios of in situ workflows. This open-source, standalone library builds on the SimGrid toolkit and can be linked to any SimGrid-based simulator. It facilitates the evaluation of the performance behavior, at scale, of different data transport configurations and the study of the effects of resource allocation strategies. We demonstrate the scalability, versatility, and accuracy of this simulated DTL by reproducing the execution of two synthetic benchmarks and of a real-world in situ workflow composed of an MPI application and a parallel data analysis. Results of simulations run on a single core show that the proposed library can simulate the interactions of tens of thousands of simulated processes deployed on two interconnected commodity clusters in a few seconds, and the execution by a thousand simulated processes of an in situ workflow in less than three minutes.

Suter, Fred [ORNL] (ORCID:0000000319021955)↗

Estimating Parameters of Delaminations in GRP Pipes Using Thermal NDE and ANN

Thermographic Non-Destructive Evaluation (TNDE) is one of the techniques that have been widely used over the decades to evaluate the integrity of structures. To meet the increased demand for robust and effective inspection in complex TNDE tasks, Artificial Neural Networks (ANNs) have been recently deployed in many problems. The aim of the paper is to adopt an inverse technique using ANNs in the field of TNDE to estimate various parameters of delamination in Glass Reinforced Polymer (GRP) pipes by supplying thermal contrast evolution data as input. A Radial Basis Network (RBN) is employed with 80 input and 3 output neurons. The estimation capability of the network was evaluated with the data obtained from numerical simulations. The overall absolute errors show that the estimation capability of ANN is good.

42 ENGINEERING↗

An open-source framework for simulation-based testing of buildings control strategies

Here this paper presents a simulation framework for evaluating building control strategies (BCSs), developed with VOLTTRON, an opensource platform that integrates data, devices, and systems for sensing and control applications, and is based on co-simulation interfaces. It realizes an integrated environment for both testing and deploying BCSs, thereby eliminating the need for having a dedicated implementation of BCS for testing. For the first time, this framework provides critical functionalities, including scalable communication management and time-drive simulation advance, i.e., advancing the simulation based on clock time. We applied this framework to evaluating two BCSs from ASHRAE Guideline 36-2008 and ASHRAE Standard 90.1-2019. The evaluation results show that those BCSs primarily benefit the heating operation by reducing gas usage but yield insignificant savings in electricity consumption. The results also emphasize the importance of tuning the parameters of the BCSs to achieve better performances.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DEATH OF A CLUSTER: THE DESTRUCTION OF M67 AS SEEN BY THE SLOAN DIGITAL SKY SURVEY

We probe the spatial and dynamical structure of the old open cluster M67 using photometric data from the Sloan Digital Sky Survey's sixth data release. Making use of an optimal contrast, or matched filter, algorithm, we map the distribution of high probability members of M67. We find an extended and elongated halo of likely members to a radius of nearly 60'. Our measured core radius of R{sub core} = 8.'24 +- 0.'60 is somewhat larger than that of previous estimates. We attribute the larger core radius measurement to the SDSS probing lower mass main sequence stars than has been done before for similar studies of M67, and the exclusion of post-main-sequence M67 members in the SDSS sample. We estimate the number of M67 members in our SDSS sample to be 1385 +- 67 stars. A lower limit on the binary fraction in M67 is measured to be 45%. A higher fraction of binary stars is measured in the core as compared to the halo, and the luminosity function of the core is found to be more depleted of low-mass stars. Thus, the halo is consistent with mass segregation within the cluster. The galactic orbit of M67 is calculated from recent proper motion and radial velocity determinations. The elongated halo is roughly aligned to the proper motion of the cluster. This appears to be a result of mass segregation due to the galactic tidal field. Our algorithm is run on Two Micron All Sky Survey photometry to directly compare to previous studies of M67. Decreasing core radii is found for stars with greater masses. We test the accuracy of our algorithm using 1000 artificial cluster Monte Carlo simulations. It is found that the matched filter technique is suitable for recovering low-density spatial structures, as well as measuring the binary fraction of the cluster.

79 ASTRONOMY AND ASTROPHYSICS↗

Quantitative Evaluation of Autonomous Driving in CARLA

There has been a great deal of recent advancements in end-to-end imitation and reinforcement learning for self-driving vehicles. Despite this, there is a severe lack of standardized metrics for evaluating the performance of autonomous self-driving agents. Existing metrics are generally lacking in their ability to capture a wide range of driving behaviors and compare the severity of different failure cases. In this work, we introduce the Quantitative Evaluation for Driving metric, or QED, which assigns a quantitative score from 0-100 that captures the quality of driving for any driving agent. Our QED metric assesses different aspects of driving behavior including the ability to stay in the center of the lane, avoid weaving and erratic behavior, follow the speed limit, and avoid collisions, and it can be used under a wide range of driving scenarios. To show the effectiveness of our QED metric, we compare the scores generated by QED against scores assigned by human evaluators on a total of 30 different drivers and 6 different towns in the CARLA driving simulator. In ``easy'' evaluation scenarios, where it is relatively straightforward to distinguish better drivers from worse drivers, QED attains an average Pearson correlation of 0.96 and average Spearman correlation of 0.97 when compared against human evaluators. In ``hard'' evaluation scenarios, where it is far more ambiguous how to rank/score different types of bad driving behavior, QED attains an average Pearson correlation of 0.82 and average Spearman correlation of 0.75 when compared against human evaluators, which are both slighter higher than when we compare human evaluators against each other. While QED may not capture every characteristic that defines good driving, we consider it an important foundation for reproducibility and standardization in the community.

Gao, Shang↗

Simulations for Tracking Cosmogenic Activation in Germanium and Copper

High-purity germanium (HPGe) detectors housed in copper cryostats and shielding materials are used in measurements of the extraordinarily rare nuclear decay process, neutrinoless double-beta decay (0νββ), and for dark matter searches. Cosmogenic production of 68Ge and 60Co in the germanium and copper represent an irreducible background to these experiments as the subsequent decays of these isotopes can mimic the signals of interest. These radioactive isotopes can be removed by chemical and/or isotopic separation, but begin to grow-in to the material after separation until the material is moved deep underground. This work is motivated by the need to have a reliable, experimentally benchmarked simulation tool for evaluating shielding materials used during transportation and near-surface manufacturing of experiment components. The resulting simulations tool has been used to enhance the effectiveness of an existing transport shield used to ship enriched germanium from the separations facility to the detector manufacturing facility.

Aguayo, Estanislao↗

GPU-based prompt gamma ray imaging from boron neutron capture therapy

Purpose: The purpose of this research is to perform the fast reconstruction of a prompt gamma ray image using a graphics processing unit (GPU) computation from boron neutron capture therapy (BNCT) simulations. Methods: To evaluate the accuracy of the reconstructed image, a phantom including four boron uptake regions (BURs) was used in the simulation. After the Monte Carlo simulation of the BNCT, the modified ordered subset expectation maximization reconstruction algorithm using the GPU computation was used to reconstruct the images with fewer projections. The computation times for image reconstruction were compared between the GPU and the central processing unit (CPU). Also, the accuracy of the reconstructed image was evaluated by a receiver operating characteristic (ROC) curve analysis. Results: The image reconstruction time using the GPU was 196 times faster than the conventional reconstruction time using the CPU. For the four BURs, the area under curve values from the ROC curve were 0.6726 (A-region), 0.6890 (B-region), 0.7384 (C-region), and 0.8009 (D-region). Conclusions: The tomographic image using the prompt gamma ray event from the BNCT simulation was acquired using the GPU computation in order to perform a fast reconstruction during treatment. The authors verified the feasibility of the prompt gamma ray image reconstruction using the GPU computation for BNCT simulations.

60 APPLIED LIFE SCIENCES↗

TU-FG-BRB-07: GPU-Based Prompt Gamma Ray Imaging From Boron Neutron Capture Therapy

Purpose: The purpose of this research is to perform the fast reconstruction of a prompt gamma ray image using a graphics processing unit (GPU) computation from boron neutron capture therapy (BNCT) simulations. Methods: To evaluate the accuracy of the reconstructed image, a phantom including four boron uptake regions (BURs) was used in the simulation. After the Monte Carlo simulation of the BNCT, the modified ordered subset expectation maximization reconstruction algorithm using the GPU computation was used to reconstruct the images with fewer projections. The computation times for image reconstruction were compared between the GPU and the central processing unit (CPU). Also, the accuracy of the reconstructed image was evaluated by a receiver operating characteristic (ROC) curve analysis. Results: The image reconstruction time using the GPU was 196 times faster than the conventional reconstruction time using the CPU. For the four BURs, the area under curve values from the ROC curve were 0.6726 (A-region), 0.6890 (B-region), 0.7384 (C-region), and 0.8009 (D-region). Conclusion: The tomographic image using the prompt gamma ray event from the BNCT simulation was acquired using the GPU computation in order to perform a fast reconstruction during treatment. The authors verified the feasibility of the prompt gamma ray reconstruction using the GPU computation for BNCT simulations.

60 APPLIED LIFE SCIENCES↗

Warm Water Oxidation Verification – Scoping and Stirred Reactor Tests

Scoping tests to evaluate the effects of agitation and pH adjustment on simulant sludge agglomeration and uranium metal oxidation at ~95°C were performed under Test Instructions(a,b) and as per sections 5.1 and 5.2 of this Test Plan prepared by AREVA. (c) The thermal testing occurred during the week of October 4-9, 2010. The results are reported here. For this testing, two uranium-containing simulant sludge types were evaluated: (1) a full uranium-containing K West (KW) container sludge simulant consisting of nine predominant sludge components; (2) a 50:50 uranium-mole basis mixture of uraninite [U(IV)] and metaschoepite [U(VI)]. This scoping study was conducted in support of the Sludge Treatment Project (STP) Phase 2 technology evaluation for the treatment and packaging of K-Basin sludge. The STP is managed by CH2M Hill Plateau Remediation Company (CHPRC) for the U.S. Department of Energy. Warm water (~95°C) oxidation of sludge, followed by immobilization, has been proposed by AREVA and is one of the alternative flowsheets being considered to convert uranium metal to UO 2 and eliminate H 2 generation during final sludge disposition. Preliminary assessments of warm water oxidation have been conducted, and several issues have been identified that can best be evaluated through laboratory testing. The scoping evaluation documented here was specifically focused on the issue of the potential formation of high strength sludge agglomerates at the proposed 95°C process operating temperature. Prior hydrothermal tests conducted at 185°C produced significant physiochemical changes to genuine sludge, including the formation of monolithic concretions/agglomerates that exhibited shear strengths in excess of 100 kPa (Delegard et al. 2007).

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

DetSuM: Detector Surrogate Model for LArTPC

In large neutrino experiments such as the Deep Underground Neutrino Experiment (DUNE), estimating detector response uncertainties typically requires simulation samples that consume substantial computing resources and time. To mitigate this challenge, we present DetSuM, an uncertainty-aware surrogate model designed to capture the detector response variations with reduced computing load compared to full simulations. This poster describes the construction and evaluation of DetSuM using simulation and reconstruction datasets in a rare-event search at DUNE. We assess DetSuM's ability to predict key detector-response variations and their associated uncertainties, discuss current limitations, and outline improvements to extend its validity in systematics studies of DUNE physics.

Li, Aobo [UC, San Diego]↗

Point design targets, specifications, and requirements for the 2010 ignition campaign on the National Ignition Facility

Point design targets have been specified for the initial ignition campaign on the National Ignition Facility [G. H. Miller, E. I. Moses, and C. R. Wuest, Opt. Eng. 443, 2841 (2004)]. The targets contain D-T fusion fuel in an ablator of either CH with Ge doping, or Be with Cu. These shells are imploded in a U or Au hohlraum with a peak radiation temperature set between 270 and 300 eV. Considerations determining the point design include laser-plasma interactions, hydrodynamic instabilities, laser operations, and target fabrication. Simulations were used to evaluate choices, and to define requirements and specifications. Simulation techniques and their experimental validation are summarized. Simulations were used to estimate the sensitivity of target performance to uncertainties and variations in experimental conditions. A formalism is described that evaluates margin for ignition, summarized in a parameter the Ignition Threshold Factor (ITF). Uncertainty and shot-to-shot variability in ITF are evaluated, and sensitivity of the margin to characteristics of the experiment. The formalism is used to estimate probability of ignition. The ignition experiment will be preceded with an experimental campaign that determines features of the design that cannot be defined with simulations alone. The requirements for this campaign are summarized. Requirements are summarized for the laser and target fabrication.

07 ISOTOPE AND RADIATION SOURCES↗