Search NASA⌕ Search

SEARCH · Search NASA

Results for “Benchmark testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,711 records · Page 95

Evaluation of HEU-Beryllium Benchmark Experiments to Improve Computational Analysis of Space Reactors

An assessment was previously performed to evaluate modeling capabilities and quantify preliminary biases and uncertainties associated with the modeling methods and data utilized in designing a nuclear reactor such as a beryllium-reflected, highly-enriched-uranium (HEU)-O 2 fission surface power (FSP) system for space nuclear power. The conclusion of the previous study was that current capabilities could preclude the necessity of a cold critical test of the FSP; however, additional testing would reduce uncertainties in the beryllium and uranium cross-section data and the overall uncertainty in the computational models. A series of critical experiments using HEU metal were performed in the 1960s and 1970s in support of criticality safety operations at the Y-12 Plant. Of the hundreds of experiments, three were identified as fast-fission configurations reflected by beryllium metal. These experiments have been evaluated as benchmarks for inclusion in the International Handbook of Evaluated Criticality Safety Benchmark Experiments (IHECSBE). Further evaluation of the benchmark experiments was performed using the sensitivity and uncertainty analysis capabilities of SCALE 6. The data adjustment methods of SCALE 6 have been employed in the validation of an example FSP design model to reduce the uncertainty due to the beryllium cross section data.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

ENDF/B-VII.1 Nuclear Data for Science and Technology: Cross Sections, Covariances, Fission Product Yields and Decay Data

The ENDF/B-VII.1 library is our latest recommended evaluated nuclear data file for use in nuclear science and technology applications, and incorporates advances made in the five years since the release of ENDF/B-VII.0. These advances focus on neutron cross sections, covariances, fission product yields and decay data, and represent work by the US Cross Section Evaluation Working Group (CSEWG) in nuclear data evaluation that utilizes developments in nuclear theory, modeling, simulation, and experiment. The principal advances in the new library are: (1) An increase in the breadth of neutron reaction cross section coverage, extending from 393 nuclides to 423 nuclides; (2) Covariance uncertainty data for 190 of the most important nuclides, as documented in companion papers in this edition; (3) R-matrix analyses of neutron reactions on light nuclei, including isotopes of He, Li, and Be; (4) Resonance parameter analyses at lower energies and statistical high energy reactions for isotopes of Cl, K, Ti, V, Mn, Cr, Ni, Zr and W; (5) Modifications to thermal neutron reactions on fission products (isotopes of Mo, Tc, Rh, Ag, Cs, Nd, Sm, Eu) and neutron absorber materials (Cd, Gd); (6) Improved minor actinide evaluations for isotopes of U, Np, Pu, and Am (we are not making changes to the major actinides {sup 235,238}U and {sup 239}Pu at this point, except for delayed neutron data and covariances, and instead we intend to update them after a further period of research in experiment and theory), and our adoption of JENDL-4.0 evaluations for isotopes of Cm, Bk, Cf, Es, Fm, and some other minor actinides; (7) Fission energy release evaluations; (8) Fission product yield advances for fission-spectrum neutrons and 14 MeV neutrons incident on {sup 239}Pu; and (9) A new decay data sublibrary. Integral validation testing of the ENDF/B-VII.1 library is provided for a variety of quantities: For nuclear criticality, the VII.1 library maintains the generally-good performance seen for VII.0 for a wide range of MCNP simulations of criticality benchmarks, with improved performance coming from new structural material evaluations, especially for Ti, Mn, Cr, Zr and W. For Be we see some improvements although the fast assembly data appear to be mutually inconsistent. Actinide cross section updates are also assessed through comparisons of fission and capture reaction rate measurements in critical assemblies and fast reactors, and improvements are evident. Maxwellian-averaged capture cross sections at 30 keV are also provided for astrophysics applications. We describe the cross section evaluations that have been updated for ENDF/B-VII.1 and the measured data and calculations that motivated the changes, and therefore this paper augments the ENDF/B-VII.0 publication 'ENDF/B-VII.0: Next Generation Evaluated Nuclear Data Library for Nuclear Science and Technology,' Nuclear Data Sheets 107, 2931 (2006).

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Battery Electrolyte Design for Electric Vertical Takeoff and Landing (eVTOL) Platforms

Here, the development of robust and high-performance battery systems is crucial for the advancement of Electric Vertical Takeoff and Landing (eVTOL) vehicles for urban air mobility. This study evaluates the performance of different lithium-ion battery chemistries under Electric Vertical Takeoff and Landing (eVTOL) load profiles. The actual flight data coupled with physical models is used to create discharge profiles for testing on developed lithium-ion cells for eVTOLs. The performance of a standard liquid electrolyte (1.2 M LiPF 6 in EC:EMC), labeled Gen-2, is benchmarked and compared with a fast-charging electrolyte (1.2 M LiFSI in EC:EMC), labeled XFC. Cell analysis involves the use of various techniques, such as impedance spectroscopy, polarization curves, and capacity retention measurements. Capacity retention is stable for both systems over 500 cycles, but unique discharge capacity trends are observed for different mission segments. During the initial takeoff hover stages, Gen-2 electrolytes experience substantial voltage fade, while XFC electrolytes maintain consistent behavior. In general, the Gen-2 electrolyte demonstrated lower discharge overpotentials and higher decay during cycling compared to the XFC electrolyte. This work highlights the complexity of eVTOL battery behavior and provides insights into battery system design, contributing to the advancement of battery energy storage solutions for urban air mobility.

25 ENERGY STORAGE↗

Thermal and mechanical performance of gypsum composites containing fly ash cenosphere encapsulated phase change materials

Utilizing phase change materials (PCMs) within construction materials improves the thermal energy storage capabilities in the built environment. Notably, integrating PCMs into drywalls presents a promising avenue to reduce building energy use. However, incorporating PCMs into drywalls poses challenges, particularly reduced mechanical properties and workability limitations as it can adversely affect the hardening and cohesiveness of gypsum composites. To address these challenges, this study explores a novel strategy to incorporate PCMs into gypsum composites through fly ash cenosphere-encapsulated PCM, namely CenoPCM, aiming to enhance the mechanical properties and thermal conductivity over existing commercial counterparts. An experimental program was conducted to study the impact of the inclusion of CenoPCM on the mechanical and thermal performance of gypsum composites, and the results were compared to those of commercially available polymerencapsulated PCM benchmark (Micronal). The findings highlighted that PCM-charged samples exhibited up to 95.90 J/g (CenoPCM) of latent heat with 70 % CenoPCM loading. The results of mechanical tests also showed that CenoPCM outperformed its polymer-encapsulated counterpart, achieving 55 % higher mechanical strength on average. Here, this improvement is attributed to the rigid shell of fly ash cenosphere (FAC) serving as a PCM carrier, providing a skeleton-like structure to gypsum composites for higher load-bearing capacity. Additionally, hotbox tests demonstrated that the CenoPCM-charged wall panels yielded a 20 % higher thermal conductivity and a 22 % increased time lag compared to Micronal PCM-charged panels, indicating its potential to shift the peak load in buildings.

Ceno PCM↗

Evaluation of Phenylnaphthalenes as Heat Transfer Fluids for High Temperature Energy Applications

The thermodynamic properties of 1- and 2-phenyl substituted polyaromatic hydrocarbons have been measured and estimated under conditions relevant to heat transport applications almost to the critical point. Densities, vapor pressures, and heat capacity measurements were used to derive critical temperature, pressure and density for the phenylnaphthalenes. The thermal and radiolytic stability of 1-phenylnaphthalene was examined using thermogravimetric analysis, differential scanning calorimetery, and gamma irradiation. Low vapor pressure and resistance to thermal decomposition may make phenylnaphthalenes suitable for heat transfer applications involving parabolic solar collectors. In particular, 1-phenylnaphthalene has an advantage over high temperature inorganic salts for applications up to 800 K because it is a liquid at temperatures at or close to ambient. Thermal cycling would have to be restricted to temperatures below the critical point to avoid degradation of the fluid. Radiation stability was also tested by a 100 kGy irradiation of 1-phenylnaphthalene in a Co-60 irradiator. NMR analysis indicated 1.7 mol.% degradation, which although lower than observed for tributylphosphate/kerosene benchmark fluids for nuclear applications, is higher than that seen in imidazolium ionic liquids.

14 SOLAR ENERGY↗

Local Phasor-Based Control of DER Inverters for Voltage Regulation on Distribution Feeders

We introduce a new control paradigm termed Phasor-Based Control (PBC) to coordinate Distributed Energy Resources (DER) for improved voltage regulation and other objectives. PBC is a multi-layer control framework where the state of the distribution grid is represented by voltage phasors, and Phasor Measurement Units (PMUs) measure the state at critical points in the distribution grid. In the PBC paradigm, a supervisory controller (S-PBC) sets phasor targets which local controllers track. In this paper, we propose a Proportional Integral (PI) implementation for the local control layer (LPBC), to regulate real and reactive power output of distributed inverters to track a voltage phasor target computed by the supervisory layer. We tune the PI controller gains offline with a genetic algorithm that yields better performance than the Ziegler-Nichols method. We benchmark the proposed L-PBC controller against droop volt-var control (DVVC) and observe improved voltage regulation in simulation on the IEEE 13 node unbalanced test feeder (IEEE 13NF). Furthermore, by means of numerical simulation we observe the response of the L-PBC controllers to small and large grid disturbances. Simulations on larger feeders, IEEE 123-node and 647-node, demonstrate challenges with tuning controllers in setups with different amounts of power-voltage coupling.

42 ENGINEERING↗

Scaling laws in jet classification

We demonstrate the emergence of scaling laws in the benchmark top versus QCD jet classification problem in collider physics. Six distinct physically-motivated classifiers exhibit power-law scaling of the binary cross-entropy test loss as a function of training set size, with distinct power law indices. This result highlights the importance of comparing classifiers as a function of dataset size rather than for a fixed training set, as the optimal classifier may change considerably as the dataset is scaled up. We speculate on the interpretation of our results in terms of previous models of scaling laws observed in natural language and image datasets.

Batson, Joshua↗

Benchmark Imagery Project: Report on Generation of Synthetic Images

The “Benchmark Imagery” project is a DOE NA-22-funded effort whose three-year goal is to create a suite of imagery that can be used to test geospatial algorithms used for extracting semantic content from overhead images of industrial facilities (e.g., auto-annotation). The project is a collaborative effort between Los Alamos National Laboratory (LANL) and the Lawrence Livermore National Laboratory (LLNL). Although a variety of image modalities are used to capture overhead photographs of terrestrial facilities, the current focus of the effort of this project is on collecting and annotating conventional visual-band (RGB or RGB/NIR) images. Presently, the set of images consists of 114 airborne images of various US industrial facilities. We have annotated all of the images in the imagery set, using a constrained vocabulary of about a dozen general terms such as “building,” ”tower,” or “electrical substation.” The project plans to include synthetic and composite images in addition to actual photographs. In preparation for using synthetic images, we have built a proof-of-principle synthetic image of a fictitious nuclear power plant. This report describes the key aspects of creating that image.

97 MATHEMATICS AND COMPUTING↗

CRCNS22 Learning Rules in the Hippocampus and their Mapping to Neuromorphic Systems (Final Technical Report)

Large scale biologically-realistic computational models are key to investigating the interplay between structure and function in nervous systems, thus paving the way to new clinical methods and neuro-inspired computing solutions. This project focuses on the hippocampus, in particular the CA3-CA1 regions, due to their role in associative learning and memory, pattern separation and completion, and spatial navigation. Investigations into the neuronal organization and learning rule(s) of this circuit can shed light into how declarative memories are formed, stored, recalled and forgotten and inform computational, experimental and clinical neuroscience work. Our project aims at developing a novel data-driven methodology supported by a broad heterogeneous base of neuroscience experimental knowledge and inspired from advances in computer science and engineering. Specifically, this work will benchmark existing and new learning rules within a full-scale spiking neural network simulation of the CA3-CA1 region. The model will be based on an open-source repository, called the Hippocampome, which contains neuronal morphologies, firing patterns, synapse probabilities, and most other required parameters for all known neuron types in the rodent hippocampal formation. The model will be first trained in a supervised fashion for associative memory tasks using backpropagation through time traditionally used in computer science, enhanced with a new technique called the surrogate gradient method. This optimization method will be used to obtain a global loss minimization, but it is not biologically inspired as it assumes the use of data not locally available to the synapses. However, we propose its use as a benchmarking tool, to compare the training performance of local biologically plausible and hardware-mappable learning rules at scale. New rules or combinations will be proposed and tested as needed, based on the obtained results. Progress in this area will also drive the development of novel hardware-mappable algorithms for continual lifelong learning and categorization of new events from few presented examples. This project goes beyond the existing state-of-the-art by looking at large scale realistic neuronal circuits as networks trainable via global optimization methods such as surrogate gradient descent. The objective function of the brain that supports learning is largely unknown, but it is likely that it operates through local learning rules. Studying network trajectories around local minima as proposed in this work represents a useful strategy for understanding whether a network is training by using a specific (set of) learning rule(s). Starting from a completely untrained network is a challenging test since it is difficult to determine how the learning rule affects the trajectory of the network. This interdisciplinary project will help understand what rule governs learning in these regions or if multiple learning rules are involved. The work will develop a robust methodology to measure if the network is converging to the target solution, oscillating around it, or diverging away.

59 BASIC BIOLOGICAL SCIENCES↗

Construction, installation and operation of ProtoDUNE-SP

The single-phase liquid argon TPC at CERN (ProtoDUNE-SP) is an engineering prototype for the first module of the DUNE far detector. This prototype, which has dimensions of a cube of about 10 m edge, provides full validation of the use of the membrane tank technology for large dimension cryostats. Furthermore, the very high performance of the protoDUNE-SP TPC with more than 500 days of continuous and stable operation, demonstrated the reliability of the LAr detection technology at a scale never tested before. In this talk we will review the main characteristics and milestones of the construction and installation of protoDUNE-SP which provide a series of benchmarks for DUNE. The performance for several different detector working points will also be discussed.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Albany/FELIX: A parallel, scalable and robust, finite element, first-order Stokes approximation ice sheet solver built for advanced analysis

This paper describes a new parallel, scalable and robust finite element based solver for the first-order Stokes momentum balance equations for ice flow. The solver, known as Albany/FELIX , is constructed using the component-based approach to building application codes, in which mature, modular libraries developed as a part of the Trilinos project are combined using abstract interfaces and template-based generic programming, resulting in a final code with access to dozens of algorithmic and advanced analysis capabilities. Following an overview of the relevant partial differential equations and boundary conditions, the numerical methods chosen to discretize the ice flow equations are described, along with their implementation. The results of several verification studies of the model accuracy are presented using (1) new test cases for simplified two-dimensional (2-D) versions of the governing equations derived using the method of manufactured solutions, and (2) canonical ice sheet modeling benchmarks. Model accuracy and convergence with respect to mesh resolution are then studied on problems involving a realistic Greenland ice sheet geometry discretized using hexahedral and tetrahedral meshes. Also explored as a part of this study is the effect of vertical mesh resolution on the solution accuracy and solver performance. The robustness and scalability of our solver on these problems is demonstrated. Lastly, we show that good scalability can be achieved by preconditioning the iterative linear solver using a new algebraic multilevel preconditioner, constructed based on the idea of semi-coarsening.

54 ENVIRONMENTAL SCIENCES↗

Field Study of Performance, Comfort, and Sizing of Two Variable-Speed Heat Pumps Installed in a Single 2-Story Residence

With the recent advancements in the application of variable-speed (VS) compressors to residential HVAC systems, opportunities are now available to size heat pumps (HPs) to more effectively meet heating and cooling loads in many of the climate zones in the US with limited use of inefficient resistance heat. This is in contrast to sizing guidance for traditional single-speed HPs that limits the ability to oversize with regard to cooling loads, because of risks of poor dehumidification during the cooling season and increased cycling losses. VS-drive HPs can often run at 30-40% of their rated cooling capacity to reduce cycling losses, and can adjust fan speed to provide better indoor humidity control. Detailed air-side performance data was collected on two VS-drive heat pumps installed in a single unoccupied research house in Knoxville, TN, a mixed-humid climate. One system provided space conditioning for the upstairs, while the other unit provided space conditioning for the downstairs. Occupancy was simulated by operating the lights, shower, appliances, other plug loads, etc. to simulate the sensible and latent loads imposed on the building space by internal electric loads and human occupants according to the Building America Research Benchmark (2008). The seasonal efficiency and energy use of the units are calculated. Annual energy use is compared to that of the single speed minimum efficiency HPs tested in the same house previously. Sizing of the units relative to the measured building load and manual J design load calculations is examined. The impact of the unit sizing with regards to indoor comfort is also evaluated.

Munk, Jeffrey D↗

wa-hls4ml and lui-gnn: A benchmark and GNN-based surrogate model for hls4ml resource and latency estimation

As machine learning (ML) increasingly serves as a tool for addressing real-time challenges in scientific applications, the development of advanced tooling has significantly reduced the time required to iterate on various designs. These advancements have solved major obstacles, but also exposed new challenges. For example, processes that were not previously considered bottlenecks, such as model synthesis, are now becoming limiting factors in the rapid iteration of designs. To reduce these emerging constraints, multiple efforts are being launched toward designing an ML-based surrogate model that estimates resource usage of synthesized accelerator architectures. This model would reduce the design iteration time, especially when designing within a set of given hardware constraints. This approach shows considerable potential, but as it stands, the effort is early and would benefit from coordination and standardization to assist future work as it emerges. We introduce wa-hls4ml, a benchmark for ML accelerator resource and latency estimation, and its corresponding initial dataset of more than 100,000 fully connected neural networks, all synthesized using hls4ml and targeting Xilinx FPGAs. In addition to the resource utilization and latency data provided, the dataset includes generated artifacts and log files for many of the synthesized neural networks, in order to support future research in ML-based code generation. The benchmark evaluates the performance of resource and latency predictors against several common ML model architectures, primarily originating from scientific domains, as exemplar models, as well as the average performance across a subset of the dataset. We measure the performance of a given predictor model through multiple metrics, including $R^2$ score and SMAPE on regression tasks, as well as inference time to further characterize the estimator under test. Additionally, we introduce the latency/utilization inference graph neural network (lui-gnn), a surrogate model that uses a graph neural network to represent input architectures in the form of a directed graph. This graph representation allows for a diverse set of model architectures to all be effectively handled by a surrogate model. We present the architecture and performance of the model, as evaluated by the new proposed benchmark, including SMAPE, $R^2$ score, and inference times, and find that lui-gnn generally predicts latency and utilization for the 75\% quantile within several percent of the synthesized resources on the synthetic test dataset, indicating that this approach of estimating resource and latency via a surrogate models has promise and warrants further research.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

JASMIN: Japanese-American study of muon interactions and neutron detection

Experimental studies of shielding and radiation effects at Fermi National Accelerator Laboratory (FNAL) have been carried out under collaboration between FNAL and Japan, aiming at benchmarking of simulation codes and study of irradiation effects for upgrade and design of new high-energy accelerator facilities. The purposes of this collaboration are (1) acquisition of shielding data in a proton beam energy domain above 100GeV; (2) further evaluation of predictive accuracy of the PHITS and MARS codes; (3) modification of physics models and data in these codes if needed; (4) establishment of irradiation field for radiation effect tests; and (5) development of a code module for improved description of radiation effects. A series of experiments has been performed at the Pbar target station and NuMI facility, using irradiation of targets with 120 GeV protons for antiproton and neutrino production, as well as the M-test beam line (M-test) for measuring nuclear data and detector responses. Various nuclear and shielding data have been measured by activation methods with chemical separation techniques as well as by other detectors such as a Bonner ball counter. Analyses with the experimental data are in progress for benchmarking the PHITS and MARS15 codes. In this presentation recent activities and results are reviewed.

43 PARTICLE ACCELERATORS↗

Quantum fluctuation theorem for error diagnostics in quantum annealers

Near term quantum hardware promises unprecedented computational advantage. Crucial in its development is the characterization and minimization of computational errors. We introduce the use of the quantum fluctuation theorem to benchmark the accuracy of quantum annealers. This versatile tool provides simple means to determine whether the quantum dynamics are unital, unitary, and adiabatic, or whether the system is prone to thermal noise. Our proposal is experimentally tested on two generations of the D-Wave machine, which illustrates the sensitivity of the fluctuation theorem to the smallest aberrations from ideal annealing. In addition, for the optimally operating D-Wave machine, our experiment provides the first experimental verification of the integral fluctuation in an interacting, many-body quantum system.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Multi-Mode Cavity Accelerator Structure

This project aimed to develop a prototype for a novel accelerator structure comprising coupled cavities that are tuned to support modes with harmonically-related eigenfrequencies, with the goal of reaching an acceleration gradient >200 MeV/m and a breakdown rate <10 -7 /pulse/meter. Phase I involved computations, design, and preliminary engineering of a prototype multi-harmonic cavity accelerator structure; plus tests of a bimodal cavity. A computational procedure was used to design an optimized profile for a bimodal cavity with high shunt impedance and low surface fields to maximize the reduction in temperature rise ΔT. This cavity supports the TM010 mode and its 2nd harmonic TM011 mode. Its fundamental frequency is at 12 GHz, to benchmark against the empirical criteria proposed within the worldwide High Gradient collaboration for X-band copper structures; namely, a surface electric field E sur max < 260 MV/m and pulsed surface heating ΔT max < 56 °K. With optimized geometry, amplitude and relative phase of the two modes, reductions are found in surface pulsed heating, modified Poynting vector, and total RF power—as compared with operation at the same acceleration gradient using only the fundamental mode.

43 PARTICLE ACCELERATORS↗

Reference Model 2 Scaled Geometry (RM2: River Current Turbine)

Contains the Reference Model 2 (RM2) scaled scale geometry files of the River Current Turbine, developed by the Reference Model Project (RMP). These scaled geometry files are saved as SolidWorks assembly, IGS, and STEP files, and require a CAD program to view. The scaled RM2 device was tested at the Saint Anthony Falls Laboratory (SAFL) at the University of Minnesota flume. The scale of the geometries included in this submission are at a 1:15 scale compared to the full scale geometry. This data was generated upon completion of the project on September 30, 2014. The Reference Model Project (RMP), sponsored by the U.S. Department of Energy (DOE), was a partnered effort to develop open-source MHK point designs as reference models (RMs) to benchmark MHK technology performance and costs, and an open-source methodology for design and analysis of MHK technologies, including models for estimating their capital costs, operational costs, and levelized costs of energy. The point designs also served as open-source test articles for university researchers and commercial technology developers. The RMP project team, led by Sandia National Laboratories (SNL), included a partnership between DOE, three national laboratories, including the National Renewable Energy Laboratory (NREL), Pacific Northwest National Laboratory (PNNL), and Oak Ridge National Laboratory (ORNL), the Applied Research Laboratory of Penn State University, and Re Vision Consulting. Reference Model 2 (RM2) is a variable speed dual-rotor cross-flow river turbine that is deployed at the water?s surface. It was designed for deployment at a reference site modeled after a reach in the Mississippi River near Baton Rouge, Louisiana. The rotors are anchored to a two-pontoon vessel platform. Surface deployment of the turbine minimizes the handling requirements during deployment and recovery and reduces overall costs for all O&M activities, including allowing for easy access to the power conversion chain (PCC). The design (two rotors per platform) also reduces the environmental footprint and associated environmental compliance costs.

16 TIDAL AND WAVE POWER↗

The Necessity for Iteration in the Application of Numerical Simulation to EGS: Examples from the EGS Collab Test Bed 1

The United States Department of Energy, Geothermal Technologies Office (GTO) is funding a collaborative investigation of enhanced geothermal systems (EGS) processes at the meso-scale. This study, referred to as the EGS Collab project, is a unique opportunity for scientists and engineers to investigate the creation of fracture networks and circulation of fluids across those networks under in-situ stress conditions. The EGS Collab project is envisioned to comprise three experiments and the site for the first experiment is on the 4850 Level in phyllite of the Precambrian Poorman formation, at the Sanford Underground Research Facility, located at the former Homestake Gold Mine, in Lead, South Dakota. Principal objectives of the project are to develop a number of intermediate-scale field sites and to conduct well-controlled in situ experiments focused on rock fracture behavior and permeability enhancement. Data generated during these experiments will be compared against predictions of a suite of computer codes specifically designed to solve problems involving coupled thermal, hydrological, geomechanical, and geochemical processes. Comparisons between experimental and numerical simulation results will provide code developers with direction for improvements and verification of process models, build confidence in the suite of available numerical tools, and ultimately identify critical future development needs for the geothermal modeling community. Moreover, conducting thorough comparisons of models, modelling approaches, measurement approaches and measured data, via the EGS Collab project, will serve to identify techniques that are most likely to succeed at the Frontier Observatory for Research in Geothermal Energy (FORGE), the GTO's flagship EGS research effort. As noted, outcomes from the EGS Collab project experiments will serve as benchmarks for computer code verification, but numerical simulation additionally plays an essential role in designing these meso-scale experiments. This paper reviews specific numerical simulations supporting the design of experiments within Test Bed 1, a volume of phyllite rock under in-situ stress conditions off the western side of the West Access Drift on the 4850 Level, near Governor's Corner. Numerical simulations were executed prior to the start of hydraulic stimulation activities within Test Bed 1 following standard practices, using best estimates of principal stress conditions, thermal conditions, and the rock petrophysical properties, including geomechanical properties. These simulations indicated notching of the borehole would promote the initiation of transverse fractures, seismic magnitudes during the hydraulic stimulation would be below 0.1 magnitude on the Richter scale, a rock thermal conductivity of 5.0 W/m K yielded agreement with kISMET borehole temperature logs, back pressure on the production borehole would increase circulation across the test bed, and the production borehole would serve to halt propagation of the hydraulic fracture to the drift. Pre-existing natural fractures, heterogeneities in the rock properties, monitoring boreholes, and overlooked mine elements have prompted a second look at numerically modeling stimulation, fluid circulation, tracer migration, and thermal breakthrough. Numerical simulation is an invaluable tool for providing insight and understanding to complex physical processes. The success of simulations, however, often depends on including all of the salient features of the system in the founding conceptual model. This paper takes a retrospective look at examples where the conceptual model and simulation was sufficient to provide accurate forecasts and those where elements were missing, necessitating rethinking of the simulation.

15 GEOTHERMAL ENERGY↗