SEARCH · Search NASA

Results for “Building benchmarking models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

All sources NASA NTRS DOE OSTI

DOE OSTI2025

Practical Introduction to Benchmarking and Characterization of Quantum Computers

Rapid progress in quantum technology has transformed quantum computing and quantum information science from theoretical possibilities into tangible engineering challenges. Breakthroughs in quantum algorithms, quantum simulations, and quantum error correction are bringing useful quantum computation closer to fruition. These remarkable achievements have been facilitated by advances in quantum characterization, verification, and validation (QCVV). QCVV methods and protocols enable scientists and engineers to scrutinize, understand, and enhance the performance of quantum information-processing devices. In this tutorial, we review the fundamental principles underpinning QCVV, and introduce a diverse array of QCVV tools used by quantum researchers. We define and explain QCVV’s core models and concepts—quantum states, measurements, and processes—and illustrate how these building blocks are leveraged to examine a target system or operation. We survey and introduce protocols ranging from simple qubit characterization to advanced benchmarking methods. Along the way, we provide illustrated examples and detailed descriptions of the protocols, highlight the advantages and disadvantages of each, and discuss their potential scalability to future large-scale quantum computers. This tutorial serves as a guidebook for researchers unfamiliar with the benchmarking and characterization of quantum computers, and also as a detailed reference for experienced practitioners.

open quantum systems & decoherence↗

DOE OSTI2024

Deployment and performance of a Low-Energy-Threshold Skipper-CCD inside a nuclear reactor

Charge Coupled Devices (CCD) are being used for reactor neutrino experiments and have already demonstrated their potential in constraining new physics models. The prospect of a Skipper-CCD experiment looking for standard and beyond standard model (BSM) physics in a nuclear reactor has been evaluated for different benchmark scenarios. Here, we report the first installation of a 2-g Skipper-CCD inside the containment building of a 2 GW th nuclear power plant and analyze its performance throughout its first 18 months of operation. The sensor was successfully deployed at Atucha II, in Argentina, 12 meters away from the center of the reactor core. We discuss the challenges involved in the commissioning of the detector and present data acquired during reactor ON and reactor OFF periods, with the sensor functioning with a sub-electron readout noise of 0.17 e - . Based on an exposure of 56.8 g day reactor ON and two reactor OFF data sets with a total exposure of 118.1 g day we characterize the system and evaluate the sensitivity to CEvNS. We achieved a background rate of 33 kdru and a low threshold of 45 eV ee . The ongoing efforts to improve sensitivities to CEvNS and BSM interaction are also discussed.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

DOE OSTI2022

Qualification of ANSI/HPS N13.1-2011 Mixing Criteria by Computational Fluid Dynamics Modeling for the 3430 Building Fan Addition and Increased Ventilation Capacity

Additional ventilation capacity has been designed for the 3430 Building filtered exhaust stack system. The updated system will increase the number of fans from two to three and include new ductwork with a larger diameter to integrate the new fan into the existing stack. Stack operations will involve running various fan combinations at any given time. The air monitoring system of the existing two-fan stack previously was found to comply with the American National Standards Institute/Health Physics Society (ANSI/HPS) N13.1-1999 standard. Full-scale, three-dimensional computational fluid dynamics (CFD) modeling was used to evaluate the modified three-fan system for compliance with the ANSI/HPS N13.1-2011 standard, which essentially is equivalent to the ANSI/HPS N13.1-1999 standard. The four mixing criteria evaluated are 1) flow angle, 2) velocity, 3) gas tracer, and 4) particle tracer. Benchmarking of the CFD modeling methodology showed good agreement with previous testing used to qualify the stack, and modeling of the existing two-fan system showed good agreement with test data collected from the 3430 Building stack. Modeling was performed to develop a suitable three-fan design. Initial modeling of the three-fan design and basic ductwork showed that flow angles and velocity uniformity were acceptable; however, the gas tracer and particle tracer mixing results were not acceptable. To meet ANSI/HPS N13.1-2011 criteria, an air blender was added to the stack design.

42 ENGINEERING↗

DOE OSTI2022

Qualification of ANSI/HPS N13.1-2011 Mixing Criteria by Computational Fluid Dynamics Modeling for the 3430 Building Fan Addition and Increased Ventilation Capacity

42 ENGINEERING↗

DOE OSTI2026

Multi‐Model Ensembles in Ecosystem Modeling: Challenges and Best Practices for Decision‐Making

Ecosystem models are increasingly central to the decision-making for environmental policy, conservation planning, and climate-related investments. Yet, the growing reliance on Multi-Model Ensembles (MMEs) of ecosystem models by practitioners and policymakers, sometimes under tight timelines and imperfect information, has frequently outpaced the scientific rigor required to ensure ensemble reliability. Here, MMEs refer to approaches that combine targeted predictions from multiple models with the expectation of improving robustness and quantifying predictive uncertainty. Poorly designed MMEs may create a false sense of confidence and lead to suboptimal policy and market decisions. This perspective argues that robust decision-making-relevant MMEs must be grounded on two pillars: (1) rigorous Model Intercomparison Projects (MIPs), which identify inter-model agreement and disagreement, characterize model uncertainties, and evaluate robustness with observationally based benchmarks—MIPs' diagnostic evaluation is so critical that it must be needed to drive MME's decision in model selection and weighting, especially when only a limited number of models available; and (2) co-design by both stakeholders and scientists to ensure that scenarios, metrics and uncertainty requirements provide decision-relevant information. Building upon the past success and lessons from the existing MIPs-MMEs efforts (e.g., climate/Earth system/crop), we derived the theoretical basis for MMEs, addressed their specific challenges in ecosystem modeling, and highlighted proper consideration of model numbers and diversity, risk of model inter-dependence, effective calibration of model parameters, possible overdue of some ecosystem model development, critical roles of open benchmark data across a wide range of conditions, and suggested use of Artificial Intelligence to support MIPs-MMEs. We highlighted the under-recognized opportunity for MIPs and MMEs to drive scientific progress and innovation through identifying better performing models, systematic benchmarking, feedback loops, and targeted model improvement. By following actionable best practice guidelines, MMEs can evolve from ad hoc aggregation of models into a trusted backbone of environmental policy and decision-making.

ecosystem modeling↗

DOE OSTI2023

TRANSLATE - a Monte Carlo simulation of electron transport in liquid argon

Here, the microphysics of electron and photon propagation in liquid argon is a key component of detector design and calibrations needed to construct and perform measurements within a wide range of particle physics experiments. As experiments grow in scale and complexity, and as the precision of their intended measurements increases, the development of tools to investigate important microphysics effects impacting such detectors becomes necessary. In this paper we present a new time-domain Monte Carlo simulation of electron transport in liquid argon. The simulation models the TRANSport in Liquid Argon of near-Thermal Electrons (TRANSLATE) with the aim of providing a multi-purpose software package for the study and optimization of detector environments, with a particular focus on ongoing and next generation liquid argon neutrino experiments utilizing the time projection chamber technology. TRANSLATE builds on previous work of Wojcik and Tachiya, amongst others, introducing additional processes, including ionization, thus modeling the full range of drift electron scattering interactions. The simulation is validated by benchmarking its performance with swarm parameters from data collected in experimental setups operating in gas and liquid.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

DOE OSTI2023

User Guide to the Facility Cybersecurity Capability Maturity Model (F-C2M2) Assessment

The Facility Cybersecurity Capability Maturity Model (F-C2M2) assessment was designed to help facilities address their unique cybersecurity challenges. Building upon the foundational principles of the U.S. Department of Energy (DOE) Cybersecurity Capability Maturity Model (C2M2), the F-C2M2 was explicitly tailored for federal facilities to help evaluate, benchmark, and enhance the cybersecurity capabilities of both their information technology (IT) and operational technology (OT) environments. This user guide was developed to facilitate a thorough understanding of the tool. Whether users are familiar with the original C2M2 or are new to the maturity model concept, this guide was designed to offer clarity, direction, and support.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2020

Stable and radioactive carbon isotope partitioning in soils and saturated systems: a reactive transport modeling benchmark study

This benchmark provides the first rigorous test of a three-isotope system [ 12 C, 13 C, and 14 C] subject to the combined effects of radioactive decay and both stable equilibrium and kinetic fractionation. We present a series of problems building in complexity based on the cycling of carbon in both organic and inorganic forms. The key components implement (1) equilibrium fractionation between multiple coexisting carbon species as a function of pH, (2) radioactive decay of radiocarbon with associated mass-dependent speciation demonstrating appropriate correction of the Δ 14 C value in agreement with reporting convention, and (3) kinetic stable isotope fractionation due to the oxidation of organic carbon to inorganic forms as a function of time and space in an open, through-flowing system. Participating RTM codes are CrunchTope, ToughReact, Hytec, and The Geochemist’s Workbench. Across all problem levels, simulation results from all RTMs demonstrate good agreement.

58 GEOSCIENCES↗

DOE OSTI2025

Reduced-order modeling for efficient cross section library development in high-temperature gas reactor pebble-bed depletion analysis

Accurate modeling of running-in and equilibrium conditions in pebble-bed reactors (PBRs) requires precise microscopic multigroup neutron cross sections. In Griffin, deterministic neutronics calculations rely on multivariate interpolation over large cross section libraries, resulting in significant memory usage and performance bottlenecks. This work, together with a companion paper on Griffin integration, explores reduced-order models (ROMs) to replace interpolation with lightweight surrogates. Several ROM techniques are benchmarked, with deep neural networks (DNNs) demonstrating superior memory efficiency, scalability, and predictive accuracy. A total of 295 DNNs were trained to build a comprehensive isotope library, integrated into Griffin through a custom LibTorch interface for depletion analysis. Initial results demonstrate that DNN-based ROMs drastically reduce memory demands while preserving accuracy, enabling finer tabulations and additional state variables without overhead. In conclusion, the framework also supports online cross section generation and real-time DNN updates through transfer learning, improving fidelity by capturing self-shielding and evolving nuclide compositions during burnup.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗

DOE OSTI2023

BuildingsBench: A Benchmark for Universal Building Load Forecasting [SWR-23-51]

The residential and commercial building stock in the United States is responsible for a significant percentage of energy consumption and greenhouse gas emissions. Electrification of end-uses, as well as decarbonizing the electrical grid through renewable energy sources such as solar and wind, constitutes the pathway to zero-emission buildings. Forecasting day-ahead building energy consumption is an integral part of this solution. Currently, specialized forecasting models are hand-made for each individual building, which is time-consuming, expensive, and leads to duplicated efforts. BuildingsBench is a Python software framework for training and comparing generalized machine learning models for universal building load forecasting. This challenge tasks a single foundational model to generalize its forecasts for a wide variety of buildings, across geographic regions, building types, weather patterns, and more. This software provide code for pre-training such models and subsequently evaluating their performance on a suite of hundreds of diverse real and synthetic buildings. BuildingsBench is a platform for: - Large-scale pretraining with the synthetic Buildings-900K dataset for short-term load forecasting (STLF). Buildings-900K is statistically representative of the entire U.S. building stock and is extracted from the NREL End-Use Load Profiles database. - Benchmarking on two tasks evaluating generalization: zero-shot STLF and transfer learning for STLF. We provide an index-based PyTorch Dataset for large-scale pretraining, easy data loading for multiple real building energy consumption datasets as PyTorch Tensors or Pandas DataFrames, simple (persistence) to advanced (transformer) baselines, metrics management, and more.

Emami, Patrick↗

DOE OSTI2022

Development of a Annual Air Handling Unit Fault Dataset for FDD Tools: Lessons Learned and Considerations for FDD Developers

As energy management and information systems (e.g., automated fault detection and diagnostics [AFDD] tools) become more prevalent in the commercial building stock, it is important to determine the effectiveness of these technologies by benchmarking their performance. The authors have been working to develop the largest publicly available dataset of HVAC fault data for performance benchmarking applications, covering the most common HVAC systems and designs including chiller plants, rooftop packaged units, dual duct air handling units and single duct air handling units. This study covers the development, modeling, and validation of a synthetic fault dataset for a single duct air handling unit (AHU), one of the most common HVAC configurations found in the commercial building stock. Despite this being a common system, real-world time series data are scarce and usually do not span a wide range of weather conditions. Due to this limitation, a detailed AHU model was employed to carry out annual simulations of numerous common sensor and mechanical faults, which were then validated by comparing their effects on system performance to expected symptoms. We summarize the nature of each fault and their impacts under different weather and operation conditions. Finally, we highlight considerations for FDD developers that may want to use this dataset to assess their algorithms’ performance and their improvement over time.

Casillas, Armando↗

DOE OSTI2020

GrAMME: Semisupervised Learning Using Multilayered Graph Attention Models

Modern data analysis pipelines are becoming increasingly complex due to the presence of multiview information sources. While graphs are effective in modeling complex relationships, in many scenarios, a single graph is rarely sufficient to succinctly represent all interactions, and hence, multilayered graphs have become popular. Though this leads to richer representations, extending solutions from the single-graph case is not straightforward. Consequently, there is a strong need for novel solutions to solve classical problems, such as node classification, in the multilayered case. In this article, we consider the problem of semisupervised learning with multilayered graphs. Though deep network embeddings, e.g., DeepWalk, are widely adopted for community discovery, we argue that feature learning with random node attributes, using graph neural networks, can be more effective. To this end, we propose to use attention models for effective feature learning and develop two novel architectures, GrAMME-SG and GrAMME-Fusion, that exploit the interlayer dependences for building multilayered graph embeddings. Using empirical studies on several benchmark data sets, we evaluate the proposed approaches and demonstrate significant performance improvements in comparison with the state-of-the-art network embedding strategies. The results also show that using simple random features is an effective choice, even in cases where explicit node attributes are not available.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2024

Observations of airflow around a supertall curved building and its impact on temperature and humidity in Houston's urban center

Characterization of realistically shaped skyscrapers embedded in non-uniform neighbourhoods experiencing intricate weather patterns remains inadequately investigated. Aiming to close this gap, the Center for Multiscale Applied Sensing team deployed its mobile observatory in the street canyons around the curved Wells Fargo Plaza skyscraper in downtown Houston, TX. Three deployments allowed airflow observations under different inflow wind and thermodynamic stability conditions. Doppler lidar measurements reveal that when inflow hits the curved wall of the skyscraper, perpendicular canyons experience similar vortex configurations creating two windward and two leeward circulations. Windsond measurements support that buoyancy within the deep street canyons can generate thermal updrafts as strong as 2 m s -1 which is sufficient to overturn the mechanical downwash under gentle wind conditions. Canyons experiencing venting during the daytime were observed to be more thermodynamically stable at night while thermodynamically stable canyons during the day were observed to be more thermodynamically unstable at night owing to the accumulation of heat near street-level. Fourier decomposition of the vertical velocity measurements shows that in all cases flow exhibited high Reynolds numbers and was composed of turbulent eddies of predominantly 6 and 15 min periods. Here, this observational dataset provides insights to assess wind load, pedestrian comfort, urban air mobility, and natural ventilation and may be used as a benchmark for numerical model and wind tunnel studies attempting to represent realistically complex urban conditions.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2026

Integral Nuclear Data and Benchmarking Needs for Fusion Energy Systems

Fusion energy systems are currently being designed and optimized using radiation transport codes. To deal with the unique environment inside a fusion-based system, many of these designs incorporate novel materials able to withstand the high radiation fields, ensure adequate cooling and thermal protection, and produce tritium. Validation plays a vital role in building trust in the predictive power of these models and computational methods. Validation of a code consists of modeling documented real-world experiments and comparing the code-predicted response to the measured response. Adequate validation requires measured responses from real-world experiments, also known as integral data, that mimic the system being designed, including materials, impinging radiation, and temperature, among other variables. The most trusted integral data are experimental responses that have been through a rigorous benchmarking process that develops a recommended computational model and evaluates all experimental uncertainties. Finally, there are a few research groups around the world that have been producing integral data for fusion applications, but a substantial investment is needed to address the unique validation needs of the fusion community.

Fusion↗

DOE OSTI2022

Distributed Wind Energy Futures Study

To better understand distributed wind opportunities in the United States, researchers at the U.S. Department of Energy's (DOE's) National Renewable Energy Laboratory explored cost, performance, and valuation benchmarks necessary for distributed wind to achieve widespread commercial viability in the United States by 2035. Building on DOE's prior benchmark report "Assessing the Future of Distributed Wind: Opportunities for Behind-the-Meter Projects", the new Distributed Wind Futures Study employs higher-resolution data and new modeling techniques to highlight geographic trends in technical and economic potential and to compare the cost and performance of distribution-connected, megawatt-scale wind applications (referred to as "front-of-the-meter" applications) and behind-the-meter systems, thereby informing the case for investment. The report identifies the best locations and sectors for behind-the-meter and front-of-the-meter applications and provides data to inform the trade-offs consumers face when deciding between distributed wind and solar photovoltaic (PV).

17 WIND ENERGY↗

DOE OSTI2022

Distributed Wind Energy Futures Study [Slides]

17 WIND ENERGY↗

DOE OSTI2022

Distinctive signals of frustrated dark matter

We study a renormalizable model of Dirac fermion dark matter (DM) that communicates with the Standard Model (SM) through a pair of mediators — one scalar, one fermion — in the representation (6, 1, $\frac{4}{3}$) of the SM gauge group SU(3) c x SU(2) L x U(1) Y . While such assignments preclude direct coupling of the dark matter to the Standard Model at tree level, we examine the many effective operators generated at one-loop order when the mediators are heavy, and find that they are often phenomenologically relevant. We reinterpret dijet and pair-produced resonance and jets + E$^{miss}_{T}$ searches at the Large Hadron Collider (LHC) in order to constrain the mediator sector, and we examine an array of DM constraints ranging from the observed relic density Ω χ h$^{2}_{Planck}$ to indirect and direct searches for dark matter. Tree-level annihilation, available for DM masses starting at the TeV scale, is required in order to produce Ω χ h$^{2}_{Planck}$ through freeze-out, but loops — led by the dimension-five DM magnetic dipole moment — are nonetheless able to produce signals large enough to be constrained, particularly by the XENON1T experiment. In some benchmarks, we find a fair amount of parameter space left open by experiment and compatible with freeze-out. In other scenarios, however, the open space is quite small, suggesting a need for further model-building and/or non-standard cosmologies.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

DOE OSTI2024

Machine learning in materials research: Developments over the last decade and challenges for the future

The number of studies that apply machine learning (ML) to materials science has been growing at a rate of approximately 1.67 times per year over the past decade. In this review, I examine this growth in various contexts. First, I present an analysis of the most commonly used tools (software, databases, materials science methods, and ML methods) used within papers that apply ML to materials science. The analysis demonstrates that despite the growth of deep learning techniques, the use of classical machine learning is still dominant as a whole. It also demonstrates how new research can effectively build upon past research, particular in the domain of ML models trained on density functional theory calculation data. Next, I present the progression of best scores as a function of time on the matbench materials science benchmark for formation enthalpy prediction. In particular, a dramatic improvement of 7 times reduction in error is obtained when progressing from feature-based methods that use conventional ML (random forest, support vector regression, etc.) to the use of graph neural network techniques. Finally, I provide views on future challenges and opportunities, focusing on data size and complexity, extrapolation, interpretation, access, and relevance.

36 MATERIALS SCIENCE↗