Search NASA⌕ Search

SEARCH · Search NASA

Results for “Building benchmarking models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

LLNL IPD Tasks: ICSBEP and Pulsed Spheres Benchmark [Slides]

This lecture presented benchmark of the blank and polyethylene spheres at SINBAD in April 2023. In responding to comments about the building, we uncovered a large amount of additional detailed information about the building and experimental set up. We incorporated this new information into an even higher fidelity model and are working on uncertainty analysis at a low level. Scheduled to present at SINBAD meeting in April 2024.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗
DOE OSTI2026

Bayesian discovery of optimal reduced order models from mechanistic and experimental data: A case study of Pd penetration in TRISO fuels using BISON

TRistructural ISOtropic (TRISO) particles rely on a silicon carbide (SiC) layer as the primary structural material and barrier to metallic fission products (FPs) release. Accurate prediction of palladium (Pd) transport and penetration is therefore critical for qualifying TRISO fuels for advanced reactors. The empirical correlation for Pd penetration in BISON is derived from historical particle-fuel data, but cannot explain the large scatter in the experimental data that arises from varying experimental conditions. To aid fuel qualification, we previously developed a mechanistic reduced order model (ROM) using BISON that resolves these dependencies. Here, in this work we build on that mechanistic ROM and perform validation and quantify its uncertainty using Bayesian uncertainty quantification (UQ). calibration against a suite of in-pile and out-of-pile experiments spanning particle compositions, geometries, and operating conditions, and we benchmark it against the empirical correlation. Bayesian UQ identifies influential parameters, calibrates them to data, and yields predictive intervals. Results show that while the empirical correlation can be tuned to fit a single experiment type, it transfers poorly; the mechanistic ROM sustains accuracy with credible uncertainty across disparate conditions. This demonstrates a practical path—via Bayesian UQ applied to mechanistic ROMs—to leverage single-effect experiments for inferring in-reactor behavior and supporting TRISO fuel qualification.

11 - NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2026

Summary of GFL Inverter Capability and Performance: Malawi [Slides]

This presentation provides a comprehensive comparison of inverter-based resource (IBR) technical requirements across multiple international grid codes - including IEEE 2800, ESO, EirGrid, and Malawi's evolving regulatory framework - to support capacity building for electricity-sector institutions in Malawi. It highlights key performance expectations for grid-following (GFL) inverters across critical domains such as primary and fast frequency response, ramping behavior, frequency and voltage ride-through capabilities, reactive power and voltage control, ROCOF withstand, phase jump tolerance, system strength considerations, protection schemes, and dynamic modeling requirements. Emphasizing a "Do no harm, do something, do more" philosophy, the document synthesizes best practices and operational benchmarks to guide the integration and stability of inverter-based resources within Malawi's power system. The presentation forms part of the SABESS Center of Excellence initiative supported by the Global Energy Alliance for People and the Planet.

24 POWER TRANSMISSION AND DISTRIBUTION↗
NASA NTRS2000

Fixed-Order Mixed Norm Designs for Building Vibration Control

This study investigates the use of H2, mu-synthesis, and mixed H2/mu methods to construct full order controllers and optimized controllers of fixed dimensions. The benchmark problem definition is first extended to include uncertainty within the controller bandwidth in the form of parametric uncertainty representative of uncertainty in the natural frequencies of the design model. The sensitivity of H2 design to unmodeled dynamics and parametric uncertainty is evaluated for a range of controller levels of authority. Next, mu-synthesis methods are applied to design full order compensators that are robust to both unmodeled dynamics and to parametric uncertainty. Finally, a set of mixed H2/mu compensators are designed which are optimized for a fixed compensator dimension. These mixed norm designs recover the H2 design performance levels while providing the same levels of robust stability as the mu designs. It is shown that designing with the mixed norm approach permits higher levels of controller authority for which the H2 designs are destabilizing. The benchmark problem is that of an active tendon system. The controller designs are all based on the use of acceleration feedback.

Whorton, Mark S.↗
DOE OSTI2025

Enhancing Gaussian Process Surrogates for Optimization and Posterior Approximation via Random Exploration

This paper proposes novel noise-free Bayesian optimization strategies that rely on a random exploration step to enhance the accuracy of Gaussian process surrogate models. The new algorithms retain the ease of implementation of the classical GP-UCB algorithm, but the additional random exploration step accelerates their convergence, nearly achieving the optimal convergence rate. Furthermore, to facilitate Bayesian inference with intractable likelihoods, we propose to utilize optimization iterates for maximum a posteriori estimation to build a Gaussian process surrogate model for the unnormalized log-posterior density. We provide bounds for the Hellinger distance between the true and the approximate posterior distributions in terms of the number of design points. We demonstrate the effectiveness of our Bayesian optimization algorithms in nonconvex benchmark objective functions, in a machine learning hyperparameter tuning problem, and in a black-box engineering design problem. The effectiveness of our posterior approximation approach is demonstrated in two Bayesian inference problems for parameters of dynamical systems.

Bayesian inference↗
DOE OSTI2025

If We Build Them, They Will Run: Automated HPC Apps Deployment and Profiling with eBPF in Cloud

The high performance computing (HPC) community is in a period of transition. The rise of AI/ML coupled with a changing landscape of resources deems portability a new metric of performance, and methods to move between on-premises and cloud environments and assess compatibility are paramount. Here we design and test a strategy for bridging the gap between traditional HPC and Kubernetes environments – first containerizing applications, providing automated orchestration to run studies, and packaging the setup with automated means to assess performance using low overhead eXtended Berkeley Packet Filter (eBPF) programs. We first assess different designs for eBPF collection, demonstrating a tradeoff between number of programs deployed on a node and overhead added. We develop 5 low overhead eBPF programs that combine with streaming ML models to assess CPU, futex, TCP, shared memory, and file access across four different builds of an HPC application for CPU and GPU. We use eBPF data to generate insights into the possible underlying etiology of scaling issues. We then assess compatibility of a well-known benchmark, HPCG, across matrices of micro-architectures and optimization levels (217 containers across 24 instance types and over 7500 runs). We provide to the community 30 applications to deploy in our automated setup and perform a scaling study from 4 to a maximum of 256 nodes for both CPU and GPU applications. Finally, we use our gained knowledge about performance to generate compatibility artifacts that are used by a newly developed Kubernetes controller to intelligently select instance type based on optimizing a figure of merit. Along with insights to scaling in this environment with a collection of applications and templates to work from, we provide an overall strategy for approaching HPC application deployment and image selection based on compatibility in cloud.

Computer science↗
DOE OSTI2024

Phase Composition and Phase Transformation of Additively Manufactured Nickel Alloy 718 AM Bench Artifacts

Additive manufacturing (AM) technologies offer unprecedented design flexibility but are limited by a lack of understanding of the material microstructure formed under their extreme and transient processing conditions and its subsequent transformation during post-build processing. As part of the 2022 AM Bench Challenge, sponsored by the National Institute of Standards and Technology, this study focuses on the phase composition and phase evolution of AM nickel alloy 718, a nickel-based superalloy, to provide benchmark data essential for the validation of computational models for microstructural predictions. Here, we employed high-energy synchrotron X-ray diffraction, in situ synchrotron X-ray scattering, as well as high-resolution transmission electron microscopy for our analyses. The study uncovers critical aspects of the microstructure in its as-built state, its transformation during homogenization, and its phase evolution during subsequent aging heat treatment. Specifically, we identified secondary phases, monitored the dissolution and coarsening of microstructural elements, and observed the formation and stability of γ ’ and γ ” phases. The results provide the rigorous benchmark data required to understand the atomic and microstructural transformations of AM nickel alloy 718, thereby enhancing the reliability and applicability of AM models for predicting phase evolution and mechanical properties.

36 MATERIALS SCIENCE↗
DOE OSTI2024

BRAKER3: Fully automated genome annotation using RNA-seq and protein evidence with GeneMark-ETP, AUGUSTUS, and TSEBRA

Gene prediction has remained an active area of bioinformatics research for a long time. Still, gene prediction in large eukaryotic genomes presents a challenge that must be addressed by new algorithms. The amount and significance of the evidence available from transcriptomes and proteomes vary across genomes, between genes, and even along a single gene. User-friendly and accurate annotation pipelines that can cope with such data heterogeneity are needed. The previously developed annotation pipelines BRAKER1 and BRAKER2 use RNA-seq or protein data, respectively, but not both. A further significant performance improvement integrating all three data types was made by the recently released GeneMark-ETP. We here present the BRAKER3 pipeline that builds on GeneMark-ETP and AUGUSTUS, and further improves accuracy using the TSEBRA combiner. BRAKER3 annotates protein-coding genes in eukaryotic genomes using both short-read RNA-seq and a large protein database, along with statistical models learned iteratively and specifically for the target genome. We benchmarked the new pipeline on genomes of 11 species under an assumed level of relatedness of the target species proteome to available proteomes. BRAKER3 outperforms BRAKER1 and BRAKER2. The average transcript-level F1-score is increased by about 20 percentage points on average, whereas the difference is most pronounced for species with large and complex genomes. BRAKER3 also outperforms other existing tools, MAKER2, Funannotate, and FINDER. The code of BRAKER3 is available on GitHub and as a ready-to-run Docker container for execution with Docker or Singularity. Overall, BRAKER3 is an accurate, easy-to-use tool for eukaryotic genome annotation.

59 BASIC BIOLOGICAL SCIENCES↗
NASA NTRS2019

Predicting Transonic Flutter Using Nonlinear Computational Simulations

This paper builds on the computational aeroelastic results published previously and generated in support of the second Aeroelastic Prediction Workshop for the NASA Benchmark Supercritical Wing configuration. The computational results are obtained using FUN3D, an unstructured flow solver developed at the NASA Langley Research Center. Flutter analyses are performed using various aerodynamic models including linear doublet lattice, Euler solutions, Reynolds averaged Navier-Stokes and Delayed Detached Eddy Simulations. The analyses are performed across the transonic Mach range for a range in angle of attack from 0° to 5°, with focus on identifying the transonic dips in the flutter onset boundaries.

Heeg, Jennifer↗
DOE OSTI2022

Muonic force behind flavor anomalies

We develop an economical theoretical framework for combined explanations of the flavor physics anomalies involving muons: (g - 2) μ , R K(*), and b → sμ + μ - angular distributions and branching ratios, that was first initiated by some of us in ref. [1]. The Standard Model (SM) is supplemented with a lepton-flavored U(1) X gauge group. The U(1) X gauge boson with the mass of O(0.1) GeV resolves the (g - 2) μ tension. A TeV-scale leptoquark, charged under the U(1) X , carries a muon number and mediates B-decays without prompting charged lepton flavor violation or inducing proton decay. We explore the theory space of the chiral, anomaly-free U(1) X gauge extensions featuring the above scenario, and identify many suitable charge assignments for the SM+3ν R fermion content with the integer charges in the range X F i $\in$ [-10, 10]. We then carry out a comprehensive phenomenological study of the muonic force in representative benchmark models. Interestingly, we found models which can resolve the tension without conflicting the complementary constraints, and all of the viable parameter space will be tested in future muonic resonance searches. Finally, the catalog of the anomaly-free lepton-non-universal charge assignments motivated us to explore different directions in model building. We present a model in which the muon mass and the (g - 2) μ are generated radiatively from a common short-distance dynamics after the U(1) X breaking. We also show how to charge a vector leptoquark under U(1) μ-τ in a complete gauge model.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2023

A subdivision-stabilized B-spline mixed material point method

Subjected to external loadings, polymeric materials, e.g., biological tissues, hydrogels, and elastomers, may undergo extreme, nearly incompressible, (self-)contact deformations. For numerical modeling employing mesh-based techniques such as the finite element method (FEM), these deformations pose significant challenges due to large distortions in the deformed geometry, accuracy issues stemming from volumetric locking effects, and increased computational cost from complex contact searches. As an alternative to mesh-based methods, the material point method (MPM), a continuum-based particle technique, is gaining attention for its ability to handle extreme distortions and capture no-slip contact without added cost. For nearly incompressible material behaviors, while mixed formulations can address locking effects by treating displacements and pressure as independent fields, they can suffer from numerical instabilities close to the incompressibility limit due to the violation of the inf-sup condition, leading to inaccurate nodal pressure solutions. Here we propose an efficient and stable mixed B-spline material point method with highest achievable regularity for quasi-compressible polymeric materials. Using the two-scale relation of B-splines, we introduce a subdivision-stabilization for the two-field mixed MPM and obtain numerically stable, oscillation-free nodal solutions with equal-order interpolations with optimal regularity. Building on the Eulerian-Lagrangian nature of MPM, a previously-converged solution framework is adopted to mitigate issues related to cell-crossing and numerical fracture artifact present in standard MPM. We assess the stability and accuracy of the developed mixed MPM at large deformations for soft materials through the benchmark Cook’s membrane problem. Additionally, we test the robustness of the proposed MPM by modeling several examples, including the compression and indentation of a circular block into a quasi-compressible substrate and the twisting deformation of a rectangular block. The findings demonstrate the MPM’s capabilities for modeling practical soft material applications.

36 MATERIALS SCIENCE↗
DOE OSTI2022

A Southern Photometric Quasar Catalog from the Dark Energy Survey Data Release 2

We present a catalog of 1.4 million photometrically selected quasar candidates in the southern hemisphere over the ~5000 deg 2 Dark Energy Survey (DES) wide survey area. We combine optical photometry from the DES second data release (DR2) with available near-infrared (NIR) and the all-sky unWISE mid-infrared photometry in the selection. We build models of quasars, galaxies, and stars with multivariate skew-t distributions in the multidimensional space of relative fluxes as functions of redshift (or color for stars) and magnitude. Our selection algorithm assigns probabilities for quasars, galaxies, and stars and simultaneously calculates photometric redshifts (photo-z) for quasar and galaxy candidates. Benchmarking on spectroscopically confirmed objects, we successfully classify (with photometry) 94.7% of quasars, 99.3% of galaxies, and 96.3% of stars when all IR bands (NIR YJHK and WISE W1W2) are available. The classification and photo-z regression success rates decrease when fewer bands are available. Our quasar (galaxy) photo-z quality, defined as the fraction of objects with the difference between the photo-z z p and the spectroscopic redshift z s , |Δz| ≡ |z s - z p |/(1 + z s ) ≤ 0.1, is 92.2% (98.1%) when all IR bands are available, decreasing to 72.2% (90.0%) using optical DES data only. Our photometric quasar catalog achieves an estimated completeness of 89% and purity of 79% at r < 21.5 (0.68 million quasar candidates), with reduced completeness and purity at 21.5 < r ≲ 24. Among the 1.4 million quasar candidates, 87,857 have existing spectra, and 84,978 (96.7%) of them are spectroscopically confirmed quasars. Finally, we provide quasar, galaxy, and star probabilities for all (0.69 billion) photometric sources in the DES DR2 coadded photometric catalog.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Field demonstration and implementation analysis of model predictive control in an office HVAC system

Model Predictive Control (MPC) is a promising technique to address growing needs for heating, ventilation, and air-conditioning (HVAC) systems to operate more efficiently and with greater flexibility. However, due to a number of factors, including the required implementation expertise, lack of high quality data, and a risk-adverse industry, MPC has yet to gain widespread adoption. While many previous studies have shown the advantages of MPC, few analyzed the implementation effort and associated practical challenges. In addition, previous work has developed an open-source, Modelica-based tool-chain that automatically generates optimal control, parameter estimation, and state estimation problems aimed at facilitating MPC implementation. Therefore, this study demonstrates usage of this tool-chain to implement MPC in a real office building, discusses practical challenges of implementing MPC, and estimates the implementation effort associated with various tasks in order to inform the development of future workflows and serve as an initial benchmark for their impact on reducing implementation effort. This study finds that the implemented MPC saves approximately 40% of HVAC energy over the existing control during a two-month trial period and that tasks related to data collection and controller deployment activities can each require as much effort as model generation.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2025

D–MOPH–25: diverse MOF–molecule pairs for Henry’s constants prediction

Computational methods like grand-canonical Monte Carlo simulations and machine learning (ML) have accelerated metal–organic frameworks (MOF) exploration but are typically limited to a narrow range of adsorbates due to data availability and force field constraints. In this study, we introduce a dataset of diverse MOF–molecule pairs for Henry’s constant prediction, D–MOPH–25, which systematically explores a diverse chemical space by combining 113 molecular adsorbates with over 5000 MOF structures through an active learning process. D–MOPH–25 constitutes the most diverse adsorbate dataset used in any ML study of molecular adsorption in MOFs to date. Our workflow builds a benchmark for predicting Henry’s constants at 300 K, leveraging conformal prediction for uncertainty quantification. Assessment through Shannon entropy and uniform manifold approximation and projection confirms the comprehensiveness of D–MOPH–25 while highlighting the importance of robust classification to filter out unphysical data points in regression tasks. Although future enhancements in model architecture and sampling criteria could improve predictive performance, our dataset already spans the target space using only 2.31% of total possibilities. This comprehensive dataset facilitates assessment of model generalizability across adsorbate species and can establish a foundation for high-throughput MOF screening and ML-driven separation processes.

active learning↗
DOE OSTI2021

Compaction of crushed salt for safe containment – overview of the KOMPASS project

Abstract. In Germany, rock salt formations are possible host rock candidates for a repository for heat-emitting radioactive waste. The safety concept of a repository in salt bases on a multibarrier system consisting mainly of the geological barrier salt and geotechnical seals ensuring safe containment. Crushed salt will be used for backfilling of cavities and sealing measures in drifts and shafts due to its favourable properties and its easy availability (mined-off material). The creep of the rock salt leads to crushed salt compaction with time. Thereby, the crushed salts' porosity is reduced from the initial porosity of 30 %–40 % to a value comparable to the porosity of undisturbed rock salt (≤1 %). In such low porosity ranges, technical impermeability is assumed. The compaction behaviour of crushed salt is rather complex and involves several coupled THM processes (Kröhn et al., 2017; Hansen et al., 2014). It is influenced by internal properties like humidity and grain size distribution, as well as boundary conditions such as temperature, compaction rate or stress state. However, the current process understanding has some important gaps referring to the material behaviour, experimental database and numerical modelling. It needs to be extended and validated, especially in the low porosity range. The objective of the KOMPASS project was development of methods and strategies for the reduction of deficits in the prediction of crushed salt compaction leading to an improvement of the prognosis quality. Key results are as follows (KOMPASS Phase 1, 2020): selection of an easily available and permanently producible synthetic crushed salt mixture, acting as a reference material for generic investigations; development and proof of different techniques for producing pre-compacted samples for further investigations; establishment of a tool of microstructure investigation methods to demonstrate the comparability of grain structures of pre-compacted samples with in-situ compacted material for future investigations; execution of various laboratory experiments using pre-compacted samples, e.g. long-term creep tests which deliver reliable information about time- and stress-dependent compaction behaviour; development of a complex experimental investigation strategy to derive necessary model parameters considering individual functional dependencies. Its technical feasibility was successfully verified; benchmarking with various existing numerical models using datasets from three different triaxial long-term tests. The result was not entirely satisfactory; however, the number of influencing factors is small and further validation work has to be done. Overall, the KOMPASS project has made significant progress in the approaches to solving the outstanding question, building the basis for further investigations.

Friedenberg, Larissa↗
DOE OSTI2025

Demography, dynamics and data: building confidence for simulating changes in the world's forests

Vegetation demographic models (VDMs) are advanced tools for simulating forest responses to climate and land-use changes, and are essential for projecting carbon cycling and large-scale forest management strategies. Despite their increasing incorporation into Earth System Models, VDMs differ in their demographic assumptions, with no prior quantitative comparison of their performance. We benchmarked nine VDMs against observational data from boreal, temperate and tropical sites, assessing their accuracy in predicting tree growth, carbon turnover, biomass stocks and size distributions. Models were simulated under consistent climate conditions with postdisturbance recovery monitored for at least 420 yr. Postdisturbance carbon recovery trajectories showed significant variability while remaining within observational ranges. Initial regrowth rates varied substantially (0.03-0.60, 0.18-0.70 and 0.35-1.10 kgCm-2 yr-1 for boreal, temperate and tropical sites, respectively), influenced by each model's initial forest state. Models captured mature forest carbon content but showed compensating effects between overestimated growth and underestimated mortality rates. This first multi-model benchmarking identifies growth and mortality rates as critical calibration targets and highlights the need to refine postdisturbance establishment conditions for model development. We outline specific benchmarking variables needed to improve predictions of forest responses to environmental change.

demographic vegetation model benchmarking↗
DOE OSTI2025

Spatiotemporal forecasting of the edge localized modes in tokamak plasmas using neural networks

Artificial intelligence techniques have been increasingly adopted by the plasma and fusion science to address problems like plasma reconstruction, surrogate modeling, and tokamak/stellarator optimization. A key focus in sustained fusion research is the prediction and mitigation of edge-localized-modes (ELMs), instabilities that occur in short, periodic bursts and can cause erosion to the tokamak vessel wall. Recent research has demonstrated the power of neural networks in approximating continuous functions. In this work, we build spatiotemporal forecasting models that can predict the onset of ELMs and their evolution at early stages. We leverage recent advances in generative modeling, sequence-to-sequence modeling, and Fourier neural operators to propose architectures and training strategies that can learn to forecast short to long term dynamics of the noisy signals due to ELMs. We benchmark the developed model against a state-of-the-art foundation model using the beam emission spectroscopy (BES) data that captures the plasma fluctuations due to ELMs over a 8 x 8 spatial grid. Our models demonstrate high accuracy, outperforming the baselines, in predicting the evolution of BES signals during ELM events. Furthermore, the developed models exhibit high accuracy in predicting the rapid rise and relaxation of the signals due to ELMs within 30–80 µs.

edge localized modes↗
DOE OSTI2024

New U.S. Data Tools are Playing a Crucial Role in Decarbonizing Buildings at Speed, Scale, and Low Cost

Preparing buildings for retrofits traditionally requires expensive on-site audits or timeintensive simulation models. As a result, the majority of buildings fail to pursue cost-saving retrofits. To address these barriers, the U.S. Department of Energy (DOE) has introduced the Building Efficiency Targeting Tool for Energy Retrofits (BETTER)-a new, free, on-line tool that utilizes a data-driven analytical engine and user-friendly web interface to automatically analyze a building's monthly energy usage in response to weather conditions. The tool benchmarks a building's electric and fossil energy usage against peers; estimates energy, cost, and emissions reductions at the building and portfolio levels; recommends energy efficiency measures; and prioritizes buildings for net-zero energy retrofits. Thanks to interoperability with the DOE's Standard Energy Efficiency Data (SEED) platform, BETTER is supporting U.S. jurisdictions to prepare buildings for retrofit at speed, scale, and low cost to comply with energy policies. This paper discusses the use of BETTER and SEED by one of the branches of the California state government to streamline a retrofit program across 455 public non-residential buildings to align with state goals to reduce greenhouse gas emissions. It describes the organization's challenge to reduce energy consumption across a geographically diverse, aging portfolio; explores how BETTER and SEED improved workflow efficiency; presents preliminary results, including avoiding audit costs of $3.28 million and developing the groundwork for retrofit projects estimated to prevent emission of 2,271 t CO2e annually; and provides guidance for other jurisdictions seeking similar results.

BETTER↗