Search NASA⌕ Search

SEARCH · Search NASA

Results for “Validating”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16

Validating and Comparing Energy Estimation Methods at Water Resource Recovery Facilities

Water resource recovery facilities play a crucial role in the water-energy nexus, consuming a substantial amount of energy in the United States. Growing treatment volumes and more stringent water quality standards are expected to increase the amount of energy needed to treat wastewater, but accurately estimating energy consumption and potential remains challenging due to variability in scale, treatment methods, and effluent treatment standards. In this study, we used publicly available data to evaluate the accuracy of methods for estimating energy consumption and generation, then quantified uncertainty based on key factors like flow rate, treatment level, and geographic location. To validate methods, we estimated energy consumption and generation at the facility-level, then compared estimates to self-reported data from utilities in major U.S. cities. We found that process models of treatment trains under best practice configurations were accurate relative to other methods for estimating electricity use, total energy use, and electricity generation from biogas utilization, and less complex methods based on effluent treatment level and prime movers also performed well for estimating electricity consumption and generation, respectively. Applying the evaluated methods to a national inventory of treatment facilities, we estimate that annual energy consumption ranged from 56.3 x 10^3 to 82.5 x 10^3 TJ in 2012 and 83.6 x 10^3 to 127 x 10^3 TJ in 2042. Our results indicate that not all estimation methods are suited for every use case, so we recommend that researchers and practitioners select an estimation method based on data availability and desired computational intensity.

Hodson, Abigayle↗

Validating sequential Monte Carlo for gravitational-wave inference

Nested sampling (NS) is the preferred stochastic sampling algorithm for gravitational-wave inference for compact binary coalescences. It can handle the complex nature of the gravitational-wave likelihood surface and provides an estimate of the Bayesian model evidence. However, there is another class of algorithms that meets the same requirements, but has not been used for gravitational-wave analyses: sequential Monte Carlo (SMC), an extension of importance sampling that maps samples from an initial density to a target density via a series of intermediate densities. In this work, we validate a type of SMC algorithm, called persistent sampling (PS), for gravitational-wave inference. We consider a range of different scenarios including binary black holes and binary neutron stars and real and simulated data and show that PS produces results that are consistent with NS whilst being, on average, 2 times more efficient and 2.74 times faster. This demonstrates that PS is a viable alternative to NS that should be considered for future gravitational-wave analyses.

black hole mergers↗

Validation of the ESPRESSO wavelength calibration using iodine absorption cell spectra

ABSTRACT High-quality wavelength calibration is crucial for science cases like radial-velocity studies of exoplanets, the search for a possible variation of fundamental constants, and the redshift drift experiment. However, for state-of-the-art spectrographs, it has become difficult to verify the wavelength calibration on sky because no astrophysical source provides spectra with sufficiently stable or accurate wavelength information. We therefore propose to use iodine absorption cells to validate the wavelength calibration. Observing a bright and featureless star through the iodine cell emulates an astrophysical target with exactly known spectral features that can be analysed like any other science target, allowing to verify the wavelength calibration derived from the internal calibration sources and to identify systematics in the data processing. As demonstration, we temporarily installed an $\mathrm{I_2}$ absorption cell at ESPRESSO. Employing a full forward modelling approach of the $\mathrm{I_2}$ spectrum, including the instrumental line-spread function, we demonstrate wavelength calibration accuracy at the level of a few $\mathrm{m\,s^{-1}}$. We also show that wavelength measurements do depend on the geometry of the light-injection into the spectrograph fibers. This highlights the importance of probing exactly the same light path as science targets, something not possible with internal calibration sources alone. We also demonstrate excellent radial-velocity stability at the ${{< 20\, \mathrm{cm\,s^{-1}}}}$ level in a full end-to-end fashion, from sky to data product. Our study therefore showcases the great potential of absorption cells for the verification and long-term monitoring of the wavelength calibration as well as the unique insights they can provide.

Schmidt, Tobias M. (ORCID:0000000248337273)↗

Validation of the DESI DR2 measurements of baryon acoustic oscillations from galaxies and quasars

The Dark Energy Spectroscopic Instrument (DESI) Data Release 2 (DR2) galaxy and quasar clustering data represents a significant expansion of data from Data Release 1 (DR1), providing improved statistical precision in baryon acoustic oscillation (BAO) constraints across multiple tracers, including bright galaxies, luminous red galaxies, emission line galaxies, and quasars. In this paper, we validate the BAO analysis of DR2. We present the results of robustness tests on the blinded DR2 data and, after unblinding, consistency checks on the unblinded DR2 data. All results are compared with those obtained from a suite of mock catalogs that replicate the selection and clustering properties of the DR2 sample. We confirm the consistency of DR2 BAO measurements with DR1 while achieving a reduction in statistical uncertainties due to the increased survey volume and completeness. The combined BAO precision, including both statistical and systematic errors, improves from ∼0.52% in DR1 to 0.30% in DR2—a factor of 1.7 gain. We assess the impact of analysis choices, including different data vectors (correlation function vs power spectrum), modeling approaches and systematics treatments, and an assumption of the Gaussian likelihood, finding that our BAO constraints are stable across these variations and assumptions with a few minor refinements to the baseline setup of the DR1 BAO analysis. We summarize a series of pre-unblinding tests that confirmed the readiness of our analysis pipeline, the final systematic errors, and the DR2 BAO analysis baseline. The successful completion of these tests led to the unblinding of the DR2 BAO measurements, ultimately leading to the DESI DR2 cosmological analysis, with their implications for the expansion history of the Universe and the nature of dark energy presented in the DESI key paper (companion paper).

79 ASTRONOMY AND ASTROPHYSICS↗

Model validation and error attribution for a drifting qubit

Qubit performance is often reported in terms of a variety of single-value metrics, each providing a facet of the underlying noise mechanism limiting performance. However, the value of these metrics may drift over long timescales, and reporting a single number for qubit performance fails to account for the low-frequency noise processes that give rise to this drift. Here, in this work, we demonstrate how we can use the distribution of these values to validate or invalidate candidate noise models. We focus on the case of randomized benchmarking (RB), where typically a single error rate is reported but this error rate can drift over time when multiple passes of RB are performed. We show that using a statistical test as simple as the Kolmogorov-Smirnov statistic on the distribution of RB error rates can be used to rule out noise models, assuming the experiment is performed over a long enough time interval to capture relevant low frequency noise. With confidence in a noise model, we show how care must be exercised when performing error attribution using the distribution of drifting RB error rate.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Optical galaxy cluster mock catalogs with realistic projection effects: Validations with the SDSS clusters

Galaxy clusters identified in optical imaging surveys suffer from projection effects: Physically unassociated galaxies along a cluster’s line of sight can be counted as its members and boost the observed richness (the number of cluster members). To model the impact of projection on cluster cosmology analyses, we apply a halo occupation distribution model to 𝑁-body simulations to simulate the red galaxies contributing to cluster members, and we use the number of galaxies in a cylinder along the line of sight (counts in cylinders) to model the impact of projection on cluster richness. We compare three projection models: uniform, quadratic, and Gaussian, and we convert between them by matching their effective cylinder volumes. We validate our mock catalogs using SDSS redMaPPer clusters’ data vectors, including counts vs richness, stacked lensing signal, spectroscopic redshift distribution of member galaxies, and richness remeasured on a redshift grid. We find the former two are insensitive to the projection model, while the latter two favor a quadratic projection model with a width of ≈180 ℎ −1 Mpc (equivalent to the volume of a uniform model with a width of 100 ℎ −1 Mpc and a Gaussian model with a width of 110 ℎ −1 Mpc, or a Gaussian redshift error of 0.04). Furthermore, our framework provides an efficient and flexible way to model optical cluster data vectors, paving the way for a simulation-based joint analysis for clusters, galaxies, and shear.

79 ASTRONOMY AND ASTROPHYSICS↗

Validation of implosion modeling through direct-drive shock timing experiments at the National Ignition Facility

Precise modeling of shocks in inertial confinement fusion implosions is critical for obtaining the desired compression in experiments. Shock velocities and post-shock conditions are determined by laser-energy deposition, heat conduction, and equations of state. This paper describes experiments at the National Ignition Facility (NIF) where multiple shocks are launched into a cone-in-shell target made of polystyrene, using laser pulse shapes with two or three pickets and varying on-target intensities. Shocks are diagnosed using the Velocity Interferometric System for Any Reflector diagnostic. Simulated and inferred shock velocities agree well for the range of intensities studied in this work. These results are the first shock-velocity measurements using direct drive on the NIF and provide a good measure of early-time, directly driven laser-energy coupling. Furthermore, the validated models add to the credibility of direct-drive-ignition designs at the megajoule scale.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Complete quasilinear model for the acceleration-driven lower hybrid drift instability and a computational assessment of its validity

A complete quasilinear model is derived for the electrostatic acceleration-driven lower hybrid drift instability in a uniform two-species low-beta plasma in which current is perpendicular to the background magnetic field. The model consists of coupled nonlinear velocity space diffusion equations for the volume-averaged ion and electron distribution functions. Each species' diffusion coefficient depends on a time-evolving spectral density of the electric-field energy per unit volume and a time-evolving dispersion relation. The dispersion relation is expressed analytically in integral form without the use of asymptotic limits and applies to arbitrary distribution functions, so long as they can be expressed as a function of one velocity coordinate, e.g., f⁡(vy) or f⁡(v⊥). The quasilinear model conserves energy and is complete in that it fully describes the evolution of the distribution functions, including resonant and nonresonant particle-wave interactions, while accounting for distribution-function-dependent mixed-complex frequencies. Further, the quasilinear diffusion model is solved numerically and self-consistently using a Crank-Nicolson temporal discretization and a second-order finite-volume velocity-space discretization. Numerical solutions are compared to nonlinear fourth-order accurate continuum kinetic Vlasov-Poisson simulations. Evolution of electric-field energy, growth rates, distribution functions, and diffusion coefficients are shown to be in agreement with Vlasov simulations. The quasilinear model is shown to predict anomalous transport terms, like resistivity and heating, to within a factor of order unity. Discrepancies between the quasilinear model and Vlasov simulations are assessed and attributed primarily to lack of damping in the quasilinear description and to the use of unperturbed-orbit susceptibilities in the linear theory dispersion relation. The results illuminate the predictive accuracy of the quasilinear model, place approximate bounds on its validity, and provide much needed vetting of quasilinear theory's ability to predict the nonlinear state of a microturbulent plasma.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Validated ligand geometries for macromolecular refinement restraints and molecular-mechanics force fields

In macromolecular structure refinement, the low observation-to-parameter ratio and the lack of high-resolution data are countered by using a priori information in the form of restraints. Having accurate geometries of the chemical entities in the sample is paramount for generating accurate chemical restraints and, therefore, accurate macromolecular structures. In particular, it is desirable to have accurate restraints for known and novel ligand entities. Quantum mechanics (QM) can minimize the energy of a ligand by adjusting its geometry, and these geometries can be used to generate restraints for macromolecular refinement. This article describes a library of approximately 37 000 small molecules extracted from the Chemical Component Dictionary in the Protein Data Bank and minimized by density-functional QM. The library includes restraint files for use in crystallography or cryo-EM refinement, along with files suitable for molecular-dynamics simulation. Because the geometries are validated using the Cambridge Structural Database, the restraints library provides users with both functional restraints and minimized geometries. This work also provides procedures for generating new and accurate restraints.

Amber↗

Optimal Network Reconfiguration and Scheduling With Hardware-in-the-Loop Validation for Improved Microgrid Resilience

With the increased occurrence of various major extreme weather events, power outages and prompt power system restorations have recently drawn more attention to the resilience and recovery of power systems. From the perspective of a more resilient power delivery at the distribution grid, system restoration using network topology reconfiguration together with optimal scheduling of distributed energy resources are adopted in this paper. The proposed optimization model aims at minimizing the total load shedding cost and other operational costs, in which linearized topological constraints borrowed from graph theory and linearized DistFlow models are respectively used to maintain the radial network topology and power flow balance after system contingencies. To demonstrate the applicability of the proposed strategy, a real-world case study of a networked three-microgrid system in Adjuntas, Puerto Rico, is used with the consideration of different independent/interconnected microgrid scenarios, contingencies, and fairness settings. Furthermore, hardware-in-the-loop testing is conducted for the same three-microgrid network, where the closely matched results with the simulated ones have validated the effectiveness of the proposed restoration strategy, which is now ready to move one step forward towards field deployment. Finally, to test the proposed restoration strategy in a larger networked system, the modified IEEE-33 bus test distribution system is considered, and the results show a more resilient power delivery for critical loads under three and four line outages.

24 POWER TRANSMISSION AND DISTRIBUTION↗

The NASA ISRO SAR (NISAR) Mission - Validation of Science Measurement Requirements

The NASA ISRO Synthetic Aperture Radar (NISAR) is scheduled for launch early in 2024 from the Satish Dhawan Space Centre (SDSC), at Sriharikota, near Chennai, India. This mission is the result of a collaboration between NASA and Indian Space Research Organization (ISRO), where NASA has contributed elements of the mission such as an L-band SAR, and ISRO has contributed other elements, such as an S-band SAR. After successful launch, the NISAR mission will collect left-looking L-band SAR data over most of the Earth’s land areas twice during every 12-day exact repeat orbit. (once while in an ascending orbit direction and once while in a descending orbit direction). NASA and ISRO have individual and joint requirements on the mission that include the performance of the imaging radars onboard the spacecraft. For example, NASA must demonstrate that this L-band SAR will achieve a set of identified science measurement accuracy requirements that span Ecosystem science, Solid Earth science, and Cryosphere science disciplines. Likewise, ISRO has several applications objectives on both the L-band and S-band data from NISAR that the ISRO science team and project will be developing and testing. Pre-launch and post-launch activities have been planned to validate that these requirements are met. Here, we will discuss how the NASA plans are being executed and will present any initial results at the conference.

Chapman, Bruce↗

Experimental Validation of a Module Cell Cracking Model

The What's Cracking app can predict how changes in crystalline silicon photovoltaic (PV) module materials, design, and mounting affect its susceptibility for cell fracture under uniform loading. This work has experimentally validated the app. A set of commercial crystalline silicon PV modules was obtained for this study. The modules were uniformly loaded at three different mounting points, and their subsequent cell fractures were recorded. A large sample size allowed for the development of an experimental statistical model for cell fracture. Here, the comparison of the experiment to predictions from the app is in excellent agreement. Both experimental and modeling results also elucidate how moving the module mounting points toward the center of the module increases the probability of cell fracture.

14 SOLAR ENERGY↗

Dynamic Validation of CNN-Based Surrogate Models for Inverter-Based Resources in Open-Source Solvers

Traditionally, distribution system planning has focused on steady-state analyses, with limited consideration of dynamic behavior. However, as large or medium-scale inverter-based resources (IBRs), particularly grid-following (GFL) inverters in commercial or industry buildings, become more prevalent, understanding their dynamic impact is essential for grid planning and operation. This article presents an innovative deep-learning (DL)-approach using convolutional neural networks technique to model the GFL inverters. Developed from real grid-tied commercial IBR transient data, these dynamic DL models overcome proprietary constraints by requiring minimal knowledge of internal converter physics while maintaining high accuracy and flexibility. To demonstrate their applicability, the models were incorporated into GridLAB-D, an open-source, three-phase distribution analysis tool. This integration enables dynamic simulations of large-scale distribution networks with high IBR penetration stability analysis. Rigorous testing and validation, aligned with industry standards, confirmed the reliability and efficiency of this approach, paving the way for enhanced planning and operational assessments of modern power systems.

Deep-learning↗

Open Source Synergy: Developing and Validating PMU Data Analysis Techniques Using Open Source Tools and Datasets

This paper presents an exploration into the development and validation of data analysis approaches for Phasor Measurement Units (PMUs) using open-source datasets and tools. Various methods for event detection, event classification, frequency response, and oscillation analysis were tested. We leverage the capabilities of Archive Walker (AW), the Frequency Response Analysis Tool (FRAT), and the Oscillation Baselining and Analysis Tool (OBAT), all open-source tools, for efficient processing and analysis of synchrophasor data. The open-source Transmission Signature Library (TSL) dataset was employed as a dataset for a comprehensive evaluation to assess the performance and reliability of the proposed methods.

PMU, event analysis, oscillation, Frequency Respon↗

Quench Simulation and Validation for EIC Direct Wind Magnets

The Electron-Ion Collider (EIC), a new facility to be built in the United States at the U.S. Department of Energy’s Brookhaven National Laboratory in collaboration with Thomas Jefferson National Accelerator Facility-will be the only new particle collider in the U.S. for the next 10∼20 years. The EIC project will investigate the origin of mass and building blocks of the Universe. It will accelerate and collide beams of electrons with protons and nuclei. Unlike any collider that has ever existed before, both EIC’s particle beams will be polarized, meaning their spins will be aligned in a controlled way to allow for precision measurements. Different types of new superconducting magnets will be required near the interaction region (IR) of EIC. A 6-around-1 NbTi cable will be used for some of those new superconducting magnets. Given the relatively smaller conductors used for those direct wind magnets, the overall engineering current density will be 2–3 times higher in comparison to traditional collared superconducting magnets in other accelerator magnets. This is technically challenging and potentially represents high risks for quench protection. Here, in this paper we use different tools and methods for quench simulation for several EIC direct wind magnets. We also present results of a sensitivity study, exploring different material properties and Jc curves. This paper also discusses and validates the quench simulation results with measurement results from a small-scale serpentine magnet tested at BNL in October 2024.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Resilient Control of Networked Microgrids Using Vertical Federated Reinforcement Learning: Designs and Real-Time Test-Bed Validations

Improving system-level resiliency of networked microgrids against adversarial cyber-attacks is an important aspect in the current regime of increased inverter-based resources (IBRs). To achieve that, this paper contributes in designing a hierarchical control layer, in conjunction with the existing control layers, resilient to adversarial attack signals. Considering model complexities, unknown dynamical behaviors of IBRs, and privacy issues regarding data sharing in multi-party-owned microgrids, designing such a control layer is non-trivial. Here, to tackle these issues, a novel federated reinforcement learning (Fed-RL) method is proposed. To grasp the interconnected dynamics of networked microgrids, the paper develops Federated Soft Actor-Critic (FedSAC) algorithm following the vertical structure of implementing Fed-RL. Next, utilizing the OpenAI Gym interface, we built a custom set-up in GridLAB-D/HELICS co-simulation platform, named Resilient RL Co-simulation (ResRLCoSIM), to train the RL agents with IEEE 123-bus benchmark comprising 3 interconnected microgrids. Finally, the learned policies in the simulation are transferred to the real-time hardware-in-the-loop (HIL) test-bed developed using the high-fidelity Hypersim platform. Finally, experiments show that the simulator-trained RL controllers achieve desirable performance with the test-bed platform, validating the minimization of the sim-to-real gap.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Assessing the accuracy of time-fraction and ductility exhaustion approaches for creep-fatigue damage prediction through feature-test validation

Determining creep-fatigue damage formation is critical for elevated temperature components integrity. This study evaluates creep-fatigue assessments with emphasis on differences between creep damage models. Evaluated are the time-fraction model and the classical and stress-modified ductility exhaustion creep damage models. This work extends the domain of stress-modified ductility exhaustion models by introducing and validating such formalism to Ni-based alloys. The fidelity of the assessments was benchmarked against uniaxial creep-fatigue and multiaxial feature tests of Alloy 617. For uniaxial specimens, best estimate predictions rank ductility exhaustion as the most accurate and precise and time-fraction as markedly conservative. For feature tests, ductility exhaustion predictions are within < 4.0 times difference, whereas time-fraction underpredicts life by factors of 7–14. The observations suggest ductility exhaustion models as alternative to time-fraction models in design codes for situations requiring characterization of the design margin. Further work in employing such models to assess other relevant phenomena (e.g., stress relaxation cracking) is discussed.

creep-fatigue↗

On the EFT validity for Drell–Yan tails at the LHC

Abstract In this article, we examine the validity range of the Effective Field Theory (EFT) description of high-energy Drell–Yan processes at the LHC. To this purpose, we consider explicit mediators that contribute to these processes in the s - and t -channels, comparing their effects in Drell–Yan distributions with the ones obtained by matching onto the corresponding EFT. We determine the conditions for the EFT results to accurately describe these scenarios. In particular, we explore the impact of including dimension-eight $$(d=8)$$ ( d = 8 ) operators in the faster convergence of the EFT series, at the analytical and numerical level, considering contributions to the cross section up to the square of $$d=8$$ d = 8 EFT operator insertions. Moreover, we discuss the possible implications of clipping LHC data and illustrate results for a specific New-Physics scenario motivated by low-energy flavor data.

Allwicher, L. (ORCID:0000000269561661)↗