Search NASA⌕ Search

SEARCH · Search NASA

Results for “data base for model validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 829 records · Page 46

High-Penetration PV Deployment in the Arizona Public Service System, Phase 1 Update: Preprint

In an effort to better understand the impacts of high penetrations of photovoltaic generators on distribution systems, Arizona Public Service and its partners have begun work on a multi-year project to develop the tools and knowledge base needed to safely and reliably integrate high penetrations of utility- and residential-scale photovoltaics (PV). Building upon the APS Community Power Project --Flagstaff Pilot, this project will analyze the impact of PV on a representative feeder in northeast Flagstaff. To quantify and catalog the effects of the estimated 1.3 MW of PV that will be installed on the feeder (both smaller units at homes as well as large, centrally located systems), high-speed weather and electrical data acquisition systems and digital 'smart' meters are being designed andinstalled to facilitate monitoring and to build and validate comprehensive, high-resolution models of the distribution system. These models will be used to analyze the impacts of the PV on distribution circuit protection systems (including anti-islanding), predict voltage regulation and phase balance issues, and develop volt/var control schemes. This paper continues from a paper presented at the2011 IEEE PVSC conference that introduces the project and describes some of the preliminary consideration, as well as project plans and early results. This paper gives a status update of the project and presents selected results from Phase 2 of the project. It discusses baseline feeder modeling, load allocation, data acquisition, utility-scale PV integration, preliminary model validation, andplans for future phases.

14 SOLAR ENERGY↗

DINGO: Digital assistant to grid operators for resilience management of power distribution system

With increasing adverse weather events and disasters, enabling resiliency of the power distribution system (PDS) is becoming increasingly important. Here in this work, resiliency is defined as the systems ability to keep supplying critical loads even with multiple contingencies. Resiliency may depend on: (a) advanced tools to assist operators in situational awareness and decision making with the increasing volume of data generated by the PDS, (b) visualization and ease of interaction with system resources and information, especially during extreme events and resulting human operator stress, and (c) flexible resources and autonomous control. Operators and support engineers need to interact with the system for key information and take action under stress, given the requirement for decisions in a short time. Integrated technological solutions are prevailing steps to support the most appropriate decision during critical times to serve essential loads. In order to meet the required goals, a Real-time Resiliency Monitoring and Operational Decision Support (RT-RMOD) tool have been developed. It supports various functionalities, including real-time monitoring, resilience assessment, and proactive decision support. However, this work makes advanced feature additions to the tool by developing data-enabled resilience management algorithms for (i) outage detection and localization, (ii) Resiliency-metric driven restoration and reconfiguration, and (iii) NLP based digital assistant for operators called DINGO (DIgital assistaNt to Grid Operators) to interact with Advanced Distribution Management System (ADMS) and RT-RMOD. The developed algorithm was validated for multiple cases of weather events using a real-world, off-grid microgrid system modeled in a real-time simulator, sensor data, and software tools.

24 POWER TRANSMISSION AND DISTRIBUTION↗

A Bayesian approach to time-domain photonic Doppler velocimetry analysis

Photonic Doppler velocimetry (PDV) is an established technique for measuring the velocities of fast-moving surfaces in high-energy-density experiments. In the standard approach to PDV analysis, the short-time Fourier transform (STFT) is used to generate a spectrogram from which the velocity history of the target is inferred. The user chooses the form, duration, and separation of the window function. Here, in this study, we present a Bayesian approach to infer the velocity directly from the PDV oscilloscope trace, without using the spectrogram for analysis. This is clearly a difficult inference problem due to the highly periodic nature of the data, but we find that with carefully chosen prior distributions for the model parameters, we can accurately recover the injected velocity from synthetic data. We validate this method using PDV data collected at the STAR two-stage light gas gun at Sandia National Laboratories, recovering shock-front velocities in quartz that are consistent with those inferred using the STFT-based approach and are interpolated across regions of low signal-to-noise data. Although this method does not rely on the same user choices as the STFT, we caution that it can be prone to misspecification if the chosen model is not sufficient to capture the velocity behavior. Analysis using posterior predictive checks can be used to establish whether a better model is required, although more complex models come with additional computational cost, often taking more than several hours to converge when sampling the Bayesian posterior. We, therefore, recommend it be viewed as a complementary method to that of the STFT-based approach.

Allison, James R. [First Light Fusion Ltd., Yarnto↗

Comparing Automated Posterior Estimation Techniques for Modeling Strong Lenses In Ground-based Survey Data

Current and future ground-based cosmological surveys, such as the Dark Energy Survey (DES), and the Vera Rubin Observatory Legacy Survey of Space and Time (LSST), are predicted to discover thousands to tens of thousands of strong gravitational lenses. The large number of strong lenses discoverable in future surveys will make strong lensing a highly competitive and complementary cosmic probe. However, conventional lens modeling techniques are unable to scale up to the sheer number of lenses that will be discovered through upcoming surveys. Therefore, the use of automated lens analysis techniques is necessary. We demonstrate that machine learning methods can be used to automate the inference of informative model posteriors of strong lensing systems in ground-based surveys with credible uncertainty estimation. We present two Simulation-Based Inference (SBI) approaches for lens parameter estimation of galaxy-galaxy lenses. We demonstrate applications of Neural Posteriors Estima tors (NPEs) and Bayesian Neural Network (BNNs) to automate the inference of a 12-parameter lensing system for DES-like ground-based imaging data. We apply a suite of diagnostics (e.g., posterior coverage and SBC) to validate the performance of our methods. We find that NPEs outperform the BNN, producing posterior distributions that are for the most part both more accurate and more precise; in particular, several source-light model parameters are systematically biased in the BNN implementation.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

ThermoPI—an Online Tool to Calculate Heat Transfer Through Foam Insulation

Thermal insulation materials with ultra-low effective thermal conductivity are crucial for a multitude of applications. Over the years, a significant amount of experimental work has been dedicated to creating new insulation materials with low thermal conductivity. Similarly, substantial efforts have been made to enhance the theoretical understanding of thermal transport mechanisms in thermal insulation materials and to push the boundaries of lower thermal conductivity. However, ample room remains for enhancing the thermal resistivity of closed-cell foam insulations. To aid in the development of ultra-low effective thermal conductivity foam insulations, Oak Ridge National Laboratory has introduced a unique online tool, ThermoPI. This tool calculates not only the effective thermal conductivity but also the thermal conductivity components for porous materials, including gases, solids, and radiative, based on the materials’ structural information (e.g., porosity, pore size, gas species, pressure, solid species, pore geometry, and temperature).This tool collected and improved the existing theoretical models for thermal insulation materials’ gas, solid, and radiative thermal conductivity. These improved models have been validated with experimental data. Effective medium theory and sound velocity softening effects are considered for solid thermal conductivity. The built-in solid materials include polystyrene, polyurethane, polyethylene, and silica. Users are allowed to input new solid materials that are not built inside the tool. For gas thermal conductivity, the subcontinuum Knudsen effect is considered. In addition to several built-in gases, users can input new gases. For solid and radiative thermal conductivity calculations, several models are available to select, and the tool can determine the best model to choose based on the materials that users input. Users are also allowed to change selections manually. In addition, the tool can also calculate the effect of interfacial resistance on the overall thermal conductivity of layered materials. This work will elaborate on the tool and discuss how it can guide the development of new insulation products.

Shrestha, Som [ORNL] (ORCID:0000000183993797)↗

On the Methodology to Calculate the Covariance of Estimated Resonance Parameters

Principles to determine resonance parameters and their covariance from experimental data are discussed. Different methods to propagate the covariance of experimental parameters are compared. A full Bayesian statistical analysis reveals that the level to which the initial uncertainty of the experimental parameters propagates, strongly depends on the experimental conditions. For high precision data the initial uncertainties of experimental parameters, like a normalization factor, has almost no impact on the covariance of the parameters in case of thick sample measurements and conventional uncertainty propagation or full Bayesian analysis. The covariances derived from a full Bayesian analysis and least-squares fit are derived under the condition that the model describing the experimental observables is perfect. When the quality of the model can not be verified a more conservative method based on a renormalization of the covariance matrix is recommended to propagate fully the uncertainty of experimental systematic effects. Finally, neutron resonance transmission analysis is proposed as an accurate method to validate evaluated data libraries in the resolved resonance region.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

An Evaluation of Semiempirical Models for Partitioning Photosynthetically Active Radiation Into Diffuse and Direct Beam Components

Photosynthesis is more efficient under diffuse than direct beam photosynthetically active radiation (PAR) per unit PAR, but diffuse PAR is infrequently measured at research sites. We examine four commonly used semiempirical models (Erbs et al., 1982, https://doi.org/10.1016/0038-092X(82)90302-4; Gu et al., 1999, https://doi.org/10.1029/1999JD901068; Roderick, 1999, https://doi.org/10.1016/S0168- 1923(99)00028-3; Weiss & Norman, 1985, https://doi.org/10.1016/0168-1923(85)90020-6) that partition PAR into diffuse and direct beam components based on the negative relationship between atmospheric transparency and scattering of PAR. Radiation observations at 58 sites (140 site years) from the La Thuille FLUXNET data set were used for model validation and coefficient testing. All four models did a reasonable job of predicting the diffuse fraction of PAR (Φ) at the 30 min timescale, with site median r2 values ranging between 0.85 and 0.87, model efficiency coefficients (MECs) between 0.62 and 0.69, and regression slopes within 10% of unity. Model residuals were not strongly correlated with astronomical or standard meteorological variables. We conclude that the Roderick (1999, https://doi.org/10.1016/S0168- 1923(99)00028-3) and Gu et al. (1999, https://doi.org/10.1029/1999JD901068) models performed better overall than the two older models. Using the basic form of these models, the data set was used to find both individual site and universal model coefficients that optimized predictive accuracy. A new universal form of the model is presented in section 5 that increased site median MEC to 0.73. Site-specific model coefficients increased median MEC further to 0.78, indicating usefulness of local/regional training of coefficients to capture the local distributions of aerosols and cloud types.

54 ENVIRONMENTAL SCIENCES↗

Predicting melt pool depth and grain length using multiple signatures from in-situ single camera two-wavelength imaging pyrometry for laser powder bed fusion

In laser powder bed fusion (LPBF), the in-situ process signatures are known to have a direct correlation with the microstructural properties of the solidified melt pool (MP). It is known that the MP cooling and heating rates, and laser processing parameters can critically determine the grain structure and thereby affect the part properties. The objective of this work is to study the feasibility of using in-process, high-speed imaging pyrometry for evaluating the solidified MP properties “below” the surface, such as depth and microstructural properties. To accomplish this, we employ an in-house single camera-based two-wavelength imaging pyrometry (STWIP) system for monitoring the printing of single-scan tracks with Inconel 718 on a commercial LPBF printer (EOS M290). Further, the lab designed STWIP system is a coaxial high-speed (>10,000 fps) imaging system capable of monitoring MP temperature, morphology, and intensity profiles. The temperature measurements from STWIP are emissivity independent. The STWIP measured MP signatures of the printed tracks are correlated with the ex-situ microscopy characterized MP depth and the average grain lengths. From the data analysis, using support vector machine (SVM)-based regression models, we found that the MP temperature signatures are crucial for an accurate prediction of MP depth and the grain length, thus validating the novelty and necessity of the developed in-situ monitoring methods and analysis.

36 MATERIALS SCIENCE↗

Making Invisible Visible: Data-Driven Seismic Inversion With Spatio-Temporally Constrained Data Augmentation

Deep learning and data-driven approaches have shown great potential in scientific domains. The promise of data-driven techniques relies on the availability of a large volume of high-quality training datasets. Due to the high cost of obtaining data through expensive physical experiments, instruments, and simulations, data augmentation techniques for scientific applications have emerged as a new direction for obtaining scientific data recently. However, existing data augmentation techniques originating from computer vision yield physically unacceptable data samples that are not helpful for the domain problems that we are interested in. In this article, we develop new data augmentation techniques based on convolutional neural networks. Specifically, our generative models leverage different physics knowledge (such as governing equations, observable perception, and physics phenomena) to improve the quality of the synthetic data. To validate the effectiveness of our data augmentation techniques, we apply them to solve a subsurface seismic full-waveform inversion using simulated CO 2 leakage data. Our interest is to invert for subsurface velocity models associated with very small CO 2 leakage. We validate the performance of our methods using comprehensive numerical tests. Here via comparison and analysis, we show that data-driven seismic imaging can be significantly enhanced by using our data augmentation techniques. Particularly, the imaging quality has been improved by 15% in test scenarios of general-sized leakage and 17% in small-sized leakage when using an augmented training set obtained with our techniques.

58 GEOSCIENCES↗

Dynamic Mooring Field Experiment and Design of a Wave Energy Converter Platform Test System

Abstract This study evaluated a multi-catenary spread mooring system design of a mobile ocean test berth for wave energy converters (WECs), the Ocean Sentinel (OS) instrumentation buoy, through dynamic simulation, numerical analysis, and comparison with measured field motion data of the OS off the OR coast. First, the accuracy of the numerical employed model based on a fully-coupled method of the OS and its mooring lines was validated by comparing predicted mooring tensions to the field measurements. Then, the anchor movability, fatigue damage, and extreme mooring tension of the OS mooring system were analyzed to assess survivability. Field test results show that the numerical model provided accurate predictions of mooring tensions even under environmental conditions of strong wind, current, and waves. Factors affecting the accuracy are discussed. One mooring anchor was shown to have moved significantly during the ocean field test. Mooring fatigue damage was calculated for different levels of sea states. Design strengths of the mooring lines were calculated and analyzed.

Engineering↗

A Micro-Mechanical Constitutive Model to Predict Hygrothermal Aging of Cross-Linked Polymers

Abstract A multi-physics material model is presented to describe the effects of temperature, oxygen, and humidity on the constitutive response of cross-linked polymers. The effect of hygrothermal damage on the mechanical integrity of the polymer matrix can be considered as the result of damage accumulation of two independent aging mechanism namely, i) thermo-oxidative, and ii) hydrolytic aging. In order to capture the mutual effects of thermo-oxidative and hydrolytic aging, an assumption has been made that each of the aging phenomenon can be superposed to each other. In fact, each of them works independently and as a result, they can compete with each other. Utilizing the theory of network decomposition, all phenomena and their correlation were modeled and thus, the strain energy function of the polymer matrix is written with respect to four independent mechanisms, i) the shrinking original matrix that has neither been attacked by water nor oxygen, ii) conversion of the first network to two new network due to the reduction and formation of cross-links, and iii) energy loss from network degradation due to attack of the water molecules to polymer active agents. Moreover, the proposed model is micro-mechanically based and is mainly relevant on thin samples due to our underlying assumption of homogeneous diffusion of oxygen and water throughout the matrix. The model has been validated against extensive data-sets obtained from experiments we specifically designed for concept validation.

Bahrololoumi, Amir↗

SU-C-201-07: Validation of a GATE Gamma Camera Model for the Siemens Symbia

Purpose: To develop a simulation model of a clinical gamma camera/SPECT system and to validate the model using experimental and published measurements from the clinical system. Methods: Geant4 Application for Tomographic Emission (GATE) was used to create a model of the Siemens Symbia gamma camera. A modular model was implemented that allows specifying combinations of crystal thickness (3/8”, 5/8”) and collimator (LEHR, MELP, HE). Shielding, energy resolution, intrinsic resolution, crystal thickness, and collimator properties were set based on manufacturer specifications. Validation of the model was performed by simulating NEMA 2007 gamma camera tests including spatial resolution and sensitivity for Tc99; these were compared with experimental and published data for the scanner. The simulated energy spectra of a Tc99 line source in acrylic blocks was visually compared with the corresponding experimental acquisition. For a 4 cm diameter sphere filled with Tc99, the attenuation maps were generated from simulation data, and the photopeak and scatter window were extracted from GATE output using ROOT to create DICOM files to use in the clinical reconstruction. Results: Simulated spatial resolutions for LEHR 3/8” crystal at 0, 10 cm, 10 cm (with scatter), and 30 cm were 4, 6.7, 7.9, and 14.5 mm FWHM; these were 9% less than published data. For 5/8” crystal the spatial resolutions were 4.5, 7.0, 8.5, and 14.7 mm FWHM; these were 4% to 10% less than published data. Simulated sensitivity was within 3.5% of published data for both LEHR 3/8” and 5/8”. The simulated energy spectra matched the photopeak and scatter window well, but did overestimate the counts below 90 keV. The simulated attenuation map and projection data were successfully reconstructed with the clinical software, and the passed visual inspection. Conclusions: Validation of a specific clinical scanner allows future studies of quantification accuracy for both planar and SPECT imaging. Research reported in this publication was supported by the National Cancer Institute of the National Institutes of Health under Award Number R01CA138986. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health.

60 APPLIED LIFE SCIENCES↗

Outcomes of the DOE Workshop on Atmospheric Challenges for the Wind Energy Industry

The U.S. Department of Energy-funded Mesoscale-to-Microscale Coupling (MMC) project team planned and conducted a virtual Workshop on Atmospheric Challenges for the Wind Energy Industry on October 19 and 20, 2020. The goal of the workshop was to forge a dialog with the community, including industry representatives, on how modeling tools are currently being used, the present active atmospheric modeling research in support of wind energy, and required advancements in capabilities and technology to continue to advance wind energy deployment. The workshop was planned in collaboration with an industry advisory panel that included representatives from wind power plant developers, turbine manufacturers, and companies that provide resource assessment and forecasting services. The format of the workshop included panels from government research sponsors, visionaries from industry, and mixed panels of researchers discussing research status and needs. A shared keynote presentation from the Technical University of Denmark experts anchored the second day of the workshop. An emphasis was placed on understanding the research needs in the offshore environment. In addition, breakout opportunities were provided each day. On the first day, the breakout discussions addressed predesigned questions configured to elicit participants’ thoughts on needed research directions. The second-day breakouts treated three important technical topics through a combination of presentations and group conversations. Each workshop participant chose their breakout preference from among downscaling details, modeling for turbines, and using artificial intelligence for atmospheric modeling. The discussions were robust and productive. The outcomes of the workshop include archiving a series of recommendations from industry and the research community on research directions required to further advance wind energy deployment. Discussions confirmed the need for high-fidelity modeling but that there are specific areas of applicability and other areas where the time and cost of computation is prohibitive. In those cases, the high-fidelity models can inform low-order models that are more practical for real-time or widely deployed applications. Industry must consider the financial cost of performing more expensive modeling approaches, but industry engineers and researchers are using these approaches where there appears to be a return on investment. An emerging type of low-order model is based on machine learning (ML). Participants confirmed that there are many atmospheric phenomena that need to be modeled better, including low-level jets, cold air outbreaks, land-sea induced circulations, diurnal variability, thin stable boundary layers, dynamic changes such as from frontal passage, interaction of wakes and blockage, and more. For the offshore environment, there is wide agreement that some level of ocean-wave-atmospheric coupling is necessary to capture variations in rotor-level winds needed to plan and operate offshore wind plants. Another recurring recommendation is that more observations are needed, particularly for the offshore environment. Those observations should consider the needs for model improvement, both for physically based models and for ML models. Observations must capture atmospheric profiles of variables that are important to understanding and modeling atmospheric and oceanic phenomena that impact boundary layer winds. Models must be validated with data and the uncertainty quantified, particularly those that are sensitive to initial and boundary conditions. Finally, a repeated request was to consider the holistic needs of hybrid plants of wind, solar, and storage resources because those types of plants are likely to be the wave of the future. In addition, industry wishes to understand impacts of the resource under a changing climate for long-term planning.

17 WIND ENERGY↗

Description of FY25 Theory and Simulation Performance Target: Development of an integrated modeling framework for fusion reactor design and assessment

The urgency to deliver fusion power is growing now more than ever, with increasing pressure for both public programs and private companies to meet milestones timelines and overcome significant remaining technical challenges to ensure growth of a nascent fusion industry in time to meet rapidly growing clean energy demands. With incredible advancements in computation and years of investment in fusion model development and validation, integrated modeling is poised to fill a key role in accelerating the timeline to a fusion pilot plant (FPP). Future fusion pilot plants will operate in regimes far beyond current experience, and device design will rely on physics-based prediction and extrapolation. Many concepts will also rely on simulation to assess safety (shielding, tritium management, materials activation and lifetimes), economics and scalability before the decision to build. Importantly, integrated simulation can be used to reveal and solve the complexities of system integration that may otherwise not be apparent in physical components or models developed in isolation. New experimental test facilities that produce relevant conditions to validate and resolve key technical challenges for various subsystems (materials, blankets, fuel cycle, etc.) have been repeatedly called for by the fusion community but are not yet realized. Integrated modeling has an important role in identifying realistic load conditions (thermal, electromagnetic, plasma, neutron and photon loads, etc.) and defining the components and experiments for these test facilities in order to ensure meaningful validation that sufficiently reduces modeling uncertainties and technical risk for the full integrated reactor. The Fusion REactor Design and Assessment (FREDA) SciDAC project is building a component-based integrated modeling framework & data structure to enable self-consistent, multi-fidelity, iterative optimization workflows for the fusion reactor design process. FREDA aims to shorten the time to viable designs by providing a set of flexible workflows to support the various stages of the design process using an integrated model hierarchy, ranging from the simple analytic descriptions to the highest fidelity, theory-based plasma and engineering modeling developed by the fusion and fission communities. These tools are expected to be needed for timely support of FPP design in the milestone program and in the FIRE collaboratives. The plasma simulation backbone of FREDA is IPS-FASTRAN with newly developed coupled Core-Edge Pedestal-SOL (CESOL) workflows, which is being extended to the far-SOL region up to the plasma facing components. FREDA incorporates the FERMI engineering modeling suite and will enable self-consistent evaluation of the thermal shields, limiters, blanket, magnets, and other surrounding structures with predictions of temperatures, erosion, dpa, activation, tritium generation and transport, creep, corrosion, material degradation, etc. Parametric generation of 3D CAD enables rapid iteration of component geometry in response to plasma and loading specifications.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Rainier Mesa CAU Infiltration Model using INFILv3

The outline of this presentation are: (1) Model Inputs - DEM, Precipitation, Air temp, Soil props, Surface geology, Vegetation; (2) Model Pre-processing - Runoff Routing and sinks, Slope and Azimuth, Soil Ksat reduction with slope (to mitigate bathtub ring), Soil-Bedrock Interface permeabilities; (3) Model Calibration - ET using PEST, Chloride mass balance data, Streamflow using PEST; (4) Model Validation - Streamflow data not used for calibration; (5) Uncertainty Analysis; and (6) Results. Conclusions are: (1) Average annual infiltration rates =11 to 18 mm/year for RM domain; (2) Average annual infiltration rates = 7 to 11 mm/year for SM domain; (3) ET = 70% of precipitation for both domains; (4) Runoff = 8-9% for RM; and 22-24% for SM - Apparently high average runoff is caused by the truncation of the lowerelevation portions of watersheds where much of the infiltration of runoff waters would otherwise occur; (5) Model results are calibrated to measured ET, CMB data, and streamflow observations; (6) Model results are validated using streamflow observations discovered after model calibration was complete; (7) Use of soil Ksat reduction with slope to mitigate bathtub ring was successful (based on calibration results); and (8) Soil-bedrock K{_}interface is innovative approach.

54 ENVIRONMENTAL SCIENCES↗

Physics-Informed Recurrent Neural Networks to Predict Reactor Operations of the AGN-201 Nuclear Reactor

4 page paper submitted to ANS Student conference. Summary of paper similar to the following abstract: The ability to predict how a reactor will operate, understand when anomalous conditions arise, and ensure a reactor is being operated as expected is crucial for deploying new nuclear facilities. Digital twins serve as a unique solution to recognizing reactor behavior; however, they require data to be useful. For next-generation reactors, this data may not currently be available. To explore how synthetic physics-informed reactor data can be used to predict reactor operations, a recurrent neural network was implemented for the Idaho State University AGN-201 digital twin. The goal of this work is to determine how synthetic data can be used to train a recurrent neural network model for predicting the reactor power of the AGN-201. The recurrent neural network was validated using both synthetic and real operational data. We envision this approach will help bridge the gap between the virtual and physical sides of a digital twin, where reactor physics models based on as-built data can be corrected for actual operating parameters to ensure the virtual model mirrors reality.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

HDSense: An efficient method for ranking observable sensitivity

Identifying which observables most effectively constrain model parameters can be computationally prohibitive when considering full likelihoods of many correlated observables. This is especially important for, e.g., hadronization models, where high precision is required to interpret the results of collider experiments. We introduce the High-Dimensional Sensitivity (HDSense) score, a computationally efficient metric for ranking observable sets using only one-dimensional histograms. Derived by profiling over unknown correlations in the Fisher information framework, the score balances total information content against redundancy between observables. We apply HDSense to rank a set observables in terms of their constraining power with respect to five parameters of the Lund string model of hadronization implemented in Pythia using simulated leptonic collider events at the $Z$ pole. Validation against machine-learning--based full-likelihood approximations demonstrates that HDSense successfully identifies near-optimal observable subsets. The framework naturally handles data from multiple experiments with different acceptances and incorporates detector effects. While demonstrated on hadronization models, the methodology applies broadly to generic parameter estimation problems where correlations are unknown or difficult to model.

Assi, Benoît [Cincinnati U.] (ORCID:00000003092433↗

Scalable deep learning for watershed model calibration

Watershed models such as the Soil and Water Assessment Tool (SWAT) consist of high-dimensional physical and empirical parameters. These parameters often need to be estimated/calibrated through inverse modeling to produce reliable predictions on hydrological fluxes and states. Existing parameter estimation methods can be time consuming, inefficient, and computationally expensive for high-dimensional problems. In this paper, we present an accurate and robust method to calibrate the SWAT model (i.e., 20 parameters) using scalable deep learning (DL). We developed inverse models based on convolutional neural networks (CNN) to assimilate observed streamflow data and estimate the SWAT model parameters. Scalable hyperparameter tuning is performed using high-performance computing resources to identify the top 50 optimal neural network architectures. We used ensemble SWAT simulations to train, validate, and test the CNN models. We estimated the parameters of the SWAT model using observed streamflow data and assessed the impact of measurement errors on SWAT model calibration. We tested and validated the proposed scalable DL methodology on the American River Watershed, located in the Pacific Northwest-based Yakima River basin. Our results show that the CNN-based calibration is better than two popular parameter estimation methods (i.e., the generalized likelihood uncertainty estimation [GLUE] and the dynamically dimensioned search [DDS], which is a global optimization algorithm). For the set of parameters that are sensitive to the observations, our proposed method yields narrower ranges than the GLUE method but broader ranges than values produced using the DDS method within the sampling range even under high relative observational errors. The SWAT model calibration performance using the CNNs, GLUE, and DDS methods are compared using R 2 and a set of efficiency metrics, including Nash-Sutcliffe, logarithmic Nash-Sutcliffe, Kling-Gupta, modified Kling-Gupta, and non-parametric Kling-Gupta scores, computed on the observed and simulated watershed responses. The best CNN-based calibrated set has scores of 0.71, 0.75, 0.85, 0.85, 0.86, and 0.91. The best DDS-based calibrated set has scores of 0.62, 0.69, 0.8, 0.77, 0.79, and 0.82. The best GLUE-based calibrated set has scores of 0.56, 0.58, 0.71, 0.7, 0.71, and 0.8. The scores above show that the CNN-based calibration leads to more accurate low and high streamflow predictions than the GLUE and DDS sets. Our research demonstrates that the proposed method has high potential to improve our current practice in calibrating large-scale integrated hydrologic models.

54 ENVIRONMENTAL SCIENCES↗