Search NASA⌕ Search

SEARCH · Search NASA

Results for “Validation Test”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

Validation of Computational Fluid Dynamics Simulations for Biological Performance Assessment in Hydropower units (Final Report)

The biological performance assessment (BioPA) toolset developed by Pacific Northwest National Laboratory (PNNL) estimates the relative biological performance of fish passage at a hydroelectric power turbine unit. The tool is based on the use of computational fluid dynamics (CFD) and fish biological response relationships. The recent release, BioPA-v3, is based on directly computed trajectory and collision of material Lagrangian particles using CFD simulation codes rather than the prior version that relies on Tecplot to compute streamtrace trajectories. Before modifying the toolset, a series of validation tests were performed at the various steps of modification in the toolset. Validation is a critical step of any numerical investigation that reflects the accuracy and reliability of the predicted results. It raises the confidence level of the user to use the modified version of the BioPA toolset. Several test cases were simulated and compared, where available, to observed data. The trajectory and collision of the small spherical and cylindrical particles in a water flume were compared to in-house experiments. The CFD predicted collision rate and flow field compared well with experimental observation for vane array and large cylinder as target bodies. Next, the CFD-predicted flow field and hydraulic performance of a laboratory-scale model of a Francis turbine was also successfully validated. Note that the trajectory of the particles is significantly affected by the flow field in such extreme conditions. In addition to the particle trajectories and flow field, the collision detection method employed in the CFD simulations was also successfully validated. The CFD predicted impact velocity, collision time, velocity, and trajectory of a sphere excellently matched with analytical value for a bouncing ball in the elastic collision. A similar approach was also tested and successfully validated for a collision of sphere with a 45° inclined plane. After successfully validating different cases, the BioPA toolset was modified to use direct output of the CFD prediction and the new version can be used in evaluating biological performance at hydroelectric turbines.

13 HYDRO ENERGY↗

Exxon Mobil-NETL Testing of DAC Materials

This joint initiative is aimed at extending our understanding of real DAC testing conditions at the NETL DAC testbed facility. Of particular focus will be: • Small Scale testing of powdered and formulated materials (supplied by ExxonMobil) to evaluate various performance metrics under DAC process cycles • Pilot scale testing of formulated materials at larger scales ExxonMobil will work with NETL to shake down equipment, validate testing methods, and define best practices for data analysis. Three tasks are proposed: 1. Validation of multi-cycle test data on powdered and formulated materials to benchmark various performance metrics of these materials. 2. Steam regeneration of powdered samples at small scale to define baseline performance under commercially relevant conditions. 3. Pilot scale testing of larger formulated materials to test commercially relevant samples under actual process cycles.

36 MATERIALS SCIENCE↗

Dark energy survey: Modeling strategy for multiprobe cluster cosmology and validation for the full six-year dataset

Here, we introduce an updated To&Krause2021 model for joint analyses of cluster abundances and large-scale two-point correlations of weak lensing and galaxy and cluster clustering (termed CL+3×2 pt analysis) and validate that this model meets the systematic accuracy requirements of analyses with the statistical precision of the final Dark Energy Survey (DES) Year 6 (Y6) dataset. The validation program consists of two distinct approaches, (i) identification of modeling and parametrization choices and impact studies using simulated analyses with each possible model misspecification and (ii) end-to-end validation using mock catalogs from customized Cardinal simulations that incorporate realistic galaxy populations and DES-Y6-specific galaxy and cluster selection and photometric redshift modeling, which are the key observational systematics. In combination, these validation tests indicate that the model presented here meets the accuracy requirements of DES-Y6 for CL+3×2 pt based on a large list of tests for known systematics. In addition, we also validate that the model is sufficient for several other data combinations: the CL+GC subset of this data vector (excluding galaxy–galaxy lensing and cosmic shear two-point statistics) and the CL+3×2 pt+BAO+SN (combination of CL+3×2 pt with the previously published Y6 DES baryonic acoustic oscillation and Y5 supernovae data).

79 ASTRONOMY AND ASTROPHYSICS↗

Dark Energy Survey: Modeling strategy for multiprobe cluster cosmology and validation for the Full Six-year Dataset

We introduce an updated To&Krause2021 model for joint analyses of cluster abundances and large-scale two-point correlations of weak lensing and galaxy and cluster clustering (termed CL+3x2pt analysis) and validate that this model meets the systematic accuracy requirements of analyses with the statistical precision of the final Dark Energy Survey (DES) Year 6 (Y6) dataset. The validation program consists of two distinct approaches, (1) identification of modeling and parameterization choices and impact studies using simulated analyses with each possible model misspecification (2) end-to-end validation using mock catalogs from customized Cardinal simulations that incorporate realistic galaxy populations and DES-Y6-specific galaxy and cluster selection and photometric redshift modeling, which are the key observational systematics. In combination, these validation tests indicate that the model presented here meets the accuracy requirements of DES-Y6 for CL+3x2pt based on a large list of tests for known systematics. In addition, we also validate that the model is sufficient for several other data combinations: the CL+GC subset of this data vector (excluding galaxy--galaxy lensing and cosmic shear two-point statistics) and the CL+3x2pt+BAO+SN (combination of CL+3x2pt with the previously published Y6 DES baryonic acoustic oscillation and Y5 supernovae data).

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

PV High Wind User Test Facility

The creation of a PV high wind test facility at the NREL Flatirons Campus that will enable private and public research efforts aimed at storm hardening PV systems. The facility will be instrumented to monitor effects of high wind conditions on modules and other array components. These in-field tests will coordinate with flow models, wind tunnel testing, validation of PV aeroelastic design codes, and post-testing module and system component analysis.

14 SOLAR ENERGY↗

Comparative verification of hydro-mechanical fracture behavior: Task G of international research project DECOVALEX–2023

Numerical simulations become a necessity when experimental approaches cannot cover the required physical and time scale of interest. One of such area is a simulation of long-term host rock behaviors for nuclear waste disposal and simulation tools involved in the assessment must go through rigorous validation tests. The DECOVALEX project (Development of COupled models and their VAlidation against EXperiments) is dedicated to this purpose by international participants. This work is part of the ongoing phase DECOVALEX–2023 (D–2023, Task G) particularly aiming to simulate fracture behaviors under various conditions. Here, in this study, we cross-verified a variety of numerical methods including continuous and discontinuous approaches against four benchmark exercises with emphasis on numerical accuracy and parameterization of the various numerical approaches. The systematic inter-comparisons of test cases highlight advantages and disadvantages of the different numerical models. Numerical details on discretization effects (e.g. mesh density and orientation) and domain size were investigated in detail for practical applications. It became evident that meticulous attention to mesh resolution and domain size is imperative for achieving accurate numerical simulations, even for static cracks. Moreover, when comparing numerical methods to closed-form solutions for static cracks, all models successfully reproduced the maximum crack opening but encountered challenges near the crack tips. Finally, the paper discusses how to convert between and therefore compare parameters of various numerical approaches. Our benchmark studies reveal that each model necessitates a distinct number of parameters, even in simple scenarios like static crack aperture benchmarks. It is generally more practical to employ fewer parameters to mitigate model over-parameterization and enhance experimental feasibility.

58 GEOSCIENCES↗

Electrodynamic Shaker Capability Estimation Through Experimental Dynamic Substructuring [Thesis]

Electrodynamic shaker systems are an essential tool in shock and vibration testing of dynamic environments. However, the specific performance capability of these systems is difficult to characterize. The dynamics of the shaker itself, the device under test and the specific test configuration used all couple to create a dynamic response unique to each test. Poorly predicted limitations in shaker capability affect the ability to achieve test specifications, delay testing schedules, and create difficulties for choosing test equipment. To predict shaker capability for a specific test configuration prior to setup, a lumped parameter model of the shaker system and a modal model of a device under test was developed. These models were then analytically coupled using LaGrange multiplier frequency based substructuring to estimate their coupled frequency response functions. The coupled frequency response functions were used to predict electrical inputs required to meet a given test specification. These input requirements were finally compared to a validation test using the specification and setup. Input requirements estimated using the substructuring estimated frequency response functions showed significant error. However, results using an ideal frequency response function showed very little error. These results indicate that with a better method of experimental dynamic substructuring employed it would be possible to accurately predict shaker capability for a given test configuration prior to setup.

42 ENGINEERING↗

Advanced Multi-Tube Mixer Combustion for 65% Efficiency (Final Report)

This project targeted advanced low NOx combustion for advanced gas turbines capable of 65%, or greater, efficiency in combined cycle application. This technology advancement has further potential to benefit gas turbines used in coal based IGCC applications with pre-combustion carbon capture and hydrogen as the resulting fuel. The program developed and synthesized the most advanced combustion system capable of achieving low NOX emissions up to turbine inlet temperatures of 3100F while also supporting the load-following needs of a modern grid. The combustion system contributes to the overall gas turbine efficiency goal by setting the maximum cycle temperature achievable for a given NOX level and by minimizing the through-combustor air flow pressure drop. Focus areas for this project targeted maximizing the turbine inlet temperature entitlement, as constrained by emissions considerations. The design also minimized parasitic air flow pressure drop by using advanced cooling techniques and performance materials selections and by minimizing hot surface area. These two technology objectives (maximum, emissions-compliant cycle temperature and minimum air flow pressure drop) were integrated into a prototype design. The primarily analytical project sought to identify the most promising technologies to meet these objectives. Additional critical “jugular” data were obtained from multi-tube mixer tests to realize the potential of leveraging “micro flames” for minimizing overall hot surface area. This data was used, in conjunction with an understanding of advanced material and cooling design technologies, to analytically develop multiple design concepts. Phase I focused on in-depth engineering analysis and design, with minimal supporting laboratory testing to enable a selection of the top three combustion architectures for achieving these overall objectives. Phase II of the program developed the selected design through a combination of sub-scale testing and analytical efforts. Early tests included a cold-flow cascade to establish aerodynamic performance characteristics and a sub-scale fired test at GE Global Research in Niskayuna, NY, to establish cooling and heat transfer characteristics in conjunction with combustion performance. The data from these tests validated the analytical models to ultimately design a full-scale, test article to evaluate at prototypical pressure and temperature conditions at GE Gas Power’s Gas Turbine Technology Laboratory in Greenville, SC. GE Gas Power also developed, tested, and recommended a suitable seal design to be applied to the unique features of the combustor. To assess the technology challenges from prospective future production of the combustor from a ceramic matrix composite material, screening tests of Environmental Barrier Coatings were completed.

20 FOSSIL-FUELED POWER PLANTS↗

A methodology for domain overlapping coupling of thermal-hydraulic systems

Multi-scale coupling has increasingly drawn attention as a promising approach for modeling thermal systems. Traditional system codes provide fast and robust predictions at the plant scale, while high-fidelity computational fluid dynamics (CFD)-based tools resolve localized flow and heat transfer phenomena with greater accuracy. By combining these complementary strengths, co-simulations enable multi-scale analysis that would otherwise be computationally prohibitive for a standalone CFD code. Here, this work introduces a robust and problem-agnostic domain overlapping (DO) coupling between the system thermal-hydraulic (STH) code System Analysis Module (SAM) and the coarse-mesh CFD code Pronghorn. Both applications belong to the Comprehensive Reactor Analysis Bundle (BlueCRAB) code suite, a code suite in active development at the Idaho National Laboratory (INL), tailored for multi-physics analysis of advanced reactors. Unlike previous approaches, BlueCRAB supports an agnostic interface between codes based on different fidelity, while its coupling formulation can address arbitrary flow geometries with multiple inlets and outlets in coupled components. The implemented method leads to consistent pressure drops, enthalpies, and scalar concentrations between coupled SAM and Pronghorn simulations. The methodology is demonstrated through two verification tests, which ensure the numerical consistency and conservation across the codes, and through one validation test against experimental data. The proposed problems explore different physical aspects inherent to thermal systems, with particular attention given to nuclear reactor analysis. These include buoyancy-driven flows, complex flow patterns, and setups with multiple inlets and outlets, representing challenges in advanced reactor applications.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗

Inspection Tools for Hanford Tanks and Waste Transport Systems - 20444

Recent integrity issues in the double-shell tanks (DST) at Hanford have motivated the need for developing innovative tools that can provide information regarding the health of the tanks. These issues include the primary linear failure of AY-102 and recent concerns of thinning in the DST secondary liners. Other concerns include erosion or corrosion on transfer lines and processing pipes. In recent years, Florida International University (FIU) has supported DOE-EM by developing tools that can assist in understanding the health of tanks and waste transport system at Hanford. More specifically, FIU has developed a miniature rover that can be deployed through small risers and gain access to refractory slots in the Hanford DSTs. It traverses through the slots on the primary liner upside down via magnets to avoid debris in the slots. Recent modifications include a spring loaded magnetic arm that allows the unit to traverse over large weld seams but does not reduce the overall functionality of the system. The system has also incorporated a control capsule that will sit within the annulus of the tank and improves on issues related to signal and voltage loss over long tether lines. Lastly, the unit is also being augmented with a second module that will include a means to prep the tank surface and obtain a thickness measurement using a dual element ultrasonic sensor. FIU has also developed a 6-inch peristaltic pipe crawler that operates similar to the previous pipe crawlers developed at FIU. This crawler is a marsupial type crawler that will navigate through the 6-inch drain lines, and deploy a small rover at the entrance of the drain slots. This rover will also traverse upside down on the secondary liner and provide information regarding the health of the liner. An initial prototype for the crawler unit has been developed, assembled and tested. The system is pneumatic and consists of three modules - two grippers and one extender. The validation tests are conducted in a mockup of the drain lines and demonstrate the system's ability to navigate through long pipe lengths and elbows. In this paper, a general overview of each of the aforementioned systems is presented along with results from testing and demonstrations that shows the applicability of each system. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Application of research reactor environments for validation of the IRDFF-II dosimetry cross section library

Activation data from seven different reactor-based reference neutron fields are examined to provide enhanced validation evidence for the newly released IRDFF-II library. A least-squares based spectrum adjustment methodology is used and rigorous statistical metrics demonstrate the consistency of the set of IRDFF-II dosimetry cross sections. The use of these reactor-based neutron fields provides validation evidence for nine more reactions than have been addressed in the 252 Cf(sf) and 235 U(th) benchmark validation testing. The use of covers to shift their energy response increases the power of the response validation but makes it challenging to properly capture response correlations.

Griffin, Patrick↗

Scalability of OpenFOAM Density-Based Solver with Runge–Kutta Temporal Discretization Scheme

Compressible density-based solvers are widely used in OpenFOAM, and the parallel scalability of these solvers is crucial for large-scale simulations. In this paper, we report our experiences with the scalability of OpenFOAM’s native rhoCentralFoam solver, and by making a small number of modifications to it, we show the degree to which the scalability of the solver can be improved. The main modification made is to replace the first-order accurate Euler scheme in rhoCentralFoam with a third-order accurate, four-stage Runge-Kutta or RK4 scheme for the time integration. The scaling test we used is the transonic flow over the ONERA M6 wing. This is a common validation test for compressible flows solvers in aerospace and other engineering applications. Numerical experiments show that our modified solver, referred to as rhoCentralRK4Foam, for the same spatial discretization, achieves as much as a 123.2% improvement in scalability over the rhoCentralFoam solver. As expected, the better time resolution of the Runge–Kutta scheme makes it more suitable for unsteady problems such as the Taylor–Green vortex decay where the new solver showed a 50% decrease in the overall time-to-solution compared to rhoCentralFoam to get to the final solution with the same numerical accuracy. Finally, the improved scalability can be traced to the improvement of the computation to communication ratio obtained by substituting the RK4 scheme in place of the Euler scheme. All numerical tests were conducted on a Cray XC40 parallel system, Theta, at Argonne National Laboratory.

Li, Sibo↗

A Centralized AI Lakehouse Framework for Brain Tumor MRI Classification and Segmentation, University KPI Forecasting, and Water Potability Prediction

In many university and healthcare projects, models are built for very different data types such as tables, institutional time series, and medical images, but they are deployed as separate applications. In this work, that separation made testing and maintenance difficult because each module had its own pipeline and runtime requirements. This paper presents an integrated AI lakehouse-style implementation that runs three model pipelines inside one containerized backend. For medical imaging, we used MRI datasets from IEEE DataPort: a four-class classification set with 7012 images (5708 train/1304 test) and a segmentation set with 3063 image–mask pairs. The classification model (ResNet50 transfer learning) is evaluated using a proper train–validation–test protocol across multiple splits (80/10/10, 70/10/20, 60/10/30, and 10/30/60), achieving a test accuracy of 99.00% under the standard 80/10/10 split. Additionally, a patient-level evaluation is conducted using an external glioma dataset to provide a more realistic assessment without data leakage. The segmentation model (DeepLabV3-ResNet50) achieved 83.09% validation mIoU and 88.79% Dice score. For university KPI forecasting, we used annual IPEDS and NSF HERD data from 2010 to 2023 for three universities (BSU, EOU, and UAB). To examine the effect of preprocessing on forecasting performance, two case studies are conducted. In the first case, linear interpolation is applied to generate semester-level data. In the second case, the original annual data is used directly without interpolation. Random Forest regression and ARIMA models are evaluated using MAE, RMSE, MAPE, and R 2 . The results showed that interpolation improved apparent forecasting performance due to smoothing, while evaluation on the original annual data provided a more realistic assessment of model behavior. To further validate the framework on a larger dataset, an additional case study is conducted using a student dropout dataset. For water potability, we trained and compared multiple tabular classifiers on a large dataset (1,048,575 samples). A Random Forest model (100 trees, max depth 10) achieved 85.86% test accuracy and high recall for unsafe samples (0.8447). All modules are served via FastAPI and deployed together using Docker, with workflow automation routing requests to the correct endpoint. System-level benchmarking indicates that the backend maintains stable throughput and latency under concurrent requests.

97 MATHEMATICS AND COMPUTING↗

Static Corrosion Summary: Static Corrosion Testing, Haynes 230 Recession Rate, Chloride Salts

In this project, the best material and processes that we have available now are used build a pump for validation testing and to be able to provide a quotation for a pump for the Gen3 CSP Phase 3 test facility. Enough high temperature and aged material data is collected to be able to safely design a pump with a high level of confidence of good performance. Manufacturing processes for the nano-composite material including spray coating and joining methods are investigated. These processes enable application of this novel material to pump components.

36 MATERIALS SCIENCE↗

J-PLUS: Support vector machine applied to STAR-GALAXY-QSO classification

Context. In modern astronomy, machine learning has proved to be efficient and effective in mining big data from the newest telescopes. Aims. In this study, we construct a supervised machine-learning algorithm to classify the objects in the Javalambre Photometric Local Universe Survey first data release (J-PLUS DR1). Methods. The sample set is featured with 12-waveband photometry and labeled with spectrum-based catalogs, including Sloan Digital Sky Survey spectroscopic data, the Large Sky Area Multi-Object Fiber Spectroscopic Telescope, and VERONCAT – the Veron Catalog of Quasars & AGN. The performance of the classifier is presented with the applications of blind test validations based on RAdial Velocity Extension, the Kepler Input Catalog, the Two Micron All Sky Survey Redshift Survey, and the UV-bright Quasar Survey. A new algorithm was applied to constrain the potential extrapolation that could decrease the performance of the machine-learning classifier. Results. The accuracies of the classifier are 96.5% in the blind test and 97.0% in training cross-validation. The F1-scores for each class are presented to show the balance between the precision and the recall of the classifier. We also discuss different methods to constrain the potential extrapolation.

79 ASTRONOMY AND ASTROPHYSICS↗

Tribology Test Bed: NiWC3b Cermet, Chloride Salts (Technical Report)

In this project, the best material and processes that we have available now are used build a pump for validation testing and to be able to provide a quotation for a pump for the Gen3 CSP Phase 3 test facility. Enough high temperature and aged material data is collected to be able to safely design a pump with a high level of confidence of good performance. Manufacturing processes for the nano-composite material including spray coating and joining methods are investigated. These processes enable application of this novel material to pump components.

36 MATERIALS SCIENCE↗

Exploring the Nature of Neutrinos with the Deep Underground Neutrino Experiment (DUNE)

The Deep Underground Neutrino Experiment (DUNE) is a next-generation experimental program designed to study the behaviour of neutrino oscillation. DUNE will utilize a neutrino beam originating at Fermilab, near Chicago, and will leverage a detector at Fermilab (Near Detector) and a detector 1300 km away in South Dakota (Far Detector), south of Saskatchewan. In the first phase of DUNE, its Far Detector will comprise of two 10,000 ton (fiducial) liquid argon (LAr) time-projection chamber (TPC) modules – powerful tracking calorimeter detectors – placed nearly a mile underground. With this large, sensitive, underground detector, DUNE aims to collect a high statistics and pure sample of neutrinos at the Far Detector. This setup also offers the potential to study non-beam physical processes via e.g. neutrinos produced in the atmosphere, supernova neutrino bursts, and/or solar neutrinos, etc. A second phase will aim to add more detector mass and expand the program. The Near Detector will consist of a LAr TPC module as well: critical to constraining systematic uncertainties in the oscillation analysis. However, this LAr TPC will have a novel design using a pixel-based readout instead of the traditional wire-based readout. This and the segmentation of the LAr TPC into multiple units are crucial in mitigating the high multiplicity of neutrino interactions expected in any readout window given its proximity to the beam. The Near Detector will feature additional components and capability beyond the LAr TPC, allowing one to deeply characterize the neutrino flux. Due to the complexity of this experimental program, several smaller-scale prototype detectors have been operating to test, validate, and improve both the technical designs and software for processing and analyzing events. By operating in charged particle test beams or neutrino beams, several of the prototypes are also capable of producing valuable results. Canadian institutions are involved in the realization of the DUNE through efforts with both the Near and Far Detectors and prototypes. DUNE is anticipated to begin operating near the end of this decade/the beginning of the next. This talk will focus on the overall DUNE program, for example its ultimate plans, status, and the efforts with prototypes.

Howard, Bruce [York U., Canada; Fermilab]↗