Search NASA⌕ Search

SEARCH · Search NASA

Results for “Benchmark testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,531 records · Page 85

Simplified Space Conditioning in Low-Load Homes: Results from Pittsburgh, Pennsylvania, New Construction Unoccupied Test House

Field testing was performed in a new construction unoccupied test house in Pittsburgh, PA. Four air-based heating, ventilation, and air conditioning distribution systems—a typical airflow ducted system to the bedrooms, a low airflow ducted system to the bedrooms, a system with transfer fans to the bedrooms, and a system with no ductwork to the bedrooms—were evaluated during heating, cooling, and midseason conditions. The relative ability of each system was assessed with respect to relevant Air Conditioning Contractors of America and ASHRAE standards for house temperature uniformity and stability, respectively.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Disentangling the gap between pure and mixed-gas performance of thin film composite membranes through improved cell design and testing methods

Testing thin film composite (TFC) membrane coupons at low stage-cuts (≤5%) in a sweep-gas permeation system is a common practice to obtain mixed-gas separation properties for benchmarking performance and making scale-up decisions. However, even under these idealized conditions, mixed-gas permeance and selectivity can be more than 30% lower than their pure-gas values, partially due to concentration polarization, an effect that typically intensifies with increased membrane permeance. This study investigates the effect of cell design on mixed-gas testing using PolyActive TM TFC membranes with pure-gas CO 2 permeance of 1700 – 3100 gas permeance unit (GPU), covering the permeance range of most state-of-the-art CO 2 /N 2 separation membranes. Here, we designed and 3D-printed a counter-current permeation cell with enhanced feed and sweep flow efficiency, resulting in a 33 – 41% increase in mixed-gas CO 2 permeance compared to traditional permeation cells. Furthermore, we compared sweep-gas and vacuum permeation methods using traditional permeation cells, revealing that the latter delivers 41% higher mixed-gas CO 2 permeance, because vacuuming effectively minimizes the downstream concentration polarization. These findings highlight the importance of cell design and permeation apparatus selection in lab-scale mixed-gas testing, with strong implications for module design and process optimization at the industrial scale.

mixed gas performance↗

Building America Case Study: Evaluating Through-Wall Air Transfer Fans, Pittsburgh, Pennsylvania (Fact Sheet)

In this project, Building America team IBACOS performed field testing in a new construction unoccupied test house in Pittsburgh, Pennsylvania to evaluate heating, ventilating, and air conditioning (HVAC) distribution systems during heating, cooling, and midseason conditions. Four air-based HVAC distribution systems were assessed:-a typical airflow ducted system to the bedrooms, a low airflow ducted system to the bedrooms, a system with transfer fans to the bedrooms, and a system with no ductwork to the bedrooms. The relative ability of each system was considered with respect to relevant Air Conditioning Contractors of America and ASHRAE standards for house temperature uniformity and stability, respectively.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Leveraging operational information from wastewater injection wells to evaluate CO 2 injection performance for carbon storage applications in the Appalachian Basin

Abstract Geologic parameters, geophysical logging, injection testing, and operational metrics from wastewater injection wells were integrated to develop a preliminary design of a carbon storage facility in the Appalachian Basin. A scattered group of 10–20 commercial wastewater injection wells dispose off produced water from oil and gas wells in the region, utilizing a sequence of stacked deep saline formations for injection zones. These wastewater injection wells provide practical benchmarks for understanding the feasibility of carbon dioxide (CO 2 ) storage. Geologic models were developed based on characterization data from the wastewater injection wells. Reservoir simulations were calibrated according to injection testing and operational data from the wastewater injection wells. Long‐term operational data on injection flow rates and pressures measured in the wastewater injection wells were especially useful to evaluate the performance of carbon storage applications. The simulations were used to estimate injection pressures, radius of CO 2 saturation, and pressure response for industrial scale CO 2 storage applications. Results were also used to provide a design basis in terms of number of injection wells, well spacing, area of review, injection system components, monitoring plan, and CO 2 pipeline distribution system. The analysis demonstrates that there is sufficient injectivity in the deep saline formations in the west‐central Appalachian Basin to store commercial volumes of anthropogenic CO 2 . The geologic system appears suitable for supporting CO 2 injection rates of 0.5–1.0 million metric tons per year at injection pressures below formation fracture pressure in a single well. The long‐term operational data of wastewater injection wells within the study area suggested a lower permeability‐thickness values than indicated by initial reservoir tests. A workflow for developing realistic permeability values for input into reservoir simulations is presented. © 2020 Society of Chemical Industry and John Wiley & Sons, Ltd.

Valluri, Manoj↗

CFD simulation of MSW combustion and SNCR in a commercial incinerator

Highlights: • Presented a CFD scheme for modeling MSW incinerator including SNCR process. • Performed a sensitivity analysis of SNCR operating conditions. • Non-uniform distributions of gas velocity, temperature and NO{sub x} in the incinerator. • The injection position of reagent was critical for a desirable performance of SNCR. • A NSR 1.5 was recommended as a compromise of NO{sub x} reduction rates and NH{sub 3} slip. - Abstract: A CFD scheme was presented for modeling municipal solid waste (MSW) combustion in a moving-grate incinerator, including the in-bed burning of solid wastes, the out-of-bed burnout of gaseous volatiles, and the selective non-catalytic reduction (SNCR) process between urea (CO(NH{sub 2}){sub 2}) and NO{sub x}. The in-bed calculations provided 2-D profiles of the gas–solid temperatures and the gas species concentrations along the bed length, which were then used as inlet conditions for the out-of-bed computations. The over-bed simulations provided the profiles of incident radiation heat flux on the top of bed. A 3-dimensional benchmark simulation was conducted with a 750 t/day commercial incinerator using the present coupling scheme incorporating with a reduced SNCR reduction mechanism. Numerical tests were performed to investigate the effects of operating parameters such as injection position, injection speed and the normalized stoichiometric ratio (NSR) on the SNCR performance. The simulation results showed that the distributions of gas velocity, temperature and NO{sub x} concentration were highly non-uniform, which made the injection position one of the most sensitive operating parameters influencing the SNCR performance of moving grate incinerators. The simulation results also showed that multi-layer injections were needed to meet the EU2000 standard, and a NSR 1.5 was suggested as a compromise of a satisfactory NO{sub x} reduction and reasonable NH{sub 3} slip rates. This work provided useful guides to the design and operation of SNCR process in moving-grate incinerators.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Code Comparison Study Fosters Confidence in the Numerical Simulation of Enhanced Geothermal Systems

Numerical simulation has become a standard analytical tool for scientists and engineers to evaluate the potential and performance of enhanced geothermal systems. A variety of numerical simulators developed by industry, universities, and national laboratories are currently available and being applied to better understand enhanced geothermal systems at the field scale. To yield credible predictions and be of value to site operators, numerical simulators must be able to accurately represent the complex coupled processes induced by producing geothermal systems, such as fracture aperture changes due to thermal stimulation, fracture shear displacement with fluid injection, rate of thermal depletion of reservoir rocks, and permeability alteration with mineral precipitation or dissolution. A suite of numerical simulators was exercised on a series of test problems that considered coupled thermal, hydraulic, geomechanical, and geochemical (THMC) processes. Problems were selected and designed to isolate selected coupled processes, to be executed on workstation class computers, and have simple but illustrative metrics for result comparisons. This paper summarizes the initial suite of seven benchmark problems, describes the code comparison activities, provides example results for problems and documents the capabilities of currently available numerical simulation codes to represent coupled processes that occur during the production of geothermal resources. Code comparisons described in this paper use the ISO (International Organization for Standardization) standard ISO-13538 for proficiency testing of numerical simulators. This approach was adopted for a recent code comparison study within the radiation transfer-modeling field of atmospheric sciences, which was focused on canopy reflectance models. This standard specifies statistical methods for analyzing laboratory data from proficiency testing schemes to demonstrate that the measurement results do not exhibit evidence of an unacceptable level of bias.

benchmark problems↗

Adiabatic quantum support vector machines

Adiabatic quantum computers can solve difficult optimization problems (e.g., the quadratic unconstrained binary optimization problem), and they seem well suited to train machine learning models. In this paper, we describe an adiabatic quantum approach for training support vector machines. We show that the time complexity of our quantum approach is an order of magnitude better than the classical approach. Next, we compare the test accuracy of our quantum approach against a classical approach that uses the Scikit-learn library in Python across five benchmark datasets (Iris, Wisconsin Breast Cancer (WBC), Wine, Digits, and Lambeq). We show that our quantum approach obtains accuracies on par with the classical approach. Finally, we perform a scalability study in which we compute the total training times of the quantum approach and the classical approach with an increasing number of features and an increasing number of data points in the training dataset. In conclusion, our scalability results show that the quantum approach obtains a 3.5–4.5x speedup over the classical approach on datasets with many (millions of) features.

Computational Complexity↗

Dynamic signatures of electronically nonadiabatic coupling in sodium hydride: a rigorous test for the symmetric quasi-classical model applied to realistic, ab initio electronic states in the adiabatic representation

Sodium hydride (NaH) in the gas phase presents a seemingly simple electronic structure making it a potentially tractable system for the detailed investigation of nonadiabatic molecular dynamics from both computational and experimental standpoints. The single vibrational degree of freedom, as well as the strong nonadiabatic coupling that arises from the excited electronic states taking on considerable ionic character, provides a realistic chemical system to test the accuracy of quasi-classical methods to model population dynamics where the results are directly comparable against quantum mechanical benchmarks. Here, using a simulated pump–probe type experiment, this work presents computational predictions of population transfer through the avoided crossings of NaH via symmetric quasi-classical Meyer–Miller (SQC/MM), Ehrenfest, and exact quantum dynamics on realistic, ab initio potential energy surfaces. The main driving force for population transfer arises from the ground vibrational level of the D 1 Σ + adiabatic state that is embedded in the manifold of near-dissociation C 1 Σ + vibrational states. When coupled through a sharply localized first-order derivative coupling most of the population transfers between t = 15 and t = 30 fs depending on the initially excited vibronic wavepacket. While quantum mechanical effects are expected due to the reduced mass of NaH, predictions of the population dynamics from both the SQC/MM and Ehrenfest models perform remarkably well against the quantum dynamics benchmark. Additionally, an analysis of the vibronic structure in the nonadiabatically coupled regime is presented using a variational eigensolver methodology.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Electromagnetic physics vectorization in the GeantV transport framework

The development of the GeantV Electromagnetic (EM) physics package has evolved following two necessary paths towards code modernization. A first phase required the revision of the main electromagnetic physics models and their implementation. The main objectives were to improve their accuracy, extend them to the new high-energy frontier posed by the Future Circular Collider (FCC) programme and allow a better adaptation to a multi-particle flow. Most of the EM physics models in GeantV have been reviewed from theoretical perspective and rewritten with vector-friendly implementations, being now available in scalar mode in the alpha release. The second phase consists of a thorough investigation on the possibility to vectorise the most CPU-intensive physics code parts, such as final state sampling. We have shown the feasibility of implementing electromagnetic physics models that take advantage of SIMD/SIMT architectures, thus obtaining gains in performance. After this phase, the time has come for the GeantV project to take a step forward towards the final proof of concept. This takes shape through the testing of the full simulation chain (transport + physics + geometry) running in vectorized mode. In this paper we will present the first benchmark results obtained after vectorizing a full set of electromagnetic physics models.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Mixed quantum/classical calculations of total and differential elastic and rotationally inelastic scattering cross sections for light and heavy reduced masses in a broad range of collision energies

The mixed quantum/classical theory (MQCT) for rotationally inelastic scattering developed recently [A. Semenov and D. Babikov, J. Chem. Phys. 139, 174108 (2013)] is benchmarked against the full quantum calculations for two molecular systems: He + H{sub 2} and Na + N{sub 2}. This allows testing new method in the cases of light and reasonably heavy reduced masses, for small and large rotational quanta, in a broad range of collision energies and rotational excitations. The resultant collision cross sections vary through ten-orders of magnitude range of values. Both inelastic and elastic channels are considered, as well as differential (over scattering angle) cross sections. In many cases results of the mixed quantum/classical method are hard to distinguish from the full quantum results. In less favorable cases (light masses, larger quanta, and small collision energies) some deviations are observed but, even in the worst cases, they are within 25% or so. The method is computationally cheap and particularly accurate at higher energies, heavier masses, and larger densities of states. At these conditions MQCT represents a useful alternative to the standard full-quantum scattering theory.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Validation of a Hybrid Domain Overlapping Coupling Between SAM and CFD Against the TALL-3D Transients

The System Thermal Hydraulics (STH) code SAM has been coupled to the Computational Fluid Dynamics (CFD) code Simcenter STAR-CCM+ utilizing a hybrid domain overlapping method with an explicit coupling in time. The coupling aims to extend the STH code’s applicability to scenarios where local momentum and energy transfers are important yet difficult for STH codes to capture, such as three-dimensional (3D) mixing. The coupling method’s numerical stability was verified in the past against two closed-loop configurations, and it was validated against a double T-junction experiment with 3D scalar mixing. In the present work, the coupling method is validated against the TALL-3D STH/CFD coupling benchmark facility. TALL-3D is a three-legged, liquid-metal facility with a large, pool-type enclosure (test section) that exhibits 3D flow effects to be modeled by a CFD code. The rest of the system exhibits approximately 1D behavior well-predicted by an STH code. First, the present STAR-CCM+ CFD model of the 3D test section is validated against experimental data. Then, the SAM-STARCCM+ coupled model is validated against six different TALL-3D steady states, including SAM standalone model results for comparison. Lastly, the SAM-STARCCM+ coupled model is validated against two TALL-3D transients, one exhibiting flow reversal in the test section and one exhibiting nonlinear, Limit Cycle Oscillations (LCO). For the first transient, the SAM-STARCCM+ coupled model properly predicts an increase in the test section’s inlet temperature during flow reversal, and this is not predicted by the SAM standalone model. Following flow reversal, the SAM-STARCCM+ coupled model better-predicts the initial flow recovery and following oscillations as the system approaches a final natural circulation state. For the second transient, no true final steady state is observed due to LCO. Neither the SAM-STARCCM+ coupled model nor the SAM standalone model can perfectly capture the experiment’s changing oscillation frequency during the transient. However, the SAM-STARCCM+ coupled model does reproduce the oscillatory feedback observed in the system. This is a significant achievement as the SAM-STARCCM+ coupled model only uses an explicit coupling in time, as opposed to a semi-implicit coupling. In comparison, previous STH/CFD coupling efforts of the TALL-3D facility required semi-implicit coupling to obtain similar results.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Anelastic sensitivity kernels with parsimonious storage for adjoint tomography and full waveform inversion

We introduce a technique to compute exact anelastic sensitivity kernels in the time domain using parsimonious disk storage. The method is based on a reordering of the time loop of time-domain forward/adjoint wave propagation solvers combined with the use of a memory buffer. It avoids instabilities that occur when time-reversing dissipative wave propagation simulations. The total number of required time steps is unchanged compared to usual acoustic or elastic approaches. The cost is reduced by a factor of 4/3 compared to the case in which anelasticity is partially accounted for by accommodating the effects of physical dispersion. We validate our technique by performing a test in which we compare the Kα sensitivity kernel to the exact kernel obtained by saving the entire forward calculation. This benchmark confirms that our approach is also exact. We illustrate the importance of including full attenuation in the calculation of sensitivity kernels by showing significant differences with physical-dispersion-only kernels.

Geochemistry & Geophysics↗

YARNsim: Simulating Hadoop YARN

Despite the popularity of the Apache Hadoop system, its success has been limited by issues such as single points of failure, centralized job/task management, and lack of support for programming models other than MapReduce. The next generation of Hadoop, Apache Hadoop YARN, is designed to address these issues. In this paper, we propose YARNsim, a simulation system for Hadoop YARN. YARNsim is based on parallel discrete event simulation and provides protocol-level accuracy in simulating key components of YARN. YARNsim provides a virtual platform on which system architects can evaluate the design and implementation of Hadoop YARN systems. Also, application developers can tune job performance and understand the tradeoffs between different configurations, and Hadoop YARN system vendors can evaluate system efficiency under limited budgets. To demonstrate the validity of YARNsim, we use it to model two real systems and compare the experimental results from YARNsim and the real systems. The experiments include standard Hadoop benchmarks, synthetic workloads, and a bioinformatics application. The results show that the error rate is within 10% for the majority of test cases. The experiments prove that YARNsim can provide what-if analysis for system designers in a timely manner and at minimal cost compared with testing and evaluating on a real system.

Hadoop↗

Supersymmetry Without Prejudice at the LHC

The discovery and exploration of Supersymmetry in a model-independent fashion will be a daunting task due to the large number of soft-breaking parameters in the MSSM. In this paper, we explore the capability of the ATLAS detector at the LHC ({radical}s = 14 TeV, 1 fb{sup -1}) to find SUSY within the 19-dimensional pMSSM subspace of the MSSM using their standard transverse missing energy and long-lived particle searches that were essentially designed for mSUGRA. To this end, we employ a set of {approx} 71k previously generated model points in the 19-dimensional parameter space that satisfy all of the existing experimental and theoretical constraints. Employing ATLAS-generated SM backgrounds and following their approach in each of 11 missing energy analyses as closely as possible, we explore all of these 71k model points for a possible SUSY signal. To test our analysis procedure, we first verify that we faithfully reproduce the published ATLAS results for the signal distributions for their benchmark mSUGRA model points. We then show that, requiring all sparticle masses to lie below 1(3) TeV, almost all(two-thirds) of the pMSSM model points are discovered with a significance S > 5 in at least one of these 11 analyses assuming a 50% systematic error on the SM background. If this systematic error can be reduced to only 20% then this parameter space coverage is increased. These results are indicative that the ATLAS SUSY search strategy is robust under a broad class of Supersymmetric models. We then explore in detail the properties of the kinematically accessible model points which remain unobservable by these search analyses in order to ascertain problematic cases which may arise in general SUSY searches.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Trinity Acceptance Tests Performance Summary.

Ensuring Real Applications perform well on Trinity is key to success. Four components: ASC applications, Sustained System Performance (SSP), Extra-Large MiniApplications problems, and Micro-benchmarks.

97 MATHEMATICS AND COMPUTING↗

Final Report on Developing Microstructure-Property Correlation in Reactor Materials using in situ High-Energy X-rays

This report provides a summary of research activities on understanding microstructure – property correlation in reactor materials using in situ high-energy X-rays. The report is a Level 2 deliverable in FY16 (M2CA-13-IL-AN_-0403-0111), under the Work Package CA-13-IL-AN_- 0403-01, “Microstructure-Property Correlation in Reactor Materials using in situ High Energy Xrays”, as part of the DOE-NE NEET Program. The objective of this project is to demonstrate the application of in situ high energy X-ray measurements of nuclear reactor materials under thermal-mechanical loading, to understand their microstructure-property relationships. The gained knowledge is expected to enable accurate predictions of mechanical performance of these materials subjected to extreme environments, and to further facilitate development of advanced reactor materials. The report provides detailed description of the in situ X-ray Radiated Materials (iRadMat) apparatus designed to interface with a servo-hydraulic load frame at beamline 1-ID at the Advanced Photon Source. This new capability allows in situ studies of radioactive specimens subject to thermal-mechanical loading using a suite of high-energy X-ray scattering and imaging techniques. We conducted several case studies using the iRadMat to obtain a better understanding of deformation and fracture mechanisms of irradiated materials. In situ X-ray measurements on neutron-irradiated pure metal and model alloy and several representative reactor materials, e.g. pure Fe, Fe-9Cr model alloy, 316 SS, HT-UPS, and duplex cast austenitic stainless steels (CASS) CF-8 were performed under tensile loading at temperatures of 20-400°C in vacuum. A combination of wide-angle X-ray scattering (WAXS), small-angle X-ray scattering (SAXS), and imaging techniques were utilized to interrogate microstructure at different length scales in real time while the specimen was subject to thermal-mechanical loading. In addition, in situ X-ray studies were complemented and benchmarked by ex situ characterization using advanced electron microscopy, atom probe tomography (APT) and micro/nano-indentation. The report presented in situ tensile test results on neutron-irradiated pure Fe, Fe-9Cr model alloy, 316 SS and CASS CF-8. These in situ experiments demonstrate the broad applications of the new capability in understanding several outstanding issues related to irradiated materials.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Superconducting Qubits Underground

Superconducting qubit devices are highly sensitive to cosmic ray induced quasiparticle poisoning—a challenge for quantum computing. At Fermilab, we utilize an underground testbed called QUIET that significantly decreases the rate of such events. We employ an open-source toolchain, including Qiskit Metal and the SQuADDs library, for device design and simulation prior to fabrication. We then test these chips in QUIET, which is capable of housing many chips, enabling tests of scalability. This presentation will cover our qubit design approach, fabrication capabilities, and first measurements from qubits deployed in QUIET, benchmarking the new facility.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Comprehensive Evaluation for Protective Coatings: Optical, Electrical, Photoelectrochemical, and Spectroscopic Characterizations

Numerous efficient semiconductors suffer from instability in aqueous electrolytes. Strategies utilizing protective coatings have thus been developed to protect these photoabsorbers against corrosion while synergistically improving charge separation and reaction kinetics. Recently, various photoelectrochemical (PEC) protective coatings have been reported with suitable electronic properties to ensure low charge transport loss and reveal the fundamental photoabsorber efficiency. However, protocols for studying the critical figures of merit for protective coatings have yet to be established. For this reason, we propose four criteria for evaluating the performance of a protective coating for PEC water-splitting: stability, conductivity, optical transparency, and energetic matching. We then propose a flow chart that summarizes the recommended testing protocols for quantifying these four performance metrics. In particular, we lay out the stepwise testing protocols to evaluate the energetics matching at a semiconductor/coating/(catalyst)/liquid interface. Finally, we provide an outlook for the future benchmarking needs for coatings.

36 MATERIALS SCIENCE↗