Search NASA⌕ Search

SEARCH · Search NASA

Results for “Test Framework”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 631 records · Page 35

Implementing and testing theoretical fission fragment yields in a Hauser-Feshbach statistical decay framework

Here, we implement fission fragment yields, calculated using Brownian shape-motion on a macroscopic-microscopic potential energy surface in six dimensions, into the Hauser-Feshbach statistical decay code CGMF. This combination allows us to test the impact of utilizing theoretically-calculated fission fragment yields on the subsequent prompt neutron and γ-ray emission. We draw connections between the fragment yields and the total kinetic energy TKE of the fission fragments and demonstrate that the use of calculated yields can introduce a difference in the $\langle$TKE$\rangle$ and, thus, the prompt neutron multiplicity v, as compared with experimental fragment yields. We deduce the uncertainty on the $\langle$TKE$\rangle$ and v from this procedure and identify possible applications.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

A logical progression of steps for implementation and testing of the 7-equation, two-phase model into a computational framework

A seven-step progression is given for the implementation of the seven-equation model, employed in the new RELAP-7 thermal hydraulics system analysis code, within the MOOSE-compatible framework. The model is well-posed and treats both phases as compressible flow in a one-dimensional, variable cross-sectional area duct/pipe/component. Some appropriate tests are also outlined to benchmark the model/implementation for each step of the progression. (authors)

97 MATHEMATICS AND COMPUTING↗

The Apache Longbow-Hellfire Missile Test at Yuma Proving Ground: Ecological Risk Assessment for Missile Firing

A multiple stressor risk assessment was conducted at Yuma Proving Ground, Arizona, as a demonstration of the Military Ecological Risk Assessment Framework. The focus was a testing program at Cibola Range, which involved an Apache Longbow helicopter firing Hellfire missiles at moving targets, M60- A1 tanks. This paper describes the ecological risk assessment for the missile launch and detonation. The primary stressor associated with this activity was sound. Other minor stressors included the detonation impact, shrapnel, and fire. Exposure to desert mule deer (Odocoileus hemionus crooki) was quantified using the Army sound contour program BNOISE2, as well as distances from the explosion to deer. Few effects data were available from related studies. Exposure-response models for the characterization of effects consisted of human "disturbance" and hearing damage thresholds in units of C-weighted decibels (sound exposure level) and a distance-based No Observed Adverse Effects Level for moose and cannonfire. The risk characterization used a weight-of-evidence approach and concluded that risk to mule deer behavior from the missile firing was likely for a negligible number of deer, but that no risk to mule deer abundance and reproduction is expected.

43 PARTICLE ACCELERATORS↗

A CFD Framework for Film Boiling and Quenching in Cryogenic Chilldown

Tests of cryogenic chilldown in a vertical stainless-steel tube are simulated using computational fluid dynamics (CFD). Subcooled liquid nitrogen enters a room-temperature tube at one end, resulting in film boiling and eventual quenching of the tube walls. A CFDbased modeling framework employing the mixture multiphase model was developed to simulate this chilldown process and was applied to validate it against experimental data. Extensive sensitivity studies have been performed to create a consistent modeling framework, and a range of test conditions are simulated to assess the modeling capability. The importance of the rewetting temperature and its relation to the foam limit temperature is discussed and considered in the CFD framework. The presented results demonstrate a qualitatively consistent representation of the film boiling and quenching regime. However, the quantitative accuracy of the simulations varies with the test conditions. In addition, simulated distributions of the vapor volume fraction are presented, but the current lack of experimental volume fraction data prevents comparisons.

Computational Fluid Dynamics↗

A CFD Framework for Film Boiling and Quenching in Cryogenic Chilldown

Tests of cryogenic chilldown in a vertical stainless-steel tube are simulated using computational fluid dynamics (CFD). Subcooled liquid nitrogen enters a room-temperature tube at one end, resulting in film boiling and eventual quenching of the tube walls. A CFDbased modeling framework employing the mixture multiphase model was developed to simulate this chilldown process and was applied to validate it against experimental data. Extensive sensitivity studies have been performed to create a consistent modeling framework, and a range of test conditions are simulated to assess the modeling capability. The importance of the rewetting temperature and its relation to the foam limit temperature is discussed and considered in the CFD framework. The presented results demonstrate a qualitatively consistent representation of the film boiling and quenching regime. However, the quantitative accuracy of the simulations varies with the test conditions. In addition, simulated distributions of the vapor volume fraction are presented, but the current lack of experimental volume fraction data prevents comparisons.

Computational Fluid Dynamics↗

Three-dimensional cooperative inversion of airborne magnetic and gravity gradient data using deep-learning techniques

Using multiple geophysical methods has become a prevailing approach in numerous geophysical applications to investigate subsurface structures and parameters. These multimethod-based exploration strategies have the potential to greatly diminish uncertainties and ambiguities encountered during geophysical data analysis and interpretation. One of the applications is the cooperative inversion of airborne magnetic and gravity gradient data for the interpretation of data obtained in mineral, oil and gas, and geothermal explorations. In this paper, a unified cooperative inversion framework is designed by combining the standard separate inversions with a deep neural network (DNN), which serves as the link between different types of data. A well-trained DNN takes the separately inverted susceptibility and density models as the inputs and provides improved models that will be used as the initial models of deterministic inversions. A two-round iteration strategy is adopted to guarantee the reasonability of the recovered models and overall efficiency of the inversion. In addition, this deep-learning (DL)-based framework demonstrates excellent generalization abilities when tested on models that are entirely distinct from the training data sets. The framework can easily incorporate multiphysics without necessitating any structural changes to the network. Synthetic experiments validate that our DL-based method outperforms conventional separate inversions and cross-gradient-based joint inversion in view of the accuracy of the recovered models and inversion efficiency. Successful application to field data further verifies the effectiveness of our DL-based method.

Geochemistry & Geophysics↗

Choreographer Pre-Testing Code Analysis and Operational Testing.

Choreographer is a "moving target defense system", designed to protect against attacks aimed at IP addresses without corresponding domain name system (DNS) lookups. It coordinates actions between a DNS server and a Network Address Translation (NAT) device to regularly change which publicly available IP addresses' traffic will be routed to the protected device versus routed to a honeypot. More details about how Choreographer operates can be found in Section 2: Introducing Choreographer. Operational considerations for the successful deployment of Choreographer can be found in Section 3. The Testing & Evaluation (T&E) for Choreographer involved 3 phases: Pre-testing, Code Analysis, and Operational Testing. Pre-testing, described in Section 4, involved installing and configuring an instance of Choreographer and verifying it would operate as expected for a simple use case. Our findings were that it was simple and straightforward to prepare a system for a Choreographer installation as well as configure Choreographer to work in a representative environment. Code Analysis, described in Section 5, consisted of running a static code analyzer (HP Fortify) and conducting dynamic analysis tests using the Valgrind instrumentation framework. Choreographer performed well, such that only a few errors that might possibly be problematic in a given operating situation were identified. Operational Testing, described in Section 6, involved operating Choreographer in a representative environment created through Emulytics TM . Depending upon the amount of server resources dedicated to Choreographer vis-á-vis the amount of client traffic handled, Choreographer had varying degrees of operational success. In an environment with a poorly resourced Choreographer server and as few as 50-100 clients, Choreographer failed to properly route traffic over half the time. Yet, with a well-resourced server, Choreographer handled over 1000 clients without missrouting. Choreographer demonstrated sensitivity to low-latency connections as well as high volumes of traffic. In addition, depending upon the frequency of new connection requests and the size of the address range that Choreographer has to work with, it is possible for all benefits of Choreographer to be ameliorated by its need to allow DNS servers rather than the end client to make DNS requests. Conclusions and Recommendations, listed in Section 7, address the need to understand the specific use case where Choreographer would be deployed to assess whether there would be problems resulting from the operational considerations described in Section 3 or performance concerns from the results of Operational Testing in Section 6. Deployed in an appropriate architecture with sufficiently light traffic volumes and a well-provisioned server, it is quite likely that Choreographer would perform satisfactorily. Thus, we recommend further detailed testing, to potentially include Red Team testing, at such time a specific use case is identified

97 MATHEMATICS AND COMPUTING↗

A CFD Framework for Film Boiling and Quenching in Cryogenic Chilldown

Tests of cryogenic chilldown in a vertical stainless steel tube are simulated using computational fluid dynamics (CFD). Subcooled liquid nitrogen enters the room-temperature tube at one end, resulting in film boiling and eventual quenching of the tube walls. A CFD-based modeling framework employing the mixture multiphase model has been developed to simulate this chilldown process and applied to validate it against experimental data. Extensive sensitivity studies have been performed to create a consistent modeling framework, and a two test conditions are simulated to test the modeling capability. The importance of the rewetting temperature and its relation to the foam limit temperature is discussed and is considered in the CFD model. The presented results demonstrate a qualitatively consistent representation of the film boiling and quenching regime. However, the quantitative accuracy of the simulations varies with the test conditions. Simulated vapor volume fraction distributions are also presented, although the current lack of experimental volume fraction data does not permit a comparison.

Computational Fluid Dynamics↗

MDPCT1 Quench Data and Performance Analysis

MDPCT1 is a four-layer cos-theta Nb3Sn dipole demonstrator developed and tested at FNAL in the framework of the U.S. Magnet Development Program. The magnet reached record fields for accelerator magnets of 14.1 T at 4.5 K in the first test and 14.5 T at 1.9 K in the second test and then showed large degradation. While its inner coils performed exceptionally well with only two quenches up to 14.5 T and no evidence of degradation, the outer coils degraded over the course of testing. By adopting new measurement and analysis techniques at FNAL we are discussing in detail what happened. Both success and failure in our diagnostics are discussed. The evolution of techniques over the course of two tests (and three thermal cycles) shows the path to address challenges brought by the first four-layer magnet tested at FNAL. This paper presents the analysis of quench data along with diagnostic features and complementary measurements taken in support of the magnet performance analysis.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Deep Learning Predicts Stress–Strain Relations of Granular Materials Based on Triaxial Testing Data

This study presents an AI-based constitutive modelling framework wherein the prediction model directly learns from triaxial testing data by combining discrete element modelling (DEM) and deep learning. A constitutive learning strategy is proposed based on the generally accepted frame-indifference assumption in constructing material constitutive models. The low-dimensional principal stress-strain sequence pairs, measured from discrete element modelling of triaxial testing, are used to train recurrent neural networks, and then the predicted principal stress sequence is augmented to other high-dimensional or general stress tensor via coordinate transformation. Through detailed hyperparameter investigations, it is found that long short-term memory (LSTM) and gated recurrent unit (GRU) networks have similar prediction performance in constitutive modelling problems, and both satisfactorily predict the stress responses of granular materials subjected to a given unseen strain path. Furthermore, the unique merits and ongoing challenges of data-driven constitutive models for granular materials are discussed.

42 ENGINEERING↗

The Apache Longbow-Hellfire Missile Test at Yuma Proving Ground: Ecological Risk Assessment for Tracked Vehicle Movement across Desert Pavement

A multiple stressor risk assessment was conducted at Yuma Proving Ground, Arizona, as a demonstration of the Military Ecological Risk Assessment Framework. The focus was a testing program at Cibola Range, which involved an Apache Longbow helicopter firing Hellfire missiles at moving targets, M60-A1 tanks. This paper describes the ecological risk assessment for the tracked vehicle movement component of the testing program. The principal stressor associated with tracked vehicle movement was soil disturbance, and a resulting, secondary stressor was hydrological change. Water loss to washes and wash vegetation was expected to result from increased infiltration and/or evaporation associated with disturbances to desert pavement. The simulated exposure of wash vegetation to water loss was quantified using estimates of exposed land area from a digital ortho quarter quad aerial photo and field observations, a 30 30 m digital elevation model, the flow accumulation feature of ESRI ArcInfo, and a two-step process in which runoff was estimated from direct precipitation to a land area and from water that flowed from upgradient to a land area. In all simulated scenarios, absolute water loss decreased with distance from the disturbance, downgradient in the washes; however, percentage water loss was greatest in land areas immediately downgradient of a disturbance. Potential effects on growth and survival of wash trees were quantified by using an empirical relationship derived from a local unpublished study of water infiltration rates. The risk characterization concluded that neither risk to wash vegetation growth or survival nor risk to mule deer abundance and reproduction was expected. The risk characterization was negative for both the incremental risk of the test program and the combination of the test and pretest disturbances.

43 PARTICLE ACCELERATORS↗

Deep learning to estimate permeability using geophysical data

Time-lapse electrical resistivity tomography (ERT) is a popular geophysical method to estimate three-dimensional (3D) permeability fields from electrical potential difference measurements. Traditional inversion and data assimilation methods are used to ingest this ERT data into hydrogeophysical models to estimate permeability. Due to ill-posedness and the curse of dimensionality, existing inversion strategies provide poor estimates and low resolution of the 3D permeability field. Recent advances in deep learning provide us with powerful algorithms to overcome this challenge. This paper presents a deep learning (DL) framework to estimate the 3D subsurface permeability from time-lapse ERT data. To test the feasibility of the proposed framework, we train DL-enabled inverse models on simulation data. Each measurement in both synthetic and field data is standardized by removing the mean and scaling the time-series to unit variance. This pre-processing step is necessary to bring simulation data closer to field observations. Subsurface process models based on hydrogeophysics are used to generate this synthetic data. Training performed on limited simulation data resulted in the DL model over-fitting. An advanced data augmentation based on mixup is implemented to generate additional training samples to overcome this issue. This mixup technique creates weakly labeled (low-fidelity) samples from strongly labeled (high-fidelity) data. The weakly labeled training data is then used to develop DL-enabled inverse models and reduce over-fitting. As both time-lapse ERT (1133048 features/realization) and 3D permeability (585453 features/realization) data samples are from a high-dimensional space, principal component analysis (PCA) is employed to reduce dimensionality. Encoded ERT and encoded permeability are generated using the trained PCA estimators. A deep neural network is then trained to map the encoded ERT to encoded permeability. This mixup training and unsupervised learning allowed us to build a fast and reasonably accurate DL-based inverse model under limited simulation data. Results show that proposed weak supervised learning can capture salient spatial features in the 3D permeability field. Quantitatively, the average mean squared error (in terms of the natural log) on the strongly labeled training, validation, and test datasets is less than 0.5. The R 2 -score (global metric) is greater than 0.75, and the percent error in each cell (local metric) is less than 10%. Finally, an added benefit in terms of computational cost is that the proposed DL-based inverse model is at least O(10 4 ) times faster than running a forward model once it is trained. Data generation, DL model training, and hyperparameter tuning to identify optimal neural network architectures utilized high-performance computing resources while the DL inference is performed on a standard laptop. Approximately, O(10 5 ) processor hours are used for generating data and DL tuning and training. We acknowledge that the data generation and DL model development are expensive. But once a DL model is trained, it can be re-used for inversion rapidly for the given system, with set physics and domain. Note that traditional inversion may require multiple forward model simulations (e.g., in the order of 10 to 1000), which are very expensive. This computational savings ≈ O(10 5 ) – O(10 7 )) makes the proposed DL-based inverse model attractive for subsurface imaging and real-time ERT monitoring applications due to fast and yet reasonably accurate estimations of permeability field.

58 GEOSCIENCES↗

Development of a Framework and Methodology for an Advanced Reactor Materials Environmental Effects Design Guide

Advanced non-light-water reactor components may operate at elevated temperature while experiencing cyclic loading, significant neutron irradiation, and exposure to reactor coolant. ASME Boiler and Pressure Vessel Code, Section III, Division 5, provides design rules for elevated-temperature service but does not include specific procedures to account for environmental effects on material properties. This report develops an initial framework and methodology for an Environmental Effects Design Guide (EEDG) focused on neutron irradiation; coolant-environment effects are reserved for future work. The proposed approach treats irradiation as a property-based overlay on the existing Division 5 design process, with two routes: a sparse-data route applying two reduction factors — FCR on creep-rupture strength and FF on fatigue life — for the creep-fatigue evaluations that typically control the design of advanced high-temperature reactor components, and a fuller framework developing the property-to-rule chain across the four Division 5 checks (primary load, strain limits and ratcheting, creep-fatigue, and buckling), together with swelling and weldments as scope items. Both routes are scoped by an in-pile qualification that restricts the use of post-irradiation-examination-derived properties in regimes where an in-pile mechanism could control the design outcome. Illustrative outputs derived on a compiled annealed Type 316 database — FCR ≈ 0.78–0.86 and FF ≈ 0.4 — demonstrate the calculation method within that specific dataset. The framework is an initial, testable design-rule concept; it identifies a practical path for preliminary design evaluations under sparse data and the material data and testing needed to develop the framework further.

Barua, Bipul (ORCID:0000000247184113)↗

A multivariate approach to ensure statistical reproducibility of climate model simulations

Effective utilization of novel hybrid architectures of pre-exascale and exascale machines requires transformations to global climate modeling systems that may not reproduce the original model solution bit-for-bit. Round-off level differences grow rapidly in these non-linear and chaotic systems. This makes it difficult to isolate bugs/errors from innocuous growth expected from round-off level differences. Here, we apply two modern multivariate two sample equality of distribution tests to evaluate statistical reproducibility of global climate model simulations using standard monthly output of short (~ 1-year) simulation ensembles of a control model and a modified model of US Department of Energy's Energy Exascale Earth System Model (E3SM). Both the tests are able to identify changes induced by modifications to some model tuning parameters. We also conduct formal power analyses of the tests by applying them on designed suites of short simulation ensembles each with an increasingly different climate from the control ensemble. The results are compared against those from another such test. These power analyses provide a framework to quantify the degree of differences that can be detected confidently by the tests for a given ensemble size (sample size). This will allow model developers using the tests to make an informed decision when accepting/rejecting an unintentional non-bit-for-bit change to the model solution.

Mahajan, Salil↗

Statistical Analysis of CFD Solutions from the Drag Prediction Workshop

A simple, graphical framework is presented for robust statistical evaluation of results obtained from N-Version testing of a series of RANS CFD codes. The solutions were obtained by a variety of code developers and users for the June 2001 Drag Prediction Workshop sponsored by the AIAA Applied Aerodynamics Technical Committee. The aerodynamic configuration used for the computational tests is the DLR-F4 wing-body combination previously tested in several European wind tunnels and for which a previous N-Version test had been conducted. The statistical framework is used to evaluate code results for (1) a single cruise design point, (2) drag polars and (3) drag rise. The paper concludes with a discussion of the meaning of the results, especially with respect to predictability, Validation, and reporting of solutions.

Hemsch, Michael J.↗

Revisiting the guidelines for ending isolation for COVID-19 patients

Since the start of the COVID-19 pandemic, two mainstream guidelines for defining when to end the isolation of SARS-CoV-2-infected individuals have been in use: the one-size-fits-all approach (i.e. patients are isolated for a fixed number of days) and the personalized approach (i.e. based on repeated testing of isolated patients). We use a mathematical framework to model within-host viral dynamics and test different criteria for ending isolation. By considering a fixed time of 10 days since symptom onset as the criterion for ending isolation, we estimated that the risk of releasing an individual who is still infectious is low (0–6.6%). However, this policy entails lengthy unnecessary isolations (4.8–8.3 days). In contrast, by using a personalized strategy, similar low risks can be reached with shorter prolonged isolations. The obtained findings provide a scientific rationale for policies on ending the isolation of SARS-CoV-2-infected individuals.

Jeong, Yong Dam↗

A comparison of single-cycle versus multi-cycle proof testing strategies

Proof testing was a useful supplement to conventional nondestructive evaluation (NDE) of space shuttle main engine (SSME) components. Since many of these components involve thin sections and high toughness materials, such as Inconel 718, conventional single-cycle proof test logic is not applicable due to the propensity for stable crack growth during the proof tests. Experience with five-cycle proof testing of SSME components is summarized and a framework is outlined for understanding multi-cycle proof testing using the fracture mechanics concept of a resistance curve. Extreme value statistics are also used to propose an empirical approach to compare the advantages and disadvantages of single- versus multi-cycle proof testing. The importance of the initial flaw size distribution and specimen thickness in such a comparison is also discussed.

Hudak, Stephen J., Jr.↗

Formal functional test designs with a test representation language

The application of the category-partition method to the test design phase of hardware, software, or system test development is discussed. The method provides a formal framework for reducing the total number of possible test cases to a minimum logical subset for effective testing. An automatic tool and a formal language were developed to implement the method and produce the specification of test cases.

Hops, J. M.↗