Search NASA⌕ Search

SEARCH · Search NASA

Results for “external validity”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11

Automated Data Review of Analytical Laboratory Results at Los Alamos National Laboratory - 20299

Newport News Nuclear BWXT-Los Alamos, LLC (N3B) collects samples in support of the U.S. Department of Energy's (DOE) Office of Environmental Management (EM) Los Alamos Legacy Cleanup Contract (LLCC). N3B receives and reviews over 1.6 million sample data points annually in support of various ongoing environmental monitoring and remediation projects of the LLCC. N3B must demonstrate and document that reported external analytical laboratory data produced for the LLCC are of sufficient quality to fulfill their intended purpose and to support defensible decision making as described in EPA QA/G4 Guidance for the Data Quality Objectives Process 1994. In 2018, N3B assumed management of the LLCC along with the Environmental Information Management (EIM) database that contains all historical and current environmental data associated with the LLCC. The entire EIM database is shared between N3B, Triad National Security, LLC (Triad), and New Mexico Environment Department (NMED). These three parties jointly manage the database, its configuration, and changes / updates. All environmental data that are entered into EIM are updated and available, on a daily basis, in the linked public database Intellus New Mexico (Intellus). The quality and defensibility of the environmental data generated from sampling activities is a key component of an effective remediation process. Providing quality data is accomplished through a data assessment process that includes examination, verification, and validation. Examination is the assessment of completeness of the deliverables, identification of any reporting errors, and determining the usability of the data based on the laboratory's evaluation of its data as described in the case narrative received with the data. Verification consists of an evaluation of the Electronic Data Deliverables (EDD) data report to determine the extent to which the external analytical laboratories met method and contract-specific quality control and reporting requirements. Validation consists of determining the data quality and the extent to which the external analytical laboratories accurately and completely reported all sample and quality control results and satisfied all contract requirements. EIM contains an automatic Data Validation Module which performs automated data review (DVM ADR). DVM ADR is a tool to assist in the validation process. When DVM ADR is used in conjunction with manual examination of sample data packages, the combination of the two will meet and exceed the requirements of verification. N3B recognized an opportunity for process improvement, focusing on DVM ADR configuration and enhancements in EIM. Testing EIM's configuration provided proof of the DVM ADR's capabilities and flexibility to accurately perform routine data checks based on analytical methods and regulatory requirements. In addition, the DVM ADR module was improved through enhancements for all analytes, particularly upgrades for radiochemistry data. Extensive testing of the DVM ADR module occurred using EDDs from actual laboratory analyses on the EIM testing site. During this process, N3B manipulated EDD information to verify that the actual outcomes matched the expected outcomes. The results of this testing were shared with the database architects, and configuration improvements were identified to address these results. During this process, N3B identified that the radiochemical DVM ADR capabilities were underutilized, and so enhanced the DVM ADR functionality with respect to radioanalytical assessment. N3B environmental data uploads to Intellus on a daily basis from EIM, once the analytical data undergoes examination and verification. As such, it is important to have a high level of confidence in the quality and defensibility of the data. The process of manual examination, along with the DVM ADR, in conjunction with full validation of a percentage the data specified through the Data Quality Objectives greatly increases efficiency of data review and confidence level of the quality of the data, and gives the project managers, governmental offices, and the public expedited access to high-quality data. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Review of Experimental Data for Validating Computer Codes Used in Shielding Calculations for Spent Fuel Storage and Transportation Systems

This report presents a review of available radiochemical assay data and shielding benchmarks applicable to spent nuclear fuel (SNF) shielding calculations. The relevant information reviewed herein includes the Spent Fuel Composition (SFCOMPO) database, the Shielding Integral Benchmark Archive and Database (SINBAD), the International Handbook of Evaluated Criticality Safety Benchmark Experiments, and published measurements of external dose rates of casks loaded with SNF. The relevant experimental data identified in this report may be used to support verification and validation of computer codes used in SNF cask/transport shielding applications, as well as development of calculation uncertainties. It should be noted that a relatively small subset of the identified experimental data (e.g., criticality alarm experiments) is available in a standard format established by the international community participating in experimental isotopic and shielding data evaluations. An effort of the SFCOMPO Technical Review Group (TRG) is underway to publish first isotopic evaluations of individual assay data using a standard data evaluation format. The SINBAD TRG has recently initiated benchmark evaluations and modernization of the database. Therefore, more relevant information is expected in the future that will enable users to select quality experimental data in depletion code and shielding code validations for SNF applications.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

External Release of Organic Scintillator DRiFT Software - Technology Evaluation and Demonstration Project Accomplishments [Slides]

Overview and Objectives: DRiFT post processes radiation transport output from MCNP, and generates realistic nuclear instrumentation response; Organic scintillator response has been developed, tested, and validated with measurements, these instruments are widely used in nuclear safeguards. At the beginning of this project, DRiFT was only available to LANL employees with access to yellow High Performance Computing clusters. Additionally, there are many complicated external software dependencies. Our TED project request proposed using funds to: Comment and clean up code, friendly testing, generating test suites and examples; Expansion of scintillator types natively supported by DRiFT; External release of DRiFT accompanied by documentation. We accomplished all objectives (and many others), they are highlighted in these slides.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Validation of CERES Flight Model 5 In-Orbit Calibrations Using Lunar Observations

Scientific studies require radiation fluxes over the Earth to be accurate within 1% for shortwave fluxes and 0.5% for outgoing longwave fluxes. The validation of in-orbit instrument performance requires both stability in calibration source and also calibration corrections to compensate for instrument changes. The Moon offers an external source whose signal variance is predictable and non-degrading. CERES detectors register the signal output from the entire face of the Moon. Lunar observations performed by CERES Flight Models (FM) 1 through 4 have been successful in assisting validation of radiances to the required accuracy. CERES Flight Model 5 (FM-5) is on Suomi/NPP spacecraft, orbiting since October 2011. This paper uses lunar measurements to validate detector output of FM-5. These measurements are adjusted to remove orbital effects due to variations in distance between Moon and Sun, distance between the satellite and the Moon and lunar phase angle. These effects create a total variation in lunar irradiance of 20% in the total channel and 8% in the shortwave channel. The change in orientation of the Moon as seen by the detector is called libration and causes variations of about 1% of the irradiance. A consistent dataset spanning at least 2 years in length is required to remove variations due to libration. The major uncertainties remaining in the measurements are assumed to be due to changes of the spectral responses of the channels due to degradation of optical surfaces in orbit. The results demonstrate that lunar observations can be used to validate FM-5 measurements.

Clouds and Earth Radiant Energy System↗

Computational study of single-expansion-ramp nozzles with external burning

A computational investigation of the effects of external burning on the performance of single expansion ramp nozzles (SERN) operating at transonic speeds is presented. The study focuses on the effects of external heat addition and introduces a simplified injection and mixing model based on a control volume analysis. This simplified model permits parametric and scaling studies that would have been impossible to conduct with a detailed CFD analysis. The CFD model is validated by comparing the computed pressure distribution and thrust forces, for several nozzle configurations, with experimental data. Specific impulse calculations are also presented which indicate that external burning performance can be superior to other methods of thrust augmentation at transonic speeds. The effects of injection fuel pressure and nozzle pressure ratio on the performance of SERN nozzles with external burning are described. The results show trends similar to those reported in the experimental study, and provide additional information that complements the experimental data, improving our understanding of external burning flowfields. A study of the effect of scale is also presented. The results indicate that combustion kinetics do not make the flowfield sensitive to scale.

Yungster, Shaye↗

Coordinate-Based Seismic Interpolation in Irregular Land Survey: A Deep Internal Learning Approach

Physical and budget constraints often result in irregular sampling, which complicates accurate subsurface imaging. Preprocessing approaches, such as missing trace or shot interpolation, are typically employed to enhance seismic data in such cases. Recently, deep learning has been used to address the trace interpolation problem at the expense of large amounts of training data to adequately represent typical seismic events. Nonetheless, most research in this area has focused on trace reconstruction, with little attention having been devoted to shot interpolation. Furthermore, existing methods assume regularly spaced receivers/sources failing in approximating seismic data from real (irregular) surveys. This work presents a novel shot gather interpolation approach which uses a continuous coordinate-based representation of the acquired seismic wavefield parameterized by a neural network. The proposed unsupervised approach, which we call coordinate-based seismic interpolation (CoBSI), enables the prediction of specific seismic characteristics in irregular land surveys without using external data during neural network training. Importantly, experimental results on real and synthetic 3-D data validate the ability of the proposed method to estimate continuous smooth seismic events in the time-space and frequency-wavenumber domains, improving sparsity or low-rank-based interpolation methods.

58 GEOSCIENCES↗

Enabling the Broader Use of MOOSE for Nuclear Energy and Other Simulation

This Final Scientific and Technical Report summarizes work performed under the Phase IIA SBIR project “Enabling the Broader Use of MOOSE for Nuclear Energy and Other Simulation” (DE-SC0020906) from August 2023 through August 2025. The objective of the Phase IIA effort was to mature and harden capabilities developed during Phase II, with the goal of enabling practical interoperability between Coreform’s isogeometric analysis (IGA) technologies and the Multiphysics Object-Oriented Simulation Environment (MOOSE), while improving robustness, performance, and scalability for complex, nuclear-relevant geometries. Over the course of Phase IIA, the project established and validated an extraction-based interoperability pathway between Coreform tools and MOOSE. A combined mesh and matrix format was defined collaboratively with MOOSE developers and integrated into the solver, enabling standard MOOSE workflows to operate on data exported from Coreform’s IGA and Flex Representation Method (FRM) pipelines. Early demonstrations validated architectural compatibility using linear solid mechanics problems, while later efforts focused on benchmark testing and external use. By the end of the project period, engineers at BWXT were able to independently set up and execute a simulation using the Coreform–MOOSE workflow and provide direct feedback that informed further refinement. In parallel, substantial effort was devoted to improving the robustness of trimmed U-spline construction for complex CAD geometries. A growing test suite of nuclear-relevant models was compiled through collaboration with multiple stakeholders and used to drive extensive bug fixing and reliability improvements. These efforts resulted in improved robustness and performance, including the addition of fallback capabilities that enhance reliability when the underlying commercial CAD kernel fails. Performance-oriented work progressed later in the project, with the development and demonstration of methods to decompose complex geometries into structured subregions and updated data representations to support more efficient solver processing. Additionally, extensive enhancements to threadsafe parallel data structures and trimming operations established a foundation for scalable processing of large assemblies. Collaboration with Sandia National Laboratories on the SGM geometric modeling kernel advanced to a functioning interface test case, positioning the workflow for future kernel integration. Overall, the Phase IIA effort successfully transitioned the project from architectural proof-of-concept to externally exercised, solver-integrated capability, while clarifying remaining technical challenges related to standardization, performance optimization, and kernel integration.

42 ENGINEERING↗

A thermoelastic transversely isotropic thick walled cylinder/disk application: An analytical solution and study

A continuum theory is utilized to represent the thermoelastic behavior of a thick walled composite cylinder that can be idealized as transversely isotropic. A multiaxial statement of the constitutive theory employed is presented, as well as the out of the plane of isotropy, plane stress, and plane strain reductions. The derived analytical solution presented is valid for a cylindrical tube or thin disk with a concentric hole, subjected to internal and/or external pressure and a general radial temperature distribution. A specific problem examined is that of a thick walled cylinder subjected to an internal and external pressure loading and a linear radial temperature distribution. The results are expressed in nondimensional form and the effects on the response behavior are examined for various material properties, fiber orientation and types of loadings.

Arnold, S. M.↗

Summary: Experimental validation of real-time fault-tolerant systems

Testing and validation of real-time systems is always difficult to perform since neither the error generation process nor the fault propagation problem is easy to comprehend. There is no better substitute to results based on actual measurements and experimentation. Such results are essential for developing a rational basis for evaluation and validation of real-time systems. However, with physical experimentation, controllability and observability are limited to external instrumentation that can be hooked-up to the system under test. And this process is quite a difficult, if not impossible, task for a complex system. Also, to set up such experiments for measurements, physical hardware must exist. On the other hand, a simulation approach allows flexibility that is unequaled by any other existing method for system evaluation. A simulation methodology for system evaluation was successfully developed and implemented and the environment was demonstrated using existing real-time avionic systems. The research was oriented toward evaluating the impact of permanent and transient faults in aircraft control computers. Results were obtained for the Bendix BDX 930 system and Hamilton Standard EEC131 jet engine controller. The studies showed that simulated fault injection is valuable, in the design stage, to evaluate the susceptibility of computing sytems to different types of failures.

Iyer, R. K.↗

Preliminary Work for Modeling the Propellers of an Aircraft as a Noise Source in an Acoustic Boundary Element Analysis

An algorithm for generating appropriate velocity boundary conditions for an acoustic boundary element analysis from the kinematics of an operating propeller is presented. It constitutes the initial phase of Integrating sophisticated rotorcraft models into a conventional boundary element analysis. Currently, the pressure field is computed by a linear approximation. An initial validation of the developed process was performed by comparing numerical results to test data for the external acoustic pressure on the surface of a tilt-rotor aircraft for one flight condition.

Vlahopoulos, Nickolas↗

Optical Strain and Crack-Detection Measurements on a Rotating Disk

The development of techniques for the in-situ measurement and structural health monitoring of the rotating components in gas turbine engines is of major interest to NASA. As part of this on-going effort, several experiments have been undertaken to develop methods for detecting cracks and measuring strain on rotating turbine engine like disks. Previous methods investigated have included the use of blade tip clearance sensors to detect the presence of cracks by monitoring the change in measured blade tip clearance and analyzing the combined disk-rotor system's vibration response. More recently, an experiment utilizing a novel optical Moiré based concept has been conducted on a subscale turbine engine disk to demonstrate a potential strain measurement and crack detection technique. Moiré patterns result from the overlap of two repetitive patterns with slightly different spacing. When this technique is applied to a rotating disk, it has the potential to allow for the detection of very small changes in spacing and radial growth in a rotating disk due to a flaw such as a crack. This investigation was a continuation of previous efforts undertaken in 2011 to 2012 to validate this optical concept. The initial demonstration attempted on a subscale turbine engine disk was inconclusive due to the minimal radial growth experienced by the disk during operation. For the present experiment a new subscale Aluminum disk was fabricated and improvements were made to the experimental setup to better demonstrate the technique. A circular reference pattern was laser etched onto a subscale engine disk and the disk was operated at speeds up to 12 000 rpm as a means of optically monitoring the Moiré created by the shift in patterns created by the radial growth due the presence of the simulated crack. Testing was first accomplished on a clean defect free disk as a means of acquiring baseline reference data. A notch was then machined in to the disk to simulate a crack and testing was repeated for the purposes of demonstrating the concept. Displacement data was acquired using external blade tip clearance and shaft displacement sensors as a means of confirming the optical data and for validating other sensor based crack detection techniques.

Woike, Mark↗

Optical Strain and Crack-Detection Measurements on a Rotating Disk

The development of techniques for the in-situ measurement and structural health monitoring of the rotating components in gas turbine engines is of major interest to NASA. As part of this on-going effort, several experiments have been undertaken to develop methods for detecting cracks and measuring strain on rotating turbine engine like disks. Previous methods investigated have included the use of blade tip clearance sensors to detect the presence of cracks by monitoring the change in measured blade tip clearance and analyzing the combined disk-rotor system's vibration response. More recently, an experiment utilizing a novel optical Moiré based concept has been conducted on a subscale turbine engine disk to demonstrate a potential strain measurement and crack detection technique. Moiré patterns result from the overlap of two repetitive patterns with slightly different spacing. When this technique is applied to a rotating disk, it has the potential to allow for the detection of very small changes in spacing and radial growth in a rotating disk due to a flaw such as a crack. This investigation was a continuation of previous efforts undertaken in 2011-2012 to validate this optical concept. The initial demonstration attempted on a subscale turbine engine disk was inconclusive due to the minimal radial growth experienced by the disk during operation. For the present experiment a new subscale Aluminum disk was fabricated and improvements were made to the experimental setup to better demonstrate the technique. A circular reference pattern was laser etched onto a subscale engine disk and the disk was operated at speeds up to 12 000 rpm as a means of optically monitoring the Moiré created by the shift in patterns created by the radial growth due the presence of the simulated crack. Testing was first accomplished on a clean defect free disk as a means of acquiring baseline reference data. A notch was then machined in to the disk to simulate a crack and testing was repeated for the purposes of demonstrating the concept. Displacement data was acquired using external blade tip clearance and shaft displacement sensors as a means of confirming the optical data and for validating other sensor based crack detection techniques.

Woike, Mark↗

Hypersonic code efficiency and validation studies

Renewed interest in hypersonic and supersonic flows spurred the development of the Compressible Navier-Stokes (CNS) code. Originally developed for external flows, CNS was modified to enable it to also be applied to internal high speed flows. In the initial phase of this study CNS was applied to both internal flow applications and fellow researchers were taught to run CNS. The second phase of this research was the development of surface grids over various aircraft configurations for the High Speed Research Program (HSRP). The complex nature of these configurations required the development of improved surface grid generation techniques. A significant portion of the grid generation effort was devoted to testing and recommending modifications to early versions of the S3D surface grid generation code.

Bennett, Bradford C.↗

Impact Testing on Reinforced Carbon-Carbon Flat Panels With BX-265 and PDL-1034 External Tank Foam for the Space Shuttle Return to Flight Program

Following the tragedy of the Orbiter Columbia (STS-107) on February 1, 2003, a major effort commenced to develop a better understanding of debris impacts and their effect on the space shuttle subsystems. An initiative to develop and validate physics-based computer models to predict damage from such impacts was a fundamental component of this effort. To develop the models it was necessary to physically characterize reinforced carbon-carbon (RCC) along with ice and foam debris materials, which could shed on ascent and impact the orbiter RCC leading edges. The validated models enabled the launch system community to use the impact analysis software LS-DYNA (Livermore Software Technology Corp.) to predict damage by potential and actual impact events on the orbiter leading edge and nose cap thermal protection systems. Validation of the material models was done through a three-level approach: Level 1-fundamental tests to obtain independent static and dynamic constitutive model properties of materials of interest, Level 2-subcomponent impact tests to provide highly controlled impact test data for the correlation and validation of the models, and Level 3-full-scale orbiter leading-edge impact tests to establish the final level of confidence for the analysis methodology. This report discusses the Level 2 test program conducted in the NASA Glenn Research Center (GRC) Ballistic Impact Laboratory with external tank foam impact tests on flat RCC panels, and presents the data observed. The Level 2 testing consisted of 54 impact tests in the NASA GRC Ballistic Impact Laboratory on 6- by 6-in. and 6- by 12-in. flat plates of RCC and evaluated two types of debris projectiles: BX-265 and PDL-1034 external tank foam. These impact tests helped determine the level of damage generated in the RCC flat plates by each projectile and validated the use of the foam and RCC models for use in LS-DYNA.

Melis, Matthew E.↗

Test Vector Development for Verification and Validation of Heavy-Duty Autonomous Vehicle Operations

The current focus in the ongoing development of autonomous driving systems (ADS) for heavy duty vehicles is that of vehicle operational safety. To this end, developers and researchers alike are working towards a complete understanding of the operating environments and conditions that autonomous vehicles are subject to during their mission. This understanding is critical to the testing and validation phases of the development of autonomous vehicles and allows for the identification of both the nominal and edge case scenarios encountered by these systems. Previous work by the authors saw the development of a comprehensive scenario generation framework to identify an operating domain specification (ODS), or external and internal conditions an autonomous driving system can expect to encounter on its mission to form critical scenario groups for autonomous vehicle testing and validating using statistical patterns, clustering, and correlation. Continuing this prior work, this paper focuses on the generation of test cases based on the critical scenarios identified that can be used to prioritize either the most common nominal driving scenarios or the least common severe driving scenarios. These test cases can then be used validate, through simulation or real-world testing, the operating design domain (ODD) for a generalized driving mission and built upon to identify spatial and temporal impacts on the driving mission of an autonomous vehicle.

Siekmann, Adam↗

Reinforced Carbon-Carbon Subcomponent Flat Plate Impact Testing for Space Shuttle Orbiter Return to Flight

Following the tragedy of the Space Shuttle Columbia on February 1, 2003, a major effort commenced to develop a better understanding of debris impacts and their effect on the Space Shuttle subsystems. An initiative to develop and validate physics-based computer models to predict damage from such impacts was a fundamental component of this effort. To develop the models it was necessary to physically characterize Reinforced Carbon-Carbon (RCC) and various debris materials which could potentially shed on ascent and impact the Orbiter RCC leading edges. The validated models enabled the launch system community to use the impact analysis software LS DYNA to predict damage by potential and actual impact events on the Orbiter leading edge and nose cap thermal protection systems. Validation of the material models was done through a three-level approach: fundamental tests to obtain independent static and dynamic material model properties of materials of interest, sub-component impact tests to provide highly controlled impact test data for the correlation and validation of the models, and full-scale impact tests to establish the final level of confidence for the analysis methodology. This paper discusses the second level subcomponent test program in detail and its application to the LS DYNA model validation process. The level two testing consisted of over one hundred impact tests in the NASA Glenn Research Center Ballistic Impact Lab on 6 by 6 in. and 6 by 12 in. flat plates of RCC and evaluated three types of debris projectiles: BX 265 External Tank foam, ice, and PDL 1034 External Tank foam. These impact tests helped determine the level of damage generated in the RCC flat plates by each projectile. The information obtained from this testing validated the LS DYNA damage prediction models and provided a certain level of confidence to begin performing analysis for full-size RCC test articles for returning NASA to flight with STS 114 and beyond.

Melis, Matthew E.↗

Computational Fluid Dynamic Modeling of Dry Cask Simulator with Crosswind

The purpose of this study is to create a STAR-CCM+ model of a Belowground Vertical Dry Cask Simulator (BVDCS) at Sandia National Laboratories (SNL) and validate the model with SNL’s experimental results. The BVDCS consists of a single boiling water reactor assembly fitted with electric heaters encompassed by a containment vessel and shell to represent a belowground spent nuclear fuel (SNF) dry storage system. Blowers are located near the inlet and outlet of the BVDCS to simulate crosswind conditions. In addition to the experimental results, the STAR-CCM+ model developed for this study is compared with a previous computational fluid dynamics (CFD) model in a different software program, which is used as a software-to-software benchmark. The experimental results provide a dataset to compare the STAR-CCM+ model results for a variety of different conditions. The main objective is to validate and improve STAR-CCM+ CFD models for spent nuclear fuel storage systems with explicitly modeled external environments and “wind driven” crossflows. These CFD models aide in the study of external particle deposition in spent nuclear fuel storage systems, which is important to predicting the significance of chloride induced stress corrosion cracking (CISCC). In addition to experimental comparison, a sensitivity analysis study is performed using the STAR-CCM+ model. The sensitivity analysis provides a quantitative assessment of the sensitivity of various parameters. This helps provide information on various parameters that are of particular importance to constructing a model representative of real life systems. The STAR-CCM+ model compared well to the experimental results showing similar responses to changes in cross wind flow, and a number of parameters are identified for model improvement.

Jensen, Ben J.↗

An Analytical Model for the Tension-Shear Coupling of Woven Fabrics with Different Weave Patterns under Large Shear Deformation

It is essential to accurately describe the large shear behavior of woven fabrics in the composite preforming process. An analytical model is proposed to describe the shear behavior of fabrics with different weave patterns, in which tension-shear coupling is considered. The coupling is involved in two parts, the friction between overlapped yarns and the in-plane transverse compression between two parallel yarns. By introducing the concept of inflection points of a yarn, the model is applicable for fabrics with different weave patterns. The analytical model is validated by biaxial tension-shear experiments. A parametric study is conducted to investigate the effects of external load, yarn geometry, and weave structure on the large shear behavior of fabrics. The developed model can reveal the physical mechanism of tension-shear coupling of woven fabrics. Moreover, the model has a high computational efficiency due to its explicit expressions, thus benefiting the material design process.

36 MATERIALS SCIENCE↗