Search NASA⌕ Search

SEARCH · Search NASA

Results for “Solution Verification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Predictive Capability Maturity Model Demonstration for Cylindrical Cavity Coupling Using Gemma in the Next Generation Workflow

The predictive capability maturity model (PCMM) uses the expert elicitation process to generate credibility evidence for a particular analysis. To ensure Gemma has the capability to efficiently produce this credibility evidence, next generation workflows (NGW) are created for the solution verification, calibration/validation, and input uncertainty quantification portions of the PCMM assessment. These workflows are then used on the Higgins cylinder problem, which is representative of applications involving external-to-internal electromagnetic field coupling through a slot. The uncertainties calculated using these workflows are then used to calculate the validation comparison error and the validation uncertainty for the model following the American Society of Mechanical Engineers (ASME) verification and validation (V&V) 20 standard. These workflows will enable analysts to iterate each element of PCMM more efficiently than if completed without using a NGW workflow. An example of this iterative process is shown in Section 7.2.

42 ENGINEERING↗
DOE OSTI2025

The Fluid Dynamics Uncertainty Quantification Challenge Problem: XFOIL vs. MFOIL

Uncertainty quantification (UQ) has become more critical in aerospace engineering due to the growing dependence on computational tools for design optimization and performance analyses of aerospace vehicles. Even though the significance of UQ in assessing the credibility of computational analyses is well recognized, its costs and complexity impede its integration into standard practices, particularly in computational fluid dynamics (CFD) and other fluid analyses. This paper presents a UQ study for low-fidelity computational aerodynamics analyses with XFOIL and mfoil (i.e., the MATLAB version of XFOIL with several implementation modifications); these tools are utilized widely in both research and education. The main contributions of this paper are as follows: 1) improved precision in quantifying the uncertainty of the baseline Monte Carlo results used to benchmark surrogate modeling techniques for UQ, 2) quantification of the effect of the implementation differences between XFOIL and mfoil on solution quantities of interest (QoIs), such as lift and pitching moment coefficients, and 3) development of an open-source UQ library for use with XFOIL and mfoil, which has educational values and helps promote UQ for fluid analyses with aerospace applications. Results and discussions revolve around cases 1-4 of the challenge problem posed by the AIAA Fluid Dynamics Technical Committee’s Uncertainty Quantification Discussion Group (UQDG). In case 3, this work employs CFDverify, an open-source solution verification software, to quantify the discretization error and evaluate the extrapolated QoIs based on the grid convergence index (GCI). This UQ study differentiates itself from previous studies in the rigor of handling baseline Monte Carlo uncertainty and in including mfoil, which is a more accessible alternative to XFOIL. Finally, despite the growing computing power, low-fidelity computational tools remain valuable, such as for aerodynamic shape optimization at Mach numbers below 0.65 and low-to-mid Reynolds numbers.

Lay, Aidan S [University of Tennessee, Knoxville (↗
NASA NTRSDate not supplied

Overview of Predictive Simulation Capability Development for Crater Evolution and Ejecta in Continuum/Rarefied Flows

As part of the Game Changing Development (GCD) Program, funded by NASA’s Space Technology Mission Directorate (STMD), the development of simulation capability for the prediction of extra-terrestrial Plume Surface Interaction (PSI) environments has been undertaken by the Fluid Dynamics Branch at NASA/MSFC. The Predictive Simulation Capability (PSC) Element is focused on creating simulation capability for the reliable and accurate prediction of PSI in Martian (~650 Pa) and Lunar (vacuum) ambient environments. In addition to the predictive simulation capability, the GCD Program also contains a companion Ground Testing Element for development of focused datasets for validation of predictive capability as well as a Flight-focused Instrumentation Element. The focus of this paper is to provide an overview and a brief status on one area of capability development through this GCD PSI project - capturing the effects of mixed continuum/rarefied flow on crater development and ejecta sheets. This includes both capability enhancements and maturation of the predictive tool, Loci/GGFS, into a production capable tool as well as validation of the tool against PSI data in Martian and Lunar environments. There are six newly developed capabilities that will be production ready by the end of the fiscal year. Newly developed capabilities must first be verified prior to being production ready, and this process includes capability demonstration, solution verification, and performance evaluation. An overview of the newly developed capabilities with respect to several test cases, including cratering simulations of the Apollo Lunar Module, will be presented. Several validation analyses have been performed to validate in Martian and more Lunar-like environments, including simulations of cratering from a subsonic flow test at Planetary Aeolian Lab (PAL) conducted in a Martian-like environment and pre-test cratering predictions of Physics Focused Ground Test (PFGT) tests planned to be performed in Martian-like and more Lunar-like environments. An overview of these validation analyses as it pertains to the capability development will be presented.

Andrew Weaver↗
NASA NTRS2020

Formal Verification of a Solution to the n-Queens Problem

This report describes a formal verification of a concise algorithm that computes a solution to the n-Queens problem for all natural numbers n, such that n > 3. The formal proof of the algorithm is completed in the Prototype Verification System (PVS) theorem prover. This verification effort serves two purposes. First, it is presented as a pedagogical example for learning a theorem prover, such as PVS, and second, as a candidate benchmark for comparing other formal methods tools to PVS.

Mahyar R Malekpour↗
NASA NTRS1990

Spacecraft command verification: The AI solution

Recently, a knowledge-based approach was used to develop a system called the Command Constraint Checker (CCC) for TRW. CCC was created to automate the process of verifying spacecraft command sequences. To check command files by hand for timing and sequencing errors is a time-consuming and error-prone task. Conventional software solutions were rejected when it was estimated that it would require 36 man-months to build an automated tool to check constraints by conventional methods. Using rule-based representation to model the various timing and sequencing constraints of the spacecraft, CCC was developed and tested in only three months. By applying artificial intelligence techniques, CCC designers were able to demonstrate the viability of AI as a tool to transform difficult problems into easily managed tasks. The design considerations used in developing CCC are discussed and the potential impact of this system on future satellite programs is examined.

Fesq, Lorraine M.↗
NASA NTRS2005

Verification, Validation, and Solution Quality in Computational Physics: CFD Methods Applied to Ice Sheet Physics

Procedures and methods for veri.cation of coding algebra and for validations of models and calculations used in the aerospace computational fluid dynamics (CFD) community would be ef.cacious if used by the glacier dynamics modeling community. This paper presents some of those methods, and how they might be applied to uncertainty management supporting code veri.cation and model validation for glacier dynamics. The similarities and differences between their use in CFD analysis and the proposed application of these methods to glacier modeling are discussed. After establishing sources of uncertainty and methods for code veri.cation, the paper looks at a representative sampling of veri.cation and validation efforts that are underway in the glacier modeling community, and establishes a context for these within an overall solution quality assessment. Finally, a vision of a new information architecture and interactive scienti.c interface is introduced and advocated.

Thompson, David E.↗
NASA NTRS2006

Verification of Numerical Solutions for the Deployment of the Highly Nonlinear MARSIS Antenna Boom Lenticular Joints

The MARSIS antenna booms are constructed using lenticular hinges between straight boom segments in a novel design which allows the booms to be extremely lightweight while retaining a high stiffness and well defined structural properties once they are deployed. Lenticular hinges are elegant in form but are complicated to model as they deploy dynamically and require highly specialized nonlinear techniques founded on carefully measured mechanical properties. Results from component level testing were incorporated into a highly specialized ADAMS model which employed an automated damping algorithm to account for the discontinuous boom lengths formed during the deployment. Additional models with more limited capabilities were also developed in both DADS and ABAQUS to verify the ADAMS model computations and to help better define the numerical behavior of the models at the component and system levels. A careful comparison is made between the ADAMS and DADS models in a series of progressive steps in order to verify their numerical results. Different trade studies considered in the model development are outlined to demonstrate a suitable level of model fidelity. Some model sensitivities to various parameters are explored using subscale and full system models. Finally, some full system DADS models are exercised to illustrate the limitations of traditional modeling techniques for variable geometry systems which were overcome in the ADAMS model.

Mars↗
DOE OSTI2019

Cross-verification of neoclassical transport solutions from XGCa against NEO

Radial neoclassical transport from the global gyrokinetic code XGC has been cross-verified against the local drift-kinetic neoclassical code NEO in NEO's local regime using a Grad-Shafranov equilibrium with a circular boundary. XGC shows excellent agreement with NEO, except for a difference of approximately 10% in the ion heat flux. Close investigation reveals that this difference is due to the simplification in NEO to use the same Coulomb logarithm ln Λ to represent all particle species, while XGC uses different formulas for collisions between different species. When XGC uses NEO's Coulomb logarithm, excellent agreement in the ion heat flux is recovered. Here, the present work not only crossverifies the equation solvers in two codes, but also verifies that the gyrokinetic and the drift-kinetic equations agree and that the linearized and nonlinear Coulomb collision operators agree in the mild gradient, local regime.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2021

Robust verification of stochastic simulation codes

We introduce a robust verification tool for computational codes, which we call Stochastic Robust Extrapolation based Error Quantification (StREEQ). Unlike the prevalent Grid Convergence Index (GCI) [1] method, our approach is suitable for both stochastic and deterministic computational codes and is generalizable to any number of discretization variables. Building on ideas introduced in the Robust Verification [2] approach, we estimate the converged solution and orders of convergence with uncertainty using multiple fits of a discretization error model. In contrast to Robust Verification, we perform these fits to many bootstrap samples yielding a larger set of predictions with smoother statistics. Here, bootstrap resampling is performed on the lack-of-fit errors for deterministic code responses, and directly on the noisy data set for stochastic responses. This approach lends a degree of robustness to the overall results, capable of yielding precise verification results for sufficiently resolved data sets, and appropriately expanding the uncertainty when the data set does not support a precise result. For stochastic responses, a credibility assessment is also performed to give the analyst an indication of the trustworthiness of the results. Furthermore, this approach is suitable for both code and solution verification, and is particularly useful for solution verification of high-consequence simulations..

97 MATHEMATICS AND COMPUTING↗
NASA NTRS1999

Wiltech Component Cleaning and Refurbishment Facility CFC Elimination Plan at NASA Kennedy Space Center

The Wiltech Component Cleaning & Refurbishment Facility (WT-CCRF) at NASA Kennedy Space Center performs precision cleaning on approximately 200,000 metallic and non metallic components every year. WT-CCRF has developed a CFC elimination plan consisting of aqueous cleaning and verification and an economical dual solvent strategy for alternative solvent solution. Aqueous Verification Methodologies were implemented two years ago on a variety of Ground Support Equipment (GSE) components and sampling equipment. Today, 50% of the current workload is verified using aqueous methods and 90% of the total workload is degreased aqueously using, Zonyl and Brulin surfactants in ultrasonic baths. An additional estimated 20% solvent savings could be achieved if the proposed expanded use of aqueous methods are approved. Aqueous cleaning has shown to be effective, environmentally friendly and economical (i.e.. cost of materials, equipment, facilities and labor).

Williamson, Steve↗
NASA NTRSDate not supplied

USM3D-ME Solutions for RANS Test Suite of High-Fidelity CFD Verification Workshop 2024

USM3D-ME solutions for the High-Fidelity CFD Verification Workshop 2024 are presented. Solutions are computed for the Reynolds-Averaged Navier-Stokes equations using the Spalart-Allmaras one equation turbulence model, SA-neg-QCR2000-R, that is enhanced with a nonlinear correction to the turbulence stresses and a correction for flow rotation. USM3D-ME solutions have been computed for the three verification cases, namely, a Joukowski airfoil, a subsonic three-dimensional flow around an extruded NACA 0012 wing in tunnel, and subsonic flow around a high-lift wing-body configuration. Iterative convergence of USM3D-ME solutions on several grids within various grid families is demonstrated. Grid convergence of integrated forces, pitching moment and sectional variations of surface pressure and skin friction are also presented.

CFD↗
DOE OSTI2023

Total metals, carbon, nitrogen & anion concentration data; Slate River & East River floodplains, Crested Butte, CO; May 2022-October 2022

This data package includes processed and undiluted measurements for metal, total carbon, total nitrogen, and anion concentrations from pore water (groundwater) and surface water samples from the Slate River and East River floodplains of Crested Butte, CO, focus field sites for the SLAC Floodplain Hydro-Biogeochemistry SFA. The data was generated as part of the work targeting the overarching research question for the SLAC SFA: How do ubiquitous subsurface interfaces mediate molecular-scale biogeochemical processes and groundwater quality in floodplains and watersheds? Samples were collected between May and October of 2022. These measurements were all recorded at the Arizona Laboratory for Emerging Contaminants (ALEC) at the University of Arizona located in Tucson, AZ. Groundwater samples were extracted from a network of installed rhizon (Rhizosphere Research Products, part no. 19.60.21F, 0.6 micrometer mesh size) and piezometer wells within the river floodplain. All water samples were shaded from sun exposure during extraction from the subsurface and preserved at 4C until measured at ALEC.Analysis by ICP-MS (metals):Measurements for total metals were made on the Agilent 7700x ICP-MS (for total metals) – Agilent Technologies, Santa Clara, CA. The analytical QA/QC protocol was adapted from US EPA Method 200.8 for analysis by ICP-MS. Calibration standards were prepared from multi-element stock solutions (SPEX Certiprep, Metuchen, NJ). Calibration curves include at least 7 points with correlation coefficients > 0.995. The QC protocol includes a continuing calibration blank (CCB), a continuing calibration verification (CCV) solution and at least one quality control sample (QCS) to be analyzed just after calibration and again after every 12 samples and at the completion of the run. The QCS solutions are from an independent source, such as NIST SRM 1643e - Trace elements in water, or QCS solutions from High Purity Standards (Charleston, SC). Acceptable QC responses must be between 90 and 110% of the certified value. Lastly, a suitable internal standard (usually Rh, In, Ga or Ge) is added using on-line addition into the sample line and mixing tee.Analysis by Shimadzu TOC-L (TOC/TN):The TOC-L system is a combustion technique where liquid samples are injected and combusted into CO2 for carbon detection by non-dispersive infrared (NDIR) and NO for detection by chemiluminescence. A calibration curve using five standard solutions between 0.1 and 7 ppm for carbon and 0.05 and 3.5 ppm for nitrogen is made for each type of measurement with a linearity >0.99. All samples, standards, and QC’s are prepared in 24mL scintillation vials that have been baked for 4hrs at 475 Cº and made using RO water (18.2mΩ). QC’s include a calibration blank check (CCB), continuing calibration check (CCC), and a certified reference material check (CRM). All QC’s are within ±10% error and are run before and after each batch of samples. Samples are diluted and rerun if any measurement concentrations are above the highest standard.Analysis by Ion Chromatography (Anions):The instrument used is the Thermo Scientific Dionex ICS-6000 using AS+AG22 column set for anion analysis with sodium carbonate eluent. A calibration curve using five standard solutions between 5 and 250 umol/L is made with a linearity >0.99. Standards and QC’s are prepared in 15mL polypropylene conical tubes, pipetted along with the samples into 1.5mL polypropylene vials. Dilutions are made using RO water (18.2mΩ). QC’s include a calibration blank check (CCB), continuing calibration check (CCC), and a certified reference material check (CRM). All QC’s are within ±10% error and are run before and after each batch of samples. Samples are diluted and rerun if any measurement concentrations are above the highest standard.All files are in csv format.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Total metals & anion concentration data; Slate River floodplain, Crested Butte, CO; May 2020-September 2020

This data package includes processed and undiluted measurements for metal and anion concentrations from pore water (groundwater) samples from the Slate River floodplain of Crested Butte, CO, a focus field site for the SLAC Floodplain Hydro-Biogeochemistry SFA. The data was generated as part of the work targeting the overarching research question for the SLAC SFA: How do ubiquitous subsurface interfaces mediate molecular-scale biogeochemical processes and groundwater quality in floodplains and watersheds? Samples were collected between May and September of 2020. These measurements were all recorded at the Arizona Laboratory for Emerging Contaminants (ALEC) at the University of Arizona located in Tucson, AZ. Groundwater samples were extracted from a network of installed rhizon (Rhizosphere Research Products, part no. 19.60.21F, 0.6 micrometer mesh size) and piezometer wells within the river floodplain. All water samples were shaded from sun exposure during extraction from the subsurface and preserved at 4C until measured at ALEC.Analysis by ICP-MS:Measurements for total metals were made on the Agilent 7700x ICP-MS (for total metals) – Agilent Technologies, Santa Clara, CA.The analytical QA/QC protocol was adapted from US EPA Method 200.8 for analysis by ICP-MS. Calibration standards were prepared from multi-element stock solution (Sigma-Aldrich Multielement standard solution for ICP, St. Louis, MO) using matrix matched to sample solutions (either 2% HCl or HNO3 from AriStar Plus,grade acids from VWR Scientific). Calibration curves include at least 7 points with correlation coefficients > 0.995. The QC protocol includes a continuing calibration blank (CCB), a continuing calibration verification (CCV) solution and at least one quality control sample (QCS) to be analyzed just after calibration and again after every 12 samples and at the completion of the run. The QCS solutions are from an independent source, such as NIST SRM 1643e - Trace Elements in Water, or QCS solutions from High Purity Standards (Charleston, SC). Acceptable QC responses must be between 90 and 110% of the certified value. An internal standard (Rh) is added via on-line addition into the sample line using a mixing tee.Analysis by Ion Chromatography (Anions):The protocol follows Method 4110 in Standard Methods for Examination of Water and Wastewater.The instrument used is the Thermo Scientific Dionex ICS-6000 using AS+AG22 column set for anion analysis with isocratic method using sodium carbonate eluent. Detection is by chemical suppression of eluent conductivity. Quality control solutions and mixed analyte standards purchased from Inorganic Ventures, Christiansburg, VA.All files are in csv format.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2019

Molten salt reactor core simulation with PROTEUS

The Nuclear Energy Advance Modeling and Simulation Program (NEAMS) of the US Department of Energy (DOE) aims to develop advanced simulation tools to aid the development of advanced nuclear technologies. The high-fidelity PROTEUS code was developed in the NEAMS program for reactor physics analysis. This paper tests the applicability of the PROTEUS code to simulate a Molten Salt Reactor (MSR). The OpenMC code based on the Monte Carlo Method was employed to generate the cross sections and to provide stochastic solutions for verification. The PROTEUS code was successfully employed to simulate the steady-state performance of an MSR represented by the ThorCon core design. The 2D lattice, 2D core, and 3D full core calculations performed by PROTEUS show good agreement with that predicted by OpenMC. Furthermore, for the nodal option within PROTEUS, the precursor drift model was also tested, and this effect resulted in a reduction of the k-eff by 300 pcm.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2022

On the Verification of Deep Reinforcement Learning Solution for Intelligent Operation of Distribution Grids

Capabilities of deep reinforcement learning (DRL) in obtaining fast decision policies in high dimensional and stochastic environments have led to its extensive use in operational research, including the operation of distribution grids with high penetration of distributed energy resources (DER). However, the feasibility and robustness of DRL solutions are not guaranteed for the system operator, and hence, those solutions may be of limited practical value. This paper proposes an analytical method to find feasibility ellipsoids that represent the range of multi-dimensional system states in which the DRL solution is guaranteed to be feasible. Empirical studies and stochastic sampling determine the ratio of the discovered to the actual feasible space as a function of the sample size. In addition, the performance of logarithmic, linear, and exponential penalization of infeasibility during the DRL training are studied and compared in order to reduce the number of infeasible solutions

Hosseini, Mohammad Mehdi↗
NASA NTRS1993

Experimental and modal verification of an integral equation solution for a thin-walled dichroic plate with cross-shaped holes

In order to add the capability of an X-band uplink onto the 70-m antenna, a new dichroic plate is needed to replace the Pyle-guide-shaped dichroic plate currently in use. The replacement dichroic plate must exhibit an additional passband at the new uplink frequency of 7.165 GHz, while still maintaining a passband at the existing downlink frequency of 8.425 GHz. Because of the wide frequency separation of these two passbands, conventional methods of designing air-filled dichroic plates exhibit grating lobe problems. A new method of solving this problem by using a dichroic plate with cross-shaped holes is presented and verified experimentally. Two checks of the integral equation solution are described. One is the comparison to a modal analysis for the limiting cross shape of a square hole. As a final check, a prototype dichroic plate with cross-shaped holes was built and measured.

Epp, L. W.↗
NASA NTRSDate not supplied

Pretest Simulations of a Supersonic Mixing and Combustion Validation Experiment to Assess Sensitivities

The reliance on CFD simulations to develop, design, and optimize scramjet systems (or components) has become commonplace. This reliance inevitably hinges on the ability of the computational analyst to quantify the level of confidence in their computational results. Unfortunately, nearly all the measured data available for this assessment comes from antiquated experimental datasets, or from tests that focused on the extraction of scramjet system (or component) performance. The objective of a CFD validation experiment is to quantify the predictive accuracy of one or more of the CFD physics submodels, implying that other uncertainties related to replicating the facility flow environment (e.g., knowledge of boundary conditions) must be minimized to the extent possible. This inevitably places stringent requirements on the quality and quantity of measurements taken to accurately specify inflow, outflow, and surface conditions for the CFD simulations; in addition to the measurements taken for the validation of physics submodels. This places additional demands on the experimental process above and beyond those for test article performance assessment. A recent high speed code credibility workshop series sponsored by AFRL identified a gap in existing validation data for fundamental assessments of turbulent mixing and combustion CFD closure models at scramjet engine relevant conditions. To address this gap, engineers at AFRL have designed a coaxial jet flame configuration that will be tested at two facilities (Research Cell 19 at the Air Force Research Lab, and at Purdue University). The effort described here documents pretest simulations of this validation experiment with the goal of fleshing out the extent of the facility flowpath that must be included to adequately reproduce the facility test section flow environment. The findings indicate that the flow around the support structure for the fuel injection centerbody upstream of the facility nozzle generates disturbances that persist throughout the nozzle expansion process; corrupting the azimuthal symmetry that was desired in the fuel/air mixing region of the test section. Simulations without this support structure maintained a high degree of azimuthal symmetry up until the fuel injection plane. However, even in this scenario the azimuthal symmetry was not maintained once the centerbody boundary layer transitioned to a wake flow downstream of the fuel injection plane.

CFD↗