Search NASA⌕ Search

SEARCH · Search NASA

Results for “validation studies”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13

Pilot In-Trail Procedure Validation Simulation Study

A Human-In-The-Loop experiment was conducted at the National Aeronautics and Space Administration (NASA) Langley Research Center (LaRC) to investigate the viability of the In-Trail Procedure (ITP) concept from a flight crew perspective, by placing participating airline pilots in a simulated oceanic flight environment. The test subject pilots used new onboard avionics equipment that provided improved information about nearby traffic and enabled them, when specific criteria were met, to request an ITP flight level change referencing one or two nearby aircraft that might otherwise block the flight level change. The subject pilots subjective assessments of ITP validity and acceptability were measured via questionnaires and discussions, and their objective performance in appropriately selecting, requesting, and performing ITP flight level changes was evaluated for each simulated flight scenario. Objective performance and subjective workload assessment data from the experiment s test conditions were analyzed for statistical and operational significance and are reported in the paper. Based on these results, suggestions are made to further improve the ITP.

Bussink, Frank J. L.↗

Study to validate the Non-Interference Performance Assessment (NIPA) technique

The NIPA (Non-Interference Performance Assessment) technique involves direct observation of group verbal activities by trained observers who rate the emotional content (affect) of each verbal interaction as either positive, negative, or neutral. During the test, in which four men were confined for 90 consecutive days, feasibility of the NIPA technique was demonstrated and observer reliability was verified. However, the validity of the test was not proved because an independent criterion measure of morale for the confined crew was lacking. There were indications, however, that NIPA measures were tracking changes in crew morale. At approximately the two-thirds point (Days 60 to 70), morale apparently fell dramatically for a period of about ten days, and simultaneously NIPA measure of positive verbalization decreased in number. A need was indicated for a separate study to apply the NIPA technique under experimental conditions and using a clearly defined criterion measure against which the ability of NIPA observations to truly measure morale changes could be determined.

Seeman, J. S.↗

Experimental validation of the TOPAS Monte Carlo system for passive scattering proton therapy

Purpose: TOPAS (TOol for PArticle Simulation) is a particle simulation code recently developed with the specific aim of making Monte Carlo simulations user-friendly for research and clinical physicists in the particle therapy community. The authors present a thorough and extensive experimental validation of Monte Carlo simulations performed with TOPAS in a variety of setups relevant for proton therapy applications. The set of validation measurements performed in this work represents an overall end-to-end testing strategy recommended for all clinical centers planning to rely on TOPAS for quality assurance or patient dose calculation and, more generally, for all the institutions using passive-scattering proton therapy systems. Methods: The authors systematically compared TOPAS simulations with measurements that are performed routinely within the quality assurance (QA) program in our institution as well as experiments specifically designed for this validation study. First, the authors compared TOPAS simulations with measurements of depth-dose curves for spread-out Bragg peak (SOBP) fields. Second, absolute dosimetry simulations were benchmarked against measured machine output factors (OFs). Third, the authors simulated and measured 2D dose profiles and analyzed the differences in terms of field flatness and symmetry and usable field size. Fourth, the authors designed a simple experiment using a half-beam shifter to assess the effects of multiple Coulomb scattering, beam divergence, and inverse square attenuation on lateral and longitudinal dose profiles measured and simulated in a water phantom. Fifth, TOPAS’ capabilities to simulate time dependent beam delivery was benchmarked against dose rate functions (i.e., dose per unit time vs time) measured at different depths inside an SOBP field. Sixth, simulations of the charge deposited by protons fully stopping in two different types of multilayer Faraday cups (MLFCs) were compared with measurements to benchmark the nuclear interaction models used in the simulations. Results: SOBPs’ range and modulation width were reproduced, on average, with an accuracy of +1, −2 and ±3 mm, respectively. OF simulations reproduced measured data within ±3%. Simulated 2D dose-profiles show field flatness and average field radius within ±3% of measured profiles. The field symmetry resulted, on average in ±3% agreement with commissioned profiles. TOPAS accuracy in reproducing measured dose profiles downstream the half beam shifter is better than 2%. Dose rate function simulation reproduced the measurements within ∼2% showing that the four-dimensional modeling of the passively modulation system was implement correctly and millimeter accuracy can be achieved in reproducing measured data. For MLFCs simulations, 2% agreement was found between TOPAS and both sets of experimental measurements. The overall results show that TOPAS simulations are within the clinical accepted tolerances for all QA measurements performed at our institution. Conclusions: Our Monte Carlo simulations reproduced accurately the experimental data acquired through all the measurements performed in this study. Thus, TOPAS can reliably be applied to quality assurance for proton therapy and also as an input for commissioning of commercial treatment planning systems. This work also provides the basis for routine clinical dose calculations in patients for all passive scattering proton therapy centers using TOPAS.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Validating and improving CT ventilation imaging by correlating with ventilation 4D-PET/CT using {sup 68}Ga-labeled nanoparticles

Purpose: CT ventilation imaging is a novel functional lung imaging modality based on deformable image registration. The authors present the first validation study of CT ventilation using positron emission tomography with{sup 68}Ga-labeled nanoparticles (PET-Galligas). The authors quantify this agreement for different CT ventilation metrics and PET reconstruction parameters. Methods: PET-Galligas ventilation scans were acquired for 12 lung cancer patients using a four-dimensional (4D) PET/CT scanner. CT ventilation images were then produced by applying B-spline deformable image registration between the respiratory correlated phases of the 4D-CT. The authors test four ventilation metrics, two existing and two modified. The two existing metrics model mechanical ventilation (alveolar air-flow) based on Hounsfield unit (HU) change (V{sub HU}) or Jacobian determinant of deformation (V{sub Jac}). The two modified metrics incorporate a voxel-wise tissue-density scaling (ρV{sub HU} and ρV{sub Jac}) and were hypothesized to better model the physiological ventilation. In order to assess the impact of PET image quality, comparisons were performed using both standard and respiratory-gated PET images with the former exhibiting better signal. Different median filtering kernels (σ{sub m} = 0 or 3 mm) were also applied to all images. As in previous studies, similarity metrics included the Spearman correlation coefficient r within the segmented lung volumes, and Dice coefficient d{sub 20} for the (0 − 20)th functional percentile volumes. Results: The best agreement between CT and PET ventilation was obtained comparing standard PET images to the density-scaled HU metric (ρV{sub HU}) with σ{sub m} = 3 mm. This leads to correlation values in the ranges 0.22 ⩽ r ⩽ 0.76 and 0.38 ⩽ d{sub 20} ⩽ 0.68, with r{sup ¯}=0.42±0.16 and d{sup ¯}{sub 20}=0.52±0.09 averaged over the 12 patients. Compared to Jacobian-based metrics, HU-based metrics lead to statistically significant improvements in r{sup ¯} and d{sup ¯}{sub 20} (p < 0.05), with density scaled metrics also showing higher r{sup ¯} than for unscaled versions (p < 0.02). r{sup ¯} and d{sup ¯}{sub 20} were also sensitive to image quality, with statistically significant improvements using standard (as opposed to gated) PET images and with application of median filtering. Conclusions: The use of modified CT ventilation metrics, in conjunction with PET-Galligas and careful application of image filtering has resulted in improved correlation compared to earlier studies using nuclear medicine ventilation. However, CT ventilation and PET-Galligas do not always provide the same functional information. The authors have demonstrated that the agreement can improve for CT ventilation metrics incorporating a tissue density scaling, and also with increasing PET image quality. CT ventilation imaging has clear potential for imaging regional air volume change in the lung, and further development is warranted.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

SCALE 6.3 Validation: Radiation Shielding

Safe and reliable use of scientific and engineering computer codes requires validation for the types of applications in which they will be used. An example in the nuclear reactor engineering and licensing field is radiation transport employed in shielding analyses. The validity of computer codes for shielding applications is demonstrated in this report for SCALE version 6.3.0. Representative benchmarks corresponding to shielding analyses are selected for the validation study. Typical measurement results analyzed from these benchmarks include neutron fluxes, detector count rates, detector energy response functions, neutron and gamma dose rates, neutron activation rates and activities, neutron leakage fluxes, and skyshine dose rates. Thousands of points of comparison between measurement and calculation are presented in this work. Other than rare outliers typically explained by either a lack of information or large uncertainties in the experiment conditions, material, or dimensions, the Monaco with Automated Variance Reduction using Importance Calculations (MAVRIC) radiation transport computer code with built-in variance reduction methods distributed with the SCALE computer code system agrees well with the measurement results. In selected benchmarks, MAVRIC is also compared to Monte Carlo N- Particle® (MCNP® ) 1 calculations. Both computer codes generally agree well within the estimated uncertainties. With the release of SCALE 6.3.0, Shift was integrated as an alternative transport solver in MAVRIC, denoted MAVRIC-Shift. Although the traditional MAVRIC using Monaco was used primarily in this validation study, many results have also been generated using MAVRIC-Shift. Agreement between MAVRIC-Monaco and MAVRIC-Shift is generally very good. The benchmarks presented in this report were obtained from reliable sources such as the International Criticality Safety Benchmark Evaluation Project Handbook, the Shielding Integral Benchmark Archive & Database, and other shielding validation work found in the literature. Additional datapoints and benchmarks will be added to future versions of this report to expand the shielding validation suite.

61 RADIATION PROTECTION AND DOSIMETRY↗

Standardized protocols for evaluating platinum group metal-free oxygen reduction reaction electrocatalysts in polymer electrolyte fuel cells

Platinum group metal (PGM)-free electrocatalysts for the oxygen reduction reaction at the polymer electrolyte fuel cell cathode have shown substantial improvements in activity—especially those derived from transition metals, nitrogen and carbon. However, their stability and durability remain insufficient. A key to enabling future improvements and performance comparisons lies in the development of test protocols that are relevant to the operating conditions of the fuel cell cathode, can be completed within a reasonable time and are ubiquitously adopted. Here we propose and validate such protocols, designed with special attention to typical catalyst degradation mechanisms of PGM-free catalysts. The results of the cross-laboratory validation study using two different catalysts attest to the strength and feasibility of the proposed approach. We hope that the information provided here can serve as a broad and effective platform for assessing the performance and durability of PGM-free catalysts for polymer electrolyte fuel cells.

25 ENERGY STORAGE↗

Fluidization of Group A Glass Particles: Experiments and Preliminary Validation

This work is aimed at providing reliable high-quality data from fluidization experiments. Geldart Group A glass beads are used as bed material. The fluidizing medium is air at atmospheric pressure which enters the system at 40% relative humidity. The air inlet velocity is varied over a broad range from 2 U mf to 26 U mf , where the minimum fluidization velocity, U mf , is 0.608 cm/s. There is not a significant change in the mean values of differential pressure; however, there are noticeable trends in their standard deviation values. Preliminary validation studies are performed using the open-source software Multiphase Flow with Interphase eXchanges (MFiX) developed by the National Energy Technology Laboratory (NETL). The results from Eulerian-Eulerian (MFiX-TFM, two-fluid model) and Eulerian-Lagrangian (MFiX-PIC, particle-in-cell) formulations are compared. The work presented in this report highlights the applicability of MFiX-PIC for large-scale applications, and reveals that PIC simulation offers a suitable alternative to TFM simulation when effects due to multiple components or polydispersity are significant. PIC modeling provides a readily extendible framework for such systems. However, PIC models do rely on an empirical closure for inter-particle stress. Some solution discrepancies were evident in MFiX-PIC predictions which require further analysis. As such, the study underlines the need for a systematic approach to quantify the sources of numerical uncertainty within the PIC model. However, even with known empiricism, MFiX-PIC has demonstrated considerable potential in analyzing gas-solid systems. The results obtained are encouraging and warrant further investigation to improve the predictive capability of MFiX-PIC.

36 MATERIALS SCIENCE↗

Verification and validation of linear gyrokinetic simulation of Alfven eigenmodes in the DIII-D tokamak

A verification and validation study is carried out for a sequence of reversed shear Alfven instability time slices. The mode frequency increases in time as the minimum (q{sub min}) in the safety factor profile decreases. Profiles and equilibria are based upon reconstructions of DIII-D discharge (no. 142111) in which many such frequency up-sweeping modes were observed. Calculations of the frequency and mode structure evolution from two gyrokinetic codes, GTC and GYRO, and a gyro-Landau fluid code TAEFL are compared. The experimental mode structure of the instability was measured using time-resolved two-dimensional electron cyclotron emission imaging. The three models reproduce the frequency upsweep event within {+-}10% of each other, and the average of the code predictions is within {+-}8% of the measurements; growth rates are predicted that are consistent with the observed spectral line widths. The mode structures qualitatively agree with respect to radial location and width, dominant poloidal mode number, ballooning structure, and the up-down asymmetry, with some remaining differences in the details. Such similarities and differences between the predictions of the different models and the experimental results are a valuable part of the verification/validation process and help to guide future development of the modeling efforts.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Global Summary MGS TES Data and Mars-Gram Validation

Mars Global Reference Atmospheric Model (Mars-GRAM 2001) is an engineering-level Mars atmosphere model widely used for many Mars mission applications. From 0-80 km, it is based on NASA Ames Mars General Circulation Model (MGCM), while above 80 km it is based on University of Arizona Mars Thermospheric General Circulation Model. Mars-GRAM 2001 and MGCM use surface topograph$ from Mars Global Surveyor Mars Orbiting Laser Altimeter (MOLA). Validation studies are described comparing Mars-GRAM with a global summary data set of Mars Global Surveyor Thermal Emission Spectrometer (TES) data. TES averages and standard deviations were assembled from binned TES data which covered surface to approx. 40 km, over more than a full Mars year (February, 1999 - June, 2001, just before start of a Mars global dust storm). TES data were binned in 10-by-10 degree latitude-longitude bins (i.e. 36 longitude bins by 19 latitude bins), 12 seasonal bins (based on 30 degree increments of Ls angle). Bin averages and standard deviations were assembled at 23 data levels (temperature at 21 pressure levels, plus surface temperature and surface pressure). Two time-of day bins were used: local time near 2 or 14 hours local time). Two dust optical depth bins wereused: infrared optical depth either less than or greater than 0.25 (which corresponds to visible optical depth either less than or greater than about 0.5). For interests in aerocapture and precision entry and landing, comparisons focused on atmospheric density. TES densities versus height were computed from TES temperature versus pressure, using assumptions of perfect gas law and hydrostatics. Mars-GRAM validation studies used density ratio (TES/Mars-GRAM) evaluated at data bin center points in space and time. Observed average TES/Mars-GRAM density ratios were generally 1+/-0.05, except at high altitudes (15-30 km, depending on season) and high latitudes (> 45 deg N), or at most altitudes in the southern hemisphere at Ls approx. 90 and 180deg). Compared to TES averages for a given latitude and season, TES data had average density standard deviation about the mean of approx. 65-10.5% (varying with height) for all data, or approx. 5-12%, depending on time of day and dust optical depth. Average standard deviation of TES/Mars-GRAM density ratio was 8.9% for local time 2 hours and 7.1% for local time 14 hours. Thus standard deviation of observed TES/Mars-GRAM density ratio, evaluated at matching positions and times, is about the same as the standard deviation of TES data about the TES mean value at a given position and season.

Justus, C.↗

Studying the validity of relativistic hydrodynamics with a new exact solution of the Boltzmann equation

We present an exact solution to the Boltzmann equation which describes a system undergoing boost-invariant longitudinal and azimuthally symmetric radial expansion for arbitrary shear viscosity to entropy density ratio. This new solution is constructed by considering the conformal map between Minkowski space and the direct product of three-dimensional de Sitter space with a line. The resulting solution respects $SO(3)_q\otimes SO(1,1)\otimes Z_2$ symmetry. We compare the exact kinetic solution with exact solutions of the corresponding macroscopic equations that were obtained from the kinetic theory in ideal and second-order viscous hydrodynamic approximations. The macroscopic solutions are obtained in de Sitter space and are subject to the same symmetries used to obtain the exact kinetic solution.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Experimental Study for Validation of Resilient Response of Controls - Thrust 2 Controls Assessment

The focus of this project is to design, execute, and analyze experiments around resilience response. As part of the Resilience through Data-Driven, Intelligently Designed Control (RD2C) initiative, this project builds upon the previously designed control algorithms and experiments. It designs detailed uses cases to test RD2C-developed mitigation schemes in specific realistic scenarios, analyze and save the measurement data sets. Having a high-confidence and consistent data set is crucial for identifying relevant metrics to describe the system resilience in specific real-life-like scenarios of power grid operation.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Propeller aircraft interior noise model utilization study and validation

Utilization and validation of a computer program designed for aircraft interior noise prediction is considered. The program, entitled PAIN (an acronym for Propeller Aircraft Interior Noise), permits (in theory) predictions of sound levels inside propeller driven aircraft arising from sidewall transmission. The objective of the work reported was to determine the practicality of making predictions for various airplanes and the extent of the program's capabilities. The ultimate purpose was to discern the quality of predictions for tonal levels inside an aircraft occurring at the propeller blade passage frequency and its harmonics. The effort involved three tasks: (1) program validation through comparisons of predictions with scale-model test results; (2) development of utilization schemes for large (full scale) fuselages; and (3) validation through comparisons of predictions with measurements taken in flight tests on a turboprop aircraft. Findings should enable future users of the program to efficiently undertake and correctly interpret predictions.

Pope, L. D.↗

SAGE II aerosol data validation - Comparative studies of SAGE II and SAM II data sets

Data from the Stratospheric Aerosol and Gas Experiment (SAGE II) satellite are compared with data from the Stratospheric Aerosol Measurement (SAM II) satellite. Both experiments produce aerosol extinction profiles by measuring the attenuation of solar radiation during each sunrise and sunset observed by the satelltie. The SAGE II obtains profiles at 1.02 microns and three smaller wavelengths, whereas the SAM II measures at only one radiometric channel at 1.0 microns. It is found that the differences between the two sets of data are generally within the error bars associated with each measurement. In addition, the sunrise and sunset data from SAGE II are analyzed.

Yue, G. K.↗

Validated Feasibility Study of Integrally Stiffened Metallic Fuselage Panels for Reducing Manufacturing Costs: Cost Assessment of Manufacturing/Design Concepts

The objective of the Integral Airframe Structures (IAS) program was to demonstrate, for an integrally stiffened structural concept, performance and weight equal to "built-up" structure with lower manufacturing cost. This report presents results of the cost assessment for several design configuration/manufacturing method combinations. The attributes of various cost analysis models were evaluated and COSTRAN selected for this study. A process/design cost evaluation matrix was developed based on material, forming, machining, and assembly of structural sub-elements and assembled structure. A hybrid design, made from high-speed machined extruded frames that are mechanically fastened to high-speed machined plate skin/stringer panels, was identified as the most cost-effective manufacturing solution. Recurring labor and material costs of the hybrid design are up to 61 percent less than the current built-up technology baseline. This would correspond to a total cost reduction of $1.7 million per ship set for a 777-sized airplane. However, there are important outstanding issues with regard to the cost of capacity of high technology machinery, and the ability to cost-effectively provide surface finish acceptable to the commercial aircraft industry. The projected high raw material cost of large extrusions also played an important role in the trade-off between plate and extruded concepts.

Metschan, S.↗

Validated Feasibility Study of Integrally Stiffened Metallic Fuselage Panels for Reducing Manufacturing Costs

The continual need to reduce airframe cost and the emergence of high speed machining and other manufacturing technologies has brought about a renewed interest in large-scale integral structures for aircraft applications. Applications have been inhibited, however, because of the need to demonstrate damage tolerance, and by cost and manufacturing risks associated with the size and complexity of the parts. The Integral Airframe Structures (IAS) Program identified a feasible integrally stiffened fuselage concept and evaluated performance and manufacturing cost compared to conventional designs. An integral skin/stiffener concept was produced both by plate hog-out and near-net extrusion. Alloys evaluated included 7050-T7451 plate, 7050-T74511 extrusion, 6013-T6511 extrusion, and 7475-T7351 plate. Mechanical properties, structural details, and joint performance were evaluated as well as repair, static compression, and two-bay crack residual strength panels. Crack turning behavior was characterized through panel tests and improved methods for predicting crack turning were developed. Manufacturing cost was evaluated using COSTRAN. A hybrid design, made from high-speed machined extruded frames that are mechanically fastened to high-speed machined plate skin/stringer panels, was identified as the most cost-effective manufacturing solution. Recurring labor and material costs of the hybrid design are up to 61 percent less than the current technology baseline.

Pettit, R. G.↗

Integral Airframe Structures (IAS): Validated Feasibility Study of Integrally Stiffened Metallic Fuselage Panels for Reducing Manufacturing Costs

The Integral Airframe Structures (IAS) program investigated the feasibility of using "integrally stiffened" construction for commercial transport fuselage structure. The objective of the program was to demonstrate structural performance and weight equal to current "built-up" structure with lower manufacturing cost. Testing evaluated mechanical properties, structural details, joint performance, repair, static compression, and two-bay crack residual strength panels. Alloys evaluated included 7050-T7451 plate, 7050-T74511 extrusion, 6013-T6511x extrusion, and 7475-T7351 plate. Structural performance was evaluated with a large 7475-T7351 pressure test that included the arrest of a two-bay longitudinal crack, and a measure of residual strength for a two-bay crack centered on a broken frame. Analysis predictions for the two-bay longitudinal crack panel correlated well with the test results. Analysis activity conducted by the IAS team strongly indicates that current analysis tools predict integral structural behavior as accurately as built-up structure. The cost study results indicated that, compared to built-up fabrication methods, high-speed machining structure from aluminum plate would yield a recurring cost savings of 61%. Part count dropped from 78 individual parts on a baseline panel to just 7 parts for machined IAS structure.

Munroe, J.↗

Seasonal and Vegetational Variation in Albedo Measured During CERES Ground-Validation Pilot Study

The Clouds and the Earth's Radiant Energy System (CERES) satellite is scheduled for launch in the Fall of 1997 aboard the Tropical Rainfall Measuring Mission (TRMM). A surface measurement pilot study has been initiated in a 37-km region near Richmond, VA, for comparison with the CERES surface flux retrievals. Two-minute averaged upwelling and downwelling surface fluxes over a mostly deciduous forest have been recorded daily for the past two years, and show a broadband, shortwave daily albedo increase during the summer months. Evidence is presented that indicates vegetational changes in the forest as the overriding mechanism for this change. Upwelling flux measured over the entire region by helicopter-mounted instrumentation has been processed for four solar seasons. Future plans include the installation of four more albedo surface sites over various types of vegetation throughout the region.

Schuster, G. L.↗