Search NASA⌕ Search

SEARCH · Search NASA

Results for “Verification study”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 361 records · Page 20

Verification and Improvement of ERS-1/2 Altimeter Geophysical Data Records for Global Change Studies

This Final Technical Report summarizes the research work conducted under NASA's Physical Oceanography Program entitled, Verification And Improvement Of ERS-112 Altimeter Geophysical Data Recorders For Global Change Studies, for the time period from January 1, 2000 through June 30, 2000. This report also provides a summary of the investigation from July 1, 1997 - June 30, 2000. The primary objectives of this investigation include verification and improvement of the ERS-1 and ERS-2 radar altimeter geophysical data records for distribution of the data to the ESA-approved U.S. ERS-1/-2 investigators for global climate change studies. Specifically, the investigation is to verify and improve the ERS geophysical data record products by calibrating the instrument and assessing accuracy for the ERS-1/-2 orbital, geophysical, media, and instrument corrections. The purpose is to ensure that the consistency of constants, standards and algorithms with TOPEX/POSEIDON radar altimeter for global climate change studies such as the monitoring and interpretation of long-term sea level change. This investigation has provided the current best precise orbits, with the radial orbit accuracy for ERS-1 (Phases C-G) and ERS-2 estimated at the 3-5 cm rms level, an 30-fold improvement compared to the 1993 accuracy. We have finalized the production and verification of the value-added ERS-1 mission (Phases A, B, C, D, E, F, and G), in collaboration with JPL PODAAC and the University of Texas. Orbit and data verification and improvement of algorithms led to the best data product available to-date. ERS-2 altimeter data have been improved and we have been active on Envisat (2001 launch) GDR algorithm review and improvement. The data improvement of ERS-1 and ERS-2 led to improvement in the global mean sea surface, marine gravity anomaly and bathymetry models, and a study of Antarctica mass balance, which was published in Science in 1998.

Shum, C. K.↗

SU-E-T-77: A Statistical Approach to Manage Quality for Pre-Treatment Verification in IMRT/VMAT

Objective: The study presents the application of a simple concept of statistical process control (SPC) for pre-treatment quality assurance procedure analysis for planar dose measurements performed using 2D-array and a-Si electronic portal imaging device (a-Si EPID). Method: A total of 195 patients of four different anatomical sites: brain (n1=45), head & neck (n2=45), thorax (n3=50) and pelvis (n4=55) were selected for the study. Pre-treatment quality assurance for the clinically acceptable IMRT/VMAT plans was measured with 2D array and a-Si EPID of the accelerator. After the γ-analysis, control charts and the quality index Cpm was evaluated for each cohort. Results: Mean and σ of γ ( 3%/3 mm) were EPID γ %≤1= 99.9% ± 1.15% and array γ %<1 = 99.6% ± 1.06%. Among all plans γ max was consistently lower than for 2D array as compared to a-Si EPID. Fig.1 presents the X-bar control charts for every cohort. Cpm values for a-Si EPID were found to be higher than array, detailed results are presented in table 1. Conclusion: Present study demonstrates the significance of control charts used for quality management purposes in newer radiotherapy clinics. Also, provides a pictorial overview of the clinic performance for the advanced radiotherapy techniques.Higher Cpm values for EPID indicate its higher efficiency than array based measurements.

60 APPLIED LIFE SCIENCES↗

Blind Validation Study of PRICE TruePlanning and SEER-H

Two of the primary parametric costing tools used to estimate the development and production cost of future spacecraft hardware are PRICE TruePlanning by PRICE Systems, and System Estimation and Evaluation of Resources-Hardware (SEER-H) by Galorath. These are standard tools used by NASA and industry to estimate the cost of new aerospace hardware. This study is an independent verification of the accuracy of these tools and was originally published in 2018. The purpose of this presentation is to circulate the findings of that study among the NASA cost community. Both PRICE Systems and Galorath have completed internal validation studies of their parametric cost estimating tools; however, they only provided the results of the studies and did not detail the exact methods used to perform the validation. In the present study, cost estimators used PRICE TruePlanning and SEER-H to estimate the cost of twelve different past NASA science missions. The estimators were prevented from knowing the actual cost of the missions in an effort to minimize cognitive biases. In the present study, SEER-H had an average error of 23%, median error of -0.3%, with a standard deviation of 43%. PRICE had an average error of 52%, median error of 50%, and standard deviation of 45%. Nine of the twelve mission's actual costs fell within the 80% confidence interval of SEER's probabilistic estimates; however, none of the missions fell within PRICE’s confidence intervals. There were several factors independent of PRICE and SEER-H which may have affected the accuracy of the results in the present study including: uncertainty in the technical data used for the estimates, the methods used to estimate uncertainty in spacecraft component mass and numbers of prototypes, and the experience of the estimators.

SEER↗

Verification of Sulfate Attack Penetration Rates for Saltstone Disposal Unit Modeling

Recent Special Analysis modeling of Saltstone Disposal Units consider sulfate attack on concrete and utilize degradation rates estimated from Cementitious Barriers Partnership software simulations. This study provides an independent verification of those simulation results using an alternative analysis method and an independent characterization data source. The sulfate penetration depths estimated herein are similar to the best-estimate values in SRNL-STI-2013-00118 Rev. 2 and well below the nominal values subsequently used to define Saltstone Special Analysis base cases.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

The verification of LANDSAT data in the geographical analysis of wetlands in west Tennessee

The reliability of LANDSAT imagery as a medium for identifying, delimiting, monitoring, measuring, and mapping wetlands in west Tennessee was assessed to verify LANDSAT as an accurate, efficient cartographic tool that could be employed by a wide range of users to study wetland dynamics. The verification procedure was based on the visual interpretation and measurement of multispectral imagery. The accuracy testing procedure was predicated on surrogate ground truth data gleaned from medium altitude imagery of the wetlands. Fourteen sites or case study areas were selected from individual 9 x 9 inch photo frames on the aerial photography. These sites were then used as data control calibration parameters for assessing the cartography accuracy of the LANDSAT imagery. An analysis of results obtained from the verification tests indicated that 1:250,000 scale LANDSAT data were the most reliable scale of imagery for visually mapping and measuring wetlands using the area grid technique. The mean areal percentage of accuracy was 93.54 percent (real) and 96.93 percent (absolute). As a test of accuracy, the LANDSAT 1:250,000 scale overall wetland measurements were compared with an area cell mensuration of the swamplands from 1:130,000 scale color infrared U-2 aircraft imagery. The comparative totals substantiated the results from the LANDSAT verification procedure.

Rehder, J.↗

WEST-3 wind turbine simulator development. Volume 2: Verification

The details of a study to validate WEST-3, a new time wind turbine simulator developed by Paragib Pacific Inc., are presented in this report. For the validation, the MOD-0 wind turbine was simulated on WEST-3. The simulation results were compared with those obtained from previous MOD-0 simulations, and with test data measured during MOD-0 operations. The study was successful in achieving the major objective of proving that WEST-3 yields results which can be used to support a wind turbine development process. The blade bending moments, peak and cyclic, from the WEST-3 simulation correlated reasonably well with the available MOD-0 data. The simulation was also able to predict the resonance phenomena observed during MOD-0 operations. Also presented in the report is a description and solution of a serious numerical instability problem encountered during the study. The problem was caused by the coupling of the rotor and the power train models. The results of the study indicate that some parts of the existing WEST-3 simulation model may have to be refined for future work; specifically, the aerodynamics and procedure used to couple the rotor model with the tower and the power train models.

Sridhar, S.↗

High temperature furnace modeling and performance verifications

Analytical, numerical and experimental studies were performed on two classes of high temperature materials processing furnaces. The research concentrates on a commercially available high temperature furnace using zirconia as the heating element and an arc furnace based on a ST International tube welder. The zirconia furnace was delivered and work is progressing on schedule. The work on the arc furnace was initially stalled due to the unavailability of the NASA prototype, which is actively being tested aboard the KC-135 experimental aircraft. A proposal was written and funded to purchase an additional arc welder to alleviate this problem. The ST International weld head and power supply were received and testing will begin in early November. The first 6 months of the grant are covered.

Smith, James E., Jr.↗

High temperature furnace modeling and performance verifications

Analytical, numerical, and experimental studies were performed on two classes of high temperature materials processing sources for their potential use as directional solidification furnaces. The research concentrated on a commercially available high temperature furnace using a zirconia ceramic tube as the heating element and an Arc Furnace based on a tube welder. The first objective was to assemble the zirconia furnace and construct parts needed to successfully perform experiments. The 2nd objective was to evaluate the zirconia furnace performance as a directional solidification furnace element. The 3rd objective was to establish a data base on materials used in the furnace construction, with particular emphasis on emissivities, transmissivities, and absorptivities as functions of wavelength and temperature. A 1-D and 2-D spectral radiation heat transfer model was developed for comparison with standard modeling techniques, and were used to predict wall and crucible temperatures. The 4th objective addressed the development of a SINDA model for the Arc Furnace and was used to design sample holders and to estimate cooling media temperatures for the steady state operation of the furnace. And, the 5th objective addressed the initial performance evaluation of the Arc Furnace and associated equipment for directional solidification. Results of these objectives are presented.

Smith, James E., Jr.↗

Studies of a Proton Bunch Phase Monitor for Range Verification in Proton Therapy

A primary subject of the present research in particle therapy is to ensure the precise irradiation of the target volume. The prompt gamma timing (PGT) method provides one possibility for in vivo range verification during the irradiation of patients. Prompt gamma rays with high energies are emitted promptly due to nuclear reactions of protons with tissue. The arrival time of these gammas to the detector reflects the stopping process of the primary protons in tissue and is directly correlated to the range. Due to the time resolution of the detector and the proton bunch time spread, as well as drifts of the bunch phase with respect to the accelerator frequency, timing spectra are smeared out and compromise the accuracy of range information intended for future clinical applications. Nevertheless, counteracting this limitation and recovering range information from the PGT measured spectra, corrections using a bunch phase monitor can be performed. A first prototype of bunch phase monitor was tested at GSI Darmstadt, where measurements of the energy correlation profile of the ion bunches were performed. At the ELBE accelerator at Helmholtz-Zentrum Dresden-Rossendorf (HZDR), set up to provide bremsstrahlung photons in very short pulses, a constant fraction algorithm for the incoming digital signals was evaluated, which is used for optimizing the time resolution. Studies of scattering experiments with different thin targets and detector positions are accomplished at Onco Ray Dresden, where a clinical proton beam is available. These experiments allow a basic characterization of the proton bunch structure and the detection yield. (authors)

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Studies of a proton phase beam monitor for range verification in proton therapy

A primary subject of the present research in particle therapy is to ensure the precise irradiation of the target volume. The prompt gamma timing (PGT) method provides one possibility for in vivo range verification during the irradiation of patients. Prompt gamma rays with high energies are emitted promptly due to nuclear reactions of protons with tissue. The arrival time of these gammas to the detector reflects the stopping process of the primary protons in tissue and are directly correlated to the range. Due to the time resolution of the detector and the proton bunch time spread, as well as drifts of the bunch phase with respect to the accelerator frequency, timing spectra are smeared out and compromise the accuracy of range information intended for future clinical applications. Nevertheless, counteracting this limitation and recovering range information from the PGT measured spectra, corrections using a phase beam monitor can be performed. A first prototype of phase beam monitor was tested at GSI Darmstadt, where measurements of the energy profile of the ion bunches were performed. At the ELBE accelerator Helmholtz-Zentrum Dresden-Rossendorf (HZDR), set up to provide bremsstrahlung photons in very short pulses, a constant fraction algorithm for the incoming digital signals was evaluated, which is used for optimizing the time resolution. Studies of scattering experiments with different thin targets and detector positions are accomplished at Oncoray Dresden, where a clinical proton beam is available. These experiments allow a basic characterization of the proton bunch structure and the detection yield. (authors)

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Independent calculation of dose distributions for helical tomotherapy using a conventional treatment planning system

Purpose: The dosimetric verification of treatment plans in helical tomotherapy usually is carried out via verification measurements. In this study, a method for independent dose calculation of tomotherapy treatment plans is presented, that uses a conventional treatment planning system with a pencil kernel dose calculation algorithm for generation of verification dose distributions based on patient CT data. Methods: A pencil beam algorithm that directly uses measured beam data was configured for dose calculation for a tomotherapy machine. Tomotherapy treatment plans were converted into a format readable by an in-house treatment planning system by assigning each projection to one static treatment field and shifting the calculation isocenter for each field in order to account for the couch movement. The modulation of the fluence for each projection is read out of the delivery sinogram, and with the kernel-based dose calculation, this information can directly be used for dose calculation without the need for decomposition of the sinogram. The sinogram values are only corrected for leaf output and leaf latency. Using the converted treatment plans, dose was recalculated with the independent treatment planning system. Multiple treatment plans ranging from simple static fields to real patient treatment plans were calculated using the new approach and either compared to actual measurements or the 3D dose distribution calculated by the tomotherapy treatment planning system. In addition, dose–volume histograms were calculated for the patient plans. Results: Except for minor deviations at the maximum field size, the pencil beam dose calculation for static beams agreed with measurements in a water tank within 2%/2 mm. A mean deviation to point dose measurements in the cheese phantom of 0.89% ± 0.81% was found for unmodulated helical plans. A mean voxel-based deviation of −0.67% ± 1.11% for all voxels in the respective high dose region (dose values >80%), and a mean local voxel-based deviation of −2.41% ± 0.75% for all voxels with dose values >20% were found for 11 modulated plans in the cheese phantom. Averaged over nine patient plans, the deviations amounted to −0.14% ± 1.97% (voxels >80%) and −0.95% ± 2.27% (>20%, local deviations). For a lung case, mean voxel-based deviations of more than 4% were found, while for all other patient plans, all mean voxel-based deviations were within ±2.4%. Conclusions: The presented method is suitable for independent dose calculation for helical tomotherapy within the known limitations of the pencil beam algorithm. It can serve as verification of the primary dose calculation and thereby reduce the need for time-consuming measurements. By using the patient anatomy and generating full 3D dose data, and combined with measurements of additional machine parameters, it can substantially contribute to overall patient safety.

60 APPLIED LIFE SCIENCES↗

Experimental Evaluation of Verification and Validation Tools on Martian Rover Software

We report on a study to determine the maturity of different verification and validation technologies (V&V) on a representative example of NASA flight software. The study consisted of a controlled experiment where three technologies (static analysis, runtime analysis and model checking) were compared to traditional testing with respect to their ability to find seeded errors in a prototype Mars Rover. What makes this study unique is that it is the first (to the best of our knowledge) to do a controlled experiment to compare formal methods based tools to testing on a realistic industrial-size example where the emphasis was on collecting as much data on the performance of the tools and the participants as possible. The paper includes a description of the Rover code that was analyzed, the tools used as well as a detailed description of the experimental setup and the results. Due to the complexity of setting up the experiment, our results can not be generalized, but we believe it can still serve as a valuable point of reference for future studies of this kind. It did confirm the belief we had that advanced tools can outperform testing when trying to locate concurrency errors. Furthermore the results of the experiment inspired a novel framework for testing the next generation of the Rover.

Brat, Guillaume↗

Preflight Definition and Verification Testing for the Plant Habitat-07 Experiment to Study Substrate Moisture Impacts on Lettuce Plant and Microbiome Development

Delivering adequate water and oxygen to root zones of crops growing in microgravity is challenging due to the complex behavior of fluids and gasses during spaceflight. Chronic excess (flood) or insufficient (drought) water levels, or intermittent watering and wilting of plants, leads to alterations in plant growth and impacts on the nutritional and microbial composition of those plants. PH-07 will apply controlled water stress to assess and quantify changes in plant growth and the microbiome of a well-tested food crop, ‘Outredgeous’ red romaine lettuce, grown in NASA’s Advanced Plant Habitat (APH) on the ISS.

Gioia Massa↗

Photometric redshift analysis in the Dark Energy Survey Science Verification data

In this study, we present results from a study of the photometric redshift performance of the Dark Energy Survey (DES), using the early data from a Science Verification period of observations in late 2012 and early 2013 that provided science-quality images for almost 200 sq. deg. at the nominal depth of the survey. We assess the photometric redshift (photo-z) performance using about 15 000 galaxies with spectroscopic redshifts available from other surveys. These galaxies are used, in different configurations, as a calibration sample, and photo-z's are obtained and studied using most of the existing photo-z codes. A weighting method in a multidimensional colour–magnitude space is applied to the spectroscopic sample in order to evaluate the photo-z performance with sets that mimic the full DES photometric sample, which is on average significantly deeper than the calibration sample due to the limited depth of spectroscopic surveys. In addition, empirical photo-z methods using, for instance, artificial neural networks or random forests, yield the best performance in the tests, achieving core photo-z resolutions σ68 ~ 0.08. Moreover, the results from most of the codes, including template-fitting methods, comfortably meet the DES requirements on photo-z performance, therefore, providing an excellent precedent for future DES data sets.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Evolution of Galaxy Luminosity and Stellar-Mass Functions since $z=1$ with the Dark Energy Survey Science Verification Data

We present the first study of the evolution of the galaxy luminosity and stellar-mass functions (GLF and GSMF) carried out by the Dark Energy Survey (DES). We describe the COMMODORE galaxy catalogue selected from Science Verification images. This catalogue is made of $\sim 4\times 10^{6}$ galaxies at $0<z\lesssim1.3$ over a sky area of $\sim155\ {\rm sq. \ deg}$ with ${\it i}$-band limiting magnitude ${\it i}=23\ {\rm mag}$. Such characteristics are unprecedented for galaxy catalogues and they enable us to study the evolution of GLF and GSMF at $0<z<1$ homogeneously with the same statistically-rich data-set and free of cosmic variance effects. The aim of this study is twofold: i) we want to test our method based on the use of photometric-redshift probability density functions against literature results obtained with spectroscopic redshifts; ii) we want to shed light on the way galaxies build up their masses over cosmic time. We find that both the ${\it i}$-band galaxy luminosity and stellar mass functions are characterised by a double-Schechter shape at $z<0.2$. Both functions agree well with those based on spectroscopic redshifts. The DES GSMF agrees especially with those measured for the GAlaxy Mass Assembly and the PRism MUlti-object Survey out to $z\sim1$. At $0.2<z<1$, we find the ${\it i}$-band luminosity and stellar-mass densities respectively to be constant ($\rho_{\rm L}\propto (1+z)^{-0.12\pm0.11}$) and decreasing ($\rho_{\rm Mstar}\propto (1+z)^{-0.5\pm0.1}$) with $z$. This indicates that, while at higher redshift galaxies have less stellar mass, their luminosities do not change substantially because of their younger and brighter stellar populations. Finally, we also find evidence for a top-down mass-dependent evolution of the GSMF.

79 ASTRONOMY AND ASTROPHYSICS↗

New analytical solutions to the two-phase water faucet problem

Here, the one-dimensional water faucet problem is one of the classical benchmark problems originally proposed by Ransom to study the two-fluid two-phase flow model. With certain simplifications, such as massless gas phase and no wall and interfacial frictions, analytical solutions had been previously obtained for the transient liquid velocity and void fraction distribution. The water faucet problem and its analytical solutions have been widely used for the purposes of code assessment, benchmark and numerical verifications. In our previous study, the Ransom’s solutions were used for the mesh convergence study of a high-resolution spatial discretization scheme. It was found that, at the steady state, an anticipated second-order spatial accuracy could not be achieved, when compared to the existing Ransom’s analytical solutions. A further investigation showed that the existing analytical solutions do not actually satisfy the commonly used two-fluid single-pressure two-phase flow equations. In this work, we present a new set of analytical solutions of the water faucet problem at the steady state, considering the gas phase density’s effect on pressure distribution. This new set of analytical solutions are used for mesh convergence studies, from which anticipated second-order of accuracy is achieved for the 2nd order spatial discretization scheme. In addition, extended Ransom’s transient solutions for the gas phase velocity and pressure are derived, with the assumption of decoupled liquid and gas pressures. Numerical verifications on the extended Ransom’s solutions are also presented.

97 MATHEMATICS AND COMPUTING↗

The 2014 Sandia Verification and Validation Challenge: Problem statement

This paper presents a case study in utilizing information from experiments, models, and verification and validation (V&V) to support a decision. It consists of a simple system with data and models provided, plus a safety requirement to assess. The goal is to pose a problem that is flexible enough to allow challengers to demonstrate a variety of approaches, but constrained enough to focus attention on a theme. This was accomplished by providing a good deal of background information in addition to the data, models, and code, but directing the participants' activities with specific deliverables. In this challenge, the theme is how to gather and present evidence about the quality of model predictions, in order to support a decision. This case study formed the basis of the 2014 Sandia V&V Challenge Workshop and this resulting special edition of the ASME Journal of Verification, Validation, and Uncertainty Quantification.

42 ENGINEERING↗