Search NASA⌕ Search

SEARCH · Search NASA

Results for “validation studies”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,729 records · Page 96

Global Validation of Columnar Water Vapor Derived from EOS MODIS-MAIAC Algorithm Against the Ground-Based AERONET Observations

The water vapor is a relevant greenhouse gas in the Earth's climate system, and satellite products become one of the most effective way to characterize and monitor the columnar water vapor (CWV) content at global scale. Recently, a new product (MCD19) was released as part of MODIS (Moderate Resolution Imaging Spectroradiometer) Collection 6 (C6). This operational product from the Multi-Angle Implementation for Atmospheric Correction (MAIAC) algorithm includes a high 1-kilometer resolution CWV retrievals. This study presents the first global validation of MAIAC C6 CWV obtained from MODIS MCD19A2 product. This evaluation was performed using Aerosol Robotic Network (AERONET) observations at 265 sites (2000-2017). Overall, the results show a good agreement between MAIAC/AERONET CWV retrievals, with correlation coefficient higher than 0.95 and RMS (Root Mean Square) error lower than 0.250 centimeters. The binned error analysis revealed an underestimation (approximately 10 percent) of Aqua CWV retrievals with negative bias for CWV higher than 3.0 centimeters. In contrast, Terra CWV retrievals show a slope of regression close to unity and a low mean bias of 0.075 centimeters. While the accuracy is relatively similar between 1.0 and 5.0 centimeters for both sensor products, Terra dataset is more reliable for applications in humid tropical areas (less than 5.0 centimeters). The expected error was defined as plus or minus 15 percent, with less than 68 percent of retrievals falling within this envelope. However, the accuracy is regionally dependent, and lower error should be expected in some regions, such as South America and Oceania. Since MODIS instruments have exceeded their design lifetime, time series analysis was also presented for both sensor products. The temporal analysis revealed a systematic offset of global average between Terra and Aqua CWV records. We also found an upward trend (approximately 0.2 centimeters per decade) in Terra CWV retrievals, while Aqua CWV retrievals remain stable over time. The sensor degradation influences the ability to detect climate signals, and this study indicates the need for revisiting calibration of the MODIS bands 17-19, mainly for Terra instrument, to assure the quality of the MODIS water vapor product. Finally, this study presents a comprehensive validation analysis of MAIAC CWV over land, raising the understanding of its overall quality.

MAIAC↗

Localization of needle tip with color doppler during pericardiocentesis: In vitro validation and initial clinical application

This study evaluates a new device that uses color Doppler ultrasonography to enable real-time image guidance of the aspirating needle, which has not been possible until now. The ColorMark device (EchoCath Inc, Princeton, NJ) induces high-frequency, low-amplitude vibrations in the needle to enable localization with color Doppler. We studied this technique in 25 consecutive patients undergoing pericardiocentesis, and in vitro, in a urethane phantom with which the accuracy of color Doppler localization of the needle tip was compared with that obtained by direct measurement. Tip localization was excellent in vitro; errors axial to the ultrasound beam (velocity Doppler -0.13 +/- 0.90 mm, power Doppler -0.05 +/- 1.7 mm) were less than lateral errors (velocity -0.36 +/- 1.8 mm, power -0.02 +/- 2.8 mm). In 18 of 25 patients, the needle was identified and guided into the pericardial space with the ColorMark technique, and it allowed successful, uncomplicated drainage of fluid. Initial failures were the result of incorrect settings on the echocardiographic machine and inappropriate combinations of the needle puncture site and imaging window. This study demonstrates a novel color Doppler technique that is highly accurate at localizing a needle tip. The technique is feasible for guiding pericardiocentesis. Further clinical validation of this technique is required.

NASA Discipline Cardiopulmonary↗

External Validation and Optimization of International Consensus Clinical Target Volumes for Adjuvant Radiation Therapy in Bladder Cancer

Purpose: International consensus (IC) clinical target volumes (CTVs) have been proposed to standardize radiation field design in the treatment of patients at high risk of locoregional failure (LRF) after radical cystectomy. The purpose of this study was to externally validate the IC CTVs in a cohort of postsurgical patients followed up for LRF and identify revisions that might improve the IC CTVs' performance. Methods and Materials: Among 334 patients with pT3 to pT4 bladder cancer treated with radical cystectomy, LRF developed in 58 (17%), of whom 52 had computed tomography scans available for review. Images with LRF were exported into a treatment planning system, and IC CTVs were contoured and evaluated for adequacy of coverage of each LRF with respect to both the patient and each of 6 pelvic subsites: common iliac (CI) region, obturator region (OR), external and internal iliac region, presacral region, cystectomy bed, or other pelvic site. Revisions to the IC contours were proposed based on the findings. Results: Of the 52 patients with documented LRF, 13 (25%) had LRFs that were outside of the IC CTV involving 17 pelvic subsites: 5 near the CI CTV, 5 near the OR CTV, 1 near the external and internal iliac region, and 6 near the cystectomy bed. The 5 CI failures were located superior to the CTV, and the 5 OR failures were located medial to the CTV. Increasing the superior boundary of the CI to a vessel-based definition of the aortic bifurcation, as well as increasing the medial extension of the OR by an additional 9 mm, decreased the number of patients with LRF outside of the IC CTV to 7 (13%). Conclusions: Modified IC CTVs inclusive of a slight adjustment superiorly for the CI region and medially for the OR may reduce the risk of pelvic failure in patients treated with adjuvant radiation therapy.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Closed Fuel Cycle Waste Treatment Strategy

This study is aimed at evaluating the existing waste management approaches for nuclear fuel cycle facilities in comparison to the objectives of implementing an advanced fuel cycle in the U.S. under current legal, regulatory, and logistical constructs. The study begins with the Global Nuclear Energy Partnership (GNEP) Integrated Waste Management Strategy (IWMS) as a general strategy and associated Waste Treatment Baseline Study (WTBS). The tenets of the IWMS are equally valid to the current waste management study. However, the flowsheet details have changed significantly from those considered under GNEP. In addition, significant additional waste management technology development has occurred since the GNEP waste management studies were performed. This study updates the information found in the WTBS, summarizes the results of more recent technology development efforts, and describes waste management approaches as they apply to both a nominal case study and near-term target reprocessing flowsheets. Many of the waste management technologies discussed also apply to other potential flowsheets that involve reprocessing. The report summarizes the waste arising from aqueous reprocessing of a typical light-water reactor (LWR) fuel to separate actinides for use in fabricating metal sodium fast reactor (SFR) fuel and from electrochemical reprocessing of the metal SFR fuel to separate actinides for recycle back into the SFR in the form of metal fuel. The primary streams considered and the recommended waste forms include: • Tritium separated from either a low volume gas stream or a high volume water stream. The recommended waste form is low-water cement in high integrity containers (HICs). • Iodine-129 separated from off-gas streams in aqueous processing. There are a range of potentially suitable waste forms. As a reference case, a glass composite material (GCM) formed by the encapsulation of the silver Mordenite (AgZ) getter material in a low-temperature glass is assumed. A number of alternatives with distinct advantages are also considered including a fused silica waste form with encapsulated nano-sized AgI crystals. • Carbon-14 separated from LWR fuel treatment off-gases and immobilized as a CaCO3 in a cement waste form. • Krypton-85 separated from LWR and SFR fuel treatment off-gases and stored as a compressed gas. • An aqueous reprocessing high-level waste (HLW) raffinate waste which is immobilized by the vitrification process in one of three forms: a single phase borosilicate glass, a borosilicate based glass ceramic, or a multi-phased crystalline synthetic rock (Synroc). • An undissolved solids (UDS) fraction from aqueous reprocessing of LWR fuel that is either included in the borosilicate HLW glass or is immobilized in the form of a metal alloy in the case of glass ceramics or Synroc. • Zirconium-based LWR fuel cladding hulls and stainless steel (SS) fuel assembly hardware that are washed and super-compacted for disposal or as an alternative with high promise the purification and reuse (or disposal as low-level waste, LLW) of Zr by reactive gas separations. • Electrochemical process salt HLW which is incorporated into a glass bonded Sodalite waste form known as the ceramic waste form (CWF). • Electrochemical process UDS and SS cladding hulls which are melted into an iron based alloy waste form. Mass and volume estimates for each of the recommended waste forms based on the source terms from the reference mass balances are reported. In addition to the above listed primary waste streams, a range of secondary process wastes are generated by aqueous reprocessing of LWR fuel, metal SFR fuel fabrication, and electrochemical reprocessing of SFR fuel. These secondary wastes have been summarized and volumes estimated by type and classification. The important waste management data gaps and research needs have been summarized for each primary waste stream and selected waste process.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

MODIS Observation of Aerosols over Southern Africa During SAFARI 2000: Data, Validation, and Estimation of Aerosol Radiative Forcing

Aerosol properties, including optical thickness and size parameters, are retrieved operationally from the MODIS sensor onboard the Terra satellite launched on 18 December 1999. The predominant aerosol type over the Southern African region is smoke, which is generated from biomass burning on land and transported over the southern Atlantic Ocean. The SAFARI-2000 period experienced smoke aerosol emissions from the regular biomass burning activities as well as from the prescribed burns administered on the auspices of the experiment. The MODIS Aerosol Science Team (MAST) formulates and implements strategies for the retrieval of aerosol products from MODIS, as well as for validating and analyzing them in order to estimate aerosol effects in the radiative forcing of climate as accurately as possible. These activities are carried out not only from a global perspective, but also with a focus on specific regions identified as having interesting characteristics, such as the biomass burning phenomenon in southern Africa and the associated smoke aerosol, particulate, and trace gas emissions. Indeed, the SAFARI-2000 aerosol measurements from the ground and from aircraft, along with MODIS, provide excellent data sources for a more intensive validation and a closer study of the aerosol characteristics over Southern Africa. The SAFARI-2000 ground-based measurements of aerosol optical thickness (AOT) from both the automatic Aerosol Robotic Network (AERONET) and handheld Sun photometers have been used to validate MODIS retrievals, based on a sophisticated spatio-temporal technique. The average global monthly distribution of aerosol from MODIS has been combined with other data to calculate the southern African aerosol daily averaged (24 hr) radiative forcing over the ocean for September 2000. It is estimated that on the average, for cloud free conditions over an area of 9 million square kin, this predominantly smoke aerosol exerts a forcing of -30 W/square m C lose to the terrestrial surface and -10 W/square m at the top of the atmosphere (TOA). While cooling the surface and Earth system, the difference of 20 W/square m is energy that heats the atmosphere.

Ichoku, Charles↗

Prediction Interval Development for Wind-Tunnel Balance Check-Loading

Results from the Facility Analysis Verification and Operational Reliability project revealed a critical gap in capability in ground-based aeronautics research applications. Without a standardized process for check-loading the wind-tunnel balance or the model system, the quality of the aerodynamic force data collected varied significantly between facilities. A prediction interval is required in order to confirm a check-loading. The prediction interval provides an expected upper and lower bound on balance load prediction at a given confidence level. A method has been developed which accounts for sources of variability due to calibration and check-load application. The prediction interval method of calculation and a case study demonstrating its use is provided. Validation of the methods is demonstrated for the case study based on the probability of capture of confirmation points.

Landman, Drew↗

Sensitivity/Uncertainty Comparison Study Involving IRSN, LANL, and ORNL Tools to Support Validation [Abstract]

Under a DOE Nuclear Criticality Safety Program (NCSP) task involving Analytical Methods, three Laboratories collaborated in a comparison of results obtained from Sensitivity/Uncertainty (S/U) packages relevant to validation of transport codes. The task involves Institut de Radioprotection et de Sûreté Nucléaire (IRSN), Los Alamos National Laboratory (LANL), and Oak Ridge National Laboratory (ORNL) comparing results of MORET 5/MACSENS V3.0, MCNP6.2/Whisper-1.1, and SCALE 6.2.3/TSUNAMI/USLSTATS respectively. All Monte Carlo transport code results utilize nuclear data from ENDF/B-VII.1 evaluation.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Electrohydraulic Forming of Near-Net Shape Automotive Panels

The objective of this project was to develop the electrohydraulic forming (EHF) process as a near-net shape automotive panel manufacturing technology that simultaneously reduces the energy embedded in vehicles and the energy consumed while producing automotive structures. Pulsed pressure is created via a shockwave generated by the discharge of high voltage capacitors through a pair of electrodes in a liquid-filled chamber. The shockwave in the liquid initiated by the expansion of the plasma channel formed between two electrodes propagates towards the blank and causes the blank to be deformed into a one-sided die cavity. The numerical model of the EHF process was validated experimentally and was successfully applied to the design of the electrode system and to a multi-electrode EHF chamber for full scale validation of the process. The numerical model was able to predict stresses in the dies during pulsed forming and was validated by the experimental study of the die insert failure mode for corner filling operations. The electrohydraulic forming process and its major subsystems, including durable electrodes, an EHF chamber, a water/air management system, a pulse generator and integrated process controls, were validated to be capable to operate in a fully automated, computer controlled mode for forming of a portion of a full-scale sheet metal component in laboratory conditions. Additionally, the novel processes of electrohydraulic trimming and electrohydraulic calibration were demonstrated at a reduced-scale component level. Furthermore, a hybrid process combining conventional stamping with EHF was demonstrated as a laboratory process for a full-scale automotive panel formed out of AHSS material. The economic feasibility of the developed EHF processes was defined by developing a cost model of the EHF process in comparison to the conventional stamping process.

36 MATERIALS SCIENCE↗

Computational Experiment Design for Operations Model Simulation

Computer simulations that demonstrate the value of novel approaches are crucial to developing more flexible and robust power systems operations with high penetrations of renewable energy at multiple geographic and temporal scales. However, optimization-based simulations that depend on forecast data often face challenges in evaluating performance, reproducing results, and testing under realistic simulation scenarios. In this paper, we develop scientific computing best-practices for the validation and reproduction of power systems operational models. We then employ two case studies to demonstrate the proposed validation and reproduction framework.

MATHEMATICS AND COMPUTING,POWER TRANSMISSION AND D↗

Simulation of Internal Combustion Engines with High-Performance Computing Tools

Traditional Lagrangian spray modeling approaches for internal combustion engines are highly griddependent due to insufficient resolution in the near nozzle region. This is primarily because of inherent restrictions of volume fraction with the Lagrangian assumption together with high computational costs associated with small grid sizes. A state-of-the-art grid-convergent spray modeling approach was developed and implemented by Senecal et al. (ASME-ICEF2012-92043) in the CONVERGE software. The key features of the methodology include Adaptive Mesh Refinement (AMR), advanced liquid-gas momentum coupling, and improved distribution of the liquid phase, which enables use of cell sizes smaller than the nozzle diameter. This modeling approach was rigorously validated against nonevaporating, evaporating, and reacting data from the literature. The current numerical study focusses on further demonstration of the grid-convergent modeling approach for simulating a single-cylinder Cat® compression ignition engine. The simulated injector is characterized with a nominal nozzle exit diameter of 259 μm. Simulations using various minimum grid sizes (ranging from 125 μm to 1000 μm) are compared for engine performance and emissions parameters of interest such as pressure, heat release rate, ignition delay, NOx, HC, and soot emissions. The peak cell-count for the highest resolution simulation was on the order of 34 million. These computationally expensive simulations were facilitated at a high-performance computing facility at Argonne National Laboratory. METIS load-balancing algorithm was developed and implemented in Converge code for the simulations. Scaling studies were also performed. The validity of previously recommended grid settings (ASME-ICEF2012-92043) for accuracy/runtime trade-off is further assessed. Efficacy of a simplified combustion model is also compared against a detailed chemical kinetics based combustion model.

33 ADVANCED PROPULSION SYSTEMS↗

Progress on Understanding Rayleigh–Taylor Flow and Mixing Using Synergy Between Simulation, Modeling, and Experiment

Simultaneous advances in numerical methods and computing, theoretical techniques, and experimental diagnostics have all led independently to better understanding of Rayleigh–Taylor (RT) instability, turbulence, and mixing. In particular, experiments have provided significant motivation for many simulation and modeling studies, as well as validation data. Numerical simulations have also provided data that is not currently measurable or very difficult to measure accurately in RT unstable flows. Thus, simulations have also motivated new measurements in this class of buoyancy-driven flows. This overview discusses simulation and modeling studies synergistic with experiments and examples of how experiments have motivated simulations and models of RT instability, flow, and mixing. First, a brief summary of measured experimental and calculated simulation quantities, of experimental approaches, and of issues and challenges in the simulation and modeling of RT experiments is presented. Implicit large-eddy, direct numerical, and large-eddy simulations validated using RT experimental data are then discussed. This is followed by a discussion of modeling using analytical, modal, buoyancy–drag, and turbulent transport models of RT mixing experiments. The discussion will focus on three-dimensional RT mixing arising from multimode perturbations. Finally, this focused review concludes with a perspective on future simulation, modeling, and experimental directions for further research. Research in simulation and modeling of RT unstable flows, coupled with experiments, has made significant progress over the past several decades. This overview serves as an opportunity to both discuss progress and to stimulate future research on simulation and modeling of this unique class of hydrodynamically unstable turbulent flows.

42 ENGINEERING↗

Description of a Dry Cask Simulator for Measuring Internal and External Thermal-Hydraulic Performance

The thermal performance of a commercial nuclear spent fuel dry storage cask is evaluated through detailed analytical modeling. These modeling efforts are performed by the vendor to demonstrate the performance as well as regulatory compliance and are independently verified by the Nuclear Regulatory Commission (NRC). The majority of commercial dry storage casks in use today are aboveground. Cooling of the assemblies located inside the sealed canister is achieved by air flowing in the bottom of the cask and exiting out the top. Carefully measured data sets generated from testing of full sized casks or smaller cask analogs are widely recognized as vital for validating design and performance models. Numerous studies have been previously conducted. Recent advances in dry storage cask designs have significantly increased the maximum thermal load allowed in a cask in part by increasing the efficiency of internal conduction pathways and by increasing the internal convection through greater canister helium pressure. These vertical, canistered cask systems rely on ventilation between the canister and the overpack to convect heat away from the canister to the environment for both above and belowground configurations. While several testing programs have been previously conducted, these earlier validation attempts did not capture the effects of elevated helium pressures or accurately portray the external convection of aboveground and belowground canistered dry cask systems. Thus the enhanced performance of modern dry storage casks cannot be fully validated using previous studies. The purpose of the investigation described in this report is to produce data sets for the validation of assumptions associated with the thermal-hydraulic simulation of modern dry cask storage systems. Of particular interest are the steady-state cladding temperatures and the effect of elevated helium pressures in sealed canisters in both above and belowground designs. An existing electrically heated but otherwise prototypic BWR Incoloy-clad test assembly will be deployed inside of a representative storage basket and cylindrical pressure vessel that will represent the canister. The arrangement of a single assembly with well-controlled boundary conditions should simplify interpretation of results. Various arrangements of outer concentric ducting will be used to mimic conditions for above and belowground storage configurations of vertical, dry cask systems with canisters. Radial and axial temperature profiles will be measured for a wide range of decay power and helium cask pressures. As of this writing, the apparatus is currently under construction at Sandia National Laboratories in Albuquerque, NM and is expected to be operational starting in April 2016. Pre-test CFD calculations have been performed using best available information. These calculations are being used to assist in test design but will need to be validated and potentially reevaluated. The planned testing will be adjusted to reflect as-built conditions and measured system limitations. Dimensional analyses indicate that the anticipated ranges of relevant dimensionless groups (Reynolds, Modified Rayleigh, and Nusselt numbers) bracket or closely approach prototypic values for both the aboveground and belowground configurations. While designed to match prototypic values, the expected test matrix will include values that exceed currently acceptable values for decay heat, internal helium pressure, and peak cladding temperatures in order to gain more insight into the underlying behavior of the system. (authors)

42 ENGINEERING↗

Estimation of cardiac reserve by peak power: validation and initial application of a simplified index

OBJECTIVES: To validate a simplified estimate of peak power (SPP) against true (invasively measured) peak instantaneous power (TPP), to assess the feasibility of measuring SPP during exercise and to correlate this with functional capacity. DESIGN: Development of a simplified method of measurement and observational study. SETTING: Tertiary referral centre for cardiothoracic disease. SUBJECTS: For validation of SPP with TPP, seven normal dogs and four dogs with dilated cardiomyopathy were studied. To assess feasibility and clinical significance in humans, 40 subjects were studied (26 patients; 14 normal controls). METHODS: In the animal validation study, TPP was derived from ascending aortic pressure and flow probe, and from Doppler measurements of flow. SPP, calculated using the different flow measures, was compared with peak instantaneous power under different loading conditions. For the assessment in humans, SPP was measured at rest and during maximum exercise. Peak aortic flow was measured with transthoracic continuous wave Doppler, and systolic and diastolic blood pressures were derived from brachial sphygmomanometry. The difference between exercise and rest simplified peak power (Delta SPP) was compared with maximum oxygen uptake (VO(2)max), measured from expired gas analysis. RESULTS: SPP estimates using peak flow measures correlated well with true peak instantaneous power (r = 0.89 to 0.97), despite marked changes in systemic pressure and flow induced by manipulation of loading conditions. In the human study, VO(2)max correlated with Delta SPP (r = 0.78) better than Delta ejection fraction (r = 0.18) and Delta rate-pressure product (r = 0.59). CONCLUSIONS: The simple product of mean arterial pressure and peak aortic flow (simplified peak power, SPP) correlates with peak instantaneous power over a range of loading conditions in dogs. In humans, it can be estimated during exercise echocardiography, and correlates with maximum oxygen uptake better than ejection fraction or rate-pressure product.

Non-NASA Center↗

EMPIRICAL VALIDATION OF MULTI-ZONE BUILDING AND HVAC SYSTEM MODELS UNDER UNCERTAINTY

This study implemented a framework of empirical validation of building energy models under uncertainty to a set of controlled experiments that aim to validate multi-zone building and HVAC system models. Energy models were created through iterative acquisitions of information and data and uses measurement data from various types of sensors as both inputs and as observations to validate predictions. Experimental and modeling uncertainties were quantified and propagated accordingly, and probabilistic accuracy metrics were used to evaluate the agreement between model predictions and observations under uncertainty. Sensitivity analysis was performed to identify the most influential uncertainties that will be prioritized to be addressed in the next steps. Current results of two cooling tests show an overall good agreement between predictions and observations on a set of HVAC system outputs despite considerable and influential uncertainty in DX cooling coil COP. Agreements on zone-level responses vary notably among individual rooms, likely because of significant uncertainties in room radiation heat gain and system supply air.

Li, Qi↗