Search NASA⌕ Search

SEARCH · Search NASA

Results for “validation studies”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,117 records · Page 62

An Integrated Social, Economic, and Ecologic Conceptual (ISEEC) Framework for Considering Rangeland Sustainability

Currently, there is no standard method to assess the complex systems in rangeland ecosystems. Decision makers need baselines to create a common language of current rangeland conditions and standards for continued rangeland assessment. The Sustainable Rangeland Roundtable (SRR), a group of private and public organizations and agencies, has created a forum to discuss rangeland sustainability and assessment. The SRR has worked to integrate social, economic, and ecological disciplines related to rangelands and has identified a standard set of indicators that can be used to assess rangeland sustainability. As part of this process, SRR has developed a two-tiered conceptual framework from a systems perspective to study the validity of indicators and the relationships among them. The first tier categorizes rangeland characteristics into four states. The second tier defines processes affecting these states through time and space. The framework clearly shows that the processes affect and are affected by each other.

54 ENVIRONMENTAL SCIENCES↗

Statistical Validation of Multiple Related Data Sets—Case Study Using Interstellar Boundary Explorer Satellite Data

Abstract Space scientists often face the question of whether data collected by different instruments are measurements of the same source population. This paper proposes a statistical validation method for evaluating the agreement between such related data sets. It offers a detailed case study focused on validating a new data set from the Interstellar Boundary Explorer (IBEX) mission, which serves as a practical how-to guide for similar analyses. Since 2008, the IBEX satellite has been gathering data on heliospheric energetic neutral atoms (ENAs) while being exposed to various sources of background noise, such as cosmic rays and solar energetic particles. The IBEX mission initially released only a qualified triple-coincidence (qABC) data product, which was designed to provide observations of ENAs free of background contamination. Further measurements revealed that the qABC data were in fact susceptible to contamination, having relatively low ENA counts and high background rates. To mitigate this issue, the mission team recently considered releasing a certain qualified double-coincidence (qBC) data product, which has roughly twice the detection rate of the qABC data product. This paper presents a simulation-based validation of the new qBC data product against the already-released qABC data product. The results show that the qBCs can plausibly be said to be measuring the same source population as the qABCs up to an average absolute deviation of 3.6%. Visual diagnostics provide additional confirmation of source rate coherence across data products. The framework introduced here is general and can be applied to other validation problems both within and outside the field of space physics.

79 ASTRONOMY AND ASTROPHYSICS↗

Experimental validation of solid oxide fuel cell polarization modeling: An LSM-YSZ/YSZ/Ni-YSZ case study

Polarization modeling based on the measured I-V curves is a useful tool for analyzing SOFC performance and diagnosing performance limitations. Using the polarization model, the overpotential of a cell is usually separated into different polarization contributions, including area specific ohmic polarization, activation polarization, and anodic and cathodic concentration polarizations. In this study, we aim to experimentally validate the accuracy of the polarization model. As a case study, anode-supported cells with LSM-YSZ/YSZ/Ni-YSZ configuration are used. By curve-fitting the I-V curves of a cell tested under different cathode oxygen partial pressures into the polarization model, the contributions of different polarization losses are quantified. To validate the polarization model, independent experiments/studies including electrochemical impedance spectroscopy, cathode kinetics study, ex-situ diffusivity measurement, and tortuosity measurement using 3D reconstructed anode are conducted. The results from polarization modeling and from validation studies are in good agreement, thereby validating the polarization model for SOFC performance analysis.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Correction for FDG PET dose extravasations: Monte Carlo validation and quantitative evaluation of patient studies

Purpose: Current procedure guidelines for whole body [18F]fluoro-2-deoxy-D-glucose (FDG)-positron emission tomography (PET) state that studies with visible dose extravasations should be rejected for quantification protocols. Our work is focused on the development and validation of methods for estimating extravasated doses in order to correct standard uptake value (SUV) values for this effect in clinical routine. Methods: One thousand three hundred sixty-seven consecutive whole body FDG-PET studies were visually inspected looking for extravasation cases. Two methods for estimating the extravasated dose were proposed and validated in different scenarios using Monte Carlo simulations. All visible extravasations were retrospectively evaluated using a manual ROI based method. In addition, the 50 patients with higher extravasated doses were also evaluated using a threshold-based method. Results: Simulation studies showed that the proposed methods for estimating extravasated doses allow us to compensate the impact of extravasations on SUV values with an error below 5%. The quantitative evaluation of patient studies revealed that paravenous injection is a relatively frequent effect (18%) with a small fraction of patients presenting considerable extravasations ranging from 1% to a maximum of 22% of the injected dose. A criterion based on the extravasated volume and maximum concentration was established in order to identify this fraction of patients that might be corrected for paravenous injection effect. Conclusions: The authors propose the use of a manual ROI based method for estimating the effectively administered FDG dose and then correct SUV quantification in those patients fulfilling the proposed criterion.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

A Semiautomated Framework for Integrating Expert Knowledge into Disease Marker Identification

Background. The availability of large complex data sets generated by high throughput technologies has enabled the recent proliferation of disease biomarker studies. However, a recurring problem in deriving biological information from large data sets is how to best incorporate expert knowledge into the biomarker selection process. Objective. To develop a generalizable framework that can incorporate expert knowledge into data-driven processes in a semiautomated way while providing a metric for optimization in a biomarker selection scheme. Methods. The framework was implemented as a pipeline consisting of five components for the identification of signatures from integrated clustering (ISIC). Expert knowledge was integrated into the biomarker identification process using the combination of two distinct approaches; a distance-based clustering approach and an expert knowledge-driven functional selection. Results. The utility of the developed framework ISIC was demonstrated on proteomics data from a study of chronic obstructive pulmonary disease (COPD). Biomarker candidates were identified in a mouse model using ISIC and validated in a study of a human cohort. Conclusions. Expert knowledge can be introduced into a biomarker discovery process in different ways to enhance the robustness of selected marker candidates. Developing strategies for extracting orthogonal and robust features from large data sets increases the chances of success in biomarker identification.

Biomarker Identification↗

Catalyst Residence Time Distributions in Riser Reactors for Catalytic Fast Pyrolysis. Part 2: Pilot-Scale Simulations and Operational Parameter Study

Here, wsing the validated simulation model developed in part one of this study for biomass catalytic fast pyrolysis (CFP), we assess the functional utility of using this validated model to assist in the development of CFP processes in fluidized catalytic cracking (FCC) reactors to a commercially viable state. Specifically, we examine the effects of mass flow rates, boundary conditions (BCs), pyrolysis vapor molecular weight variation, and the impact of the chemical cracking kinetics on the catalyst residence times. The factors that had the largest impact on the catalyst residence time included the feed stock molecular weight and the degree of chemical cracking as controlled by the catalyst activity. Lastly, because FCC reactors have primarily been developed and utilized for petroleum cracking, we perform a comparison analysis of CFP with petroleum and show the operating regimes are fundamentally different.

09 BIOMASS FUELS↗

A Global Evaluation of IMERG Precipitation Occurrence Using SMAP Detected Soil Moisture Change

A globally consistent ground validation method for remotely sensed precipitation products is crucial for building confidence in these products. This study develops a new methodology to validate the IMERG precipitation products through the use of SMAP soil moisture changes as a proxy for precipitation occurrence. Using a standard 2x2 contingency table method, preliminary results provide confidence in SMAP’s ability to be utilized as a validation tool for IMERG as results are comparable to previous validation studies. However, the method allows for an overestimate of false alarm frequency due to light precipitation events that can evaporate before the subsequent SMAP overpass and changes in overpass-to-overpass SMAP soil moisture that are within the range of SMAP uncertainty. To counter these issues, a 3x3 contingency table is used to reduce noise and extract more signal from the detection method. Through the use of this novel approach, the validation method produces a global mean POD of 0.64 and global mean FAR of 0.40, the first global-scale ground validation skill scores for the IMERG products. Advancing the method to validate precipitation quantity and the development of a real-time validation for the IMERG Early product are the crucial next developments.

Precipitation↗

ENTROPY VS. ENERGY WAVEFORM PROCESSING: A COMPARISON ON THE HEAT EQUATION

Virtually all modern imaging devices function by collecting either electromagnetic or acoustic backscattered waves and using the energy carried by these waves to determine pixel values that build up what is basically an ”energy” picture. However, waves also carry ”informa- tion” that also may be used to compute the pixel values in an image. We have employed several measures of information, all of which are based on different forms of entropy. Numerous published studies have demonstrated the advantages of entropy, or “information imaging”, over conventional methods for materials characterization and medical imaging. Similar results also have been obtained with microwaves. The most sensitive information measure appears to be the joint entropy of the backscattered wave and a reference signal. A typical study is comprised of repeated acquisition of backscattered waves from a specimen that is changing slowing with acquisition time or location. The sensitivity of repeated experimental observations of such a slowly changing quantity may be defined as the mean variation (i.e., observed change) divided by mean variance (i.e., observed noise). We compute the sensitivity for joint entropy and signal energy measurements assuming that noise is Gaussian and using Wiener integration to compute the required mean values and variances. These can be written as solutions to the Heat equation, which permits estimation of their magnitudes. There always exists a reference such that joint entropy has larger variation and smaller variance than the corresponding quantities for signal energy, matching observations of several studies. Moreover, a general prescription for finding an “optimal” reference for the joint entropy emerges, which also has been validated in several studies.

Entropy↗

An Experimental Study of Characteristic Combustion-Driven Flow for CFD Validation

A series of uni-element rocket injector studies were completed to provide benchmark quality data needed to validate computational fluid dynamic models. A shear coaxial injector geometry was selected as the primary injector for study using gaseous hydrogen/oxygen and gaseous hydrogen/liquid oxygen propellants. Emphasis was placed on the use of nonintrusive diagnostic techniques to characterize the flowfields inside an optically-accessible rocket chamber. Measurements of the velocity and species fields were obtained using laser velocimetry and Raman spectroscopy, respectively. Qualitative flame shape information was also obtained using laser-induced fluorescence excited from OH radicals and laser light scattering studies of aluminum oxide particle seeded combusting flows. The gaseous hydrogen/liquid oxygen propellant studies for the shear coaxial injector focused on breakup mechanisms associated with the liquid oxygen jet under subcritical pressure conditions. Laser sheet illumination techniques were used to visualize the core region of the jet and a Phase Doppler Particle Analyzer was utilized for drop velocity, size and size distribution characterization. The results of these studies indicated that the shear coaxial geometry configuration was a relatively poor injector in terms of mixing. The oxygen core was observed to extend well downstream of the injector and a significant fraction of the mixing occurred in the near nozzle region where measurements were not possible to obtain. Detailed velocity and species measurements were obtained to allow CFD model validation and this set of benchmark data represents the most comprehensive data set available to date. As an extension of the investigation, a series of gas/gas injector studies were conducted in support of the X-33 Reusable Launch Vehicle program. A Gas/Gas Injector Technology team was formed consisting of the Marshall Space Flight Center, the NASA Lewis Research Center, Rocketdyne and Penn State. Injector geometries studied under this task included shear and swirl coaxial configurations as well as an impinging jet injector.

Santoro, Robert J.↗

An Experimental Study of Characteristic Combustion-Driven Flow for CFD Validation

A series of uni-element rocket injector studies were completed to provide benchmark quality data needed to validate computational fluid dynamic models. A shear coaxial injector geometry was selected as the primary injector for study using gaseous hydrogen/oxygen and gaseous hydrogen/liquid oxygen propellants. Emphasis was placed on the use of non-intrusive diagnostic techniques to characterize the flowfields inside an optically-accessible rocket chamber. Measurements of the velocity and species fields were obtained using laser velocimetry and Raman spectroscopy, respectively Qualitative flame shape information was also obtained using laser-induced fluorescence excited from OH radicals and laser light scattering studies of aluminum oxide particle seeded combusting flows. The gaseous hydrogen/liquid oxygen propellant studies for the shear coaxial injector focused on breakup mechanisms associated with the liquid oxygen jet under sub-critical pressure conditions. Laser sheet illumination techniques were used to visualize the core region of the jet and a Phase Doppler Particle Analyzer was utilized for drop velocity, size and size distribution characterization. The results of these studies indicated that the shear coaxial geometry configuration was a relatively poor injector in terms of mixing. The oxygen core was observed to extend well downstream of the injector and a significant fraction of the mixing occurred in the near nozzle region where measurements were not possible to obtain Detailed velocity and species measurements were obtained to allow CFD model validation and this set of benchmark data represents the most comprehensive data set available to date As an extension of the investigation, a series of gas/gas injector studies were conducted in support of the X-33 Reusable Launch Vehicle program. A Gas/Gas Injector Technology team was formed consisting of the Marshall Space Flight Center, the NASA Lewis Research Center, Rocketdyne and Penn State. Injector geometries studied under this task included shear and swirl coaxial configurations as well as an impinging jet injector.

Santoro, Robert J.↗

Validation of Photovoltaic Modeling Tool Solargraf Against Measured Data

Solargraf is a cloud-based 3D design tool by Enphase Energy that allows users to design solar and storage systems with a variety of elements. Through a Cooperative Research and Development Agreement (CRADA), Enphase Energy collaborated with the National Renewable Energy Laboratory (NREL) to validate Solargraf's 3D design simulation against measured PV system performance. This study follows the same methodology of similar validation studies completed at NREL. The predicted performance results from simulations in both Solargraf and NREL's System Advisor Model (SAM) tool were compared with measured data to evaluate performance predictions.

14 SOLAR ENERGY↗

Comprehensive Analysis of Coal and Biomass Conversion to Jet Fuel: Oxygen Blown, Transport Reactor Integrated Gasifier (TRIG) and Fischer-Tropsch (F-T) Catalyst Configurations Modeled and Validated Scenarios

This study evaluates the technological/process, life cycle environmental, and economic perspective of 20 discreet F-T jet fuel production scenarios. The technological/process model provides a process level evaluation of the 10 alternate CBTL facility scenarios considered in this study. Aspen Plus simulation models for the CBTL facility scenarios were developed to determine the composition and flows of all of the major streams in the plants. These were used to develop conceptual level cost estimates for capital and operating costs for the major process units. NETL completed this study for the Connecticut Center for Advanced Technology (CCAT) to provide techno-economic and life cycle analysis modeling support for CBTL alternative jet fuel production, which forms key references to their report to the Defense Logistics Agency (their project sponsor/funder).

01 COAL, LIGNITE, AND PEAT↗

Comprehensive Analysis of Coal and Biomass Conversion to Jet Fuel: Oxygen Blown, Entrained-Flow Gasifier (EFG) and Fischer-Tropsch (F-T) Catalyst Configurations Modeled and Validated Scenarios

This study evaluates the technological/process, life cycle environmental, and economic perspective of 10 discreet F-T jet fuel production scenarios. The technological/process model provides a process level evaluation of the 10 alternate CBTL facility scenarios considered in this study. Aspen Plus simulation models for the CBTL facility scenarios were developed to determine the composition and flows of all of the major streams in the plants. These were used to develop conceptual level cost estimates for capital and operating costs for the major process units. NETL completed this study for the Connecticut Center for Advanced Technology (CCAT) to provide techno-economic and life cycle analysis modeling support for CBTL alternative jet fuel production, which forms key references to their report to the Defense Logistics Agency (their project sponsor/funder).

01 COAL, LIGNITE, AND PEAT↗

Intermountain West Wildland Fires: Mapping Tree Mortality and Burn Patches using NASA Earth Observations to Determine Fire Risk and Inform Fire Management Practices

Within the intermountain west, monitoring fuel loads is a major concern for wildland fire management efforts. To address this concern, we partnered with the U.S. Forest Service to inform the agency which forested areas should be prioritized for prescribed burning and fuel reduction near human communities in the Bridger-Teton National Forest, Wyoming. We created burn maps, fuel load maps, and a tutorial document to identify forest impact trends and provide the partner with the tools to replicate project methods for expansion to other wildfire crisis strategy sites. These end products were made using two NASA Earth observations: Landsat 8 Operational Land Imager and Shuttle Radar Topography Mission. Based on our random forest analysis, our maps identified 998 acres within the Wildland Urban Interface that are predicted to have high fuel loading and high burn severity within the Bridger-Teton National Forest. Forested areas closer to heavily populated areas such as Jackson, Kelly, Moran, New Forks Lake, and Star Valley Ranch should be prioritized for fuel reduction. However, our random forest model analysis was limited to using vegetation and topographical indices with no field data for model validation. Therefore, future studies should use field data for model validation to improve model accuracy and additionally incorporate Global Ecosystem Dynamics Investigation data into models to create better predictions of forested areas with high fuel load and high burn severity.

Remote Sensing↗

Numerical and Experimental Study of an Aircraft Igniter Plasma Jet Discharge

The spark discharge of an aircraft plasma jet igniter is studied using high-fidelity numerical simulations and X-ray radiography measurements. The target problem here features the thermal expansion of hot gas introduced by the electric spark within a confined igniter cavity, which eventually evolves into a pulsed jet of a high-temperature kernel. A comprehensive set of models adapted from existing strategies for internal combustion engine spark plug discharge is extended to the target problem, including the modeling of energy deposition, plasma reactions, thermodynamic properties, and heat losses. A series of validation and parameter studies are performed and presented. The kernel size is found to be sensitive to heat losses arising from radiation and hot gas remained within the discharge cavity, rather than heat conduction to the wall in the discharge cavity. Depending on the enforced shape of the post-breakdown electric arc, the spark kernel can be off-centered, tilted, and considerably asymmetric. These features have been previously not considered when studying such igniter configurations and may have a first-order impact on the ignition process. Provided a proper setup of the heat loss models and electric arc shape, the numerical results are quantitatively comparable to the experimental results in terms of the kernel size, shape, and velocity throughout different stages after the spark discharge.

Tang, Yihao↗

Statistical validation of event predictors: A comparative study based on the field of seizure prediction

The prediction of events is of substantial interest in many research areas. To evaluate the performance of prediction methods, the statistical validation of these methods is of utmost importance. Here, we compare an analytical validation method to numerical approaches that are based on Monte Carlo simulations. The comparison is performed in the field of the prediction of epileptic seizures. In contrast to the analytical validation method, we found that for numerical validation methods insufficient but realistic sample sizes can lead to invalid high rates of false positive conclusions. Hence we outline necessary preconditions for sound statistical tests on above chance predictions.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Fuel cycle depletion validation and code-to-code verification studies for High Flux Isotope Reactor highly and low-enriched uranium fuel designs

Here, this paper documents fuel cycle depletion validation and code-to-code verification studies for the High Flux Isotope Reactor (HFIR) highly enriched uranium (HEU) and proposed low-enriched uranium (LEU) fuel designs. In support of HFIR’s world-leading performance, transport and depletion simulations are performed to ensure safe operations, design and qualify irradiation experiments, enhance core components and irradiation facilities, and design and characterize LEU fuel designs. Identifying well-validated, computationally efficient codes is required for the success of these efforts. The HFIR Controller, Shift, and VESTA codes were deployed to simulate HEU uranium–oxide dispersion fuel cycles at 85, 95, and 100 MW operations, as well as LEU fuel cycles operating at 95 MW with uranium–silicide dispersion and uranium–molybdenum monolithic alloy fuel forms. Excellent agreement between the codes and with experimentally obtained 235 U enrichment distributions provides increased confidence in the ability of these codes to model and simulate HFIR’s unique core design.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

SU-E-J-145: Validation of An Analytical Model for in Vivo Range Verification Using GATE Monte Carlo Simulation in Proton Therapy

Purpose: Predicted PET images on the basis of analytical filtering approach for proton range verification has been successful developed and validated using FLUKA Monte Carlo (MC) codes and phantom measurements. The purpose of the study is to validate the effectiveness of analytical filtering model for proton range verification on GATE/GEANT4 Monte Carlo simulation codes. Methods: In this study, we performed two experiments for validation of predicted β+-isotope by the analytical model with GATE/GEANT4 simulations. The first experiments to evaluate the accuracy of predicting β+-yields as a function of irradiated proton energies. In second experiment, we simulate homogeneous phantoms of different materials irradiated by a mono-energetic pencil-like proton beam. The results of filtered β+-yields distributions by the analytical model is compared with those of MC simulated β+-yields in proximal and distal fall-off ranges. Results: The results investigate the distribution between filtered β+-yields and MC simulated β+-yields distribution in different conditions. First, we found that the analytical filtering can be applied over the whole range of the therapeutic energies. Second, the range difference between filtered β+-yields and MC simulated β+-yields at the distal fall-off region are within 1.5mm for all materials used. The findings validated the usefulness of analytical filtering model on range verification of proton therapy on GATE Monte Carlo simulations. In addition, there is a larger discrepancy between filtered prediction and MC simulated β+-yields using GATE code, especially in proximal region. This discrepancy might Result from the absence of wellestablished theoretical models for predicting the nuclear interactions. Conclusion: Despite the fact that large discrepancies of the distributions between MC-simulated and predicted β+-yields were observed, the study prove the effectiveness of analytical filtering model for proton range verification using GATE Monte Carlo simulation.

60 APPLIED LIFE SCIENCES↗