Search NASA⌕ Search

SEARCH · Search NASA

Results for “validation studies”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16

National Transport Code Collaboration PTRANSP (Final Report)

PTRANSP, which is the predictive version of the TRANSP code, was developed in a collaborative effort involving the Princeton Plasma Physics Laboratory, General Atomics Corporation, Lawrence Livermore National Laboratory, and Lehigh University. The PTRANSP/TRANSP suite of codes is the premier integrated tokamak modeling software in the United States. A production service for PTRANSP/TRANSP simulations is maintained at the Princeton Plasma Physics Laboratory; the server has a simple command line client interface and is subscribed to by about 100 researchers from tokamak projects in the US, Europe, and Asia. This service produced nearly 13000 PTRANSP/TRANSP simulations in the four year period FY 2005 through FY 2008. Major archives of TRANSP results are maintained at PPPL, MIT, General Atomics, and JET. Recent utilization, counting experimental analysis simulations as well as predictive simulations, more than doubled from slightly over 2000 simulations per year in FY 2005 and FY 2006 to over 4300 simulations per year in FY 2007 and FY 2008. PTRANSP predictive simulations applied to ITER increased eight fold from 30 simulations per year in FY 2005 and FY 2006 to 240 simulations per year in FY 2007 and FY 2008, accounting for more than half of combined PTRANSP/TRANSP service CPU resource utilization in FY 2008. PTRANSP studies focused on ITER played a key role in journal articles. Examples of validation studies carried out for momentum transport in PTRANSP simulations were presented at the 2008 IAEA conference. The increase in number of PTRANSP simulations has continued (more than 7000 TRANSP/PTRANSP simulations in 2010) and results of PTRANSP simulations appear in conference proceedings, for example the 2010 IAEA conference, and in peer reviewed papers. PTRANSP provides a bridge to the Fusion Simulation Program (FSP) and to the future of integrated modeling. Through years of widespread usage, each of the many parts of the PTRANSP suite of codes has been thoroughly validated against experimental data and benchmarked against other codes. At the same time, architectural modernizations are improving the modularity of the PTRANSP code base. The NUBEAM neutral beam and fusion products fast ion model, the Plasma State data repository (developed originally in the SWIM SciDAC project and adapted for use in PTRANSP), and other components are already shared with the SWIM, FACETS, and CPES SciDAC FSP prototype projects. Thus, the PTRANSP code is already serving as a bridge between our present integrated modeling capability and future capability. As the Fusion Simulation Program builds toward the facility currently available in the PTRANSP suite of codes, early versions of the FSP core plasma model will need to be benchmarked against the PTRANSP simulations. This will be necessary to build user confidence in FSP, but this benchmarking can only be done if PTRANSP itself is maintained and developed.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Towards application of a neutron cross-section uncertainty propagation capability in the criticality safety methodology - 14434

At the Paul Scherrer Institute (PSI) the methodology for criticality safety evaluations (CSE) used for Swiss applications is focused, following common practice, on establishing an upper subcriticality limit (USL) for the effective neutron multiplication factor (k{sub eff}), based on a statistical evaluation of the obtained validation results in terms of the calculated-to-benchmark k{sub eff} values. Recently, a new computational tool referred to as NUSS (Nuclear data Uncertainty Stochastic Sampling) was developed in order to propagate neutron-nuclear data (ND) uncertainties in calculations with Monte Carlo transport codes in combination with general-purpose ND libraries in ACE format. Thereby, this tool should now allow for a quantification of ND data uncertainties in CSE and to introduce these into the CSE criteria definition. This paper concerns an application of the NUSS methodology for criticality validation studies. Calculated k{sub eff} uncertainty estimations were obtained for the current PSI validation suite including in total 149 critical benchmark configurations for which in-house MCNP(X) models were developed, covering both uranium and mixed uranium-plutonium oxide fuels. The MCNPX-2.7.0 code was used together with the ENDF/B-VII.1 ND library while the ND variance-covariance matrixes (VCM) were taken from both SCALE-6.0 44-group libraries and also from ENDF/B-VII.1 files. Based on the newly obtained information on the uncertainties, a re-assessment of the lower tolerance bound (LTB) for k{sub eff} using the total uncertainties as weighting factors is proposed as means for the present PSI CSE methodology upgrade and some possible directions of further methodology enhancements are discussed next. (authors)

42 ENGINEERING↗

First-In-Human Validation of CT-Based Proton Range Prediction Using Prompt Gamma Imaging in Prostate Cancer Treatments

Uncertainty in computed tomography (CT)-based range prediction substantially impairs the accuracy of proton therapy. Direct determination of the stopping-power ratio (SPR) from dual-energy CT (DECT) has been proposed (DirectSPR), and initial validation studies in phantoms and biological tissues have proven a high accuracy. However, a thorough validation of range prediction in patients has not yet been achieved by any means. Here, we present the first systematic validation of CT-based proton range prediction in patients using prompt gamma imaging (PGI).

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Experimental study of adaptive pointing and tracking for large flexible space structures

This paper describes an experimental study of adaptive pointing and tracking control for flexible spacecraft conducted on a complex ground experiment facility. The algorithm used in this study is based on a multivariable direct model reference adaptive control law. Several experimental validation studies were performed earlier using this algorithm for vibration damping and robust regulation, with excellent results. The current work extends previous studies by addressing the pointing and tracking problem. As is consistent with an adaptive control framework, the plant is assumed to be poorly known to the extent that only system level knowledge of its dynamics is available. Explicit bounds on the steady-state pointing error are derived as functions of the adaptive controller design parameters. It is shown that good tracking performance can be achieved in an experimental setting by adjusting adaptive controller design weightings according to the guidelines indicated by the analytical expressions for the error.

Boussalis, D.↗

Benchmark Shock Tube Experiments for Radiative Heating Relevant to Earth Re-Entry

Detailed spectrally and spatially resolved radiance has been measured in the Electric Arc Shock Tube (EAST) facility for conditions relevant to high speed entry into a variety of atmospheres, including Earth, Venus, Titan, Mars and the Outer Planets. The tests that measured radiation relevant for Earth re-entry are the focus of this work and are taken from campaigns 47, 50, 52 and 57. These tests covered conditions from 8 km/s to 15.5 km/s at initial pressures ranging from 0.05 Torr to 1 Torr, of which shots at 0.1 and 0.2 Torr are analyzed in this paper. These conditions cover a range of points of interest for potential fight missions, including return from Low Earth Orbit, the Moon and Mars. The large volume of testing available from EAST is useful for statistical analysis of radiation data, but is problematic for identifying representative experiments for performing detailed analysis. Therefore, the intent of this paper is to select a subset of benchmark test data that can be considered for further detailed study. These benchmark shots are intended to provide more accessible data sets for future code validation studies and facility-to-facility comparisons. The shots that have been selected as benchmark data are the ones in closest agreement to a line of best fit through all of the EAST results, whilst also showing the best experimental characteristics, such as test time and convergence to equilibrium. The EAST data are presented in different formats for analysis. These data include the spectral radiance at equilibrium, the spatial dependence of radiance over defined wavelength ranges and the mean non-equilibrium spectral radiance (so-called 'spectral non-equilibrium metric'). All the information needed to simulate each experimental trace, including free-stream conditions, shock time of arrival (i.e. x-t) relation, and the spectral and spatial resolution functions, are provided.

Shock Tube↗

Lake Charles CCS Project (Final Technical Report, Phase 2)

In late September 2014 development of the Lake Charles Clean Energy (LCCE) Plant was abandoned resulting in termination of Lake Charles Carbon Capture and Sequestration (CCS) Project which was a subset the LCCE Plant. As a result, the project was only funded through Phase 2A (Design) and did not enter Phase 2B (Construction) or Phase 2C (Operations). This report was prepared relying on information prepared and provided by engineering companies which were engaged by Leucadia Energy, LLC to prepare or review Front End Engineering and Design (FEED) for the Lake Charles Clean Energy Project, which includes the Carbon Capture and Sequestration (CCS) Project in Lake Charles, Louisiana. The Lake Charles Carbon Capture and Sequestration (CCS) Project was to be a large-scale industrial CCS project intended to demonstrate advanced technologies that capture and sequester carbon dioxide (CO 2 ) emissions from industrial sources into underground formations. The Scope of work was divided into two discrete sections; 1) Capture and Compression prepared by the Recipient Leucadia Energy, LLC, and 2) Transport and Sequestration prepared by sub-Recipient Denbury Onshore, LLC. Capture and Compression-The Lake Charles CCS Project Final Technical Report describes the systems and equipment that would be necessary to capture CO 2 generated in a large industrial gasification process and sequester the CO 2 into underground formations. The purpose of each system is defined along with a description of its equipment and operation. Criteria for selection of major equipment are provided and ancillary utilities necessary for safe and reliable operation in compliance with environmental regulations are described. Construction considerations are described including a general arrangement of the CCS process units within the overall gasification project. A cost estimate is provided, delineated by system area with cost breakdown showing equipment, piping and materials, construction labor, engineering, and other costs. The CCS Project Final Technical Report is based on a Front End Engineering and Design (FEED) study prepared by SK E&C, completed in [June] 2014. Subsequently, Fluor Enterprises completed a FEED validation study in mid-September 2014. The design analyses indicated that the FEED package was sufficient and as expected. However, Fluor considered the construction risk based on a stick-build approach to be unacceptable, but construction risk would be substantially mitigated through utilization of modular construction where site labor and schedule uncertainty is minimized. Fluor’s estimate of the overall EPC project cost utilizing the revised construction plan was comparable to SKE&C’s value after reflecting Fluor’s assessment of project scope and risk characteristic. Development was halted upon conclusion of Phase 2A FEED and the project was not constructed.Transport and Sequestration – The overall objective of the pipeline project was to construct a pipeline to transport captured CO 2 from the Lake Charles Clean Energy project to the existing Denbury Green Line and then to the Hastings Field in Southeast Texas to demonstrate effective geologic sequestration of captured CO 2 through commercial EOR operations. The overall objective of the MVA portion of the project was to demonstrate effective geologic sequestration of captured CO 2 through commercial Enhanced Oil Recovery (EOR) operations in order to evaluate costs, operational processes and technical performance. The DOE target for the project was to capture and implement a research MVA program to demonstrate the sequestration through EOR of approximately one million tons of CO 2 per year as an integral component of commercial operations.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Validation of RU-WRF, the Custom Atmospheric Mesoscale Model of the Rutgers Center for Ocean Observing Leadership

The Rutgers University Center for Ocean Observing Leadership (RU-COOL) contracted the National Renewable Energy Laboratory (NREL) to evaluate RU-COOL's atmospheric observation and modeling capabilities for characterizing the New Jersey offshore wind resource. The observational network used by RU-COOL consists of mostly public but some private coastal and offshore buoy-based stations. The core wind resource modeling capability of RU-COOL is a custom setup of the Weather Research and Forecasting (WRF) mesoscale model, referred to in this report as RU-WRF. The most unique feature of RU-WRF and not found in other WRF model setups is the use of custom sea surface temperature (SST) product generated by RU-COOL. This custom product was designed to better capture the unique coastal upwelling and strong storm mixing in the Mid-Atlantic Bight, which other typical SST products are not designed to capture. Funding for the development, maintenance, and use of RU-WRF by RU-COOL is provided by the New Jersey Board of Public Utilities, who also funded the validation work presented in this report. In this validation study, NREL was specifically tasked to: 1) Assess the observational network used by RU-COOL to validate RU-WRF and make recommendations for improvement, 2) Assess methods used by RU-COOL to validate RU-WRF and make recommendations for improvement, 3) Examine the inputs to and setup within RU-WRF, compare against available NREL data sets, and make recommendations for improvement.

17 WIND ENERGY↗

Bias Characterization, Vertical Interpolation, and Horizontal Interpolation for Distributed Wind Siting Using Mesoscale Wind Resource Estimates

Much like their counterparts in utility-scale wind energy, developers of industrial, small-scale and distributed wind turbine deployments need to understand and accurately characterize the wind resource to properly assess the power generation and financial ramifications during siting and planning. National Renewable Energy Laboratory’s WIND (Wind Integration National Dataset) Toolkit (WTK) provides a best-in-class wind resource dataset generated using the Weather Research and Forecasting (WRF) model. This dataset includes parameters such as the wind speed, wind direction, and temperature at various heights, plus atmospheric stability near the surface. This data is available at 2-km spatial resolution and five-minute temporal resolution across 7 years, from 2007 to 2013 through a publicly accessible API interface. The Tools Assessing Performance (TAP) project seeks to extend this dataset to allow long term resource estimates and leverage it to better equip distributed wind equipment manufacturers, owner-operators, and installation professionals with better tools for practical siting applications. In this report, we present the results from our investigation within the TAP project focused on characterization of bias in WTK-based wind speed estimates and evaluation of vertical and horizontal interpolation techniques. We discuss the tradeoffs between different techniques and their combinations, as well as describe the lower bounds we determine for the studied validation errors. While the specific estimates we present are specific to WTK and the validation dataset we have chosen for this investigation (NREL's Wind Resource Meteorological Database), the overall analysis and the studied techniques are general enough to be applied to a broader set of wind datasets, both simulation-based and observational.

17 WIND ENERGY↗

Bayesian model aggregation for ensemble-based estimates of protein pKa values

This paper investigates an ensemble-based technique called Bayesian Model Averaging (BMA) to improve the performance of protein amino acid p$K_a$ predictions. Structure-based p$K_a$ calculations play an important role in the mechanistic interpretation of protein structure and are also used to determine a wide range of protein properties. A diverse set of methods currently exist for p$K_a$ prediction, ranging from empirical statistical models to {\it ab initio} quantum mechanical approaches. However, each of these methods are based on a set of assumptions that have inherent bias and sensitivities that can effect a model's accuracy and generalizability for p$K_a$ prediction in complicated biomolecular systems. We use BMA to combine eleven diverse prediction methods that each estimate pKa values of amino acids in staphylococcal nuclease. These methods are based on work conducted for the pKa Cooperative and the pKa measurements are based on experimental work conducted by the Garc{\'i}a-Moreno lab. Our study demonstrates that the aggregated estimate obtained from BMA outperforms all individual prediction methods in our cross-validation study with improvements from 40-70\% over other method classes. This work illustrates a new possible mechanism for improving the accuracy of p$K_a$ prediction and lays the foundation for future work on aggregate models that balance computational cost with prediction accuracy.

electrostatics↗

A Corrected Score Function Framework for Modelling Circadian Gene Expression

Many biological processes display oscillatory behaviour based on an approximately 24 h internal timing system specific to each individual. One process of particular interest is gene expression, for which several circadian transcriptomic studies have identified associations between gene expression during a 24 h period and an individual's health. A challenge with analysing data from these studies is that each individual's internal timing system is offset relative to the 24 h day-night cycle, where day–night cycle time is recorded for each collected sample. Laboratory procedures can accurately determine each individual's offset and determine the internal time of sample collection. However, these laboratory procedures are labour-intensive and expensive. Here, in this paper, we propose a corrected score function framework to obtain a regression model of gene expression given internal time when the offset of each individual is too burdensome to determine. A feature of this framework is that it does not require the probability distribution generating offsets to be symmetric with a mean of zero. Simulation studies validate the use of this corrected score function framework for cosinor regression, which is prevalent in circadian transcriptomic studies. Illustrations with data from three circadian transcriptomic studies further demonstrate that the proposed framework consistently mitigates bias relative to using a score function that does not account for this offset.

59 BASIC BIOLOGICAL SCIENCES↗

Application of queueing models to multiprogrammed computer systems operating in a time-critical environment

A model of a central processor (CPU) which services background applications in the presence of time critical activity is presented. The CPU is viewed as an M/M/1 queueing system subject to periodic interrupts by deterministic, time critical process. The Laplace transform of the distribution of service times for the background applications is developed. The use of state of the art queueing models for studying the background processing capability of time critical computer systems is discussed and the results of a model validation study which support this application of queueing models are presented.

Eckhardt, D. E., Jr.↗

WEC-Sim Array Development and Experimental Comparison Study: Preprint

Wave energy is still considered to be an emerging industry, and one significant contribution that researchers are making is to find solutions that reduce costs. The National Renewable Energy Laboratory and Sandia National Laboratories have contributed to this by creating WEC-Sim, an opensource modeling toolbox, to assist with early design decisions related to the design of wave energy converters (WECs). Previously, studies involving WEC-Sim have focused on single WEC modeling. In this paper, we will conduct a validation study to investigate the accuracy and ability of WEC-Sim to model arrays of WECs. The results from the WEC-Sim array simulations are compared to those from an existing experimental study. In addition, the array model is used to investigate the interaction between the WECs in the array and the influence of array spacing on the WECs' hydrodynamic performance.

16 TIDAL AND WAVE POWER↗

GPM DPR Retrievals: Algorithm, Evaluation, and Validation

The primary goal of the Dual-frequency Precipitation Radar (DPR) aboard the Global Precipitation Measurement (GPM) core satellite is to infer precipitationrate and raindrop/particle size distributions (DSD/PSD). The focus of this paper is threefold: 1)description of the DPR retrieval algorithm that uses an adjustable relationship between rainrate (R) and the mass-weighted diameter (Dm) or an R-Dm relationship in solving for R and Dmsimultaneously; 2) evaluation of the DPR algorithm based on the physical simulationsthat employ measured DSD/PSD to understand the mechanism and errorcharacteristics of the retrieval method; 3) review of ground validation studies for theDPR product as well as analysis of the strengths and weaknesses of the ground radarand rain gauge/disdrometer validations. Overall, the DPR Version-6 algorithmprovides reasonably accurate estimates of R and Dm in rain. Non-uniformity in therain profile, however, tends to degrade the accuracy of the R and Dm estimates tosome extent as the range-independent assumption of the adjustable parameter () ofthe R-Dm relation is not able to fully account for natural variation of DSD in the verticalprofile. Underestimation of the DPR snow rate is found when compared with theindependent dual-frequency ratio (DFR) technique. This is possibly the result of theconstraint associated with the path integral attenuation (PIA)/differential PIA (dPIA)used in the DPR algorithm to find the best  and range-independent  assumption. Arange-variable  model, proposed in the DPR Version-7 algorithm, is expected toimprove rain and snow retrieval.

Liang Liao↗

Feature extraction for structural dynamics model validation

This study focuses on defining and comparing response features that can be used for structural dynamics model validation studies. Features extracted from dynamic responses obtained analytically or experimentally, such as basic signal statistics, frequency spectra, and estimated time-series models, can be used to compare characteristics of structural system dynamics. By comparing those response features extracted from experimental data and numerical outputs, validation and uncertainty quantification of numerical model containing uncertain parameters can be realized. In this study, the applicability of some response features to model validation is first discussed using measured data from a simple test-bed structure and the associated numerical simulations of these experiments. issues that must be considered were sensitivity, dimensionality, type of response, and presence or absence of measurement noise in the response. Furthermore, we illustrate a comparison method of multivariate feature vectors for statistical model validation. Results show that the outlier detection technique using the Mahalanobis distance metric can be used as an effective and quantifiable technique for selecting appropriate model parameters. However, in this process, one must not only consider the sensitivity of the features being used, but also correlation of the parameters being compared.

42 ENGINEERING↗

Comparison of C5 and C6 Aqua-MODIS Dark Target Aerosol Validation

We compare C5 and C6 validation to compare the C6 10 km aerosol product against the well validated and trusted aerosol product on global and regional scales. Only the 10 km aerosol product is evaluated in this study, validation of the new C6 3 km aerosol product still needs to be performed. Not all of the time series has processed yet for C5 or C6, and the years processed for the 2 products is not exactly the same (this work is preliminary!). To reduce the impact of outlier observations, MODIS is spatially averaged within 27.5 km of the AERONET site, and AERONET is temporatally averaged within 30 minutes of the MODIS overpass time. Only high quality (QA = 3 over land, QA greater than 0 over ocean) pixels are included in the mean.

MODIS↗

Characterizing diurnal and seasonal cycles in monsoon systems from TRMM and CEOP observations

The CEOP Inter-Monsoon Study (CIMS) is one of the two main science drivers of CEOP that aims to (a) provide better understanding of fundamental physical processes in monsoon regions around the world, and (b) demonstrate the synergy and utility of CEOP data in providing a pathway for model physics evaluation and improvement. As the data collection phase for EOP-3 and EOP-4 is being completed, two full annual cycles (2003-2004) of research-quality data sets from satellites, reference sites, and model output location time series (MOLTS) have been processed and made available for data analyses and model validation studies. This article presents preliminary results of a CIMS study aimed at the characterization and intercomparison of all major monsoon systems. The CEOP reference site data proved its value in such exercises by being a powerful tool to cross-validate the TRMM data, and to intercompare with multi-model results in ongoing work. We use 6 years (1998-2003) of pentad CEOP/TRMM data with 2deg x 2.5deg latitude-longitude grid, over the domain of interests to define the monsoon climatological diurnal and annual cycles for the East Asian Monsoon (EAM), the South Asian Monsoon (SAM), the West Africa Monsoon (WAM), the North America/Mexican Monsoon (NAM), the South American Summer Monsoon (SASM) and the Australian Monsoon (AUM). As noted, the TRMM data used in the study were cross-validated using CEOP reference site data, where applicable. Results show that the observed diurnal cycle of rain peaked around late afternoon over monsoon land, and early morning over the oceans. The diurnal cycles in models tend to peak 2-3 hours earlier than observed. The seasonal cycles of the EAM and SAM show the strongest continentality, i.e, strong control by continental processes away from the ITCZ. The WAM, and the AUM shows the less continentality, i.e, strong control by the oceanic ITCZ.

Lau, William K. M.↗

Characterizing Diurnal and Seasonal Cycles in Monsoon Systems from TRMM and CEOP Observations

The CEOP Inter-Monsoon Study (CIMS) is one of the two main science drivers of CEOP that aims to (a) provide better understanding of fundamental physical processes in monsoon regions around the world, and (b) demonstrate the synergy and utility of CEOP data in providing a pathway for model physics evaluation and improvement. As the data collection phase for EOP-3 and EOP-4 is being completed, two full annual cycles (2003-2004) of research-quality data sets from satellites, reference sites, and model output location time series (MOLTS) have been processed and made available for data analyses and model validation studies. This article presents preliminary results of a CIMS study aimed at the characterization and intercomparison of all major monsoon systems. The CEOP reference site data proved its value in such exercises by being a powerful tool to cross-validate the TRMM data, and to intercompare with multi-model results in ongoing work. We use 6 years (1998-2003) of pentad CEOP/TRMM data with 2 deg x 2.5 deg. latitude-longitude grid, over the domain of interests to define the monsoon climatological diurnal and annual cycles for the East Asian Monsoon (EAM), the South Asian Monsoon (SAM), the West Africa Monsoon (WAM), the North America/Mexican Monsoon (NAM), the South American Summer Monsoon (SASM) and the Australian Monsoon (AUM). As noted, the TRMM data used in the study were cross-validated using CEOP reference site data, where applicable. Results show that the observed diurnal cycle of rain peaked around late afternoon over monsoon land, and early morning over the oceans. The diurnal cycles in models tend to peak 2-3 hours earlier than observed. The seasonal cycles of the EAM and SAM show the strongest continentality, i.e, strong control by continental processes away from the ITCZ. The WAM, and the AUM shows the less continentality, i.e, strong control by the oceanic ITCZ.

Lau, William K. M.↗

Anion exchange membrane test protocol validation

This study presents the validation of protocols for measuring ion exchange capacity (IEC) and alkaline stability of anion exchange membranes (AEMs) for low-temperature water electrolysis. While protocols are often tested within individual laboratories, their results across multiple laboratories with varying equipment, environmental conditions, and personnel qualification remain unverified. The validation involved Los Alamos National Laboratory (LANL), National Renewable Energy Laboratory (NREL), and University of Oregon (UO) using the same commercially available AEM to assess reproducibility and reliability of the protocols under diverse conditions. For the IEC protocol, results across laboratories were consistent within ±10% of the NMR-determined reference value. The alkaline stability protocol could pose greater challenges due to factors such as variations in sample collection timing, preservation methods, and analytical techniques, but consistent test results for percentage IEC loss were demonstrated across institutions. These results highlight the reliability and applicability of the protocols, emphasizing the importance of validation to ensure consistency in diverse research environments.

08 HYDROGEN↗