Search NASA⌕ Search

SEARCH · Search NASA

Results for “Model Validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 415 records · Page 23

Angular radiation temperature simulation for time-dependent capsule drive prediction in inertial confinement fusion

The x-ray drive on a capsule in an inertial confinement fusion setup is crucial for ignition. Unfortunately, a direct measurement has not been possible so far. We propose an angular radiation temperature simulation to predict the time-dependent drive on the capsule. A simple model, based on the view-factor method for the simulation of the radiation temperature, is presented and compared with the experimental data obtained using the OMEGA laser facility and the simulation results acquired with VISRAD code. We found a good agreement between the time-dependent measurements and the simulation results obtained using this model. The validated model was then used to analyze the experimental results from the Shenguang-III prototype laser facility. More specifically, the variations of the peak radiation temperatures at different view angles with the albedo of the hohlraum, the motion of the laser spots, the closure of the laser entrance holes, and the deviation of the laser power were investigated. Furthermore, the time-dependent radiation temperature at different orientations and the drive history on the capsule were calculated. The results indicate that the radiation temperature from “U20W112” (named according to the diagnostic hole ID on the target chamber) can be used to approximately predict the drive temperature on the capsule. In addition, the influence of the capsule on the peak radiation temperature is also presented.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Integrating crop growth models with remote sensing for predicting biomass yield of sorghum

Abstract Plant phenotypes are often descriptive, rather than predictive of crop performance. As a result, extensive testing is required in plant breeding programmes to develop varieties aimed at performance in the target environments. Crop models can improve this testing regime by providing a predictive framework to (i) augment field phenotyping data and derive hard-to-measure phenotypes and (ii) estimate performance across geographical regions using historical weather data. The goal of this study was to parameterize the Agricultural Production Systems sIMulator (APSIM) crop growth models with remote-sensing and ground-reference data to predict variation in phenology and yield-related traits in 18 commercial grain and biomass sorghum hybrids. Genotype parameters for each hybrid were estimated using remote-sensing measurements combined with manual phenotyping in West Lafayette, IN, in 2018. The models were validated in hybrid performance trials in two additional seasons at that site and against yield trials conducted in Bushland, TX, between 2001 and 2018. These trials demonstrated that (i) maximum plant height, final dry biomass and radiation use efficiency (RUE) of photoperiod-sensitive and -insensitive forage sorghum hybrids tended to be higher than observed in grain sorghum, (ii) photoperiod-sensitive sorghum hybrids exhibited greater biomass production in longer growing environments and (iii) the parameterized and validated models perform well in above-ground biomass simulations across years and locations. Crop growth models that integrate remote-sensing data offer an efficient approach to parameterize larger plant breeding populations.

Yang, Kai-Wei↗

TH-C-BRD-04: Beam Modeling and Validation with Triple and Double Gaussian Dose Kernel for Spot Scanning Proton Beams

Purpose: To present the validity of our beam modeling with double and triple Gaussian dose kernels for spot scanning proton beams in Nagoya Proton Therapy Center. This study investigates the conformance between the measurements and calculation results in absolute dose with two types of beam kernel. Methods: A dose kernel is one of the important input data required for the treatment planning software. The dose kernel is the 3D dose distribution of an infinitesimal pencil beam of protons in water and consists of integral depth doses and lateral distributions. We have adopted double and triple Gaussian model as lateral distribution in order to take account of the large angle scattering due to nuclear reaction by fitting simulated inwater lateral dose profile for needle proton beam at various depths. The fitted parameters were interpolated as a function of depth in water and were stored as a separate look-up table for the each beam energy. The process of beam modeling is based on the method of MDACC [X.R.Zhu 2013]. Results: From the comparison results between the absolute doses calculated by double Gaussian model and those measured at the center of SOBP, the difference is increased up to 3.5% in the high-energy region because the large angle scattering due to nuclear reaction is not sufficiently considered at intermediate depths in the double Gaussian model. In case of employing triple Gaussian dose kernels, the measured absolute dose at the center of SOBP agrees with calculation within ±1% regardless of the SOBP width and maximum range. Conclusion: We have demonstrated the beam modeling results of dose distribution employing double and triple Gaussian dose kernel. Treatment planning system with the triple Gaussian dose kernel has been successfully verified and applied to the patient treatment with a spot scanning technique in Nagoya Proton Therapy Center.

07 ISOTOPE AND RADIATION SOURCES↗

Modeling Helium Segregation to the Surfaces of Plasma-Exposed Tungsten as a Function of Temperature and Surface Orientation

We provide a description of the dependence on surface crystallographic orientation and temperature of the segregation of helium implanted with energies consistent with low-energy plasma exposure to tungsten surfaces. Here, we describe multiscale modeling results based on a hierarchical approach to scale bridging that incorporates atomistic studies based on a reliable interatomic potential to parameterize a spatially dependent drift-diffusion-reaction cluster-dynamics code. An extensive set of molecular dynamics (MD) simulations has been performed at 933 K and/or 1200 K to determine the probabilities of desorption and modified trap mutation that occurs as small, mobile Hen (1 ≤ n ≤ 7) clusters diffuse from the near-surface region toward surfaces of varying crystallographic orientation due to an elastic interaction force that provides the thermodynamic driving force for surface segregation. These near-surface cluster dynamics have significant effects on the surface morphology, the near-surface defect structures, and the amount of helium retained in the material upon plasma exposure, for which we have developed an extensive MD database of cumulative evolution during high-flux helium implantation at 933 K, which we compare to our properly parameterized cluster-dynamics model. This validated model is then used to evaluate the effects of temperature on helium retention and subsurface helium clustering.

Blondel, Sophie↗

Extraction of Vibration Data with Imaging

To date, the primary sensing technology used to measure the vibration response has been accelerometers and strain gages mounted directly to the structure and using either wired or, more recently, wireless telemetry. Cost issues with these sensors and the associated data acquisition systems typically limit the numbers that are deployed on in situ structures. Although there are a few structures with larger sensing counts that in some cases exceed over 1000 sensors, more typical numbers range from ten to one hundred sensors resulting in low spatial resolution when they are applied to physically large systems. When one considers that nuclear power plant structures usually have complex geometries, material properties, connectivity and boundary conditions, it is clear these current approaches to vibration measurements can only provide limited information about a system’s dynamics response characteristics. As an alternative, many non-contact measurement technologies have emerged, including point wise measurement methods such as Global Positioning System (GPS), microwave interferometry, and laser Doppler vibrometry (LDV), as well as simultaneous full-field measurement methods such as electronic speckle pattern interferometry, holography interferometry, and muon tomography, some of which can provide high spatial resolution measurements. Among these methods, digital video imaging techniques have emerged as a feasible solution for full-field vibration measurements that provide significantly more detailed dynamic response information because every pixel becomes a measurement point. Furthermore, recent advances in image processing and computer vision algorithms have been successfully used to process video data for experimental and operational modal analysis. Such full-field measurements have the potential to significantly improve many current structural assessment procedures including system identification (modal parameter estimation), structural health monitoring, load reconstruction, model validation, and model updating. Furthermore, more recent full-field imaging techniques can be accomplished with relatively low-cost, commercially-available off-the-shelf cameras. However, these measurement procedures have other limitations that must be considered such as the ability to only measure visibly accessible points on a structure and a more limited dynamic range and bandwidth than can be achieved with accelerometers or strain gages.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Modeling the U.S. Western Electric Interconnection to Understand the Consequences of Hydrometeorological Extremes and Options for Risk Mitigation

Electricity grid operators around the world face a dual challenge; withstanding increasingly severe weather and the longer term impacts of climate change, while simultaneously decarbonizing. Extreme weather events such as heat waves and droughts are rising in both severity and frequency, which is threatening the reliability of electricity grids through increased demand, generation capacity losses, and equipment failures. Consequently, incorporating hydrometeorological stressors into computational power systems analysis is becoming an even more critical tool in long term planning and short term operations. However, there is a general lack of open-source customizable grid simulation software capable of exhaustively stress testing the grid under hydrometeorological uncertainty, and/or examining potential risk mitigation pathways. A related, persistent challenge for power system modelers is striking an appropriate balance between model fidelity (e.g. spatial scale and time resolution) and computational tractability (wall clock run-time). In this study, we are proposing a solution to this problem with open-source software that allows users to seamlessly customize the scale and track the accuracy of grid operations models. Our approach allows users to search over numerous model parameters (network topology, mathematical formulation, economic hurdle rates, and transmission line scaling) to identify model instantiations that accommodate experimental design. Further, we use this approach to demonstrate the importance of including extreme weather events in model validation and model selection. Focusing on the occurrence of heatwaves and droughts in the U.S. Western Interconnection, we examine role of extreme events in balancing tradeoffs between model fidelity and run-time at the model design stage.

Economics↗

Application of PCM Validation to BFBT Experiments

In support of model validation, this summary applies a recently proposed methodology, denoted hereinafter by physics-guided coverage mapping (PCM), to the estimation of void fraction in heated channels using the OECD/NEA full size fine mesh bundle test (BFBT) data. PCM here is developed as a quantitative approach that allows for a rigorous scaling of experimental biases to the application domain, i.e., the range of the conditions intended for model application. PCM aims to address some of the conceptual and computational difficulties associated with model validation exercises where it is essential to establish with a certain confidence that the available experiments provide enough evidence to support the use of the model for its intended range of application. To our knowledge, this methodology represents a first-of-a-kind application of physics models to support validation, in a manner that precludes parameters calibration, and avoids the introduction of expert-based scale-distortion uncertainties. (authors)

42 ENGINEERING↗

Modeling and Validation of Offset Cancellation for Hybrid Photonic-Electronic Transimpedance Amplifier Using All-Electronic Circuits

Hybrid photonic-electronic circuits involving crossdomain feedback signals are difficult to validate and troubleshoot. This paper describes an approach to model and validate an offset-cancellation loop for a hybrid transimpedance amplifier (TIA) using all-electronic circuits. An equivalent electrical model is developed for the tunable interferometer attenuators used for offset trimming, and it includes test features to extract the system performance. The stability analysis of the system shows 75 ◦ of phase margin and 102 dB of gain margin. Measurement results demonstrate good agreement with analysis and successful TIA offset cancellation.

Marchant, Jared↗

Validating corrosion models: A comparison of governing equations

Experimental validation of Finite Element Method (FEM) models varying electrochemical governing equations, inclusion of chemical reactions, and time on the resultant damage profile for two galvanic couples is explored. Two anode materials (Magnesium AZ31 and Carbon Steel) in contact with a cathode (Stainless Steel 304 L) were modeled in/exposed to NaCl (1 and 0.1 M respectively for the anode materials) for up to one week. The physics approach, inclusion of chemical reactions, and the boundary conditions required to accurately represent the damage profile in FEM models depended on the galvanic couple materials and, ultimately, the corrosion rate. For high rates of corrosion (i.e., magnesium anode), the Nernst-Planck equation with Electroneutrality was sufficient to describe the damage, while, for low rates of corrosion (i.e., carbon steel anode), the Laplace equation was sufficient. In all cases, the most complete governing equation (Nernst-Planck-Poisson Equation) was not necessary to accurately describe the damage. Precipitation reactions in solution also played a critical role in the predicted damage profile, especially for high corrosion rate systems. Finally, for short time periods (< 6 h), the choice of governing equations does not significantly influence damage profile results. Overall, the choice of physics to reduce error in simulations relies on the boundary conditions, geometry, conductivity of the solution, electrochemical potential differences, and time of exposure. The above results are discussed with regard to accuracy and computational savings.

Carbon steel↗

Data-Driven Residential Load Modeling and Validation in GridLAB-D

Accurately characterizing the impacts of high penetrations of distributed energy resources (DER) on the electric distribution system has driven modeling methods from traditional static snap shots, often representing a critical point in time (e.g., summer peak load), to quasi-static time series (QSTS) simulations capturing all the effects of variable DER, associated controls and hence, impacts on the distribution system over a given time period. Unfortunately, the high time resolution DER source and load data required for model inputs is often scarce or non-existent. This paper presents work performed within the GridLAB-D model environment to synthesize, calibrate, and validate 1-second residential load models based on measured transformer loads and physics-based models suitable for QSTS electric distribution system modeling. The modeling and validation approach taken was to create a typical GridLAB-D model home that, when replicated to represent multiple diverse houses on a single transformer, creates a statistically similar load to a measured load for a given weather input. The model homes are constructed to represent the range of actual homes on an instrumented transformer: square footage, thermal integrity, heating and cooling system definition as well as realistic occupancy schedules. House model calibration and validation was performed using the distribution transformer load data and corresponding weather. The modeled loads were found to be similar to the measured loads for four evaluation metrics: 1) daily average energy, 2) daily average and standard deviation of power, 3) power spectral density, and 4) load shape.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Application of Extended Kalman Filter Techniques for Dynamic Model Parameter Calibration

Abstract -Phasor measurement has previously been used for sub-system model validation, which enables rigorous comparison of model simulation and recorded dynamics and facilitates identification of problematic model components. Recent work extends the sub-system model validation approach with a focus on how model parameters may be calibrated to match recorded dynamics. In this paper, a calibration method using Extended Kalman Filter (EKF) technique is proposed. This paper presents the formulation as well as case studies to show the validity of the EKF-based parameter calibration method. The proposed calibration method is expected to be a cost-effective means complementary to traditional equipment testing for improving dynamic model quality.

Extended Kalman Filter↗

Wind Energy Instrumentation Atlas

The US Department of Energy (DOE) A2e program is focused on developing the next generation of predictive tools to better understand wind plant performance and help industry lower the overall cost of energy. A formal verification and validation process is required to demonstrate improved accuracy of these new models beyond those currently employed. And a critical part of model validation is utilization of a diverse set of accurate observations of atmospheric forcing and wind plant response. A number of existing data sets that will be used for this purpose, as highlighted by Schreck and Maniaci (2017) but A2e researchers also realize that new datasets will be required to meet validation objectives. As such, plans for new experiments based on model validation priorities (NALU validation plan, 2017) are currently being developed. This document is intended to serve as a reference to experimental study planners that describes the capability, accuracy and resolution of existing and developing measurement technologies to observe quantities of interest for wind plant model validation. Such systems can be broken into two major categories: those that measure the flow field and surrounding atmosphere around and within a wind plant and those that measure the turbine response within the wind plant. The A2e validation team will use this catalogue of instrument capability in conjunction with the validation plan, to choose the optimal set of instruments to be deployed, inform instrument placement and operation and estimate the types of validation that may be gathered through new field campaigns. Where existing instrumentation is deficient, the document will also help guide DOE towards potential areas where instrumentation development is required to meet validation objectives and A2e technology development funding may be required. The domain of interest is the wind plant microscale, within and surrounding a single wind plant, typically, tens of kilometers on a side in horizontal directions and to the top of the atmospheric boundary layer (about 1km) in the vertical. Some observations of dominant mesoscale forcing phenomena are required, with the highest resolution measurements occurring in the wind turbine wakes and on the turbines themselves. The simulation tools to be validated are mesoscale driven large-eddy simulations of the atmosphere with full aeroelastic response of individual turbines within the plant. Use cases vary slightly among tool users, but should focus on the primary end customers of the simulations and research insights, which would be turbine manufacturers, wind plant developers and owners. Broadly speaking their interests are maximizing energy output, while maintaining turbine reliability and lifetime.

17 WIND ENERGY↗

Cable Damage Detection System and Algorithms Using Time Domain Reflectometry

This report describes the hardware system and the set of algorithms we have developed for detecting damage in cables for the Advanced Development and Process Technologies (ADAPT) Program. This program is part of the W80 Life Extension Program (LEP). The system could be generalized for application to other systems in the future. Critical cables can undergo various types of damage (e.g. short circuits, open circuits, punctures, compression) that manifest as changes in the dielectric/impedance properties of the cables. For our specific problem, only one end of the cable is accessible, and no exemplars of actual damage are available. This work addresses the detection of dielectric/impedance anomalies in transient time domain reflectometry (TDR) measurements on the cables. The approach is to interrogate the cable using time domain reflectometry (TDR) techniques, in which a known pulse is inserted into the cable, and reflections from the cable are measured. The key operating principle is that any important cable damage will manifest itself as an electrical impedance discontinuity that can be measured in the TDR response signal. Machine learning classification algorithms are effectively eliminated from consideration, because only a small number of cables is available for testing; so a sufficient sample size is not attainable. Nonetheless, a key requirement is to achieve very high probability of detection and very low probability of false alarm. The approach is to compare TDR signals from possibly damaged cables to signals or an empirical model derived from reference cables that are known to be undamaged. This requires that the TDR signals are reasonably repeatable from test to test on the same cable, and from cable to cable. Empirical studies show that the repeatability issue is the 'long pole in the tent' for damage detection, because it is has been difficult to achieve reasonable repeatability. This one factor dominated the project. The two-step model-based approach is summarized as follows: Step 1, Cable Modeling: Given input-output TDR signals s(n) and x{sub U}(n) for a cable known to be free of damage, system identification algorithms are used to compute a dynamic prediction-error cable model that has output {cflx x}{sub U}(n). The model is declared valid when the innovations e{sub U}(n) = x{sub U}(n) {cflx x}{sub U}(n) satisfy a statistical zero-mean whiteness test. This validated model output is then used as a known reference to which other cables can be compared. Step 2, Cable Testing: The TDR output signal x{sub D}(n) from a cable under test is compared with the model output {cflx x}{sub U}(n) by computing the innovations e{sub D}(n) = x{sub D}(n) {cflx x}{sub U}(n). The innovations are tested using a short-term whiteness test statistic, which employs a statistical confidence interval. If the cable passes the test, this implies that the model is valid and the cable is declared undamaged. If the cable fails the test, this indicates a model mismatch, which means that the cable's dielectric properties have changed; and this implies that the cable is damaged. The test threshold is adjusted to maximize probability of detection and minimize probability of false alarm according to an empirically determined receiver operating characteristic (ROC) curve. An associated confidence interval on the probability of correct classification is also provided. The effectiveness of the algorithm is demonstrated using measured TDR signals for undamaged and damaged cables. Experimental and algorithmic methods for coping with repeatability issues are presented. The model-based damage detection algorithms have been shown to perform well for some representative examples of real TDR signals acquired using the two-dimensional (2D) mockup fixture. If the damage causes a short circuit, then damage detection performance is generally good to excellent. Examples include the cases demonstrated in this report for cuts and pinholes. If the damage does not cause a short circuit, then damage detection performance is generally poor to fair. Examples include the cases demonstrated in this report for crushes and partial cuts.

42 ENGINEERING↗

Burst pressure models and validations for thick-walled pipelines containing corrosion defects

Corrosion is one major threat to pipeline integrity. Over the past decades, many corrosion models have been developed for determining the remaining strength of corroded pipelines, including ASME B31.G, Modified B31.G, LPC, PCORRC and their modified models. All these corrosion models are applicable only to large diameter, thin-walled pipelines with a diameter to wall thickness ratio D/t ≥ 20. In practice, many pipelines have a small diameter and thick wall with a D/t ratio < 20, and thus an adequate corrosion model is needed for assessing remaining strength for corroded thick-walled pipelines. This paper briefly reviews the theoretical burst pressure models for defect-free thin and thick-walled pipelines and four representative corrosion assessment models for thin-walled corroded pipelines. On this basis, two modified corrosion models are proposed to thick-walled pipelines in terms of the average shear stress yield theory. To verify the proposed corrosion models, comprehensive validations are performed. Numerical validations include the elastic-plastic finite element analysis to determine burst pressure for pipelines without and with corrosion defects and the model evaluation using a large dataset of available FEA results of burst pressure for machined defects. Experimental validations include a set of burst pressure tests for defect-free thick-walled pipes with different thicknesses and the model evaluation using one large burst dataset for machined defects with flat bottoms and another large dataset for real corrosion defects with curved river bottom profiles. Both numerical and experimental validations show that the proposed corrosion models can more accurately predict the remaining strength for corroded thin and thick-walled pipelines.

Pipeline↗

Modeling the Risk of Radiation-Induced Acute Esophagitis for Combined Washington University and RTOG Trial 93-11 Lung Cancer Patients

Purpose: To construct a maximally predictive model of the risk of severe acute esophagitis (AE) for patients who receive definitive radiation therapy (RT) for non-small-cell lung cancer. Methods and Materials: The dataset includes Washington University and RTOG 93-11 clinical trial data (events/patients: 120/374, WUSTL = 101/237, RTOG9311 = 19/137). Statistical model building was performed based on dosimetric and clinical parameters (patient age, sex, weight loss, pretreatment chemotherapy, concurrent chemotherapy, fraction size). A wide range of dose-volume parameters were extracted from dearchived treatment plans, including Dx, Vx, MOHx (mean of hottest x% volume), MOCx (mean of coldest x% volume), and gEUD (generalized equivalent uniform dose) values. Results: The most significant single parameters for predicting acute esophagitis (RTOG Grade 2 or greater) were MOH85, mean esophagus dose (MED), and V30. A superior-inferior weighted dose-center position was derived but not found to be significant. Fraction size was found to be significant on univariate logistic analysis (Spearman R = 0.421, p < 0.00001) but not multivariate logistic modeling. Cross-validation model building was used to determine that an optimal model size needed only two parameters (MOH85 and concurrent chemotherapy, robustly selected on bootstrap model-rebuilding). Mean esophagus dose (MED) is preferred instead of MOH85, as it gives nearly the same statistical performance and is easier to compute. AE risk is given as a logistic function of (0.0688 Asterisk-Operator MED+1.50 Asterisk-Operator ConChemo-3.13), where MED is in Gy and ConChemo is either 1 (yes) if concurrent chemotherapy was given, or 0 (no). This model correlates to the observed risk of AE with a Spearman coefficient of 0.629 (p < 0.000001). Conclusions: Multivariate statistical model building with cross-validation suggests that a two-variable logistic model based on mean dose and the use of concurrent chemotherapy robustly predicts acute esophagitis risk in combined-data WUSTL and RTOG 93-11 trial datasets.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Recommended Research Directions for Improving the Validation of Complex Systems Models.

Improved validation for models of complex systems has been a primary focus over the past year for the Resilience in Complex Systems Research Challenge. This document describes a set of research directions that are the result of distilling those ideas into three categories of research -- epistemic uncertainty, strong tests, and value of information. The content of this document can be used to transmit valuable information to future research activities, update the Resilience in Complex Systems Research Challenge's roadmap, inform the upcoming FY18 Laboratory Directed Research and Development (LDRD) call and research proposals, and facilitate collaborations between Sandia and external organizations. The recommended research directions can provide topics for collaborative research, development of proposals, workshops, and other opportunities.

99 GENERAL AND MISCELLANEOUS↗

A Validated Prediction Model for Overall Survival From Stage III Non-Small Cell Lung Cancer: Toward Survival Prediction for Individual Patients

Purpose: Although patients with stage III non-small cell lung cancer (NSCLC) are homogeneous according to the TNM staging system, they form a heterogeneous group, which is reflected in the survival outcome. The increasing amount of information for an individual patient and the growing number of treatment options facilitate personalized treatment, but they also complicate treatment decision making. Decision support systems (DSS), which provide individualized prognostic information, can overcome this but are currently lacking. A DSS for stage III NSCLC requires the development and integration of multiple models. The current study takes the first step in this process by developing and validating a model that can provide physicians with a survival probability for an individual NSCLC patient. Methods and Materials: Data from 548 patients with stage III NSCLC were available to enable the development of a prediction model, using stratified Cox regression. Variables were selected by using a bootstrap procedure. Performance of the model was expressed as the c statistic, assessed internally and on 2 external data sets (n=174 and n=130). Results: The final multivariate model, stratified for treatment, consisted of age, gender, World Health Organization performance status, overall treatment time, equivalent radiation dose, number of positive lymph node stations, and gross tumor volume. The bootstrapped c statistic was 0.62. The model could identify risk groups in external data sets. Nomograms were constructed to predict an individual patient's survival probability ( (www.predictcancer.org)). The data set can be downloaded at (https://www.cancerdata.org/10.1016/j.ijrobp.2015.02.048). Conclusions: The prediction model for overall survival of patients with stage III NSCLC highlights the importance of combining patient, clinical, and treatment variables. Nomograms were developed and validated. This tool could be used as a first building block for a decision support system.

62 RADIOLOGY AND NUCLEAR MEDICINE↗