Search NASA⌕ Search

SEARCH · Search NASA

Results for “EVALUATION”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 901 records · Page 50

SU-E-P-07: Evaluation of Productivity Systems for Radiation Therapy

Purpose: Health systems throughout the United States are under increased financial pressure to reduce operating cost. As a result, productivity models developed by third-party consultants are being used to optimize staff to treatment volumes. The purpose of this study was to critically evaluate productivity systems for radiation oncology. Methods: Staffing efficiency was evaluated using multiple productivity models. The first model evaluated staffing levels using equal weighting of procedure codes and hours worked. A second productivity model was developed using hours worked by job class and relative value units for each procedure code. A third model was developed using the measured procedure times extracted from the electronic medical record, which tracks the wait and treatment times for each patient for each treatment fraction. A MatLab program was developed to query and analyze the daily treatment data. A model was then created to determine any theoretical gains in treatment productivity. Results: Productivity was evaluated for six radiation therapy departments operating nine linear accelerators delivering over 40,000 treatment fractions per year. Third party productivity models that do not take into consideration the unique nature of radiation therapy can be counterproductive. For example, other outpatient departments can compress their daily schedule to decrease the worked hours. This approach was tested using the treatment schedule evaluation tool developed as part of this study. It was determined that the maximum possible savings for treatment schedule compression was $32,000 per year per linac. All annual cost savings would be lost if only two patients per year choose to be treated elsewhere because of limited or restricted appointment times. Conclusion: The use of productivity models in radiation therapy can easily result in a loss of treatment revenue that is greater than any potential cost savings in reduced hours worked by staff.

60 APPLIED LIFE SCIENCES↗

SU-E-J-35: Clinical Performance Evaluation of a Phase II Proton CT Scanner

Purpose: To develop the methodology to evaluate the clinical performance of a Phase II Proton CT scanner Methods: Range errors on the order of 3%-5% constitute a major uncertainty in current charged particle treatment planning based on Hounsfield Unit (HU)-relative stopping power (RSP) calibration curves. Within our proton CT collaboration, we previously developed and built a Phase I proton CT scanner that provided a sensitive area of 9 cm (axial) × 18 cm (in-plane). This scanner served to get initial experience with this new treatment planning tool and to incorporate lessons learned into the next generation design. A Phase II scanner was recently completed and is now undergoing initial performance testing. It will increase the proton acquisition rate and provide a larger detection area of 9 cm x 36 cm. We are now designing a comprehensive evaluation program to test the image quality, imaging dose, and range uncertainty associated with this scanner. The testing will be performed along the lines of AAPM TG 66. Results: In our discussion of the evaluation protocol we identified the following priorities. The image quality of proton CT images, in particular spatial resolution and low-density contrast discrimination, will be evaluated with the Catphan600 phantom. Initial testing showed that the Catphan uniformity phantom did not provide sufficient uniformity; it was thus replaced by a cylindrical water phantom. The imaging dose will be tested with a Catphan dose module, and compared to a typical cone beam CT dose for comparable image quality. Lastly, we developed a dedicated dosimetry range phantom based on the CIRS pediatric head phantom HN715. Conclusion: A formal evaluation of proton CT as a new tool for proton treatment planning is an important task. The availability of the new Phase II proton CT scanner will allow us to perform this task. This research is supported by the National Institute of Biomedical Imaging and Bioengineering of the NIH under award number R01EB013118. The content is solely the responsibility of the authors and does not necessarily represent the official views of the NIH.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

SU-E-T-569: Evaluation of VMAT Plans Generated with HD120 and Millennium 120 MLC Between Two Matched Linacs

Purpose: To evaluate VMAT treatment plans generated with HD120 MLC and Millennium 120 MLC between two matched linacs and to determine if one can back up the other. Methods: The 6x photon beams are matched for our Varian TrueBeam STx and Trilogy linacs, which are equipped with HD120 MLC and Millennium 120 MLC, respectively. Three prostate and three brain VMAT plans were used for the evaluation. Five plans (three prostate and two brain plans) were originally generated with the TrueBeam STx and re-computed with the Trilogy. One brain plan was evaluated the other way around. For each plan, the PTV coverage of V95 was made the same between two linacs. The dosimetric differences associated with the plans were compared using: 1) Percentage mean dose differences to the PTV, 2) Homogeneity index, HI = (Dmax − Dmin)/Dmean for the PTV. For prostate plans, the mean dose differences to the rectum were evaluated. While for brain plans, the percentage max dose differences to the lenses (left and right lens) were evaluated. Results: For three prostate plans, the average of the percentage mean dose differences to the PTV was 0.5 ± 0.1% and the HI was 0.1 ± 0.0%. The average of the percentage mean dose difference to the rectum was 3.5 ± 0.5%. For three brain plans, the average of the percentage mean dose differences to the PTV was 0.2 ± 1.1% and the HI was 0.2 ± 0.1%. The average of the percentage max dose differences to the lenses was 22.9 ± 4.0%. Conclusion: For prostate VMAT plans, changing the treatment from the TrueBeam STx to the Trilogy does not necessarily need re-optimization. But for brain plans, in order to minimize dose to the lenses, it is recommended to re-optimize the plan if changing the treatment between these two linacs.

60 APPLIED LIFE SCIENCES↗

SU-E-J-50: An Evaluation of the Stability of Image Quality Parameters of the Elekta XVI and IView Imaging Systems

Introduction Quality assurance of the image quality for image guided localization systems is crucial to ensure accurate visualization and localization of target volumes. In this study, the long term stability of selected image parameters was assessed and evaluated for CBCT mode, planar radiographic kV mode and MV mode. Methods and Materials: The CATPHAN, QckV-1 and QC-3 phantoms were used to evaluate the image quality parameters. The planar radiographic images were analyzed in PIPSpro™ with spatial resolution (f30, f40, f50) being recorded. For XVI CBCT, Head and Neck Small20 (S20) and Pelvis Medium20 (M20) standard acquisition modes were evaluated for Uniformity, Noise, Spatial Resolution and HU constancy. Dose and kVp for the XVI were recorded using the Unfors RaySafe Xi system with the R/F Low Detector for the kV planar radiographic mode. Results A total of 20 and 10 measurements were acquired for the planar radiographic and CBCT systems respectively over a two month period. Values were normalized to the mean and the standard deviations (STD) were recorded. For the planar radiographic spatial resolution, the STD for f30, f40, f50 were 0.004, 0.002, 0.002 and 0.005, 0.007, 0.008 for the kV and MV, respectively. The average recorded dose for kV was 38.7±2.7 μGy. The STD of the evaluated metrics for the S20 acquisition were: 0.444(f30), 0.067(f40), 0.062(f50), 0.018(Water/poly-HU constancy), 0.028(uniformity) and 0.106(noise). The standard deviations for the M20 acquisition were: 0.108(f30), 0.073(f40), 0.091(f50), 0.008(Water/poly-HU constancy), 0.005(uniformity) and 0.005(noise). Using these, tolerances can be reported as a warning and action threshold of 1σ and 2σ. Conclusion A study was performed to assess the stability of the basic image quality parameters recommended by TG-142 for the Elekta XVI and iView imaging systems. Consistent imaging and dosimetric properties over the evaluated time frame were noted. This work was funded in part by the Cancer Prevention Research Institute of Texas Pre doctoral fellowship training grant (RP140105) to Dennis N. Stanley M.Sc.

60 APPLIED LIFE SCIENCES↗

SU-E-J-275: Review - Computerized PET/CT Image Analysis in the Evaluation of Tumor Response to Therapy

Purpose: To review the literature in using computerized PET/CT image analysis for the evaluation of tumor response to therapy. Methods: We reviewed and summarized more than 100 papers that used computerized image analysis techniques for the evaluation of tumor response with PET/CT. This review mainly covered four aspects: image registration, tumor segmentation, image feature extraction, and response evaluation. Results: Although rigid image registration is straightforward, it has been shown to achieve good alignment between baseline and evaluation scans. Deformable image registration has been shown to improve the alignment when complex deformable distortions occur due to tumor shrinkage, weight loss or gain, and motion. Many semi-automatic tumor segmentation methods have been developed on PET. A comparative study revealed benefits of high levels of user interaction with simultaneous visualization of CT images and PET gradients. On CT, semi-automatic methods have been developed for only tumors that show marked difference in CT attenuation between the tumor and the surrounding normal tissues. Quite a few multi-modality segmentation methods have been shown to improve accuracy compared to single-modality algorithms. Advanced PET image features considering spatial information, such as tumor volume, tumor shape, total glycolytic volume, histogram distance, and texture features have been found more informative than the traditional SUVmax for the prediction of tumor response. Advanced CT features, including volumetric, attenuation, morphologic, structure, and texture descriptors, have also been found advantage over the traditional RECIST and WHO criteria in certain tumor types. Predictive models based on machine learning technique have been constructed for correlating selected image features to response. These models showed improved performance compared to current methods using cutoff value of a single measurement for tumor response. Conclusion: This review showed that computerized PET/CT image analysis holds great potential to improve the accuracy in evaluation of tumor response. This work was supported in part by the National Cancer Institute Grant R01CA172638.

60 APPLIED LIFE SCIENCES↗

SU-E-T-106: An Institutional Review of Using Commercially Available Software to Evaluate Treatment Plan Quality for Various Treatment Sites and Beam Deliveries

Purpose: Use Sun Nuclear Quality Reports™ with PlanIQ™ to evaluate different treatment delivery techniques for various treatment sites. Methods: Fifteen random patients with different treatment sites were evaluated. These include the Head/Neck, prostate, pelvis, lung, esophagus, axilla, bladder and abdomen. Initially, these sites were planned on the Pinnacle {sup 3} V9.6 treatment planning system and utilized nine 6MV step-n-shoot IMRT fields. The RT plan, dose and structure sets were sent to Quality Reports™ where a DVH was recreated and the plans were compared to a unique Plan Algorithm for each treatment site. Each algorithm has its own plan quality metrics and objectives, which include the PTV coverage, PTV maximum dose, the prescription dose outside the target, doses to the critical structures, and the global maximum dose and its location. Each plan was scored base on meeting each objective. Plans may have been reoptimized and reevaluated with Quality Reports™ based on the initial score. PlanIQ™ was used to evaluate if any objective not met was achievable or difficult to obtain. A second plan using VMAT delivery was created for each patient and scored with Quality Reports™. Results: There were a wide range of scores for the different treatment sites with some scoring better for IMRT plans and some better for the VMAT deliveries. The variation in the scores could be attributed to the treatment site, location, and shape of the target. Most deliveries were chosen for the VMAT due to the short treatment times and quick patient throughput with acceptable plan scores. Conclusion: The tools are provided for both physician and dosimetrist to objectively evaluate the use of VMAT delivery versus the step-n-shoot IMRT delivery for various sites. PlanIQ validates if objectives can be met. For the physicist, a concise pass/fail report is created for plan evaluation.

60 APPLIED LIFE SCIENCES↗

SU-E-T-266: Development of Evaluation System of Optimal Synchrotron Controlling Parameter for Spot Scanning Proton Therapy with Multiple Gate Irradiations in One Operation Cycle

Purpose: We have developed a gated spot scanning proton beam therapy system with real-time tumor-tracking. This system has the ability of multiple-gated irradiation in a single synchrotron operation cycle controlling the wait-time for consecutive gate signals during a flat-top phase so that the decrease in irradiation efficiency induced by irregular variation of gate signal is reduced. Our previous studies have shown that a 200 ms wait-time is appropriate to increase the average irradiation efficiency, but the optimal wait-time can vary patient by patient and day by day. In this research, we have developed an evaluation system of the optimal wait-time in each irradiation based on the log data of the real-time-image gated proton beam therapy (RGPT) system. Methods: The developed system consists of logger for operation of RGPT system and software for evaluation of optimal wait-time. The logger records timing of gate on/off, timing and the dose of delivered beam spots, beam energy and timing of X-ray irradiation. The evaluation software calculates irradiation time in the case of different wait-time by simulating the multiple-gated irradiation operation using several timing information. Actual data preserved in the log data are used for gate on and off time, spot irradiation time, and time moving to the next spot. Design values are used for the acceleration and deceleration times. We applied this system to a patient treated with the RGPT system. Results: The evaluation system found the optimal wait-time of 390 ms that reduced the irradiation time by about 10 %. The irradiation time with actual wait-time used in treatment was reproduced with accuracy of 0.2 ms. Conclusion: For spot scanning proton therapy system with multiple-gated irradiation in one synchrotron operation cycle, an evaluation system of the optimal wait-time in each irradiation based on log data has been developed. Funding Support: Japan Society for the Promotion of Science (JSPS) through the FIRST Program.

60 APPLIED LIFE SCIENCES↗

A method for evaluating image quality of monochrome and color displays based on luminance by use of a commercially available color digital camera

Purpose: The aim of this study is to propose a method for the quantitative evaluation of image quality of both monochrome and color liquid-crystal displays (LCDs) using a commercially available color digital camera. Methods: The intensities of the unprocessed red (R), green (G), and blue (B) signals of a camera vary depending on the spectral sensitivity of the image sensor used in the camera. For consistent evaluation of image quality for both monochrome and color LCDs, the unprocessed RGB signals of the camera were converted into gray scale signals that corresponded to the luminance of the LCD. Gray scale signals for the monochrome LCD were evaluated by using only the green channel signals of the camera. For the color LCD, the RGB signals of the camera were converted into gray scale signals by employing weighting factors (WFs) for each RGB channel. A line image displayed on the color LCD was simulated on the monochrome LCD by using a software application for subpixel driving in order to verify the WF-based conversion method. Furthermore, the results obtained by different types of commercially available color cameras and a photometric camera were compared to examine the consistency of the authors’ method. Finally, image quality for both the monochrome and color LCDs was assessed by measuring modulation transfer functions (MTFs) and Wiener spectra (WS). Results: The authors’ results demonstrated that the proposed method for calibrating the spectral sensitivity of the camera resulted in a consistent and reliable evaluation of the luminance of monochrome and color LCDs. The MTFs and WS showed different characteristics for the two LCD types owing to difference in the subpixel structure. The MTF in the vertical direction of the color LCD was superior to that of the monochrome LCD, although the WS in the vertical direction of the color LCD was inferior to that of the monochrome LCD as a result of luminance fluctuations in RGB subpixels. Conclusions: The authors’ method based on the use of a commercially available color camera is useful to evaluate and understand the display performances of both monochrome and color LCDs in radiology departments.

60 APPLIED LIFE SCIENCES↗

Experimental evaluation of neutron dose in radiotherapy patients: Which dose?

Purpose: The evaluation of peripheral dose has become a relevant issue recently, in particular, the contribution of secondary neutrons. However, after the revision of the Recommendations of the International Commission on Radiological Protection, there has been a lack of experimental procedure for its evaluation. Specifically, the problem comes from the replacement of organ dose equivalent by the organ-equivalent dose, being the latter “immeasurable” by definition. Therefore, dose equivalent has to be still used although it needs the calculation of the radiation quality factor Q, which depends on the unrestricted linear energy transfer, for the specific neutron irradiation conditions. On the other hand, equivalent dose is computed through the radiation weighting factor w{sub R}, which can be easily calculated using the continuous function provided by the recommendations. The aim of the paper is to compare the dose equivalent evaluated following the definition, that is, using Q, with the values obtained by replacing the quality factor with w{sub R}. Methods: Dose equivalents were estimated in selected points inside a phantom. Two types of medical environments were chosen for the irradiations: a photon- and a proton-therapy facility. For the estimation of dose equivalent, a poly-allyl-diglicol-carbonate-based neutron dosimeter was used for neutron fluence measurements and, additionally, Monte Carlo simulations were performed to obtain the energy spectrum of the fluence in each point. Results: The main contribution to dose equivalent comes from neutrons with energy higher than 0.1 MeV, even when they represent the smallest contribution in fluence. For this range of energy, the radiation quality factor and the radiation weighting factor are approximately equal. Then, dose equivalents evaluated using both factors are compatible, with differences below 12%. Conclusions: Quality factor can be replaced by the radiation weighting factor in the evaluation of dose equivalent in radiotherapy environments simplifying the practical procedure.

61 RADIATION PROTECTION AND DOSIMETRY↗

Evaluation of various approaches for assessing dose indicators and patient organ doses resulting from radiotherapy cone-beam CT

Purpose: The aim of this study was to evaluate various approaches for assessing patient organ doses resulting from radiotherapy cone-beam CT (CBCT), by the use of thermoluminescent dosimeter (TLD) measurements in anthropomorphic phantoms, a Monte Carlo based dose calculation software, and different dose indicators as presently defined. Methods: Dose evaluations were performed on a CBCT Elekta XVI (Elekta, Crawley, UK) for different protocols and anatomical regions. The first part of the study focuses on using PCXMC software (PCXMC 2.0, STUK, Helsinki, Finland) for calculating organ doses, adapting the input parameters to simulate the exposure geometry, and beam dose distribution in an appropriate way. The calculated doses were compared to readouts of TLDs placed in an anthropomorphic Rando phantom. After this validation, the software was used for analyzing organ dose variability associated with patients’ differences in size and gender. At the same time, various dose indicators were evaluated: kerma area product (KAP), cumulative air-kerma at the isocenter (K{sub air}), cone-beam dose index, and central cumulative dose. The latter was evaluated in a single phantom and in a stack of three adjacent computed tomography dose index phantoms. Based on the different dose indicators, a set of coefficients was calculated to estimate organ doses for a range of patient morphologies, using their equivalent diameters. Results: Maximum organ doses were about 1 mGy for head and neck and 25 mGy for chest and pelvis protocols. The differences between PCXMC and TLDs doses were generally below 10% for organs within the field of view and approximately 15% for organs at the boundaries of the radiation beam. When considering patient size and gender variability, differences in organ doses up to 40% were observed especially in the pelvic region; for the organs in the thorax, the maximum differences ranged between 20% and 30%. Phantom dose indexes provided better correlation with organ doses than K{sub air} and KAP, with average ratios ranging between 0.9 and 1.1 and variations for different organs and protocols below 20%. The triple phantom setup allowed us to take into account scatter dose contributions, but nonetheless, the correlation with the evaluated organ doses was not improved with this method. Conclusions: The simulation of rotational geometry and of asymmetric beam distribution by means of PCXMC 2.0 enabled us to determine patient organ doses depending on weight, height and gender. Alternatively, the measurement of an in phantom dose indicator combined with proper correction coefficients can be a useful tool for a first dose estimation of in-field organs. The data and coefficients provided in this study can be applied to any patient undergoing a scan by an Elekta XVI equipment.

60 APPLIED LIFE SCIENCES↗

SU-G-BRC-08: Evaluation of Dose Mass Histogram as a More Representative Dose Description Method Than Dose Volume Histogram in Lung Cancer Patients

Purpose: Dose-volume-histogram (DVH) is widely used for plan evaluation in radiation treatment. The concept of dose-mass-histogram (DMH) is expected to provide a more representative description as it accounts for heterogeneity in tissue density. This study is intended to assess the difference between DVH and DMH for evaluating treatment planning quality. Methods: 12 lung cancer treatment plans were exported from the treatment planning system. DVHs for the planning target volume (PTV), the normal lung and other structures of interest were calculated. DMHs were calculated in a similar way as DVHs expect that the voxel density converted from the CT number was used in tallying the dose histogram bins. The equivalent uniform dose (EUD) was calculated based on voxel volume and mass, respectively. The normal tissue complication probability (NTCP) in relation to the EUD was calculated for the normal lung to provide quantitative comparison of DVHs and DMHs for evaluating the radiobiological effect. Results: Large differences were observed between DVHs and DMHs for lungs and PTVs. For PTVs with dense tumor cores, DMHs are higher than DVHs due to larger mass weighing in the high dose conformal core regions. For the normal lungs, DMHs can either be higher or lower than DVHs depending on the target location within the lung. When the target is close to the lower lung, DMHs show higher values than DVHs because the lower lung has higher density than the central portion or the upper lung. DMHs are lower than DVHs for targets in the upper lung. The calculated NTCPs showed a large range of difference between DVHs and DMHs. Conclusion: The heterogeneity of lung can be well considered using DMH for evaluating target coverage and normal lung pneumonitis. Further studies are warranted to quantify the benefits of DMH over DVH for plan quality evaluation.

60 APPLIED LIFE SCIENCES↗

SU-G-BRB-06: Commissioning and Evaluation of EPID-Based in Vivo Dosimetry Software Using a Tissue-Maximum Ratio Approach

Purpose: To commission and evaluate an in vivo EPID-based transit dosimetry software (EPIgray, DOSIsoft, Cachan, France) using simple fields and TG119-based IMRT treatment plans. Methods: EPIgray was commissioned on a Truebeam based on finite tissue-maximum ratio (fTMR) measurements with solid water blocks of thicknesses between 0 and 37 cm. Field sizes varied from 2×2 to 20×20 cm{sup 2}. Subsequently, treatment plans of single and opposed beams with field sizes between 4×4 and 15×15 cm{sup 2} as well as IMRT plans were measured to evaluate the dose reconstruction accuracy. Single field dose predictions were made for anterior-posterior and lateral beams. IMRT plans were created based on TG119 recommendations. The reconstructed dose was compared to the planned dose for selected points at isocenter and away from isocenter. Results: For single square fields, the dose in EPIgray was reconstructed within 3% accuracy at isocenter relative to the planned dose. Similarly, the relative deviation of the total dose was accurately reconstructed within 3% for all IMRT plans with points placed inside a high dose region near the isocenter. Predictions became less accurate than 5% when the evaluation point was outside the majority of IMRT beam segments. Additionally, points 5 cm or more away from the isocenter or within an avoidance structure were predicted less reliably. Conclusion: EPIgray formalism accuracy is adequate for an efficient error detection system. It provides immediate intra-fractional feedback on the delivery of treatment plans without affecting the treatment beam. Besides the EPID, no additional hardware is required, which makes it accessible to all clinics. The software evaluates point dose measurements to verify treatment plan delivery and patient positioning within 5% accuracy, depending on the placement of evaluation points. EPIgray is not intended to replace patient-specific quality assurance but should be utilized as an additional layer of safety for continuous patient treatment verification. This research is supported by DOSIsoft.

60 APPLIED LIFE SCIENCES↗

WE-AB-BRA-05: PET-Guided Delivery Quality Evaluation of Yttrium-90 Microsphere Radioembolizaton for Hepatocellular Carcinoma Patients: The Optimal Sequence of Radioembolizaton and Chemoembolization Treatments

Purpose: Selective-internal-radiation-therapy (SIRT) and transarterial-chemoembolization (TACE) are commonly used for treatment of liver tumors. The use of TACE, which is macroembolic, prior to SIRT may cause hemodynamic changes in tumor vasculature that impair yttrium-90 (90Y) microsphere delivery to the targeted lesions. This work aims to quantify dosimetric tumor coverage using 90Y positron emission tomography (PET) dosimetry after SIRT alone compared to TACE followed by SIRT. Methods: A total of 40 consecutive hepatocellular carcinoma (HCC) SIRT patients who had a post-SIRT 90Y PET/CT scan were evaluated. The patient-specific-3D-dose was reconstructed from the PET images. Patients were categorized into two groups: patients received TACE prior SIRT procedure (n=18) and patient received SIRT alone (n=22). The lesions and liver were delineated by a senior radiologist. We evaluated both the lesion-specific dose-volume-histogram (DVH) and the selectivity index (SI) defined as the ratio of the average dose inside the total lesion(s) and the average dose of the normal liver. The SI values of patients were compared based on whether TACE was previously used. Results: A wide spectrum was observed in the lesion-specific DVH-evaluation and SI appeared to be suitable of evaluating the quality of each SIRT infusion. The average SI of the entire patient group was 3.0, i.e. targeted lesion receiving three times higher dose than normal liver. The average SI was 1.8 for patients who had prior TACE and 3.9 for patients who did not have prior TACE (p=0.008). 85% of the patients with prior TACE demonstrated poor 90Y-microsphere delivery (SI <2) while none demonstrated excellent delivery (SI >4). On the other hand, the incidence SI >4 among patients with no prior TACE was 37%. Conclusion: 3D dose evaluation using post-SIRT PET suggests that 90Y microsphere delivery to liver tumors is impaired among patients who received prior TACE compared to those who receive SIRT alone.

60 APPLIED LIFE SCIENCES↗

Object-Based Evaluation of Dynamical and Statistical Downscaled Precipitation Products over CONUS

High-resolution precipitation data, generated through dynamical downscaling (DD) or statistical downscaling (SD) of global climate model output, provide critical information for regional climate assessment and adaptation planning. Most downscaling development and validation have focused on accurate gridscale precipitation construction and ignored the spatial structure of precipitation across model grids and at the event scale. However, many applications, e.g., hydrologic modeling and the analysis using the downscaled precipitation, require a reasonable representation of the spatial structure of precipitation within watersheds. Therefore, a set of standard metrics to evaluate the representation of the spatial structure of individual storms across diverse downscaled precipitation products is desired. To address this need, we conducted an object-based evaluation of precipitation in decades-long DD and SD products over the contiguous United States (CONUS). Specifically, we evaluate their ability to reproduce various features of precipitation objects in the observations: total volume, precipitation area, peak intensity, and spatial structure. Multiple metrics (bias, Perkins score, and nonparametric statistical tests) are used to quantify model performance. Our evaluation reveals notable variations in performance among individual products across different climate zones and seasons, as well as between extreme and nonextreme events. In general, most DD products exhibit balanced performance across the four precipitation object features, while SD products vary more significantly in their performance across products. Based on this comprehensive evaluation, we provide guidance on choosing downscaled products for specific regions, seasons, and precipitation object features. These findings and recommendations can inform precipitation-relevant modeling and analysis over CONUS, guide future downscaling technique developments, and provide actionable information for climate impact assessment and adaptation.

Downscaling↗

Object-Based Evaluation of Dynamical and Statistical Downscaled Precipitation Products over CONUS

High-resolution precipitation data, generated through dynamical downscaling (DD) or statistical downscaling (SD) of global climate model output, provide critical information for regional climate assessment and adaptation planning. Most downscaling development and validation have focused on accurate gridscale precipitation construction and ignored the spatial structure of precipitation across model grids and at the event scale. However, many applications, e.g., hydrologic modeling and the analysis using the downscaled precipitation, require a reasonable representation of the spatial structure of precipitation within watersheds. Therefore, a set of standard metrics to evaluate the representation of the spatial structure of individual storms across diverse downscaled precipitation products is desired. To address this need, we conducted an object-based evaluation of precipitation in decades-long DD and SD products over the contiguous United States (CONUS). Specifically, we evaluate their ability to reproduce various features of precipitation objects in the observations: total volume, precipitation area, peak intensity, and spatial structure. Multiple metrics (bias, Perkins score, and nonparametric statistical tests) are used to quantify model performance. Our evaluation reveals notable variations in performance among individual products across different climate zones and seasons, as well as between extreme and nonextreme events. In general, most DD products exhibit balanced performance across the four precipitation object features, while SD products vary more significantly in their performance across products. Based on this comprehensive evaluation, we provide guidance on choosing downscaled products for specific regions, seasons, and precipitation object features. These findings and recommendations can inform precipitation-relevant modeling and analysis over CONUS, guide future downscaling technique developments, and provide actionable information for climate impact assessment and adaptation.

Environmental sciences↗

Observational Data for Next-Generation Climate Model Evaluation: Requirements, Considerations, and Best Practices

Climate model simulations are an important source of information about our planet’s climate system and also enable informed decision-making under different future scenarios. As a new archive of results from the next generation of climate models is anticipated to become available with the Coupled Model Intercomparison Project phase 7 (CMIP7), the need to develop efficient and robust methods to evaluate models is paramount. Observations are an integral part of model evaluation, providing a means to quantify and understand the degree to which climate models can faithfully reproduce Earth system processes. Such analysis is critical for constraining climate projections, identifying areas of focus for model development, and assisting analysts in deciphering the utility of models for specific applications. Observations of Earth system come from a diversity of sources, span different space–time domains, and are produced by different communities, and each dataset features different data structures and formats, metadata standards, and its own unique uncertainties. Uncertainties in an observational dataset may stem from gaps in temporal and spatial coverage, instrumentation errors, or assumptions in retrieval and processing methods. How then does one ensure that observational data are ready for use and utilized in the most appropriate way for robust, rapid, and routine climate model evaluation? The CMIP7 Model Benchmarking Task Team with input from the broader climate modeling, model evaluation, and observational data communities present a vision and considerations for best practices toward the optimal and appropriate use of observational data to support next-generation climate model evaluation.

Climate models↗

Evaluation of Various Methods for Estimating Global Solar Radiation in the Southeastern United States

Global solar radiation Rg is an important input for crop models to simulate crop responses. Because the scarcity of long and continuous records of Rg is a serious limitation in many countries, Rg is estimated using models. For crop-model application, empirical Rg models that use commonly measured meteorological variables, such as temperature and precipitation, are generally preferred. Although a large number of models of this kind exist, few have been evaluated for conditions in the United States. This study evaluated the performances of 16 empirical, temperature- and/or precipitation-based Rg models for the southeastern United States. By taking into account spatial distribution and data availability, 30 locations in the region were selected and their daily weather data spanning eight years obtained. One-half of the data was used for calibrating the models, and the other half was used for evaluation. For each model, location-specific parameter values were estimated through regressions. Models were evaluated for each location using the root-mean-square error and the modeling efficiency as goodness-of-fit measures. Among the models that use temperature or precipitation as the input variable, the Mavromatis model showed the best performance. The piecewise linear regression based Wu et al. model (WP) performed best not only among the models that use both temperature and precipitation but also among the 16 models evaluated, mainly because it has separate relationships for low and high radiation levels. The modeling efficiency of WP was from ~5% to more than 100% greater than those of the other models, depending on models and locations.

Irradiance, Model evaluation/performance, Agricult↗

Multicriteria screening evaluation of geothermal resources on mine lands for direct use heating

Abstract Direct use of geothermal energy is the oldest and most versatile form of utilizing geothermal energy. In the last decade, this utilization has significantly increased, especially with the installation of geothermal (ground-source) heat pumps. Many current and inactive mine land sites across the U.S. could be redeveloped with clean energy technologies such as direct use geothermal, which would revitalize former mining communities, help with reducing greenhouse gas emissions, and accelerate the transition to a clean energy economy. We present a multicriteria screening framework to evaluate various aspects of direct-use geothermal projects on mine lands. The criteria are divided into three categories: (1) technical potential, (2) demand and benefits, and (3) regulatory and permitting. We demonstrate the framework using publicly available data on a national scale (continental U.S.). Then, using an example of abandoned coal mines in Illinois and focusing on resource potential, we illustrate how this evaluation can be applied at the state or more local scales when a region’s characteristics drive spatial variability estimates. The strength of this approach is the ability to combine seemingly disparate parameters and inputs from numerous sources. The framework is very flexible—additional criteria can be easily incorporated and weights modified if input data support them. Vice versa, the framework can also help identify additional data needed for evaluating those criteria. The multicriteria screening evaluation methodology provides a framework for identifying potential candidates for detailed site evaluation and characterization.

15 GEOTHERMAL ENERGY↗