Search NASA⌕ Search

SEARCH · Search NASA

Results for “evaluation datasets”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,333 records · Page 74

Dynamic Model Agnostic Reliability Evaluation of Machine-Learning Models Integrated in Instrumentation & Control Systems

In recent years, the field of data-driven neural network-based machine learning (ML) algorithms has grown significantly and spurred research in its applicability to instrumentation and control systems. While they are promising in operational contexts, the trustworthiness of such algorithms is not adequately assessed. Failures of ML-integrated systems are poorly understood; the lack of comprehensive risk modeling can degrade the trustworthiness of these systems. In recent reports by the National Institute for Standards and Technology, trustworthiness in ML is a critical barrier to adoption and will play a vital role in intelligent systems' safe and accountable operation. Thus, in this work, we demonstrate a real-time model-agnostic method to evaluate the relative reliability of ML predictions by incorporating out-of-distribution detection on the training dataset. It is well documented that ML algorithms excel at interpolation (or near-interpolation) tasks but significantly degrade at extrapolation. This occurs when new samples are "far" from training samples. The method, referred to as the Laplacian distributed decay for reliability (LADDR), determines the difference between the operational and training datasets, which is used to calculate a prediction's relative reliability. LADDR is demonstrated on a feedforward neural network-based model used to predict safety significant factors during different loss-of-flow transients. LADDR is intended as a "data supervisor" and determines the appropriateness of well-trained ML models in the context of operational conditions. Ultimately, LADDR illustrates how training data can be used as evidence to support the trustworthiness of ML predictions when utilized for conventional interpolation tasks.

97 MATHEMATICS AND COMPUTING↗

An international land-biosphere model benchmarking activity for the IPCC Fifth Assessment Report (AR5)

The need to capture important climate feedbacks in general circulation models (GCMs) has resulted in efforts to include atmospheric chemistry and land and ocean biogeochemistry into the next generation of production climate models, called Earth System Models (ESMs). While many terrestrial and ocean carbon models have been coupled to GCMs, recent work has shown that such models can yield a wide range of results (Friedlingstein et al., 2006). This work suggests that a more rigorous set of global offline and partially coupled experiments, along with detailed analyses of processes and comparisons with measurements, are needed. The Carbon-Land Model Intercomparison Project (C-LAMP) was designed to meet this need by providing a simulation protocol and model performance metrics based upon comparisons against best-available satellite- and ground-based measurements (Hoffman et al., 2007). Recently, a similar effort in Europe, called the International Land Model Benchmark (ILAMB) Project, was begun to assess the performance of European land surface models. These two projects will now serve as prototypes for a proposed international land-biosphere model benchmarking activity for those models participating in the IPCC Fifth Assessment Report (AR5). Initially used for model validation for terrestrial biogeochemistry models in the NCAR Community Land Model (CLM), C-LAMP incorporates a simulation protocol for both offline and partially coupled simulations using a prescribed historical trajectory of atmospheric CO2 concentrations. Models are confronted with data through comparisons against AmeriFlux site measurements, MODIS satellite observations, NOAA Globalview flask records, TRANSCOM inversions, and Free Air CO2 Enrichment (FACE) site measurements. Both sets of experiments have been performed using two different terrestrial biogeochemistry modules coupled to the CLM version 3 in the Community Climate System Model version 3 (CCSM3): the CASA model of Fung, et al., and the carbon-nitrogen (CN) model of Thornton. Comparisons of the CLM3 offline results against observational datasets have been performed and are described in Randerson et al. (2009). CLM version 4 has been evaluated using C-LAMP, showing improvement in many of the metrics. Efforts are now underway to initiate a Nitrogen-Land Model Intercomparison Project (N-LAMP) to better constrain the effects of the nitrogen cycle in biosphere models. Presented will be new results from C-LAMP for CLM4, initial N-LAMP developments, and the proposed land-biosphere model benchmarking activity.

54 ENVIRONMENTAL SCIENCES↗

Learning curves for drug response prediction in cancer cell lines

Motivated by the size and availability of cell line drug sensitivity data, researchers have been developing machine learning (ML) models for predicting drug response to advance cancer treatment. As drug sensitivity studies continue generating drug response data, a common question is whether the generalization performance of existing prediction models can be further improved with more training data. We utilize empirical learning curves for evaluating and comparing the data scaling properties of two neural networks (NNs) and two gradient boosting decision tree (GBDT) models trained on four cell line drug screening datasets. The learning curves are accurately fitted to a power law model, providing a framework for assessing the data scaling behavior of these models. The curves demonstrate that no single model dominates in terms of prediction performance across all datasets and training sizes, thus suggesting that the actual shape of these curves depends on the unique pair of an ML model and a dataset. The multi-input NN (mNN), in which gene expressions of cancer cells and molecular drug descriptors are input into separate subnetworks, outperforms a single-input NN (sNN), where the cell and drug features are concatenated for the input layer. In contrast, a GBDT with hyperparameter tuning exhibits superior performance as compared with both NNs at the lower range of training set sizes for two of the tested datasets, whereas the mNN consistently performs better at the higher range of training sizes. Moreover, the trajectory of the curves suggests that increasing the sample size is expected to further improve prediction scores of both NNs. These observations demonstrate the benefit of using learning curves to evaluate prediction models, providing a broader perspective on the overall data scaling characteristics. A fitted power law learning curve provides a forward-looking metric for analyzing prediction performance and can serve as a co-design tool to guide experimental biologists and computational scientists in the design of future experiments in prospective research studies.

60 APPLIED LIFE SCIENCES↗

Reference Site Conditions for Floating Wind Arrays in the United States

Floating offshore wind farm design is highly site-specific, requiring detailed information about the specific conditions of a project area for realistic design studies. Unfortunately, publicly available site condition data for potential floating offshore wind project sites in the United States is scarce. To support U.S. offshore wind research, we developed reference site condition datasets, including metocean and seabed information, for four potential floating wind project areas in the U.S.: Humboldt Bay, Morro Bay, the Gulf of Maine, and the Gulf of Mexico. These datasets were compiled using publicly available data. Our metocean analysis, covering wind, waves, and surface currents, utilized measurement data from 2000 to 2020. Sources included the National Renewable Energy Laboratory’s National Offshore Wind Dataset for wind data, National Data Buoy Center buoys for wave data, and the High Frequency Radar Network for surface currents. These data were integrated into hourly time series used to compute extreme return periods up to 500 years, monthly statistics, and joint probability clusters for fatigue analysis. Soil conditions were evaluated using the usSEABED database and bathymetry grids were interpolated from the NCEI Digital Elevation Model Global Mosaic. In addition to providing curated reference site condition datasets for four U.S. areas, our assessment highlights the need for more publicly available metocean and soil condition data.

17 WIND ENERGY↗

AssistTaxi: A Comprehensive Dataset for Taxiway Analysis and Autonomous Operations

The availability of high-quality datasets play a crucial role in advancing research and development especially, for safety critical and autonomous systems. This poster presents AssistTaxi, which is a comprehensive novel dataset which is a collection of images for runway and taxiway analysis. The dataset comprises of more than 300,000 frames of diverse and carefully collected data, gathered from Melbourne (MLB) and Grant-Valkaria (X59) general aviation airports. The importance of AssistTaxi lies in its potential to advance autonomous operations, enabling researchers and developers to train and evaluate algorithms for efficient and safe taxiing. Researchers can utilize AssistTaxi to benchmark their algorithms, assess performance, and explore novel approaches for runway and taxiway analysis. Additionally, the dataset serves as a valuable resource for validating and enhancing existing algorithms as well as facilitating innovation in autonomous operations for aviation. We also propose an initial approach to label the dataset using a contour based detection and line extraction technique.

Data Collection↗

Automatic generation and simulation of urban building energy models based on city datasets for city-scale building retrofit analysis

Buildings in cities consume 30–70% of total primary energy, and improving building energy efficiency is one of the key strategies towards sustainable urbanization. Urban building energy models (UBEM) can support city managers to evaluate and prioritize energy conservation measures (ECMs) for investment and the design of incentive and rebate programs. This paper presents the retrofit analysis feature of City Building Energy Saver (CityBES) to automatically generate and simulate UBEM using EnergyPlus based on cities’ building datasets and user-selected ECMs. CityBES is a new open web-based tool to support city-scale building energy efficiency strategic plans and programs. The technical details of using CityBES for UBEM generation and simulation are introduced, including the workflow, key assumptions, and major databases. Also presented is a case study that analyzes the potential retrofit energy use and energy cost savings of five individual ECMs and two measure packages for 940 office and retail buildings in six city districts in northeast San Francisco, United States. The results show that: (1) all five measures together can save 23–38% of site energy per building; (2) replacing lighting with light-emitting diode lamps and adding air economizers to existing heating, ventilation and air-conditioning (HVAC) systems are most cost-effective with an average payback of 2.0 and 4.3 years, respectively; and (3) it is not economical to upgrade HVAC systems or replace windows in San Francisco due to the city's mild climate and minimal cooling and heating loads. Furthermore, the CityBES retrofit analysis feature does not require users to have deep knowledge of building systems or technologies for the generation and simulation of building energy models, which helps overcome major technical barriers for city managers and their consultants to adopt UBEM.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

A Surface Radiation Balance Data Set from Siple Dome in West Antarctica for Atmospheric and Climate Model Evaluation

A field campaign at Siple Dome in West Antarctica during the austral summer 2019-2020 offers an opportunity to evaluate climate model performance, particularly cloud microphysical simulation. Over Antarctic ice sheets and ice shelves, clouds are a major regulator of the surface energy balance, and in the warm season their presence occasionally induces surface melt that can gradually weaken an ice shelf structure. This dataset from Siple Dome, obtained using transportable and solar-poweredequipment, includes surface energy balance measurements, meteorology and cloud remote sensing. To demonstrate how these data can be used to evaluate model performance, comparisons are made with meteorological reanalysis known to give generally good performance over Antarctica (ERA5). Surface albedo measurements show expected variability with observed cloud amount, and can be used to evaluate a model's snowpack parameterization. One case study discussed involves a squall with northerly winds, during which ERA5 fails to produce cloud cover throughout one of the days. A second case study illustrates how shortwave spectroradiometer measurements that encompass the 1.6-micron atmospheric window reveal cloud phase transitions associated with cloud lifecycle. Here, continuously precipitating mixed-phase clouds become mainly liquid water clouds from local morning through the afternoon, not reproduced by ERA5. We challenge researchers to run their various regional or global models in a manner that has the large-scale meteorology follow the conditions of this field campaign, compare cloud and radiation simulations with this Siple Dome dataset, and potentially investigate why cloud microphysical simulations or other model components might produce discrepancies with these observations.

cloud remote sensing↗

Transient dynamics of terrestrial carbon storage: Mathematical foundation and its applications

Terrestrial ecosystems have absorbed roughly 30% of anthropogenic CO 2 emissions over the past decades, but it is unclear whether this carbon (C) sink will endure into the future. Despite extensive modeling and experimental and observational studies, what fundamentally determines transient dynamics of terrestrial C storage under global change is still not very clear. Here we develop a new framework for understanding transient dynamics of terrestrial C storage through mathematical analysis and numerical experiments. Our analysis indicates that the ultimate force driving ecosystem C storage change is the C storage capacity, which is jointly determined by ecosystem C input (e.g., net primary production, NPP) and residence time. Since both C input and residence time vary with time, the C storage capacity is time-dependent and acts as a moving attractor that actual C storage chases. The rate of change in C storage is proportional to the C storage potential, which is the difference between the current storage and the storage capacity. The C storage capacity represents instantaneous responses of the land C cycle to external forcing, whereas the C storage potential represents the internal capability of the land C cycle to influence the C change trajectory in the next time step. The influence happens through redistribution of net C pool changes in a network of pools with different residence times. Moreover, this and our other studies have demonstrated that one matrix equation can replicate simulations of most land C cycle models (i.e., physical emulators). As a result, simulation outputs of those models can be placed into a three-dimensional (3-D) parameter space to measure their differences. The latter can be decomposed into traceable components to track the origins of model uncertainty. In addition, the physical emulators make data assimilation computationally feasible so that both C flux- and pool-related datasets can be used to better constrain model predictions of land C sequestration. Altogether, this new mathematical framework offers new approaches to understanding, evaluating, diagnosing, and improving land C cycle models.

54 ENVIRONMENTAL SCIENCES↗

3D liver segmentation using multiple region appearances and graph cuts

Purpose: Efficient and accurate 3D liver segmentations from contrast-enhanced computed tomography (CT) images play an important role in therapeutic strategies for hepatic diseases. However, inhomogeneous appearances, ambiguous boundaries, and large variance in shape often make it a challenging task. The existence of liver abnormalities poses further difficulty. Despite the significant intensity difference, liver tumors should be segmented as part of the liver. This study aims to address these challenges, especially when the target livers contain subregions with distinct appearances. Methods: The authors propose a novel multiregion-appearance based approach with graph cuts to delineate the liver surface. For livers with multiple subregions, a geodesic distance based appearance selection scheme is introduced to utilize proper appearance constraint for each subregion. A special case of the proposed method, which uses only one appearance constraint to segment the liver, is also presented. The segmentation process is modeled with energy functions incorporating both boundary and region information. Rather than a simple fixed combination, an adaptive balancing weight is introduced and learned from training sets. The proposed method only calls initialization inside the liver surface. No additional constraints from user interaction are utilized. Results: The proposed method was validated on 50 3D CT images from three datasets, i.e., Medical Image Computing and Computer Assisted Intervention (MICCAI) training and testing set, and local dataset. On MICCAI testing set, the proposed method achieved a total score of 83.4 ± 3.1, outperforming nonexpert manual segmentation (average score of 75.0). When applying their method to MICCAI training set and local dataset, it yielded a mean Dice similarity coefficient (DSC) of 97.7% ± 0.5% and 97.5% ± 0.4%, respectively. These results demonstrated the accuracy of the method when applied to different computed tomography (CT) datasets. In addition, user operator variability experiments showed its good reproducibility. Conclusions: A multiregion-appearance based method is proposed and evaluated to segment liver. This approach does not require prior model construction and so eliminates the burdens associated with model construction and matching. The proposed method provides comparable results with state-of-the-art methods. Validation results suggest that it may be suitable for the clinical use.

60 APPLIED LIFE SCIENCES↗

Experiments and Simulation of a Borehole in Salt to Understand Heat, Brine, and Vapor Migration - 19192

Disposition of heat-generating nuclear waste (HGNW) remains a continuing technical and sociopolitical challenge. Numerous concepts for HGNW management have been proposed and examined internationally, including an extensive focus on geologic disposal. One proposed geologic material is salt because of its low permeability and viscoplastic deformation that causes self-repair of damage done to the salt by waste emplacement activities. Evaluating the safety and technical challenges of storing HGNW in a salt repository is an ongoing process involving experiments and supporting numerical simulation. Currently an experiment is underway at the Waste Isolation Pilot Plant (WIPP) to explore how the presence of a heat generating source affects phenomena such as brine migration, vapor transport, and mechanical changes to the bedded salt. A sub-horizontal heated borehole test is in progress in the underground at the WIPP that includes a centrally located 10.2 cm diameter borehole with an adjustable heater surrounded with smaller diameter boreholes instrumented with thermocouples. The central borehole contains an inflatable packer, heating block, brine sampler, and constantly flowing nitrogen gas circulation system. Air-injection tests performed in the central borehole provide pressure measurements that are used to constrain permeability of the system. The steady-state temperatures, as well as the rise and fall of temperature when the heater is cycled on and off, have been measured for up to 60 days. In the borehole, dry nitrogen gas circulation evaporates water and outflows to a desiccant container where water mass is measured daily during the experiment to quantify vapor removal. Although this test is a 'shake-down' for a planned second round of fresh borehole testing, we have gathered a rich dataset. These data allow us to build simulations using the Finite Element Heat and Mass transfer code (FEHM) to evaluate the experimental results, determine field-scale parameters, and identify code improvements to reproduce important physical processes that may not be accounted for at present. A 3-D numerical mesh, built using LaGrit software (lagrit.lanl.gov; Miller et al., 2007), includes increasing resolution around the central borehole. Modeling of the experiment allows for determining the local thermal conductivity and permeability of any damaged bedded salt around the borehole, where damage from drilling may change the permeability, porosity and saturation conditions, by parameter testing and inverse methods. Additionally, assumptions about brine and vapor flow and transport are being tested by comparing measured and simulated results. The combination of experimental data and model results provide additional data to help support the safety case for safe and effective HGNW disposition in bedded salt formations. Initial results from this experiment show that water flow into the borehole is within previous experimental results. Further, we have found that the design of the heater block is restricting energy to flow into the rock salt. Thus, this test has proven useful in design of the next generation experiment where infrared heating may be used to bypass issues caused by air gaps located around the current stainless steel block heater. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Validation Experiments for Turbulent Separation over an Axisymmetric Body of Revolution

Historically, the flow physics involved with most turbulent separated flows have presented fundamental challenges to validating numerical approaches. As recognized by the CFD Vision 2030 study commissioned by NASA, validation of Reynolds-averaged Navier-Stokes (RANS) models and other scale-resolving methods for turbulent separated flow requires data from advanced, high-fidelity experiments designed specifically for CFD implementation. In accordance with this effort, a new test platform, referred to as the NASA Axisymmetric Afterbody, was designed to obtain detailed measurements of the flow field undergoing a smooth, adverse pressure gradient induced separation for a fixed Reynolds number, Re = 180,000. The parametric body offers a range of flow states progressing from fully attached, to incipient separation, and finally to small-scale separated flow based on variable afterbody geometries. In an initial effort to evaluate RANS turbulence model capabilities, the present configurations of the axisymmetric model host a mild adverse pressure gradient over the contoured boattail section, inducing incipient turbulent separation, as well as a slightly larger adverse pressure gradient, inducing a small-scale region of turbulent separation. Experiments include steady pressure measurements and 2-D PIV to provide the preliminary dataset for simulation studies, which examine the effect of variable grid domains and RANS turbulence models. This is done in an effort to understand and evaluate the critical variability between solutions for the present model configurations. Results indicate potential discrepancies may be due to the effect of the square tunnel test section walls, relatively large blockage ratio, and slight variability in reference parameters. Ongoing work will focus on higher fidelity experimental campaigns to obtain surface flow visualizations and Stereo-Particle Image Velocimetry (SPIV) to deliver higher spatial resolution of the three-dimensional flow field to aid turbulence modelers.

Validation↗

Using compressive sensing to recover images from PET scanners with partial detector rings

Purpose: Most positron emission tomography/computed tomography (PET/CT) scanners consist of tightly packed discrete detector rings to improve scanner efficiency. The authors’ aim was to use compressive sensing (CS) techniques in PET imaging to investigate the possibility of decreasing the number of detector elements per ring (introducing gaps) while maintaining image quality. Methods: A CS model based on a combination of gradient magnitude and wavelet domains (wavelet-TV) was developed to recover missing observations in PET data acquisition. The model was designed to minimize the total variation (TV) and L1-norm of wavelet coefficients while constrained by the partially observed data. The CS model also incorporated a Poisson noise term that modeled the observed noise while suppressing its contribution by penalizing the Poisson log likelihood function. Three experiments were performed to evaluate the proposed CS recovery algorithm: a simulation study, a phantom study, and six patient studies. The simulation dataset comprised six disks of various sizes in a uniform background with an activity concentration of 5:1. The simulated image was multiplied by the system matrix to obtain the corresponding sinogram and then Poisson noise was added. The resultant sinogram was masked to create the effect of partial detector removal and then the proposed CS algorithm was applied to recover the missing PET data. In addition, different levels of noise were simulated to assess the performance of the proposed algorithm. For the phantom study, an IEC phantom with six internal spheres each filled with F-18 at an activity-to-background ratio of 10:1 was used. The phantom was imaged twice on a RX PET/CT scanner: once with all detectors operational (baseline) and once with four detector blocks (11%) turned off at each of 0 °, 90 °, 180 °, and 270° (partially sampled). The partially acquired sinograms were then recovered using the proposed algorithm. For the third test, PET images from six patient studies were investigated using the same strategy of the phantom study. The recovered images using WTV and TV as well as the partially sampled images from all three experiments were then compared with the fully sampled images (the baseline). Comparisons were done by calculating the mean error (%bias), root mean square error (RMSE), contrast recovery (CR), and SNR of activity concentration in regions of interest drawn in the background as well as the disks, spheres, and lesions. Results: For the simulation study, the mean error, RMSE, and CR for the WTV (TV) recovered images were 0.26% (0.48%), 2.6% (2.9%), 97% (96%), respectively, when compared to baseline. For the partially sampled images, these results were 22.5%, 45.9%, and 64%, respectively. For the simulation study, the average SNR for the baseline was 41.7 while for WTV (TV), recovered image was 44.2 (44.0). The phantom study showed similar trends with 5.4% (18.2%), 15.6% (18.8%), and 78% (60%), respectively, for the WTV (TV) images and 33%, 34.3%, and 69% for the partially sampled images. For the phantom study, the average SNR for the baseline was 14.7 while for WTV (TV) recovered image was 13.7 (11.9). Finally, the average of these values for the six patient studies for the WTV-recovered, TV, and partially sampled images was 1%, 7.2%, 92% and 1.3%, 15.1%, 87%, and 27%, 25.8%, 45%, respectively. Conclusions: CS with WTV is capable of recovering PET images with good quantitative accuracy from partially sampled data. Such an approach can be used to potentially reduce the cost of scanners while maintaining good image quality.

60 APPLIED LIFE SCIENCES↗

PPI DataHub Project Data Package: S. elongatus PCC 7942 Limited Proteolysis and Thermal Proteome Profiling Structural Proteomics (JM-PB-DP3)

The purpose of this experiment was to investigate structural alterations in proteins involved in central carbon metabolism and photosynthetic electron transfer pathways in Synechococcus elongatus PCC 7942. Sample data was obtained from S. elongatus cell lysates using three complementary mass spectrometry (MS) techniques using limited proteolysis (LiP-MS), thermal proteome profiling (TPP-MS), and redox enrichment (Redox-MS) in evaluating alterations solvent accessibility and structural stability caused by light perturbation at the molecular level. Experimentally processed sample data for LiP and TPP proteomic datasets were derived from the same cell culture stock, prepared simultaneously in parallel, and acquired by mass spectrometry. Processed datasets are openly accessible from the download button and contain secondary processed proteomic results files, computed outputs, and supporting metadata materials. Experimental samples processed for LiP-MS label-free quantification (LFQ) or TPP-MS tandem mass tag (TMT) 10-plex were acquired using a Q-Exactive HF-X mass spectrometer and processed/compiled using either MSGF+ (v2024.03.26) or ​​​​PlexedPiper for proteome evaluation. Additional software supporting downstream proteomic analysis include FragPipe (v.4.0), MSFragger (v.22.1), and an adapted Microbial Isolate LiP Analysis Workflow (located at Zenodo). Processed proteomic data downloads include a sample naming key, normalized quantification results files, and processed protein annotated abundance files.

59 BASIC BIOLOGICAL SCIENCES↗

Evaluating the Impact of Residential Solar Contract Cancellations in the United States

The residential solar photovoltaic (PV) market in the United States is growing, despite frequent customer cancellations. Contract cancellations result in lost time and costs that must be borne by installers, often in the form of higher "soft costs" (i.e., non-equipment costs). These costs are often passed on to customers who successfully install PV systems. To date, few studies have attempted to estimate national cancellation rates or model the impacts on installed system costs. In this report, we utilize an installer-provided dataset of 199,665 residential PV-only projects representing about 10% of U.S. installs each year from 2017-2019. With this data, we evaluate cancellation rates and trends from contract signing to install. Next, by leveraging NREL's soft cost model for residential solar, we estimate installer spending through each phase of the pre-install process. Applying our findings on cancellation timelines and rates, we then estimate the potential cost impacts to successful installs from contract cancellations. Our work suggests that the rates and impacts of contract cancellations have been previously underestimated. Namely, we find that cancellations/unsuccessful project are; more common than previous estimates suggest; occur earlier in project timelines, though a significant number happen even after permit/ATB approvals; and contribute significantly to customer acquisition and other soft costs. We also find that cancellation do not appear to be driven by review delays in permitting and interconnection applications.

14 SOLAR ENERGY↗

Correlation approach for quality assurance of additive manufactured parts based on optical metrology

Surface topography and surface finish are two significant factors for evaluating the quality of products in additive manufacturing (AM). AM parts are fabricated layer by layer, which is quite different from traditional formative or subtractive methods. Despite rapid progress in additive manufacturing and associated optical metrology for quality control and in-situ monitoring, limited research has been conducted to investigate the reliability of 3D surface measurement data. The surface topologies scanned by multiple optical systems demonstrated significant differences due to varying sampling mechanisms, resolutions, system noises, etc. The 3D datasets should be trustworthy in order to extract parameters for quality assurance or feedback control from 3D surface measurements. In this paper, we set up new standards to evaluate the reliability of 3D surface measurement data and analyze the variation in the topographical profile. In this study, two non-contact optical methods based on Focus Variation Microscopy (FVM) and Structured Light System (SLS) were adopted to measure the surface topography of the target components. The two optical metrology systems generated two entirely different point cloud datasets. Statistical methods were applied to test the difference between the data obtained from the two systems. By using a data analytics approach for comparison, it was found that the surface roughness estimated from the point cloud data sets of FVM and SLS has no significant difference, though the point cloud data sets were completely different. This paper provides standard validation approach to evaluate the plausibility of metrology data from in-situ real-time surface analysis for process planning of AM.

36 MATERIALS SCIENCE↗

Evaluation of clinical IMRT treatment planning using the GATE Monte Carlo simulation platform for absolute and relative dose calculations

Purpose: The objective of this study was to evaluate and validate the use of the Geant4 application for emission tomography (GATE) Monte Carlo simulation platform for clinical intensity modulated radiotherapy (IMRT) dosimetry studies. Methods: The first step consisted of modeling a 6 MV photon beam linear accelerator (LINAC), with its corresponding validation carried out using percent depth dose evaluation, transverse profiles, tissue phantom ratio, and output factor on water phantom. The IMRT evaluation was performed by comparing simulation and measurements in terms of absolute and relative doses using IMRT dedicated quality assurance phantoms considering seven different patient datasets. Results: Concerning the LINAC simulated model validation tissue phantom ratios at 20 and 10 cm in water TPR{sub 10}{sup 20} obtained from GATE and measurements were 0.672 {+-} 0.063 and 0.675, respectively. In terms of percent depth dose and transverse profiles, error ranges were, respectively: 1.472%{+-} 0.285% and 4.827%{+-} 1.323% for field size of 4 Multiplication-Sign 4, 5 Multiplication-Sign 5, 10 Multiplication-Sign 10, 15 Multiplication-Sign 15, 20 Multiplication-Sign 20, 25 Multiplication-Sign 25, 30 Multiplication-Sign 30, and 40 Multiplication-Sign 40 cm{sup 2}. Most errors were observed at the edge of radiation fields because of higher dose gradient in these areas. Output factors showed good agreement between simulation and measurements with a maximum error of 1.22%. Finally, for IMRT simulations considering seven patient datasets, GATE provided good results with a relative error of 0.43%{+-} 0.25% on absolute dose between simulated and measured beams (measurements at the isocenter, volume 0.125 cm{sup 3}). Planar dose comparisons were also performed using gamma-index analysis. For the whole set of beams considered the mean gamma-index value was 0.497 {+-} 0.152 and 90.8%{+-} 3.6% of the evaluated dose points satisfied the 5%/ 4 mm criterion. Conclusions: These results show that GATE allows reliable simulation of complex beams in radiotherapy after an accurate LINAC modeling is validated. A simple cross-calibration procedure proposed in this work allows obtaining absolute dose values even in complex fields.

60 APPLIED LIFE SCIENCES↗

Ten questions on urban building energy modeling

Buildings in cities consume up to 70% of all primary energy. To achieve cities’ energy and climate goals, it is necessary to reduce energy use and associated greenhouse gas emissions in buildings through energy conservation and efficiency improvements. Computational tools empowered with rich urban datasets can model performance of buildings at the urban scale to provide quantitative insights for stakeholders and inform their decision making on urban energy planning, as well as building energy retrofits at scale, to achieve efficiency, sustainability, and resilience of urban buildings. Designing and operating urban buildings as a group (from a city block to a district to an entire city) rather than as single individuals requires simulation and optimization to account for interactions among buildings and between buildings and their surrounding urban environment, and for district energy systems serving multiple buildings with diverse thermal loads across space and time. When hundreds or more buildings are involved in typical urban building energy modeling (UBEM) to estimate annual energy demand, evaluate design or retrofit options, and quantify impacts of extreme weather events or climate change, it is crucial to integrate urban datasets and UBEM tools in a seamless automatic workflow with cloud or high-performance computing for users including urban planners, designers and researchers. This paper presents ten questions that highlight significant UBEM research and applications. The proposed answers in this work aim to stimulate discussion and provide insights into the current and future research on UBEM, and more importantly, to inspire new and important questions from young researchers in the field.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

A Novel Markerless Technique to Evaluate Daily Lung Tumor Motion Based on Conventional Cone-Beam CT Projection Data

Purpose: In this study, we present a novel markerless technique, based on cone beam computed tomography (CBCT) raw projection data, to evaluate lung tumor daily motion. Method and Materials: The markerless technique, which uses raw CBCT projection data and locates tumors directly on every projection, consists of three steps. First, the tumor contour on the planning CT is used to create digitally reconstructed radiographs (DRRs) at every projection angle. Two sets of DRRs are created: one showing only the tumor, and another with the complete anatomy without the tumor. Second, a rigid two-dimensional image registration is performed to register the DRR set without the tumor to the CBCT projections. After the registration, the projections are subtracted from the DRRs, resulting in a projection dataset containing primarily tumor. Finally, a second registration is performed between the subtracted projection and tumor-only DRR. The methodology was evaluated using a chest phantom containing a moving tumor, and retrospectively in 4 lung cancer patients treated by stereotactic body radiation therapy. Tumors detected on projection images were compared with those from three-dimensional (3D) and four-dimensional (4D) CBCT reconstruction results. Results: Results in both static and moving phantoms demonstrate that the accuracy is within 1 mm. The subsequent application to 22 sets of CBCT scan raw projection data of 4 lung cancer patients includes about 11,000 projections, with the detected tumor locations consistent with 3D and 4D CBCT reconstruction results. This technique reveals detailed lung tumor motion and provides additional information than conventional 4D images. Conclusion: This technique is capable of accurately characterizing lung tumor motion on a daily basis based on a conventional CBCT scan. It provides daily verification of the tumor motion to ensure that these motions are within prior estimation and covered by the treatment planning volume.

62 RADIOLOGY AND NUCLEAR MEDICINE↗