Search NASA⌕ Search

SEARCH · Search NASA

Results for “timing error evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,387 records · Page 77

Analysis of Prostate Patient Setup and Tracking Data: Potential Intervention Strategies

Purpose: To evaluate the setup, interfraction, and intrafraction organ motion error distributions and simulate intrafraction intervention strategies for prostate radiotherapy. Methods and Materials: A total of 17 patients underwent treatment setup and were monitored using the Calypso system during radiotherapy. On average, the prostate tracking measurements were performed for 8 min/fraction for 28 fractions for each patient. For both patient couch shift data and intrafraction organ motion data, the systematic and random errors were obtained from the patient population. The planning target volume margins were calculated using the van Herk formula. Two intervention strategies were simulated using the tracking data: the deviation threshold and period. The related planning target volume margins, time costs, and prostate position 'fluctuation' were presented. Results: The required treatment margin for the left-right, superoinferior, and anteroposterior axes was 8.4, 10.8, and 14.7 mm for skin mark-only setup and 1.3, 2.3, and 2.8 mm using the on-line setup correction, respectively. Prostate motion significantly correlated among the superoinferior and anteroposterior directions. Of the 17 patients, 14 had prostate motion within 5 mm of the initial setup position for {>=}91.6% of the total tracking time. The treatment margin decreased to 1.1, 1.8, and 2.3 mm with a 3-mm threshold correction and to 0.5, 1.0, and 1.5 mm with an every-2-min correction in the left-right, superoinferior, and anteroposterior directions, respectively. The periodic corrections significantly increase the treatment time and increased the number of instances when the setup correction was made during transient excursions. Conclusions: The residual systematic and random error due to intrafraction prostate motion is small after on-line setup correction. Threshold-based and time-based intervention strategies both reduced the planning target volume margins. The time-based strategies increased the treatment time and the in-fraction position fluctuation.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

"Designing, simulating, and performing the 100-AV field test for the CIRCLES consortium: Methodology and Implementation of the Largest mobile traffic control experiment to date"

Previous controlled experiments on single-lane ring roads have shown that a single partially autonomous vehicle (AV) can effectively mitigate traffic waves. This naturally prompts the question of how these findings can be generalized to field operational, high-density traffic conditions. To address this question, the Congestion Impacts Reduction via CAV-in-the-loop Lagrangian Energy Smoothing (CIRCLES) Consortium conducted MegaVanderTest (MVT), a live traffic control experiment involving 100 vehicles near Nashville, TN, USA. This article is a tutorial for developing analytical and simulation-based tools essential for designing and executing a live traffic control experiment like the MVT. It presents an overview of the proposed roadmap and various procedures used in designing, monitoring, and conducting the MVT, which is the largest mobile traffic control experiment at the time. The design process is aimed at evaluating the impact of the CIRCLES AVs on surrounding traffic. The article discusses the agent-based traffic simulation framework created for this evaluation. A novel methodological framework is introduced to calibrate this microsimulation, aiming to accurately capture traffic dynamics and assess the impact of adding 100 vehicles to existing traffic. The calibration model's effectiveness is verified using data from a six-mile section of Nashville's I-24 highway. The results indicate that the proposed model establishes an effective feedback loop between the optimizer and the simulator, thereby calibrating flow and speed with different spatiotemporal characteristics to minimize the error between simulated and real-world data. Finally, We simulate AVs in multiple scenarios to assess their effect on traffic congestion. This evaluation validates the AV routes, thereby contributing to the execution of a safe and successful live traffic control experiment via AVs.

Ameli, Mostafa↗

Towards local progression estimation of pulmonary emphysema using CT

Purpose: Whole lung densitometry on chest CT images is an accepted method for measuring tissue destruction in patients with pulmonary emphysema in clinical trials. Progression measurement is required for evaluation of change in health condition and the effect of drug treatment. Information about the location of emphysema progression within the lung may be important for the correct interpretation of drug efficacy, or for determining a treatment plan. The purpose of this study is therefore to develop and validate methods that enable the local measurement of lung density changes, which requires proper modeling of the effect of respiration on density. Methods: Four methods, all based on registration of baseline and follow-up chest CT scans, are compared. The first naïve method subtracts registered images. The second employs the so-called dry sponge model, where volume correction is performed using the determinant of the Jacobian of the transformation. The third and the fourth introduce a novel adaptation of the dry sponge model that circumvents its constant-mass assumption, which is shown to be invalid. The latter two methods require a third CT scan at a different inspiration level to estimate the patient-specific density-volume slope, where one method employs a global and the other a local slope. The methods were validated on CT scans of a phantom mimicking the lung, where mass and volume could be controlled. In addition, validation was performed on data of 21 patients with pulmonary emphysema. Results: The image registration method was optimized leaving a registration error below half the slice increment (median 1.0 mm). The phantom study showed that the locally adapted slope model most accurately measured local progression. The systematic error in estimating progression, as measured on the phantom data, was below 2 gr/l for a 70 ml (6%) volume difference, and 5 gr/l for a 210 ml (19%) difference, if volume correction was applied. On the patient data an underlying linearity assumption relating lung volume change with density change was shown to hold (fitR{sup 2} = 0.94), and globalized versions of the local models are consistent with global results (R{sup 2} of 0.865 and 0.882 for the two adapted slope models, respectively). Conclusions: In conclusion, image matching and subsequent analysis of differences according to the proposed lung models (i) has good local registration accuracy on patient data, (ii) effectively eliminates a dependency on inspiration level at acquisition time, (iii) accurately predicts progression in phantom data, and (iv) is reasonably consistent with global results in patient data. It is therefore a potential future tool for assessing local emphysema progression in drug evaluation trials and in clinical practice.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Using neural networks and Dyna algorithm for integrated planning, reacting and learning in systems

The traditional AI answer to the decision making problem for a robot is planning. However, planning is usually CPU-time consuming, depending on the availability and accuracy of a world model. The Dyna system generally described in earlier work, uses trial and error to learn a world model which is simultaneously used to plan reactions resulting in optimal action sequences. It is an attempt to integrate planning, reactive, and learning systems. The architecture of Dyna is presented. The different blocks are described. There are three main components of the system. The first is the world model used by the robot for internal world representation. The input of the world model is the current state and the action taken in the current state. The output is the corresponding reward and resulting state. The second module in the system is the policy. The policy observes the current state and outputs the action to be executed by the robot. At the beginning of program execution, the policy is stochastic and through learning progressively becomes deterministic. The policy decides upon an action according to the output of an evaluation function, which is the third module of the system. The evaluation function takes the following as input: the current state of the system, the action taken in that state, the resulting state, and a reward generated by the world which is proportional to the current distance from the goal state. Originally, the work proposed was as follows: (1) to implement a simple 2-D world where a 'robot' is navigating around obstacles, to learn the path to a goal, by using lookup tables; (2) to substitute the world model and Q estimate function Q by neural networks; and (3) to apply the algorithm to a more complex world where the use of a neural network would be fully justified. In this paper, the system design and achieved results will be described. First we implement the world model with a neural network and leave Q implemented as a look up table. Next, we use a lookup table for the world model and implement the Q function with a neural net. Time limitations prevented the combination of these two approaches. The final section discusses the results and gives clues for future work.

Lima, Pedro↗

Use of a realistic breathing lung phantom to evaluate dose delivery errors

Purpose: To compare the effect of respiration-induced motion on delivered dose (the interplay effect) for different treatment techniques under realistic clinical conditions. Methods: A flexible resin tumor model was created using rapid prototyping techniques based on a computed tomography (CT) image of an actual tumor. Twenty micro-MOSFETs were inserted into the tumor model and the tumor model was inserted into an anthropomorphic breathing phantom. Phantom motion was programed using the motion trajectory of an actual patient. A four-dimensional CT image was obtained and several treatment plans were created using different treatment techniques and planning systems: Conformal (Eclipse), step-and-shoot intensity-modulated radiation therapy (IMRT) (Pinnacle), step-and-shoot IMRT (XiO), dynamic IMRT (Eclipse), complex dynamic IMRT (Eclipse), hybrid IMRT [60% conformal, 40% dynamic IMRT (Eclipse)], volume-modulated arc therapy (VMAT) [single-arc (Eclipse)], VMAT [double-arc (Eclipse)], and complex VMAT (Eclipse). The complex plans were created by artificially pushing the optimizer to give complex multileaf collimator sequences. Each IMRT field was irradiated five times and each VMAT field was irradiated ten times, with each irradiation starting at a random point in the respiratory cycle. The effect of fractionation was calculated by randomly summing the measured doses. The maximum deviation for each measurement point per fraction and the probability that 95% of the model tumor had dose deviations less than 2% and 5% were calculated as a function of the number of fractions. Tumor control probabilities for each treatment plan were calculated and compared. Results: After five fractions, measured dose deviations were less than 2% for more than 95% of measurement points within the tumor model for all plans, except the complex dynamic IMRT, step-and-shoot IMRT (XiO), complex VMAT, and single-arc VMAT plans. Reducing the dose rate of the complex IMRT plans from 600 to 200 MU/min reduced the dose deviations to less than 2%. Dose deviations were less than 5% after five fractions for all plans, except the complex single-arc VMAT plan. Conclusions: Rapid prototyping techniques can be used to create realistic tumor models. For most treatment techniques, the dose deviations averaged out after several fractions. Treatments with unusually complicated multileaf collimator sequences had larger dose deviations. For IMRT treat-ments, dose deviations can be reduced by reducing the dose rate. For VMAT treatments, using two arcs instead of one is effective for reducing dose deviations.

60 APPLIED LIFE SCIENCES↗

Predicting lake surface water phosphorus dynamics using process-guided machine learning

Phosphorus (P) loading to lakes is degrading the quality and usability of water globally. Accurate predictions of lake P dynamics are needed to understand whole-ecosystem P budgets, as well as the consequences of changing lake P concentrations for water quality. However, complex biophysical processes within lakes, along with limited observational data, challenge our capacity to reproduce short-term lake dynamics needed for water quality predictions, as well as long-term dynamics needed to understand broad scale controls over lake P. Here we use an emerging paradigm in modeling, process-guided machine learning (PGML), to produce a phosphorus budget for Lake Mendota (Wisconsin, USA) and to accurately predict epilimnetic phosphorus over a time range of days to decades. In our implementation of PGML, which we term a Process-Guided Recurrent Neural Network (PGRNN), we combine a process-based model for lake P with a recurrent neural network, and then constrain the predictions with ecological principles. We test independently the process-based model, the recurrent neural network, and the PGRNN to evaluate the overall approach. The process-based model accounted for most of the observed pattern in lake P; however it missed the long-term trend in lake P and had the worst performance in predicting winter and summer P in surface waters. The root mean square error (RMSE) for the process-based model, the recurrent neural network, and the PGRNN was 33.0 μg P L -1 , 22.7 μg P L -1 , and 20.7 μg P L -1 , respectively. All models performed better during summer, with RMSE values for the three models (same order) equal to 14.3 μg P L -1 , 10.9 μg P L -1 , and 10.7 μg P L -1 . Although the PGRNN had only marginally better RMSE during summer, it had lower bias and reproduced long-term decreases in lake P missed by the other two models. For all seasons and all years, the recurrent neural network had better predictions than process alone, with root mean square error (RMSE) of 23.8 μg P L -1 and 28.0 μg P L -1 , respectively. The output of PGRNN indicated that new processes related to water temperature, thermal stratification, and long term changes in external loads are needed to improve the process model. By using ecological knowledge, as well as the information content of complex data, PGML shows promise as a technique for accurate prediction in messy, real-world ecological dynamics, while providing valuable information that can improve our understanding of process.

54 ENVIRONMENTAL SCIENCES↗

Spatiotemporally Adaptive Compression for Scientific Dataset with Feature Preservation – A Case Study on Simulation Data with Extreme Climate Events Analysis

Scientific discoveries are increasingly constrained by limited storage space and I/O capacities. For time-series simulations and experiments, their data often need to be decimated over timesteps to accommodate storage and I/O limitations. In this paper, we propose a technique that addresses storage costs while improving post-analysis accuracy through spatiotemporal adaptive, error-controlled lossy compression. We investigate the trade-off between data precision and temporal output rates, revealing that reducing data precision and increasing timestep frequency lead to more accurate analysis outcomes. Additionally, we integrate spatiotemporal feature detection with data compression and demonstrate that performing adaptive error-bounded compression in higher dimensional space enables greater compression ratios, leveraging the error propagation theory of a transformation-based compressor. To evaluate our approach, we conduct experiments using the well-known E3SM climate simulation code and apply our method to compress variables used for cyclone tracking. Our results show a significant reduction in storage size while enhancing the quality of cyclone tracking analysis, both quantitatively and qualitatively, in comparison to the prevalent timestep decimation approach. Compared to three state-of-the-art lossy compressors lacking feature preservation capabilities, our adaptive compression framework improves perfectly matched cases in TC tracking by 26.4-51.3% at medium compression ratios and by 77.3-571.1% at large compression ratios, with a merely 5–11% computational overhead.

Gong, Qian↗

Characteristics and performance of the first commercial multileaf collimator for a robotic radiosurgery system

Purpose: The “InCise™ multileaf-collimator (MLC)” is the first commercial MLC to be mounted on a robotic SRS/SBRT platform (CyberKnife). The authors assessed characteristics and performance of this novel device in a preclinical five months test period. Methods: Commissioning beam data were acquired with unshielded diodes. EBT3 radiochromic films were employed for measurement of transmission, leaf/bank position accuracy (garden fence) before and after exercising the MLC, for end-to-end testing and further characterization of the beam. The robot workspace with MLC was assessed analytically by transformation to an Euler geometry (“plane,” “gantry,” and “collimator” angles) and by measuring pointing accuracy at each node. Stability over time was evaluated in picket fence and adapted Winston–Lutz tests (AQA). Results: Beam penumbrae (80%–20%, with 100% = 2 × dose at inflection point for field sizes ≥ 50 × 50 mm{sup 2}) were 2.2–3.7 mm for square fields in reference condition (source-axis-distance 800 mm, depth 15 mm) and depended on field size and off-axis position. Transmission and leakage did not exceed 0.5%. Accessible clinical workspace with MLC covered non-coplanar gantry angles of [−113°; +112°] and collimator angles of [−100°; +107°], with an average robot pointing accuracy of 0.12 ± 0.09 mm. For vertical beams, garden fence tests exhibited an average leaf positioning error of ≤0.2 mm, which increased by 0.25 and 0.30 mm (banks X1 and X2) with leaves traveling parallel to gravity. After execution of a leaf motion stress routine, garden fence tests showed slightly increased jaggedness and allowed to identify one malfunctioning leaf motor. Total system accuracy with MLC was 0.38 ± 0.05 mm in nine end-to-end tests. Picket fence and AQA tests displayed stable results over the test period. Conclusions: The InCise™ MLC for CyberKnife showed high accuracy and adequate characteristics for SRS/SBRT applications. MLC performance after exercise demands specific quality assurance measures.

60 APPLIED LIFE SCIENCES↗

Doppler-Lidar Evaluation of HRRR-Model Skill at Simulating Summertime Wind Regimes in the Columbia River Basin during WFIP2

Complex-terrain locations often have repeatable near-surface wind patterns, such as synoptic gap flows and local thermally forced flows. An example is the Columbia River Valley in east-central Oregon-Washington, a significant wind-energy-generation region and the site of the Second Wind-Forecast Improvement Project (WFIP2). Data from three Doppler lidars deployed during WFIP2 define and characterize summertime wind regimes and their large-scale contexts, and provide insight into NWP model errors by examining differences in the ability of a model [NOAA’s High-Resolution Rapid-Refresh (HRRR-version1)] to forecast wind-speed profiles for different regimes. Seven regimes were identified based on daily time series of the lidar-measured rotor-layer winds, which then suggested two broad categories. First, in three regimes the primary dynamic forcing was the large-scale pressure gradient. Second, in two regimes the dominant forcing was the diurnal heating-cooling cycle (regional sea-breeze-type dynamics), including the marine intrusion previously described, which generates strong nocturnal winds over the region. The other two included a hybrid regime and a non-conforming regime. For the large-scale pressure-gradient regimes, HRRR had wind-speed biases of ~1 m s -1 and RMSEs of 2-3 m s -1 . Errors were much larger for the thermally forced regimes, owing to the premature demise of the strong nocturnal flow in HRRR. Thus, the more dominant the role of surface heating in generating the flow, the larger the errors. Major errors could result from surface heating of the atmosphere, boundary-layer responses to that heating, and associated terrain interactions. Finally, measurement/modeling research programs should be aimed at determining which modeled processes produce the largest errors, so those processes can be improved and errors reduced.

17 WIND ENERGY↗

Large Language Model for Validation, Optical Calibration, and Learning (VOCAL) Distributed Temperature Sensing Interface

Distributed temperature sensing (DTS) using fiber optic sensors (FOS) offers a promising method for temperature measurements in advanced reactors, such as sodium fast reactors and molten salt cooled reactors. To support the calibration and validation of DTS measurements, Argonne National Laboratory developed the Validation, Optical Calibration, and Learning (VOCAL) software package. This report describes the integration of a local large language model (LLM) with a retrieval-augmented generation (RAG) system into the VOCAL interface to serve as an interactive user assistant. The LLM framework enhances the VOCAL platform’s accessibility to users by explaining interface components, clarifying inputs and outputs, and answering user queries dynamically in real-time. The accuracy of the LLM assistant performance was evaluated with 20 queries regarding the interface and its parameters using experimental data from the Thermal Hydraulic Experimental Test Article (THETA) facility. Results demonstrate that the LLM achieved a 95% accuracy rate, with a BERTScore of 0.8816 and SBERT value of 0.7417. Furthermore, validation of the RAG system within the LLM framework showed optimal accuracy with k-values between 1 and 2 using the k-refinement convergence test. The prompt perturbation analysis demonstrated good initial consistency for the RAG system, exhibiting the highest accuracy under punctuation variations and the greatest sensitivity under query reordering. Notably, the model’s errors were limited to data retrieval failures rather than factual hallucinations, reinforcing its baseline reliability. The integration of LLM provides a highly accurate, userfriendly enhancement to the VOCAL platform without disrupting its core computational capabilities for FOS calibration and validation.

Hong, Evan↗

Digitizing Today’s Buildings in the Real World: Lessons from Field Demonstrations

Digital twins, created by generating a virtual replica of a building, enable safe evaluation of operational scenarios and applications like fault detection and diagnosis and advanced controls. However, a prerequisite is the creation of a machine-readable digital representation of a building, currently hindered by fragmented information scattered across mechanical drawings, point lists, and natural language sequences. As a result, digital twin development remains labor-intensive, error-prone, and difficult to validate. To address these challenges, two efforts from ASHRAE aim to support the digitalization of buildings. ASHRAE s223 establishes a semantic model of buildings, representing system components, configuration, and data sources. ASHRAE s231 defines a vendor-neutral programming language for expressing their control logic. As the industry evaluates implementing them in their products, understanding the challenges that vendors and implementers may face is crucial. In this paper, we present findings and lessons learned from field demonstrations in five buildings that implemented control applications using ASHRAE s223 and s231. The demonstrations highlight how semantic modeling and formalized control descriptions can significantly reduce software development time, manual point mapping, and hard-coding. Beyond time efficiency, they enable reliable automation by minimizing human interpretation and providing a means for consistency across projects. We describe the processes and best practices for model creation and model usage, from translating heterogeneous building documentation into semantic representations to implementing control logic in real-world systems. Finally, we discuss the challenges that persist, including integration with legacy software environments, gaps in interoperability, and the level of expertise still required to effectively leverage semantic models.

Prakash, Anand Krishnan↗

Optimal GSTDN/TDRSS bit error rate evaluation using limited sample sizes

Statistical studies of telemetry errors were made on data from the Solar Mesosphere Explorer (SME). Examination of frame sync words, as received at the ground station, indicated a wide spread of Bit Error Rates (BER) among stations. A study of the distribution of errors per station pass, however, showed that there was a tendency for the station software to add an even number of spurious errors to the count. A count of wild points in science data, rejecting drop-outs and other system errors, yielded an average random BER of 3.1 x 10 to the -6 with 99% confidence limits of 2.6 and 3.8 x 10 to the -6. The system errors are typically 5 to 100 times more frequent than the truly random errors.

Coffey, R. E.↗

Usefulness of Guided Breathing for Dose Rate-Regulated Tracking

Purpose: To evaluate the usefulness of guided breathing for dose rate-regulated tracking (DRRT), a new technique to compensate for intrafraction tumor motion. Methods and Materials: DRRT uses a preprogrammed multileaf collimator sequence that tracks the tumor motion derived from four-dimensional computed tomography and the corresponding breathing signals measured before treatment. Because the multileaf collimator speed can be controlled by adjusting the dose rate, the multileaf collimator positions are adjusted in real time during treatment by dose rate regulation, thereby maintaining synchrony with the tumor motion. DRRT treatment was simulated with free, audio-guided, and audiovisual-guided breathing signals acquired from 23 lung cancer patients. The tracking error and duty cycle for each patient were determined as a function of the system time delay (range, 0-1.0 s). Results: The tracking error and duty cycle averaged for all 23 patients was 1.9 {+-} 0.8 mm and 92% {+-} 5%, 1.9 {+-} 1.0 mm and 93% {+-} 6%, and 1.8 {+-} 0.7 mm and 92% {+-} 6% for the free, audio-guided, and audiovisual-guided breathing, respectively, for a time delay of 0.35 s. The small differences in both the tracking error and the duty cycle with guided breathing were not statistically significant. Conclusion: DRRT by its nature adapts well to variations in breathing frequency, which is also the motivation for guided-breathing techniques. Because of this redundancy, guided breathing does not result in significant improvements for either the tracking error or the duty cycle when DRRT is used for real-time tumor tracking.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Carbon-Ion Pencil Beam Scanning Treatment With Gated Markerless Tumor Tracking: An Analysis of Positional Accuracy

Purpose: Having implemented amplitude-based respiratory gating for scanned carbon-ion beam therapy, we sought to evaluate its effect on positional accuracy and throughput. Methods and Materials: A total of 10 patients with tumors of the lung and liver participated in the first clinical trials at our center. Treatment planning was conducted with 4-dimensional computed tomography (4DCT) under free-breathing conditions. The planning target volume (PTV) was calculated by adding a 2- to 3-mm setup margin outside the clinical target volume (CTV) within the gating window. The treatment beam was on when the CTV was within the PTV. Tumor position was detected in real time with a markerless tumor tracking system using paired x-ray fluoroscopic imaging units. Results: The patient setup error (mean ± SD) was 1.1 ± 1.2 mm/0.6 ± 0.4°. The mean internal gating accuracy (95% confidence interval [CI]) was 0.5 mm. If external gating had been applied to this treatment, the mean gating accuracy (95% CI) would have been 4.1 mm. The fluoroscopic radiation doses (mean ± SD) were 23.7 ± 21.8 mGy per beam and less than 487.5 mGy total throughout the treatment course. The setup, preparation, and irradiation times (mean ± SD) were 8.9 ± 8.2 min, 9.5 ± 4.6 min, and 4.0 ± 2.4 min, respectively. The treatment room occupation time was 36.7 ± 67.5 min. Conclusions: Internal gating had a much higher accuracy than external gating. By the addition of a setup margin of 2 to 3 mm, internal gating positional error was less than 2.2 mm at 95% CI.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Development and evaluation of a Fault-Tolerant Multiprocessor (FTMP) computer. Volume 3: FTMP test and evaluation

The experimental test and evaluation of the Fault-Tolerant Multiprocessor (FTMP) is described. Major objectives of this exercise include expanding validation envelope, building confidence in the system, revealing any weaknesses in the architectural concepts and in their execution in hardware and software, and in general, stressing the hardware and software. To this end, pin-level faults were injected into one LRU of the FTMP and the FTMP response was measured in terms of fault detection, isolation, and recovery times. A total of 21,055 stuck-at-0, stuck-at-1 and invert-signal faults were injected in the CPU, memory, bus interface circuits, Bus Guardian Units, and voters and error latches. Of these, 17,418 were detected. At least 80 percent of undetected faults are estimated to be on unused pins. The multiprocessor identified all detected faults correctly and recovered successfully in each case. Total recovery time for all faults averaged a little over one second. This can be reduced to half a second by including appropriate self-tests.

Lala, J. H.↗

Use of Uncertainty in Modeling DFLAW Treatment at Hanford - 17115

Average or mean is understood by most; standard deviation (SD) is understood by few. Certainty is easy to model; uncertainty is not. The flowsheet simulation, described in this paper, placed uncertainties in the G2 model of the Hanford Tank Waste Treatment and Immobilization Plant's (WTP) Direct Feed Low-Activity Waste (DFLAW) process for performance and sensitivity evaluations. G2 is a dynamic material balance model that starts and proceeds with operating logic until all the feed is processed. Dynamic material balance is achieved by tracking the flows, storage, and change of all materials within the plant as time increments. Processing equipment and limitations of the flowsheet are modeled (e.g., equipment types, piping, volumes, flowrates, efficiencies, and physical and chemical environments that impact separations, phase equilibriums, and chemical reactions). Operating logic represents the rules and strategies of a running plant. The G2 model simulated both certainty and uncertainty scenarios for comparison purposes. For the uncertainty scenarios, process decisions were made using presumed values to simulate various operational measurement errors and process variabilities. Presumed means that the known G2 values are adjusted to replicate measurement errors and variabilities. These include: 1) volume measurement, 2) sample analysis, 3) melter decontamination factor (DF), 4) glass former weighing, and 5) glass former composition variations. The errors were randomly generated in accordance with SD values of measurement devices, laboratory methods, and glass former composition ranges. The G2 model runs give insight on the DFLAW process' controllability and the expected range of glass properties. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

The effects of bias, drift, and trends in calculating anomalies for evaluating skill of seasonal-to-decadal initialized climate predictions

In initialized seasonal to decadal (S2D) predictions, model hindcasts rapidly drift away from the initial observed state and converge toward a preferred state characterized by systematic error, or bias. Bias and drift are among the greatest challenges facing initialized prediction today. Differences in trends between initial states and drifted states, combined with bias and drift, introduce complexities in calculating anomalies to assess skill of initialized predictions. We examine several methods of calculating anomalies using the Decadal Prediction Large Ensemble (DPLE) using the Community Earth System Model (CESM) initialized hindcasts and focus on Pacific and Atlantic SSTs to illustrate issues with anomaly calculations. Three methods of computing anomalies, one as differences from a long term model climatology, another as bias-adjusted differences from the previous 15 year average from observations, and a third as differences from the previous 15 year average from the model, are contrasted and each is shown to have limitations. For the first, trends in bias and drift introduce higher skill estimates earlier and later in the hindcast period due to the trends that contribute to skill. For the second, higher skill can be introduced in situations where low frequency variability in the observations is large compared to the hindcasts on timescales greater than 15 years, while lower skill can result if the predicted signal is small and the bias-correction itself produces a transition of SST anomalies to the opposite sign of those that are observed. The third method has somewhat lower skill compared to each of the others, but has less difficulties with not only the long term trends in the model climatology, but also with the unrealistic situational skill from using observations as a reference. However, the first 15 years of the hindcast period cannot be evaluated due to having to wait to accumulate the previous 15 year model climatology before the method can be applied. Here, the IPO transition in the 2014–2016 time frame from negative to positive (predicted by Meehl et al. in in Nat Commun, 10.1038/NCOMMS11718, 2016) did indeed verify using all three methods, though each provides somewhat different skill values as a result of the respective limitations. There is no clear best method, as all are roughly comparable, and each has its own set of limitations and caveats. However, all three methods show generally higher overall skill in the AMO region compared to the IPO region.

54 ENVIRONMENTAL SCIENCES↗

Evaluation of the 2008 Predictions of Run-Timing and Survival of Wild Migrant Yearling Chinook and Steelhead on the Columbia and Snake Rivers.

Columbia Basin Research uses the COMPASS model on a daily basis during the outmigration of Snake River Chinook and steelhead smolts to predict downstream passage and survival. Fish arrival predictions and observations from program RealTime along with predicted and observed environmental conditions are used to make in-season predictions of arrival and survival to various dams in the Columbia and Snake Rivers. For 2008, calibrations of travel and survival parameters for two stocks of fish-Snake River yearling PIT-tagged wild chinook salmon (chin1pit) and Snake River PIT-tagged steelhead (lgrStlhd)-were used to model travel and survival of steelhead and chinook stocks from Lower Granite Dam (LWG) or McNary Dam (MCN) to Bonneville Dam (BON). This report summarizes the success of the COMPASS/RealTime process to model these migrations as they occur. We compared model results on timing and survival to data from two sources: stock specific counts at dams and end-of-season control survival estimates (Jim Faulkner, NOAA, pers. comm. Dec. 16, 2008). The difference between the predicted and observed day of median passage and the Mean Absolute Deviation (MAD) between predicted and observed arrival cumulative distributions are measures of timing accuracy. MAD is essentially the average percentage error over the season. The difference between the predicted and observed survivals is a measure of survival accuracy. Model results and timing data were in good agreement from LWG to John Day Dam (JDA). Predictions of median passage days for the chin1pit and lgrStlhd stocks were 0 and 2 days (respectively) later than observed. MAD for chin1pit and lgrStlhd stocks at JDA were 2.3% and 5.9% (respectively). Between JDA and BON modeling and timing data were not as well matched. At BON, median passage predictions were 6 and 10 days later than observed and MAD values were 7.8% and 16.0% respectively. Model results and survival data were in good agreement from LWG to MCN. COMPASS predicted survivals of 0.77 and 0.69 for chin1pit and lgrStlhd, while the data control's survivals were 0.79 and 0.68. The differences are 0.02 and 0.01 (respectively), nearly identical. However, from MCN to BON, COMPASS predicted survivals of 0.74 and 0.69 while the data controls survivals were 0.47 and 0.53 respectively. Differences of 0.27 and 0.16. In summary: Travel and survival of chin1pit and lgrStlhd stocks were well modeled in the upper reaches. Fish in the lower reaches down through BON suffered unmodeled mortality, and/or passed BON undetected. A drop in bypass fraction and unmodeled mortality during the run could produce such patterns by shifting the observed median passage day to appear artificially early.

13 HYDRO ENERGY↗