Search NASA⌕ Search

SEARCH · Search NASA

Results for “validation studies”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

Modeling and Evaluating Pilot Performance in NextGen: Review of and Recommendations Regarding Pilot Modeling Efforts, Architectures, and Validation Studies

NextGen operations are associated with a variety of changes to the national airspace system (NAS) including changes to the allocation of roles and responsibilities among operators and automation, the use of new technologies and automation, additional information presented on the flight deck, and the entire concept of operations (ConOps). In the transition to NextGen airspace, aviation and air operations designers need to consider the implications of design or system changes on human performance and the potential for error. To ensure continued safety of the NAS, it will be necessary for researchers to evaluate design concepts and potential NextGen scenarios well before implementation. One approach for such evaluations is through human performance modeling. Human performance models (HPMs) provide effective tools for predicting and evaluating operator performance in systems. HPMs offer significant advantages over empirical, human-in-the-loop testing in that (1) they allow detailed analyses of systems that have not yet been built, (2) they offer great flexibility for extensive data collection, (3) they do not require experimental participants, and thus can offer cost and time savings. HPMs differ in their ability to predict performance and safety with NextGen procedures, equipment and ConOps. Models also vary in terms of how they approach human performance (e.g., some focus on cognitive processing, others focus on discrete tasks performed by a human, while others consider perceptual processes), and in terms of their associated validation efforts. The objectives of this research effort were to support the Federal Aviation Administration (FAA) in identifying HPMs that are appropriate for predicting pilot performance in NextGen operations, to provide guidance on how to evaluate the quality of different models, and to identify gaps in pilot performance modeling research, that could guide future research opportunities. This research effort is intended to help the FAA evaluate pilot modeling efforts and select the appropriate tools for future modeling efforts to predict pilot performance in NextGen operations.

pilot human performance models↗

Prospective Study Validating Inter- and Intraobserver Variability of Tissue Compliance Meter in Breast Tissue of Healthy Volunteers: Potential Implications for Patients With Radiation-Induced Fibrosis of the Breast

Purpose: Accurate detection of radiation-induced fibrosis (RIF) is crucial in management of breast cancer survivors. Tissue compliance meter (TCM) has been validated in musculature. We validate TCM in healthy breast tissue with respect to interobserver and intraobserver variability before applying it in RIF. Methods and Materials: Three medical professionals obtained three consecutive TCM measurements in each of the four quadrants of the right and left breasts of 40 women with no breast disease or surgical intervention. The intraclass correlation coefficient (ICC) assessed interobserver variability. The paired t test and Pearson correlation coefficient (r) were used to assess intraobserver variability within each rater. Results: The median age was 45 years (range, 24-68 years). The median bra size was 35C (range, 32A-40DD). Of the participants, 27 were white (67%), 4 black (10%), 5 Asian (13%), and 4 Hispanic (10%). ICCs indicated excellent interrater reliability (low interobserver variability) among the three raters, by breast and quadrant (all ICC {>=}0.99). The paired t test and Pearson correlation coefficient both indicated low intraobserver variability within each rater (right vs. left breast), stratified by quadrant (all r{>=} 0.94, p < 0.0001). Conclusions: The interobserver and intraobserver variability is small using TCM in healthy mammary tissue. We are now embarking on a prospective study using TCM in women with breast cancer at risk of developing RIF that may guide early detection, timely therapeutic intervention, and assessment of success of therapy for RIF.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Multi-institutional Validation Study of Commercially Available Deformable Image Registration Software for Thoracic Images

Purpose: To assess the accuracy of the commercially available deformable image registration (DIR) software for thoracic images at multiple institutions. Methods and Materials: Thoracic 4-dimensional (4D) CT images of 10 patients with esophageal or lung cancer were used. Datasets for these patients were provided by DIR-lab ( (dir-lab.com)) and included a coordinate list of anatomic landmarks (300 bronchial bifurcations) that had been manually identified. Deformable image registration was performed between the peak-inhale and -exhale images. Deformable image registration error was determined by calculating the difference at each landmark point between the displacement calculated by DIR software and that calculated by the landmark. Results: Eleven institutions participated in this study: 4 used RayStation (RaySearch Laboratories, Stockholm, Sweden), 5 used MIM Software (Cleveland, OH), and 3 used Velocity (Varian Medical Systems, Palo Alto, CA). The ranges of the average absolute registration errors over all cases were as follows: 0.48 to 1.51 mm (right-left), 0.53 to 2.86 mm (anterior-posterior), 0.85 to 4.46 mm (superior-inferior), and 1.26 to 6.20 mm (3-dimensional). For each DIR software package, the average 3-dimensional registration error (range) was as follows: RayStation, 3.28 mm (1.26-3.91 mm); MIM Software, 3.29 mm (2.17-3.61 mm); and Velocity, 5.01 mm (4.02-6.20 mm). These results demonstrate that there was moderate variation among institutions, although the DIR software was the same. Conclusions: We evaluated the commercially available DIR software using thoracic 4D-CT images from multiple centers. Our results demonstrated that DIR accuracy differed among institutions because it was dependent on both the DIR software and procedure. Our results could be helpful for establishing prospective clinical trials and for the widespread use of DIR software. In addition, for clinical care, we should try to find the optimal DIR procedure using thoracic 4D-CT data.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

SU-F-18C-08: A Validation Study of a Commercially Available Software Package's Absorbed Dose Estimates in a Physical Phantom

Purpose: This study assesses the accuracy of the absorbed dose estimates from CT scans generated by Monte Carlo (MC) simulation using a commercially available radiation dose monitoring software program. Methods: Axial CT studies of an anthropomorphic abdomen phantom with dose bores at a central location and 4 peripheral locations were conducted using a fixed tube current at 120 kV. A 100 mm ion chamber and a 0.6 cc ion chamber calibrated at diagnostic energy levels were used to measure dose in the phantom at each of the 5 dose bore locations. Simulations using the software program's Monte Carlo engine were run using a mathematical model of the anthropomorphic phantom to determine conversion coefficients between the CTDIvol used for the study and the dose at the location of the dose bores. Simulations were conducted using both the software's generic CT beam model and a refined model generated using HVL and bow tie filter profile measurements made on the scanner used for the study. Results: Monte Carlo simulations completed using the generalized beam model differed from the measured conversion factors by an absolute value average of 13.0% and 13.8% for the 100 mm and 0.6 cc ion chamber studies, respectively. The MC simulations using the scanner specific beam model generated conversion coefficients that differed from the CTDIvol to measured dose conversion coefficients by an absolute value average of 7.3% and 7.8% for the 100 mm and 0.6 cc ion chamber cases, respectively. Conclusion: A scanner specific beam model used in MC simulations generates more accurate dose conversion coefficients in an anthropomorphic phantom than those generated with a generalized beam model. Agreement between measured conversion coefficients and simulated values were less than 20% for all positions using the universal beam model.

07 ISOTOPE AND RADIATION SOURCES↗

Bifacial PV Module Energy Modeling Validation Study

The cost delta between monofacial and bifacial photovoltaic (PV) modules was decreasing in 2018 when this study was initially proposed, making bifacial modules an attractive offering. However, there were limited field studies available that could be considered utility-scale representative, and PV module manufacturers were stating large ranges for the expected energy yield improvements of bifacial technology. This generated uncertainties regarding bifacial performance gains and the actual LCOE (levelized cost of energy). There was also relatively low confidence in the industry’s energy modeling tools’ ability to accurately predict bifacial energy yield, meaning that early adopters of bifacial modules were not able to fully account for the increased energy yield in their energy and financial models. The intent of this project was to provide the solar industry with greater certainty on the energy yield gains of bifacial modules and provide higher confidence in the ability for different energy modeling software to model bifacial PV site performance. Achieving this would allow for bifacial technology to become bankable (i.e. accepted by Independent Engineers, site financiers and other PV site stakeholders), offering a step change in PV site performance that had not been seen since the widespread adoption of the single-axis tracker. Over the course of this study other economic factors including a significant tariff exemption for bifacial modules resulted in accelerated adoption of bifacial technology throughout the US utility scale solar segment. The number of early adopters increased rapidly, and with many investors accepting this module choice the question of bifacial bankability was seemingly answered faster than expected. However, PVEL’s study has still achieved significant accomplishments in demonstrating the accuracy of bifacial modeling across three different software platforms. The results of this study have shown that the mean biased error (MBE) between the field data and the predicted values from all three software platforms were aligned with a maximum MBE of 1.3% and a minimum MBE of -1.8%.

14 SOLAR ENERGY↗