Search NASA⌕ Search

SEARCH · Search NASA

Results for “blind comparison”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Lensing without borders – I. A blind comparison of the amplitude of galaxy–galaxy lensing between independent imaging surveys

ABSTRACT Lensing without borders is a cross-survey collaboration created to assess the consistency of galaxy–galaxy lensing signals (ΔΣ) across different data sets and to carry out end-to-end tests of systematic errors. We perform a blind comparison of the amplitude of ΔΣ using lens samples from BOSS and six independent lensing surveys. We find good agreement between empirically estimated and reported systematic errors which agree to better than 2.3σ in four lens bins and three radial ranges. For lenses with zL > 0.43 and considering statistical errors, we detect a 3–4σ correlation between lensing amplitude and survey depth. This correlation could arise from the increasing impact at higher redshift of unrecognized galaxy blends on shear calibration and imperfections in photometric redshift calibration. At zL > 0.54, amplitudes may additionally correlate with foreground stellar density. The amplitude of these trends is within survey-defined systematic error budgets that are designed to include known shear and redshift calibration uncertainty. Using a fully empirical and conservative method, we do not find evidence for large unknown systematics. Systematic errors greater than 15 per cent (25 per cent) ruled out in three lens bins at 68 per cent (95 per cent) confidence at z < 0.54. Differences with respect to predictions based on clustering are observed to be at the 20–30 per cent level. Our results therefore suggest that lensing systematics alone are unlikely to fully explain the ‘lensing is low’ effect at z < 0.54. This analysis demonstrates the power of cross-survey comparisons and provides a promising path for identifying and reducing systematics in future lensing analyses.

79 ASTRONOMY AND ASTROPHYSICS↗

A Paired, Double-Blind, Randomized Comparison of a Moisturizing Durable Barrier Cream to 10% Glycerine Cream in the Prophylactic Management of Postmastectomy Irradiation Skin Care: Trans Tasman Radiation Oncology Group (TROG) 04.01

Purpose: A previous, unblinded study demonstrated that an alcohol-free barrier film containing an acrylate terpolymer (ATP) was effective in reducing skin reactions compared with a 10% glycerine cream (sorbolene). The different appearances of these products precluded a blinded comparison. To test the acrylate terpolymer principle in a double-blinded manner required the use of an alternative cream formulation, a moisturizing durable barrier cream (MDBC); the study was conducted by the Trans Tasman Radiation Oncology Group (TROG) as protocol 04.01. Methods and Materials: A total of 333 patients were randomized; 1 patient was ineligible and 14 patients withdrew or had less than 7 weeks' observations, leaving 318 for analysis. The chest wall was divided into medial and lateral compartments, and patients were randomized to have MDBC applied daily to the medial or lateral compartment and sorbolene to the other compartment. Weekly observations, photographs, and symptom scores (pain and pruritus) were collected to week 12 or resolution of skin reactions if earlier. Skin dose was confirmed by centrally calibrated thermoluminescent dosimeters. Results: Rates of medial and lateral compartment Common Toxicity Criteria (CTC), version 3, greater than or equal to grade 3 skin reactions were 23% and 41%, but rates by skin care product were identical at 32%. There was no significant difference between MDBC and sorbolene in the primary endpoint of peak skin reactions or secondary endpoints of area-under-the-curve skin reaction scores. Conclusions: The MDBC did not reduce the peak skin reaction compared to sorbolene. It is possible that this is related to the difference in the formulation of the cream compared with the film formulation. Skin dosimetry verification and double blinding are essential for radiation skin care comparative studies.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Analysis of Phenix natural convection test with the TRACE code

Experimental data from the Natural Convection (NC) test performed in the Phenix reactor prior to its final shutdown have been used to further validate the single-phase sodium flow modeling in TRACE. The experimental data for the benchmark have been shared by the CEA in the frame of a Coordinated Research Project (CRP), initiated by the IAEA Technical Working Group on Fast Reactors (TWG-FR). This paper presents a complete TRACE model of the Phenix primary circuit developed for the analysis. Steady-state calculations at nominal (350 MWth) and reduced (120 MWth) power are compared to the experimental data for the validation of the model. We presents results from the 'blind' comparison, i.e. the comparison of the test results with those computed prior to the communication of the experimental data, so-called 'pre-test' results. 'Post-test' results, calculated from a model improved on the basis of the discrepancies identified from the blind comparison, are also presented. The analysis highlights the need to accurately simulate the reactor structures, since these define the thermal inertia of the system during the first phase of the transient. Furthermore, it shows the limitations of computed 1D-results when applied to the simulation of highly-stratified temperature fields. Nevertheless, the simulated reactor behavior and temperatures are found to match very well with the experimental data after the first two hours and, in general, the TRACE blind predictions may be considered as having been quite satisfactory. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

A computational modeling framework for pre-clinical evaluation of cardiac mapping systems

There are a variety of difficulties in evaluating clinical cardiac mapping systems, most notably the inability to record the transmembrane potential throughout the entire heart during patient procedures which prevents the comparison to a relevant “gold standard”. Cardiac mapping systems are comprised of hardware and software elements including sophisticated mathematical algorithms, both of which continue to undergo rapid innovation. The purpose of this study is to develop a computational modeling framework to evaluate the performance of cardiac mapping systems. The framework enables rigorous evaluation of a mapping system’s ability to localize and characterize (i.e., focal or reentrant) arrhythmogenic sources in the heart. The main component of our tool is a library of computer simulations of various dynamic patterns throughout the entire heart in which the type and location of the arrhythmogenic sources are known. Our framework allows for performance evaluation for various electrode configurations, heart geometries, arrhythmias, and electrogram noise levels and involves blind comparison of mapping systems against a “silver standard” comprised of computer simulations in which the precise transmembrane potential patterns throughout the heart are known. A feasibility study was performed using simulations of patterns in the human left atria and three hypothetical virtual catheter electrode arrays. Activation times (AcT) and patterns (AcP) were computed for three virtual electrode arrays: two basket arrays with good and poor contact and one high-resolution grid with uniform spacing. The average root mean squared difference of AcTs of electrograms and those of the nearest endocardial action potential was less than 1 ms and therefore appears to be a poor performance metric. In an effort to standardize performance evaluation of mapping systems a novel performance metric is introduced based on the number of AcPs identified correctly and those considered spurious as well as misclassifications of arrhythmia type; spatial and temporal localization accuracy of correctly identified patterns was also quantified. This approach provides a rigorous quantitative analysis of cardiac mapping system performance. Proof of concept of this computational evaluation framework suggests that it could help safeguard that mapping systems perform as expected as well as provide estimates of system accuracy.

59 BASIC BIOLOGICAL SCIENCES↗

Mometasone Furoate Cream Reduces Acute Radiation Dermatitis in Patients Receiving Breast Radiation Therapy: Results of a Randomized Trial

Purpose: We wanted to confirm the benefit of mometasone furoate (MF) in preventing acute radiation reactions, as shown in a previous study (Boström et al, Radiother Oncol 2001;59:257-265). Methods and Materials: The study was a double-blind comparison of MF with D (Diprobase), administered daily from the start of radiation therapy for 5 weeks in patients receiving breast radiation therapy, 40 Gy in 2.67-Gy fractions daily over 3 weeks. The primary endpoint was mean modified Radiation Therapy Oncology Group (RTOG) score. Results: Mean RTOG scores were significantly less for MF than for D (P=.046). Maximum RTOG and mean erythema scores were significantly less for MF than for D (P=.018 and P=.012, respectively). The Dermatology Life Quality Index (DLQI) score was significantly less for MF than for D at weeks 4 and 5 when corrected for Hospital Anxiety and Depression (HAD) questionnaire scores. Conclusions: MF cream significantly reduces radiation dermatitis when applied to the breast during and after radiation therapy. For the first time, we have shown a significantly beneficial effect on quality of life using a validated instrument (DLQI), for a topical steroid cream. We believe that application of this cream should be the standard of care where radiation dermatitis is expected.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

An international benchmark for wind plant wakes from the American WAKE ExperimeNt (AWAKEN)

This article introduces the first benchmark study within the International Energy Agency Wind Task 57 framework, focusing on wind plant wakes. Leveraging data from the American WAKE ExperimeNt (AWAKEN), the benchmark aims to assess the accuracy of simulation tools in modeling wind plant wakes and their impact on the downstream flow under diverse inflow conditions. The AWAKEN field campaign, conducted in Oklahoma from 2022 to 2024, provides unprecedented observations of wind plant-atmosphere interactions, thus offering a large dataset to validate numerical models of different complexity. The benchmark will include three phases—code calibration, blind comparison, and iteration—allowing participants to refine their numerical models based on the feedback from the benchmark team. This article describes the benchmark case study selected from observations providing details on atmospheric conditions, wake evidence, and wind turbine operation. The benchmark’s structure and timeline, along with the expected publication of results, are discussed as well. This collaborative effort aims to enhance the accuracy of wind plant wake simulations, thus contributing to the improvement of wind energy production estimates.

17 WIND ENERGY↗

Radiation Effects Science: Advancing the Frontiers of Science and Engineering

Recent improvements in the radiation effects science capability at Sandia have achieved the following: Record gamma-ray outputs at HERMES enable qualification for Life Extension Programs (LEPs) and evaluation of electromagnetic pulse (EMP) effects on electric grid elements; Completed blind comparison for model validation of cavity system generated EMP in advanced computer simulations; For the first time, new diagnostics provide a high resolution photon energy spectrum on Z (Grand Challenge LDRD); ACRR completed record number of operations, two years in a row, to support design and qualification; Installed the nation’s largest GHz electromagnetic test chamber for design and qualification.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

A Portable Immunoassay Platform for Multiplexed Detection of Biotoxins in Clinical and Environmental Samples

Multiple cases of attempted bioterrorism events using biotoxins have highlighted the urgent need for tools capable of rapid screening of suspect samples in the field (e.g., mailroom and public events). We present a portable microfluidic device capable of analyzing environmental (e.g., white powder), food (e.g., milk) and clinical (e.g., blood) samples for multiplexed detection of biotoxins. The device is rapid (<15-30 min sample-to-answer), sensitive (< 0.08 pg/mL detection limit for botulinum toxin), multiplexed (up to 64 parallel assays) and capable of analyzing small volume samples (< 20 μL total sample input). The immunoassay approach (SpinDx) is based on binding of toxins in a sample to antibody-laden capture particles followed by sedimentation of particles through a density-media in a microfluidic disk and quantification using a laser-induced fluorescence detector. A direct, blinded comparison with a gold standard ELISA revealed a 5-fold more sensitive detection limit for botulinum toxin while requiring 250-fold less sample volume and a 30 minute assay time with a near unity correlation. A key advantage of the technique is its compatibility with a variety of sample matrices with no additional sample preparation required. Ultrasensitive quantification has been demonstrated from direct analysis of multiple clinical, environmental and food samples, including white powder, whole blood, saliva, salad dressing, whole milk, peanut butter, half and half, honey, and canned meat. We believe that this device can met an urgent need in screening both potentially exposed people as well as suspicious samples in mail-rooms, airports, public sporting venues and emergency rooms. The general-purpose immunodiagnostics device can also find applications in screening of infectious and systemic diseases or serve as a lab device for conducting rapid immunoassays.

Koh, Chung-Yan↗

Feature review of photovoltaic modeling software utilizing blind performance assessment

While confidence in photovoltaic (PV) modeling software has always been essential, the rapid pace of new PV plant developments makes accuracy and credibility more critical than ever. Independent assessments, particularly through blind modeling comparisons, are therefore necessary to ensure unbiased benchmarking across PV modeling software. Previous studies have been limited by a narrow range of models compared, anonymized results, or system size. This study presents results from the first-ever onymous blind modeling comparison, evaluated using both lab- and utility-scale fixed-tilt, monofacial, south-facing systems at sub-hourly time intervals. Seven commercially used PV software tools were compared: 3E SynaptiQ, PlantPredict, PVsyst, RatedPower, SAM, SolarFarmer, and Solargis Evaluate. Predictions were submitted directly by software representatives, providing unique insights into each software’s implementation and resulting prediction behavior. Notable features, including plane-of-array (POA) transposition model, module temperature model, shading model, and performance model were analyzed and compared. Four summary tables compile these features of the software, serving as a resource to help users understand the methodological differences and select the most suitable software for their applications. The software tools show deviations from mean error in annual yield up to 2.5 % in the lab-scale system, increasing to 6.0 % for the utility-scale system. These differences arise from a combination of user decisions and the inherent behavior of the software, indicating the need for continuous and rigorous validation of modeling methods using these software tools against complex, real-world systems.

14 SOLAR ENERGY↗

PV Performance Modeling - Data and Resources

The Photovoltaic (PV) Performance Modeling Collaborative (PVPMC) organized a blind PV performance modeling intercomparison to allow PV modelers to blindly test their models and modeling ability against real system data. Measured weather and irradiance data were provided along with detailed descriptions of PV systems from two locations (Albuquerque, New Mexico, USA and Roskilde, Denmark). Participants were asked to simulate the plane-of-array irradiance, module temperature, and DC power output from six systems and submit their results to Sandia for processing. This dataset includes seven MS-Excel sheets with instructions, notes and all necessary data (weather, irradiance, temperature, power) used for the data analysis of the blind modeling comparison. The hourly data represent six different systems from Albuquerque, NM and Roskilde, Denmark over a period of one year. These data are useful for PV performance model validation studies.

14 SOLAR ENERGY↗

MO-G-201-04: Knowledge-Based Planning for Single-Isocenter Stereotactic Radiosurgery to Multiple Brain Metastases

Purpose: Single-isocenter, linac-based SRS for multiple brain metastases (multi-mets) can deliver highly conformal radiation doses and reduce overall patient treatment time compared to other therapy techniques. This study aims to quantify the dosimetric benefits of knowledge-based planning (KBP) for multi-met treatments. Methods: Using a previously-published KBP methodology (an artificial neural network (ANN) trained on single-target linac-based SRS plans), 3D dose distribution predictions for multi-met patients were obtained by treating each brain lesion as a solitary target and subsequently combining individual predictions into a single distribution using a dose-weighted geometric averaging to obtain the best results in the inter-target space. 17 previously-treated multi-met plans, with target numbers ranging from N=2–5, were used to validate the ANN predictions and subsequent KBP auto-planning routine. The fully-deliverable KBP plans were developed by converting dose distribution predictions into patient-specific optimization objectives while maintaining identical target normalizations (typically PTV V100%=D98%). Plan quality improvements were quantified by the difference between SRS quality metrics (QMs): δdQM=QM(clinical)-QM(KBP). QMs of interest were: gradient measure (GM), conformity index (CI), brain V10 and V5, brainstem D0.1cc and heterogeneity index (HI). Finally, overall plan quality was judged via blinded plan comparison by SRS-specializing physicians. Results: Two clinical plans were found to be significant outliers wherein plan quality was dramatically worse than KBP. Despite indicating KBP superiority, these were removed from the QM analysis to prevent skewing the results. In the remaining cases, clinical and KBP QMs were nearly identical with modest improvements in the KBP sample: δGM=0.12±0.56mm, δCI=−0.01±0.04, Brain δV10=0.8±2.6cc, brain δV5=6.3 ±10.7cc, brainstem δD0.1cc=0.06±1.19Gy and δHI= −0.04±0.05. Ultimately, 13/17 KBP plans were deemed superior to the manual plans in blinded physician review. Conclusion: The results demonstrate that KBP-driven automated planning in linac-based single-isocenter treatments for multiple brain metastases is indistinguishable from, or even better than, traditional manual planning. J. Hattangadi: Research Grant; Varian Medical Systems; K.L. Moore: Research Grant: Varian Medical Systems.

60 APPLIED LIFE SCIENCES↗

Blind photovoltaic modeling intercomparison: A multidimensional data analysis and lessons learned

The Photovoltaic (PV) Performance Modeling Collaborative (PVPMC) organized a blind PV performance modeling intercomparison to allow PV modelers to blindly test their models and modeling ability against real system data. Measured weather and irradiance data were provided along with detailed descriptions of PV systems from two locations (Albuquerque, New Mexico, USA, and Roskilde, Denmark). Participants were asked to simulate the plane-of-array irradiance, module temperature, and DC power output from six systems and submit their results to Sandia for processing. The results showed overall median mean bias (i.e., the average error per participant) of 0.6% in annual irradiation and –3.3% in annual energy yield. While most PV performance modeling results seem to exhibit higher precision and accuracy as compared to an earlier blind PV modeling study in 2010, human errors, modeling skills, and derates were found to still cause significant errors in the estimates.

14 SOLAR ENERGY↗

Uniform Recalibration of Common Spectrophotometry Standard Stars onto the CALSPEC System Using the SuperNova Integral Field Spectrograph

Abstract We calibrate spectrophotometric optical spectra of 32 stars commonly used as standard stars, referenced to 14 stars already on the Hubble Space Telescope–based CALSPEC flux system. Observations of CALSPEC and non-CALSPEC stars were obtained with the SuperNova Integral Field Spectrograph over the wavelength range 3300–9400 Å as calibration for the Nearby Supernova Factory cosmology experiment. In total, this analysis used 4289 standard-star spectra taken on photometric nights. As a modern cosmology analysis, all presubmission methodological decisions were made with the flux scale and external comparison results blinded. The large number of spectra per star allows us to treat the wavelength-by-wavelength calibration for all nights simultaneously with a Bayesian hierarchical model, thereby enabling a consistent treatment of the Type Ia supernova cosmology analysis and the calibration on which it critically relies. We determine the typical per-observation repeatability (median 14 mmag for exposures ≳5 s), the Maunakea atmospheric transmission distribution (median dispersion of 7 mmag with uncertainty 1 mmag), and the scatter internal to our CALSPEC reference stars (median of 8 mmag). We also check our standards against literature filter photometry, finding generally good agreement over the full 12 mag range. Overall, the mean of our system is calibrated to the mean of CALSPEC at the level of ∼3 mmag. With our large number of observations, careful cross-checks, and 14 reference stars, our results are the best calibration yet achieved with an integral-field spectrograph, and among the best calibrated surveys.

79 ASTRONOMY AND ASTROPHYSICS↗

Shuttle Return-to-Flight IH-108 Aerothermal Test at CUBRC - Flow Field Calibration and CFD

This paper discusses one specific aspect of the Shuttle Retrun-To-Flight IH-108 Aerothermal Test at CUBRC, the test flow field calibration. It showed the versatility of the CUBRC LENS II wind tunnel for an aerothermal test with unique and demanding requirements. CFD analyses were used effectively to extend the test range at the low end of the Mach range. It demonstrated how ground test facility and CFD synergy can be utilitzed iteratively to enhance the confidence in the fedility of both tools. It addressed the lingering concerns of the aerothermal community on use of inpulse facility and CFD analysis. At the conclusion of the test program, members from the NASA Marshall (MSFC), CUBRC and USA (United Space Alliance) Consultants (The Grey Beards) were asked to independently verify the flight scaling data generated by Boeing for flight certification of the re-designed external tank (ET) components. The blind test comparison showed very good results. A more comprehensive discussion of the topics in this paper can be found in Chapter 6 of Reference [1]. The overall aspect of the test program has been discussed in an AIAA paper by Tim Wadhams [2]. The Shuttle Ascent Stack performance and related issues discussed in the Report [1] are not included in this paper. No ITAR data is included in this paper.

Lau, Kei Y.↗