Search NASA⌕ Search

SEARCH · Search NASA

Results for “map validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Dark Energy Survey Year 3 results: Simulation-based cosmological inference with wavelet harmonics, scattering transforms, and moments of weak lensing mass maps. Validation on simulations

Beyond-two-point statistics contain additional information on cosmological as well as astrophysical and observational (systematics) parameters. In this methodology paper we provide an end-to-end simulationbased analysis of a set of Gaussian and non-Gaussian weak lensing statistics using detailed mock catalogs of the Dark Energy Survey (DES). Here, we implement: 1) second and third moments; 2) wavelet phase harmonics (WPH); 3) the scattering transform (ST). Our analysis is fully based on simulations, it spans a space of seven $νw$CDM cosmological parameters, and it forward models the most relevant sources of systematics of the data (masks, noise variations, clustering of the sources, intrinsic alignments, and shear and redshift calibration). We implement a neural network compression of the summary statistics, and we estimate the parameter posteriors using a likelihood-free-inference approach. We validate the pipeline extensively, and we find that WPH exhibits the strongest performance when combined with second moments, followed by ST, and then by third moments. The combination of all the different statistics further enhances constraints with respect to second moments, up to 25 percent, 15 percent, and 90 percent for S 8 , Ω m , and the figure-of-merit FoM S8;Ωm , respectively. We further find that non-Gaussian statistics improve constraints on w and on the amplitude of intrinsic alignment with respect to second moments constraints. The methodological advances presented here are suitable for application to Stage IV surveys from Euclid, Rubin-LSST, and Roman with additional validation on mock catalogs for each survey. In a companion paper we present an application to DES Year 3 data.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2015

EMRinger: side chain–directed model and map validation for 3D cryo-electron microscopy

Advances in high-resolution cryo-electron microscopy (cryo-EM) require the development of validation metrics to independently assess map quality and model geometry. We report that EMRinger is a tool that assesses the precise fitting of an atomic model into the map during refinement and shows how radiation damage alters scattering from negatively charged amino acids. EMRinger (https://github.com/fraser-lab/EMRinger) will be useful for monitoring progress in resolving and modeling high-resolution features in cryo-EM.

47 OTHER INSTRUMENTATION↗
DOE OSTI2020

Dark Energy Survey Year 3 results: cosmology with moments of weak lensing mass maps – validation on simulations

ABSTRACT We present a simulated cosmology analysis using the second and third moments of the weak lensing mass (convergence) maps. The second moment, or variances, of the convergence as a function of smoothing scale contains information similar to standard shear two-point statistics. The third moment, or the skewness, contains additional non-Gaussian information. The analysis is geared towards the third year (Y3) data from the Dark Energy Survey (DES), but the methodology can be applied to other weak lensing data sets. We present the formalism for obtaining the convergence maps from the measured shear and for obtaining the second and third moments of these maps given partial sky coverage. We estimate the covariance matrix from a large suite of numerical simulations. We test our pipeline through a simulated likelihood analyses varying 5 cosmological parameters and 10 nuisance parameters and identify the scales where systematic or modelling uncertainties are not expected to affect the cosmological analysis. Our simulated likelihood analysis shows that the combination of second and third moments provides a 1.5 per cent constraint on S8 ≡ σ8(Ωm/0.3)0.5 for DES Year 3 data. This is 20 per cent better than an analysis using a simulated DES Y3 shear two-point statistics, owing to the non-Gaussian information captured by the inclusion of higher order statistics. This paper validates our methodology for constraining cosmology with DES Year 3 data, which will be presented in a subsequent paper.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2016

GLASS daytime all-wave net radiation product: Algorithm development and preliminary validation

Mapping surface all-wave net radiation (R n ) is critically needed for various applications. Several existing R n products from numerical models and satellite observations have coarse spatial resolutions and their accuracies may not meet the requirements of land applications. In this study, we develop the Global LAnd Surface Satellite (GLASS) daytime R n product at a 5 km spatial resolution. Its algorithm for converting shortwave radiation to all-wave net radiation using the Multivariate Adaptive Regression Splines (MARS) model is determined after comparison with three other algorithms. The validation of the GLASS R n product based on high-quality in situ measurements in the United States shows a coefficient of determination value of 0.879, an average root mean square error value of 31.61 Wm -2 , and an average bias of 17.59 Wm -2 . Furthermore, we also compare our product/algorithm with another satellite product (CERES-SYN) and two reanalysis products (MERRA and JRA55), and find that the accuracy of the much higher spatial resolution GLASS R n product is satisfactory. The GLASS R n product from 2000 to the present is operational and freely available to the public.

58 GEOSCIENCES↗
DOE OSTI2017

Validation and uncertainty quantification of detector response functions for a $1"×2"$ NaI collimated detector intended for inverse radioisotope source mapping applications

Detector response functions (DRFs) are often used for inverse analysis. We compute the DRF of a sodium iodide (NaI) nuclear material holdup field detector using the code named g03 developed by the Center for Engineering Applications of Radioisotopes (CEAR) at NC State University. Three measurement campaigns were performed in order to validate the DRF’s constructed by g03: on-axis detection of calibration sources, off-axis measurements of a highly enriched uranium (HEU) disk, and on-axis measurements of the HEU disk with steel plates inserted between the source and the detector to provide attenuation. Furthermore, this work quantifies the uncertainty of the Monte Carlo simulations used in and with g03, as well as the uncertainties associated with each semi-empirical model employed in the full DRF representation. Overall, for the calibration source measurements, the response computed by the DRF for the prediction of the full-energy peak region of responses was good, i.e. within two standard deviations of the experimental response. In contrast, the DRF tended to overestimate the Compton continuum by about 45–65% due to inadequate tuning of the electron range multiplier fit variable that empirically represents physics associated with electron transport that is not modeled explicitly in g03. For the HEU disk measurements, computed DRF responses tended to significantly underestimate (more than 20%) the secondary full-energy peaks (any peak of lower energy than the highest-energy peak computed) due to scattering in the detector collimator and aluminum can, which is not included in the g03 model. We ran a sufficiently large number of histories to ensure for all of the Monte Carlo simulations that the statistical uncertainties were lower than their experimental counterpart’s Poisson uncertainties. The uncertainties associated with least-squares fits to the experimental data tended to have parameter relative standard deviations lower than the peak channel relative standard deviation in most cases and good reduced chi-square values. The highest sources of uncertainty were identified as the energy calibration polynomial factor (due to limited source availability and NaI resolution) and the Ba-133 peak fit (only a very weak source was available), which were 20% and 10%, respectively.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2020

MAPPER – A NOVEL CAPABILITY TO SUPPORT NUCLEAR MODEL VALIDATION AND MAPPING OF BIASES AND UNCERTAINTIES

This paper overviews the initial results of a new project at the Oak Ridge National Laboratory -- supported via an internal seed funding program -- focused on the development of a novel computational capability, called MAPPER, to support model validation. The MAPPER development aims to eliminate the need for empirical criteria, such as similarity indices, often employed to identify applicable experiments for given application conditions. To achieve that, MAPPER employs an information-theoretic-based approach, based on the Kullback-Leibler (KL) divergence principle, to combine responses of available or to-be-built experiments with application responses of interest using a training set of samples generated using randomized execution of the experiments and the application high fidelity analysis models. These samples are condensed using reduced order modeling techniques in the form of a joint probability distribution function (PDF) connecting each application response of interest with a new effective experimental response. The initial focus of the MAPPER capability will be to support the confirmatory analysis required for criticality safety analysis of storage facilities which require k-eff biases to be known for safe operation. This paper reports some of the initial results obtained with MAPPER as applied to a set of critical experiments for which existing similarity-based methods have been shown to provide inaccurate estimates of the biases.

Mertyurek, Ugur↗
DOE OSTI2023

A large expert-curated cryo-EM image dataset for machine learning protein particle picking

Cryo-electron microscopy (cryo-EM) is a powerful technique for determining the structures of biological macromolecular complexes. Picking single-protein particles from cryo-EM micrographs is a crucial step in reconstructing protein structures. However, the widely used template-based particle picking process is labor-intensive and time-consuming. Though machine learning and artificial intelligence (AI) based particle picking can potentially automate the process, its development is hindered by lack of large, high-quality labelled training data. To address this bottleneck, we present CryoPPP, a large, diverse, expert-curated cryo-EM image dataset for protein particle picking and analysis. It consists of labelled cryo-EM micrographs (images) of 34 representative protein datasets selected from the Electron Microscopy Public Image Archive (EMPIAR). The dataset is 2.6 terabytes and includes 9,893 high-resolution micrographs with labelled protein particle coordinates. The labelling process was rigorously validated through 2D particle class validation and 3D density map validation with the gold standard. The dataset is expected to greatly facilitate the development of both AI and classical methods for automated cryo-EM protein particle picking.

42 ENGINEERING↗
DOE OSTI2025

Updates on MURAVES Project at Mt. Vesuvius

The MUon RAdiography of VESuvius (MURAVES) project aims to employ muography imaging techniques to investigate the internal structure of the summit of Mount Vesuvius, an active volcano located near Naples, Italy. This paper reports recent advancements in data analysis and simulation tools that significantly improve the quality and reliability of the experiment’s results. A new track selection method, referred to as the Golden Selection, has been developed to identify high-quality muon tracks by applying an improved χ 2 -based criterion. This method enhances the signal-to-background ratio and improves the resolution of the resulting muographic images. Moreover, the simulation framework has been upgraded through the integration of the MULDER (MUon simuLation for DEnsity Reconstruction) library, which consolidates the functionalities of previously used libraries into a single, unified platform. MULDER enables efficient and accurate modeling of muon flux variations induced by topographical features. A good agreement is observed between the simulated and measured muon flux maps, validating the effectiveness of the new analysis and simulation approaches.

Cosmic rays↗
DOE OSTI2011

Localization of Bogoliubov quasiparticles in interacting Bose gases with correlated disorder

We study the Anderson localization of Bogoliubov quasiparticles (elementary many-body excitations) in a weakly interacting Bose gas of chemical potential {mu} subjected to a disordered potential V. We introduce a general mapping (valid for weak inhomogeneous potentials in any dimension) of the Bogoliubov-de Gennes equations onto a single-particle Schroedinger-like equation with an effective potential. For disordered potentials, the Schroedinger-like equation accounts for the scattering and localization properties of the Bogoliubov quasiparticles. We derive analytically the localization lengths for correlated disordered potentials in the one-dimensional geometry. Our approach relies on a perturbative expansion in V/{mu}, which we develop up to third order, and we discuss the impact of the various perturbation orders. Our predictions are shown to be in very good agreement with direct numerical calculations. We identify different localization regimes: For low energy, the effective disordered potential exhibits a strong screening by the quasicondensate density background, and localization is suppressed. For high-energy excitations, the effective disordered potential reduces to the bare disordered potential, and the localization properties of quasiparticles are the same as for free particles. The maximum of localization is found at intermediate energy when the quasicondensate healing length is of the order of the disorder correlation length. Possible extensions of our work to higher dimensions are also discussed.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2026

SPT-3G D1: Compton-$y$ maps using data from the SPT-3G and Planck surveys

We present thermal Sunyaev-Zel'dovich (tSZ) Compton-$y$ parameter maps constructed from two years (2019-2020) of observations with the South Pole Telescope (SPT) third-generation camera, SPT-3G, combined with data from the Planck satellite. Using a linear combination (LC) pipeline, we obtain a suite of reconstructions that explore different trade-offs between statistical sensitivity and suppression of astrophysical contaminants, including minimum-variance, CMB-deprojected, and CIB-deprojected $y$-maps. We validate these maps through different statistical techniques such as auto- and cross-power spectra with large-scale structure tracers as well as stacking on cluster locations. These tests are used to understand the balance between noise and astrophysical foreground residuals (such as the CIB) in combination with the recovery of the tSZ signal for different maps. For example, results from stacking at the location of clusters confirm the robustness of the recovered tSZ signal over the $\sim 1500\: {\rm deg}^2$ SPT-3G survey field used in this analysis. The high-resolution and low-noise maps produced here provide an important cosmological tool for future studies, including measurements of the Compton-$y$ map power spectrum, cross-correlations with other tracers of the large-scale structure, detailed modeling of cluster pressure profiles, and study of the thermodynamic state of the baryons in the Universe.

Maniyar, A. S. [Harvard-Smithsonian Ctr. Astrophys↗
DOE OSTI2013

Validation of velocity map imaging conditions over larger areas

We have established through simulations and experiments the area over which Velocity Map Imaging (VMI) conditions prevail. We designed a VMI setup in which we can vary the ionization position perpendicular to the center axis of the time-of-flight spectrometer. We show that weak extraction conditions are far superior over standard three-plate setups if the aim is to increase the ionization volume without distorting VMI conditions. This is important for a number of crossed molecular beam experiments that already utilize weak extraction conditions, but to a greater extent for surface studies where fragments are desorbed or scattered off a surface in all directions. Our results on the dissociation of NO{sub 2} at 226 nm show that ionization of the fragments can occur up to {+-}5.5 mm away from the center axis of the time-of-flight spectrometer without affecting resolution or arrival position.

43 PARTICLE ACCELERATORS↗
DOE OSTI2019

Validation of transfer map calculation for electrostatic deflectors in the code COSY INFINITY

The code COSY INFINITY uses a beamline coordinate system with a Frenet–Serret frame relative to the reference particle, and calculates differential algebra-valued transfer maps by integrating the ODEs of motion in the respective vector space over a differential algebra (DA). In our work, we described and performed computation of the DA transfer map of an electrostatic spherical deflector in a laboratory coordinate system using two conventional methods: (1) by integrating the ODEs of motion using a numerical integrator and (2) by computing analytically and in closed form the properties of the respective elliptical orbits from Kepler theory. We compared the resulting transfer maps with (3) the DA transfer map of COSY INFINITY’s built-in electrostatic spherical deflector element ESP and (4) the transfer map of the electrostatic spherical deflector computed using the program GIOS, which uses analytic formulas from a paper1 by Hermann Wollnik regarding second-order aberrations. In addition to the electrostatic spherical deflector, we studied an electrostatic cylindrical deflector, where the Kepler theory is not applicable. We computed the DA transfer map by the ODE integration method (1), and we compared it with the transfer maps by (3) COSY INFINITY’s built-in electrostatic cylindrical deflector element ECL and (4) GIOS. The transfer maps of electrostatic spherical and cylindrical deflectors obtained using the direct calculation methods (1) and (2) are in excellent agreement with those computed using (3) COSY INFINITY. On the other hand, we found a significant discrepancy with (4) the program GIOS.

43 PARTICLE ACCELERATORS↗
DOE OSTI2025

Stellar reddening map from DESI imaging and spectroscopy

We present new Galactic reddening maps of the high Galactic latitude sky using DESI imaging and spectroscopy. We directly measure the reddening of 2.6 million stars by comparing the observed stellar colors in $g-r$ and $r-z$ from DESI imaging with the synthetic colors derived from DESI spectra from the first two years of the survey. The reddening in the two colors is on average consistent with the Fitzpatrick (1999) extinction curve with $R_\mathrm{V}=3.1$ . We find that our reddening maps differ significantly from the commonly used Schlegel et al. (1998) (SFD) reddening map (by up to 80 mmag in $E(B-V)$ ), and we attribute most of this difference to systematic errors in the SFD map. To validate the reddening map, we select a galaxy sample with extinction correction based on our reddening map, and this yields significantly better uniformity than the SFD extinction correction. Finally, we discuss the potential systematic errors in the DESI reddening measurements, including the photometric calibration errors that are the limiting factor on our accuracy. The $E(g-r)$ and $E(r-z)$ maps presented in this work, and for convenience their corresponding $E(B-V)$ maps with SFD calibration, are publicly available.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

Bringing 2D Eclipse Mapping out of the Shadows with Leave-one-out Cross Validation

Abstract Eclipse mapping is a technique for inferring 2D brightness maps of transiting exoplanets from the shape of an eclipse light curve. With JWST’s unmatched precision, eclipse mapping is now possible for a large number of exoplanets. However, eclipse mapping has only been applied to two planets, and the nuances of fitting eclipse maps are not yet fully understood. Here, we use Leave-one-out Cross Validation (LOO-CV) to investigate eclipse mapping, with application to a JWST NIRISS/SOSS observation of the ultrahot Jupiter WASP-18b. LOO-CV is a technique that provides insight into the out-of-sample predictive power of models on a data-point-by-data-point basis. We show that constraints on planetary brightness patterns behave as expected, with large-scale variations driven by the phase-curve variation in the light curve and smaller-scale structures constrained by the eclipse ingress and egress. For WASP-18b we show that the need for higher model complexity (smaller-scale features) is driven exclusively by the shape of the eclipse ingress and egress. We use LOO-CV to investigate the relationship between planetary brightness map components when mapping under a positive-flux constraint to better understand the need for complex models. Finally, we use LOO-CV to understand the degeneracy between the competing “hot spot” and “plateau” brightness map models of WASP-18b, showing that the plateau model is driven by the ingress shape and the hot spot model is driven by the egress shape, but preference for neither model is due to outliers or unmodeled signals. Based on this analysis, we make recommendations for the use of LOO-CV in future eclipse-mapping studies.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2017

Sub genome anchored physical frameworks of the allotetraploid Upland cotton (Gossypium hirsutum L.) genome, and an approach toward reference-grade assemblies of polyploids

Like those of many agricultural crops, the cultivated cotton is an allotetraploid and has a large genome (~2.5 gigabase pairs). The two sub genomes, A and D, are highly similar but unequally sized and repeat-rich, which pose significant challenges for accurate genome reconstruction using standard approaches. Here we report the development of BAC libraries, sub genome specific physical maps, and a new-generation sequencing approach that will lead to a reference-grade genome assembly for Upland cotton. Three BAC libraries were constructed, fingerprinted, and integrated with BAC-end sequences (BES) to produce a de novo whole-genome physical map. The BAC map was partitioned by sub genomes through alignment to the diploid progenitor D-genome reference sequence with densely spaced BES anchor points and computational filtering. The physical maps were validated with FISH and genetic mapping of SNP markers derived from BES. Two pairs of homeologous chromosomes, A11/D11 and A12/D12, were used to assess multiplex sequencing approaches for completeness and scalability. The results represent the first sub genome anchored physical maps of Upland cotton, and a new-generation approach to the whole-genome sequencing, which will lead to the reference-grade assembly of allopolyploid cotton and serve as a general strategy for sequencing other polyploid species.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2014

Adaptive nonlocal means filtering based on local noise level for CT denoising

Purpose: To develop and evaluate an image-domain noise reduction method based on a modified nonlocal means (NLM) algorithm that is adaptive to local noise level of CT images and to implement this method in a time frame consistent with clinical workflow. Methods: A computationally efficient technique for local noise estimation directly from CT images was developed. A forward projection, based on a 2D fan-beam approximation, was used to generate the projection data, with a noise model incorporating the effects of the bowtie filter and automatic exposure control. The noise propagation from projection data to images was analytically derived. The analytical noise map was validated using repeated scans of a phantom. A 3D NLM denoising algorithm was modified to adapt its denoising strength locally based on this noise map. The performance of this adaptive NLM filter was evaluated in phantom studies in terms of in-plane and cross-plane high-contrast spatial resolution, noise power spectrum (NPS), subjective low-contrast spatial resolution using the American College of Radiology (ACR) accreditation phantom, and objective low-contrast spatial resolution using a channelized Hotelling model observer (CHO). Graphical processing units (GPU) implementation of this noise map calculation and the adaptive NLM filtering were developed to meet demands of clinical workflow. Adaptive NLM was piloted on lower dose scans in clinical practice. Results: The local noise level estimation matches the noise distribution determined from multiple repetitive scans of a phantom, demonstrated by small variations in the ratio map between the analytical noise map and the one calculated from repeated scans. The phantom studies demonstrated that the adaptive NLM filter can reduce noise substantially without degrading the high-contrast spatial resolution, as illustrated by modulation transfer function and slice sensitivity profile results. The NPS results show that adaptive NLM denoising preserves the shape and peak frequency of the noise power spectrum better than commercial smoothing kernels, and indicate that the spatial resolution at low contrast levels is not significantly degraded. Both the subjective evaluation using the ACR phantom and the objective evaluation on a low-contrast detection task using a CHO model observer demonstrate an improvement on low-contrast performance. The GPU implementation can process and transfer 300 slice images within 5 min. On patient data, the adaptive NLM algorithm provides more effective denoising of CT data throughout a volume than standard NLM, and may allow significant lowering of radiation dose. After a two week pilot study of lower dose CT urography and CT enterography exams, both GI and GU radiology groups elected to proceed with permanent implementation of adaptive NLM in their GI and GU CT practices. Conclusions: This work describes and validates a computationally efficient technique for noise map estimation directly from CT images, and an adaptive NLM filtering based on this noise map, on phantom and patient data. Both the noise map calculation and the adaptive NLM filtering can be performed in times that allow integration with clinical workflow. The adaptive NLM algorithm provides effective denoising of CT data throughout a volume, and may allow significant lowering of radiation dose.

62 RADIOLOGY AND NUCLEAR MEDICINE↗