Search NASA⌕ Search

SEARCH · Search NASA

Results for “Self Organizing Map”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6

Wintertime synoptic patterns of midlatitude boundary layer clouds over the western North Atlantic: Climatology and insights from in-situ ACTIVATE observations

The winter synoptic evolution of the western North Atlantic and its influence on the atmospheric boundary layer is described by means of a regime classification based on Self Organizing Maps applied to 12 year of data (2009-2020). The regimes are classified into categories according to daily 600-hPa geopotential height: dominant ridge, trough to ridge eastward transition (trough-ridge), dominant trough, and ridge to trough eastward transition (ridge-trough). A fifth synoptic regime resembles the winter climatological mean. Coherent changes in sea-level pressure and large-scale winds are in concert with the synoptic regimes: 1) the ridge regime is associated with a well-developed anticyclone; 2) the trough-ridge gives rise to a low pressure center over the ocean, ascents, and northerly winds over the coastal zone; 3) trough is associated with the eastward displacement of a cyclone, coastal subsidence, and northerly winds, all representative characteristics of cold-air outbreaks; 4) the ridge-trough regime features the development of an anticyclone and weak coastal winds. Low clouds are characteristic of the trough regime, with both trough and trough-ridge featuring synoptic maxima in cloud droplet number concentration (N d ). The N d increase is primarily observed near the coast, concomitant with strong surface heat fluxes exceeding by more than 400 W m -2 compared to fluxes further east. Five consecutive days of aircraft observations collected during the ACTIVATE campaign corroborates the climatological characterization, confirming the occurrence of high N d for days identified as trough. This study emphasizes the role of boundary-layer dynamics and aerosol activation and their roles in modulating cloud microphysics.

54 ENVIRONMENTAL SCIENCES↗

Synoptic Drivers of Atmospheric River Induced Precipitation Near Dronning Maud Land, Antarctica

Atmospheric rivers (ARs) that reach the Antarctic Ice Sheet (AIS) transport anomalous moisture from lower latitudes and can impact the AIS via extreme precipitation and increased downward longwave radiation. ARs contribute significantly to the interannual variability of precipitation over the AIS and thus are likely to play a key role in understanding future changes in the surface mass balance of the AIS. Dronning Maud Land (DML) is one of four maxima in AR frequency over coastal East Antarctica, with AR precipitation explaining 77% of the interannual variability in precipitation for this region. We employ a 16-node self-organizing map (SOM) trained with MERRA-2 sea-level pressure anomalies to identify synoptic-scale environments associated with landfalling ARs in and around DML. Node composites of atmospheric variables reveal common drivers of precipitation associated with ARs reaching DML including anomalous high-low surface pressure couplets, anomalously high integrated water vapor, and coastal barrier jets. Using a quasi-geostrophic framework, we find that upward vertical motion associated with the occlusion process of attendant cyclones dominates atmospheric lift in AR environments. We further identify mechanisms that explain the variability in AR precipitation intensity across nodes, such as the lift associated with the occlusion process of attendant cyclones and the spatial coincidence of ascent induced by the occlusion process and frontogenesis. Here, the latter suggests that ARs making landfall during the mature phase of cyclogenesis result in higher precipitation intensity compared to landfalling ARs that occur during the occluded phase.

54 ENVIRONMENTAL SCIENCES↗

Meteorological Drivers of North American Monsoon Extreme Precipitation Events

Abstract In this paper the meteorological drivers of North American Monsoon (NAM) extreme precipitation events (EPEs) are identified and analyzed. First, the NAM area and its subregions are distinguished using self‐organizing maps applied to the Climate Prediction Center global precipitation data set. This reveals distinct subregions, shaped by the inhomogeneous geographic features of the NAM area, with distinct extreme precipitation character and drivers. Next, defining EPEs as days when subregion‐mean precipitation exceeds the 95th percentile of rainy days, five synoptic features and one mesoscale feature are investigated as potential drivers of EPEs. Essentially all EPEs can be associated with at least one selected driver, with only one event remaining unclassified. This analysis shows the dominant role of Gulf of California moisture surges, mesoscale convective systems and frontal systems in generating NAM extreme precipitation. Finally, a frequency and probability analysis is conducted to contrast precipitation distributions conditioned on the associated meteorological drivers. The findings demonstrate that the co‐occurrence of multiple features does not necessarily enhance the EPE probability.

Meteorology & Atmospheric Sciences↗

Spring Dust in Colorado Plateau: Transport Pathways and Interannual Variability Derived From Two Decades of MERRA‐2 Reanalysis

Spring dust storms in the U.S. Southwest significantly impact environmental and human systems, yet their climatological patterns and driving mechanisms remain poorly understood. Using two decades of MERRA-2 reanalysis data and self-organizing map clustering, we identified four distinct dust transport pathways from surrounding and remote deserts for the top 10% of spring dust events impacting the Colorado Plateau: (a) intense southwesterly near-surface transport where eastward upward transport is blocked by topography, (b) substantial remote transport plus weaker surface emissions, (c) moderate southwesterly transport with stronger upper-level transport, and (d) rare northwesterly pattern linked to the Great Basin sources, which accounts for 38%, 14%, 37%, and 11% of total events, respectively. The frequency and intensity of these events strongly correlate with large-scale climate variability, with increased dust events during La Niña. Our results provide a robust framework for improving seasonal dust forecasts and understanding future dust dynamics under climate change.

aerosol transport↗

Microparticle cloud imaging and tracking for data-driven plasma science

Oceans of image and particle track data encountered in plasma interactions with microparticle clouds motivate development and applications of machine-learning (ML) algorithms. A local-constant-velocity tracker, a Kohonen neural network or self-organizing map, the feature tracking kit, and U-Net are described and compared with each other for microparticle cloud datasets generated from exploding wires, dusty plasmas, and atmospheric plasmas. Particle density and the signal-to-noise ratio have been identified as two important factors that affect the tracking accuracy. Fast Fourier transform is used to reveal how U-Net, a deep convolutional neural network developed for non-plasma applications, achieves the improvements for noisy scenes. Viscous effects are revealed in the ballistic motions of the particles from the exploding wires and atmospheric plasmas. Subdiffusion of microparticles satisfying Δr 2 ∝t k (k=0.84±0.02) is obtained from the dusty plasma datasets. Microparticle cloud imaging and tracking, when enhanced with data and ML models, present new possibilities for plasma physics.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Augmenting Satellite Precipitation Estimation with Lightning Information

We have used lightning information to augment the Precipitation Estimation from Remotely Sensed Imagery using an Artificial Neural Network - Cloud Classification System (PERSIANN-CCS). Co-located lightning data are used to segregate cloud patches, segmented from GOES-12 infrared data, into either electrified (EL) or non-electrified (NEL) patches. A set of features is extracted separately for the EL and NEL cloud patches. The features for the EL cloud patches include new features based on the lightning information. The cloud patches are classified and clustered using self-organizing maps (SOM). Then brightness temperature and rain rate (T-R) relationships are derived for the different clusters. Rain rates are estimated for the cloud patches based on their representative T-R relationship. The Equitable Threat Score (ETS) for daily precipitation estimates is improved by almost 12% for the winter season. In the summer, no significant improvements in ETS are noted.

artificial neural network↗

STRUCTURE IN THE THREE-DIMENSIONAL GALAXY DISTRIBUTION. I. METHODS AND EXAMPLE RESULTS

Three methods for detecting and characterizing structure in point data, such as that generated by redshift surveys, are described: classification using self-organizing maps, segmentation using Bayesian blocks, and density estimation using adaptive kernels. The first two methods are new, and allow detection and characterization of structures of arbitrary shape and at a wide range of spatial scales. These methods should elucidate not only clusters, but also the more distributed, wide-ranging filaments and sheets, and further allow the possibility of detecting and characterizing an even broader class of shapes. The methods are demonstrated and compared in application to three data sets: a carefully selected volume-limited sample from the Sloan Digital Sky Survey redshift data, a similarly selected sample from the Millennium Simulation, and a set of points independently drawn from a uniform probability distribution-a so-called Poisson distribution. We demonstrate a few of the many ways in which these methods elucidate large-scale structure in the distribution of galaxies in the nearby universe.

79 ASTRONOMY AND ASTROPHYSICS↗

STRUCTURE IN THE 3D GALAXY DISTRIBUTION. II. VOIDS AND WATERSHEDS OF LOCAL MAXIMA AND MINIMA

The major uncertainties in studies of the multi-scale structure of the universe arise not from observational errors but from the variety of legitimate definitions and detection methods for individual structures. To facilitate the study of these methodological dependencies, we have carried out 12 different analyses defining structures in various ways. This has been done in a purely geometrical way by utilizing the HOP algorithm as a unique parameter-free method of assigning groups of galaxies to local density maxima or minima. From three density estimation techniques (smoothing kernels, Bayesian blocks, and self-organizing maps) applied to three data sets (the Sloan Digital Sky Survey Data Release 7, the Millennium simulation, and randomly distributed points) we tabulate information that can be used to construct catalogs of structures connected to local density maxima and minima. We also introduce a void finder that utilizes a method to assemble Delaunay tetrahedra into connected structures and characterizes regions empty of galaxies in the source catalog.

79 ASTRONOMY AND ASTROPHYSICS↗

Using active learning to improve quasar identification for the DESI spectra processing pipeline

The Dark Energy Spectroscopic Instrument (DESI) survey uses an automatic spectral classification pipeline to classify spectra. QuasarNET is a convolutional neural network used as part of this pipeline originally trained using data from the Baryon Oscillation Spectroscopic Survey (BOSS). In this paper we implement an active learning algorithm to optimally select spectra to use for training a new version of the QuasarNET weights file using only DESI data, with the goal of improving classification accuracy. This active learning algorithm includes a novel outlier rejection step using a Self-Organizing Map to ensure we label spectra representative of the larger quasar sample observed in DESI. We perform two iterations of the active learning pipeline, assembling a final dataset of 5600 labeled spectra, a small subset of the approximately 1.3 million quasar targets in DESI's Data Release 1. When splitting the spectra into training and validation subsets we achieve similar performance to the previously trained weights file in completeness and purity calculated on the validation dataset but do so with less than one tenth of the amount of training data. The new weights also more consistently classify objects in the same way when used on unlabeled data compared to the old weights file. In the process of improving QuasarNET's classification accuracy we discovered a systemic error in QuasarNET's redshift estimation and used our findings to improve our understanding of QuasarNET's redshifts.

Machine learning↗

Examining future changes in coastal low-level jet properties offshore California through dynamical downscaling

The coastal low-level jet, or coastal low-level jet (CLLJ), is a synoptically-forced meteorological feature frequently present offshore the western United States (U.S.). Characterized by a wind speed maximum that resides at the top of the marine boundary layer, the CLLJ is largely controlled by the location and strength of the North Pacific High (NPH) as well as the coastal geometry. Considering the rich wind resource available in this offshore region, the Bureau of Ocean Energy Management identified wind energy lease areas offshore California and supported the deployment of two U.S. Department of Energy wind lidar buoys near Morro Bay and Humboldt. Despite our relatively good understanding of the fundamental mechanisms responsible for large-scale CLLJ properties offshore the western U.S., future changes in CLLJ characteristics are less clear. To address this research challenge, and ultimately to better inform future wind turbine deployments, we use simulations driven by three global climate models (GCMs). We apply self-organizing maps to the model outputs for a historical and two future climate periods to show the range of NPH regimes that support CLLJ conditions during the warm seasons, as well as the subtle contribution from land-falling cyclones approaching the mainland during the cold seasons. Compared to the historical period, the three GCM-driven simulations agree that CLLJ conditions will become more (less) prevalent from central California northward (southward). They agree less with respect to future changes in maximum CLLJ wind speeds and CLLJ heights. However, after considering model biases present during the historical period, wind speeds between the models are actually more similar during the 2070–2095 period than during the historical period. The potential combination of more frequent CLLJ conditions characterized by relatively consistent wind speeds occurring at lower heights across northern California suggests that the Humboldt lease area may be ideal for a long-term wind turbine deployment.

54 ENVIRONMENTAL SCIENCES↗

Propagating sample variance uncertainties in redshift calibration: simulations, theory, and application to the COSMOS2015 data

ABSTRACT Cosmological analyses of galaxy surveys rely on knowledge of the redshift distribution of their galaxy sample. This is usually derived from a spectroscopic and/or many-band photometric calibrator survey of a small patch of sky. The uncertainties in the redshift distribution of the calibrator sample include a contribution from shot noise, or Poisson sampling errors, but, given the small volume they probe, they are dominated by sample variance introduced by large-scale structures. Redshift uncertainties have been shown to constitute one of the leading contributions to systematic uncertainties in cosmological inferences from weak lensing and galaxy clustering, and hence they must be propagated through the analyses. In this work, we study the effects of sample variance on small-area redshift surveys, from theory to simulations to the COSMOS2015 data set. We present a three-step Dirichlet method of resampling a given survey-based redshift calibration distribution to enable the propagation of both shot noise and sample variance uncertainties. The method can accommodate different levels of prior confidence on different redshift sources. This method can be applied to any calibration sample with known redshifts and phenotypes (i.e. cells in a self-organizing map, or some other way of discretizing photometric space), and provides a simple way of propagating prior redshift uncertainties into cosmological analyses. As a worked example, we apply the full scheme to the COSMOS2015 data set, for which we also present a new, principled SOM algorithm designed to handle noisy photometric data. We make available a catalogue of the resulting resamplings of the COSMOS2015 galaxies.

79 ASTRONOMY AND ASTROPHYSICS↗

Optimizing the shape of photometric redshift distributions with clustering cross-correlations

We present an optimization method for the assignment of photometric galaxies to a chosen set of redshift bins. This is achieved by combining simulated annealing, an optimization algorithm inspired by solid-state physics, with an unsupervised machine learning method, a self-organizing map (SOM) of the observed colours of galaxies. Starting with a sample of galaxies that is divided into redshift bins based on a photometric redshift point estimate, the simulated annealing algorithm repeatedly reassigns SOM-selected subsamples of galaxies, which are close in colour, to alternative redshift bins. We optimize the clustering cross-correlation signal between photometric galaxies and a reference sample of galaxies with well-calibrated redshifts. Depending on the effect on the clustering signal, the reassignment is either accepted or rejected. By dynamically increasing the resolution of the SOM, the algorithm eventually converges to a solution that minimizes the number of mismatched galaxies in each tomographic redshift bin and thus improves the compactness of their corresponding redshift distribution. This method is demonstrated on the synthetic Legacy Survey of Space and Time cosmoDC2 catalogue. We find a significant decrease in the fraction of catastrophic outliers in the redshift distribution in all tomographic bins, most notably in the highest redshift bin with a decrease in the outlier fraction from 57 percent to 16 percent.

79 ASTRONOMY AND ASTROPHYSICS↗

Dark Energy Survey Year 3 results: redshift calibration of the MagLim lens sample from the combination of SOMPZ and clustering and its impact on cosmology

ABSTRACT We present an alternative calibration of the MagLim lens sample redshift distributions from the Dark Energy Survey (DES) first 3 yr of data (Y3). The new calibration is based on a combination of a self-organizing-map-based scheme and clustering redshifts to estimate redshift distributions and inherent uncertainties, which is expected to be more accurate than the original DES Y3 redshift calibration of the lens sample. We describe in detail the methodology, and validate it on simulations and discuss the main effects dominating our error budget. The new calibration is in fair agreement with the fiducial DES Y3 n(z) calibration, with only mild differences (<3σ) in the means and widths of the distributions. We study the impact of this new calibration on cosmological constraints, analysing DES Y3 galaxy clustering and galaxy–galaxy lensing measurements, assuming a Lambda cold dark matter cosmology. We obtain Ωm = 0.30 ± 0.04, σ8 = 0.81 ± 0.07, and S8 = 0.81 ± 0.04, which implies a ∼0.4σ shift in the Ω − S8 plane compared to the fiducial DES Y3 results, highlighting the importance of the redshift calibration of the lens sample in multiprobe cosmological analyses.

79 ASTRONOMY AND ASTROPHYSICS↗

DESI complete calibration of the colour–redshift relation (DC3R2): results from early DESI data

We present initial results from the Dark Energy Spectroscopic Instrument (DESI) complete calibration of the colour–redshift relation (DC3R2) secondary target survey. Our analysis uses 230 k galaxies that overlap with KiDS-VIKING ugriZYJHK s photometry to calibrate the colour–redshift relation and to inform photometric redshift (photo-z) inference methods of future weak lensing surveys. Together with emission line galaxies (ELGs), luminous red galaxies (LRGs), and the Bright Galaxy Survey (BGS) that provide samples of complementary colour, the DC3R2 targets help DESI to span 56 percent of the colour space visible to Euclid and LSST with high confidence spectroscopic redshifts. The effects of spectroscopic completeness and quality are explored, as well as systematic uncertainties introduced with the use of common Self-Organizing Maps trained on different photometry than the analysis sample. We further examine the dependence of redshift on magnitude at fixed colour, important for the use of bright galaxy spectra to calibrate redshifts in a fainter photometric galaxy sample. We find that noise in the KiDS-VIKING photometry introduces a dominant, apparent magnitude dependence of redshift at fixed colour, which indicates a need for carefully chosen deep drilling fields, and survey simulation to model this effect for future weak lensing surveys.

79 ASTRONOMY AND ASTROPHYSICS↗

Evaluating cosmological biases using photometric redshifts for Type Ia Supernova cosmology with the Dark Energy Survey Supernova Program

Cosmological analyses with Type Ia Supernovae (SNe Ia) have traditionally been reliant on spectroscopy for both classifying the type of supernova and obtaining reliable redshifts to measure the distance–redshift relation. While obtaining a host-galaxy spectroscopic redshift for most SNe is feasible for small-area transient surveys, it will be too resource intensive for upcoming large-area surveys such as the Vera Rubin Observatory Legacy Survey of Space and Time, which will observe on the order of millions of SNe. Here, we use data from the Dark Energy Survey (DES) to address this problem with photometric redshifts (photo-z) inferred directly from the SN light curve in combination with Gaussian and full p(z) priors from host-galaxy photo-z estimates. Using the DES 5-yr photometrically classified SN sample, we consider several photo-z algorithms as host-galaxy photo-z priors, including the Self-Organizing Map redshifts (SOMPZ), Bayesian Photometric Redshifts (BPZ), and Directional-Neighbourhood Fitting (DNF) redshift estimates employed in the DES 3 × 2 point analyses. With detailed catalogue-level simulations of the DES 5-yr sample, we find that the simulated w can be recovered within ±0.02 when using SN+SOMPZ or DNF prior photo-z, smaller than the average statistical uncertainty for these samples of 0.03. With data, we obtain biases in w consistent with simulations within ~1σ for three of the five photo-z variants. We further evaluate how photo-z systematics interplay with photometric classification and find classification introduces a subdominant systematic component. This work lays the foundation for next-generation fully photometric SNe Ia cosmological analyses.

(cosmology:) dark energy↗

Chromatic effects on the PSF and shear measurement for the Roman Space Telescope High-Latitude Wide Area Survey

Weak gravitational lensing (WL) is a key cosmological probe that requires precise measurement of galaxy images to infer shape distortions, or shear, and constrain cosmology. Accurate estimation of the point spread function (PSF) is crucial for shear measurement, but the wavelength dependence of the PSF introduces chromatic biases that can systematically impact shear inference. We focus on biases arising from spectral energy distribution (SED) differences between stars, used for PSF modelling, and galaxies, used for shear measurement. We investigate these effects in Roman’s four design reference mission WL bands (Y106, J129, H158, F184) and wide filter (W146). Using Roman-like image simulations, we quantify the induced shear biases and compare them to requirements on those biases. Multiplicative biases over all galaxies hover around ~0.2 per cent in the WL bands and 2 per cent in the wide filter, exceeding the mission requirement of |m| < 0.032 per cent and relaxed requirement of |m| < 0.1 per cent⁠. In individual redshift bins, biases can reach 0.4–0.9 per cent for the WL bands and 3–6 per cent for the wide filter. Additive biases remain acceptable in the WL bands but exceed systematic limits in the wide filter. We develop and test PSF-level corrections, showing that a first-order correction reduces biases within survey requirements for the WL bands; however, higher-order terms are necessary for the wide filter. Our results highlight the necessity of chromatic corrections for precision WL with Roman and provide a framework for mitigating these biases. Finally, we compare analytical colour-based corrections to self-organizing maps and find that both methods effectively reduce biases.

79 ASTRONOMY AND ASTROPHYSICS↗

Dark Energy Survey Year 6 results: Redshift calibration of the MagLim++ lens sample

In this work, we derive and calibrate the redshift distribution of the MagLim++ lens galaxy sample used in the Dark Energy Survey Year 6 (DES Y6) 3 x 2pt cosmology analysis. The 3 x 2pt analysis combines galaxy clustering from the lens galaxy sample and weak gravitational lensing. The redshift distributions are inferred using the SOMPZ method - a Self-Organizing Map framework that combines deep-field multi-band photometry, wide-field data, and a synthetic source injection ( B alrog) catalog. Key improvements over the DES Year 3 (Y3) calibration include a noise-weighted SOM metric, an expanded Balrog catalogue, and an improved scheme for propagating systematic uncertainties, which allows us to generate O(10 8 ) redshift realizations that collectively span the dominant sources of uncertainty. These realizations are then combined with independent clustering-redshift measurements via importance sampling. The resulting calibration achieves typical uncertainties on the mean redshift of 1-2%, corresponding to a 20-30% average reduction relative to DES Y3. We compress the n(z) uncertainties into a small number of orthogonal modes for use in cosmological inference. Marginalizing over these modes leads to only a minor degradation in cosmological constraints. Here, this analysis establishes the MagLim++ sample as a robust lens sample for precision cosmology with DES Y6 and provides a scalable framework for future surveys.

dark energy↗

Optimization of a High Pressure Turbine Blade and Sector-Based Annular Rig Design for Supercritical CO2 Power Cycle Representative Testing

Abstract As part of the ongoing research into the design of hardware for zero emission cycles, a first-stage high-pressure turbine (HPT) blade is optimized for a 300 MWe supercritical CO2 (sCO2) power cycle using the surrogate-assisted genetic algorithm optimizer in Numeca FINE/Design three-dimensional with objectives of increasing efficiency and decreasing heat load to the blade. Supercritical CO2 property tables are constructed from NIST REFPROP data for the condensable gas simulation in FINE/Turbo. A detailed mesh sensitivity study is performed for a baseline design to identify the proper-grid refinement and efficiently allocate resources for the optimization. Seventy design variables are selected for the initial population generation. Self-organizing maps are then used to focus the design variables on the most important ones affecting the objective functions. The optimization results in approximately 3000 three-dimensional Reynolds Averaged Navier Stokes simulations of different blade shapes with increases in efficiency of up to 0.85% and decreases in heat load of 14%. Families of blade shapes are identified for experimental testing in an annular rig at the Purdue Experimental Turbine Aerothermal Laboratory. A design to adapt the annular cascade for testing optimized geometries is introduced, which features eccentric radius sectors allowing for scaled-up geometries of sCO2 optimized blade profiles to be tested at design cycle representative conditions at high Reynolds numbers in dry air. Analysis into the effects of Reynolds number, working fluid, and geometric relations are presented to prove the efficacy of the test method.

Engineering↗