Search NASA⌕ Search

SEARCH · Search NASA

Results for “Model Counting”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 487 records · Page 27

Dispersion Loss Counteracts Embedding Condensation and Improves Generalization in Small Language Models

Large language models (LLMs) achieve remarkable performance through ever-increasing parameter counts, but scaling incurs steep computational costs. To better understand LLM scaling, we study representational differences between LLMs and their smaller counterparts, with the goal of replicating the representational qualities of larger models in smaller models. We observe a geometric phenomenon which we term embedding condensation, where token embeddings collapse into a narrow cone-like subspace in some language models. Through systematic analyses across multiple Transformer families, we show that small models such as GPT2 and Qwen3-0.6B exhibit severe condensation, whereas larger models such as GPT2-x1 and Qwen3-32B are more resistant to this phenomenon. Additional observations show that embedding condensation is not reliably mitigated by knowledge distillation from larger models. To fight against it, we formulate a dispersion loss that explicitly encourages embedding dispersion during training. Experiments demonstrate that it mitigates condensation, recovers dispersion patterns seen in larger models, and yields performance gains across 10 benchmarks. We believe this work offers a principled path toward improving smaller Transformers without additional parameters.

Xiao, Xi [ORNL] (ORCID:0009000009316982)↗

Energy and particle balance during plasma detachment in a long-leg divertor configuration

Abstract Comprehensive studies of energy and particle balances in the transition to plasma detachment in an alternative divertor configuration with long outer legs are shown. Numerical simulations are performed with the 2D code suite SOLPS 4.3, using a disconnected double null grid with narrow, tightly baffled long poloidal leg divertors at the outer lower target and outer upper target. A particle count scan is performed using the ‘closed gas box’ model, where the tunable parameter in the simulations is the total number of deuterium particles in the simulation space and all other parameters are held fixed, including a constant input power and trace neon impurity radiation, to assess the physics of the transition to detachment in the system as the particle count increases. Three main aspects of the physics of divertor detachment are addressed: the criteria for the local onset of divertor detachment in each of the divertors, the distribution of heat flux and other plasma parameters between the four divertors as each divertor transitions to detachment, and the role of perpendicular transport in the transition to the detached regime. A synergistic mechanism by which the cross-field transport is reduced by factors associated with the onset of plasma recombination effects is identified. These results are compared to the existing understanding of the physics of the transition to plasma detachment in standard divertors.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

On microstates counting in many body polymer quantum systems

Polymer quantum systems are mechanical models quantized in a similar way as loop quantum gravity but in which loops/graphs resembling polymers are replaced by discrete sets of points. Such systems have allowed to study in a simpler context some novel aspects of loop quantum gravity. Although thermal aspects play a crucial role in cosmology and black hole physics little attention has been given to the thermostatistics of many body polymer quantum systems. In this work we explore how the features of a one-dimensional effective polymer gas, affect its microstate counting and hence the corresponding thermodynamical quantities.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

The Uncertainty of Biomass Estimates from Modeled ICESat-2 Returns Across a Boreal Forest Gradient

The Forest Light (FLIGHT) radiative transfer model was used to examine the uncertainty of vegetation structure measurements from NASA's planned ICESat-2 photon counting light detection and ranging (LiDAR) instrument across a synthetic Larix forest gradient in the taiga-tundra ecotone. The simulations demonstrate how measurements from the planned spaceborne mission, which differ from those of previous LiDAR systems, may perform across a boreal forest to non-forest structure gradient in globally important ecological region of northern Siberia. We used a modified version of FLIGHT to simulate the acquisition parameters of ICESat-2. Modeled returns were analyzed from collections of sequential footprints along LiDAR tracks (link-scales) of lengths ranging from 20 m-90 m. These link-scales traversed synthetic forest stands that were initialized with parameters drawn from field surveys in Siberian Larix forests. LiDAR returns from vegetation were compiled for 100 simulated LiDAR collections for each 10 Mg · ha(exp -1) interval in the 0-100 Mg · ha(exp -1) above-ground biomass density (AGB) forest gradient. Canopy height metrics were computed and AGB was inferred from empirical models. The root mean square error (RMSE) and RMSE uncertainty associated with the distribution of inferred AGB within each AGB interval across the gradient was examined. Simulation results of the bright daylight and low vegetation reflectivity conditions for collecting photon counting LiDAR with no topographic relief show that 1-2 photons are returned for 79%-88% of LiDAR shots. Signal photons account for approximately 67% of all LiDAR returns, while approximately 50% of shots result in 1 signal photon returned. The proportion of these signal photon returns do not differ significantly (p greater than 0.05) for AGB intervals greater than 20 Mg · ha(exp -1). The 50m link-scale approximates the finest horizontal resolution (length) at which photon counting LiDAR collection provides strong model fits and minimizes forest structure uncertainty in the synthetic Larix stands. At this link-scale AGB greater than 20 Mg · ha(exp -1) has AGB error from 20-50% at the 95% confidence level. These results suggest that the theoretical sensitivity of ICESat-2 photon counting LiDAR measurements alone lack the ability to consistently discern differences in inferred AGB at 10 Mg · ha(exp -1) intervals in sparse forests characteristic of the taiga-tundra ecotone.

LiDAR↗

Effects of heavy-element settling on solar neutrino fluxes and interior structure

We consider the effects of gravitational settling of both He and heavier elements on the predicted solar neutrino fluxes and interior sound speed and density profiles. We find that while the structural changes that result from the inclusion of both He and heavy-element settling are only slightly larger than the changes resulting from the inclusion of He settling alone, the additional increases in expected neutrino fluxes are of comparable size. Our preferred model with both He and heavy-element settling has neutrino count rates of 9.0 SNU for Cl-37 detectors and 137 SNU for Ga-71 detectors, as compared to 7.1 and 127 SNU for a comparable model without any diffusive separation, or 8.0 and 132 SNU for a model that includes He settling alone. We suggest that the correction factors by which the predicted neutrino fluxes of solar models calculated without including the effects of diffusion should be multiplied are 1.25 +/- 0.08 for Cl detectors, 1.07 +/- 0.02 for Ga detectors, and 1.28 +/- 0.09 for the B-8 flux (1 sigma errors). Comparison of internal sound speed and density profiles strongly suggests that the additional changes in calculated p-mode oscillation frequencies due to the inclusion of heavy-element settling will be small compared to the changes that result from He settling alone, especially for the higher degree modes. All models with diffusive separation give much better agreement with the observed depth of the convection zone than do nondiffusive models. The model that includes both He and heavy-element settling requires an initial He mass fraction Y = 0.280 and has a surface He abundance of Y = 0.251 at the solar age.

Proffitt, Charles R.↗

A HYBRID MODEL FOR THE EVOLUTION OF GALAXIES AND ACTIVE GALACTIC NUCLEI IN THE INFRARED

We present a comprehensive investigation of the cosmological evolution of the luminosity function of galaxies and active galactic nuclei (AGNs) in the infrared (IR). Based on the observed dichotomy in the ages of stellar populations of early-type galaxies on one side and late-type galaxies on the other, the model interprets the epoch-dependent luminosity functions at z {>=} 1.5 using a physical approach for the evolution of proto-spheroidal galaxies and of the associated AGNs, while IR galaxies at z < 1.5 are interpreted as being mostly late-type ''cold'' (normal) and ''warm'' (starburst) galaxies. As for proto-spheroids, in addition to the epoch-dependent luminosity functions of stellar and AGN components separately, we have worked out, for the first time, the evolving luminosity functions of these objects as a whole (stellar plus AGN component), taking into account in a self-consistent way the variation with galactic age of the global spectral energy distribution. The model provides a physical explanation for the observed positive evolution of both galaxies and AGNs up to z {approx_equal} 2.5 and for the negative evolution at higher redshifts, for the sharp transition from Euclidean to extremely steep counts at (sub-)millimeter wavelengths, as well as the (sub-)millimeter counts of strongly lensed galaxies that are hard to account for by alternative, physical or phenomenological, approaches. The evolution of late-type galaxies and z < 1.5 AGNs is described using a parametric phenomenological approach. The modeled AGN contributions to the counts and to the cosmic infrared background (CIB) are always sub-dominant. They are maximal at mid-IR wavelengths: the contribution to the 15 and 24 {mu}m counts reaches 20% above 10 and 2 mJy, respectively, while the contributions to the CIB are of 8.6% and of 8.1% at 15 {mu}m and 24 {mu}m, respectively. The model provides a good fit to the multi-wavelength (from the mid-IR to millimeter waves) data on luminosity functions at different redshifts and on number counts (both global and per redshift slices). A prediction of the present model, useful to test it, is a systematic variation with wavelength of the populations dominating the counts and the contributions to the CIB intensity. This implies a specific trend for cross-wavelength CIB power spectra, which is found to be in good agreement with the data.

79 ASTRONOMY AND ASTROPHYSICS↗

High Force Spring Clamp System

This is the Final Technical Report for the work by Hyperboloid LLC using SBIR Grant # DE-SC0019579. The work responded to US DOE SBIR Topics FY2019, Phase 1, Release 1, August 13 2018, Topic: 30. a. (2) SRF cavity joining techniques that create vacuum seals without resorting to the use of bolted flanges in order to minimize particulates. Hyperboloid LLC designed, developed and tested the High Force Spring Clamp System characterized in Patent US 9756715 that is aimed at solving this topic. The patent is held by Thomas Jefferson National Accelerator Facility. The flange bolts are substituted with exceptionally high force, binder-clip-like “C” Clamps. The clamps are opened and applied by hydraulic based tooling called “Clamp Openers” using particle minimization methods. Model 1 Clamp reached the goal of sealing the SRF industry standard hexagonal section, aluminum alloy gasket, leak-free on a research cavity as determined by a superfluid helium challenge, at 2 K for 2 assembly cycles. Descriptions include the ANSYS calculations that determine the size and shape of the clamp, the details of the Clamp Opener construction, particle counts from sealing flanges using both bolts and clamps. Model 2 Clamp, at half the size, needing a softer metallic gasket to be successful, is more readily adaptable to Cryomodule designs. It was tested, but a needs soft gasket development to be successful.

43 PARTICLE ACCELERATORS↗

Performance and Accuracy Implications of Parallel Split Physics-Dynamics Coupling in the Energy Exascale Earth System Atmosphere Model

Simultaneous calculation of atmospheric processes is faster than calculating processes one at a time. This type of parallelism is beneficial or perhaps even necessary to provide good performance on modern supercomputers, which achieve faster performance through increased processor count rather than improved clock speed. The scalability of the Energy Exascale Earth System Model (E3SM) Atmosphere Model (EAM) is limited by the fluid dynamics which scales up to the number of mesh cells in the global mesh. In contrast, the suite of physics parameterizations in EAM is scalable up to the total number of physics columns, which is an order of magnitude greater than the number of mesh cells. A proposed solution to unlocking the greater potential performance from the physics suite is to solve the physics and dynamics in parallel. This work represents a first attempt at parallel splitting of the grid-scale fluid dynamics model and the subgrid-scale physics parameterizations in a global atmosphere model. We will demonstrate that switching to parallel physics-dynamics coupling extends the scalability of the EAM to up to 3 times the previous peak scalability limit and is up to 20% faster than the sequentially split coupling at the highest core counts and the same time step. Decadal simulations of both coupling approaches show very little impact to the model climate. This improved performance does not come without drawbacks, however. Parallel splitting requires a shorter time step and other modifications which largely offset performance gains. A mass fixer is required for conservation. Techniques for mitigating these issues are also discussed.

97 MATHEMATICS AND COMPUTING↗

A NEW STATISTICAL PERSPECTIVE TO THE COSMIC VOID DISTRIBUTION

In this study, we obtain the size distribution of voids as a three-parameter redshift-independent log-normal void probability function (VPF) directly from the Cosmic Void Catalog (CVC). Although many statistical models of void distributions are based on the counts in randomly placed cells, the log-normal VPF that we obtain here is independent of the shape of the voids due to the parameter-free void finder of the CVC. We use three void populations drawn from the CVC generated by the Halo Occupation Distribution (HOD) Mocks, which are tuned to three mock SDSS samples to investigate the void distribution statistically and to investigate the effects of the environments on the size distribution. As a result, it is shown that void size distributions obtained from the HOD Mock samples are satisfied by the three-parameter log-normal distribution. In addition, we find that there may be a relation between the hierarchical formation, skewness, and kurtosis of the log-normal distribution for each catalog. We also show that the shape of the three-parameter distribution from the samples is strikingly similar to the galaxy log-normal mass distribution obtained from numerical studies. This similarity between void size and galaxy mass distributions may possibly indicate evidence of nonlinear mechanisms affecting both voids and galaxies, such as large-scale accretion and tidal effects. Considering the fact that in this study, all voids are generated by galaxy mocks and show hierarchical structures in different levels, it may be possible that the same nonlinear mechanisms of mass distribution affect the void size distribution.

79 ASTRONOMY AND ASTROPHYSICS↗

Models of the contribution of blazars to the anisotropy of the extragalactic diffuse gamma-ray background

We study the relation between the measured anisotropies in the extragalactic diffuse gamma-ray background (DGRB) and the DGRB spectral intensity, and their potential origin from the unresolved blazar population. Using a physical-evolution model for blazars with a luminosity dependent density evolution (LDDE) and an observationally-determined luminosity-dependent blazar spectral energy distribution (SED), we find that blazars can account for the observed anisotropy of the DGRB consistent with their observed source-count distribution, but are in turn constrained in contributing significantly to the observed DGRB intensity. For the best-fit LDDE model accounting for the DGRB anisotropy and source-count distribution, blazars only contribute 5.9{sup +2.1}{sub −1.0}% (68% CL) of the DGRB intensity above 1 GeV. Requiring a higher fraction of the DGRB intensity contribution by blazars overproduces the DGRB anisotropy, and therefore blazars in the LDDE+SED-sequence model cannot simultaneously account for the DGRB intensity as well as anisotropy. We discuss the limitations of LDDE models. However, these models do not require the many unjustified and observationally-inconsistent simplifying assumptions — including a single power law for all blazar spectra and a simple broken power-law model for their source-count distribution — that are present in much previous work.

79 ASTRONOMY AND ASTROPHYSICS↗

An interactive program for software reliability modeling

With the tremendous growth in computer software, the demand has arisen for producing cost effective reliable software. Over the last 10 years an area of research has developed which attempts to address this problem by estimating a program's current reliability by modeling either the times between error detections or the error counts in past testing periods. A new tool for interactive software reliability analysis using the computer is described. This computer program allows the user to perform a complete reliability analysis using any of eight well-known models appearing in the literature. Some of the capabilities of the program are illustrated by means of an analysis of a set of simulated error data.

Farr, W. H.↗

FAR-ULTRAVIOLET NUMBER COUNTS OF FIELD GALAXIES

The far-ultraviolet (FUV) number counts of galaxies constrain the evolution of the star formation rate density of the universe. We report the FUV number counts computed from FUV imaging of several fields including the Hubble Ultra Deep Field, the Hubble Deep Field North, and small areas within the GOODS-North and South fields. These data were obtained with the Hubble Space Telescope (HST) Solar Blind Channel of the Advance Camera for Surveys. The number counts sample an FUV AB magnitude range from 21 to 29 and cover a total area of 15.9 arcmin{sup 2}, {approx}4 times larger than the most recent HST FUV study. Our FUV counts intersect bright FUV Galaxy Evolution Explorer counts at 22.5 mag and they show good agreement with recent semi-analytic models based on dark matter 'merger trees' by R. S. Somerville et al. We show that the number counts are {approx}35% lower than in previous HST studies that use smaller areas. The differences between these studies are likely the result of cosmic variance; our new data cover more lines of sight and more area than previous HST FUV studies. The integrated light from field galaxies is found to contribute between 65.9{sup +8}{sub -8} and 82.6{sup +12}{sub -12} photons s{sup -1} cm{sup -2} sr{sup -1} A{sup -1} to the FUV extragalactic background. These measurements set a lower limit for the total FUV background light.

79 ASTRONOMY AND ASTROPHYSICS↗

Spatial Transferability of Machine Learning Based Volume Estimation Models

High-quality traffic volume data is essential for efficient transportation planning and operations. However, such high-quality data is expensive to collect, owing primarily to the high capital cost of installing and maintaining continuous counting stations (CCSs). Recent availability of probe-based vehicle data offers a cost-effective solution for increasing the observability of traffic volumes. However, having ample ground truth traffic data is a prerequisite for developing robust volume estimation models. Though this might not be a big issue in many states, states with scarce CCS data might be able to benefit from robust volume estimation models developed in (adjacent) data-rich states. While there is a reasonable amount of spatial transferability research in the transportation domain, there is a dearth of knowledge on the spatial transferability of probe-based volume estimation models. To address this gap, this paper explores spatial transferability of volume estimation models developed from data in three states (Colorado, North Carolina, and Pennsylvania). Results indicate that it is extremely important to maintain temporal consistency when attempting spatial transferability of volume estimation models. It was also found that models trained on regions with lower peak traffic volumes will limit the performance of models transferred to states with higher peak hourly traffic volumes. Corroborating findings from existing spatial transferability research on other topics, it was found that a meta-model (developed using data from multiple states) performs better than volume estimation models developed within any one of the states.

ADVANCED PROPULSION SYSTEMS↗

The current status of REH theory

A response is made to the evaluation of Fitch (1980) of REH (random evolutionary hits) theory for the evolutionary divergence of proteins and nucleic acids. Correct calculations for the beta hemoglobin mRNAs of the human, mouse and rabbit in the absence and presence of selective constraints are summarized, and it is shown that the alternative evolutionary analysis of Fitch underestimates the total fixed mutations. It is further shown that the model used by Fitch to test for the completeness of the count of total base substitutions is in fact a variant of REH theory. Considerations of the variance inherent in evolutionary estimations are also presented which show the REH model to produce no more variance than other evolutionary models. In the reply, it is argued that, despite the objections raised, REH theory applied to proteins gives inaccurate estimates of total gene substitutions. It is further contended that REH theory developed for nucleic sequences suffers from problems relating to the frequency of nucleotide substitutions, the identity of the codons accepting silent and amino acid-changing substitutions, and estimate uncertainties.

Holmquist, R.↗

Multichannel response analysis on 2D projection views for detection of clustered microcalcifications in digital breast tomosynthesis

Purpose: To investigate the feasibility of a new two-dimensional (2D) multichannel response (MCR) analysis approach for the detection of clustered microcalcifications (MCs) in digital breast tomosynthesis (DBT). Methods: With IRB approval and informed consent, a data set of two-view DBTs from 42 breasts containing biopsy-proven MC clusters was collected in this study. The authors developed a 2D approach for MC detection using projection view (PV) images rather than the reconstructed three-dimensional (3D) DBT volume. Signal-to-noise ratio (SNR) enhancement processing was first applied to each PV to enhance the potential MCs. The locations of MC candidates were then identified with iterative thresholding. The individual MCs were decomposed with Hermite–Gaussian (HG) and Laguerre–Gaussian (LG) basis functions and the channelized Hotelling model was trained to produce the MCRs for each MC on the 2D images. The MCRs from the PVs were fused in 3D by a coincidence counting method that backprojects the MC candidates on the PVs and traces the coincidence of their ray paths in 3D. The 3D MCR was used to differentiate the true MCs from false positives (FPs). Finally a dynamic clustering method was used to identify the potential MC clusters in the DBT volume based on the fact that true MCs of clinical significance appear in clusters. Using two-fold cross validation, the performance of the 3D MCR for classification of true and false MCs was estimated by the area under the receiver operating characteristic (ROC) curve and the overall performance of the MCR approach for detection of clustered MCs was assessed by free response receiver operating characteristic (FROC) analysis. Results: When the HG basis function was used for MCR analysis, the detection of MC cluster achieved case-based test sensitivities of 80% and 90% at the average FP rates of 0.65 and 1.55 FPs per DBT volume, respectively. With LG basis function, the average FP rates were 0.62 and 1.57 per DBT volume at the same sensitivity levels. The difference in the two sets of basis functions for detection of MCs did not show statistical significance. Conclusions: The authors' experimental results indicate that the MCR approach is promising for the detection of MCs on PV images. The HG or LG basis functions are both effective in characterizing the signal response of MCs using the channelized Hotelling model. The coincidence counting method for fusion of the 2D MCR in 3D is an important step for FP reduction. Further study is underway to improve the MCR approach for microcalcification detection in DBT.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Beyond real: alternative unitary cluster Jastrow models for molecular electronic structure calculations on near-term quantum computers

Near-term quantum devices require wavefunction ansätze that are expressive while also of shallow circuit depth in order to both accurately and efficiently simulate molecular electronic structure. While the unitary coupled cluster ansatz (e.g., UCCSD) has become a standard, the high gate count associated with the implementation of this limits its feasibility on noisy intermediate-scale quantum (NISQ) hardware. k -Fold unitary cluster Jastrow (uCJ) ansätze mitigate this challenge by providing O( kN 2 ) circuit scaling and favorable linear depth circuit implementation. Previous work has focused on the real orbitalrotation (Re-uCJ) variant of uCJ, which allows an exact (Trotter-free) implementation. Here we extend and generalize the k -fold uCJ framework by introducing two new variants, Im-uCJ and g-uCJ, which incorporate imaginary and fully complex orbital rotation operators, respectively. Similar to Re-uCJ, both of the new variants achieve quadratic gate-count scaling. Our results focus on the simplest k = 1 model, and show that the uCJ models frequently maintain energy errors within chemical accuracy (∼1 kcal mol −1 ). Both g-uCJ and Im-uCJ are more expressive in terms of capturing electron correlation and are also more accurate than the earlier Re-uCJ ansatz. We further show that Im-uCJ and g-uCJ circuits can also be implemented exactly, without any Trotter decomposition. Numerical tests using k = 1 on H 2 , H 3 + , Be 2 , C 2 H 4 , C 2 H 6 and C 6 H 6 in various basis sets confirm the practical feasibility of these shallow Jastrow-based ansätze for applications on near-term quantum hardware.

Tkachenko, Nikolay V. [University of California, B↗