Search NASA⌕ Search

SEARCH · Search NASA

Results for “gradient projection”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 397 records · Page 22
All sourcesNASA NTRSDOE OSTI
NASA NTRS1997

Pioneer 10 and 11 Data Analysis

This report finishes the work of NASA Grant NAS2-153, which supported data analysis for the UCSD instruments on Pioneers 10 and 11. The data analyzed under this grant span 22 years of interplanetary measurements in the inner and outer heliosphere. The UCSD instruments made their mark in cosmic ray research based upon their high energy thresholds, directional responses, and reliable data streams. one of their primary scientific objectives concerns the size, configuration, and time behavior of the heliosphere. The size scale is inferred from the radial intensity gradient, which is measured between the two spacecraft and extrapolated to interstellar intensity levels at the cosmic ray modulation boundary. This boundary still eludes us, and its position, motion, and the best method of extrapolation are ongoing problems. Current projections place the boundary beyond 100 AU, which may be beyond the termination shock, and raises the question of possible modulation in the heliosheath. Probably our only hope of seeing this region in the immediate future rides on the possibility that the boundary will move inward. Our instruments have recorded many Forbush, or transient, decreases in the outer heliosphere. These observations led us to a model that attributes many of the decreases to solar wind stream-stream interactions, and relates the cosmic ray variations to the locally observed magnetic field magnitude. As the cosmic ray variations in this model result only from topological changes in the modulation integral, the model is a tool for studying the possibility that the 11 year cosmic ray modulation cycle can be accounted for by a superposition of Forbush decreases. The cosmic ray angular distribution function is measurable, given a good telemetry rate, by the UCSD Cerenkov detector which counts particles of energy greater than 500 MeV/n. We obtained statistically significant samples from 1 to 9 AU, at 13 AU, and at 34 AU. The anisotropy tends to be a few tenths of a per cent at all radial distances. A quasiperiodic variation in the east-west anisotropy with period of about 50 days remains unexplained.

Fillius, Walker↗
NASA NTRS1996

Space research activities during missions of the past

For over 30 yr, men and women have lived for various periods of time in a weightless (or free-fall) environment while orbiting the Earth. During these years, we have learned that humans function quite well for short periods of weightlessness, that is, for up to a little more than a year. Some space flight missions have provided physiologic data, including cardiovascular data, from the spacefarers. In fact, some missions have provided laboratories for systematic study of cardiovascular responses and adaptation to space flight. However, the opportunity to obtain physiologic data from people in space is a rarity. It is important to remember that the population sample sizes are small, other stresses may confound the effects of weightlessness, and in some situations the crewmembers are subjects for several experiments at the same time. Furthermore, comparison of cardiovascular data from space flight to data obtained on the ground is sometimes difficult because the subject's posture on the ground is not always reported; in a gravity environment, posture influences the hydrostatic gradient. This over view describes what we have learned about cardiovascular function during flight and after return to Earth.

NASA Discipline Cardiopulmonary↗
NASA NTRS2011

Tropical and Subtropical Cloud Transitions in Weather and Climate Prediction Models: The GCSS/WGNE Pacific Cross-Section Intercomparison (GPCI)

A model evaluation approach is proposed in which weather and climate prediction models are analyzed along a Pacific Ocean cross section, from the stratocumulus regions off the coast of California, across the shallow convection dominated trade winds, to the deep convection regions of the ITCZ the Global Energy and Water Cycle Experiment Cloud System Study/Working Group on Numerical Experimentation (GCSS/ WGNE) Pacific Cross-Section Intercomparison (GPCI). The main goal of GPCI is to evaluate and help understand and improve the representation of tropical and subtropical cloud processes in weather and climate prediction models. In this paper, a detailed analysis of cloud regime transitions along the cross section from the subtropics to the tropics for the season June July August of 1998 is presented. This GPCI study confirms many of the typical weather and climate prediction model problems in the representation of clouds: underestimation of clouds in the stratocumulus regime by most models with the corresponding consequences in terms of shortwave radiation biases; overestimation of clouds by the 40-yr ECMWF Re-Analysis (ERA-40) in the deep tropics (in particular) with the corresponding impact in the outgoing longwave radiation; large spread between the different models in terms of cloud cover, liquid water path and shortwave radiation; significant differences between the models in terms of vertical cross sections of cloud properties (in particular), vertical velocity, and relative humidity. An alternative analysis of cloud cover mean statistics is proposed where sharp gradients in cloud cover along the GPCI transect are taken into account. This analysis shows that the negative cloud bias of some models and ERA-40 in the stratocumulus regions [as compared to the first International Satellite Cloud Climatology Project (ISCCP)] is associated not only with lower values of cloud cover in these regimes, but also with a stratocumulus-to-cumulus transition that occurs too early along the trade wind Lagrangian trajectory. Histograms of cloud cover along the cross section differ significantly between models. Some models exhibit a quasi-bimodal structure with cloud cover being either very large (close to 100%) or very small, while other models show a more continuous transition. The ISCCP observations suggest that reality is in-between these two extreme examples. These different patterns reflect the diverse nature of the cloud, boundary layer, and convection parameterizations in the participating weather and climate prediction models.

Teixeira, J.↗
NASA NTRS2022

Constraining Arctic Climate Projections of Wintertime Warming With Surface Turbulent Flux Observations and Representation of Surface-Atmosphere Coupling

The drivers of rapid Arctic climate change—record sea ice loss, warming SSTs, and a lengthening of the sea ice melt season—compel us to understand how this complex system operates and use this knowledge to enhance Arctic predictability. Changing energy flows sparked by sea ice decline, spotlight atmosphere-surface coupling processes as central to Arctic system function and its climate change response. Despite this, the representation of surface turbulent flux parameterizations in models has not kept pace with our understanding. The large uncertainty in Arctic climate change projections, the central role of atmosphere-surface coupling, and the large discrepancy in model representation of surface turbulent fluxes indicates that these processes may serve as useful observational constraints on projected Arctic climate change. This possibility requires an evaluation of surface turbulent fluxes and their sensitivity to controlling factors (surface-air temperature and moisture differences, sea ice, and winds) within contemporary climate models (here Coupled Model Intercomparison Project 6). The influence of individual controlling factors and their interactions is diagnosed using a multi-linear regression approach. This evaluation is done for four sea ice loss regimes, determined from observational sea ice loss trends, to control for the confounding effects of natural variability between models and observations. The comparisons between satellite- and model-derived surface turbulent fluxes illustrate that while models capture the general sensitivity of surface turbulent fluxes to declining sea ice and to surface-air gradients of temperature and moisture, substantial mean state biases exist. Specifically, the central Arctic is too weak of a heat sink to the winter atmosphere compared to observations, with implications to the simulated atmospheric circulation variability and thermodynamic profiles. Models were found to be about 50% more efficient at turning an air-sea temperature gradient anomaly into a sensible heat flux anomaly relative to observations. Further, the influence of sea ice concentration on the sensible heat flux is underestimated in models compared to observations. The opposite is found for the latent heat flux variability in models; where the latent heat flux is too sensitive to a sea ice concentration anomaly. Lastly, the results suggest that present-day trends in sea ice retreat regions may serve as suitable observational constraints of projected Arctic warming.

turbulent fluxes↗
DOE OSTI2026

Numerical Investigation of Fluid Flow and Space Charge in Liquid Argon Time Projection Chamber (LArTPC) Detectors

Overview This project focused on developing a high-fidelity numerical framework to simulate the multiphysics environment within Liquid Argon Time Projection Chamber (LArTPC) detectors. The primary objective was to characterize the complex interplay between ion transport, background fluid dynamics, and electric field distortions—a critical factor for the calibration and sensitivity of next-generation High Energy Physics experiments, such as DUNE. Technical Achievements The research successfully yielded a hybrid numerical space-charge solver utilizing a Cell-Centered Finite Volume Method (FVM) for ion transport coupled with a Finite Element Method (FEM) for electric potential. Key accomplishments include: • Verification & Validation: The 3-D solver was rigorously verified against 1-D analytical solutions, demonstrating high numerical accuracy in predicting space-charge-induced field deviations. • Field Distortion Analysis: 3D simulations revealed that space charge effects introduce significant non-uniformities in the electric field. Critically, the research identified that background LAr flow velocities, when comparable to ion drift velocities, markedly exacerbate these distortions. • Technology Transfer: The resulting source code and comprehensive user manuals were successfully transferred to collaborators at Fermilab, providing a portable computational tool for the broader scientific community. Challenges and Future Directions While the space-charge solver achieved all performance metrics, the integrated fluid dynamics modeling encountered convergence challenges stemming from the extreme 200-fold disparity in length scales between the detector's 37 mm inlet pipes and the 8-meter global domain. To address this, the project has identified a clear technical pivot toward Hierarchical Geometric Adaptive Mesh Refinement (HG-AMR). By implementing an h-type refinement strategy with hanging nodes, future iterations of this solver will be capable of resolving localized high-gradient inlet flows without the prohibitive computational costs of regular grids. This advancement, combined with data-driven uncertainty quantification based on MicroBooNE-style calibration, will enable the precise modeling of detector responses in large-scale cryogenic environments where direct measurement remains difficult. Impact The computational tools developed under this award provide a foundation for enhancing the energy resolution and spatial reconstruction of noble liquid detectors. By bridging the gap between theoretical fluid dynamics and experimental field calibration, this work supports the DOE’s mission to advance the frontiers of neutrino physics and dark matter detection.

42 ENGINEERING↗
NASA NTRS1981

Singular perturbation, state aggregation and nonlinear filtering

Consideration is given to a state process evolving in R(n), whose motion is that of a pure jump process in R(n) in the 0(1) time scale, upon which is superimposed a continuous motion along the orbits of a gradient-like vector field g in R(n) in the 0(1/epsilon) time scale. The infinitesimal generator of the state process is, in other words, of the form L + (1/epsilon)g. It follows from the main results presented that the projected filters converge to the finite state Wonham filter corresponding to the problem of estimating the finite state process in the presence of additive white noise.

Hijab, O.↗
NASA NTRS1985

Biogeochemical cycling in terrestrial ecosystems - Modeling, measurement, and remote sensing

The use of modeling, remote sensing, and measurements to characterize the pathways and to measure the rate of biogeochemical cycling in forest ecosystems is described. The application of the process-level model to predict processes in intact forests and ecosystems response to disturbance is examined. The selection of research areas from contrasting climate regimes and sites having a fertility gradient in that regime is discussed, and the sites studied are listed. The use of remote sensing in determining leaf area index and canopy biochemistry is analyzed. Nitrous oxide emission is investigated by using a gas measurement instrument. Future research projects, which include studying the influence of changes on nutrient cycling in ecosystems and the effect of pollutants on the ecosystems, are discussed.

Peterson, D. L.↗
NASA NTRS2003

Citizen Explorer: An Earth Observer With New Small Satellite Technology - 1

Citizen Explorer-I (CX-I), designed and built by students at Colorado Space Grant Consortium in Boulder to provide global ozone monitoring, employs a unique mission architecture and several innovative technologies during its mission. The mission design allows K-12 schools around the world to be involved as ground stations available to receive science data and telemetry from CX-I. Another important technology allows the spacecraft to be less reliant on ground operators. Spacecraft Command Language (SCL) allows mission designers to set constraints on the satellite operations. The satellite then automatically adheres to the constraints when the satellite is out of contact with Mission Operations. In addition to SCL, a low level of artificial intelligence will be supplied to the spacecraft through the use of the Automated Scheduling and Planning ENvironment (ASPEN). ASPEN is used to maintain a spacecraft schedule in order to achieve the objectives a mission operator would normally have to complete. Within the communications system of CX-I, internet of CX-I, internet protocols are the main method for communicating with the satellite. As internet protocols have not been widely used in satellite communication, CX-I provides an opportunity to study the effectiveness of using internet protocols over radio links. The Attitude Determination and Control System (ADCS) on CX-I uses a gravity gradient boom as a means of orienting the satellite's science instruments toward nadir. The boom design is unique because it is constructed of tape measure material. These new technologies' effectiveness will be tested for use on future small satellite projects within the space satellite industry.

Allen, Zachary↗
DOE OSTI2021

Demonstrate the Out-of-Pile Performance of a Real-Time Measurement System to Measure Thermal Conductivity Based on Photo Thermal Radiometry

SUMMARY The goal of this project is to develop a fiber-based instrument to perform in-reactor thermal conductivity measurements of fuels and materials. This instrument is based on photothermal radiometry (PTR) and involves heating a sample locally and measuring the induced temperature gradient by collecting blackbody radiation [2]. Thermal conductivity of the sample is extracted by comparing experimental results with a continuum-based model [3,4]. As a laser-based technique, PTR is a non-contact measurement technique that can be performed remotely and non-destructively. In addition, it has several advantages over other photothermal techniques, making it an ideal approach for in-situ measurement of thermal conductivity of nuclear fuels. Because blackbody radiation increases with emissivity and temperature, the PTR technique works well with unprepared surfaces, and measurement accuracy increases with temperature. Moreover, this approach is capable of measuring samples with irregular or poorly defined boundary conditions, which is a common situation for friable spent fuels.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
NASA NTRS2002

Cloud Condensation Nuclei in FIRE III

Yum and Hudson showed that the springtime Arctic aerosol is probably a result of long-range transport at high altitudes. Scavenging of particles by clouds reduces the low level concentrations by a factor of 3. This produces a vertical gradient in particle concentrations when low-level clouds are present. Concentrations are uniform with height when clouds are not present. Low-level CCN (cloud condensation nuclei) spectra are similar to those in other maritime areas as found by previous projects including FIRE 1 and ASTEX, which were also supported on earlier NASA-FIRE grants. Wylie and Hudson carried this work much further by comparing the CCN spectra observed during ACE with back trajectories of air masses and satellite photographs. This showed that cloud scavenging reduces CCN concentrations at all altitudes over the springtime Arctic, with liquid clouds being more efficient scavengers than frozen clouds. The small size of the Arctic Ocean seems to make it more susceptible to continental and thus anthropogenic aerosol influences than any of the other larger oceans.

Hudson, James G.↗
NASA NTRS2007

Space Invariant Independent Component Analysis and ENose for Detection of Selective Chemicals in an Unknown Environment

In this paper, we present a space invariant architecture to enable the Independent Component Analysis (ICA) to solve chemical detection from two unknown mixing chemical sources. The two sets of unknown paired mixture sources are collected via JPL 16-ENose sensor array in the unknown environment with, at most, 12 samples data collected. Our space invariant architecture along with the maximum entropy information technique by Bell and Sejnowski and natural gradient descent by Amari has demonstrated that it is effective to separate the two mixing unknown chemical sources with unknown mixing levels to the array of two original sources under insufficient sampled data. From separated sources, they can be identified by projecting them on the 11 known chemical sources to find the best match for detection. We also present the results of our simulations. These simulations have shown that 100% correct detection could be achieved under the two cases: a) under-completed case where the number of input (mixtures) is larger than number of original chemical sources; and b) regular case where the number of input is as the same as the number of sources while the time invariant architecture approach may face the obstacles: overcomplete case, insufficient data and cumbersome architecture.

ENose↗
DOE OSTI2020

Novel strategies for modal-based structural material identification

Here, we present modal-based methods for model calibration in structural dynamics, and address several key challenges in the solution of gradient-based optimization problems with eigenvalues and eigenvectors, including the solution of singular Helmholtz problems encountered in sensitivity calculations, non-differentiable objective functions caused by mode swapping during optimization, and cases with repeated eigenvalues. Unlike previous literature that relied on direct solution of the eigenvector adjoint equations, we present a parallel iterative domain decomposition strategy (Adjoint Computation via Modal Superposition with Truncation Augmentation) for the solution of the singular Helmholtz problems. For problems with repeated eigenvalues we present a novel Mode Separation via Projection algorithm, and in order to address mode swapping between inverse iterations we present a novel Injective mode ordering metric. We present the implementation of these methods in a massively parallel finite element framework with the ability to use measured modal data to extract unknown structural model parameters from large complex problems. A series of increasingly complex numerical examples are presented that demonstrate the implementation and performance of the methods in a massively parallel finite element framework [7], [5], using gradient-based optimization techniques in the Rapid Optimization Library (ROL) [21].

36 MATERIALS SCIENCE↗
DOE OSTI2024

NSA Site Science: Use of ARM Observations from Northern Alaska to Evaluate and Improve Prediction Capabilities

The Arctic is warming at a rate nearly double that of the rest of the planet, leading to profound changes in atmospheric, oceanic, and ice processes. The U.S. Department of Energy's (DOE) Atmospheric Radiation Measurement (ARM) user facility has played a significant role in Arctic research, operating observatories in Alaska's North Slope for over 25 years. These observatories provide a rich, and wide-reaching dataset that offers insight into atmospheric processes in northern Alaska. This report details the results of a nine-year research project (2015–2024) supported by the DOE Atmospheric Systems Research (ASR) program, that leverages data from ARM’s deployment of observing facilities at Utqiaġvik (known as the North Slope of Alaska, or NSA, site) and Oliktok Point, Alaska. The project was conducted in two phases: - Phase 1 (2015–2019): Focused on understanding key atmospheric processes at Oliktok Point, including cloud formation, high-latitude precipitation, aerosol-cloud interactions, and cloud properties. - Phase 2 (2019–2024): Extended the research to the broader North Slope region, using data from both Oliktok Point and Utqiaġvik. Topics explored included surface energy budgets, atmospheric stability, ice nucleation processes, and microphysics in Arctic clouds. The project resulted in numerous research products, including 50 peer-reviewed publications and dissertations, 169 presentations, and 10 data products. These products cover a variety of topics, including: - Cloud Macro- and Microphysical Properties: Arctic clouds play a crucial role in energy transfer, and accurate representation in models is critical. The study explored cloud transitions, ice crystal shapes, and dual-wavelength radar data to understand ice crystal habits and size distributions. - Aerosol Properties and Processes: The team examined aerosol sources in the Arctic, including industrial emissions and natural sources. Observations showed significant spatial gradients in aerosol concentrations due to human activities and wildfire smoke. The influence of aerosols on cloud formation and the surface energy budget was also assessed. - Aerosol-Cloud Interactions: Research revealed that aerosols might suppress cloud ice production, affecting cloud radiative forcing and precipitation. The impact of local industrial emissions on cloud properties was also investigated. - Contextualizing the North Slope of Alaska in the context of the broader Arctic: To understand broader trends, the project evaluated large-scale circulation patterns and the influence of weather systems on the Arctic. Studies indicated that large-scale processes play a significant role in temperature patterns and the timing of snowmelt. - Advancing ARM Observational and Modeling Capabilities: The project developed new radar data products and advanced measurement techniques, including clutter mitigation and drizzle detection. Uncrewed aerial systems (UAS) and tethered balloon systems (TBS) were deployed to gather detailed atmospheric data. Additionally, the project supported 10 early career scientists, providing training and mentorship to undergraduate interns, graduate students, postdoctoral researchers, and early career researchers. These efforts contributed to the advancement of ARM research capabilities and fostered a new generation of scientists skilled in Arctic atmospheric research. Ultimately, this ASR-supported project has provided valuable insights into Arctic atmospheric processes and their broader climate implications. Recommendations for future work include continuing support for long-term observing at Arctic locations to foster additional research, further exploration of aerosol-cloud interactions and the potential impacts of enhanced industrialization of the Arctic, and expanded use of uncrewed systems to gather data in this remote and harsh environment. Additionally, the data products developed by this work, and the data products developed through the ARM infrastructure, leave a treasure-trove of additional information that should be explored for many years to come to gain additional insight into physical processes in the Arctic atmosphere that drive the rapid changes occurring in at high latitudes and their global impact.

58 GEOSCIENCES↗
DOE OSTI2022

Enhanced jet stream waviness induced by suppressed tropical Pacific convection during boreal summer

Abstract Consensus on the cause of recent midlatitude circulation changes toward a wavier manner in the Northern Hemisphere has not been reached, albeit a number of studies collectively suggest that this phenomenon is driven by global warming and associated Arctic amplification. Here, through a fingerprint analysis of various global simulations and a tropical heating-imposed experiment, we suggest that the suppression of tropical convection along the Inter Tropical Convergence Zone induced by sea surface temperature (SST) cooling trends over the tropical Eastern Pacific contributed to the increased summertime midlatitude waviness in the past 40 years through the generation of a Rossby-wave-train propagating within the jet waveguide and the reduced north-south temperature gradient. This perspective indicates less of an influence from the Arctic amplification on the observed mid-latitude wave amplification than what was previously estimated. This study also emphasizes the need to better predict the tropical Pacific SST variability in order to project the summer jet waviness and consequent weather extremes.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

Interactions between molecular-scale biogeochemical processes and hyporheic exchange for understanding coupled Fe-S-C cycling in iron-rich riparian wetlands (Final Technical Report)

Riparian wetlands are dynamic interfaces that exert strong control over water quality, contaminant mobility, and greenhouse gas emissions. These systems are characterized by hyporheic exchange between oxic surface water and anoxic groundwater, which generates steep redox gradients and promotes spatially and temporally variable microbial activity. Despite growing recognition of tightly coupled iron (Fe), sulfur (S), and carbon (C) cycling in these environments, the mechanisms governing these interactions—particularly under low-sulfate freshwater conditions—remain poorly constrained. This project developed a mechanistic understanding of how hydrologic variability and microbial processes interact to control Fe–S–C cycling in iron-rich riparian wetlands. Using a multi-scale and multi-method approach integrating field observations, geochemical and spectroscopic analyses, metagenomics, and reactive transport modeling, we demonstrate that “cryptic” sulfur cycling—rapid sulfur transformations involving intermediate-valence species—plays a dominant and previously underrecognized role in freshwater wetlands. These processes persist despite low sulfate concentrations and significantly influence iron reduction, carbon mineralization, and methane dynamics. The results show that cryptic sulfur cycling enhances dissolved Fe 2+ production, regulates methane concentrations, and is strongly controlled by climate-driven hydrologic fluxes. By linking hydroclimate, subsurface flow, and biogeochemical reactions, this work provides a predictive framework for understanding how wetland systems respond to environmental change, with direct implications for water quality and carbon cycling.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS1988

Synthesis of finite displacements and displacements in continental margins

The scope of the project is the analysis of displacement-rate fields in the transitional regions between cratonal and oceanic lithospheres over Phanerozoic time (last 700 ma). Associated goals are an improved understanding of range of widths of major displacement zones; the partition of displacement gradients and rotations with position and depth in such zones; the temporal characteristics of such zones-the steadiness, episodicity, and duration of uniform versus nonunifrom fields; and the mechanisms and controls of the establishment and kinematics of displacement zones. The objective is to provide a context of time-averaged kinematics of displacement zones. The initial phase is divided topically among the methodology of measurement and reduction of displacements in the lithosphere and the preliminary analysis from geologic and other data of actual displacement histories from the Cordillera, Appalachians, and southern North America.

Speed, R. C.↗
NASA NTRS2011

The Changing California Coast: The Effect of a Variable Water Budget on Coastal Vegetation Succession

The land-ocean interface along the central coast of California is one of the most diverse biogeographic regions of the state. This area is composed of a species-rich mosaic of coastal grassland, shrubland, and forest vegetation types. An acceleration of conifer encroachment into shrublands and shrub encroachment into grasslands along the coast has been recently documented. These vegetation changes are believed to be driven primarily by fire suppression and changing grazing patterns. Climatic variables such as precipitation, fog, cloud cover, temperature, slope, and elevation also play an important role in vegetation succession. Our study area is located along the central California coast, which is characterized by a precipitation gradient from the relatively wetter and cooler north to the drier and warmer south. Some studies indicate changing fog patterns along this coast, which may greatly impact vegetation. A decrease in water availability could slow succession processes. The primary objective of this project is to determine if vegetation succession rates are changing for the study area and to identify climate and ecosystem variables which contribute to succession, specifically the transition among grassland, shrubland, and forest. To identify vegetation types and rates of succession, we classified two Landsat TM 5 scenes from 1985 to 2010 with a resulting overall accuracy of 82.4%. Vegetation succession was correlated to changes in maximum and minimum temperatures, precipitation, and elevation for each sub-region of the study area. Fog frequency was then compared between the northern and southern regions of the study area for determining the spatial relation between fog frequency and the percent of vegetation change.

Hsu, Wei-Chen↗
DOE OSTI2023

Extending Parsimonious Bayesian Inference

Parsimonious Bayesian inference is a theoretical framework for efficient data assimilation that seeks to balance increased consistency between predictions and training data against corresponding increases in model complexity. Within this framework, over-training is understood as optimization that encodes excessive information within model parameters while only achieving small improvements between predictions and training data. This project aims to develop practical methods of limiting excess model information during optimization. One key observation is that practical heuristics for parsimonious learning in high-dimensions must balance expressivity, i.e. the ability of the model to capture diverse predictions with only a few non-zero parameters, against discoverability, i.e. the ability to train the model with gradient-based optimization and drive parameters to low information states. As such, we developed logical activation functions that are able to adaptively approximate arbitrary truth tables that define Boolean logic operations within a probabilistic framework. These functions have demonstrated the ability to learn exclusive disjunction (XOR) and conditioned disjunction (if [condition] then [result_if_true] else [result_if_false]) within a single layer of a neural network. To efficiently exploit these activation functions to drive parsimonious learning required several other advances within the domain of variational inference. The most efficient form of complexity suppression is structured sparsification, driving most model parameters to zero while achieving the structural coherence among nonzeros needed for bandwidth reduction. Such models are not only far more efficient at suppressing information-theoretic complexity, they also reduce the other forms of complexity (computations, communication, storage, and the number of dependencies needed to evaluate predictions). Aiming to support enhanced sparsification, this project examined new approaches to high-dimensional variational inference that allow us to calibrate and control parameter uncertainty during optimization. By identifying which parameters can sustain sparsifying perturbations with little impact on prediction quality, we can develop better pruning strategies by framing them as approximate Bayesian inference. These advances also open paths to mitigate concerns with deploying advanced learning methods in resource-constrained environments, such as running models on power-limited or communication-limited devices.

97 MATHEMATICS AND COMPUTING↗