Search NASA⌕ Search

SEARCH · Search NASA

Results for “Parameter Dimensionality Reduction”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8

Gradient-Free Construction of Active Subspaces for Dimension Reduction in Complex Models with Applications to Neutronics

Recent developments in the field of reduced-order modeling---and, in particular, active subspace construction---have made it possible to efficiently approximate complex models by constructing low-order response surfaces based upon a small subspace of the original high-dimensional parameter space. These methods rely upon the fact that the response tends to vary more prominently in a few dominant directions defined by linear combinations of the original inputs, allowing for a rotation of the coordinate axis and a consequent transformation of the parameters. In this work, we discuss a gradient-free active subspace algorithm that is feasible for high-dimensional parameter spaces where finite-difference techniques are impractical. This analysis extends the gradient-free algorithm introduced in [A. Lewis, R. Smith, and B. Williams, Comput. Math. Appl., 72 (2016), pp. 1603--1615] in two significant ways: (i) we introduce an initialization algorithm to identify lower-dimensional subspaces of influential directions to seed the gradient-free algorithm for high-dimensional problems, and (ii) we analyze dimension selection criteria to verify the algorithms. Finally, we illustrate the initialized gradient-free active subspace algorithm for a neutronics example implemented with SCALE6.1 for input dimensions up to 7700.

97 MATHEMATICS AND COMPUTING↗

Flap Side-Edge Noise: Acoustic Analysis of Sen's Model

The two-dimensional flap side-edge flow model developed by Sen is analyzed to reveal the noise production potential of the proposed mechanism. The model assumes that a vortex will form at the equilibrium position off the side edge of the flap. The vortex is then perturbed away from the equilibrium position by incoming turbulence causing it to oscillate and thus radiate sound. The noise field is calculated three-dimensionally by taking the flap to have a finite chord. Spectra and directivity of the farfield sound are presented. In addition, the effect of retarded time differences is evaluated. The parameters in the model are related to typical aircraft parameters and noise reduction possibilities are proposed.

Hardin, Jay C.↗

Compressing Vision Transformers in Geospatial Transfer Learning with Manifold-Constrained Optimization

Deploying geospatial foundation models on resource-constrained edge devices demands compact architectures that maintain high downstream performance. However, their large parameter counts and the accuracy loss often induced by compression limit practical adoption.In this work, we leverage manifold-constrained optimization framework DLRT to compress large vision transformer–based geospatial foundation models during transfer learning. By enforcing structured low-dimensional parameterizations aligned with downstream objectives, this approach achieves strong compression while preserving task-specific accuracy. We show that the method outperforms of-the-shelf low-rank methods as LoRA. Experiments on diverse geospatial benchmarks confirm substantial parameter reduction with minimal accuracy loss, enabling high-performing, on-device geospatial models.

Snyder, Thomas [Yale University]↗

Topological insulators and topological nonlinear {sigma} models

In this paper we link the physics of topological nonlinear {sigma} models with that of Chern-Simons insulators. We show that corresponding to every 2n-dimensional Chern-Simons insulator there is a (n-1)-dimensional topological nonlinear {sigma} model with the Wess-Zumino-Witten term. Breaking internal symmetry in these nonlinear {sigma} models leads to nonlinear {sigma} models with the {theta} term. [This is analogous to the dimension reduction leading from 2n-dimensional Chern-Simons insulators to (2n-1) and (2n-2)-dimensional topological insulators protected by discrete symmetries.] The correspondence described in this paper allows one to derive the topological term in a theory involving fermions and order parameters (we shall referred to them as ''fermion-{sigma} models'') when the conventional gradient-expansion method fails. We also discuss the quantum number of solitons in topological nonlinear {sigma} model and the electromagnetic action of the (2n-1)-dimensional topological insulators. Throughout the paper we use a simple model to illustrate how things work.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

DP-TwoLevel: two-stage gradient subspace learning for differentially private federated learning

Federated learning (FL) enables collaborative model training across distributed data sources without sharing raw data, but faces fundamental challenges in communication efficiency and privacy. Differentially private (DP) training mitigates information leakage but introduces noise that degrades model performance, especially in high-dimensional settings. We propose DP-TwoLevel, a hierarchical gradient projection method that improves utility under fixed DP constraints by exploiting low-dimensional structure in model updates. Our approach learns a two-level PCA-based representation of gradients and applies DP noise in a reduced-dimensional subspace, thereby lowering the effective noise magnitude while preserving dominant signal components. We evaluate the method across three datasets (MNIST, Fashion-MNIST, CIFAR-10) and three privacy regimes (ϵ∈0.5, 1.0, 2.0). Across nine experimental settings, DP-TwoLevel consistently outperforms DP-FedAvg, achieving an average accuracy improvement of 9.44%, with larger gains observed in lower ϵ(higher-noise) regimes (up to +22.31%). We further analyze scalability across models ranging from 100K to 1.49M parameters and identify a variance-based success criterion: performance remains strong when the projection preserves more than 75% of gradient variance, degrades in a marginal regime (65–75%), and fails below this threshold. Our results demonstrate that structure-aware dimensionality reduction can significantly improve the privacy–utility tradeoff in FL without modifying formal privacy guarantees. We also provide empirical evidence of scaling limitations for global projections and motivate per-layer extensions for larger models.

Kotevska, Olivera [ORNL] (ORCID:0000000316772243)↗

On the Validity of the Tada Stress Intensity Factor Solution for the Single Edge Notch Tension Specimen With Pinned Ends

The validity of the Tada stress intensity factor (K Tada ) for pinned-ends single edge notch tension [SEN(T)] specimens is assessed via a combined experimental-modeling approach. Analysis of fatigue crack growth rate reductions during constant-∆K Tada loading demonstrates that specific combinations of alloy stiffness, geometry, and loading result in the true K deviating below K Tada . Geometrically non-linear, 3-dimensional finite element calculations confirm mild-to-strong influences of these parameters, which are not captured by K Tada . Most existing pinned SEN(T) data are found to use parameters where KTada is not significantly reduced, but the present results underscore the need for a more broadly applicable K solution.

Non-linear FEA↗

Rholography, black holes and Scherk-Schwarz

We present a construction of a class of near-extremal asymptotically flat black hole solutions in four (or five) dimensional gauged supergravity with R-symmetry gaugings obtained from Scherk-Schwarz reductions on a circle. The entropy of these black holes is counted holographically by the well known MSW (or D1/D5) system, with certain twisted boundary conditions labeled by a twist parameter ρ. Here, we find that the corresponding (0, 4) (or (4, 4)) superconformal algebras are exactly those studied by Schwimmer and Seiberg, using a twist on the outer automorphism group. The interplay between R-symmetries, ρ-algebras and holography leads us to name our construction “Rholography”.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Lattice QED in an external magnetic field: Evidence for dynamical chiral symmetry breaking

We simulate quantum electrodynamics (QED) in a strong constant homogeneous external magnetic field on a Euclidean space-time lattice using the rational hybrid Monte Carlo method, developed for simulating lattice quantum chromodynamics (QCD). Our primary goal is to measure the chiral condensate in the limit when the input electron mass m is zero. We observe a nonzero value, indicating that the external magnetic field catalyzes chiral symmetry breaking as predicted by approximate truncated Schwinger-Dyson methods. Such behavior is associated with dominance by the lowest Landau level which causes the effective dimensional reduction from 3 + 1 dimensions to 1 + 1 dimensions for charged particles (electrons and positrons) where the attractive forces of QED can produce chiral symmetry breaking with a dynamical electron mass and associated chiral condensate. Since our lattice simulations use bare (lattice) parameters, while the Schwinger-Dyson analyses work with renormalized quantities, direct numerical comparison will require renormalization of our lattice results. Published by the American Physical Society 2024

Kogut, J. B. (ORCID:000000030151548X)↗

Function Preserving Projection

With function preserving projection (FPP), we aim to address high-dimensional data exploration challenges common in many scientific applications. Instead of preserving the global or local geometric structure of a dataset like traditional dimensionality reduction methods (e.g., principal component analysis, t-stochastic neighborhood embedding), the proposed approach finds a linear projection that reveal interpretable (yet potentially nonlinear) pattern of the properties of interests defined on a highdimensional domain (e.g., simulation yield defined on the input parameter space). The key insight driving FPP is the fact that while non-linear embeddings are difficult to interpret, humans are highly skilled in understanding complex visual patterns. FPP lets users select the complexity of a pattern they consider interpretable, allows to find a joint projection that explains multiple functions, and provides a confidence statistic (akin to a p-value) indicating how salient the resulting pattern is. We demonstrate the efficacy of the proposed method on several synthetic and scientific datasets for both continuous (regression) and discrete (classification) problems of interests and illustrate the scalability of FPP by finding an optimal projection for close to 40 gigabytes in around 10 minutes.

Liu, SHUSEN↗

Domain-decomposition nonlinear manifold reduced order model

This software combines nonlinear-manifold reduced order models (NM-ROMs) with domain decomposition (DD) techniques. NM-ROMs, which utilize a shallow, sparse autoencoder trained with full order model (FOM) snapshot data, approximate the FOM state on a nonlinear manifold. These models offer advantages over linear-subspace ROMs (LS-ROMs) particularly in scenarios with slowly decaying Kolmogorov n-width. However, the training of NM-ROMs involves a number of parameters that scale with the size of the FOM, and storing high-dimensional FOM snapshots can significantly increase the cost of ROM training for extreme-scale problems. To mitigate these costs, the software employs DD to partition the FOM into smaller subdomains, computes NM-ROMs for each, and then integrates these to form a global NM-ROM. This strategy offers multiple benefits: it enables parallel training of subdomain NM-ROMs, reduces the number of parameters needed, decreases the dimensional requirements of subdomain FOM training data, and allows for customization to the unique characteristics of each FOM subdomain. The use of a shallow, sparse autoencoder architecture in each subdomain NM-ROM facilitates the application of hyper-reduction (HR), simplifying the nonlinear complexities and enhancing computational speed. This software marks the inaugural application of NM-ROM combined with HR to a DD problem. It features an algebraic DD reformulation of the FOM, training of NM-ROMs with HR for each subdomain, and employs a sequential quadratic programming (SQP) solver for the evaluation of the coupled global NMROM. The effectiveness of the DD NM-ROM with HR is numerically demonstrated on the 2D steady-state Burgers' equation, showing an order of magnitude improvement in accuracy over the DD LS-ROM with HR.

Diaz, AlejandroN↗

Generative learning for slow manifolds and bifurcation diagrams

In dynamical systems characterized by separation of time scales, the approximation of so called “slow manifolds”, on which the long term dynamics lie, is a useful step for model reduction. Initializing on such slow manifolds is a useful step in modeling, since it circumvents fast transients, and is crucial in multiscale algorithms (like the equation-free approach) alternating between fine scale (fast) and coarser scale (slow) simulations. In a similar spirit, when one studies the infinite time dynamics of systems depending on parameters, the system attractors (e.g., its steady states) lie on bifurcation diagrams (curves for one-parameter continuation, and more generally, on manifolds in state parameter space. Sampling these manifolds gives us representative attractors (here, steady states of ODEs or PDEs) at different parameter values. Algorithms for the systematic construction of these manifolds (slow manifolds, bifurcation diagrams) are required parts of the “traditional” numerical nonlinear dynamics toolkit. In more recent years, as the field of Machine Learning develops, conditional score-based generative models (cSGMs) have been demonstrated to exhibit remarkable capabilities in generating plausible data from target distributions that are conditioned on some given label. It is tempting to exploit such generative models to produce samples of data distributions (points on a slow manifold, steady states on a bifurcation surface) conditioned on (consistent with) some quantity of interest (QoI, observable). In this work, we present a framework for using cSGMs to quickly (a) initialize on a low-dimensional (reduced-order) slow manifold of a multi-time-scale system consistent with desired value(s) of a QoI (a “label”) on the manifold, and (b) approximate steady states in a bifurcation diagram consistent with a (new, out-of-sample) parameter value. This conditional sampling can help uncover the geometry of the reduced slow-manifold and/or approximately “fill in” missing segments of steady states in a bifurcation diagram. Finally, the quantity of interest, which determines how the sampling is conditioned, is either known a priori or identified using manifold learning-based dimensionality reduction techniques applied to the training data.

Dynamical systems↗

Simulating bioclogging effects on dynamic riverbed permeability and infiltration

Bioclogging in rivers can detrimentally impact aquifer recharge. This is particularly so in dry regions, where losing rivers are common, and where disconnection between surface water and groundwater (leading to the development of an unsaturated zone) can occur. Reduction in riverbed permeability due to biomass growth is a time-variable parameter that is often neglected, yet permeability reduction from bioclogging can introduce order of magnitude changes in seepage fluxes from rivers over short (i.e., monthly) timescales. To address the combined effects of bioclogging and disconnection on infiltration, we developed in this paper numerical representations of bioclogging processes within a one-dimensional, variably saturated flow model representing losing-connected and losing-disconnected rivers. We tested these formulations using a synthetic case study informed with biological data obtained from the Russian River, California, USA. Our findings show that modeled biomass growth reduced seepage for losing-connected and losing-disconnected rivers. However, for rivers undergoing disconnection, infiltration declines occurred only after the system was fully disconnected. Before full disconnection, biologically induced permeability declines were not significant enough to offset the infiltration gains introduced by disconnection. The two effects combine to lead to a characteristic infiltration curve where peak infiltration magnitude and timing is controlled by permeability declines relative to hydraulic gradient gains. Biomass growth was found to hasten the onset of full disconnection; a condition we term ‘effective disconnection’. Finally, our results show that river infiltration can respond dynamically to bioclogging and subsequent permeability declines that are highly dependent on river connection status.

58 GEOSCIENCES↗

Enhancements to the RAVEN code in FY16

The RAVEN code has been under development at the Idaho National Laboratory since 2012. Its main goal is to create a multi-purpose platform for the deploying of all the capabilities needed for Probabilistic Risk Assessment, uncertainty quantification, data mining analysis and optimization studies. RAVEN has currently reached a good level of maturity in terms of deployed state-of-art and advanced capabilities. The main subject of this report is to show the activities that have been recently accomplished: • Implementation of ensemble modeling for time-series, and • initial implementation of model validation for surrogate models, and • advanced visualization capability for topology based data analysis The development of ensemble modeling for time-series has been performed in order to begin tackling the needs of those RISMC applications that need to communicate 1-Dimensional information (e.g. power histories, etc.) among different models. In this document the implementation details and an application example is reported. The second subject of this report is about the initial development of methods, within the RAVEN framework, to assess the validity of the predictive capabilities of surrogate models. Indeed, after the construction of a surrogate tight to a certain physical model, it is crucial to assess the goodness of its representation, in order to be confident with its prediction. In this initial activity, a cross-validation technique has been employed. This report will highlight the implementation details and proof its correct implementation by an application example. The final subject of this report is about the implementation of advanced visualization capability in RAVEN, for interactive data analysis. Indeed, RAVEN offers several post-processing capabilities that can structurally decompose data extracted from experimental results offering both data clustering/partitioning and dimensionality reduction techniques. A disadvantage of the workflow available in RAVEN is that it treats these as black box operations and the user is expected to know specific information about their data including the number of partitions to expect in some cases or the “correct” parameter settings for a particular algorithm. In order to overcome this limitation, it has been added an interactive user interface that can be run in RAVEN to explore different parameter settings on the fly specifically for the topological post-processor and allows the user to explore the data interactively. The design of this user interface is generalizable to other algorithms and can be used as a model to generate more dynamic and user-friendly visualization capabilities within RAVEN.

97 MATHEMATICS AND COMPUTING↗

Self-action of a wave field in one-dimensional system of weakly coupled active optical waveguides

The dynamics of self-action of a wave field in an array of weakly coupled active optical waveguides is studied analytically and numerically. It is shown that the introduction of weak gain in each of the waveguides allows significant reduction of radiation losses and efficient capture of all radiation in a single optical waveguide. The possibility of controlling the radiation localisation in the desired waveguide at the expense of varying the injection angle of the wave field into the considered system is demonstrated. The dependences of the characteristic parameters of the wave field are determined. (paper)

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

A fast and accurate domain decomposition nonlinear manifold reduced order model

Here, this paper integrates nonlinear-manifold reduced order models (NM-ROMs) with domain decomposition (DD). NM ROMs approximate the full order model (FOM) state in a nonlinear-manifold by training a shallow, sparse autoencoder using FOM snapshot data. These NM-ROMs can be advantageous over linear-subspace ROMs (LS-ROMs) for problems with slowly decaying Kolmogorov n-width. However, the number of NM-ROM parameters that need to be trained scales with the size of the FOM. Moreover, for “extreme-scale” problems, the storage of high-dimensional FOM snapshots alone can make ROM training expensive. To alleviate the training cost, this paper applies DD to the FOM, computes NM-ROMs on each subdomain, and couples them to obtain a global NM-ROM. This approach has several advantages: Subdomain NM-ROMs can be trained in parallel, involve fewer parameters to be trained than global NM-ROMs, require smaller subdomain FOM dimensional training data, and can be tailored to subdomain specific features of the FOM. The shallow, sparse architecture of the autoencoder used in each subdomain NM-ROM allows application of hyper-reduction (HR), reducing the complexity caused by nonlinearity and yielding computational speedup of the NM-ROM. This paper provides the first application of NM-ROM (with HR) to a DD problem. In particular, this paper details an algebraic DD reformulation of the FOM, training a NM-ROM with HR for each sub domain, and a sequential quadratic programming (SQP) solver to evaluate the coupled global NM-ROM. Theoretical convergence results for the SQP method and a priori and a posteriori error estimates for the DD NM-ROM with HR are provided. The proposed DD NM-ROM with HR approach is numerically compared to a DD LS-ROM with HR on the 2D steady-state Burgers’ equation, showing an order of magnitude improvement in accuracy of the proposed DD NM-ROM over the DD LS-ROM.

97 MATHEMATICS AND COMPUTING↗

Efficient Stochastic Inversion Using Adjoint Models and Kernel-PCA

Performing stochastic inversion on a computationally expensive forward simulation model with a high-dimensional uncertain parameter space (e.g. a spatial random field) is computationally prohibitive even when gradient information can be computed efficiently. Moreover, the ‘nonlinear’ mapping from parameters to observables generally gives rise to non-Gaussian posteriors even with Gaussian priors, thus hampering the use of efficient inversion algorithms designed for models with Gaussian assumptions. In this paper, we propose a novel Bayesian stochastic inversion methodology, which is characterized by a tight coupling between the gradient-based Langevin Markov Chain Monte Carlo (LMCMC) method and a kernel principal component analysis (KPCA). This approach addresses the ‘curse-of-dimensionality’ via KPCA to identify a low-dimensional feature space within the high-dimensional and nonlinearly correlated parameter space. In addition, non-Gaussian posterior distributions are estimated via an efficient LMCMC method on the projected low-dimensional feature space. We will demonstrate this computational framework by integrating and adapting our recent data-driven statistics-on-manifolds constructions and reduction-through-projection techniques to a linear elasticity model.

42 ENGINEERING↗

Analysis of dpa rates in the HFIR reactor vessel using a hybrid Monte Carlo/deterministic method

The Oak Ridge High Flux Isotope Reactor (HFIR), which began full-power operation in 1966, provides one of the highest steady-state neutron flux levels of any research reactor in the world. An ongoing vessel integrity analysis program to assess radiation-induced embrittlement of the HFIR reactor vessel requires the calculation of neutron and gamma displacements per atom (dpa), particularly at locations near the beam tube nozzles, where radiation streaming effects are most pronounced. In this study we apply the Forward-Weighted Consistent Adjoint Driven Importance Sampling (FW-CADIS) technique in the ADVANTG code to develop variance reduction parameters for use in the MCNP radiation transport code. We initially evaluated dpa rates for dosimetry capsule locations, regions in the vicinity of the HB-2 beamline, and the vessel beltline region. We then extended the study to provide dpa rate maps using three-dimensional cylindrical mesh tallies that extend from approximately 12 below to approximately 12 above the axial extent of the core. The mesh tally structures contain over 15,000 mesh cells, providing a detailed spatial map of neutron and photon dpa rates at all locations of interest. Relative errors in the mesh tally cells are typically less than 1%.

Blakeman, Edward↗

Validating an Air Traffic Management Concept of Operation Using Statistical Modeling

Validating a concept of operation for a complex, safety-critical system (like the National Airspace System) is challenging because of the high dimensionality of the controllable parameters and the infinite number of states of the system. In this paper, we use statistical modeling techniques to explore the behavior of a conflict detection and resolution algorithm designed for the terminal airspace. These techniques predict the robustness of the system simulation to both nominal and off-nominal behaviors within the overall airspace. They also can be used to evaluate the output of the simulation against recorded airspace data. Additionally, the techniques carry with them a mathematical value of the worth of each prediction-a statistical uncertainty for any robustness estimate. Uncertainty Quantification (UQ) is the process of quantitative characterization and ultimately a reduction of uncertainties in complex systems. UQ is important for understanding the influence of uncertainties on the behavior of a system and therefore is valuable for design, analysis, and verification and validation. In this paper, we apply advanced statistical modeling methodologies and techniques on an advanced air traffic management system, namely the Terminal Tactical Separation Assured Flight Environment (T-TSAFE). We show initial results for a parameter analysis and safety boundary (envelope) detection in the high-dimensional parameter space. For our boundary analysis, we developed a new sequential approach based upon the design of computer experiments, allowing us to incorporate knowledge from domain experts into our modeling and to determine the most likely boundary shapes and its parameters. We carried out the analysis on system parameters and describe an initial approach that will allow us to include time-series inputs, such as the radar track data, into the analysis

Statistical emulation↗