Search NASA⌕ Search

SEARCH · Search NASA

Results for “Constrained regression”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
NASA NTRS2013

Statistical Issues in Galaxy Cluster Cosmology

The number and growth of massive galaxy clusters are sensitive probes of cosmological structure formation. Surveys at various wavelengths can detect clusters to high redshift, but the fact that cluster mass is not directly observable complicates matters, requiring us to simultaneously constrain scaling relations of observable signals with mass. The problem can be cast as one of regression, in which the data set is truncated, the (cosmology-dependent) underlying population must be modeled, and strong, complex correlations between measurements often exist. Simulations of cosmological structure formation provide a robust prediction for the number of clusters in the Universe as a function of mass and redshift (the mass function), but they cannot reliably predict the observables used to detect clusters in sky surveys (e.g. X-ray luminosity). Consequently, observers must constrain observable-mass scaling relations using additional data, and use the scaling relation model in conjunction with the mass function to predict the number of clusters as a function of redshift and luminosity.

Galaxy↗
NASA NTRS1982

Sensitivity of constrained linear inversions to the selection of the Lagrange multiplier

The influence of the choice of the Lagrange multiplier on constrained linear inversions is explored, with reference made to applications in inferring the columnar aerosol size distributions from spectral aerosol optical depth measurements. A range of the Lagrange multiplier is examined to find all positive solutions for the solution vector, which represents modifying factors to the assumed form of the size distribution. An iterative method is devised to constrain the calculations to consideration of only positive quantities and a requirement that the regression fit to data be consistent with measurement errors. The determination of the variances and covariances is formulated and applied to existing data sets for optical depth. Variances in the solution are found to be large for particle radii when the information content of the data is small.

King, M. D.↗
DOE OSTI2025

Jensen–Shannon divergence based novel loss functions for Bayesian neural networks

Bayesian neural networks (BNNs) are state-of-the-art machine learning methods that can naturally regularize and systematically quantify uncertainties using their stochastic parameters. Kullback–Leibler (KL) divergence-based variational inference used in BNNs suffer from unstable optimization and challenges in approximating light-tailed posteriors due to the unbounded nature of the KL divergence. To resolve these issues, we formulate a novel loss function for BNNs based on a new modification to the generalized Jensen–Shannon (JS) divergence, which is bounded. In addition, we propose a Geometric JS divergence-based loss, which is computationally efficient since it can be evaluated analytically. We found that the JS divergence-based variational inference is intractable, and hence employed a constrained optimization framework to formulate these losses. Our theoretical analysis and empirical experiments on multiple regression and classification data sets suggest that the proposed losses perform better than the KL divergence-based loss, especially when the data sets are noisy or biased. Specifically, there are approximately 5% and 8% improvements in accuracy for a noise-added CIFAR-10 dataset and a regression dataset, respectively. There is about 13% reduction in false negative predictions of a biased histopathology dataset. Additionally, we quantify and compare the uncertainty metrics for the regression and classification tasks.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Mountain Basin Controls on the Snow-to-Streamflow Signal: An AIC-Weighted Multiple Linear Regression Framework

A regression-based analysis quantifies how basin characteristics modulate the snow-to-streamflow signal. First, we use the ERA5-Land reanalysis gridded product (European Centre for Medium Range Weather Forecasts reanalysis 5 -Land component) for 4,655 hydrologic unit code - 10 (HUC10) mountain basins across the western United States (US) for water years 1987–2024. Linear regressions are performed for peak snow water equivalent (SWE) and annual streamflow for each mountain basin. Models use ordinary least squares in Python’s statsmodels package. After which, an Akaike Information Criterion (AIC)–weighted ensemble multiple linear regression (MLR) framework with 47 watershed traits is used to predict the linear regression coefficient of determination (r-squared) defining the ability of peak SWE to predict annual streamflow across all mountain basin. Predictor sets are constrained to avoid multicollinearity by excluding models with variance inflation factors (VIF) greater than 5. Mountain basin traits included in the MLR include seasonal climate, topography, vegetation type and structure, and bedrock geology. Accepted models are considered if their AIC is within 2.0 of the model with the minimum AIC, or best model. To compare predictor influence across acceptable models, we computed standardized regression coefficients. To evaluate structural redundancy among models, we constructed binary inclusion vectors for each acceptable model, denoting whether a predictor was present (1) or absent (0). Core predictor variables are defined as occurring in at least 67% of the acceptable models. For this regional analysis, only one model was found acceptable, with higher snow-to-streamflow translation (higher r-squared) occurring in colder mountain basins with higher relative winter precipitation, more snow accumulation and a lower fraction of annual precipitation that falls in the spring and summer. The second component of the data package uses previously published, high-resolution output from an integrated hydrological model of the East River watershed using the U.S. Geological Survey Groundwater and Surface water Flow model (GSFLOW, doi:10.15485/1998576). East River MLR expands upon the approach described above to explore the response of five streamflow metrics—annual streamflow, runoff efficiency, 7-day minimum flow, low-flow duration, and non-perennial stream fraction to snow system indicators including peak SWE, snow-covered area, snow disappearance date, and the fraction of basin area characterized by low-to-no snow, as well as seasonal precipitation and temperature, and annual hydrologic variables representing soil moisture, evapotranspiration (ET), the partitioning of incoming precipitation to evapotranspiration (ET/P), groundwater storage, and groundwater inflow to streams. MLR was done on all water years (P0: 1987-2024) and for each period as determined in the split analysis using pooled regression techniques (P1: 1987-2011 and P2: 2012-2024) to evaluate shifting predictor variable emphasis on streamflow generation. Results indicate that since 2012, peak SWE has lost statistical strength in its prediction of annual streamflow and runoff efficiency, and the indirect influence of spring temperature has emerged as critically important. Low-flow metrics remain largely influenced by soil moisture, vegetation water use and groundwater inflows with summer precipitation becoming a direct influence on minimum summer flow. Together, these data and Python-based analysis tools provide a framework for identifying the key watershed characteristics that control how streamflow responds to snow from year to year. The package also helps quantify uncertainty in statistical models and assess how snow–streamflow relationships vary across regions and over time. This dataset contains comma-separated values files (.csv), text files (.txt), python code files (.py), figure files (.png), and shapefiles (.cpg, .dbf, .prj, .sbn, .sbx, .shp, .xml). Further details on file contents and MLR execution can be found in the readme file and the FLMD files. Work was supported by the Watershed Function Science Focus Area at Lawrence Berkeley National Laboratory funded by the US Department of Energy, Office of Science, Biological and Environmental Research under Contract No. DE-AC02-05CH11231.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRSDate not supplied

TPSAS-NF1676L-14454-DND

FUN3D Core Capabilities - Established as a research code in late 1980’s; now supports numerous internal and external efforts across the speed range - Solves 2D/3D steady and unsteady Euler and RANS equations on node-based mixed element grids for compressible and incompressible flows - General dynamic mesh capability: any combination of rigid / overset / morphing grids, including 6-DOF effects - Aeroelastic modeling using mode shapes, full FEM, CC, etc. - Constrained / multipoint adjoint-based design and mesh adaptation - Distributed development team using agile/extreme software practices including 24/7 regression and performance testing - Capabilities fully integrated, online documentation, training videos, tutorials

Eric J Nielsen↗
NASA NTRSDate not supplied

NASA LaRC Contribution to the High Angle Working Group of the Third Aeroelastic Prediction Workshop: BSCW Shock Buffet

FUN3D Core Capabilities - Established as a research code in late 1980s; now supports numerous internal and external efforts across the speed range - Solves 2D/3D steady and unsteady Euler and RANS equations on node-based mixed element grids for compressible and incompressible flows - General dynamic mesh capability: any combination of rigid / overset / morphing grids, including 6-DOF effects - Aeroelastic modeling using mode shapes, full FEM, etc. - Constrained / multipoint adjoint-based design and mesh adaptation - Distributed development team using agile/extreme software practices including 24/7 regression, performance testing - Capabilities fully integrated, online documentation, training videos, tutorials

Pawel Chwalowski↗
NASA NTRS2005

Attribution of Recovery in Lower-Stratospheric Ozone

Multiple satellite and ground-based observations provide consistent evidence that the thickness of Earth's protective ozone layer has stopped declining since 1997, close to the time of peak stratospheric halogen loading. Regression analyses with Effective Equivalent Stratospheric Chlorine (EESC) in conjunction with further analyses using more sophisticated photochemical model calculations constrained by satellite data demonstrate that the cessation of ozone depletion between 18-25 km altitude is consistent with a leveling off of stratospheric abundances of chlorine and bromine, due to the Montreal Protocol and its amendments. However, ozone increases in the lowest part of the stratosphere, from the tropopause to 18 km, account for about half of the improvement in total column ozone during the past 9 years at northern hemisphere mid-latitudes. The increase in ozone for altitudes below 18 km is most likely driven by changes in transport, rather than driven by declining chlorine and bromine. Even with this evidence that the Montreal Protocol and its amendments are having the desired, positive effect on ozone above 18 km, total column ozone is recovering faster than expected due to the apparent transport driven changes at lower altitudes. Accurate prediction of future levels of stratospheric ozone will require comprehensive understanding of the factors that drive temporal changes at various altitudes, and partitioning of the recent transport-driven increases between natural variability and changes in atmospheric structure perhaps related to anthropogenic climate change.

Yang, Eun-Su↗
NASA NTRS2006

Attribution of Recovery in Lower-stratospheric Ozone

Multiple satellite and ground-based observations provide consistent evidence that the thickness of Earth's protective ozone layer has stopped declining since 1997, close to the time of peak stratospheric halogen loading. Regression analyses with Effective Equivalent Stratospheric Chlorine (EESC) in conjunction with further analyses using more sophisticated photochemical model calculations constrained by satellite data demonstrate that the cessation of ozone depletion between 18-25 km altitude is consistent with a leveling off of stratospheric abundances of chlorine and bromine, due to the Montreal Protocol and its amendments. However, ozone increases in the lowest part of the stratosphere, from the tropopause to 18 km, account for about half of the improvement in total column ozone during the past 9 years at northern hemisphere mid-latitudes. The increase in ozone for altitudes below 18 km is most likely driven by changes in transport, rather than driven by declining chlorine and bromine. Even with this evidence that the Montreal Protocol and its amendments are having the desired, positive effect on ozone above 18 km, total column ozone is recovering faster than expected due to the apparent transport driven changes at lower altitudes. Accurate prediction of future levels of stratospheric ozone will require comprehensive understanding of the factors that drive temporal changes at various altitudes, and partitioning of the recent transport-driven increases between natural variability and changes in atmospheric structure perhaps related to anthropogenic climate change.

Yang, Eun-Su↗
DOE OSTI2026

Adaptive spectra-to-exposure conversion using ridge regularized polynomial response models

Real-time gamma spectra-to-exposure conversion in aerial and ground monitoring commonly relies on calibration-derived, detector- or system-specific conversion coefficients that are assumed to generalize across operational environments. In practice, deployment specific differences in spectral composition and transport conditions can introduce systematic bias relative to reference instruments, motivating methods that adapt coefficients using minimal field supervision while explicitly limiting overfitting. In this work, we present a conservative coefficient adaptation framework that updates a baseline polynomial energy-weighting function using ridge-regularized regression, with leave-one-out cross-validation (LOOCV) used to select the regularization strength. The findings support ridge-constrained minimal-supervision adaptation as a practical mechanism to suppress site-specific bias without destabilizing a calibration-derived baseline.

61 RADIATION PROTECTION AND DOSIMETRY↗
DOE OSTI2025

Uncertainty quantification for misspecified machine learned interatomic potentials

The use of high-dimensional regression techniques from machine learning has significantly improved the quantitative accuracy of interatomic potentials. Atomic simulations can now plausibly target quantitative predictions in a variety of settings, which has brought renewed interest in robust means to quantify uncertainties. In many practical settings where model complexity is constrained (e.g., due to performance considerations), misspecification — the inability of any one choice of model parameters to exactly match all training data — is a key contributor to errors that is often disregarded. Here, we employ a recent misspecification-aware regression technique to quantify parameter uncertainties, which is then propagated to a broad range of phase and defect properties in tungsten. The propagation is performed through both brute-force resampling and implicit Taylor expansion. The propagated misspecification uncertainties robustly quantify and bound errors on a broad range of material properties. We demonstrate application to recent foundational machine learning interatomic potentials, accurately predicting and bounding errors in MACE-MPA-0 energy predictions across the diverse materials project database.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Bayesian Gaussian process inference for neutron spin echo measurement

Neutron spin echo (NSE) spectroscopy provides unique access to microscopic dynamics, but its application is often constrained by low neutron flux, long acquisition times, and significant noise. Here, we present a Bayesian inference approach based on Gaussian process regression (GPR) to reconstruct high-quality spin echo signals from sparse and noisy data by exploiting correlations in reciprocal space. Benchmarks on synthetic datasets and validation with experimental NSE measurements of dendrimers show that GPR suppresses noise, interpolates missing intensity values, and accommodates irregular observations. The method improves accuracy, shortens acquisition times, and enables high-throughput and real-time studies. Beyond NSE, the framework is broadly applicable to other low signal-to-noise ratio scattering techniques, thereby extending the scope of neutron spectroscopy.

Tung, Chi-Huan [Oak Ridge National Laboratory (ORN↗
DOE OSTI2025

Leveraging transfer learning and leaf spectroscopy for leaf trait prediction with broad spatial, species, and temporal applicability

Accurate and reliable prediction of leaf traits is crucial for understanding plant adaptations to environmental variation, monitoring terrestrial ecosystems, and enhancing comprehension of functional diversity and ecosystem functioning. Currently, various approaches (e.g., statistical, physical models) have been developed to estimate leaf traits through hyperspectral remote sensing and leaf spectroscopy. However, the absence of high-performing, transferable, and stable models across various domains of space, plant functional types (PFTs) and seasons hinder our ability to quantify and comprehend spatiotemporal variations in leaf traits. This study proposes robust and highly transferable models for better predicting leaf traits with hyperspectral reflectance. Initially, three datasets were assembled, pairing common leaf traits — chlorophyll (Chla+b), carotenoids (Ccar), leaf mass per area (LAM), equivalent water thickness (EWT) — with leaf spectra measurements collected across diverse geographic locations in the U.S. and Europe, PFTs, and seasons. Measurements were acquired using spectroradiometers (e.g., ASD FieldSpec 3/4/Pro and SVC HR-1024i) with integrating spheres, leaf clips, and contact probes. Here, we then developed transfer learning-based hybrid models that incorporated the domain knowledge of radiative transfer models (RTMs) through pretraining processes and were well-constrained by fine-tuning with field measurements. Through comparison with other state-of-the-art statistical models, including partial-least squares regression (PLSR) and Gaussian Process Regression (GPR), as well as pure physical models, we found that the proposed transfer learning models achieved better predictive performance and higher transferability. Specifically, compared to other statistical models and pure RTMs, the transfer learning model exhibited higher coefficient of determination (R 2 ) values with range of 0.01 to 0.79, lower normalized root mean square error (NRMSE) with range of 0.06 % to 33.25 % in model performance. Additionally, the models exhibited improved transferability, with higher R 2 values range from 0.04 to 0.32, lower NRMSE range from 0.08 % to 30.81 %. The findings underscore that transfer learning models through integrating domain knowledge from RTMs and limited observations, can harness the advantages of both RTMs and statistical models and serve as a promising approach for effectively predicting leaf traits.

59 BASIC BIOLOGICAL SCIENCES↗
NASA NTRS2021

Global Intercomparison of hyper-resolution ECOSTRESS coastal sea surface temperature measurements from the Space Station with VIIRS-N20

The ECOSTRESS multi-channel thermal radiometer on the Space Station has an unprecedented spatial resolution of 70 m and a return time of hours to 5 days. It resolves details of oceanographic features not detectable in imagery from MODIS or VIIRS, and has open-ocean coverage, unlike Landsat. We calibrated two years of ECOSTRESS sea surface temperature observations with L2 data from VIIRS-N20 (2019–2020) worldwide but especially focused on important upwelling systems currently undergoing climate change forcing. Unlike operational SST products from VIIRS-N20, the ECOSTRESS surface temperature algorithm does not use a regression approach to determine temperature, but solves a set of simultaneous equations based on first principles for both surface temperature and emissivity. We compared ECOSTRESS ocean temperatures to well-calibrated clear sky satellite measurements from VIIRS-N20. Data comparisons were constrained to those within 90 min of one another using co-located clear sky VIIRS and ECOSTRESS pixels. ECOSTRESS ocean temperatures have a consistent 1.01 ◦C negative bias relative to VIIRS-N20, although deviation in brightness temperatures within the 10.49 and 12.01 µm bands were much smaller. As an alternative, we compared the performance of NOAA, NASA, and U.S. Navy operational split-window SST regression algorithms taking into consideration the statistical limitations imposed by intrinsic SST spatial autocorrelation and applying corrections on brightness temperatures. We conclude that standard bias-correction methods using already validated and well-known algorithms can be applied to ECOSTRESS SST data, yielding highly accurate products of ultra-high spatial resolution for studies of biological and physical oceanography in a time when these are needed to properly evaluate regional and even local impacts of climate change.

Nicolas Weidberg↗
DOE OSTI2025

SymbolNet: neural symbolic regression with adaptive dynamic pruning for compression

Abstract Compact symbolic expressions have been shown to be more efficient than neural network (NN) models in terms of resource consumption and inference speed when implemented on custom hardware such as field-programmable gate arrays (FPGAs), while maintaining comparable accuracy (Tsoi et al 2024 EPJ Web Conf. 295 09036). These capabilities are highly valuable in environments with stringent computational resource constraints, such as high-energy physics experiments at the CERN Large Hadron Collider. However, finding compact expressions for high-dimensional datasets remains challenging due to the inherent limitations of genetic programming (GP), the search algorithm of most symbolic regression (SR) methods. Contrary to GP, the NN approach to SR offers scalability to high-dimensional inputs and leverages gradient methods for faster equation searching. Common ways of constraining expression complexity often involve multistage pruning with fine-tuning, which can result in significant performance loss. In this work, we propose S y m b o l N e t , a NN approach to SR specifically designed as a model compression technique, aimed at enabling low-latency inference for high-dimensional inputs on custom hardware such as FPGAs. This framework allows dynamic pruning of model weights, input features, and mathematical operators in a single training process, where both training loss and expression complexity are optimized simultaneously. We introduce a sparsity regularization term for each pruning type, which can adaptively adjust its strength, leading to convergence at a target sparsity ratio. Unlike most existing SR methods that struggle with datasets containing more than O ( 10 ) inputs, we demonstrate the effectiveness of our model on the LHC jet tagging task (16 inputs), MNIST (784 inputs), and SVHN (3072 inputs).

Tsoi, Ho Fung (ORCID:0000000225502184)↗
DOE OSTI2025

Developing a robust strength model using physically-informed genetic programming

The strength of materials is influenced by a range of external conditions, such as temperature and deformation rate. Consequently, materials that demonstrate substantial variations in their mechanical behavior due to fluctuations in temperature and strain rate require complex strength models to accurately predict material performance in real-world applications. To predict such complex behavior, a robust and flexible strength model is necessary. In this work, we utilize genetic programming-based symbolic regression (GPSR) to develop data-driven strength models that accurately represent the measured stress–strain responses of tin across a wide range of strain, strain rate and temperature regimes. The GPSR models are constrained by physically-informed conditions, which leads to significant improvement in extrapolation. The best model is integrated into a multi-physics code to perform Taylor impact simulations, validating the model’s accuracy and robustness. In conclusion, the model predictions showed excellent agreement with experimental results, particularly when compared to predictions using traditional strength models.

Genetic programming↗
NASA NTRS2000

Influence of central set on anticipatory and triggered grip-force adjustments

The effects of predictability of load magnitude on anticipatory and triggered grip-force adjustments were studied as nine normal subjects used a precision grip to lift, hold, and replace an instrumented test object. Experience with a predictable stimulus has been shown to enhance magnitude scaling of triggered postural responses to different amplitudes of perturbations. However, this phenomenon, known as a central-set effect, has not been tested systematically for grip-force responses in the hand. In our study, predictability was manipulated by applying load perturbations of different magnitudes to the test object under conditions in which the upcoming load magnitude was presented repeatedly or under conditions in which the load magnitudes were presented randomly, each with two different pre-load grip conditions (unconstrained and constrained). In constrained conditions, initial grip forces were maintained near the minimum level necessary to prevent pre-loaded object slippage, while in unconstrained conditions, no initial grip force restrictions were imposed. The effect of predictable (blocked) and unpredictable (random) load presentations on scaling of anticipatory and triggered grip responses was tested by comparing the slopes of linear regressions between the imposed load and grip response magnitude. Anticipatory and triggered grip force responses were scaled to load magnitude in all conditions. However, regardless of pre-load grip force constraint, the gains (slopes) of grip responses relative to load magnitudes were greater when the magnitude of the upcoming load was predictable than when the load increase was unpredictable. In addition, a central-set effect was evidenced by the fewer number of drop trials in the predictable relative to unpredictable load conditions. Pre-load grip forces showed the greatest set effects. However, grip responses showed larger set effects, based on prediction, when pre-load grip force was constrained to lower levels. These results suggest that anticipatory processes pertaining to load magnitude permit the response gain of both voluntary and triggered rapid grip force adjustments to be set, at least partially, prior to perturbation onset. Comparison of anticipatory set effects for reactive torque and lower extremity EMG postural responses triggered by surface translation perturbations suggests a more general rule governing anticipatory processes.

Non-NASA Center↗
NASA NTRS1993

Predicting LANDSAT MSS endmember signatures from corresponding higher resolution TM fraction images

The approach to predicting Landsat Multispectral Scanner System (MSS) endmember signatures from fraction images derived from high resolution Landsat Thematic Mapper (TM) data is presented. The purpose, conducted in the Mogi-Guacu study site located in Sao Paulo State, Brazil, was to determine if information derived from a mixture model applied to higher resolution TM data could serve as ground truth for the lower resolution MSS sensor. The Constrained Least Squares (CLS) method was used to generate vegetation, soil, and shade fraction images from the TM data. The resulting images were then used to estimate the endmember spectral response for MSS data by regressing each MSS spectral channel against the corresponding proportion values estimated for the same resolution cells from the TM mixture model. The evaluation of the predicted signatures was performed by comparing the corresponding fraction images derived from both the MSS and TM data acquired on 14 Sep. 1986. The techniques serves as a potential tool for integrating information in global studies where remote sensors with different spectral and spatial resolutions were used.

Shimabukuro, Yosio E.↗
NASA NTRS1990

Constrained optimization using design of experiment surfaces

An algorithm for solving constrained optimization problems is presented. First, design of experiment techniques are used to survey the design space. After evaluating the objective and constraint functions, as specified by Taguchi orthogonal arrays, analytical models of these functions are generated using a least-squares regression analysis. Next, a nonlinear programming package is used to optimize the analytical model. Based on the optimization information, the design space is reduced so as to close in around the minimum, and the entire procedure is repeated until convergence. An important feature of the algorithm is that function gradients are not required; therefore, for problems in which gradients would have to be estimated using finite-differences the number of function evaluations required for the optimization is significantly reduced, when compared with traditional nonlinear programming techniques. In addition, there is no requirement that the gradients must be smooth and continuous.

Bolt, Marvin Vance↗