Search NASA⌕ Search

SEARCH · Search NASA

Results for “loss function regularization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Design of Distributed Controllers Seeking Optimal Power Flow Solutions Under Communication Constraints

This paper focuses on power distribution networks featuring inverter-interfaced distributed energy resources (DERs), and develops feedback controllers that drive the DER output powers to solutions of time-varying AC optimal power flow (OPF) problems. Control synthesis is grounded on primal-dual-type methods for regularized Lagrangian functions, as well as linear approximations of the AC power-flow equations. Convergence and OPF-solution-tracking capabilities are established while acknowledging: i) communication-packet losses, and ii) partial updates of control signals. The latter case is particularly relevant since it enables asynchronous operation of the controllers where DER setpoints are updated at a fast time scale based on local voltage measurements, and information on the network state is utilized if and when available, based on communication constraints. As an application, the paper considers distribution systems with high photovoltaic integration, and demonstrates that the proposed framework provides fast voltage-regulation capabilities, while enabling the near real-time pursuit of solutions of AC OPF problems.

24 POWER TRANSMISSION AND DISTRIBUTION↗

HomPINNs: Homotopy physics-informed neural networks for learning multiple solutions of nonlinear elliptic differential equations

Physics-informed neural networks (PINNs) based machine learning is an emerging framework for solving nonlinear differential equations. However, due to the implicit regularity of neural network structure, PINNs can only find the flattest solution in most cases by minimizing the loss functions. In this paper, we combine PINNs with the homotopy continuation method, a classical numerical method to compute isolated roots of polynomial systems, and propose a new deep learning framework, named homotopy physics-informed neural networks (HomPINNs), for solving multiple solutions of nonlinear elliptic differential equations. The implementation of an HomPINN is a homotopy process that is composed of the training of a fully connected neural network, named the starting neural network, and training processes of several PINNs with different tracking parameters. The starting neural network is to approximate a starting function constructed by the trivial solutions, while other PINNs are to minimize the loss functions defined by boundary condition and homotopy functions, varying with different tracking parameters. These training processes are regraded as different steps of a homotopy process, and a PINN is initialized by the well-trained neural network of the previous step, while the first starting neural network is initialized using the default initialization method. Finally, several numerical examples are presented to show the efficiency of our proposed HomPINNs, including reaction-diffusion equations with a heart-shaped domain.

97 MATHEMATICS AND COMPUTING↗

The application of Plant Reliability Data Information System (PRINS) to CANDU reactor

As risk-informed applications (RIAs) are actively implanted in the nuclear industry, an issue associated with technical adequacy of Probabilistic Safety Assessment (PSA) arises in its modeling and data sourcing. In Korea, PSA for all Korean NPPs has been completed and KHNP(Korea Hydro and Nuclear Power Plant Company) developed the database called the Plant Reliability Data Information System (PRinS). It has several characteristics that distinguish it from other database system such as NPRDs (INPO,1994), PRIS (IAEA), and SRDF (EdF). This database has the function of systematic data management such as automatic data-gathering, periodic data deposition and updating, statistical analysis including Bayesian method, and trend analysis of failure rate or unavailability. In recent PSA for CANDU reactor, the component failure data of EPRI ALWR URD and Component Reliability Database were preferentially used as generic data set. The error factor for most component failure data was estimated by using the information NUREG/CR-4550 and NUREG/CR-4639. Also, annual trend analysis was performed for the functional losses of components using the statistical analysis and chart module of PRinS. Furthermore, the database has been updated regularly and maintained as a living program to reflect the current status. This paper presents the failure data analysis using PRinS which provides Bayesian analysis on main components in the CANDU reactor. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Loss Landscape Analysis for Reliable Quantized ML Models for Scientific Sensing

In this paper, we propose a method to perform empirical analysis of the loss landscape of machine learning (ML) models. The method is applied to two ML models for scientific sensing, which necessitates quantization to be deployed and are subject to noise and perturbations due to experimental conditions. Our method allows assessing the robustness of ML models to such effects as a function of quantization precision and under different regularization techniques -- two crucial concerns that remained underexplored so far. By investigating the interplay between performance, efficiency, and robustness by means of loss landscape analysis, we both established a strong correlation between gently-shaped landscapes and robustness to input and weight perturbations and observed other intriguing and non-obvious phenomena. Our method allows a systematic exploration of such trade-offs a priori, i.e., without training and testing multiple models, leading to more efficient development workflows. This work also highlights the importance of incorporating robustness into the Pareto optimization of ML models, enabling more reliable and adaptive scientific sensing systems.

Baldi, Tommaso [Pisa, Scuola Normale Superiore]↗

Decreases in polyunsaturated fatty acid content improve heat stress tolerance during flowering and silicle development in pennycress (Thlaspi arvense L.)

Introduction: Pennycress (Thlaspi arvense L.) is an emerging intermediate oilseed crop grown in the offseason between primary summer crops to produce three cash crops in two years. Previous efforts to improve seed oil quality produced Clustered Regularly Interspaced Short Palindromic Repeats (CRISPR) genome-edited lines with decreased polyunsaturated fatty acids (PUFAs) levels, through loss of function of the FATTY ACID DESATURASE 2 (FAD2), REDUCED OLEATE DESATURATION1 (ROD1), and FATTY ACID ELONGASE1 (FAE1) genes. While seed oil compositions were previously characterized, it remains unknown how vegetative and reproductive tissue compositions might differ and affect tolerance to high temperature (HT) conditions.Methods: In four growth chamber experiments, we explored HT tolerance during flowering and silicle development. Plants were subjected to a 34 °C day/28 °C night regime and compared to control plants maintained at 20 °C. Pollen grain viability at a range of temperatures, lipid peroxidation and proline content in leaves and silicles following HT, and seed yield were measured.Results: Both fad2 and rod1 mutant lines had relatively higher pollen viability (71% and 54% respectively) under moderately elevated temperature (28 °C) compared to wild-type controls (37%). They also showed smaller decreases in seed yield (0% and 40% for fad2 and rod1 respectively, compared to 61% for wild type), following HT exposure during late flowering and early silicle development. Silicles of fad2 plants experienced 65% less lipid peroxidation under HT and 55% less buildup of proline, signifying less stress.Discussion: The differential results of fad2 and rod1 are likely due to the role of FAD2 in membranes in all tissues, whereas ROD1 predominantly affects triacylglycerol (TAG) composition in oil-accumulating tissues including pollen. Our results indicate that decreasing PUFAs, through gene editing, can increase heat tolerance in reproductive tissues as an auxiliary benefit accompanying improved seed oil quality.

59 BASIC BIOLOGICAL SCIENCES↗

Light exposure influences the diurnal oscillation of gut microbiota in mice

Highlights: • Gut microbiota displayed robust rhythmic fluctuation in both compositional and functional level in mice. • The fluctuation of gut microbiota was modulated by enviromental light exposure. • The abundance of Clostridiawas dramatically enhanced in the small intestine when mice were underwent constant darkness. The gut microbiota exhibit diurnal compositional and functional oscillations that influence the host homeostasis. However, the upstream factors that affect the microbial oscillations remain elusive. Here, we focused on the potential impact of light exposure, the main factor that affects the host circadian oscillation, on the diurnal oscillations of intestinal microflora to explore the upstream factor that governs the fluctuations of the gut microbes. The gut microbiota of the mice that were underwent regular light/dark (LD) cycles exhibited a robust rhythm at both compositional and functional level, in all parts of the intestine. Comparably, constant darkness (Dark-Dark, DD) led to the loss of the rhythmic oscillations in almost all parts of the intestine. Additionally, the abundance of Clostridia in DD conditions was dramatically enhanced in the small intestine. Our data indicated light exposure is the upstream factor that governs the regular diurnal fluctuations of gut microbiota in vivo.

60 APPLIED LIFE SCIENCES↗

CFM-ID 4.0 – a web server for accurate MS-based metabolite identification

The CFM-ID 4.0 web server (https://cfmid.wishartlab.com) is an online tool for predicting, annotating and interpreting tandem mass (MS/MS) spectra of small molecules. It is specifically designed to assist researchers pursuing studies in metabolomics, exposomics and analytical chemistry. More specifically, CFM-ID 4.0 supports the: 1) prediction of electrospray ionization quadrupole time-of-flight tandem mass spectra (ESI-QTOF-MS/MS) for small molecules over multiple collision energies (10 eV, 20 eV, and 40 eV); 2) annotation of ESI-QTOF-MS/MS spectra given the structure of the compound; and 3) identification of a small molecule that generated a given ESI-QTOF-MS/MS spectrum at one or more collision energies. The CFM-ID 4.0 web server makes use of a substantially improved MS fragmentation algorithm, a much larger database of experimental and in silico predicted MS/MS spectra and improved scoring methods to offer more accurate MS/MS spectral prediction and MS/MS-based compound identification. Compared to earlier versions of CFM-ID, this new version has an MS/MS spectral prediction performance that is ~22% better and a compound identification accuracy that is ~35% better on a standard (CASMI 2016) testing dataset. CFM-ID 4.0 also features a neutral loss function that allows users to identify similar or substituent compounds where no match can be found using CFM-ID’s regular MS/MS-to-compound identification utility. Finally, the CFM-ID 4.0 web server now offers a much more refined user interface that is easier to use, supports molecular formula identification (from MS/MS data), provides more interactively viewable data (including proposed fragment ion structures) and displays MS mirror plots for comparing predicted with observed MS/MS spectra. These improvements should make CFM-ID 4.0 much more useful to the community and should make small molecule identification much easier, faster, and more accurate.

59 BASIC BIOLOGICAL SCIENCES↗

Long-Term Efficacy of Percutaneous Internal Plastic Stent Placement for Non-anastomotic Biliary Stenosis After Liver Transplantation

PurposeWe aimed to evaluate the long-term efficacy of percutaneous management of non-anastomotic biliary stenosis after liver transplantation, using plastic internal biliary stents.Materials and MethodsThis study included 35 cases (28 men, 7 women; mean age: 52.09 ± 8.13 years, range 34–68) in 33 patients who needed repeated interventional procedures because of biliary strictures. After classification of the biliary strictures, we inserted percutaneous biliary plastic stents through the T-tube or percutaneous transhepatic biliary drainage tracts. Stents were exchanged according to percutaneous methods at regular 2- to 6-month intervals. The stents were removed if the condition improved, as observed on cholangiogram as well as based on clinical findings. The median patient follow-up period after initial diagnosis and treatment was 6.04 years (range 0.29–9.95 years). We assessed treatment success rate and patient and graft survival times.ResultsDuring the follow-up period, 14 patients (14/33, 42.42 %) were successfully treated and were tube-free. The median tube-free time, time without a stent, was 4.13 years (range 1.00–9.01). In contrast, internal plastic stents remained in 9 patients (9/33, 27.27 %) until the last follow-up. These patients had acceptable hepatic function. Among the remaining 10 patients, 3 (3/33, 9.09 %) were lost to regular follow-up and the other 7 (7/33, 21.21 %) patients died. The overall graft loss rate was 20.0 % (7/35). The median time from initial treatment to graft loss was 1.84 years (range 0.42–4.25).ConclusionsPercutaneous plastic stents placement is technically feasible and clinically useful in patients with multiple biliary stenoses following liver transplantation.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Advances and perspectives on the use of CRISPR/Cas9 systems in plant genomics research

Genome editing with site-specific nucleases has become a powerful tool for functional characterization of plant genes and genetic improvement of agricultural crops. Among the various site-specific nuclease-based technologies available for genome editing, the clustered regularly interspaced short palindromic repeat (CRISPR)/CRISPR-associated protein 9 (Cas9) systems have shown the greatest potential for rapid and efficient editing of genomes in plant species. Here, this article reviews the current status of application of CRISPR/Cas9 to plant genomics research, with a focus on loss-of-function and gain-of-function analysis of individual genes in the context of perennial plants and the potential application of CRISPR/Cas9 to perturbation of gene expression, as well as identification and analysis of gene modules as part of an accelerated domestication and synthetic biology effort.

59 BASIC BIOLOGICAL SCIENCES↗

Estimating conditional quantiles with the help of the pinball loss

Using the so-called pinball loss for estimating conditional quantiles is a well-known tool in both statistics and machine learning. So far, however, only little work has been done to quantify the efficiency of this tool for non-parametric (modified) empirical risk minimization approaches. The goal of this work is to fill this gap by establishing inequalities that describe how close approximate pinball risk minimizers are to the corresponding conditional quantile. These inequalities, which hold under mild assumptions on the data-generating distribution, are then used to establish so-called variance bounds which recently turned out to play an important role in the statistical analysis of (modified) empirical risk minimization approaches. To illustrate the use of the established inequalities, we then use them to establish an oracle inequality for support vector machines that use the pinball loss. Here, it turns out that we obtain learning rates which are optimal in a min-max sense under some standard assumptions on the regularity of the conditional quantile function.

97 MATHEMATICS AND COMPUTING↗

Alignment of morphology during high spatial frequency periodic structure formation in GaAs

The interaction among multiple intense ultrashort laser pulses and solids is known to provide a regular nanoscale surface corrugation. A coupled mechanism has been identified that operates in a specific range of fluences in GaAs that exhibits transient loss of the imaginary part of the dielectric function and Χ 2 , which produces a unique corrugation known as high spatial frequency laser induced periodic surface structures (HSFL). The final structures have 180 nm periods, and their alignment perpendicular to the laser polarization is first observed in an intermediate morphology with correlation distances of 150±40 nm. Quantum molecular dynamics simulations suggest that HSFL self-assembly is initiated when the intense laser field softens the interatomic binding potential, which leads to an ultrafast generation of point defects. The morphological evolution begins as self-interstitial diffusion, driven by stress relaxation, to the surface producing 1–2 nm tall islands. An ab initio calculation of excited electron concentration combined with a Drude-Lorentz model of the excited GaAs dielectric function is used to determine that the conditions for SPP coupling at HSFL formation fluences are both satisfied and occur at wavelengths that are imprinted into the observed surface morphologies. The evolution of these morphologies is reported on as the interplay between surface plasmon polaritons that localize defect generation within the structures present on the previous laser exposure and stress relaxation driven defect diffusion.

36 MATERIALS SCIENCE↗

Multidimensional Distributional Neural Network Output Demonstrated in Super‐Resolution of Surface Wind Speed

Accurate quantification of uncertainty in neural network predictions remains a central challenge for scientific applications involving high-dimensional, correlated data. While existing methods capture either aleatoric or epistemic uncertainty, few offer closed-form, multidimensional distributions that preserve spatial correlation while remaining computationally tractable. In this work, we present a framework for training neural networks with a multidimensional Gaussian loss, generating a closed-form predictive distribution over outputs informed by non-identically distributed training data. Our approach captures aleatoric uncertainty by iteratively estimating the means and covariance matrices, and is demonstrated on a super-resolution example out-of-training-sample. We leverage a Fourier representation of the covariance matrix to stabilize network training and preserve spatial correlation. We introduce a novel regularization strategy—referred to as information sharing—that interpolates between image-specific and global covariance estimates, enabling convergence of the super-resolution downscaling network trained on image-specific distributional loss functions. This framework allows for efficient sampling, explicit correlation modeling, and extensions to more complex distribution families all without disrupting prediction performance. We demonstrate the method on a surface wind speed downscaling task and discuss its broader applicability to uncertainty-aware prediction in scientific models.

17 WIND ENERGY↗

FunDiff: diffusion models over function spaces for physics-informed generative modeling

Recent advances in generative modeling-particularly diffusion models and flow matching-have been widely used for synthesizing discrete data such as images and videos. However, adapting these models to physical applications remains challenging, as the quantities of interest are continuous functions governed by complex physical laws. To address this, we introduce FunDiff, an efficient and robust framework for generative modeling in function spaces. FunDiff combines a latent diffusion process with a function autoencoder architecture to handle input functions with varying discretizations, generates continuous functions that can be evaluated at arbitrary locations, and seamlessly incorporate physical priors. These priors are enforced through architectural constraints or physics-informed loss functions, ensuring that generated samples satisfy fundamental physical laws. We theoretically establish minimax optimality guarantees for density estimation in function spaces, demonstrating that diffusion-based estimators achieve optimal convergence rates under suitable regularity conditions. We further demonstrate the practical effectiveness of FunDiff across diverse applications in fluid dynamics and solid mechanics. Empirical results indicate that our method can generate physically consistent samples with high fidelity to the target distribution, and exhibit robustness to noisy and low-resolution data.

Wang, Sifan [Yale University, New Haven, CT (Unite↗

Alpha image reconstruction (AIR): A new iterative CT image reconstruction approach using voxel-wise alpha blending

Purpose: Iterative image reconstruction gains more and more interest in clinical routine, as it promises to reduce image noise (and thereby patient dose), to reduce artifacts, or to improve spatial resolution. Among vendors and researchers, however, there is no consensus of how to best achieve these aims. The general approach is to incorporatea priori knowledge into iterative image reconstruction, for example, by adding additional constraints to the cost function, which penalize variations between neighboring voxels. However, this approach to regularization in general poses a resolution noise trade-off because the stronger the regularization, and thus the noise reduction, the stronger the loss of spatial resolution and thus loss of anatomical detail. The authors propose a method which tries to improve this trade-off. The proposed reconstruction algorithm is called alpha image reconstruction (AIR). One starts with generating basis images, which emphasize certain desired image properties, like high resolution or low noise. The AIR algorithm reconstructs voxel-specific weighting coefficients that are applied to combine the basis images. By combining the desired properties of each basis image, one can generate an image with lower noise and maintained high contrast resolution thus improving the resolution noise trade-off. Methods: All simulations and reconstructions are performed in native fan-beam geometry. A water phantom with resolution bar patterns and low contrast disks is simulated. A filtered backprojection (FBP) reconstruction with a Ram-Lak kernel is used as a reference reconstruction. The results of AIR are compared against the FBP results and against a penalized weighted least squares reconstruction which uses total variation as regularization. The simulations are based on the geometry of the Siemens Somatom Definition Flash scanner. To quantitatively assess image quality, the authors analyze line profiles through resolution patterns to define a contrast factor for contrast-resolution plots. Furthermore, the authors calculate the contrast-to-noise ratio with the low contrast disks and the authors compare the agreement of the reconstructions with the ground truth by calculating the normalized cross-correlation and the root-mean-square deviation. To evaluate the clinical performance of the proposed method, the authors reconstruct patient data acquired with a Somatom Definition Flash dual source CT scanner (Siemens Healthcare, Forchheim, Germany). Results: The results of the simulation study show that among the compared algorithms AIR achieves the highest resolution and the highest agreement with the ground truth. Compared to the reference FBP reconstruction AIR is able to reduce the relative pixel noise by up to 50% and at the same time achieve a higher resolution by maintaining the edge information from the basis images. These results can be confirmed with the patient data. Conclusions: To evaluate the AIR algorithm simulated and measured patient data of a state-of-the-art clinical CT system were processed. It is shown, that generating CT images through the reconstruction of weighting coefficients has the potential to improve the resolution noise trade-off and thus to improve the dose usage in clinical CT.

60 APPLIED LIFE SCIENCES↗

Stationary bubbles and their tunneling channels toward trivial geometry

In the path integral approach, one has to sum over all histories that start from the same initial condition in order to obtain the final condition as a superposition of histories. Applying this into black hole dynamics, we consider stable and unstable stationary bubbles as a reasonable and regular initial condition. We find examples where the bubble can either form a black hole or tunnel toward a trivial geometry, i.e., with no singularity nor event horizon. We investigate the dynamics and tunneling channels of true vacuum bubbles for various tensions. In particular, in line with the idea of superposition of geometries, we build a classically stable stationary thin-shell solution in a Minkowski background where its fate is probabilistically given by non-perturbative effects. Since there exists a tunneling channel toward a trivial geometry in the entire path integral, the entire information is encoded in the wave function. This demonstrates that the unitarity is preserved and there is no loss of information when viewed from the entire wave function of the universe, whereas a semi-classical observer, who can see only a definitive geometry, would find an effective loss of information. Ultimately, this may provide a resolution to the information loss dilemma.

79 ASTRONOMY AND ASTROPHYSICS↗