Search NASA⌕ Search

SEARCH · Search NASA

Results for “loss function regularization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Short term hearing loss in general aviation operations, phase 1, part 1

The effects of light aircraft noise on six subjects during flight operations were investigated. The noise environment in the Piper Apache light aircraft was found to be capable of producing hearing threshold shifts. The following are the principal findings and conclusions: (1) Through most of the frequency range for which measurements were taken (500 to 6000 Hz), there was a regular progression showing increased loss of auditory acuity as a function of increased exposure time. (2) Extensive variability was found in the results among subjects, and in the measured loss at discrete frequencies for each subject. (3) The principal loss of hearing occurred at the low frequencies, around 500 Hz.

Parker, J. F., Jr.↗

Physics-informed Karhunen-Loeve and Neural Network Approximations for Solving Inverse Differential Equation Problems

Here we present the PI-CKL-NN method for parameter estimation in differential equation (DE) models given sparse measurements of the parameters and states. In the proposed approach, the space- or time-dependent parameters are approximated by Karhunen-Loeve (KL) expansions that are conditioned on the parameters’ measurements, and the states are approximated by deep neural networks (DNNs). The unknown weights in the KL expansions and DNNs are found my minimizing the cost function that enforces the measurements of the states the DE constraint. Regularization is achieved by adding the l2 norm of the conditional KL coefficients into the loss function. Our approach assumes that the parameter fields are correlated in space or time and enforces the statistical knowledge (the mean and the covariance function) in addition to the DE constraints and measurements as opposed to the physics-informed neural network (PINN) and other similar physics-informed machine learning methods where only DE constraints and data are used for parameter estimation. We use the PI-CKL-NN method for parameter estimation in an ordinary differential equation with an unknown time-dependent parameter and the one- and two-dimensional partial differential diffusion equations with unknown space-dependent diffusion coefficients. We also demonstrate that PI-CKL-NN is more accurate than the PINN method, especially when the observations of the parameters are very sparse

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Predictive Modeling for Differential Diagnosis and Mortality Risk Assessment

The prevalence of electronic health record (EHR) systems has brought prodigious biomedical informatics opportunity. Automated machine learning methods can effectively utilize such data and have become common tools for healthcare predictive modeling. Researches in medical informatics have explored the potential of deep learning and classical models in emergent care scenarios. In particular, predicting differential diagnoses for admissions have proven useful in decreasing unnecessary lab tests and improving inpatient triage decision-making. Moreover, identification of high-risk patients for in-hospital mortality is vitally important to maximize allocation of medical resources.The Medical Information Mart for Intensive Care (MIMIC-III) database, containing de-identified critical care inpatient was used in our study. This data set captures hospital patient laboratory measurements, pharmacologic prescriptions, diagnostic data and procedure event recordings. When considering adult patients and discounting admissions with ICU length of stay less than 24 hours, there were 37,787 unique admissions and 30,414 total patients. We examined the top 25 most prevalent ICD-9 group-level disease specificities in MIMIC-III using a multi-label classification model. In-hospital mortality was modeled as binary classification with 4,155 (13%) adult patients that expired, of which 3,138 (75.5%) were in the ICU setting. The metrics AUC, F1 score, sensitivity and specificity values calculated for each disease label measured prediction performance.The usage of ICD-9 group codes reduced feature dimension from 14,567 to 942 and greatly improved distribution of patient diagnostic categories. Disease temporal patterns were captured by considering the most frequently sampled 6 vital signs and 13 laboratory values. Missing data were imputed at each time-stamp. Time-series raw hourly average values were converted into 5 summary features (mean, standard deviation, number of observations, min & max values). Patient demographic variables such as age, gender, marital status and ethnicity were also factored into the modeling. Choi et al showed that contextual embedding of medical data, diagnostic and procedural codes alone can predict future diagnoses with sensitivity as high as 0.79. We utilized an embedding technique called word2vec which allowed sparse representations of medical history to be transformed into dense word vectors. The mappings captured contextual information by treating each admission as a sentence and learning the most likely neighboring words in a sliding window fashion. Binary and multi-label classification was achieved via collapse models, which do not consider temporal information, as well as recurrent neural networks with regularization, Softmax output layer activation together with categorical cross-entropy as the loss function.

US Army collaboration↗

A Variational Autoencoder Model Toward Molecular Structure Representation Learning of Fuels

Here, in this work, a Variational Autoencoder (VAE)-based data-driven modeling framework is developed with the overarching goal of enabling fuel design. The VAE model is trained on a large dataset with several chemical species to learn a compressed latent space molecular representation. Chemical structure in the form of Simplified Molecular Input Line Entry System (SMILES) string is fed as input, encoded into the VAE latent space, and decoded back to the SMILES string using Long Short-Term Memory (LSTM) networks. Complexities of the VAE training loss function are thoroughly examined by varying the weightage (beta (𝜷) parameter) of the latent space regularization term, thereby assessing the balance between reconstruction accuracy and validity, and focusing on both accurate molecular structure reconstruction and latent space consistency. Two different strategies for 𝜷 variation are evaluated: linear annealing and cyclic annealing. In addition, the impact of total correlation adjustment and hierarchical priors is also studied with regard to the balance between reconstruction fidelity and latent space regularization, and potential issues such as posterior collapse, over-regularization, and poor disentanglement of latent variables. Overall, the best performance of the model is achieved with hierarchical priors and incrementally increasing 𝜷 from 0 to a threshold value of 0.25 over 75 epochs. The generative VAE model can be readily coupled with Quantitative Structure–Property Relationship (QSPR) analysis to develop an integrated end-to-end framework for fuel-property prediction and molecular design of novel promising fuels.

fuel design↗

Design of Distributed Controllers Seeking Optimal Power Flow Solutions Under Communication Constraints

This paper focuses on power distribution networks featuring inverter-interfaced distributed energy resources (DERs), and develops feedback controllers that drive the DER output powers to solutions of time-varying AC optimal power flow (OPF) problems. Control synthesis is grounded on primal-dual-type methods for regularized Lagrangian functions, as well as linear approximations of the AC power-flow equations. Convergence and OPF-solution-tracking capabilities are established while acknowledging: i) communication-packet losses, and ii) partial updates of control signals. The latter case is particularly relevant since it enables asynchronous operation of the controllers where DER setpoints are updated at a fast time scale based on local voltage measurements, and information on the network state is utilized if and when available, based on communication constraints. As an application, the paper considers distribution systems with high photovoltaic integration, and demonstrates that the proposed framework provides fast voltage-regulation capabilities, while enabling the near real-time pursuit of solutions of AC OPF problems.

24 POWER TRANSMISSION AND DISTRIBUTION↗

HomPINNs: Homotopy physics-informed neural networks for learning multiple solutions of nonlinear elliptic differential equations

Physics-informed neural networks (PINNs) based machine learning is an emerging framework for solving nonlinear differential equations. However, due to the implicit regularity of neural network structure, PINNs can only find the flattest solution in most cases by minimizing the loss functions. In this paper, we combine PINNs with the homotopy continuation method, a classical numerical method to compute isolated roots of polynomial systems, and propose a new deep learning framework, named homotopy physics-informed neural networks (HomPINNs), for solving multiple solutions of nonlinear elliptic differential equations. The implementation of an HomPINN is a homotopy process that is composed of the training of a fully connected neural network, named the starting neural network, and training processes of several PINNs with different tracking parameters. The starting neural network is to approximate a starting function constructed by the trivial solutions, while other PINNs are to minimize the loss functions defined by boundary condition and homotopy functions, varying with different tracking parameters. These training processes are regraded as different steps of a homotopy process, and a PINN is initialized by the well-trained neural network of the previous step, while the first starting neural network is initialized using the default initialization method. Finally, several numerical examples are presented to show the efficiency of our proposed HomPINNs, including reaction-diffusion equations with a heart-shaped domain.

97 MATHEMATICS AND COMPUTING↗

The application of Plant Reliability Data Information System (PRINS) to CANDU reactor

As risk-informed applications (RIAs) are actively implanted in the nuclear industry, an issue associated with technical adequacy of Probabilistic Safety Assessment (PSA) arises in its modeling and data sourcing. In Korea, PSA for all Korean NPPs has been completed and KHNP(Korea Hydro and Nuclear Power Plant Company) developed the database called the Plant Reliability Data Information System (PRinS). It has several characteristics that distinguish it from other database system such as NPRDs (INPO,1994), PRIS (IAEA), and SRDF (EdF). This database has the function of systematic data management such as automatic data-gathering, periodic data deposition and updating, statistical analysis including Bayesian method, and trend analysis of failure rate or unavailability. In recent PSA for CANDU reactor, the component failure data of EPRI ALWR URD and Component Reliability Database were preferentially used as generic data set. The error factor for most component failure data was estimated by using the information NUREG/CR-4550 and NUREG/CR-4639. Also, annual trend analysis was performed for the functional losses of components using the statistical analysis and chart module of PRinS. Furthermore, the database has been updated regularly and maintained as a living program to reflect the current status. This paper presents the failure data analysis using PRinS which provides Bayesian analysis on main components in the CANDU reactor. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Loss Landscape Analysis for Reliable Quantized ML Models for Scientific Sensing

In this paper, we propose a method to perform empirical analysis of the loss landscape of machine learning (ML) models. The method is applied to two ML models for scientific sensing, which necessitates quantization to be deployed and are subject to noise and perturbations due to experimental conditions. Our method allows assessing the robustness of ML models to such effects as a function of quantization precision and under different regularization techniques -- two crucial concerns that remained underexplored so far. By investigating the interplay between performance, efficiency, and robustness by means of loss landscape analysis, we both established a strong correlation between gently-shaped landscapes and robustness to input and weight perturbations and observed other intriguing and non-obvious phenomena. Our method allows a systematic exploration of such trade-offs a priori, i.e., without training and testing multiple models, leading to more efficient development workflows. This work also highlights the importance of incorporating robustness into the Pareto optimization of ML models, enabling more reliable and adaptive scientific sensing systems.

Baldi, Tommaso [Pisa, Scuola Normale Superiore]↗

Decreases in polyunsaturated fatty acid content improve heat stress tolerance during flowering and silicle development in pennycress (Thlaspi arvense L.)

Introduction: Pennycress (Thlaspi arvense L.) is an emerging intermediate oilseed crop grown in the offseason between primary summer crops to produce three cash crops in two years. Previous efforts to improve seed oil quality produced Clustered Regularly Interspaced Short Palindromic Repeats (CRISPR) genome-edited lines with decreased polyunsaturated fatty acids (PUFAs) levels, through loss of function of the FATTY ACID DESATURASE 2 (FAD2), REDUCED OLEATE DESATURATION1 (ROD1), and FATTY ACID ELONGASE1 (FAE1) genes. While seed oil compositions were previously characterized, it remains unknown how vegetative and reproductive tissue compositions might differ and affect tolerance to high temperature (HT) conditions.Methods: In four growth chamber experiments, we explored HT tolerance during flowering and silicle development. Plants were subjected to a 34 °C day/28 °C night regime and compared to control plants maintained at 20 °C. Pollen grain viability at a range of temperatures, lipid peroxidation and proline content in leaves and silicles following HT, and seed yield were measured.Results: Both fad2 and rod1 mutant lines had relatively higher pollen viability (71% and 54% respectively) under moderately elevated temperature (28 °C) compared to wild-type controls (37%). They also showed smaller decreases in seed yield (0% and 40% for fad2 and rod1 respectively, compared to 61% for wild type), following HT exposure during late flowering and early silicle development. Silicles of fad2 plants experienced 65% less lipid peroxidation under HT and 55% less buildup of proline, signifying less stress.Discussion: The differential results of fad2 and rod1 are likely due to the role of FAD2 in membranes in all tissues, whereas ROD1 predominantly affects triacylglycerol (TAG) composition in oil-accumulating tissues including pollen. Our results indicate that decreasing PUFAs, through gene editing, can increase heat tolerance in reproductive tissues as an auxiliary benefit accompanying improved seed oil quality.

59 BASIC BIOLOGICAL SCIENCES↗

Light exposure influences the diurnal oscillation of gut microbiota in mice

Highlights: • Gut microbiota displayed robust rhythmic fluctuation in both compositional and functional level in mice. • The fluctuation of gut microbiota was modulated by enviromental light exposure. • The abundance of Clostridiawas dramatically enhanced in the small intestine when mice were underwent constant darkness. The gut microbiota exhibit diurnal compositional and functional oscillations that influence the host homeostasis. However, the upstream factors that affect the microbial oscillations remain elusive. Here, we focused on the potential impact of light exposure, the main factor that affects the host circadian oscillation, on the diurnal oscillations of intestinal microflora to explore the upstream factor that governs the fluctuations of the gut microbes. The gut microbiota of the mice that were underwent regular light/dark (LD) cycles exhibited a robust rhythm at both compositional and functional level, in all parts of the intestine. Comparably, constant darkness (Dark-Dark, DD) led to the loss of the rhythmic oscillations in almost all parts of the intestine. Additionally, the abundance of Clostridia in DD conditions was dramatically enhanced in the small intestine. Our data indicated light exposure is the upstream factor that governs the regular diurnal fluctuations of gut microbiota in vivo.

60 APPLIED LIFE SCIENCES↗

CFM-ID 4.0 – a web server for accurate MS-based metabolite identification

The CFM-ID 4.0 web server (https://cfmid.wishartlab.com) is an online tool for predicting, annotating and interpreting tandem mass (MS/MS) spectra of small molecules. It is specifically designed to assist researchers pursuing studies in metabolomics, exposomics and analytical chemistry. More specifically, CFM-ID 4.0 supports the: 1) prediction of electrospray ionization quadrupole time-of-flight tandem mass spectra (ESI-QTOF-MS/MS) for small molecules over multiple collision energies (10 eV, 20 eV, and 40 eV); 2) annotation of ESI-QTOF-MS/MS spectra given the structure of the compound; and 3) identification of a small molecule that generated a given ESI-QTOF-MS/MS spectrum at one or more collision energies. The CFM-ID 4.0 web server makes use of a substantially improved MS fragmentation algorithm, a much larger database of experimental and in silico predicted MS/MS spectra and improved scoring methods to offer more accurate MS/MS spectral prediction and MS/MS-based compound identification. Compared to earlier versions of CFM-ID, this new version has an MS/MS spectral prediction performance that is ~22% better and a compound identification accuracy that is ~35% better on a standard (CASMI 2016) testing dataset. CFM-ID 4.0 also features a neutral loss function that allows users to identify similar or substituent compounds where no match can be found using CFM-ID’s regular MS/MS-to-compound identification utility. Finally, the CFM-ID 4.0 web server now offers a much more refined user interface that is easier to use, supports molecular formula identification (from MS/MS data), provides more interactively viewable data (including proposed fragment ion structures) and displays MS mirror plots for comparing predicted with observed MS/MS spectra. These improvements should make CFM-ID 4.0 much more useful to the community and should make small molecule identification much easier, faster, and more accurate.

59 BASIC BIOLOGICAL SCIENCES↗

Evolutionary Design of Controlled Structures

Basic physical concepts of structural delay and transmissibility are provided for simple rod and beam structures. Investigations show the sensitivity of these concepts to differing controlled-structures variables, and to rational system modeling effects. An evolutionary controls/structures design method is developed. The basis of the method is an accurate model formulation for dynamic compensator optimization and Genetic Algorithm based updating of sensor/actuator placement and structural attributes. One and three dimensional examples from the literature are used to validate the method. Frequency domain interpretation of these controlled structure systems provide physical insight as to how the objective is optimized and consequently what is important in the objective. Several disturbance rejection type controls-structures systems are optimized for a stellar interferometer spacecraft application. The interferometric designs include closed loop tracking optics. Designs are generated for differing structural aspect ratios, differing disturbance attributes, and differing sensor selections. Physical limitations in achieving performance are given in terms of average system transfer function gains and system phase loss. A spacecraft-like optical interferometry system is investigated experimentally over several different optimized controlled structures configurations. Configurations represent common and not-so-common approaches to mitigating pathlength errors induced by disturbances of two different spectra. Results show that an optimized controlled structure for low frequency broadband disturbances achieves modest performance gains over a mass equivalent regular structure, while an optimized structure for high frequency narrow band disturbances is four times better in terms of root-mean-square pathlength. These results are predictable given the nature of the physical system and the optimization design variables. Fundamental limits on controlled performance are discussed based on the measured and fit average system transfer function gains and system phase loss.

Masters, Brett P.↗

Long-Term Efficacy of Percutaneous Internal Plastic Stent Placement for Non-anastomotic Biliary Stenosis After Liver Transplantation

PurposeWe aimed to evaluate the long-term efficacy of percutaneous management of non-anastomotic biliary stenosis after liver transplantation, using plastic internal biliary stents.Materials and MethodsThis study included 35 cases (28 men, 7 women; mean age: 52.09 ± 8.13 years, range 34–68) in 33 patients who needed repeated interventional procedures because of biliary strictures. After classification of the biliary strictures, we inserted percutaneous biliary plastic stents through the T-tube or percutaneous transhepatic biliary drainage tracts. Stents were exchanged according to percutaneous methods at regular 2- to 6-month intervals. The stents were removed if the condition improved, as observed on cholangiogram as well as based on clinical findings. The median patient follow-up period after initial diagnosis and treatment was 6.04 years (range 0.29–9.95 years). We assessed treatment success rate and patient and graft survival times.ResultsDuring the follow-up period, 14 patients (14/33, 42.42 %) were successfully treated and were tube-free. The median tube-free time, time without a stent, was 4.13 years (range 1.00–9.01). In contrast, internal plastic stents remained in 9 patients (9/33, 27.27 %) until the last follow-up. These patients had acceptable hepatic function. Among the remaining 10 patients, 3 (3/33, 9.09 %) were lost to regular follow-up and the other 7 (7/33, 21.21 %) patients died. The overall graft loss rate was 20.0 % (7/35). The median time from initial treatment to graft loss was 1.84 years (range 0.42–4.25).ConclusionsPercutaneous plastic stents placement is technically feasible and clinically useful in patients with multiple biliary stenoses following liver transplantation.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Advances and perspectives on the use of CRISPR/Cas9 systems in plant genomics research

Genome editing with site-specific nucleases has become a powerful tool for functional characterization of plant genes and genetic improvement of agricultural crops. Among the various site-specific nuclease-based technologies available for genome editing, the clustered regularly interspaced short palindromic repeat (CRISPR)/CRISPR-associated protein 9 (Cas9) systems have shown the greatest potential for rapid and efficient editing of genomes in plant species. Here, this article reviews the current status of application of CRISPR/Cas9 to plant genomics research, with a focus on loss-of-function and gain-of-function analysis of individual genes in the context of perennial plants and the potential application of CRISPR/Cas9 to perturbation of gene expression, as well as identification and analysis of gene modules as part of an accelerated domestication and synthetic biology effort.

59 BASIC BIOLOGICAL SCIENCES↗

Estimating conditional quantiles with the help of the pinball loss

Using the so-called pinball loss for estimating conditional quantiles is a well-known tool in both statistics and machine learning. So far, however, only little work has been done to quantify the efficiency of this tool for non-parametric (modified) empirical risk minimization approaches. The goal of this work is to fill this gap by establishing inequalities that describe how close approximate pinball risk minimizers are to the corresponding conditional quantile. These inequalities, which hold under mild assumptions on the data-generating distribution, are then used to establish so-called variance bounds which recently turned out to play an important role in the statistical analysis of (modified) empirical risk minimization approaches. To illustrate the use of the established inequalities, we then use them to establish an oracle inequality for support vector machines that use the pinball loss. Here, it turns out that we obtain learning rates which are optimal in a min-max sense under some standard assumptions on the regularity of the conditional quantile function.

97 MATHEMATICS AND COMPUTING↗