Search NASA⌕ Search

SEARCH · Search NASA

Results for “feature normalization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Deep Learning Based Frequency Stability Assessment in Power Grid with High Renewables

Frequency stability assessment is one critical aspect of power system security assessment. Traditional N-1 screening method is based on the simulations of a few typical daily and seasonal operation scenarios. However, the increasing integration of inverter-based renewables and the retirement of conventional synchronous generators result in decreasing system inertia and growing complexity of system operating conditions. Selecting a few typical operation scenarios cannot cover all operating conditions, and the time-domain simulation of all operation conditions requires tremendous time. This paper proposes a more efficient frequency stability assessment method based on deep learning. The affinity propagation clustering algorithm is used to divide the dataset into different clusters, so the selected dataset for training can cover the diversified operating conditions as much as possible. Also, feature normalization is applied to both the training dataset and testing dataset in order to remove any unnecessary bias. Especially, trained model based on full dataset normalization has bounded error in the prediction. The case study on the reduced 240-bus WECC system demonstrates that the proposed method can predict accurate frequency nadir with limited training dataset. The deep learning model using the revised feature normalization can predict more accurate frequency nadir than that using the traditional feature normalization and has very small maximum prediction error.

affinity propagation↗

A Fast and Accurate Transient Stability Assessment Method Based on Deep Learning: WECC Case Study

Transient stability is one of the critical aspects of power system stability assessment. The increasing integration of inverter-based resources and the retirement of conventional synchronous generators result in the decreasing system inertia and growing complexity of system operating conditions. Using a few selected typical operating conditions cannot guarantee system transient stability in all operating conditions, and the time-domain simulation of all operating conditions requires tremendous time and is often infeasible. This paper proposes a more efficient transient stability assessment method based on deep learning. The binary search method is used to determine the critical clearing time (CCT) in creating training databased by time-domain simulation. This method is fast and accurate with 1 ms resolution. The buses whose CCTs are lower than 200 ms are considered critical buses. Buses close to each other are grouped based on their mutual admittance matrix to reduce the search space of the critical buses. This paper also proposes the generator feature normalization based on the physical model. Case study on the reduced 240-bus WECC system model demonstrates that the proposed method can predict CCT accurately and efficiently.

critical clearing time↗

Phasor-Measurement-Unit-Based Data Analytics Using Digital Twin and PhasorAnalytics Software

A major objective of this project was to apply GE’s commercial machine learning and data analytics toolsets to large-scale, real-world, anonymized Phasor Measurement Unit (PMU) datasets in order to extract signatures, correlated and/or causal factors, and precursor patterns associated with significant power system phenomena. The project had a particular emphasis on extraction of insights relevant to asset health monitoring, real-time load modeling and cybersecurity monitoring. Additionally, the team was directed to undertake a comprehensive data quality analysis for the provided datasets and encouraged to estimate the ‘machine-learning readiness’ of the datasets by documenting any major obstacles to the application of commercial machine learning algorithms. To accomplish the aforementioned objectives, the project team’s work centered around the identification of key event signatures and application of the identified event signatures for event detection and event classification. The industry-validated, semi-supervised machine learning strategy employed for event signature identification involved several major tasks, including data-preprocessing, generation of an overabundance of features, normal data identification, normality modeling, and event signature identification through a methodical, quantitative ranking of features in order of relevance to each studied event type. Throughout the project, data quality issues and mitigation techniques were investigated. In this report, insights are provided regarding the readiness of the provided synchrophasor datasets for application of machine learning and data analytics. The methodologies employed for this technical strategy are summarized in this report. With regards to data preprocessing and feature generation, the provided Training and Test Datasets were ingested into GE’s big data environment. Subsequently, the team applied bad data cleansing and data imputation scripts, event detection scripts, and application programming interfaces (APIs) to the datasets for convenient data access. The project team completed development and validation of dozens of physics-based, statistics-based and transformation-based feature functions used for the extraction of over 60 synchrophasor features. Using a new parallel feature generation technology developed on this project, over 60 features have been rapidly generated for the full two years’ worth of Training and Test Dataset data associated with both the Eastern and Western interconnects. Even accommodating for temporal down-sampling inherent to the feature extraction procedure, this parallel feature generation activity resulted in a massive feature set with a storage requirement approximately equal to that of the raw training dataset itself. With regards to normal data identification and normality modeling, a normality model was built using the feature data extracted from the Training Dataset and iteratively refined subsequent to incremental adjustments and expansions of the Training Dataset feature data. With respect to event characterization and signature identification, an event signature identification pipeline was developed and used in conjunction with the normality model to identify over 15 event signatures for key event categories within the Training Dataset. The identified event signatures were used to characterize hundreds of key events in terms of relative severity, duration, and location of the event. An investigation was undertaken to identify correlated and causal factors involved in transformer events. A separate investigation into temporal trends in ring-down analysis results was undertaken to determine possible associations between system dynamics and various other factors such as loading, season or year. To validate the identified event signatures, additional work was undertaken to develop signature-based anomaly detection and classification tools suitable for convenient application to the synchrophasor datasets. The anomaly detection and classification tools, suitable for online application, were then applied to the entirety of the Eastern Interconnect Training and Test Datasets. Performance of the event detection and classification tools was evaluated upon receipt of the Test Dataset event logs (i.e., the labels for events contained in the Test Dataset), and promising results were obtained despite several challenges (documented herein) associated with application of supervised or semi-supervised machine learning methods to large-scale, anonymized datasets. Finally, the detection and classification tools were used to detect, classify, and characterize thousands of new events not included in the original event logs provided by the DOE within both the Training and Test Datasets.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Anomaly forecasting and early warning generation

The example embodiments are directed to a system and method for forecasting anomalies in feature detection. In one example, the method includes storing feature behavior information of at least one monitoring node of an asset, including a normalcy boundary identifying normal feature behavior and abnormal feature behavior for the at least one monitoring node in feature space, receiving input signals from the at least one monitoring node of the asset and transforming the input signals into feature values in the feature space, wherein the feature values are located within the normalcy boundary, forecasting that a future feature value corresponding to a future input signal from the at least one monitoring node is going to be positioned outside the normalcy boundary based on the feature values within the normalcy boundary, and outputting information concerning the forecasted future feature value being outside the normalcy boundary for display.

Abbaszadeh, Masoud↗

Radiation-Induced Noise Resilience of Neuromorphic Architectures

Neuromorphic event-based networks use asynchronous time-dependent information to extract features from input data that can allow for edge-based distributed applications such as object recognition. The noise resilience properties of such networks, especially in the context of space applications, are yet to be explored. In this paper, we use the hierarchy of time surfaces (HOTS) algorithm, which is one of the neuromorphic algorithms, to understand the least and most resilient modules in a neuromorphic network. The HOTS algorithm relies on the computing of time surfaces that maps the temporal delays between neighboring pixels into normalized features that involve many computations that are also found in other neuromorphic networks such as exponential decays, distance computations, etcetera. We implemented HOTS on a Digilent PYNQ board with a Xilinx Zynq 7020 system on a chip, and we subjected the boards running the HOTS network inference to neutron radiation at the Los Alamos Neutron Science Center. Furthermore, we used simulation models from our previous similar experiments on the event-based sensor to create a neutron induced noise model to quantify the effect of this noise on the overall performance of the network. This experiment provides the preliminary measurements of the reliability of the HOTS algorithm and proposes methods to create a more reliable HOTS architecture in future spacecraft missions.

Engineering↗

Machine learning enhanced predictions of ICRF heating: Overcoming numerical limitations via data curation

In this work, we present the development of robust surrogate models for Ion Cyclotron Range of Frequencies (ICRF) and High-Harmonic Fast Wave (HHFW) heating predictions in fusion plasmas. Building upon our previous efforts to achieve real-time capable models, we identify the cause of the outliers found using TORIC in certain HHFW heating scenarios. The outliers are observed to be spurious ion Bernstein wave (IBW)-like modes caused by a wavelength control algorithm designed to address challenging scenarios with high perpendicular wavenumbers. The effect arises from the modulation in the perpendicular susceptibility, which can induce sign reversal and IBW-like propagation for scenarios featuring normalized ion Larmor radius λ i ≫ 1. We use TORIC with this algorithm disabled to generate a novel HHFW-NSTX database that is free of outliers. Surrogate models trained on this database, including Random Forest Regressor (RFR), Multi-Layer Perceptrons, and Gaussian Process Regressors (GPR), demonstrate the ability to accurately predict HHFW heating profiles, with regression scores of R 2 ∈[0.93−0.99]. Additionally we demonstrate that it is possible to generalize predictions beyond training data by the use of both RFR and GPR models, enabling the prediction of scenarios previously limited to the original model. GPR models also provide uncertainty quantification, offering insights into model confidence. This work introduces a comprehensive Verification, Validation, and Uncertainty Quantification methodology for surrogate modeling, applicable not only to ICRF heating but also to other RF heating challenges and fusion physics problems. Beyond accelerated inference, these models show effective extrapolation capabilities, providing an alternative for addressing numerical challenges.

Artificial neural networks↗

Transport signatures of phase fluctuations in superconducting qubits

Abstract Josephson junctions supply the nonlinear inductance element in superconducting qubits. In the widely used transmon configuration, where the junction is shunted by a large capacitor, the low charging energy minimizes the sensitivity of the qubit to charge noise while maintaining the necessary anharmonicity to qubit states. We report here low-frequency transport measurements on small standalone junctions and identically fabricated capacitively-shunted junctions that show two distinct features normally attributed to small capacitance junctions near zero bias: reduced switching currents and prominent finite resistance associated with phase diffusion in the current–voltage characteristic. Our transport data reveals the existence of phase fluctuations in transmons arising from intrinsic junction capacitance.

Wisne, M. (ORCID:0009000610684209)↗

WeakIdent: Weak formulation for identifying differential equation using narrow-fit and trimming

Data-driven identification of differential equations is an interesting but challenging problem, especially when the given data are corrupted by noise. When the governing differential equation is a linear combination of various differential terms, the identification problem can be formulated as solving a linear system, with the feature matrix consisting of linear and nonlinear terms multiplied by a coefficient vector. This product is equal to the time derivative term, and thus generates dynamical behaviors. The goal is to identify the correct terms that form the equation to capture the dynamics of the given data. We propose a general and robust framework to recover differential equations using a weak formulation with two new mechanisms, narrow-fit and trimming, for both ordinary and partial differential equations (ODEs and PDEs). The weak formulation facilitates an efficient and robust way to handle noise, and two new mechanisms, narrow-fit and trimming, improve the coefficient support and value recoveries respectively. For each sparsity level, Subspace Pursuit is utilized to find an initial set of support from the large dictionary. Then, we focus on highly dynamic regions (rows of the feature matrix), and error normalize the feature matrix in the narrow-fit step. The support is further updated via trimming the terms that contribute the least. Finally, the support set of features with the smallest Cross-Validation error is chosen as the result. A comprehensive set of numerical experiments are presented for both systems of ODEs and PDEs with various noise levels. The proposed method gives a robust recovery of the coefficients, and a significant denoising effect which can handle up to 100% noise-to-signal ratio for some equations. We compare the proposed method with several state-of-the-art algorithms for the recovery of differential equations.

97 MATHEMATICS AND COMPUTING↗

Frequency-domain computing using nonlinear acoustic-wave device on lithium niobate

Abstract Multiply-accumulation are crucial computing operations in signal processing, numerical simulations, and machine learning. In recent years, optical analog approaches have demonstrated higher computing performance and better power efficiency than their digital counterparts. However, analog computing chips usually need large areas and complex structures for parallel computing, as a single device element only executes one computing operation at a single time. Here, we demonstrate frequency-domain computing using the nonlinear acoustic-wave devices on lithium niobate, featuring a normalized external second-harmonic generation conversion efficiency of ~ 5.7 × 10-4 W-1. The second-order sum-frequency nonlinear process of lithium niobate enables multiplication of inputs encoded in the frequency domain. Compared to the analog schemes, our device features a notably simpler design, and nanofabrication requires only one lift-off. Using a single acoustic-wave device within an area of 0.03 mm2, we can simultaneously conduct over 130,000 multiply-accumulation operations. Our acoustic-wave device shows applications in real and complex vector convolutions and image processing. This demonstration sets the stage for experimental realizations into frequency-domain integrated nonlinear acoustic computing systems, potentially shaping future developments in acoustic neural networks and quantum computing.

chai, mingzhao (ORCID:0009000466226341)↗

A machine-learning-aided data recovery approach for predicting multi-material thermal behaviors in advanced test reactor capsules

Instrumented experiments conducted at test reactors are essential to the deployment of new advanced reactor systems. Designing new experiments and generating data on specific reactor conditions require significant investments in terms of both time and cost. Finite element analysis software can be used to create high-fidelity models of experiment environments in order to support the actual experiments, but computation time remains a concern in terms of applying outcomes to real-time usage of data (e.g., a digital twin [DT]). Here, the present research proposes a machine-learning (ML) aided approach to making temperature and displacement predictions based on the thickness of the outer gas gap on the experimental capsule used for in-pile demonstration of a novel new thermal conductivity probe in the Advanced Test Reactor (ATR). This capsule consisted of U10Zr fuel, a rodlet, sodium, and inner and outer capsules. Gas gaps existed between the fuel and the rodlet, and between the inner and the outer capsule. The learning data pertained to an experimental capsule's radial distributions of temperature and displacement, as obtained based on Abaqus and the physical features. For the first step of ML sequence, the temperature was predicted using three positional parameters. Next, the displacement was predicted using seven additional parameters. Each physical feature was normalized in order to be both nondimensional and standardized. The temperature and displacement predictions showed good agreement with the simulation results in all cases involving interpolation and extrapolation. Furthermore, data similarity enhancement increased the similarity between the training and the target data, thereby increasing the predictive accuracy of the ML models. In certain extrapolation cases involving limited original ML model accuracy, data similarity enhancement and data recovery was able to somewhat improve this accuracy.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Heterogeneous response of cancer-associated fibroblasts to the glucose deprivation through mitochondrial calcium uniporter

Highlights: • CAFs from a tumor mass are heterogeneous under the glucose deficient condition. • CAFs survive under glucose deficient condition by activation of TGF-β and calcium. • Calcium influx to mitochondria is critical for survival of glucose-deficient CAFs. • MCU in CAFs could be a feasible target for the development of anticancer drugs. Cancer-associated fibroblasts (CAFs) are an abundant component of the tumor microenvironment and have distinct features from normal fibroblasts (NFs). However, the discriminative nature of heterogeneous CAFs under glucose starvation remains unknown. In this study, we investigated the changes in the mitochondrial calcium concentration and relevant intracellular machinery in CAFs under glucose-deficient conditions. Xenografted tumor masses were dissected into multiple pieces and subjected to the CAF isolation using magnetically activated cell sorting (MACS). NFs were separated from the normal lung and skin. Under glucose starvation, CAFs from the tumor mass exhibited heterogeneity in cell proliferation, ATP production and calcium concentration. Compared to NFs, mitochondrial calcium concentration was significantly higher in glucose-starved CAFs with upregulation of mitochondrial calcium uniporter (MCU) that led to enhancement of ATP production and cell growth. Intriguingly, treatment of glucose-starved CAFs with oligomycin increased apoptosis by disrupted calcium homeostasis following overactivation of the mPTP. Moreover, oligomycin-induced apoptosis was mitigated by calcium chelation. This study demonstrated that the discriminative calcium influx to mitochondria through MCU coordinated cell growth and apoptosis in glucose-starved CAFs but not in NFs.

60 APPLIED LIFE SCIENCES↗

Automatic Detection of Defects in High-Reliability Components

Disastrous consequences can result from defects in manufactured parts—particularly the high consequence parts developed at Sandia. Identifying flaws in as-built parts can be done with nondestructive means, such as X-ray Computed Tomography (CT). However, due to artifacts and complex imagery, the task of analyzing the CT images falls to humans. Human analysis is inherently unreproducible, unscalable, and can easily miss subtle flaws. We hypothesized that deep learning methods could improve defect identification, increase the number of parts that can effectively be analyzed, and do it in a reproducible manner. We pursued two methods: 1) generating a defect-free version of a scan and looking for differences (PandaNet), and 2) using pre-trained models to develop a statistical model of normality (Feature-based Anomaly Detection System: FADS). Both PandaNet and FADS provide good results, are scalable, and can identify anomalies in imagery. In particular, FADS enables zero-shot (training-free) identification of defects for minimal computational cost and expert time. It significantly outperforms prior approaches in computational cost while achieving comparable results. FADS’ core concept has also shown utility beyond anomaly detection by providing feature extraction for downstream tasks.

47 OTHER INSTRUMENTATION↗

Machine-Learning-aided Approach for Predicting the Thermal Expansion Behaviors in Advanced Test Reactor Capsules (NURETH-20 full paper)

Instrumented experiments at test reactors are essential to deploying new advanced reactor systems. Designing new experiments and generating data on specific conditions require both time and cost investment. A high-fidelity model of the experiment environment can be created using finite element analysis software to support the actual experiments, but computation time is still a concern in applying outcomes to real-time usage (e.g., a digital twin). This research proposes a machine-learning-aided approach to temperature and displacement predictions, based on the thickness of the outer gas gap on the experimental capsule used for the in-pile demonstration of a novel thermal conductivity probe in the Advanced Test Reactor. The capsule consisted of U10Zr fuel, a rodlet, sodium, and inner and outer capsules. There were gas gaps between the fuel and rodlet and between the inner and outer capsule. The learning data consisted of an experimental capsule’s radial distributions of temperature and displacement, as obtained from Abaqus and the physical features. For the first step, temperature was predicted using three positional parameters. Then the displacement was predicted using six different positional parameters. Each physical feature was normalized to be both nondimensional and standardized. The temperature and displacement predictions showed good agreement in all cases involving interpolation and extrapolation. Also, data similarity enhancement increased the similarity between training and target data increasing the predictive accuracy of machine-learning models. In some cases of extrapolation, the accuracy of the machine-learning model showed limited performance, but still data similarity enhancement improved the accuracy.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Yet Another Discriminant Analysis (YADA): A Probabilistic Model for Machine Learning Applications

This paper presents a probabilistic model for various machine learning (ML) applications. While deep learning (DL) has produced state-of-the-art results in many domains, DL models are complex and over-parameterized, which leads to high uncertainty about what the model has learned, as well as its decision process. Further, DL models are not probabilistic, making reasoning about their output challenging. In contrast, the proposed model, referred to as Yet Another Discriminate Analysis(YADA), is less complex than other methods, is based on a mathematically rigorous foundation, and can be utilized for a wide variety of ML tasks including classification, explainability, and uncertainty quantification. YADA is thus competitive in most cases with many state-of-the-art DL models. Ideally, a probabilistic model would represent the full joint probability distribution of its features, but doing so is often computationally expensive and intractable. Hence, many probabilistic models assume that the features are either normally distributed, mutually independent, or both, which can severely limit their performance. YADA is an intermediate model that (1) captures the marginal distributions of each variable and the pairwise correlations between variables and (2) explicitly maps features to the space of multivariate Gaussian variables. Numerous mathematical properties of the YADA model can be derived, thereby improving the theoretic underpinnings of ML. Validation of the model can be statistically verified on new or held-out data using native properties of YADA. However, there are some engineering and practical challenges that we enumerate to make YADA more useful.

97 MATHEMATICS AND COMPUTING↗

Dynamic, resilient sensing system for automatic cyber-attack neutralization

An industrial asset may have monitoring nodes that generate current monitoring node values. An abnormality detection computer may determine that an abnormal monitoring node is currently being attacked or experiencing fault. A dynamic, resilient estimator constructs, using normal monitoring node values, a latent feature space (of lower dimensionality as compared to a temporal space) associated with latent features. The system also constructs, using normal monitoring node values, functions to project values into the latent feature space. Responsive to an indication that a node is currently being attacked or experiencing fault, the system may compute optimal values of the latent features to minimize a reconstruction error of the nodes not currently being attacked or experiencing a fault. The optimal values may then be projected back into the temporal space to provide estimated values and the current monitoring node values from the abnormal monitoring node are replaced with the estimated values.

97 MATHEMATICS AND COMPUTING↗

Scaling of the strange-metal scattering in unconventional superconductors

Marked evolution of properties with minute changes in the doping level is a hallmark of the complex chemistry that governs copper oxide superconductivity as manifested in the celebrated superconducting domes and quantum criticality taking place at precise compositions. The strange-metal state, in which the resistivity varies linearly with temperature, has emerged as a central feature in the normal state of copper oxide superconductors. The ubiquity of this behaviour signals an intimate link between the scattering mechanism and superconductivity. However, a clear quantitative picture of the correlation has been lacking. In this study we report the observation of precise quantitative scaling laws among the superconducting transition temperature (T c ), the linear-in-T scattering coefficient (A 1 ) and the doping level (x) in electron-doped copper oxide La 2-x Ce x CuO 4 (LCCO). High-resolution characterization of epitaxial composition-spread films, which encompass the entire overdoped range of LCCO, has enabled us to systematically map its structural and transport properties with unprecedented accuracy and with increments of Δx = 0.0015. Additionally, we have uncovered the relations T c ~ (x c - x) 0.5 ~ (A 1 $\square$ ) 0.5 , where x c is the critical doping in which superconductivity disappears and A 1 $\square$ is the coefficient of the linear resistivity per CuO 2 plane. The striking similarity of the T c versus A 1 $\square$ relation among copper oxides, iron-based and organic superconductors may be an indication of a common mechanism of the strange-metal behaviour and unconventional superconductivity in these systems.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Phase instability-coupled fracture behavior in garnet LLZO solid electrolytes: a machine learning-enabled atomistic study

Fracture in the garnet-type solid electrolyte Li 7 La 3 Zr 2 O 12 (LLZO) poses a critical threat to both the performance and safety of solid-state batteries. To unravel the coupled chemomechanical processes that govern fracture in LLZO under external loading, we carry out large-scale molecular-dynamics simulations with a validated machine-learning force field. Our results demonstrate that triaxial stresses at crack flanks trigger a localized cubic-to-tetragonal phase transformation, which is accompanied by Li-ion rearrangement. The emergent tetragonal domains feature lattice contraction normal to the fracture plane, imposing coherent misfit strains that provide an additional driving force for further crack propagation. Crucially, introducing Li deficiencies stabilizes the cubic phase, postponing the phase transition and thereby delaying fracture initiation. These findings highlight the role of intrinsic phase instability in dictating LLZO's fracture resistance and its critical connection to local Li concentration. This chemomechanical coupling points toward targeted strategies to enhance the mechanical robustness of garnet electrolytes, including tuning Li content, ensuring dopant homogeneity, and refining processing protocols.

Materials science↗

Characterization of two electronic subsystems in cuprates through optical conductivity

Understanding the physical properties of unconventional superconductors as well as of other correlated materials presents a formidable challenge. Their unusual evolution with doping, frequency, and temperature has frequently led to non-Fermi-liquid (non-FL) interpretations. Optical conductivity is a major challenge in this context. Here, the optical spectra of two archetypal cuprates, underdoped HgBa 2 CuO 4+δ and optimally doped Bi 2 Sr 2 CaCu 2 O 8+δ , are interpreted based on the standard Fermi-liquid (FL) paradigm. At both dopings, perfect frequency-temperature FL scaling is found to be modified by the presence of a second, gapped electronic subsystem. Further, this non-FL component emerges as a well-defined mid-infrared spectral feature after the FL contribution, determined independently by transport, is subtracted. Temperature, frequency, and doping evolution of the MIR feature identify a gapped rather than dissipative response. In contrast, the dissipative response is found to be relevant for pnictides and ruthenates. Such an unbiased FL/non-FL separation is extended across the cuprate phase diagram, capturing all the key features of the normal state and providing a natural explanation why the superfluid density is attenuated on the overdoped side. Thus, we obtain a unified interpretation of optical responses and transport measurements in all analyzed physical regimes and all analyzed compounds.

36 MATERIALS SCIENCE↗