Search NASA⌕ Search

SEARCH · Search NASA

Results for “Neural recommender systems”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

34 records · Page 2
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Benchmarking the Performance of Neuromorphic and Spiking Neural Network Simulators

Software simulators play a critical role in the development of new algorithms and system architectures in any field of engineering. Neuromorphic computing, which has shown potential in building brain-inspired energy-efficient hardware, suffers a slow-down in the development cycle due to a lack of flexible and easy-to-use simulators of either neuromorphic hardware itself or of spiking neural networks (SNNs), the type of neural network computation executed on most neuromorphic systems. While there are several openly available neuromorphic or SNN simulation packages developed by a variety of research groups, they have mostly targeted computational neuroscience simulations, and only a few have targeted small-scale machine learning tasks with SNNs. Evaluations or comparisons of these simulators have often targeted computational neuroscience-style workloads. In this work, we seek to evaluate the performance of several publicly available SNN simulators with respect to non-computational neuroscience workloads, in terms of speed, flexibility, and scalability. We evaluate the performance of the NEST, Brian2, Brian2GeNN, BindsNET and Nengo packages under a common front-end neuromorphic framework. Our evaluation tasks include a variety of different network architectures and workload types to mimic the computation common in different algorithms, including feed-forward network inference, genetic algorithms, and reservoir computing. We also study the scalability of each of these simulators when running on different computing hardware, from single core CPU workstations to multi-node supercomputers. Our results show that the BindsNET simulator has the best speed and scalability for most of the SNN workloads (sparse, dense, and layered SNN architectures) on a single core CPU. However, when comparing the simulators leveraging the GPU capabilities, Brian2GeNN outperforms the others for these workloads in terms of scalability. NEST performs the best for small sparse networks and is also the most flexible simulator in terms of reconfiguration capability NEST shows a speedup of at least 2x compared to the other packages when running evolutionary algorithms for SNNs. The multi-node and multi-thread capabilities of NEST show at least 2x speedup compared to the rest of the simulators (single core CPU or GPU based simulators) for large and sparse networks. We conclude our work by providing a set of recommendations on the suitability of employing these simulators for different tasks and scales of operations. We also present the characteristics for a future generic ideal SNN simulator for different neuromorphic computing workloads.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Development and assessment of prognosis digital twin in a NAMAC system

The nearly autonomous management and control (NAMAC) system is a comprehensive control system to assist plant operations by furnishing control recommendations to operators. Prognosis digital twin (DT-P) is a critical component in NAMAC for predicting action effects and supporting NAMAC decision-making during normal and accident scenarios. To quantifying and reducing uncertainty of machine-learning-based DT-Ps in multi-step predictions, this work investigates and derives insights from the application of three techniques for optimizing the performance of DT-P by long short-term memory recurrent neural networks, including manual search, sequential model-based optimization, and physics-guided machine learning. Finally, sequential model-based optimization and physics-guide machine learning result in smallest errors when the predicting transients are similar to the training data.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2022

AI for Experimental Controls at Jefferson Lab

We report the AI for Experimental Controls project is developing an AI system to control and calibrate detector systems located at Jefferson Laboratory. Currently, calibrations are performed offline and require significant time and attention from experts. This work would reduce the amount of data and the amount of time spent calibrating in an offline setting. The first use case involves the Central Drift Chamber (CDC) located inside the GlueX spectrometer in Hall D. We use a combination of environmental and experimental data, such as atmospheric pressure, gas temperature, and the flux of incident particles as inputs to a sequential Neural Network (NN) to recommend a high voltage setting and the corresponding calibration constants in order to maintain consistent gain and optimal resolution throughout the experiment. Utilizing AI in this manner represents an initial shift from offline calibration towards near real time calibrations performed at Jefferson Laboratory.

47 OTHER INSTRUMENTATION↗
DOE OSTI2020

Neural network representability of fully ionized plasma fluid model closures

The closure problem in fluid modeling is a well-known challenge to modelers aiming to accurately describe their systems of interest. Over many years, analytic formulations in a wide range of regimes have been presented but a practical, generalized fluid closure for magnetized plasmas remains an elusive goal. Here, as a first step toward constructing a novel data-based approach to this problem, we apply ever-maturing machine learning methods to assess the capability of neural network architectures to reproduce crucial physics inherent in known magnetized plasma closures. We find encouraging results, indicating the applicability of neural networks to closure physics, but also arrive at recommendations on how one should choose appropriate network architectures for the given locality properties dictated by the underlying physics of the plasma.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2022

Comparative Study of Wind Energy Potential Estimation Methods for Wind Sites in Togo and Benin (West Sub-Saharan Africa)

The characterization of wind speed distribution and the optimal assessment of wind energy potential are critical factors in selecting a suitable site for wind power plants (WPP). The Weibull distribution law has been used extensively to analyze the wind characteristics of candidate WPP sites, and to estimate the available and deliverable energy. This paper presents a comparative study of five wind energy resource assessment methods as they applied to the context of wind sites in West Sub-Saharan Africa. We investigated three numerical approaches, namely, the adaptive neuro-fuzzy inference system (ANFIS), the multilayer perceptron method (MLP), and support vector regression (SVR), to derive the distribution law of wind speeds and to optimally quantify the corresponding wind energy potential. Next, we compared these three approaches to two well-known Weibull distribution law-based methods: the empirical method of Justus (EMJ) and the maximum likelihood method (MLM). Case study results indicated that the neural network-based methods, ANFIS and MLP, yielded the most accurate distribution fits and wind energy potential estimates, and consequently, are the most recommended methods for the wind sites in Togo and Benin. The orders of magnitude of the root mean squared error (RMSE) in estimating the recoverable energy using ANFIS were, respectively, 10-4 and 10-5 for Lomé and Cotonou, while MLP achieved an RMSE order of magnitude of 10-3 for both sites.

17 WIND ENERGY↗
DOE OSTI2024

Trustworthiness modeling and evaluation for a nearly autonomous management and control system

The Nearly Autonomous Management and Control (NAMAC) system supports the advanced reactor operation by recommending control actions to operators based on real-time measurements and digital twins (DTs) learning from the knowledge base. To enable the safe and reliable use of autonomous technologies, NAMAC and its recommendations should be trustworthy to operators and regulators at both the design and operation stages. This study proposes a NAMAC trustworthiness modeling and evaluation framework supported by trustworthiness ontologies and evidence-based approaches. The development-time and run-time ontologies are separately constructed and then converted to Bayesian networks to quantitatively evaluate the NAMAC trustworthiness. This evaluation is demonstrated by collecting and characterizing evidence from NAMAC practices, such as the development and assessment of the NAMAC system, data coverage assessment, and the training and optimizations of neural-network-based DTs. Our proposed approach can aggregate various trustworthiness attributes of complex artificial-intelligence-supported systems for safety-critical applications. It also considers the interaction between different DTs and extends beyond the trustworthiness evaluation of a single DT. In conclusion, the evidence-based method enhances the transparency of the trustworthiness modeling and evaluation processes and helps identify uncertainties and subjectivity involved in the processes.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2024

A framework to enhance disaster debris estimation with AI and aerial photogrammetry

This study addresses the critical need to enhance disaster preparedness and response, focusing on hurricane impact assessment and debris estimation. Accurate assessments in this context are critical for post-event search-and-rescue (SAR) operations and resource distribution. Recent computing advancements are revealing the potential of unmanned aerial vehicles (UAVs) and artificial intelligence (AI) technologies in collecting data and assisting with post-hurricane reconnaissance. However, the use of AI and UAV photogrammetry for accurate disaster impact analysis remains underexplored. To this end, this study proposes a damage and debris analysis framework harnessing reality capture through aerial imagery and photogrammetry. Within this framework, a region-based neural network is leveraged to detect debris locations in aerial imagery with favorable performance. In a testbed within the Beaumont-Port Arthur region, in Southeast Texas, this study performs 3D reality captures of the built environment. Since the accuracy of the 3D reality capture is of importance in research areas associated with time-sensitive disaster response, we further investigate the optimal 2D aerial imagery overlap ratio required to generate a sufficiently accurate 3D model for disaster impact analysis and debris volume estimation. Results indicate that, in the case of aerial imagery for infrastructure systems, a minimum of 60 % overlap is recommended for damage assessment and debris analysis. In contrast, for flat green areas, a minimum of 50 % overlap is adequate. Overall, for disaster response applications, our study reveals that an overlap ratio between 60 % and 70 % is optimal for achieving a balance between time efficiency and data quality in aerial data collection. Furthermore, these quantitative recommendations are crucial for enabling efficient disaster response efforts. Additionally, our study outcomes will improve disaster impact analysis and facilitating timely and effective response strategies.

Artificial intelligence↗
NASA NTRS1992

Application of fuzzy logic-neural network based reinforcement learning to proximity and docking operations: Attitude control results

As part of the RICIS activity, the reinforcement learning techniques developed at Ames Research Center are being applied to proximity and docking operations using the Shuttle and Solar Max satellite simulation. This activity is carried out in the software technology laboratory utilizing the Orbital Operations Simulator (OOS). This report is deliverable D2 Altitude Control Results and provides the status of the project after four months of activities and outlines the future plans. In section 2 we describe the Fuzzy-Learner system for the attitude control functions. In section 3, we provide the description of test cases and results in a chronological order. In section 4, we have summarized our results and conclusions. Our future plans and recommendations are provided in section 5.

Jani, Yashvant↗
DOE OSTI2020

Deeply uncertain: comparing methods of uncertainty quantification in deep learning algorithms

We present a comparison of methods for uncertainty quantification (UQ) in deep learning algorithms in the context of a simple physical system. Three of the most common uncertainty quantification methods - Bayesian Neural Networks (BNN), Concrete Dropout (CD), and Deep Ensembles (DE) - are compared to the standard analytic error propagation. We discuss this comparison in terms endemic to both machine learning ("epistemic" and "aleatoric") and the physical sciences ("statistical" and "systematic"). The comparisons are presented in terms of simulated experimental measurements of a single pendulum - a prototypical physical system for studying measurement and analysis techniques. Our results highlight some pitfalls that may occur when using these UQ methods. For example, when the variation of noise in the training set is small, all methods predicted the same relative uncertainty independently of the inputs. This issue is particularly hard to avoid in BNN. On the other hand, when the test set contains samples far from the training distribution, we found that no methods sufficiently increased the uncertainties associated to their predictions. This problem was particularly clear for CD. In light of these results, we make some recommendations for usage and interpretation of UQ methods.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2020

Machine-Learning Enabled Evaluation of Probability of Piping Degradation In Secondary Systems of Nuclear Power Plants

The transition to condition-based, risk-informed automated maintenance will contribute to a significant reduction of operations and maintenance costs that account for the majority of nuclear power generation costs. Furthermore, of the operations and maintenance costs in U.S. plants, approximately 80% are labor costs. To address the issue of rising operating costs and economic viability, technologies used to perform online monitoring of piping and other secondary system structural components in commercial nuclear power plants (NPPs) are under evaluation. These online monitoring systems have the potential to identify when a more detailed inspection is needed using real time measurements, rather than at a pre-determined inspection interval thus reducing the maintenance cost. This paper describes distributed high-temperature stable fiber sensors fabricated in optical fibers through a roll-to-roll laser direct writing process using femtosecond lasers. Using phase-sensitive optical time domain reflectometry, distributed acoustic and vibration sensors can be developed and deployed to critical components and systems in NPPs to perform active measurements with spatial resolution down to 0.5-meter throughout the piping systems. Complex acoustic and vibration signatures harnessed by distributed sensors are registered and analyzed by artificial intelligence algorithms for degradation detection and flaw identification. Piping elbows with machined-in flaws were instrumented with fiber sensors. High-spatial-resolution data were used to develop and validate machine learning algorithms, including both linear and nonlinear regression, and classification. Additionally, classification and sensor analysis were also performed for data analysis. The paper concludes with recommendations and future work on applications of machine learning enabled high-resolution fiber sensors for piping degradation monitoring in current or future NPPs.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2024

Assurance of Reasoning Enabled Systems (ARES)

ARES was in part motivated by the determination of President’s Council of Advisors on Science and Technology (PCAST) on May 13th, 2023 that published a set of inquiries: In an era in which convincing images, audio, and text can be generated with ease on a massive scale, how can we ensure reliable access to verifiable, trustworthy information? How can we be certain that a particular piece of media is genuinely from the claimed source? What technologies, policies, and infrastructure can be developed to detect and counter AI-generated disinformation? In an effort to automatically analyze and patch/optimize code the work in this report describes various neural Machine Learning (ML) analysis engine implementations to assist in situations where source code is deficient or completely lacking to decompile (lift) binary code to ’C’. The goal is to gradually reduce human intervention. To this end, two Large Language Model (LLM) variants (Code LLama 2, LLama 3.1 and Starcoder1, Starcoder 2) where finetuned with ’before/after’ code pairs on the OpenBLAS library. LLama trained on the lowering process, Starcoder trained on the lifting process with National Security Agency’s (NSA) open-source Ghidra decompiler assist. The inferencing test results indicate correctness for only very short sequences for Starcoder 2. Moving forward, the experiments conclude with a set of recommendations of required resources and technologies

97 MATHEMATICS AND COMPUTING↗
NASA NTRS2020

Electromagnetic Pain Relief/Blocking: Feasibility Assessment

Context/Background: Astronauts use pharmaceuticals during spaceflight to manage acute and chronic pain, but use of analgesics will have drawbacks for exploration-class missions because the shelf life of these medications is limited, resupply will be curtailed, astronauts may develop tolerance and/or addiction to these medications, and side effects can include impairment of cognitive abilities. Electromagnetic devices have been developed that treat pain terrestrially by affecting neuromodulation–dubbed “electroceuticals”, these devices have varied mechanisms of action that either stimulate or suppress neural activity in the central nervous system or peripheral nerves. Objective/Purpose: The available literature was reviewed and FDA-approved pain treatments (both pharmacological and non-pharmacological), as well as those currently under development, were assessed for their suitability for use in exploration class spaceflight missions. Data Sources: Due to the COVID-19 pandemic and the resulting closure of libraries, data sources were restricted to those available digitally. Online database searches included PubMed, U.S. Patent and Trademark Office, federal grant award databases (National Aeronautics and Space Administration (NASA), Department of Defense (DoD), National Institutes of Health (NIH)), and general internet searches. More than 1,600 records were reviewed in this effort. Study Selection/Eligibility Criteria: Targeted searches included different aspects of pain management. Priority was given to review studies, to cover as much of the available literature as possible in this limited effort. Study Appraisal and Synthesis Methods/Data Extraction and Data Synthesis: The titles of the studies and the awards that were obtained by searching online databases were reviewed and further information was sought for the relevant titles. Abstracts or award summaries were generally available online; for journal abstracts, full text articles were either available online or were requested via interlibrary loan. Results: An overwhelming majority of the literature focuses on the treatment of chronic rather than acute pain because it is assumed that acute pain only rarely fails to resolve and instead transitions into chronic pain when the central nervous system becomes hypersensitized. The available electromagnetic devices marketed for pain treatment have varying levels of invasiveness, use different mechanisms of action, and have demonstrated varying efficacy when evaluated scientifically. A truly noninvasive, highly efficient device is desired for use during spaceflight. One portable, self-contained, FDA-approved device was identified that, from preliminarily assessment, best met these criteria; the device noninvasively applies pulsed shortwave therapy (PSWT) to modify pain signals from peripheral nerves, however, the device has limited battery life and the effects are relatively non-selective in type of neural signal modified. Limitations: This current effort, although extensive, did not identify a comprehensive list of all alternatives for pain treatment. Once the pandemic limitations are lifted, a longer, more thorough effort may find additional options. Conclusions/Implications: The ideal electromagnetic pain treatment device for use on exploration-class spaceflight missions does not yet exist, but it may be available soon. It is not feasible for NASA to develop medical devices due to the schedule constraints for pending exploration-class missions, but adapting a promising device that is already FDA-approved might be an option. Monitoring research that is ongoing at other federal agencies is recommended, and further review of the candidate PSWT device identified in this current effort may be warranted.

Carol Mullenax↗
NASA NTRSDate not supplied

Electromagnetic Pain Relief/Blocking: Feasibility Assessment

CONTEXT/BACKGROUND Astronauts use pharmaceuticals during spaceflight to manage acute and chronic pain, but use of analgesics will have drawbacks for exploration-class missions because the shelf life of these medications is limited, resupply will be curtailed, astronauts may develop tolerance and/or addiction to these medications, and side effects can include impairment of cognitive abilities. Electromagnetic devices have been developed that treat pain terrestrially by affecting neuromodulation–dubbed “electroceuticals”, these devices have varied mechanisms of action that either stimulate or suppress neural activity in the central nervous system or peripheral nerves. OBJECTIVE/PURPOSE The available literature was reviewed and FDA-approved pain treatments (both pharmacological and non-pharmacological), as well as those currently under development, were assessed for their suitability for use in exploration class spaceflight missions. DATA SOURCES Due to the COVID-19 pandemic and the resulting closure of libraries, data sources were restricted to those available digitally. Online database searches included PubMed, U.S. Patent and Trademark Office, federal grant award databases (National Aeronautics and Space Administration (NASA), Department of Defense (DoD), National Institutes of Health (NIH)), and general internet searches. More than 1,600 records were reviewed in this effort. STUDY SELECTION/ELIGIBILITY CRITERIA Targeted searches included different aspects of pain management. Priority was given to review studies, to cover as much of the available literature as possible in this limited effort. STUDY APPRAISAL AND SYNTHESIS METHODS/DATA EXTRACTION AND DATA SYNTHESIS The titles of the studies and the awards that were obtained by searching online databases were reviewed and further information was sought for the relevant titles. Abstracts or award summaries were generally available online; for journal abstracts, full text articles were either available online or were requested via interlibrary loan. RESULTS An overwhelming majority of the literature focuses on the treatment of chronic rather than acute pain because it is assumed that acute pain only rarely fails to resolve and instead transitions into chronic pain when the central nervous system becomes hypersensitized. The available electromagnetic devices marketed for pain treatment have varying levels of invasiveness, use different mechanisms of action, and have demonstrated varying efficacy when evaluated scientifically. A truly noninvasive, highly efficient device is desired for use during spaceflight. One portable, self-contained, FDA-approved device was identified that, from preliminarily assessment, best met these criteria; the device noninvasively applies pulsed shortwave therapy (PSWT) to modify pain signals from peripheral nerves, however, the device has limited battery life and the effects are relatively non-selective in type of neural signal modified. LIMITATIONS This current effort, although extensive, did not identify a comprehensive list of all alternatives for pain treatment. Once the pandemic limitations are lifted, a longer, more thorough effort may find additional options. CONCLUSIONS/IMPLICATIONS The ideal electromagnetic pain treatment device for use on exploration-class spaceflight missions does not yet exist, but it may be available soon. It is not feasible for NASA to develop medical devices due to the schedule constraints for pending exploration-class missions, but adapting a promising device that is already FDA-approved might be an option. Monitoring research that is ongoing at other federal agencies is recommended, and further review of the candidate PSWT device identified in this current effort may be warranted.

C A Mullenax↗
DOE OSTI2020

ASCENDS: Advanced data SCiENce toolkit for Non-Data Scientists

Recently, advances in machine learning and artificial intelligence have been playing more and more critical roles in a wide range of areas. For the last several years, industries have shown that how learning from data, identifying patterns and making decisions with minimal human intervention can be extremely useful to their business (e.g., image classification, recommending a product to a customer, finding friends in a social network, predicting customers actions, etc.). These success stories have been motivating scientists who study physics, chemistry, materials, medicine, and many other subjects, to explore a new pathway of utilizing machine learning techniques like regression and classification for their scientific activities. However, most existing machine learning tools, systems, and methodologies have been developed for programming experts but not for scientists (or any users) who have no or little knowledge of programming. ASCENDS is a toolkit that is developed to assist scientists (or any persons) who want to use their data for machine learning tasks, more specifically, correlation analysis, regression, and classification. ASCENDS does not require programming skills. Instead, it provides a set of simple but powerful CLI (Command Line Interface) and GUI (Graphic User Interface) tools for non-data scientists to be able to intuitively perform advanced data analysis and machine learning techniques. ASCENDS has been implemented by wrapping around opensource software including Keras, TensorFlow, and scikit-learn.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Big Data Synchrophasor Monitoring and Analytics for Resiliency Tracking (BDSMART)

This report contains key findings from a project titled Big Data Synchrophasor Monitoring and Analytics for Resiliency Tracking (BDSMART), which was carried out through a collaborative effort of a team of researchers from Texas A&M Engineering Experiment Station, Temple University, and Quanta Technology, LLC. The in-kind support came from OSIsoft (acquired by AVEVA), which provided their PI Historian software to demonstrate the use case of streaming PMU data. The first section of the report describes the project goals and objectives related to the development of Machine Learning (ML) models capable of detecting and classifying events by processing phasor measurements captured in the field by Phasor Measurement Units (PMUs). The data for this study was contributed by the utilities/ISOs from the Western and Eastern interconnects and ERCOT, further referred to as Interconnect B (IC B), Interconnect A (IC A), and Interconnect C (IC C), respectively. The approach that the BDSMART Research Team proposed and the key research tasks defined by the team are outlined in this section. The next section describes the technical approach. We first discuss the data constraints related to the PMU measurements and data interpretation constraints imposed by the data contributors. They provided neither the topological information of the grid nor PMU placement locations and captured recorded data at very few locations in the system with the reporting rate of either 30 or 60 fps. The recordings are mostly positive sequence voltage, frequency, and ROCOF, and in some limited cases, three-phase voltages and currents. We then reflect on the bad data issues that stem from poor recording practices and vague definitions of the PMU status bits to supposedly be used for bad data identification. Finally, the data discovery points to imprecise time stamps with incomplete event start/end time, as well as inconsistent and incomplete event labeling, which combined make the implementation of the data models using supervising learning quite challenging. Following the data discovery study, we hypothesize that because the IC B data has the most complete labels, we should focus our model development on that data and then test it on data from other interconnects. We also define the common metrics used to evaluate the results from the ML algorithm tests. We concluded this section by summarizing the common ML models we used and explaining how we implemented and tested them. The issues from this section are expanded in the Training Dataset Report from this project. The final section of this report deals with the accomplishments and conclusions. As the accomplishments, we formulate the problem we are solving and what is achieved by solving the problem. We then reflect on each of the analytics tools we developed and point out the performance of each tool when applied to solving the mentioned problems. We reference this work for further details to the papers we published on each tool. In the conclusions, we give recommendations on how to improve future PMU recording practices to facilitate the ML algorithm implementation and guidance for the future standardization work aimed at clarifying the ambiguities associated with the PMU status bits. We finally list future tasks that can bring about further improvements in the proposed algorithms. The issues from this section are expanded in the Training, and Test Dataset Report filed at the project completion date.

97 MATHEMATICS AND COMPUTING↗