Search NASA⌕ Search

SEARCH · Search NASA

Results for “Neural Network Potentials”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8

Inverse Text Normalization of Air Traffic Control System Command Center Planning Telecon Transcriptions

We present a hybrid neural network and rule-based Inverse Text Normalization (ITN) method for domains containing unique technical phraseology, specifically ATCSCC planning telecon audio transcriptions. The Air Traffic Control System Command Center (ATCSCC) hosts bihourly planning telephone conferences (or planning telecons) to ensure smooth operations within the National Airspace (NAS). Access to both live and post meeting transcripts of this speech audio would enable quick review of meetings. ITN is the process of converting un-formatted "raw'' speech-to-text transcripts into a human (expert) readable written form. Our hybrid ITN framework utilizes a neural network to format conversational English, and rule-based methods to format domain-specific aviation text. With a preliminary overall Word Error Rate with Punctuation and Capitalization (WER PC) of 8.26, we show that this method has vast potential in being applied to ATCSCC planning telecon audio and other audio/text based data available in ATM.

Air Traffic Management↗

Neural network representation and learning of mappings and their derivatives

Discussed here are recent theorems proving that artificial neural networks are capable of approximating an arbitrary mapping and its derivatives as accurately as desired. This fact forms the basis for further results establishing the learnability of the desired approximations, using results from non-parametric statistics. These results have potential applications in robotics, chaotic dynamics, control, and sensitivity analysis. An example involving learning the transfer function and its derivatives for a chaotic map is discussed.

White, Halbert↗

Optical Interconnection Via Computer-Generated Holograms

Method of free-space optical interconnection developed for data-processing applications like parallel optical computing, neural-network computing, and switching in optical communication networks. In method, multiple optical connections between multiple sources of light in one array and multiple photodetectors in another array made via computer-generated holograms in electrically addressed spatial light modulators (ESLMs). Offers potential advantages of massive parallelism, high space-bandwidth product, high time-bandwidth product, low power consumption, low cross talk, and low time skew. Also offers advantage of programmability with flexibility of reconfiguration, including variation of strengths of optical connections in real time.

Liu, Hua-Kuang↗

Remote Sensing of In-Flight Icing Conditions: Operational, Meteorological, and Technological Considerations

Remote-sensing systems that map aircraft icing conditions in the flight path from airports or aircraft would allow icing to be avoided and exited. Icing remote-sensing system development requires consideration of the operational environment, the meteorological environment, and the technology available. Operationally, pilots need unambiguous cockpit icing displays for risk management decision-making. Human factors, aircraft integration, integration of remotely sensed icing information into the weather system infrastructures, and avoid-and-exit issues need resolution. Cost, maintenance, power, weight, and space concern manufacturers, operators, and regulators. An icing remote-sensing system detects cloud and precipitation liquid water, drop size, and temperature. An algorithm is needed to convert these conditions into icing potential estimates for cockpit display. Specification development requires that magnitudes of cloud microphysical conditions and their spatial and temporal variability be understood at multiple scales. The core of an icing remote-sensing system is the technology that senses icing microphysical conditions. Radar and microwave radiometers penetrate clouds and can estimate liquid water and drop size. Retrieval development is needed; differential attenuation and neural network assessment of multiple-band radar returns are most promising to date. Airport-based radar or radiometers are the most viable near-term technologies. A radiometer that profiles cloud liquid water, and experimental techniques to use radiometers horizontally, are promising. The most critical operational research needs are to assess cockpit and aircraft system integration, develop avoid-and-exit protocols, assess human factors, and integrate remote-sensing information into weather and air traffic control infrastructures. Improved spatial characterization of cloud and precipitation liquid-water content, drop-size spectra, and temperature are needed, as well as an algorithm to convert sensed conditions into a measure of icing potential. Technology development also requires refinement of inversion techniques. These goals can be accomplished with collaboration among federal agencies including NASA, the FAA, the National Center for Atmospheric Research, NOAA, and the Department of Defense. This report reviews operational, meteorological, and technological considerations in developing the capability to remotely map in-flight icing conditions from the ground and from the air.

Ryerson, Charles C.↗

High-Performance Computing Optimization for Aladyn – Adaptive Neural Network Molecular Dynamics Mini-Application

This report provides a description and performance evaluation of the optimization techniques for high performance computing (HPC) implementation of the open source Computational Materials mini-application Aladyn (https://github.com/nasa/aladyn). Aladyn is a basic molecular dynamics code written in FORTRAN 2003, which is designed to demonstrate the use of adaptive neural networks (ANNs) in atomistic simulations. The role of ANNs is to efficiently reproduce the very complex energy landscape resulting from the atomic interactions in materials with the accuracy of the more expensive quantum mechanics-based calculations. The ANN is trained on a large set of atomic structures calculated using the density functional theory (DFT) method. While achieving orders of magnitude faster computational performance than DFT, the ANN-based approach was still very computationally demanding compared to the conventional approach of using empirically fitted energy functions. After its initial development, Aladyn was evaluated and optimized by experts at the NASA Advanced Supercomputing (NAS) division to exploit modern supercomputer architectures. The code has been optimized for execution on multicore central processing units (CPUs), including Intel® Skylake microarchitecture, and on graphic accelerators, such as Nvidia® V100 graphic processing units (GPUs), using Open Multi-Processing (OpenMP) and Open Accelerators (OpenACC) programming interfaces. The optimization achieved a speedup of 4.7 times the baseline version on CPU performance and an additional 2.4 times on CPU+GPU performance. Atomistic computer simulations are a fundamental tool in materials research to model material properties form physics-based first principles. Atomic interaction, governed by Quantum Mechanics (QM) require sophisticated and highly computationally demanding mathematical models to calculate [1]. Classical methods use approximate functional forms, empirically fitted through a set of variable parameters to emulate atomic energies as direct functions of atomic coordinates [2]. While empirical potentials are computationally much simpler, allowing simulations of large-scale systems of up to a trillion (1012) atoms [3], they are substantially less accurate compared to quantum calculations and applicable only to very specific atomic configurations or predefined crystallographic phases. A recently suggested approach is to use heuristic machine learning methods [4], such as those based on Adaptive Neural Networks (ANNs) to predict atomic energies, after being trained on a sufficiently large database of QM-calculated structures [5,6]. This approach reduces significantly the computational complexity, allowing for simulations of orders of magnitude larger systems compared to QM-based methods without compromising accuracy. Still, compared to classical methods using empirical energy functions, ANN methods remain two- to three orders of magnitude more computationally demanding. Hence, the computational cost of simulations, together with the need for extensive training of ANNs, still makes the practical implementation of ANN-based methods quite challenging. The purpose of the Aladyn mini-application software [7], available as open source at https://github.com/nasa/aladyn, is to be a testbed for exploring possible optimization strategies to develop highly scalable parallel algorithms for ANN-based atomistic simulations. Aladyn is aimed at utilizing the architecture of the high-end modern highperformance computing (HPC) hardware based on multicore central processing units (CPUs) equipped with graphic processing unit (GPU) accelerators. Specifically, the goal is to optimize the performance on a single HPC compute node, before implementing scaling to multi-node parallelization using message passing interface (MPI). At the same time, the open source code of Aladyn can serve as a training model for students and professors in academia.

Yamakov, Vesselin I.↗

Spaceflight Effects on Neurocognitive Performance: Extent, Longevity and Neural Bases

We are conducting ongoing experiments in which we are performing structural and functional magnetic resonance brain imaging to identify the relationships between changes in neurocognitive function and neural structural alterations following a six month International Space Station mission. Our central hypothesis is that measures of brain structure, function, and network integrity will change from pre to post spaceflight. Moreover, we predict that these changes will correlate with indices of cognitive, sensory, and motor function in a neuroanatomically selective fashion. Our interdisciplinary approach utilizes cutting edge neuroimaging techniques and a broad ranging battery of sensory, motor, and cognitive assessments that are conducted pre flight, during flight, and post flight to investigate potential neuroplastic and maladaptive brain changes in crewmembers following long-duration spaceflight. Success in this endeavor would 1) result in identification of the underlying neural mechanisms and operational risks of spaceflight-induced changes in behavior, and 2) identify whether a return to normative behavioral function following re-adaptation to Earth's gravitational environment is associated with a restitution of brain structure and function or instead is supported by substitution with compensatory brain processes. We have collected data on several crewmembers and preliminary findings will be presented. Eventual comparison to results from our parallel bed rest study will enable us to parse out the multiple mechanisms contributing to any spaceflight-induced neural structural and behavioral changes that we observe.

Seidler, R. D.↗

Ensembles of radial basis function networks for spectroscopic detection of cervical precancer

The mortality related to cervical cancer can be substantially reduced through early detection and treatment. However, current detection techniques, such as Pap smear and colposcopy, fail to achieve a concurrently high sensitivity and specificity. In vivo fluorescence spectroscopy is a technique which quickly, noninvasively and quantitatively probes the biochemical and morphological changes that occur in precancerous tissue. A multivariate statistical algorithm was used to extract clinically useful information from tissue spectra acquired from 361 cervical sites from 95 patients at 337-, 380-, and 460-nm excitation wavelengths. The multivariate statistical analysis was also employed to reduce the number of fluorescence excitation-emission wavelength pairs required to discriminate healthy tissue samples from precancerous tissue samples. The use of connectionist methods such as multilayered perceptrons, radial basis function (RBF) networks, and ensembles of such networks was investigated. RBF ensemble algorithms based on fluorescence spectra potentially provide automated and near real-time implementation of precancer detection in the hands of nonexperts. The results are more reliable, direct, and accurate than those achieved by either human experts or multivariate statistical algorithms.

Cervix Neoplasms/pathology↗

Optical information processing for NASA's space exploration

The development status of optical processing techniques under development at NASA-JPL, NASA-Ames, and NASA-Johnson, is evaluated with a view to their potential applications in future NASA planetary exploration missions. It is projected that such optical processing systems can yield major reductions in mass, volume, and power requirements relative to exclusively electronic systems of comparable processing capabilities. Attention is given to high-order neural networks for distortion-invariant classification and pattern recognition, multispectral imaging using an acoustooptic tunable filter, and an optical matrix processor for control problems.

Chao, Tien-Hsin↗

Concept, Simulation, and Instrumentation for Radiometric Inflight Icing Detection

The multi-agency Flight in Icing Remote Sensing Team (FIRST), a consortium of the National Aeronautics and Space Administration (NASA), the Federal Aviation Administration (FAA), the National Center for Atmospheric Research (NCAR), the National Oceanographic and Atmospheric Administration (NOAA), and the Army Corps of Engineers (USACE), has developed technologies for remotely detecting hazardous inflight icing conditions. The USACE Cold Regions Research and Engineering Laboratory (CRREL) assessed the potential of onboard passive microwave radiometers for remotely detecting icing conditions ahead of aircraft. The dual wavelength system differences the brightness temperature of Space and clouds, with greater differences potentially indicating closer and higher magnitude cloud liquid water content (LWC). The Air Force RADiative TRANsfer model (RADTRAN) was enhanced to assess the flight track sensing concept, and a 'flying' RADTRAN was developed to simulate a radiometer system flying through simulated clouds. Neural network techniques were developed to invert brightness temperatures and obtain integrated cloud liquid water. In addition, a dual wavelength Direct-Detection Polarimeter Radiometer (DDPR) system was built for detecting hazardous drizzle drops. This paper reviews technology development to date and addresses initial polarimeter performance.

Ryerson, Charles↗

Sub-problem Optimization With Regression and Neural Network Approximators

Design optimization of large systems can be attempted through a sub-problem strategy. In this strategy, the original problem is divided into a number of smaller problems that are clustered together to obtain a sequence of sub-problems. Solution to the large problem is attempted iteratively through repeated solutions to the modest sub-problems. This strategy is applicable to structures and to multidisciplinary systems. For structures, clustering the substructures generates the sequence of sub-problems. For a multidisciplinary system, individual disciplines, accounting for coupling, can be considered as sub-problems. A sub-problem, if required, can be further broken down to accommodate sub-disciplines. The sub-problem strategy is being implemented into the NASA design optimization test bed, referred to as "CometBoards." Neural network and regression approximators are employed for reanalysis and sensitivity analysis calculations at the sub-problem level. The strategy has been implemented in sequential as well as parallel computational environments. This strategy, which attempts to alleviate algorithmic and reanalysis deficiencies, has the potential to become a powerful design tool. However, several issues have to be addressed before its full potential can be harnessed. This paper illustrates the strategy and addresses some issues.

Guptill, James D.↗

Objectively Identifying Transverse Cirrus Bands in Tropical Cyclones using a Convolutional Neural Network

Transverse cirrus bands (TCBs) are a phenomenon that occurs in many mesoscale and synoptic weather systems, including tropical cyclones. TCBs are defined as "Bands of clouds oriented perpendicular to the flow in which they are embedded" (NOAA) and can be associated with low static stability and high environmental vertical wind shear in the upper levels (Kawashima 2021). TCBs in tropical cyclones are of particular interest due to their apparent occurrence and potential linkage to the tropical cyclone diurnal cycle, stronger tropical cyclones, and rapid intensification, where rapid intensification is an intensification rate of 30 knots or more in 24 hours (NHC).

John Mark Mayhall↗

Advanced Design Methodology for Robust Aircraft Sizing and Synthesis

Contract efforts are focused on refining the Robust Design Methodology for Conceptual Aircraft Design. Robust Design Simulation (RDS) was developed earlier as a potential solution to the need to do rapid trade-offs while accounting for risk, conflict, and uncertainty. The core of the simulation revolved around Response Surface Equations as approximations of bounded design spaces. An ongoing investigation is concerned with the advantages of using Neural Networks in conceptual design. Thought was also given to the development of systematic way to choose or create a baseline configuration based on specific mission requirements. Expert system was developed, which selects aerodynamics, performance and weights model from several configurations based on the user's mission requirements for subsonic civil transport. The research has also resulted in a step-by-step illustration on how to use the AMV method for distribution generation and the search for robust design solutions to multivariate constrained problems.

Mavris, Dimitri N.↗

Utilizing Ion-Mobility Data to Estimate Molecular Masses

A method is being developed for utilizing readings of an ion-mobility spectrometer (IMS) to estimate molecular masses of ions that have passed through the spectrometer. The method involves the use of (1) some feature-based descriptors of structures of molecules of interest and (2) reduced ion mobilities calculated from IMS readings as inputs to (3) a neural network. This development is part of a larger effort to enable the use of IMSs as relatively inexpensive, robust, lightweight instruments to identify, via molecular masses, individual compounds or groups of compounds (especially organic compounds) that may be present in specific environments or samples. Potential applications include detection of organic molecules as signs of life on remote planets, modeling and detection of biochemicals of interest in the pharmaceutical and agricultural industries, and detection of chemical and biological hazards in industrial, homeland-security, and industrial settings.

Duong, Tuan↗

Presound: UAV Diagnostic System Enabled by Vibration-Based Machine Learning

A low-weight, inexpensive small unmanned aerial system (sUAS) that takes off, performs a mission, lands, and safely stows and recharges itself has myriad future applications ranging from agricultural imaging to last-mile package delivery. Likewise, Urban Air Mobility (UAM) systems will enable people to take air taxis from point to point in cities, rapidly moving commuters long distances without concern for road traffic and congestion. Fully electric aviation systems will be cleaner and quieter than ground transport. Cities could eliminate cars and buses, and convert roads to higher capacity bike and pedestrian throughways. Yet, for sUAS as well as UAM, system reliability and assurance is a limiting factor to deploying affordable autonomous flight systems. For this bright future of aviation to be realized, aircraft must be able to autonomously and accurately self-diagnose health issues both before takeoff and during flight. The GreenSight PreSound system is designed to identify defects on aircraft through intelligent analysis of vibration. It accomplishes this by measuring structural vibrations induced by the vehicle’s own propellers, and analyzing that data using a machine learning model that determines whether a defect is present. The PreSound system is designed to require no human oversight, and to operate across a wide array of vehicles through re-training of the model for each target aircraft. PreSound has been developed and seen limited early success using data collected from the GreenSight Dreamer sUAS, a 5lb quadrotor vehicle designed for aerial imaging applications. The final detection model, trained on data with props spinning at 50% throttle, achieves excellent performance with over 99% average accuracy in detecting blade damage using a single FFT vector input. It demonstrates the ability to generalize to new types of blade damage, correctly classifying a different type of blade damage with 98% accuracy. Full test pulses were classified with 100% accuracy, and in live testing, all sets of data during blade movement were classified accurately with over 95% confidence. When trained on in-flight data, the same model achieves an average accuracy of 85% in distinguishing between undamaged and blade-damaged states in flight. The authors believe that these accuracies show significant potential of this approach to expand unmanned flight safety, with significant potential benefits in accelerating Advanced Aerial Mobility (AAM) and UAM aviation applications.

UAS↗

Inverse Text Normalization of Air Traffic Control System Command Center Planning Telecon Transcriptions

We present a hybrid neural network and rule-based Inverse Text Normalization (ITN) method for domains containing unique technical phraseology, specifically Air Traffic Control System Command Center (ATCSCC) planning telecon audio transcriptions. The ATCSCC hosts bi-hourly planning telephone conferences (or planning telecons) to ensure smooth operations within the National Airspace (NAS). Access to both live and post meeting transcripts of this speech audio would enable quick review of meetings. Provided speech transcripts, ITN is the process of converting unformatted raw Automated Speaker Recognition (ASR) model transcripts into a human (expert) readable written form. Our hybrid ITN framework utilizes a fine-tuned Bidirectional Encoder Representations from Transformers neural network to format conversational English, and rule-based methods to format domain-specific aviation text. With an overall Punctuation Error Rate (PER) of 25.56 and Word Error Rate with Punctuation and Capitalization (WER PC) of 5.47, we show that this method has vast potential in being applied to ATCSCC planning telecon audio and other audio/text based data available in ATM.

ATM↗

Inverse Text Normalization of Air Traffic Control System Command Center Planning Telecon Transcriptions

We present a hybrid neural network and rule-based Inverse Text Normalization (ITN) method for domains containing unique technical phraseology, specifically Air Traffic Control System Command Center (ATCSCC) planning telecon audio transcriptions. The ATCSCC hosts bi-hourly planning telephone conferences (or planning telecons) to ensure smooth operations within the National Airspace (NAS). Access to both live and post meeting transcripts of this speech audio would enable quick review of meetings. Provided speech transcripts, ITN is the process of converting unformatted raw Automated Speaker Recognition (ASR) model transcripts into a human (expert) readable written form. Our hybrid ITN framework utilizes a fine-tuned Bidirectional Encoder Representations from Transformers neural network to format conversational English, and rule-based methods to format domain-specific aviation text. With an overall Punctuation Error Rate (PER) of 25.56 and Word Error Rate with Punctuation and Capitalization (WER PC) of 5.47, we show that this method has vast potential in being applied to ATCSCC planning telecon audio and other audio/text based data available in ATM.

ATM↗

Intelligent Control for the BEES Flyer

This paper describes the effort to provide a preliminary capability analysis and a neural network based adaptive flight control system for the JPL-led BEES aircraft project. The BEES flyer was envisioned to be a small, autonomous platform with sensing and control systems mimicking those of biological systems for the purpose of scientific exploration on the surface of Mars. The platform is physically tightly constrained by the necessity of efficient packing within rockets for the trip to Mars. Given the physical constraints, the system is not an ideal configuration for aerodynamics or stability and control. The objectives of this effort are to evaluate the aerodynamics characteristics of the existing design, to make recommendaaons as to potential improvements and to provide a control system that stabilizes the existing aircraft for nominal flight and damaged conditions. Towards this several questions are raised and analyses are presented to arrive at answers to some of the questions raised. CART3D, a high-fidelity inviscid analysis package for conceptual and preliminary aerodynamic design, was used to compute a parametric set of solutions over the expected flight domain. Stability and control derivatives were extracted from the database and integrated with the neural flight control system. The Integrated Vehicle Modeling Environment (IVME) was also used for estimating aircraft geometric, inertial, and aerodynamic characteristics. A generic neural flight control system is used to provide adaptive control without the requirement for extensive gain scheduling or explicit system identification. The neural flight control system uses reference models to specify desired handling qualities in the roll, pitch, and yaw axes, and incorporates both pre-trained and on-line learning neural networks in the inverse model portion of the controller. Results are presented for the BEES aircraft in the subsonic regime for terrestrial and Martian environments.

Krishnakumar, K.↗

The Effects of Long Duration Head Down Tilt Bed Rest on Neurocognitive Performance: The Effects of Exercise Interventions

We are conducting ongoing experiments in which we are performing structural and functional magnetic resonance brain imaging to identify the relationships between changes in neurocognitive function and neural structural alterations following a six month International Space Station mission and following 70 days exposure to a spaceflight analog, head down tilt bedrest. Our central hypothesis is that measures of brain structure, function, and network integrity will change from pre to post intervention (spaceflight, bedrest). Moreover, we predict that these changes will correlate with indices of cognitive, sensory, and motor function in a neuroanatomically selective fashion. Our interdisciplinary approach utilizes cutting edge neuroimaging techniques and a broad ranging battery of sensory, motor, and cognitive assessments that will be conducted pre flight, during flight, and post flight to investigate potential neuroplastic and maladaptive brain changes in crewmembers following long-duration spaceflight. Success in this endeavor would 1) result in identification of the underlying neural mechanisms and operational risks of spaceflight-induced changes in behavior, and 2) identify whether a return to normative behavioral function following re-adaptation to Earth's gravitational environment is associated with a restitution of brain structure and function or instead is supported by substitution with compensatory brain processes. Our ongoing bed rest participants are also engaging in exercise studies directed by Dr. Lori Ploutz Snyder. In this presentation, I will briefly highlight the existing literature linking exercise and fitness to brain and behavioral functions. I will also overview the metrics from my study that could be investigated in relation to the exercise and control subgroups.

Seidler, R. D.↗