SEARCH · Search NASA
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
This presentation applies open set recognition to classify unknown waveforms, enabling systems to not only identify known types but also reliably detect when waveforms fall outside the training distribution. This approach enhances robustness by avoiding forced misclassification of novel or anomalous signals.
We developed multiple machine learning methods for the detection and classification of new wireless communication waveforms, which is critical for targeted attacks in wireless networks and electronic warfare. Our machine learning models are capable of dynamically detecting security threats in near real time through our advanced open set recognition (OSR) approach. This model has demonstrated significant improvements in the detection of unknown waveforms, thereby enhancing the security and reliability of mission critical communications. Our approach to detecting uncertain security threats is novel; we advanced OSR techniques by incorporating domain knowledge of wireless signals. Specifically, we combined time and frequency domain model features to enhance the model’s performance. Utilizing an OSR approach eliminates the need for training data to be distributed similarly to the deployment environment and removes the requirement for the training set to contains all possible threat classes. This is crucial because it is often infeasible to determine and characterize all potential security threats in advance. Our model were trained on simulated data, generated in partnership with the University at Albany, State of New York. The data set contained a diverse array of wireless signals, including those with additive white Gaussian noise and multipath signals, with and without line of sight. This comprehensive training set allowed us to optimize our models to detect unknown waveforms under various challenging scenarios, such as low signal-to-noise ratios. By training on various waveforms, varying signal-to-noise ratio, and different sample sizes under normal conditions, our models were fine tuned to perform effectively in challenging environments.
Identifying unseen electromagnetic waveforms is critical for many applications, like interference management, electronic warfare and spectrum management. Traditionally this is done using statistical methods for anomaly detection, which has evolved to deep learning models for identifying the unseen data, formally termed as open set recognition. Some prior methods use a generative model to emulate open set data, which face challenges in generating synthetic samples for open set while simultaneously selecting an optimal discriminator for accurate classification. To alleviate this issue, we propose a discriminative model that effectively combines time and frequency domain features of communication signals for accurate predictions. We further introduce a cosine similarity loss that makes the domain specific features unique to enhance the prediction rate. Additionally, our model avoids generic feature vectors by extracting class-specific features during training, resulting in improved class representation. The experiment results show that this combined feature approach with cosine loss outperforms single-domain models and improves accuracy by 10% over models without cosine loss.
Detection of unknown waveforms in mission-critical communications is a crucial area of interest for the Department of Energy (DoE). Traditional methods and recent deep learning-based approaches often assume that the training set includes all possible classes, which is impractical for detecting new waveforms. This limitation gives rise to the problem of open-set recognition (OSR), which involves correctly identifying known classes while detecting and rejecting unknown or unseen classes. To address this limitation, we propose a novel dual-domain complex-valued neural architecture that jointly processes time-domain and frequency-domain signal representations using transformer mechanisms. A transformer model is a deep learning architecture that uses self-attention mechanisms to process and learn relationships in sequential data. Our model employs a cosine similarity loss to extract domain-specific features and incorporates a transformer architecture in the latent space to weigh the importance of different features from the time and frequency domains. The transformer layer includes stacked self-attention and cross-attention modules to learn intra-domain and inter-domain dependencies, creating a more holistic signal representation. An attention-based fusion module intelligently combines the time and frequency-domain features using multi-head attention, enabling the network to learn the optimal feature for each domain in each input signal. Quantitative results demonstrate the impact of these architectural choices on overall performance, showing significant improvement after incorporating self and cross-attention modules and using complex attention fusion over simple weighted fusion. Our ongoing work will focus on addressing the limitations of threshold-based OSR methods by developing a novel generative framework that integrates a conditional diffusion probabilistic model (DPM). DPM is a generative framework that learns to synthesize complex data by reversing a gradual noising process using a neural network trained to denoise step-by-step. Our goal is to leverage the inherent strengths of DPMs for identifying unknown signals more robustly. One primary advantage of using a DPM is its ability to provide a more reliable anomaly score based on the model's reconstruction error, rather than relying solely on classifier confidence. Additionally, the iterative denoising process of DPMs makes this approach naturally resilient to low Signal-to-Noise Ratio (SNR) conditions, where traditional methods often fail. By implementing this generative framework, we aim to enhance the model's capability to accurately detect unknown waveforms and maintain performance in challenging environments.
In real-world applications like spectrum management and interference detection, dealing with unseen electromagnetic waveforms is critical. Although some methods attempt to simulate open set data using generator models, they face challenges in generating synthetic samples for open set while simultaneously selecting an optimal discriminator for accurate classification. This results in difficulties capturing distinctive features across classes, especially in dynamic scenarios where new classes emerge. To detect unseen waveforms, we propose combining time and frequency domain features with cosine similarity loss to enhance feature distinctiveness and enabling more accurate predictions. This approach efficiently captures more comprehensive information than single-domain representations or approaches without cosine loss. Additionally, our model avoids generic feature vectors by extracting class-specific features during training, resulting in improved class representation. The experiment results show that this combined feature approach with cosine loss outperforms single-domain models and improves accuracy by 10\% over models without cosine loss.
Deep Learning based classification techniques have shown excellent performance in static environments, where the training and testing samples are drawn from the same distribution. However, real world scenarios often present samples that do not belong to the known set of classes chosen during training. This is quite common for electromagnetic signals, where it is impractical to assume that all possible waveforms are known a-priori, specially in scenarios like warfare. To address this problem, we propose a deep learning based adversarial model where the generator learns to generate waveform features that can deceive the discriminator model as true samples. We introduce domain knowledge of wireless signals by decomposing the signal into a lower dimensional unique feature set, which is used for classifying known versus unknown signals. We further introduce multiple domain representations of the signal to extract features and combine them together to accurately classify new waveforms as an unknown class. Our results show that combined features from multiple domains outperform any single domain representation, especially at low SNR regimes with fewer number of samples to classify.
Deep Learning based classification techniques have shown excellent performance in static environments, where the training and testing samples are drawn from the same distribution. However, real world scenarios often present samples that do not belong to the known set of classes chosen during training. This is quite common for electromagnetic signals, where it is impractical to assume that all possible waveforms are known a-priori, specially in scenarios like warfare. To address this problem, we propose a deep learning based adversarial model where the generator learns to generate waveform features that can deceive the discriminator model as true samples. We introduce domain knowledge of wireless signals by decomposing the signal into a lower dimensional unique feature set, which is used for classifying known versus unknown signals. We further introduce multiple domain representations of the signal to extract features and combine them together to accurately classify new waveforms as an unknown class. Our results show that combined features from multiple domains outperform any single domain representation, especially at low SNR regimes with fewer number of samples to classify.
Nanostructures for Electrical Energy Storage (NEES, www.efrc.umd.edu) was an Energy Frontier Research Center supported by the DOE Office of Science, Basic Energy Sciences, from 8/1/2009 to 7/31/2020. Led by the University of Maryland, NEES enjoyed extensive collaborations with its funded partners, including two DOE Laboratories and six universities. The NEES vision has been to reveal a set of scientific insights and design principles that can underpin a next-generation electrical energy storage approach, building on advances in nanoscale science and technology to achieve simultaneous high power and high energy over extended charge/discharge cycling. The vision is motivated by the recognition that scaling into the nano regime opens the door to new physical phenomena and that the tools enlisted in nanoscale research provide major new opportunities for the synthesis not only of materials at molecular scale but for structures at nano scale and above. NEES has translated this vision into its research program based on two observations. First, while the behavior of ions and electrons in electrolytes and in electrode materials is crucial to electrical energy storage (or more appropriately electrochemical energy storage), it is the transport of ion and electron charge between different structural components of a storage device that ultimately determine its performance. With it well recognized that the choice of electrode materials typically constrain ion transport kinetics as well as maximum ion concentration, the search for better electrode materials has been a primary driver of battery research. At the same time the synthesis of electrodes is typically based on aggregation of particles with varying size, shape, and orientation in the electrode. Together with the presence of additional materials to impart electrical conductivity and cohesion to the composite electrode, change in electrode materials is necessarily accompanied by structural changes at the nano/micro scale that are difficult to categorize and manage. From the beginning, NEES’ vision has been to create and study simpler, highly controlled spatial arrangements of known materials as battery components (electrodes, current collectors, and electrolyte) and to understand how design and structure above the molecular scale determines the energy storage performance available from known materials. Second, advances in nanoscience dramatically expanded the portfolio of synthesis methods, structural motifs, and new phenomena available for research. Some of these gave rapid access to new building blocks at the deep nanoscale (e.g., carbon nanotubes grown by self-assembly, nanoscale arrays formed by electrochemical self-alignment, monolayer films controlled by self-limiting reaction). Such advances served as the enabler for the NEES vision to be pursued experimentally through study of 3D structures created and controlled at the nano, micro, and meso scales. Here, we use meso as in the BES MESO Report, implying not only intermediate or varying length scales, but very much the way behavior is influenced by other factors including aggregation of nanocomponents at different densities and spatial configurations, statistical variations in the aggregates, hierarchical architectures in which they can be assembled, or local 3D configurations that result from the architectures. Over its life cycle, NEES has pursued two overarching goals: (1) to understand the scientific fundamentals of electrochemical storage from the nanoscale to the mesoscale; and (2) to create and learn from innovative, controlled, heterogeneous nanostructures, where such nanostructures can enable the first goal and serve as models for future paradigms in energy storage. Specific goals have included: Synthesize heterogeneous nanostructures comprised of multiple materials arranged in controlled fashion and characterize their behavior; Demonstrate and elucidate design principles for achieving simultaneous high power and high energy; Develop materials processes which enable precision control of thin layers and 3D structures; Investigate the impact of artificial interphases on electrode stability during ion insertion/deinsertion; Create dense arrays of nanostructures to understand how the architecture of these assemblies, along with nanostructure design, influences energy storage behavior at the mesoscale; Identify and understand the consequences of nanoconfinement and local inhomogeneities in 3D mesoscale arrays; Develop and apply computational models to stimulate, guide and interpret experiments.
This paper develops a conceptual model, adapted from the way research and development non-profits and universities tend to be organized, that could help amplify the reach and effectiveness of the international space architecture community. The model accommodates current activities and published positions, and increases involvement by allocating accountability for necessary professional and administrative activities. It coordinates messaging and other outreach functions to improve brand management. It increases sustainability by balancing volunteer workload. And it provides an open-ended structure that can be modified gracefully as needs, focus, and context evolve. Over the past 20 years, Space Architecture has attained some early signs of legitimacy as a discipline: an active, global community of practicing and publishing professionals; university degree programs; a draft undergraduate curriculum; and formal committee establishment within multiple professional organizations. However, the nascent field has few outlets for expression in built architecture, which exacerbates other challenges the field is experiencing in adolescence: obtaining recognition and inclusion as a unique contributor by the established aerospace profession; organizing and managing outreach by volunteers; striking a balance between setting admittance or performance credentials and attaining a critical mass of members; and knowing what to do, beyond sharing common interests, to actually increase the market demand for space architecture. This paper develops a conceptual model, adapted from the way research-anddevelopment non-profits and universities tend to be organized, that could help amplify the reach and effectiveness of the international space architecture community. The model accommodates current activities and published positions, and increases involvement by allocating accountability for necessary professional and administrative activities. It coordinates messaging and other outreach functions to improve brand management. It increases sustainability by balancing volunteer workload. And it provides an open-ended structure that can be modified gracefully as needs, focus, and context evolve. This organizational model is offered up for consideration, debate, and toughening by the space architecture community at large.
The Machine Learning for Correlated Intelligence Laboratory Directed Research & Development (LDRD) Project explored competing a variety of machine learning (ML) classification techniques against a known, open source dataset through the use of a rapid and automated algorithm research & development (RD) infrastructure. This approach relied heavily on creating an infrastructure in which to provide a pipeline for automatic target recognition (ATR) ML algorithm competition. Results are presented for nine ML classifiers against a primary dataset using the pipeline infrastructure developed for this project. New approaches to feature set extraction are presented and discussed as well.
The dataset is comprised of both real and synthetic images from a vehicle's forward-facing camera. Each camera image is accompanied by a corresponding pixel-level semantic segmentation image (all files are .png files). In total, the dataset contains 5600 images in the training/validation set and 1400 images in the testing set. The training dataset contains mostly synthetic RGB images collected with a wide range of weather and lighting conditions using the CARLA simulator [1]. In addition, the training data also includes a small pre-selected subset of data from the Cityscapes training dataset – which is comprised of RGB-segmentation image pairs from driving scenarios in various European cities [2]. The testing data is split into three sets. The first set contains synthetic CARLA images with weather/lighting conditions that were not present in the training set. The second set is a subset of the Cityscapes testing dataset. Finally, the third set is an unknown testing set which will not be revealed to the participants until after the submission deadline. [1] Dosovitskiy, A., Ros, G., Codevilla, F., Lopez, A., and Koltun, V. (2017, October). CARLA: An open urban driving simulator. In Conference on robot learning (pp. 1-16). PMLR. [2] Cordts, M., Omran, M., Ramos, S., Rehfeld, T., Enzweiler, M., Benenson, R., ... and Schiele, B. (2016). The cityscapes dataset for semantic urban scene understanding. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 3213-3223).
Named entity recognition (NER) has been widely used in chemical text mining for the automatic identification and extraction of chemical entities. However, existing chemical NER systems primarily focus on scenarios with abundant training data, requiring significant human effort on annotations. This poses challenges for applications in the chemical field, such as catalysis, where many advancements have traditionally relied on trial-and-error investigations and incremental adjustment of variables. This hinders catalysis science and technology progress in addressing emerging energy and environmental crises. In this work, we propose a few-shot NER model that can quickly adapt to extract new types of chemical entities by using only a limited number of annotated examples. Our model employs a metric-learning approach to transfer entity similarity knowledge from high-resource chemical domains (with abundant annotations) to enable effective entity recognition in low-resource specialized domains (limited annotation). We validate the effectiveness of our model on a few-shot chemical NER benchmark built based on six existing chemical NER data sets. Experiments show that the proposed few-shot NER model can achieve reasonable performance with only 5 examples per entity type and shows consistent improvement as the number of examples increases. Furthermore, we demonstrate how the proposed model can be trained with large language model (LLM) annotated data, opening a new pathway for rapid adaptation of NER systems. Furthermore, our approach leverages the knowledge broadness of large language models for chemistry while distilling this knowledge into a lightweight model suitable for efficient and in-house use.
Abstract The permeability of complex porous materials is of interest to many engineering disciplines. This quantity can be obtained via direct flow simulation, which provides the most accurate results, but is very computationally expensive. In particular, the simulation convergence time scales poorly as the simulation domains become less porous or more heterogeneous. Semi-analytical models that rely on averaged structural properties (i.e., porosity and tortuosity) have been proposed, but these features only partly summarize the domain, resulting in limited applicability. On the other hand, data-driven machine learning approaches have shown great promise for building more general models by virtue of accounting for the spatial arrangement of the domains’ solid boundaries. However, prior approaches building on the convolutional neural network (ConvNet) literature concerning 2D image recognition problems do not scale well to the large 3D domains required to obtain a representative elementary volume (REV). As such, most prior work focused on homogeneous samples, where a small REV entails that the global nature of fluid flow could be mostly neglected, and accordingly, the memory bottleneck of addressing 3D domains with ConvNets was side-stepped. Therefore, important geometries such as fractures and vuggy domains could not be modeled properly. In this work, we address this limitation with a general multiscale deep learning model that is able to learn from porous media simulation data. By using a coupled set of neural networks that view the domain on different scales, we enable the evaluation of large ( $$>512^3$$ > 512 3 ) images in approximately one second on a single graphics processing unit. This model architecture opens up the possibility of modeling domain sizes that would not be feasible using traditional direct simulation tools on a desktop computer. We validate our method with a laminar fluid flow case using vuggy samples and fractures. As a result of viewing the entire domain at once, our model is able to perform accurate prediction on domains exhibiting a large degree of heterogeneity. We expect the methodology to be applicable to many other transport problems where complex geometries play a central role.
As efforts of the National Aeronautics and Space Administration (NASA) and the Federal Aviation Administration (FAA) continue to digitize the air traffic management (ATM) domain, there is countless times of need for downstream natural language processing (NLP) tasks such as named entity recognition, text summarization, classification, and more. Although there are a plethora of open-sourced pre-trained transformer models in the NLP field such as BERT, RoBERTa, XLNet, and GPT-3, these models are trained on general corpora and perform poorly on domain-specific terminology and phraseology seen in ATM documents such as Notice to Airmen (NOTAMs) and Letters of Agreement (LoA). Our proposed research objective will be to first gather a large corpus of air traffic management related documents, orders, notices, books, technical papers, conference papers, articles, and other miscellaneous sources of text data from the FAA, NASA, and accredited conference and publication societies. After gathering this data, many steps will have to be taken to collate and preprocess the data into a format understandable by our test transformer models. Thirdly, we will set up training pipelines to train the RoBERTa model on its unsupervised training task masked language modelling (MLM) using resources provided by the NASA Advanced Supercomputing (NAS) facilities. Finally, these fine-tuned transformer models will be evaluated on their performance on down-stream NLP tasks as mentioned above, to show whether they will be effective when working with ATM related data or not. Once complete, this model could be made open-sourced on the HuggingFace website, where the rest of the ATM community can access and utilize this tool.
The recent reorganization and shift to managing total quality at the NASA Langley Research Center (LaRC) has placed an increasing emphasis on teams and teamwork in accomplishing day-to-day work activities and long-term projects. The purpose of this research was to review the nature of teams and teamwork at LaRC. Models of team performance and teamwork guided the gathering of information. Current and former team members served as participants; their collective experience reflected membership in over 200 teams at LaRC. The participants responded to a survey of open-ended questions which assessed various aspects of teams and teamwork. The participants also met in a workshop to clarify and elaborate on their responses. The work accomplished by the teams ranged from high-level managerial decision making (e.g., developing plans for LaRC reorganization) to creating scientific proposals (e.g., describing spaceflight projects to be designed, sold, and built). Teams typically had nine members who remained together for six months. Member turnover was around 20 percent; this turnover was attributed to heavy loads of other work assignments and little formal recognition and reward for team membership. Team members usually shared a common and valued goal, but there was not a clear standard (except delivery of a document) for knowing when the goal was achieved. However, members viewed their teams as successful. A major factor in team success was the setting of explicit a priori rules for communication. Task interdependencies between members were not complex (e.g., sharing of meeting notes and ideas about issues), except between members of scientific teams (i.e., reliance on the expertise of others). Thus, coordination of activities usually involved scheduling and attendance of team meetings. The team leader was designated by the team's sponsor. This leader usually shared power and responsibilities with other members, such that team members established their own operating procedures for decision making. Sponsors followed a hands-off policy during team operations, but they approved and reviewed team products. Most teams, particularly high-level decision-making teams, had little or no authority to carry out their decisions. Team members had few interpersonal conflicts. They monitored each other respectfully about meeting deadlines. Feedback and backup behaviors were seen as desirable aspects of teamwork, wanted by the members, and done appropriately.
While geostationary satellites, such as the GOES-R series, provide wildland fire hotspot readings at a high temporal resolution, they are prone to false negative readings and decreased confidence. One cause of decreased hotspot confidence is cloud contamination. Smoke produced from wildfire is often misinterpreted as cloud contamination, resulting in inaccurate and unsure sensor readings. To this end, we built a deep learning image segmentation model to identify smoke and cloud in true color satellite images. The model is pre-trained using self-supervised learning on over 10,000 GOES-R images to learn the underlying structure of satellite imagery. Then, the model is fine-tuned on a set of 130 labeled documents using supervised learning. The resulting model performs multi-class image segmentation with 85% accuracy and runs in under a minute on a standard personal computer. When paired alongside hotspot data, the model’s outputs can help increase confidence in wildfire location by identifying cases of cloud contamination that are due to smoke. The resulting model can be deployed in a stand-alone application or bundled in an Open Data Integration for wildland fire management (ODIN) application.
Mycobacterium tuberculosis has evolved numerous type VII secretion (ESX) systems to secrete multiple factors important for both growth and virulence across their cell envelope. ESX-1, ESX-3, and ESX-5 systems have been shown to each secrete a distinct set of substrates, including PE and PPE families of proteins, named for conserved Pro-Glu and Pro-Pro-Glu motifs in their N termini. Proper secretion of the PE–PPE proteins requires the presence of EspG, with each system encoding its own unique copy. There is no cross-talk between any of the ESX systems, and how each EspG recognizes its subset of PE–PPE proteins is currently unknown. The only current structural characterization of PE–PPE–EspG heterotrimers is from the ESX-5 system. Here we present the crystal structure of the PE5 mt –PPE4 mt –EspG 3mm heterotrimer from the ESX-3 system. Our heterotrimer reveals that EspG 3mm interacts exclusively with PPE4 mt in a similar manner to EspG 5 , shielding the hydrophobic tip of PPE4 mt from solvent. The C-terminal helical domain of EspG 3mm is dynamic, alternating between “open” and “closed” forms, and this movement is likely functionally relevant in the unloading of PE–PPE heterodimers at the secretion machinery. In contrast to the previously solved ESX-5 heterotrimers, the PE–PPE heterodimer of our ESX-3 heterotrimer is interacting with its chaperone at a drastically different angle and presents different faces of the PPE protein to the chaperone. We conclude that the PPE–EspG interface from each ESX system has a unique shape complementarity that allows each EspG to discriminate among noncognate PE–PPE pairs.
Each of 12 subjects set a binocularly viewed target to apparent eye level; the target was projected on the rear wall of an open box, the floor of which was horizontal or pitched up and down at angles of 7.5 degrees and 15 degrees. Settings of the target were systematically biased by 60% of the pitch angle when the interior of the box was illuminated, but by only 5% when the interior of the box was darkened. Within-subjects variability of the settings was less under illuminated viewing conditions than in the dark, but was independent of box pitch angle. In a second experiment, 11 subjects were tested with an illuminated pitched box, yielding biases of 53% and 49% for binocular and monocular viewing conditions, respectively. The results are discussed in terms of individual and interactive effects of optical, gravitational, and extraretinal eye-position information in determining judgements of eye level.