Search NASA⌕ Search

SEARCH · Search NASA

Results for “scratch”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16

Open Innovation for a NASA Architecture Library

NASA’s Center of Excellence for Collaborative Innovation (CoECI) uses open innovation, or “crowdsourcing”, to access the global public to find ideas, concepts, designs, or solutions that meet a previously unmet need possibly resulting in significant advances in performance. The Center of Excellence for Collaborative Innovation was launched at the request of the White House Office of Science and Technology Policy. This is both a non-traditional method of innovation and a non-traditional method of outreach to the public to involve them in space technologies and programs. It has been used often for software development and new hardware technology. In this case we applied it to innovate with systems engineering tools for creating space architectures. The challenge was sponsored by NASA Engineering and Safety Center Systems Engineering Technical Fellow as part of a program for NASA’s adoption of MBSE. It was a trial to see if there would be as much participation or quality submissions with this more specialized topic and skill. The challenge sought space architecture representations and decompositions to create a library of modeled parts in a system modeling language (SysML). Mission architects mostly start from scratch to build model elements representing the functional and physical architecture of a system in SysML. There are a few beginning libraries, but these are also local to a program or group. A common library will save system engineers a large amount of time, will allow project stakeholders to recognize common graphics and quickly understand the architecture options. The challenge was promoted internationally, especially through professional organizations and universities with a systems engineering focus. It was open for 4 months, purposefully over the winter holiday break time to allow participants extra time outside of work or school. The challenge was designed so that expertise in space hardware was not necessary but getting to play with models of space architecture could provide motivation to participate. We did not receive as many entries as other broader outreach challenges, but the ones we received were extremely thorough and high quality. Solutions came from individuals and teams, students and professional consultants from the United States and Europe. We learned a few lessons about how to engage with the public and what characteristics of a problem result in good crowdsourcing results. The outreach challenge produced several useful ideas and modeled space elements, and the group will be engaging the winners to learn more about their new approaches.

innovation↗

The many faces of the Mars Sample Return mission architecture

The purpose of the Mars Sample Return mission would be to take advantage of the capability to study Mars to the level of detail only possible in Earth laboratories. This paper will attempt to summarize some of the Guidance and Control challenges, even if it succeeds in only scratching the surface.

Mattingly, Richard L.↗

Creating a Voyager Thermal Model 39 Years Into the Flight Mission, Along with Model Correlation and Application

After 39 years of continuous operation in space, the output of the Voyager 1 & 2 spacecraft RTG power systems has decreased to the point where managing the power margin and maintaining thermal control has become increasingly difficult. As the total power dissipation in the bus has decreased, propellant line temperatures and margin above minimum AFTs have decreased, creating risk of the hydrazine freezing (at 1.6°C). This is further complicated by the lack of existing thermal models that can be used to assess propellant tank and line temperatures. In 2014, an effort was begun to create a Voyager spacecraft thermal model for that purpose.A steady-state Thermal Desktop model has been created from scratch over the past two years. The initial thermal model development was started by Applied Sciences Laboratory (ASL) under contract to JPL. The effort relied primarily on archived manufacturing drawings, limited documentation, interviews of senior engineers who worked on the Voyager design and implementation, and the experience of the Voyager Flight Operations team.Data from the Voyager System Thermal Vacuum tests is no longer available, making it necessary to correlate the model to more recent flight data and small in-flight tests. Correlation was achieved to within ±5°C for a hot case and a cold case (both data sets from 2014). However, the flight system has very few temperature sensors directly on propellant lines. So the task remains to determine how best to use the model, in conjunction with flight data, to make sure the Voyagers can continue to fly successfully. How does one go about creating a thermal model for a spacecraft that is already launched, has limited existing mechanical description files, no thermal model in order to do a maneuver that was never planned when the spacecraft was designed?

Ledeboer, William C.↗

Creating a Voyager Thermal Model 39 Years Into the Flight Mission, Along With Model Correlation and Application

After 39 years of continuous operation in space, the output of the Voyager 1 & 2 spacecraft Radioisotope Thermoelectric Generator (RTG) power systems has decreased to the point where managing the power margin and maintaining thermal control has become increasingly difficult. As the total power dissipation in the bus has decreased, propellant line temperatures and margin above minimum Allowable Flight Temperature (AFT) have decreased, creating risk of the hydrazine freezing (at 1.6°C). This is further complicated by the lack of existing thermal models that can be used to assess propellant tank and line temperatures. In 2014, an effort was begun to create a Voyager spacecraft thermal model for that purpose. A steady-state Thermal Desktop model has been created from scratch over the past two years. Applied Sciences Laboratory (ASL) started the initial thermal model development under contract to Jet Propulsion Laboratory (JPL). The effort relied primarily on archived manufacturing drawings, limited documentation, interviews of senior engineers who worked on the Voyager design and implementation, and the experience of the Voyager Flight Operations team. Data from the Voyager System Thermal Vacuum (STV) tests is no longer available, making it necessary to correlate the model to more recent flight data and small in-flight tests. Correlation was achieved to within ±5°C for a hot case and a cold case (both data sets from 2014). However, the flight system has very few temperature sensors directly on propellant lines. Therefore, the task remains to determine how best to use the model, in conjunction with flight data, to make sure the Voyagers can continue to fly successfully.

Ledeboer, William C.↗

Applications of the Dynamic N-Dimensional K-Vector

The n-dimensional k-vector (NDKV) is an appealing alternative to binary tress for resolving complex queries in large relational databases. The method has excelled in several applications involving static databases. The present paper extends the theory supporting the NDKV to handle dynamic databases, where the data is updated frequently. This includes deleting records, adding new entries, or editing existing elements. The merit of this new version of the NDKV, the dynamic n-dimensional k-vector (DNDKV), is that it is no longer necessary to recompute the entire k-vector (the main structure that indexes the data) every time a record changes. The algorithm updates the four constituents of the standard NDKV on the fly: the database, sorted database, index, and k-vector tables. As a result, the DNDKV becomes comparable in terms of capabilities and flexibility to stateof-the-art storage engines relying on structured query languages (SQL). The performance of the DNDKV is assessed by running typical read/write operations on a database that contains millions of pre-computed missions to celestial bodies. This database requires frequent updates whenever an orbit solution is refined or new bodies are discovered. The DNDKV is faster than rebuilding the k-vector tables completely, provided that the number of elements being added or removed is not excessively large. Direct runtime comparisons with MySQL suggest that the DNDKV is several times faster for reading but might be slower for writing and updating the database. One limit of the technique is the elements being added must be within the range of the current k-vector tables. If this is not the case, the technique cannot be used and the k-vector tables must be rebuilt from scratch.

Mortari, Daniele↗

Onboard Hyperspectral Image Classification via Transfer Learning for Communication-Limited Spacecraft

Employing deep-learning and artificial-intelligence (AI) techniques onboard spacecraft can dramatically improve priority data selection to ensure more effective use of the available downlink. However, deployment of effective deep-learning models requires significant training on the ground, which may not be feasible, due to limited data available in an unexplored environment. Therefore, this research explores building robust classification models for onboard data processing where training data is highly limited using transfer-learning techniques. In this paper, we focus on the use case of hyperspectral imaging for remote sensing, a domain where the high dimensionality of the data from the sensor can rapidly saturate the downlink bandwidth. With this bottleneck, there is an impending need to autonomously and robustly classify data onboard to optimize downlink of high-impact measurements, thus maximizing the scientific utility per bit transmitted to the ground. This paper examines the use of deep neural networks onboard for hyperspectral image classification in a communication-limited scenario to analyze how the models perform with limited training data. The use of transfer learning can ameliorate the issue of poor generalization by transferring features learned from training on a large source dataset for one classification task to the target classification task with limited training data. For two deep-learning models from literature, we compare the accuracy of the models trained using transfer learning to models trained from scratch using a random weight initialization with varying amounts of training data. We demonstrate the feasibility and performance of running inference of the deep-learning models on representative flight-like hardware.

Advanced Avionics, Machine Learning, Data Processi↗

A Practical Guide to Writing a Radiative Transfer Code

Using our decades-long experience in radiative transfer (RT) code development for Earth science, we endeavor to reduce the knowledge gap of bringing RT from theory to code quickly. Despite numerous classic and recent literature, it is still hard to develop anRT code from scratch within a few weeks. It is equally hard to understand, not to mention modify, an existing “monster” RT code, for which the developer is either located remotely or has retired. Following the format of “Numerical Recipes” by Press et al., we collocate in this paper small pieces of necessary theory with corresponding small pieces of RT code. These are arranged in an order that is natural for code development, which is often opposite of the natural order for laying out the theoretical basis. We focus on the transfer of unpolarized monochromatic solar radiation in a plane-parallel atmosphere over a reflecting surface. Both the surface and the atmosphere are homogeneous (uniform) at all directions. The multiple scattering is numerically solved using the deterministic method of Gauss-Seidel iterations. Except for the presented Python-Numba open-source RT code gsit, the paper does not report any new scientific results, but rather serves as an academic demonstration. If development time is an issue or the reader is familiar with basic concepts of RT theory, we recommend proceeding directly to Sec.3 “RT code development.

multiple light scattering↗

Lean Model-Based Systems Engineering on the NASA High-Density Vertiplex Subproject

The High Density Vertiplex (HDV) subproject of NASA’s Advanced Air Mobility (AAM) project adopted Model-Based Systems Engineering (MBSE)in July of 2020, prior to subproject formulation. A small and lean team of HDV Systems Engineers(SE) are utilizing MagicDraw to execute NASA SE processes via MBSE. The SEs learned how to use MagicDraw from scratch and HDV is the first project for which the SEs have utilized MagicDraw. This paper will demonstrate project technical execution via MBSE, utilizing the digital elements built into the SysML (Systems Modeling Language). SysML provides a model-centric means of carrying out the NASA SE common technical processes by providing tools for complete system modeling, including requirements and interface management and design capture. The authors also leverage and extend SysML to perform other SE tasks, such as Verification and Validation (V&V)tracking. MBSE has two main purposes for HDV: 1) documenting the subproject’s logical architecture for distribution outside of the subproject, 2) capturing the subproject’s physical architecture in a single-source-of-truth for use by the subproject’s members. This paper details the challenges, lessons learned, and solutions that were encountered in implementing MBSE in the first iteration on a multi-iteration, full-lifecycle design, build, fly project.

Demetrios Katsaduros↗

Increasing accessibility to deep learning-based analytics for space biology: pretrained models, transfer learning, and analytics platform development

Biological systems react in complex ways to the stressors of spaceflight, and the data capturing these relationships is concomitantly high-dimensional and complex. Deep learning and machine learning approaches are increasingly popular as an analytical approach for space biosciences, due to their ability to model complex relationships in complex data. However, such approaches often require large datasets and extensive computational resources. New approaches that minimize data sizes and computational power needed to leverage machine learning, and resources that make these approaches accessible, are needed to increase accessibility and adoption of machine learning in the space biosciences. Transfer learning, in which a pretrained model of broad utility is trained on a large dataset, and subsequently reused on downstream applications for which data is more limited, is one approach to minimizing data and computational intensity of deep learning applications. This transfer learning approach results in more performant models in high-dimensional, low-sample-size settings such as space biology, as compared to training models on limited data from scratch. This presentation will outline efforts to generate pretrained models for the space biology community, and highlight transfer learning applications modeling microbial antibiotic resistance during spaceflight. Finally, in order to increase accessibility of these models and tools, as well as others, for the broader space biology community, we present a modeling and analysis platform facilitating machine learning applications in space biology. This platform streamlines machine learning training and analysis in a notebook format, facilitates download and use of space biology data from the NASA GeneLab database, and can be utilized on NASA-hosted servers or downloaded and hosted locally. This effort, as part of the AI4LS (Artificial Intelligence for Life in Space) working group, will increase accessibility, feasibility, and performance of machine learning approaches for the space biology community.

Adrienne Hoarfrost↗

Development of a Ground Multi-Mission Low-Cost Optical Terminal (LCOT) for Free-Space Optical Communications

Once confined to the realm of laboratory experiments and theoretical papers, space-based laser communications (lasercomm) are on the verge of achieving mainstream status. Organizations from Facebook to NASA, and missions from cubesats to Orion are employing lasercomm to achieve gigabit communication speeds at mass and power requirements lower than that of traditional radio frequency (RF) methods. Since first demonstrating free-space optical communications services with Lunar Laser Communications Demonstration (LLCD) in 2013, NASA has invested in developing optical communications technologies and capabilities to enhancing its space communications networks. Along with evolving optical space terminals, NASA is also developing lasercomm grounds stations capable of meeting the rapidly increasing data volume demands of upcoming missions, from low-earth to lunar orbits and beyond and integrating these advanced capabilities into its Near-Space and Deep Space Networks. To meet this emerging need, the Low-Cost Optical Terminal (LCOT) project at NASA’s Goddard Space Flight Center (GSFC) is designing, building and validating a prototype for a flexible, multi-mission, and economical optical ground terminal that could be used as a blueprint for a global network of optical ground stations, capable of supporting a wide variety of missions. To date a major impediment to widespread adoption of laser communication has been the lack of an existing ground network infrastructure. A mission that wishes to take advantage of laser communication not only needs to invest in an optical space terminal, but it must also finance the creation of ground terminals to receive the downlink signal. This adds significant additional cost. Missions that do decide to incur the cost of financing a network of ground terminals end up building highly specialized optical receivers that are operable as receivers for that specific mission only. Significant Non-Recurring Engineering (NRE) cost is invested to build highly specialized one-of-a-kind ground terminals that go into storage after that particular mission is over. This is not an economical approach and does nothing to grow the number of optical ground stations available to future missions. In essence each mission that wants to take advantage of the benefits of lasercom has to start from scratch to provide a ground terminal network to support it. As long as this is the case, the cost for using laser communications will be too high for most missions to consider. LCOT intends to close this gap in technology by designing and developing a standard optical ground terminal design that is flexible enough to serve as a receiver for a wide range of future missions – a ground terminal that can be quickly reconfigured to receive downlinks at different wavelengths using different signal formats. Not only does LCOT have the industry-building objectives of utilizing commercial-off-the-shelf (COTS) components to the maximum extent possible, but also spurs the commercial development of other necessary lasercomm components not currently offered by industry. Finally, LCOT will give NASA scientists and engineers a facility where they can gain real-world experience with optical communications. It will give engineers a cost-effective way to try out new concepts and processes by providing the infrastructure for such testing. In this way it is hoped LCOT will serve as a stimulus for innovation in optical communications and speed its widespread adoption by future missions. The LCOT is comprised of five subsystems: Free-Space Optical, Transceiver, Amplifier, Monitor and Control, and Observatory Infrastructure. In August 2021, the LCOT team installed a 70 cm telescope, developed by Planewave Instruments that was optimized for optical communications. Free-Space Optical subsystem comprises of the telescope and its associated hardware, including a transmitter optical assembly, wide field cameras, two optical benches, and an adaptive optics subsystem. The transmit optical assembly, a unique concept design, is a cluster of four functionally independent transmit subassemblies located on the receive telescope. In addition to receiving optical signals and directing the expanded beam with high precision to the space terminal, it also performs tracking functions. The transmit optical assembly will support operations from Low Earth Orbit (LEO) through lunar and will be used as a template for industry manufacturing. The Optical Infrastructure subsystem is responsible for providing environmentally controlled shelters for LCOT equipment and various other systems. To maintain the safety and proper functionality of the telescope, a 16 ft Astrohaven clamshell dome procured which provides all-sky coverage without the need to rotate the dome. Additionally, Atmospheric Monitoring Assembly (AMA) will be part of optical infrastructure subsystem to ensure accurate performance of the LCOT. Like existing optical ground stations, LCOT will measure standard weather station parameters, infrared all sky image of cloud cover, and cloud height. LCOT, however, adds requirements for measuring night time seeing and, in the future, daytime seeing. Unlike other optical ground terminals, the LCOT is transceiver agnostic; user transceivers may be duplex transceivers, standalone receivers, or standalone transmitters with or without acquisition beacon functionality. As such, the LCOT project accommodates testing with external customer transceivers in a flexible manor, further complimenting its intended multi-mission goals. Another unique component of LCOT is the use of a new amplifier technology – the Very Large Mode Area (VLMA) amplifiers. This new technology allows LCOT to avoid the issues faced by previous laser communications ground terminals, gives users more flexibility and modular capability, and is capable of reaching an order of magnitude higher peak power than traditional High Power Optical Amplifiers (HPOA). One drawback of the VLMA HPOA approach is that the amplified light is output into free-space. The solution developed by LCOT is an optics train that couples the output of the VLMA amplifier into a short fiber for transport to the transmit telescopes with high efficiency. Like many of the LCOT components, a set of detailed manufacturing drawings have been created for the optics train to allow any machine shop with a multi-axis Computer Numerical Control (CNC) machine to fabricate the piece parts from commonly available materials. In line with the goals of LCOT, the monitor and control functions are developed as a modular and flexible system with the ability to support future hardware or algorithm changes, minimizing disruptions. A main priority of development in the Monitor and Control Subsystem (MCS) is the safety monitor system.

laser communication↗

Development of a Ground Multi-mission Low Cost Optical Terminal(LCOT) for Free-Space Optical Communication

Once confined to the realm of laboratory experiments and theoretical papers, space-based laser communications (lasercomm) are on the verge of achieving mainstream status. Organizations from Facebook to NASA, and missions from cubesats to Orion are employing lasercomm to achieve gigabit communication speeds at mass and power requirements lower than that of traditional radio frequency (RF) methods. Since first demonstrating free-space optical communications services with Lunar Laser Communications Demonstration (LLCD) in 2013, NASA has invested in developing optical communications technologies and capabilities to enhancing its space communications networks. Along with evolving optical space terminals, NASA is also developing lasercomm grounds stations capable of meeting the rapidly increasing data volume demands of upcoming missions, from low-earth to lunar orbits and beyond and integrating these advanced capabilities into its Near-Space and Deep Space Networks. To meet this emerging need, the Low-Cost Optical Terminal (LCOT) project at NASA’s Goddard Space Flight Center (GSFC) is designing, building and validating a prototype for a flexible, multi-mission, and economical optical ground terminal that could be used as a blueprint for a global network of optical ground stations, capable of supporting a wide variety of missions. To date a major impediment to widespread adoption of laser communication has been the lack of an existing ground network infrastructure. A mission that wishes to take advantage of laser communication not only needs to invest in an optical space terminal, but it must also finance the creation of ground terminals to receive the downlink signal. This adds significant additional cost. Missions that do decide to incur the cost of financing a network of ground terminals end up building highly specialized optical receivers that are operable as receivers for that specific mission only. Significant Non-Recurring Engineering (NRE) cost is invested to build highly specialized one-of-a-kind ground terminals that go into storage after that particular mission is over. This is not an economical approach and does nothing to grow the number of optical ground stations available to future missions. In essence each mission that wants to take advantage of the benefits of lasercom has to start from scratch to provide a ground terminal network to support it. As long as this is the case, the cost for using laser communications will be too high for most missions to consider. LCOT intends to close this gap in technology by designing and developing a standard optical ground terminal design that is flexible enough to serve as a receiver for a wide range of future missions – a ground terminal that can be quickly reconfigured to receive downlinks at different wavelengths using different signal formats. Not only does LCOT have the industry-building objectives of utilizing commercial-off-the-shelf (COTS) components to the maximum extent possible, but also spurs the commercial development of other necessary lasercomm components not currently offered by industry. Finally, LCOT will give NASA scientists and engineers a facility where they can gain real-world experience with optical communications. It will give engineers a cost-effective way to try out new concepts and processes by providing the infrastructure for such testing. In this way it is hoped LCOT will serve as a stimulus for innovation in optical communications and speed its widespread adoption by future missions. The LCOT is comprised of five subsystems: Free-Space Optical, Transceiver, Amplifier, Monitor and Control, and Observatory Infrastructure. In August 2021, the LCOT team installed a 70 cm telescope, developed by Planewave Instruments that was optimized for optical communications. Free-Space Optical subsystem comprises of the telescope and its associated hardware, including a transmitter optical assembly, wide field cameras, two optical benches, and an adaptive optics subsystem. The transmit optical assembly, a unique concept design, is a cluster of four functionally independent transmit subassemblies located on the receive telescope. In addition to receiving optical signals and directing the expanded beam with high precision to the space terminal, it also performs tracking functions. The transmit optical assembly will support operations from Low Earth Orbit (LEO) through lunar and will be used as a template for industry manufacturing. The Optical Infrastructure subsystem is responsible for providing environmentally controlled shelters for LCOT equipment and various other systems. To maintain the safety and proper functionality of the telescope, a 16 ft Astrohaven clamshell dome procured which provides all-sky coverage without the need to rotate the dome. Additionally, Atmospheric Monitoring Assembly (AMA) will be part of optical infrastructure subsystem to ensure accurate performance of the LCOT. Like existing optical ground stations, LCOT will measure standard weather station parameters, infrared all sky image of cloud cover, and cloud height. LCOT, however, adds requirements for measuring night time seeing and, in the future, daytime seeing. Unlike other optical ground terminals, the LCOT is transceiver agnostic; user transceivers may be duplex transceivers, standalone receivers, or standalone transmitters with or without acquisition beacon functionality. As such, the LCOT project accommodates testing with external customer transceivers in a flexible manor, further complimenting its intended multi-mission goals. Another unique component of LCOT is the use of a new amplifier technology – the Very Large Mode Area (VLMA) amplifiers. This new technology allows LCOT to avoid the issues faced by previous laser communications ground terminals, gives users more flexibility and modular capability, and is capable of reaching an order of magnitude higher peak power than traditional High Power Optical Amplifiers (HPOA). One drawback of the VLMA HPOA approach is that the amplified light is output into free-space. The solution developed by LCOT is an optics train that couples the output of the VLMA amplifier into a short fiber for transport to the transmit telescopes with high efficiency. Like many of the LCOT components, a set of detailed manufacturing drawings have been created for the optics train to allow any machine shop with a multi-axis Computer Numerical Control (CNC) machine to fabricate the piece parts from commonly available materials. In line with the goals of LCOT, the monitor and control functions are developed as a modular and flexible system with the ability to support future hardware or algorithm changes, minimizing disruptions. A main priority of development in the Monitor and Control Subsystem (MCS) is the safety monitor system.

Haleh Safavi↗

Mars Terrain Segmentation with Less Labels

Planetary rover systems need to perform terrain segmentation to identify drivable areas as well as identify specific types of soil for sample collection. The latest Martian terrain segmentation methods rely on supervised learning which is very data hungry and difficult to train where only a small number of labeled samples are available. Moreover, the semantic classes are defined differently for different applications (e.g., rover traversal vs. geological) and as a result the network has to be trained from scratch each time, which is an inefficient use of resources. This research proposes a semi-supervised learning framework for Mars terrain segmentation where a deep segmentation network trained in an unsupervised manner on unlabeled images is transferred to the task of terrain segmentation trained on few labeled images. The network incorporates a backbone module which is trained using a contrastive loss function and an output atrous convolution module which is trained using a pixel-wise cross-entropy loss function. Evaluation results using the metric of segmentation accuracy show that the proposed method with contrastive pre-training outperforms plain supervised learning by 2%-10%. Moreover, the proposed model is able to achieve a segmentation accuracy of 91.1% using only 161 training images (1% of the original dataset) compared to 81.9% with plain supervised learning.

Wilson, Brian D↗

Lean Model-Based Systems Engineering on the NASA High-Density Vertiplex Subproject

The High Density Vertiplex (HDV) subproject of NASA’s Advanced Air Mobility (AAM) project adopted Model-Based Systems Engineering (MBSE) in July of 2020, prior to subproject formulation. A small and lean team of HDV Systems Engineers (SE) are utilizing MagicDraw to execute NASA SE processes via MBSE. The SEs learned how to use MagicDraw from scratch and HDV is the first project for which the SEs have utilized MagicDraw. This presentation will demonstrate project technical execution via MBSE, utilizing the digital elements built into the SysML (Systems Modeling Language). SysML provides a model-centric means of carrying out the NASA SE common technical processes by providing tools for complete system modeling, including requirements and interface management and design capture. The authors also leverage and extend SysML to perform other SE tasks, such as Verification and Validation (V&V) tracking. MBSE has two main purposes for HDV: 1) documenting the subproject’s logical architecture for distribution outside of the subproject, 2) capturing the subproject’s physical architecture in a single-source-of-truth for use by the subproject’s members. This presentation details the challenges, lessons learned, and solutions that were encountered in implementing MBSE in the first iteration on a multi-iteration, full-lifecycle design, build, fly project.

systems engineering↗

Foundation AI Models for Science

Foundation Models (FM) are AI models that are designed to replace a task or an application specific model. These FM can be applied to many different downstream applications. These FM are trained using self supervised techniques and can be built on any type of sequence data. The use of self supervised learning removes the hurdle for developing a large labeled dataset for training. Most FM use transformer architecture utilizes the notion of self attention which allows the network to model the influence of distant data points to each other both in space and time. The FM models exhibit emergent properties that are induced from the data. FM can be an important tool for science. The scale of these models results in better performance for different downstream applications and these applications show better accuracy over models built from scratch. FM drastically reduces the cost of entry to build different downstream applications both in time and effort. FM for selected science datasets such as optical satellite data, can accelerate applications ranging from data quality monitoring, feature detection and prediction. FM can make it easier to infuse AI into scientific research by removing the training data bottleneck and increasing the use of science data.

Manil Maskey↗

Revolutionizing Earth Science with Generalized AI Models

Foundation Models (FM) are generalized Artificial Intelligence (AI) models that are designed to replace a task or an application-specific model and can be used for many downstream applications. These FM can be built on any sequence data and are trained utilizing self-supervised approaches. The obstacle of creating a sizable labeled dataset for training is removed by using self-supervised learning. Most FM employ transformer design that takes advantage of the idea of self-attention, allowing the network to represent the impact of distant data points on one another in space and time. The FM models show emergent qualities that are induced from the data. FM can become a valuable tool for Earth science researchers. Due to the size of these models, downstream applications built fine-tuning these FM perform better and exhibit greater accuracy than models created from scratch. FM significantly lowers the entry barrier in terms of both the time and effort required to develop various downstream applications. For some scientific datasets, such as optical remote sensing data, FM can speed up processes like classification, object detection and prediction. By eliminating the training data bottleneck and maximizing the usage of science data, FM can make it simpler to integrate AI into scientific research. Initial results for three different FMs will be presented.

Rahul Ramachandran↗

Discerning Cell Surface Defects with 3D Optical Profilometry

This investigation seeks to establish better criteria that can be used for qualitative visual screening of cylindrical battery cells through exploration of various defects across multiple cylindrical Lithium-Ion battery cells. This investigation focuses on INR18650s and INR21700s cells from Molicel, LG, and Samsung. The principal instrument used is a high-definition 3D optical profilometer with measurement accuracy less than 0.5 microns. Through this effort, a catalog was built discerning minor surface imperfections from significant flaws. The catalog generated covers a comparison of axial and radial scratches, less than 5 microns, greater than 5 microns and greater than 15 microns, as well as the difference between surface discoloration, early-stage pitting, and late stages of corrosion. An exploration is made into cell button defects and crimp shoulder defects. When ultra-high-power optical magnification and three-dimension topological tools are not immediately available, this catalog will help determine if an individual cell is usable, worth further investigation, or failing. The purpose of this catalog is to be a field guide used for quick reference of a potential issue, with the goal of increasing screening throughput while reducing the need for costly examination. Trade names and trademarks are used in this abstract for identification only. Their usage does not constitute an official endorsement, either expressed or implied, by the National Aeronautics and Space Administration.

battery↗

Discerning Cell Surface Defects with 3D Optical Profilometry

This investigation seeks to establish better criteria that can be used for qualitative visual screening of cylindrical battery cells through exploration of various defects across multiple cylindrical Lithium-Ion battery cells. This investigation focuses on INR18650s and INR21700s cells from Molicel, LG, and Samsung. The principal instrument used is a high-definition 3D optical profilometer with measurement accuracy less than 0.5 microns. Through this effort, a catalog was built discerning minor surface imperfections from significant flaws. The catalog generated covers a comparison of axial and radial scratches, less than 5 microns, greater than 5 microns and greater than 15 microns, as well as the difference between surface discoloration, early-stage pitting, and late stages of corrosion. An exploration is made into cell button defects and crimp shoulder defects. When ultra-high-power optical magnification and three-dimension topological tools are not immediately available, this catalog will help determine if an individual cell is usable, worth further investigation, or failing. The purpose of this catalog is to be a field guide used for quick reference of a potential issue, with the goal of increasing screening throughput while reducing the need for costly examination. Trade names and trademarks are used in this abstract for identification only. Their usage does not constitute an official endorsement, either expressed or implied, by the National Aeronautics and Space Administration.

battery↗

Towards an Aviation Large Language Model by Fine-tuning and Evaluating Transformers

In the aviation domain, there are many applications for machine learning and artificial intelligence tools that utilize natural language. For example, there is a desire to know the commonalities in written safety reports such as voluntary post incidents reports or aerial wildfire operations reports to better understand the risks present. Another use-case is the possibility of extracting airspace procedures and constraints currently written in documents such as Letters of Agreement. These applications can benefit from the use of state-of-the-art natural language processing techniques when adapted to the language/phraseology specific to the aviation domain. This paper evaluates the viability of adaptation of NLP tools to the aviation domain by fine-tuning transformer based models using aviation data sets. In 2018, a novel language model based on neural units (also called transformers) was created and became known as “Bidirectional Encoder Representations from Transformers” or BERT. This architecture combined with large amounts of English training data and innovative semi-supervised training tasks set the standard for what would later emerge as Large Language Models. The performance of these models was further improved by hyperparameter tuning and refinement of the semi-supervised training task and resulted in “Robustly Optimized BERT Pre-training Approach through hyperparameter tuning” or RoBERTa models. These pre-trained Large Language Models proved to be useful for a wide variety of natural language processing tasks such as text classification and question answering through a process called fine-tuning. The transformer architecture with pre-trained weights served as the basis with the last few layers replaced with layers fine-tuned to perform a new task e.g., a layer that provides a label for the entire input text. This process of fine-tuning can also be used to adapt the models to new domains; e.g., BioBERT started with the pre-trained BERT model and was completed by additional fine-tuning and training on biomedical documents. Transformer-based architectures can also be used to create rich representations of text called embeddings which can serve as the input to other machine learning models. This allows simpler algorithms such as logistic regression to use context-rich representations of the text while still remaining quick to train and evaluate. In the world of aviation, there is a growing demand for natural language processing and understanding but the domain presents unique challenges. Due to the technical content (and specialized language) of most aviation documents, fine-tuning pre-trained Large Language Models to specific tasks has not met the benchmark on natural language processing tasks set by simpler models trained from scratch on the data. To address this deficiency, this paper evaluates the improvements from fine-tuning a Large Language Model on a large set of aviation documents using the original semi-supervised training tasks before performing specific natural language tasks. In fine-tuning, a domain-specific dataset is used on the original training task but with the pre-trained Large Language Model instead of starting from a random initialization. This approach allows the model to be adapted to the specific domain language without discarding the information gained from training on general English data. This paper utilized two major dataset types to train and assess the RoBERTa fine-tuning performance. The first are 7,057 Letters of Agreement which are Federal Aviation Administration (FAA) documents that formalize airspace operations across the national airspace system. They contain many examples of ‘aviation English’ using domain specific terminology and phrasing which serves as a representative basis to perform the semi-supervised fine-tuning. The second type is the 494 document classification labels to be used for evaluation. This down-stream evaluation aims to show the performance of the fine-tuned model, better understand how much data is needed for an effective fine-tuning, and how fine-tuning can be adapted for different applications in-the domain. After semi-supervised training, evaluation begins by encoding the documents for classification using the fine-tuned RoBERTa model. Then a logistic regression classifier is trained to label the document type and compared against our ground truth labels. This currently leads to a 82.8% accuracy on 10-fold cross validation showing improvement over baseline RoBERTa which achieved 81.0%. We plan to measure the improvements on additional tasks and it is expected that these improvements will lead to more robust models that can tackle the natural language processing challenges present in aviation datasets.

ATM↗