Search NASA⌕ Search

SEARCH · Search NASA

Results for “Learning algorithms”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 325 records · Page 18
All sourcesNASA NTRSDOE OSTI
NASA NTRS2021

Collaborative Communications Between A Human and A Resilient Safety Support System

Successful introductory UAM integration into the NAS will be contingent on resilient safety systems that support reduced-crew flight operations. In this paper, we present a system that performs three functions: 1) monitors an operator’s physiological state; 2) assesses when the operator is experiencing anomalous states; and 3) mitigates risks by a combination of dynamic, context-based unilateral or collaborative dynamic function allocation of operational tasks. The monitoring process receives high data-rate sensor values from eye-tracking and electrocardiogram sensors. The assessment process takes these values and performs a classification that was developed using machine learning algorithms. The mitigation process invokes a collaboration protocol called DFACCto which, based on context, performs vehicle operations that the operator would otherwise routinely execute. This system has been demonstrated in a UAM flight simulator for an operator incapacitation scenario. The methods and initial results as well as relevant UAM and AAM scenarios will be described.

Advanced air mobility↗
NASA NTRSDate not supplied

MULTI-OBJECTIVE REINFORCEMENT LEARNING FOR LOW-THRUST TRANSFER DESIGN BETWEEN LIBRATION POINT ORBITS

Multi-Reward Proximal Policy Optimization (MRPPO) is a multi-objective reinforcement learning algorithm used to construct low-thrust transfers between periodic orbits in multi-body systems. Previous implementations of MRPPO have relied on a predefined reference transfer to successfully train each policy. In this paper, an algorithmic modification labeled the ‘moving reference’, is introduced to autonomously construct these reference trajectories during training. With this modification, MRPPO is used to recover various low-thrust transfers between two periodic orbits in the Earth-Moon circular restricted three-body problem to solve a multi-objective optimization problem. These results are then compared with the solutions recovered via a gradient descent optimization scheme to validate the performance of MRPPO with the moving reference modification.

Christopher J. Sullivan↗
NASA NTRSDate not supplied

MULTI-OBJECTIVE REINFORCEMENT LEARNING FOR LOW-THRUST TRANSFER DESIGN BETWEEN LIBRATION POINT ORBITS

Multi-Reward Proximal Policy Optimization (MRPPO) is a multi-objective reinforcement learning algorithm used to construct low-thrust transfers between periodic orbits in multi-body systems. Previous implementations of MRPPO have relied on a predefined reference transfer to successfully train each policy. In this paper, an algorithmic modification labeled the ‘moving reference’, is introduced to autonomously construct these reference trajectories during training. With this modification, MRPPO is used to recover various low-thrust transfers between two periodic orbits in the Earth-Moon circular restricted three-body problem to solve a multi-objective optimization problem. These results are then compared with the solutions recovered via a gradient descent optimization scheme to validate the performance of MRPPO with the moving reference modification

Christopher John Sullivan↗
NASA NTRS2021

Exploring Transfers Between Earth-Moon Halo Orbits via Multi-Objective Reinforcement Learning

Multi-Reward Proximal Policy Optimization, a multi-objective deep reinforcement learning algorithm, is used to examine the design space of low-thrust trajectories for a SmallSat transferring between two libration point orbits in the Earth- Moon system. Using Multi-Reward Proximal Policy Optimiza- tion, multiple policies are simultaneously and efficiently trained on three distinct trajectory design scenarios. Each policy is trained to create a unique control scheme based on the trajectory design scenario and assigned reward function: a unique combination of weights scaling competing objectives that guide the spacecraft to the target mission orbit, incentivize faster flight times, and penalize propellant mass usage. Then, the policies are evaluated on the same set of perturbed initial conditions in each scenario to generate the propellant mass usages, flight times, and state discontinuities from a reference trajectory for each control scheme. This solution space of low-thrust trajectories for a SmallSat is used to examine the multi-objective trade space for the trajectory design scenario. By autonomously constructing the solution space, insights into the required propellant mass, flight time, and transfer geometry are rapidly achieved.

Mashiku, Alinda K.↗
NASA NTRSDate not supplied

Spacecraft Material Characterization Using Reflectance Spectra Extracted from RGB/IR Color Images

The space environment is detrimental to the exterior of the spacecraft and imposes stringent requirements on spacecraft materials. Space materials are often expected to perform for 15-20 years in the harsh space environment without significant degradation of their optical, electrical, mechanical and thermal properties. Further, as commercial activities increase in the space domain, development of predictive capability for material evolution is critical for agile adaption of novel materials. Therefore, it is very important to understand the effects of the space environments on the spacecraft materials. The Materials on the International Space Station Experiment Flight Facility (MISSE-FF) has flown numerous material samples to investigate the effect of LEO space weather exposure on the performance and durability of materials and devices. We are manifest on the MISSE-16 mission, scheduled to launch in June 2022, to fly fifteen novel and well-characterized materials in the LEO environment for a duration of six months. Changes in spectral reflectivity will be measured in real time throughout the mission with an RGB/IR camera. These time-resolved data will function as a "space-truth" reference for our team's ongoing laboratory-based space weather-material interaction experiments. Correlation of the MISSE-16 data with extensive ground testing of duplicate samples under simulated space weather conditions will enable development of fundamental chemical models for material degradation. This paper discusses preliminary results from the ground test campaign to collect the RGB/IR images for pristine and damaged materials and the development of machine learning algorithms to extract reflectance spectra from the color images.

Jainisha R. Shah↗
NASA NTRSDate not supplied

Detecting Satellite Laser Ranging Station Data and Operational Anomalies with Machine Learning Isolation Forests at NASA's CDDIS

The International Laser Ranging Service (ILRS) is currently composed of 45 active satellite laser ranging (SLR) stations with several more set to join the network over the next several years. Station changes and histories are logged to files, but not always in real time. Sometimes these details are not added until long after changes have been made to the station –on occasion, years later. This in addition to unexpected hardware errors and other system issues that are not immediately detected impact the products generated by analysts. The ILRS Central Bureau (CB) and NASA’s Crustal Dynamics Data Information System (CDDIS) have worked to provide tools for station engineers to use. This includes the creation of station plots which contain temperature and pressure information along with LAser GEOdynamic Satellite (LAGEOS) and LAser RElativity Satellite (LARES) tracking information that enable the monitoring of station performance and todetermine whether the station has undergone any changes. As next steps, the CDDIS is working to enhance these station performance monitoring tools through machine learning. Isolation forest is an unsupervised machine learning algorithm commonly applied to anomaly detection. In this poster, the CDDIS details the steps taken to track anomalies within SLR station performance using isolation forest with LAGEOS and LARES satellite data.

Benjamin P Michael↗
NASA NTRSDate not supplied

Probing the Sun with Imaging Spectrographs

EUV and X-ray images of the Sun have revolutionized our understanding of our closest star. With them, we can probe the morphology and temperature structure of the solar atmosphere and see how they evolve as a function of space and time. However, image data cannot be used to determine line-of-sight velocities, abundances, or densities. This information is required to calculate the energy budget of eruptive events, provide boundary conditions for global solar models, and explore fundamental processes occurring in the solar atmosphere. For those diagnostics, we require spectroscopy. Because the structures on the Sun are extended sources, most modern-day spectrographs observe the Sun through long narrow slits. Two-dimensional, spectrally pure solar images with velocity, abundance, and density information are built up by stepping the slit over regions of interest. This mode of operation implies that two-dimensional information is highly limited by cadence and the temporal evolution and spatial structure of these parameters can never be truly separated. Both spatial and spectral information can be obtained in a single snapshot with slitless spectrographs, which were often used in the 1950-1970s, but were abandoned due to the difficulty of unfolding the overlapping spatial and spectral information. Thanks to advances in computer processing speeds and machine learning algorithms, there have been several techniques developed to complete the spatial/spectral unfolding, unlocking the full capability of slitless spectrographs for solar observations. The goal of this talk is to give a broad overview of the capability of such instruments and demonstrate their usefulness in the next decade of solar observatories and beyond.

Amy Winebarger↗
NASA NTRS2022

Diesel Passenger Vehicle Shares Influenced Covid-19 Changes in Urban Nitrogen Dioxide Pollution

Diesel-powered vehicles emit several times more nitrogen oxides than comparable gasoline-powered vehicles, leading to ambient nitrogen dioxide (NO2) pollution and adverse health impacts. The COVID-19 pandemic and ensuing changes in emissions provide a natural experiment to test whether NO2 reductions have been starker in regions of Europe with larger diesel passenger vehicle shares. Here we use a semi-empirical approach that combines in-situ NO2 observations from urban areas and an atmospheric composition model within a machine learning algorithm to estimate business-as-usual NO2 during the first wave of the COVID-19 pandemic in 2020. These estimates account for the moderating influences of meteorology, chemistry, and traffic. Comparing the observed NO2 concentrations against business-as-usual estimates indicates that diesel passenger vehicle shares played a major role in the magnitude of NO2 reductions. European cities with the five largest shares of diesel passenger vehicles experienced NO2 reductions ∼ 2.5 times larger than cities with the five smallest diesel shares. Extending our methods to a cohort of non-European cities reveals that NO2 reductions in these cities were generally smaller than reductions in European cities, which was expected given their small diesel shares. We identify potential factors such as the deterioration of engine controls associated with older diesel vehicles to explain spread in the relationship between cities’ shares of diesel vehicles and changes in NO2 during the pandemic. Our results provide a glimpse of potential NO2 reductions that could accompany future deliberate efforts to phase out or remove passenger vehicles from cities.

Nitrogen Dioxide↗
NASA NTRSDate not supplied

Spacecraft Material Characterization Using Reflectance Spectra Extracted from RGB/IR Color Images

The space environment is detrimental to the exterior of the spacecraft and imposes stringent requirements on spacecraft materials. Space materials are often expected to perform for 15-20 years in the harsh space environment without significant degradation of their optical, electrical, mechanical and thermal properties. Further, as commercial activities increase in the space domain, development of predictive capability for material evolution is critical for agile adaption of novel materials. Therefore, it is very important to understand the effects of the space environments on the spacecraft materials. The Materials on the International Space Station Experiment Flight Facility (MISSE-FF) has flown numerous material samples to investigate the effect of LEO space weather exposure on the performance and durability of materials and devices. We are manifest on the MISSE-16 mission, scheduled to launch in June 2022, to fly fifteen novel and well-characterized materials in the LEO environment for a duration of six months. Changes in spectral reflectivity will be measured in real time throughout the mission with an RGB/IR camera. These time-resolved data will function as a "space-truth" reference for our team's ongoing laboratory-based space weather-material interaction experiments. Correlation of the MISSE-16 data with extensive ground testing of duplicate samples under simulated space weather conditions will enable development of fundamental chemical models for material degradation. This paper discusses preliminary results from the ground test campaign to collect the RGB/IR images for pristine and damaged materials and the development of machine learning algorithms to extract reflectance spectra from the color images.

Jainisha R. Shah↗
NASA NTRS2019

Soil Displacement Terramechanics for Wheel-Based Trenching with a Planetary Rover

Planetary exploration rovers are expensive, weight constrained, and cannot be serviced once deployed. Here, we explore one way to increase their capabilities while avoiding the cost, mass, and complexity leading to these issues. We propose to re-use the large wheel actuators for trenching and other digging operations, which will enable a range of missions such as sampling deeper layers of soil. We present a new, closed-form model of the soil displaced by an angled, spinning wheel to analyze the trenching potential of a driving strategy and inform the control of the wheel. The model is demonstrated with single wheel experiments under different driving conditions. The model suggests: that a deep trench does not require large tractive efforts; that the shape of the trench can be controlled; and that a rear wheel has a lower risk of entrapment when trenching than a front wheel. Ultimately this model could be used in a nonprehensile manipulation planning or learning algorithm to enable autonomous trenching.

Wheels↗
NASA NTRSDate not supplied

The Anatomy of Software Changes and Bugs in Autonomous Operating System

Cyberphysical systems with autonomous functions are complex pieces of software, consisting of many components, some of which implement autonomous functionality and some may use AI or machine learning algorithms. Software bugs in an autonomous system are of particular concern, as they can have catastrophic consequences. However, detailed studies based on empirical data are rare and therefore these bugs are not well understood. This paper aims to contribute towards filling that gap by investigating the software changes and bugs in Autonomy Operating System (AOS) for Unmanned Aircraft Systems (UAS), which consist of 26 components containing about 103,000 lines of code and having a total of 772 bugfixes. Based on the data extracted from the code repository and semi-structured interviews with the developers of AOS, we explore the differences among autonomous software components, components developed using Model-based Software Engineering, and reuse with respect to change proneness, fault proneness, distribution of bugfixes among AOS components and files of these components, and characteristics of bugs of different AOS components. Our results show that the autonomous components were significantly more change prone (measured in number of commits and code churn) and fault prone (measured in bugfixes per KLoC) than non-autonomous components. The distribution of the locations of bugfixes was skewed, both at component and file level (i.e., a small number of components / files contained the majority of bugs). These evidence-based findings provide important insights to researchers and practitioners alike and can be used to efficiently improve the quality and reliability of autonomous systems.

Katerina Goseva-Popstojanova↗
NASA NTRSDate not supplied

Coronado Ecological Conservation: Assessing Vegetation Change Due to Border Wall Construction and Shifting Social Trails

Species monitoring is essential in mitigating the impacts of plant invasion, such as radical changes in an area’s ecosystem, degraded soil health, increased wildfire severity, landslides, and increased flooding. NASA DEVELOP partnered with the National Park Service (NPS) to investigate invasive species in disturbed lands: specifically, areas affected by off-trail walking and US-Mexico border construction activities. The team assessed how construction has impacted the distribution of Lehmann’s lovegrass and Russian thistle invasives throughout Coronado National Memorial, AZ from 1986 to 2022. Using data from Landsat 5 and 8, Sentinel-2, the National Agriculture Imagery Program, and PlanetScope, the team computed vegetation indices including the Normalized Difference Vegetation Index, Normalized Difference Moisture Index, Modified Soil Adjusted Vegetation Index 2, Enhanced Vegetation Index, and Tasseled Cap Wetness, Brightness, and Greenness transformations as vegetation health indicators to input into various machine learning algorithms. To minimize noise, the team conducted Principal Component Analysis on the vegetation indices and spectral bands before running k-means++ clustering and random forest classification algorithms. Between all datasets, we found the median area fully overtaken by invasive plants was 5.37% of the park’s total area in 2022. The NPS will use the end products to help increase restoration efforts in disturbed areas with high concentrations of invasive plants. The NPS’s collection of ground data for 2022–2023, in conjunction with future data collection, will notably improve the accuracy of classification models, leading to more precise monitoring of invasive spread over time.

Carson Schuetze↗
NASA NTRSDate not supplied

Predicting Airport Runway Configurations for Decision-Support Using Supervised Learning

One of the most challenging tasks for air traffic controllers is runway configuration management (RCM). It deals with the optimal selection of runways to operate on (for arrivals and departures) based on traffic, surface wind speed, wind direction, other environmental variables, noise constraints, and several other airport-specific factors. It affects the efficiency of the National Airspace System (NAS) and both surface and airspace operations can benefit from better understanding future runway configurations. In this paper, we present a comprehensive implementation of predictive models for runway configuration estimation from large volumes of historical data. Specifically, operational data from two full years (2018 and 2019) is collected, analyzed, and fused together to build the data product used in this work. The data set differs from prior work in the field in terms of its scope, resolution, and variety of factors collected and considered. Meteorological data is collected from two different sources – current weather conditions from METAR (Meteorological Terminal Aviation Routine Weather Report) and forecast weather conditions from Localized Aviation MOS Program (LAMP). Operational data from the Federal Aviation Administration (FAA) Aviation System Performance Metrics (ASPM) related to scheduled and actual number of arrivals and departures, average taxi times, etc. are collected. NASA’s Sherlock Data Warehouse is used to identify critical information such as go-arounds, and other events that might impact RCM decision-making. All data is collected and aggregated over 15-minute intervals throughout the two years. This provides a resolution like the timescales that might be necessary for runway configuration management decision-making. A variety of supervised learning algorithms are tested including Support Vector Machine, Random Forest, Gradient Boosting, etc. including tuning of the model hyperparameters. The modeling process is applied and presented on two representative U.S. airports – Charlotte Douglas International Airport (KCLT) and Denver International Airport (KDEN). The two airports present different levels of complexity in terms of the total number of configurations used and provide a balanced perspective on the generalizability of the developed approach to other airports in the NAS. Initial results are promising (F1 score of 0.91 at KCLT and 0.83 at KDEN) for data in the test set. The final paper will contain a comprehensive comparison between different models and model building strategies as well as further refined results. Most important predictors for each airport will be identified along with a discussion and recommendations on adapting the framework to other scenarios.

Tejas G Puranik↗
NASA NTRSDate not supplied

Probing the Sun with Imaging Spectrographs

EUV and X-ray images of the Sun have revolutionized our understanding of our closest star. With them, we can probe the morphology and temperature structure of the solar atmosphere and see how they evolve as a function of space and time. However, image data cannot be used to determine line-of-sight velocities, abundances, or densities. This information is required to calculate the energy budget of eruptive events, provide boundary conditions for global solar models, and explore fundamental processes occurring in the solar atmosphere. For those diagnostics, we require spectroscopy. Because the structures on the Sun are extended sources, most modern-day spectrometers observe the Sun through long narrow slits. Two-dimensional, spectrally pure solar images with velocity, abundance, and density information are built up by stepping the slit over regions of interest. This method implies that two-dimensional information is highly limited by cadence and the temporal evolution and spatial structure of these parameters can never be truly separated. Both spatial and spectral information can be obtained in a single snapshot with slitless spectrometers, which were often used in the 1950-1970s, but were abandoned due to the difficulty of unfolding the overlapping spatial and spectral information. Thanks to advances in computer processing speeds and machine learning algorithms, there have been several techniques developed to complete the spatial/spectral unfolding, unlocking the full capability of slitless spectrometers for solar observations. The goal of this talk is to give an overview of the capability of such instruments, including recent results from a sounding rocket flight, and demonstrate their usefulness in the next decade of solar observatories and beyond.

Amy Winebarger↗
NASA NTRS2021

Multi-objective Reinforcement Learning for Low-thrust Transfer Design Between Libration Point Orbits

Multi-Reward Proximal Policy Optimization (MRPPO) is a multi-objective rein- forcement learning algorithm used to construct low-thrust transfers between pe- riodic orbits in multi-body systems. Previous implementations of MRPPO have relied on a predefined reference transfer to successfully train each policy. In this paper, an algorithmic modification labeled the ‘moving reference’, is introduced to autonomously construct these reference trajectories during training. With this modification, MRPPO is used to recover various low-thrust transfers between two periodic orbits in the Earth-Moon circular restricted three-body problem to solve a multi-objective optimization problem. These results are then compared with the solutions recovered via a gradient descent optimization scheme to validate the performance of MRPPO with the moving reference modification.

Anderson, Rodney L.↗
NASA NTRS2021

Multi-objective Reinforcement Learning for Low-thrust Transfer Design Between Libration Point Orbits

Multi-Reward Proximal Policy Optimization (MRPPO) is a multi-objective rein- forcement learning algorithm used to construct low-thrust transfers between pe- riodic orbits in multi-body systems. Previous implementations of MRPPO have relied on a predefined reference transfer to successfully train each policy. In this paper, an algorithmic modification labeled the ‘moving reference’, is introduced to autonomously construct these reference trajectories during training. With this modification, MRPPO is used to recover various low-thrust transfers between two periodic orbits in the Earth-Moon circular restricted three-body problem to solve a multi-objective optimization problem. These results are then compared with the solutions recovered via a gradient descent optimization scheme to validate the performance of MRPPO with the moving reference modification.

Anderson, Rodney L↗
NASA NTRS2023

Coronado Ecological Conservation: Assessing Vegetation Change Due to Border Wall Construction and Shifting Social Trails

Species monitoring is essential for mitigating the impacts of plant invasion, such as radical changes in an area’s ecosystem, degraded soil health, increased wildfire severity, landslides, and increased flooding. For this project, NASA DEVELOP partnered with the National Park Service (NPS) to investigate invasive species in disturbed lands: specifically, areas affected by off-trail travel and U.S.-Mexico border construction activities. The team assessed how construction has impacted the distribution of Lehmann’s lovegrass and Russian thistle invasives throughout Coronado National Memorial, AZ from 1986-2022. Using data from Landsat 5 and 8, Sentinel-2, NAIP, and PlanetScope, the team computed NDVI, NDMI, MSAVI2, EVI, and Tasseled Cap Wetness, Brightness, and Greenness transformations as vegetation health indicators to input into various machine learning algorithms. To minimize noise, the team conducted Principal Component Analysis on vegetation indices and spectral bands before running k-means clustering and random forest classification algorithms. Between all datasets, the team found that the median area fully overtaken by invasive plants was 5.37% of the park’s total area in 2022. The NPS will use end products to help increase restoration efforts in disturbed areas with high concentrations of invasive plants, and this project can serve as a jumping off point for future invasive species monitoring. The NPS’s collection of ground data for 2022-2023, in conjunction with future data collection, will notably improve the accuracy of classification models, leading to more precise monitoring of invasive species spread over time.

Coronado National Memorial↗
NASA NTRSDate not supplied

Extracting Lessons of Resilience Using Machine Mining of the ASRS Database

NASA’s Aviation Safety Reporting System (ASRS) database is the world's largest repository of voluntary, confidential safety information provided by aviation's frontline personnel, including pilots, air traffic controllers, mechanics, flight attendants, dispatchers, and other members of the aviation community and the public. The database contains close to 2 million narratives, many of which describe everyday situations in which people saved the day. In these situations, people’s resilient behavior solved a problem, dealt with a malfunction, and maintained a safe operation despite a serious perturbation. To be able to extract lessons of such resilience from this large database, the use of machine learning algorithms is being explored. In this report, we describe a comparison between two such algorithms: Perilog and Word2Vec. An identical search using both programs was done on a database containing approximately 470,000 ASRS reports submitted between 1988 and 2022. The comparison reveals some of the strength and weaknesses of each algorithm as well as the challenges inherent in using such algorithms to extract lessons of resilience from the ASRS database.

resilience↗