Search NASA⌕ Search

SEARCH · Search NASA

Results for “learning based systems”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,369 records · Page 76

Geolocation tracking for human identification and activity recognition using radar deep transfer learning

Abstract Human identification and activity recognition (HIAR) is crucial for many applications, such as surveillance, smart homes, and assisted living. As a sensing modality, radar has many unique characteristics including privacy protection, and contactless sensing. Single classification systems have shown to be accurate, but for long‐term solutions both human identification (ID) and human activity recognition (HAR) will need to be integrated in one system where it can be utilised simultaneously. In this article, a novel radar‐based human tracking system is presented where three classifiers are utilised to identify the subject and his/her behaviour. For any kind of motion, the system tracks the subject and detect the type of his/her motion. Based on the detected type of motion, the three classifiers are utilised for identification and activity recognition. The classifiers are built utilising deep transfer learning where three radar datasets are established to train and validate each of the deep networks. To recognise six activities and 10 human subjects, the three classifiers, namely, HAR, Gait ID, and Heart sound ID, achieve superior performance compared to the best reported results in literature with classification accuracies of 97.6%, 100%, and 41.8% respectively. Three successful examples are presented to demonstrate the introduced concept.

Alkasimi, Ahmad↗

The Geostationary Operational Satellite R Series SpaceWire Based Data System

The Geostationary Operational Environmental Satellite R-Series Program (GOES-R, S, T, and U) mission is a joint program between National Oceanic & Atmospheric Administration (NOAA) and National Aeronautics & Space Administration (NASA) Goddard Space Flight Center (GSFC). SpaceWire was selected as the science data bus as well as command and telemetry for the GOES instruments. GOES-R, S, T, and U spacecraft have a mission data loss requirement for all data transfers between the instruments and spacecraft requiring error detection and correction at the packet level. The GOES-R Reliable Data Delivery Protocol (GRDDP) [1] was developed in house to provide a means of reliably delivering data among various on board sources and sinks. The GRDDP was presented to and accepted by the European Cooperation for Space Standardization (ECSS) and is part of the ECSS Protocol Identification Standard [2]. GOES-R development and integration is complete and the observatory is scheduled for launch November 2016. Now that instrument to spacecraft integration is complete, GOES-R Project reviewed lessons learned to determine how the GRDDP could be revised to improve the integration process. Based on knowledge gained during the instrument to spacecraft integration process the following is presented to help potential GRDDP users improve their system designs and implementation.

Networks↗

Life-Cycle Assessment Integration into Scalable Open-Source Numerical Models (LiAISON) for Prospective Impact Analysis of Novel Technologies

Decarbonizing the industrial sector is a significant challenge in achieving a net-zero greenhouse gas (GHG) emissions economy by 2050 and the Paris Agreement, i.e., a global climate change mitigation target of achieving a maximum average temperature change potential of 1.5 Degrees Celsius or less by 2100 with respect to pre-industrial levels. In the United States (US), the industrial sector accounts for 23% of total GHG emissions and is home to a number of hard-to-electrify activities. The chemicals subsector has the single largest subsector emissions profile after direct emissions from fossil fuel combustion and leakage from fossil fuel distribution systems. Within the chemicals subsector, many processes depend on hydrogen or ammonia precursors. Decarbonizing these two commodities would contribute significantly to decarbonizing the industrial sector as hydrogen could also be used for low carbon steel production (e.g., hydrogen-based direct reduction of iron) and other industrial applications. Emerging technologies require the application of prospective life cycle assessment (LCA), which can account for technology (foreground) scaling and process improvements via learning-by-doing, among others. In many cases, the future system context (background) in which the technologies are assumed to operate in is equally relevant. Background scenarios generated by integrated assessment models (IAM) can coherently incorporate potential future dynamics of the energy-climate-human-land system. Further, IAM scenarios are harmonized across socioeconomic and climate change mitigation pathways, which facilitates the comparability of prospective LCAs using different IAMs. We introduce an open source prospective LCA framework, the Life-cycle Assessment Integration into Scalable Open-source Numerical models (LiAISON), to analyze the non-linear relationships between technology foreground and the future energy system background across a series of midpoint and resource use metrics. The integration of LCA and IAM data is achieved using prospective environmental Impact assessment (PREMISE). We showcase it by assessing two Power-to-Hydrogen (PtH2) processes, namely Solid Oxide Electrolysis (SOE) and Polymer Electrolyte Membrane Electrolysis (PEME). We compare the technologies to a baseline of hydrogen production via natural gas-based Steam Methane Reforming (SMR) in a US context of multiple energy system and climate change mitigation futures. Besides providing an analysis that specifies the LCA results ranges with temporal and geospatial explicitness across the two technologies, metrics, and impact assessment methods, this research also aims to establish a base framework that can be expanded to use other IAM generated scenarios and US open-source life cycle inventory (LCI) databases. We find that the temporal environmental performance of either technology or their difference to SMR is directly influenced by the underlying background dynamics. Additionally we compare our results by linking two other prospective models with LiAISON - GCAM (Global Change Assessment Model) and ReEDS (Regional Energy Deployment System) to analyze the effect of changing background scenarios using varying predictions in life cycle analysis.

decarbonizing↗

Life-Cycle Assessment Integration into Scalable Open-Source Numerical Models (LiAISON) for Analyzing Emerging Low-Carbon Technologies

Decarbonizing the industrial sector is a significant challenge in achieving a net-zero greenhouse gas (GHG) emissions economy by 2050 and the Paris Agreement, i.e., a global climate change mitigation target of achieving a maximum average temperature change potential of 1.5 degrees Celsius or less by 2100 with respect to pre-industrial levels. In the United States (US), the industrial sector accounts for 23% of total GHG emissions and is home to a number of hard-to-electrify activities. The chemicals subsector has the single largest subsector emissions profile after direct emissions from fossil fuel combustion and leakage from fossil fuel distribution systems. Within the chemicals subsector, many processes depend on hydrogen or ammonia precursors. Decarbonizing these two commodities would contribute significantly to decarbonizing the industrial sector as hydrogen could also be used for low carbon steel production (e.g., hydrogen-based direct reduction of iron) and other industrial applications. Emerging technologies require the application of prospective life cycle assessment (LCA), which can account for technology (foreground) scaling and process improvements via learning-by-doing, among others. In many cases, the future system context (background) in which the technologies are assumed to operate in is equally relevant. Background scenarios generated by integrated assessment models (IAM) can coherently incorporate potential future dynamics of the energy-climate-human-land system. Further, IAM scenarios are harmonized across socioeconomic and climate change mitigation pathways, which facilitates the comparability of prospective LCAs using different IAMs. We introduce an open source prospective LCA framework, the Life-cycle Assessment Integration into Scalable Open-source Numerical models (LiAISON), to analyze the non-linear relationships between technology foreground and the future energy system background across a series of midpoint and resource use metrics. The integration of LCA and IAM data is achieved using prospective environmental Impact assessment (PREMISE). We showcase it by assessing two Power-to-Hydrogen (PtH2) processes, namely Solid Oxide Electrolysis (SOE) and Polymer Electrolyte Membrane Electrolysis (PEME). We compare the technologies to a baseline of hydrogen production via natural gas-based Steam Methane Reforming (SMR) in a US context of multiple energy system and climate change mitigation futures. Besides providing an analysis that specifies the LCA results ranges with temporal and geospatial explicitness across the two technologies, metrics, and impact assessment methods, this research also aims to establish a base framework that can be expanded to use other IAM generated scenarios and US open-source life cycle inventory (LCI) databases. We find that the temporal environmental performance of either technology or their difference to SMR is directly influenced by the underlying background dynamics. Under baseline projections (i.e., no decarbonization goals), neither process reaches parity with the incumbent technology across several environmental metrics. Under the decarbonization scenarios, the underlying sectoral shifts result in declining impacts over time, compared to 2020 levels, except for metal depletion levels, which increase. The background shifts postulate a heavily decarbonized economy and energy system, which help technologies reach parity with SMR between 2040-2050 (RCP2.6) and 2030-2040 (RCP1.9) for global warming. Despite declines across several other metrics over time, neither PtH2 technology break even with SMR by 2100 besides for global warming.

decarbonizing↗

Life-Cycle Assessment Integration into Scalable Open-Source Numerical Models (LiAISON) for Analyzing Emerging Low-Carbon Technologies

Decarbonizing the industrial sector is a significant challenge in achieving a net-zero greenhouse gas (GHG) emissions economy by 2050 and the Paris Agreement, i.e., a global climate change mitigation target of achieving a maximum average temperature change potential of 1.5 degrees C or less by 2100 with respect to pre-industrial levels. In the United States (US), the industrial sector accounts for 23% of total GHG emissions and is home to a number of hard-to-electrify activities. The chemicals subsector has the single largest subsector emissions profile after direct emissions from fossil fuel combustion and leakage from fossil fuel distribution systems. Within the chemicals subsector, many processes depend on hydrogen or ammonia precursors. Decarbonizing these two commodities would contribute significantly to decarbonizing the industrial sector as hydrogen could also be used for low carbon steel production (e.g., hydrogen-based direct reduction of iron) and other industrial applications. Emerging technologies require the application of prospective life cycle assessment (LCA), which can account for technology (foreground) scaling and process improvements via learning-by-doing, among others. In many cases, the future system context (background) in which the technologies are assumed to operate in is equally relevant. Background scenarios generated by integrated assessment models (IAM) can coherently incorporate potential future dynamics of the energy-climate-human-land system. Further, IAM scenarios are harmonized across socioeconomic and climate change mitigation pathways, which facilitates the comparability of prospective LCAs using different IAMs. We introduce an open source prospective LCA framework, the Life-cycle Assessment Integration into Scalable Open-source Numerical models (LiAISON), to analyze the non-linear relationships between technology foreground and the future energy system background across a series of midpoint and resource use metrics The integration of LCA and IAM data is achieved using prospective environmental Impact assessment (PREMISE). We showcase it by assessing two Power-to-Hydrogen (PtH2) processes, namely Solid Oxide Electrolysis (SOE) and Polymer Electrolyte Membrane Electrolysis (PEME). We compare the technologies to a baseline of hydrogen production via natural gas-based Steam Methane Reforming (SMR) in a US context of multiple energy system and climate change mitigation futures. Besides providing an analysis that specifies the LCA results ranges with temporal and geospatial explicitness across the two technologies, metrics, and impact assessment methods, this research also aims to establish a base framework that can be expanded to use other IAM generated scenarios and US open-source life cycle inventory (LCI) databases. We find that the temporal environmental performance of either technology or their difference to SMR is directly influenced by the underlying background dynamics. Under baseline projections (i.e., no decarbonization goals), neither process reaches parity with the incumbent technology across several environmental metrics. Under the decarbonization scenarios, the underlying sectoral shifts result in declining impacts over time, compared to 2020 levels, except for metal depletion levels, which increase. The background shifts postulate a heavily decarbonized economy and energy system, which help technologies reach parity with SMR between 2040-2050 (RCP2.6) and 2030-2040 (RCP1.9) for global warming. Despite declines across several other metrics over time, neither PtH2 technology break even with SMR by 2100 besides for global warming.

decarbonizing↗

Towards Prospective LCA Using Life-Cycle Assessment Integration into Scalable Open-Source Numerical Models (LiAISON) Framework for Analyzing Emerging Low-Carbon Technologies

Decarbonizing the industrial sector is a significant challenge in achieving a net-zero greenhouse gas (GHG) emissions economy by 2050 and the Paris Agreement, i.e., a global climate change mitigation target of achieving a maximum average temperature change potential of 1.5 Degrees Celsius or less by 2100 with respect to pre-industrial levels. In the United States (US), the industrial sector accounts for 23% of total GHG emissions and is home to a number of hard-to-electrify activities. The chemicals subsector has the single largest subsector emissions profile after direct emissions from fossil fuel combustion and leakage from fossil fuel distribution systems. Within the chemicals subsector, many processes depend on hydrogen or ammonia precursors. Decarbonizing these two commodities would contribute significantly to decarbonizing the industrial sector as hydrogen could also be used for low carbon steel production (e.g., hydrogen-based direct reduction of iron) and other industrial applications. Emerging technologies require the application of prospective life cycle assessment (LCA), which can account for technology (foreground) scaling and process improvements via learning-by-doing, among others. In many cases, the future system context (background) in which the technologies are assumed to operate in is equally relevant. Background scenarios generated by integrated assessment models (IAM) can coherently incorporate potential future dynamics of the energy-climate-human-land system. Further, IAM scenarios are harmonized across socioeconomic and climate change mitigation pathways, which facilitates the comparability of prospective LCAs using different IAMs. We introduce an open source prospective LCA framework, the Life-cycle Assessment Integration into Scalable Open-source Numerical models (LiAISON), to analyze the non-linear relationships between technology foreground and the future energy system background across a series of midpoint and resource use metrics The integration of LCA and IAM data is achieved using prospective environmental Impact assessment (PREMISE). We showcase it by assessing two Power-to-Hydrogen (PtH2) processes, namely Solid Oxide Electrolysis (SOE) and Polymer Electrolyte Membrane Electrolysis (PEME). We compare the technologies to a baseline of hydrogen production via natural gas-based Steam Methane Reforming (SMR) in a US context of multiple energy system and climate change mitigation futures. Besides providing an analysis that specifies the LCA results ranges with temporal and geospatial explicitness across the two technologies, metrics, and impact assessment methods, this research also aims to establish a base framework that can be expanded to use other IAM generated scenarios and US open-source life cycle inventory (LCI) databases. We find that the temporal environmental performance of either technology or their difference to SMR is directly influenced by the underlying background dynamics. Additionally we compare our results by linking two other prospective models with LiAISON - GCAM(Global Change Assessment Model) and ReEDS (Regional Energy Deployment System) to analyze the effect of changing background scenarios using varying predictions in life cycle analysis.

emissions↗

A machine learning Automated Recommendation Tool for synthetic biology

Abstract Synthetic biology allows us to bioengineer cells to synthesize novel valuable molecules such as renewable biofuels or anticancer drugs. However, traditional synthetic biology approaches involve ad-hoc engineering practices, which lead to long development times. Here, we present the Automated Recommendation Tool (ART), a tool that leverages machine learning and probabilistic modeling techniques to guide synthetic biology in a systematic fashion, without the need for a full mechanistic understanding of the biological system. Using sampling-based optimization, ART provides a set of recommended strains to be built in the next engineering cycle, alongside probabilistic predictions of their production levels. We demonstrate the capabilities of ART on simulated data sets, as well as experimental data from real metabolic engineering projects producing renewable biofuels, hoppy flavored beer without hops, fatty acids, and tryptophan. Finally, we discuss the limitations of this approach, and the practical consequences of the underlying assumptions failing.

59 BASIC BIOLOGICAL SCIENCES↗

A Digital Twin Framework Utilizing Machine Learning for Robust Predictive Maintenance: Enhancing Tire Health Monitoring

We introduce a novel digital twin (DT) framework for the predictive maintenance of long-term physical systems. Using monitoring tire health as an application, we show how the DT framework can be used to enhance automotive safety and efficiency, and how the technical challenges can be overcome using a three-step approach. First, to manage the data complexity over a long operation span, we employ data reduction techniques to concisely represent physical tires using historical performance and usage data. Relying on these data, for fast real-time prediction, we train a transformer-based model offline on our concise dataset to predict future tire health over time, represented as remaining casing potential (RCP). Based on our architecture, our model quantifies both epistemic and aleatoric uncertainties, providing reliable confidence intervals around predicted RCP. Second, to incorporate real-time data, we update the predictive model in the DT framework, ensuring its accuracy throughout its lifespan with the aid of hybrid modeling and the use of the discrepancy function. Third, to assist decision-making in predictive maintenance, we implement a tire state decision algorithm, which strategically determines the optimal timing for tire replacement based on RCP forecasted by our transformer model. This approach ensures that our DT accurately predicts system health, continually refines its digital representation, and supports predictive maintenance decisions. Furthermore, our framework effectively embodies a physical system, leveraging big data and machine learning (ML) for predictive maintenance, model updates, and decision-making.

advanced computing infrastructure↗

Emulation Modeling for Development of Cyber-Defense Capabilities for Satellite Systems

The objective of this project was to develop a novel capability to generate synthetic data sets for the purpose of training Machine Learning (ML) algorithms for the detection of malicious activities on satellite systems. The approach experimented with was to a) generate sparse data sets using emulation modeling and b) enlarge the sparse data using Generative Adversarial Networks (GANs). We based our emulation modeling on the Open Source NASA Operational Simulator for Small Satellites (NOS3) developed by the Katherine Johnson Independent Verification and Validation (IV&V) program in West Virginia. Significant new capabilities on NOS3 had to be developed for our data set generation needs. To expand these data sets for the purpose of training ML, we experimented with a) Extreme Learning Machines (ELMs) and b) Wasserstein-GANs (WGAN-GP).

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

Real-Time Hazard Detection and Avoidance Demonstration for a Planetary Lander

The Autonomous Landing Hazard Avoidance Technology (ALHAT) Project is chartered to develop and mature to a Technology Readiness Level (TRL) of six an autonomous system combining guidance, navigation and control with terrain sensing and recognition functions for crewed, cargo, and robotic planetary landing vehicles. In addition to precision landing close to a pre-mission defined landing location, the ALHAT System must be capable of autonomously identifying and avoiding surface hazards in real-time to enable a safe landing under any lighting conditions. This paper provides an overview of the recent results of the ALHAT closed loop hazard detection and avoidance flight demonstrations on the Morpheus Vertical Testbed (VTB) at the Kennedy Space Center, including results and lessons learned. This effort is also described in the context of a technology path in support of future crewed and robotic planetary exploration missions based upon the core sensing functions of the ALHAT system: Terrain Relative Navigation (TRN), Hazard Detection and Avoidance (HDA), and Hazard Relative Navigation (HRN).

Epp, Chirold D.↗

RX-ADS: Interpretable Anomaly Detection Using Adversarial ML for Electric Vehicle CAN Data

Recent year has brought considerable advancements in Electric Vehicles (EVs) and associated infrastructures/ communications. Intrusion Detection Systems (IDS) are widely deployed for anomaly detection in such critical infrastructures. This paper presents an Interpretable Anomaly Detection System (RX-ADS) for intrusion detection in CAN protocol communication in EVs. Contributions include: 1) window based feature extraction method; 2) deep Autoencoder based anomaly detection method; and 3) adversarial machine learning based explanation generation methodology. The presented approach was tested on two benchmark CAN datasets: OTIDS and Car Hacking. The anomaly detection performance of RX-ADS was compared against the state-of-the-art approaches on these datasets: HIDS and GIDS. The RX-ADS approach presented performance comparable to the HIDS approach (OTIDS dataset) and has outperformed HIDS and GIDS approaches (Car Hacking dataset). Further, the proposed approach was able to generate explanations for detected abnormal behaviors arising from various intrusions. Furthermore, these explanations were later validated by information used by domain experts to detect anomalies. Other advantages of RX-ADS include: 1) the method can be trained on unlabeled data; 2) explanations help experts in understanding anomalies and root course analysis, and also help with AI model debugging and diagnostics, ultimately improving user trust in AI systems.

42 ENGINEERING↗

Traffic Signal Optimization by Integrating Reinforcement Learning and Digital Twins

Machine learning (ML) methods, especially reinforcement learning (RL), have been widely considered for traffic signal optimization in intelligent transportation systems. Most of these ML methods are centralized, lacking in scalability and adaptability in large traffic networks. Further, it is challenging to train such ML models due to the lack of training platforms and/or the cost of deploying and training in a real traffic networks. This paper presents an approach for the integration of decentralized graph-based multi-agent reinforcement learning (DGMARL) with a Digital Twin (DT) to optimize traffic signals for the reduction of traffic congestion and network-wide fuel consumption related to stopping. Specifically, the DGMARL agents learn traffic state patterns and make decisions regarding traffic signal control with assistance from a Digital Twin module, which simulates and replicates the traffic behaviors of a real traffic network. The proposed approach was evaluated using PTV-Vissim [1], a microscopic traffic simulation platform. PTV-Vissim is also the simulation engine of the DT, enabling emulation and optimization of the traffic signals on the MLK Smart Corridor in Chattanooga, Tennessee. Compared to an actuated signal control baseline approach, experiment results show that Eco_PI, a developed performance measure capturing the impact of stops on fuel consumption, was reduced by 44.27% in a 24-hour and an average of 29.88% in a PM-peak-hour scenario.

Multi-Agent Reinforcement Learning, Digital Twin, ↗

A Machine Learning Approach to Improve Air Traffic Management Initiatives

Collaborating closely with commercial air carriers and related organizations, the Federal Aviation Administration(FAA) regulates air traffic and ensures the safety and efficiency of air operations. Air traffic controllers make strategic decisions, such as delaying, rerouting, or canceling flights, partly based on guidance provided by the FAA’s Air TrafficControl System Command Center (ATCSCC). The guidance includes, among other things, control measures known asTraffic Management Initiatives (TMIs) designed to enhance safety and improve operational efficiency. TMIs play a crucial role in managing the demand and capacity within the U.S. National Airspace System (NAS). Two major TMIs that are routinely used (primarily to mitigate the adverse effects of bad weather) are Ground Delay Programs (GDPs) andGround Stops (GSs). In a GDP, flights destined for airports facing thunderstorm activity experience delays at their origin airports. This proactive approach minimizes the risk of routing aircraft through hazardous weather conditions and also replaces (fuel burning) airborne delays with ground delays. In a GS, a temporary restriction is imposed on the departure or arrival of aircraft at a specific airport or within a designated airspace. Although other TMIs (e.g., miles-in-trail) are also implemented as part of (air) traffic flow management in the NAS, the focus of this work is on GDPs and GSs. Since TMIs, by design, lead to flight delays or cancellations, it is crucial to put in place the right set of parameters(e.g., scope and duration of the GDP). For example, when the end time of a GDP extends beyond what is necessary, it imposes unnecessary delays on departing flights. This situation could occur as a result of inaccurate prediction of the(required) duration of the GDP based on the weather forecast. On the other hand, if a GDP ends prematurely before the underlying capacity constraints are resolved at the destination airport, it may result in airborne holding. The delicate balance lies in matching the termination of the GDP precisely with the resolution of capacity constraints, avoiding both the imposition of unnecessary ground delays and the need for airborne holding due to premature program termination.Failing to specify the right parameters for TMIs also leads to flight delays, creating a significant obstacle in managing the increasing traffic volumes causing increased work load for the controllers. To address this issue, we propose the integration of Machine Learning (ML) models in the traffic flow management(TFM) pipeline. In current operations, decisions are made by human experts based on extensive training, historical patterns, available traffic and weather data. Since we have an abundance of data from past events that tell us the likely impact of various TMIs, by ingesting historical data, properly trained ML models can offer valuable insights and aid human decision-making. With the FAA increasingly exploring advanced analytics, ML emerges as a focal point for enhancing TFM within the National Airspace System (NAS). As a first step, this study aims to provide traffic controllers with decision-making support for the issuance and adjustment of TMIs. Data analytics and machine learning have been previously employed to address some of the challenges associated with TMIs. Numerous studies have concentrated on various facets of TMI issuance, exploring factors influencing TMI parameters, including arrival rate, airport capacity, and delay prediction. For example, using weather forecasts, several statistical methods were used to produce probabilistic capacity profiles which in conjunction with deterministic models provided insights into the GDP planning process [1–4]. The downside of using deterministic models is that they rely on fixed inputs and predetermined rules, which lack the ability to account for the inherent uncertainty and variability present in real-world scenarios. In a separate series of studies, researchers aimed to predict the occurrences of GDPs and GSs. The majority of these studies utilized various supervised learning methods, including Decision Trees, Naive Bayes, Support VectorMachines, and Random Forests to analyze the influence of weather conditions and arrival demand on TMI incidents[5–8]. However, these studies primarily focused on predicting the incidence of TMIs without explicitly addressing the scope of TMIs, including their duration and their geographical coverage. Furthermore, the emphasis of these studies was largely on GDPs, given their higher frequency and longer duration when compared to GSs. A limited number of studies focused on predicting the parameters of TMIs, specifically addressing their duration and extent. In one such study focusing on optimizing the TMI parameters at San Francisco International Airport (SFO),the authors utilized a probabilistic forecast of fog [9]. They simulated various capacity scenarios based on the (fog)burn-off forecasts, selecting GDP parameters that minimized airborne and overall ground delays. However, this approach exclusively emphasizes stratus (fog) burn-off as the primary determinant of GDP and GS, neglecting other influential factors like severe weather events, runway closures, lower capacity than traffic demand, and other important variables. Given the complexity of predicting the TMI and determining its scope, we seek a more holistic approach. We aim to consider all significant factors that could impact TMIs and their parameters. What sets this research apart is the fusion of all data sources relevant to the issuance and adjustment of TMIs and it represents the first comprehensive attempt to optimize TMIs in this manner. Since this comprehensive solution involves various aspects, we break down the problem into smaller components and input all parameters into a unified model called the “TMI Adjuster”. Figure 1 shows the overall framework and the list of datasets used in each model. The objective of the TMI Adjuster module is to deliver reliable, consistent and expedited recommendations for the progression, adjustment, and termination of TMIs. The ML solution entails developing a pipeline capable of predicting the necessity of a TMI (e.g., GS or GDP) along with its various parameters. For example, in the case of a GS, this includes the scope of the GS either in terms of distance from the destination airport or based on pre-defined airspace sectors. Here, scope refers to those regions and departing airports that are subject to the GS. In this paper, we concentrate on the issuance of GSs in the three major airports in the New York area — LaGuardia(LGA), John F. Kennedy International (JFK), and Newark Liberty International (EWR). We fuse traffic, weather and other relevant aviation data from years 2017 to 2019 to train and validate the ML models. In particular, we use the following datasets: •Terminal Aerodrome Forecast (TAF): meteorological forecasts specific to each airport, issued four times a day, covering predefined time periods. •TMI data: includes all GSs and GDPs along with their respective parameters. •Aviation System Performance Metrics (ASPM): includes traffic related data such as aircraft delays, arrival, and departure rates. •Notices to Airmen (NOTAMs): utilized to extract runway closure data and manage interdependencies between terminals in close proximity. •Flight cancellation data •Airspace Flow Programs (AFP): includes information on flight airborne holdings caused by TMIs. The data preprocessing entails transforming ASPM, TMI, AFP, NOTAMs, and weather data into an hourly format and consolidating all datasets by merging them based on date and time as the primary key. The TMI Adjuster framework comprises two parallel models: one dedicated to GS and a second model focused on GDP. As previously mentioned, our specific focus is on the GS model as a multi-classification problem. In this framework, each data point of the GS model input summarizes ten hours of data. Specifically, the data loader for the GS model generates the input and output of the model as follows: at a given time step, the input includes the actual traffic, weather, and TMI data from the two-hour window before the time step, alongside the weather forecast and scheduled traffic for the next 8 hours starting from the time step. Based on this information, the output of the GS model for each time interval consists of three dimensions. The first dimension represents a binary decision on whether there should be a GS in place for the next hour or not. The second dimension is related to the scope of the GS in the United States, and the third dimension is related to the scope of the GS in Canada (i.e., to determine if the GS impacts airports in Canada).One of the challenges with TMI modeling is the sparsity of TMI events, particularly regarding its scope. To address this challenge in the scope of the GS model output, we implement grouping. The GS scope for the US region is defined based on a list of centers that should be included when the GS is in place. With 20 centers in the US, we utilized historical data to group them into 4 categories. In particular, we summarized our historical data in a graph format where nodes represent centers, and link weights are defined based on the co-occurrence of centers in the scope parameter ofTMIs. By identified strongly connected components in this graph, we were able to partition the centers into four groups. We consider two model structures for the GS Model. Firstly, a hierarchical classification model [10], where the human decision-making for a GS is of hierarchical nature. The decision-maker first decides whether there is a need fora GS, and if the answer is yes, determines the scope. A hierarchical classification model organizes the problem into a class hierarchy, typically a tree or a Directed Acyclic Graph (DAG) structure, and considers the dependency of the decision in the previous step to the next component [10]. Here, we employ the local classifier per level approach, which involves training one multi-class classifier for each level of the class hierarchy. The second structure is the independent structure. In this setting, as the name suggests, we do not consider the dependency of the decisions in the different dimensions of the output of the model. Instead, for each dimension, we train a multi-class classifier independently. Table 1 summarizes GS model statistics for training, validation and testing. The table documents the effect of limiting data to the time steps when there was actually a TMI in place or when a TMI had just terminated. This resulted in a more balanced distribution of the GS class(GS positive class)versus “No GS”(GS negative class), which might help the training process. While JFK and LGA follow very similar distributions, with 40% and 42% GS positive class respectively, EWR has proportionally fewer GS incidents at 28%. Our subsequent phase involves evaluating the performance of both hierarchical structure and independent structure using different state-of-the-art multi-class classifier models such as Random Forest, Decision Trees, K-nearest Neighbors, and Logistic Regression and forecast the duration and scope of the GSs.

Farzan Masrour Shalmani↗

Reinforcement learning applied to dilute combustion control for increased fuel efficiency

To reduce the modeling burden for control of spark-ignition engines, reinforcement learning (RL) has been applied to solve the dilute combustion limit problem. Q-learning was used to identify an optimal control policy to adjust the fuel injection quantity in each combustion cycle. A physics-based model was used to determine the relevant states of the system used for training the control policy in a data-efficient manner. The cost function was chosen such that high cycle-to-cycle variability (CCV) at the dilute limit was minimized while maintaining stoichiometric combustion as much as possible. Experimental results demonstrated a reduction of CCV after the training period with slightly lean combustion, contributing to a net increase in fuel conversion efficiency of 1.33%. To ensure stoichiometric combustion for three-way catalyst compatibility, a second feedback loop based on an exhaust oxygen sensor was incorporated into the fuel quantity controller using a slow proportional-integral (PI) controller. The closed-loop experiments showed that both feedback loops can cooperate effectively, maintaining stoichiometric combustion while reducing combustion CCV and increasing fuel conversion efficiency by 1.09%. Finally, a modified cost function was proposed to ensure stoichiometric combustion with a single controller. In addition, the learning period was shortened by half to evaluate the RL algorithm performance on limited training time. Experimental results showed that the modified cost function could achieve the desired CCV targets, however, the learning time was reduced by half and the fuel conversion efficiency increased only by 0.30%.

33 ADVANCED PROPULSION SYSTEMS↗

Addressing Human System Risks to Future Space Exploration

NASA is contemplating future human exploration missions to destinations beyond low Earth orbit, including the Moon, deep-space asteroids, and Mars. While we have learned much about protecting crew health and performance during orbital space flight over the past half-century, the challenges of these future missions far exceed those within our current experience base. To ensure success in these missions, we have developed a Human System Risk Board (HSRB) to identify, quantify, and develop mitigation plans for the extraordinary risks associated with each potential mission scenario. The HSRB comprises research, technology, and operations experts in medicine, physiology, psychology, human factors, radiation, toxicology, microbiology, pharmacology, and food sciences. Methods: Owing to the wide range of potential mission characteristics, we first identified the hazards to human health and performance common to all exploration missions: altered gravity, isolation/confinement, increased radiation, distance from Earth, and hostile/closed environment. Each hazard leads to a set of risks to crew health and/or performance. For example the radiation hazard leads to risks of acute radiation syndrome, central nervous system dysfunction, soft tissue degeneration, and carcinogenesis. Some of these risks (e.g., acute radiation syndrome) could affect crew health or performance during the mission, while others (e.g., carcinogenesis) would more likely affect the crewmember well after the mission ends. We next defined a set of design reference missions (DRM) that would span the range of exploration missions currently under consideration. In addition to standard (6-month) and long-duration (1-year) missions in low Earth orbit (LEO), these DRM include deep space sortie missions of 1 month duration, lunar orbital and landing missions of 1 year duration, deep space journey and asteroid landing missions of 1 year duration, and Mars orbital and landing missions of 3 years duration. We then assessed the likelihood and consequences of each risk against each DRM, using three levels of likelihood (Low: less than or equal to 0.1%; Medium: 0.1%–1.0%; High: greater than or equal to 1.0%) and four levels of consequence ranging from Very Low (temporary or insignificant) to High (death, loss of mission, or significant reduction to length or quality of life). Quantitative evidence from clinical, operational, and research sources were used whenever available. Qualitative evidence was used when quantitative evidence was unavailable. Expert opinion was used whenever insufficient evidence was available. Results: A set of 30 risks emerged that will require further mitigation efforts before being accepted by the Agency. The likelihood by consequence risk assessment process provided a means of prioritizing among the risks identified. For each of the high priority risks, a plan was developed to perform research, technology, or standards development thought necessary to provide suitable reduction of likelihood or consequence to allow agency acceptance. Conclusion: The HSRB process has successfully identified a complete set of risks to human space travelers on planned exploration missions based on the best evidence available today. Risk mitigation plans have been established for the highest priority risks. Each risk will be reassessed annually to track the progress of our risk mitigation efforts.

Paloski, W. H.↗

DeepGrid: Robust Deep Reinforcement Learning-based Contingency Management

Increasing uncertainty raised by the integration of renewable energy resources requires an enormous number of simulations to be carried out for the security assessment of the power grid. However, it is challenging to assess the steady-state and dynamic security indices for different system contingency events by doing an exhaustive analysis in real-time due to the computational and communication constraints. One promising solution is using data-driven techniques along with the system models to train an intelligent contingency management framework to better handle the contingencies in real-time. Nevertheless, implementing a data-driven technique to obtain the best remedial actions necessitates to account for the effect of the measurement noise on the performance of the contingency management. To tackle these challenges, we leverage a robust deep reinforcement learning (DRL) algorithm called Double Deep Q-Network (DDQN) to design a recommender system capable of prescribing optimal control actions with the help of the real-time digital simulator (RTDS). The use of RTDS system in combination with the advanced DRL algorithm allows to explore a wide variety of system contingencies in order to derive better remedial actions. The performance of the proposed algorithm is evaluated in IEEE 9-bus system under different loading conditions, and different network configurations in presence of noisy measurements.

Ghasemkhani, Amir↗

Multiscale Modeling Meets Machine Learning: What Can We Learn?

Machine learning is increasingly recognized as a promising technology in the biological, biomedical, and behavioral sciences. There can be no argument that this technique is incredibly successful in image recognition with immediate applications in diagnostics including electrophysiology, radiology, or pathology, where we have access to massive amounts of annotated data. However, machine learning often performs poorly in prognosis, especially when dealing with sparse data. This is a field where classical physics-based simulation seems to remain irreplaceable. In this review, we identify areas in the biomedical sciences where machine learning and multiscale modeling can mutually benefit from one another: Machine learning can integrate physics-based knowledge in the form of governing equations, boundary conditions, or constraints to manage ill-posted problems and robustly handle sparse and noisy data; multiscale modeling can integrate machine learn- ing to create surrogate models, identify system dynamics and parameters, analyze sensitivities, and quantify uncertainty to bridge the scales and understand the emergence of function. With a view towards applications in the life sciences, we discuss the state of the art of combining machine learning and multiscale modeling, identify applications and opportunities, raise open questions, and address potential challenges and limitations. We anticipate that it will stimulate discussion within the community of computational mechanics and reach out to other disciplines including mathematics, statistics, computer science, artificial intelligence, biomedicine, systems biology, and precision medicine to join forces towards creating robust and efficient models for biological systems.

machine learning, multiscale modeling, physics-bas↗

High Throughput Computational Framework of Materials Properties for Extreme Environments

This project aims to establish a framework capable of efficiently predicting the properties of structural materials for service in harsh environments over a wide range of temperatures and over long periods of time. The approach is to develop and integrate high throughput first-principles calculations in combination with machine learning (ML) methods, perform high throughput CALPHAD (calculations of phase diagrams) modeling, and carry out finite element method (FEM) simulations. Relevant to high temperature service in fossil power system, nickel-based superalloys such as Inconel 740 and Haynes 282 as well as the associated (Ni-Cr-Co)-Al-C-Fe-Mn-Mo-Nb-Si-Ti system, were investigated. The present framework was built on the concept of phase-based property data, in which properties of individual phases are modeled as a function of internal and external independent variables. This project established an open-source infrastructure with the following capabilities: (1) High throughput implementation of first-principles calculations at finite temperatures and variable compositions using both accurate phonon calculations and the efficient Debye model for thermodynamic properties, elastic constants, diffusion coefficients, vacancy formation, stacking and twin faults, and dislocation mobility; i.e., using the developed code DFTTK; (2) Machine learning capabilities to predict the above properties so that the number of first-principles calculations can be significantly reduced; e.g., using the developed code SIPFENN; (3) High throughput CALPHAD modeling of the above properties as a function of temperature and composition using our unique capability based on ESPEI and PyCalphad; (4) New capabilities to predict the stress-strain behavior of individual phases; and (5) New models for tensile strength prediction in common FEM software with the crystal plasticity finite element simulations (CPFEM).

, Ni-based superalloys↗