Search NASA⌕ Search

SEARCH · Search NASA

Results for “agent based modeling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 649 records · Page 36

Optimizing Long Term Hydrogen Fueling Infrastructure Plans on Freight Corridors for Heavy Duty Fuel Cell Electric Vehicles

The development of a future hydrogen energy economy will require the development of several hydrogen market and industry segments including a hydrogen based commercial freight transportation ecosystem. For a sustainable freight transportation ecosystem, the supporting fueling infrastructure and the associated vehicle powertrains making use of hydrogen fuel will need to be co-established. This paper develops a long-term plan for refueling infrastructure deployment using the OR-AGENT (Optimal Regional Architecture Generation for Electrified National Transportation) tool developed at the Oak Ridge National Laboratory, which has been used to optimize the hydrogen refueling infrastructure requirements on the I-75 corridor for heavy duty (HD) fuel cell electric commercial vehicles (FCEV). This constraint-based optimization model considers existing fueling locations, regional specific vehicle fuel economy and weight, vehicle origin and destination (OD), vehicle volume by class and infrastructure costs to characterize in-mission refueling requirements for a given freight corridor. The authors applied this framework to determine the ideal long term public access locations for hydrogen refueling (constrained by existing fueling stations and dispensing technology), the minimal viable cost to deploy sufficient hydrogen fuel dispensers, and associated equipment, to accommodate a growing population of hydrogen fuel cell trucks. So the framework discussed in this paper can be expanded and applied to additional electrified powertrains as well as a larger interstate system, expanded regional corridor, or other transportation networks.

08 HYDROGEN↗

Efficacy of Climate Forcings in PDRMIP Models

Quantifying the efficacy of different climate forcings is important for understanding the real‐world climate sensitivity. This study presents a systematic multimodel analysis of different climate driver efficacies using simulations from the Precipitation Driver and Response Model Intercomparison Project (PDRMIP). Efficacies calculated from instantaneous radiative forcing deviate considerably from unity across forcing agents and models. Effective radiative forcing (ERF) is a better predictor of global mean near‐surface air temperature (GSAT) change. Efficacies are closest to one when ERF is computed using fixed sea surface temperature experiments and adjusted for land surface temperature changes using radiative kernels. Multimodel mean efficacies based on ERF are close to one for global perturbations of methane, sulfate, black carbon, and insolation, but there is notable intermodel spread. We do not find robust evidence that the geographic location of sulfate aerosol affects its efficacy. GSAT is found to respond more slowly to aerosol forcing than CO2 in the early stages of simulations. Despite these differences, we find that there is no evidence for an efficacy effect on historical GSAT trend estimates based on simulations with an impulse response model, nor on the resulting estimates of climate sensitivity derived from the historical period. However, the considerable intermodel spread in the computed efficacies means that we cannot rule out an efficacy‐induced bias of ±0.4 K in equilibrium climate sensitivity to CO2 doubling when estimated using the historical GSAT trend.

T B Richardson↗

Optimizing Hydrogen Fueling Infrastructure Plans on Freight Corridors for Heavy-Duty Fuel Cell Electric Vehicles

The development of a future hydrogen energy economy will require the development of several hydrogen market and industry segments including a hydrogen-based commercial freight transportation ecosystem. For a sustainable freight transportation ecosystem, the supporting fueling infrastructure and the associated vehicle powertrains making use of hydrogen fuel will need to be co-established. This article introduces the OR-AGENT (Optimal Regional Architecture Generation for Electrified National Transportation) tool developed at the Oak Ridge National Laboratory, which has been used to optimize the hydrogen refueling infrastructure requirements on the I-75 corridor for heavy-duty (HD) fuel cell electric commercial vehicles (FCEV). This constraint-based optimization model considers existing fueling locations, regional-specific vehicle fuel economy and weight, vehicle origin and destination (O-D), and vehicle volume by class and infrastructure costs to characterize in-mission refueling requirements for a given freight corridor. The authors applied this framework to determine the ideal public access locations for hydrogen refueling (constrained by existing fueling stations), the minimal viable cost to deploy sufficient hydrogen fuel dispensers, and associated equipment, to accommodate a growing population of hydrogen fuel cell trucks. The framework discussed in this article can be expanded and applied to a larger interstate system, expanded regional corridor, or other transportation network. This article is the third in a series of papers that defined the model development to optimize a national hydrogen refueling infrastructure ecosystem for HD commercial vehicles.

33 ADVANCED PROPULSION SYSTEMS↗

Fire Suppression in Low Gravity Using a Cup Burner

Longer duration missions to the moon, to Mars, and on the International Space Station increase the likelihood of accidental fires. The goal of the present investigation is to: (1) understand the physical and chemical processes of fire suppression in various gravity and O2 levels simulating spacecraft, Mars, and moon missions; (2) provide rigorous testing of numerical models, which include detailed combustion-suppression chemistry and radiation sub-models; and (3) provide basic research results useful for advances in space fire safety technology, including new fire-extinguishing agents and approaches.The structure and extinguishment of enclosed, laminar, methane-air co-flow diffusion flames formed on a cup burner have been studied experimentally and numerically using various fire-extinguishing agents (CO2, N2, He, Ar, CF3H, and Fe(CO)5). The experiments involve both 1g laboratory testing and low-g testing (in drop towers and the KC-135 aircraft). The computation uses a direct numerical simulation with detailed chemistry and radiative heat-loss models. An agent was introduced into a low-speed coflowing oxidizing stream until extinguishment occurred under a fixed minimal fuel velocity, and thus, the extinguishing agent concentrations were determined. The extinguishment of cup-burner flames, which resemble real fires, occurred via a blowoff process (in which the flame base drifted downstream) rather than the global extinction phenomenon typical of counterflow diffusion flames. The computation revealed that the peak reactivity spot (the reaction kernel) formed in the flame base was responsible for attachment and blowoff of the trailing diffusion flame. Furthermore, the buoyancy-induced flame flickering in 1g and thermal and transport properties of the agents affected the flame extinguishment limits.

Takahashi, Fumiaki↗

Fire Suppression in Low Gravity Using a Cup Burner

Longer duration missions to the moon, to Mars, and on the International Space Station increase the likelihood of accidental fires. The goal of the present investigation is to: (1) understand the physical and chemical processes of fire suppression in various gravity and O2 levels simulating spacecraft, Mars, and moon missions; (2) provide rigorous testing of numerical models, which include detailed combustion suppression chemistry and radiation sub-models; and (3) provide basic research results useful for advances in space fire safety technology, including new fire-extinguishing agents and approaches. The structure and extinguishment of enclosed, laminar, methane-air co-flow diffusion flames formed on a cup burner have been studied experimentally and numerically using various fire-extinguishing agents (CO2, N2, He, Ar, CF3H, and Fe(CO)5). The experiments involve both 1g laboratory testing and low-g testing (in drop towers and the KC-135 aircraft). The computation uses a direct numerical simulation with detailed chemistry and radiative heat-loss models. An agent was introduced into a low-speed coflowing oxidizing stream until extinguishment occurred under a fixed minimal fuel velocity, and thus, the extinguishing agent concentrations were determined. The extinguishment of cup-burner flames, which resemble real fires, occurred via a blowoff process (in which the flame base drifted downstream) rather than the global extinction phenomenon typical of counterflow diffusion flames. The computation revealed that the peak reactivity spot (the reaction kernel) formed in the flame base was responsible for attachment and blowoff of the trailing diffusion flame. Furthermore, the buoyancy-induced flame flickering in 1g and thermal and transport properties of the agents affected the flame extinguishment limits.

Takahashi, Fumiaki↗

An mRNA vaccine encoding the Ebola virus glycoprotein induces high neutralizing antibody titers and provides strong protection against lethal infections in mouse models

Ebola virus (EBOV) is the causative agent of Ebola disease (EBOD), a viral hemorrhagic fever with a notably high case fatality rate. Current treatments for EBOD are limited to monoclonal antibodies or two licensed viral vector vaccines, a recombinant vesicular stomatitis virus (rVSV)-vectored vaccine or an adenovirus and modified vaccinia Ankara regimen. However, comparisons of protection, efficacy, and durability with alternative nucleotide platforms remain understudied. Here, we evaluated the immunogenicity of an mRNA vaccine expressing the EBOV glycoprotein (GP) in parallel with rVSV- and DNA-based vaccine platforms. The mRNA EBOV-GP vaccine, formulated in lipid nanoparticles, elicited significantly higher levels of total IgG and neutralizing antibody titers compared to the rVSV-EBOV-GP vaccine. Linear antibody epitope analysis indicated a preference for targeting the mucin-like domain in EBOV-GP1 following rVSV-based vaccination, while the mRNA platform distinctly targeted the internal fusion loop of EBOV-GP2. After characterizing the immunogenicity of the mRNA vaccine, two models of EBOD were used to demonstrate its protective efficacy: a surrogate rVSV-based challenge model of EBOD using type-I interferon deficient C57BL/6 mice and infection of BALB/c mice with authentic mouse-adapted EBOV. In both studies, the EBOV mRNA vaccine fully protected the mouse cohorts against morbidity and mortality. Additionally, the EBOV mRNA vaccine produced greater neutralizing antibody titers compared to the DNA EBOV-GP vaccine. These results suggest that an mRNA vaccine expressing EBOV-GP can induce robust, functional humoral responses that are protective against EBOD, warranting further development as an alternative to, or as part of a vaccine strategy including, viral vectored vaccines.

DNA vaccines↗

Simulation-based Design of a Shadow Shield for the MIND Backpack System

Modeling and simulation is a cost- and time-saving method to study conceptual designs of radiation detection systems. MCNP radiation transport code has been an indispensable tool in development of radiation detection systems, and the PINS systems have also utilized MCNP modeling and simulation in the system development. MCNP models of the PINS systems have been used to understand detector responses and to fill the gap in experimental data. Recently, the MIND backpack system was announced to be developed, and its prototype design was required to conduct laboratory tests and demonstrations. A shadow shield is the component to be designed by Idaho National Laboratory in order to maximize the performance of a backpack system while meeting the sponsor’s requirements. MCNP modeling and simulation was utilized to find the best specification of a shadow shield. This study was performed to down-select a shadow shield design for the MIND system. A total of 24 designs for a shadow shield were identified to build MCNP models, and their simulation results were used to prioritize each design. As a quantitative performance metric, an equation of Figure-of-Merit was introduced in the decision making analysis. In addition, the Analytic Hierarchy Process was adopted to prioritize and recommend best performing shadow shield designs.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Emergency Voltage Regulation in Power Systems via Ripple-Type Control

With increasing penetrations of volatile renewable generation and cyber-physical disruptions, ensuring the safe operation of bulk power systems has become unprecedentedly challenging. Because communication and computational costs restrict centralized system dispatch to being called upon every few minutes, and because purely local schemes are shown to be insufficient, distributed controls have been advocated for handling unanticipated system conditions in real time. The applicability of distributed control schemes, however, is fundamentally limited by their need for widespread communication and model cognizance. In this context, we put forth a hybrid, low-communication, saturation-driven protocol for the coordination of control agents that are distributed over a physical system and are allowed to communicate with peers over a "hotline" communication network. Under this protocol, when agents observe a constraint violation based on local measurements, they respond locally until their control resources saturate, in which case they send a beacon for assistance to peer agents. The scheme ensures that minor violations are efficiently mitigated via fast local controls, whereas severe violations can be handled by collaboration among a relatively small set of agents. We evaluate the performance of this scheme via numerical tests on the IEEE 14-bus test feeder, where agents act upon noisy measurements under diverse scenarios of load variations and severe low-/high-voltage events.

collaboration↗

Autonomous planning and scheduling on the TechSat 21 mission

The Autonomous Sciencecraft Experiment (ASE) will fly onboard the Air Force TechSat 21 constellation of three spacecraft scheduled for launch in 2006. ASE uses onboard continuous planning, robust task and goal-based execution, model-based mode identification and reconfiguration, and onboard machine learning and pattern recognition to radically increase science return by enabling intelligent downlink selection and autonomous retargeting.

AI architectures applications intelligent agents m↗

Node-Solution Microenvironment Governs the Selectivity of Thioanisole Oxidation within Catalytic Zr-Based Metal–Organic Framework

Lewis acidic metal oxides, including zirconia (ZrO 2 ), are catalytically active toward oxidative reactions in the presence of sacrificial oxidants like t-butyl hydroperoxide (TBHP). The structural ambiguity and heterogeneity of the ZrO 2 surface impose challenges to chemists in understanding the reaction mechanism down to atomic-level precision. The inorganic, Zr-oxo nodes of many crystalline metal–organic frameworks (MOFs) structurally mimic ZrO 2 . Herein, we report three novel findings: (A) Zr-based MOF, Zr-MOF-808 is catalytically competent in activating TBHP to induce oxygen atom transfer (OAT) reactions to a model substrate, thioanisole, at room temperature, (B) its reaction mechanism can be derived with greater structural precision owing to the crystallinity of the MOF, and (C) the node-binding agent and other reaction conditions significantly impact the selectivity between the singly oxidized methyl phenyl sulfoxide vs the doubly oxidized sulfone. These findings suggest that both the activity and selectivity of OAT reactions within Zr-MOF-808 are governed by the chemistry occurring at the interface of the node and the surrounding reaction medium. Implications of these findings in OAT reactions and other MOF/metal oxide-catalyzed relevant catalysis are discussed.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Techno-economic Analysis and Life Cycle Assessment of Gluconic Acid and Xylonic Acid Production from Waste Materials

Organic acid-based bioleaching has attracted significant research interest for the recovery of rare earth elements(REEs) and other critical metals. Utilizing biologically produced leaching agents, known as biolixiviants, derived from waste materials holds great promise for enhancing the economic viability and environmental sustainability of bioleaching processes. Here this study focuses on the modeling and optimization of biolixiviant production using corn stover (CS), date palm clippings (DP), and nonrecyclable paper (NP). Techno-economic analysis revealed that gluconic acid production from NP is more cost-effective than that from CS and DP, with respective costs of $0.04/kg, $0.06−0.08/kg, and $0.06−0.09/kg of the biolixiviant, yielding gluconic acid concentrations of 135.39, 172.90, and 176.87 mM, respectively. Life cycle assessment demonstrated that biolixiviant production from NP exerts the lowest environmental impact compared with the other evaluated substrates. When applied to the bioleaching of a neodymium−iron−boron magnet swarf, the biolixiviant derived from NP exhibits the highest leaching efficiencies, confirming its cost and environmental competitiveness in comparison to CS and DP

60 APPLIED LIFE SCIENCES↗

Towards Autonomous Lunar Resource Excavation via Reinforcement Learning

To continue on a sustainable and flexible path, NASA needs to address the challenge of collecting and moving large amounts of regolith at the destination. NASA’s Regolith Advanced Surface Systems Operations Robot (RASSOR) is principally designed to mine and deliver regolith for In-Situ Resource Utilization (ISRU) processing. RASSOR’s design enables it to efficiently collect and deposit regolith, return collected material for processing, and myriad related ISRU activities. To reliably perform these operations on the lunar surface, RASSOR software and sensory systems need to be robust and maximize the information extracted from a reduced sensor payload. Herein, we present preliminary findings from the Intelligent Capabilities Enhanced RASSOR project. We created reduced-order simulation environments to develop autonomous trenching controllers via reinforcement learning and prototype state estimation architectures. The goal of reinforcement learning is for an agent to learn a policy (task strategy) through interactions with an environment. When the agent performs an action, a change occurs in environment state and a numerical reward is received which informs the agent whether the action performed was good or not. Since reinforcement learning algorithms learn through trial-and-error, a simulation is a desirable first environment for development and learning. We developed two simulations, the first is a 2D excavation simulation developed to facilitate parameter selection, and a 3D simulation developed using a game physics engine, to simulate simplified soil interactions and increase the fidelity of the dynamic models of the robotic agents. The development of this 3D simulation has enabled the training of additional sensing capabilities and research both at the granular mechanics and operations levels. We experimented with various virtual sensor payloads to identify a combination that enabled efficient excavation operation and learning. Our reward function is based on how much material is excavated per step. A penalty is also received for leaving the dig site and to smooth the acceleration of the drum arms. We implemented pseudo time-of-flight sensors to report distance from each drum to ground and the height above ground which was found to be more efficient than existing solutions. Our findings suggest that reinforcement learning for autonomous operations has learned viable trenching strategies within 3000 training episodes in our simplified 2D environment and helped identify desirable sensing capabilities, arrangements, and considerations such as the positioning of time-of-flight sensors. Future work includes expanding our simulation to more complex environments and scenarios, and transfer learning from simulation to RASSOR 2.0 hardware for deployment in the Regolith Test Bin at NASA's Kennedy Space Center.

rassor↗

An experimental and numerical study of wellbore leakage mitigation using pH-triggered polymer gelant

The potential leakage of hydrocarbon fluids or carbon dioxide from subsurface formations is a primary concern in wellbore integrity, oil and gas production, and CO 2 storage. Leaky wells with fractured cement or debonded microannuli are common sources of subsurface fluid leakage. The hydrocarbon fluid or CO 2 can migrate through such pathways to shallower formations and ultimately to surface. Cement fractures may have apertures on the order of microns, which are difficult to seal with typical workover techniques. A material that provides low viscosity during the injection but much higher viscosity after injection, with a minimum pressure gradient to yield flow at the target zone, is a potentially effective approach to seal the leakage pathways through cement fractures. pH-triggered polymers are such a material: aqueous solutions with low viscosity at low pH, containing pH-sensitive microgels which viscosify upon neutralization to become highly swollen gels with substantial yield stress that can block fluid flow. For the wellbore leakage application, the large alkalinity of wellbore cement provides the required neutralization. Our coreflood and rheological experiments show that pH-triggered polymer sealants such as polyacrylic acid polymer provide a robust seal if the process is properly designed; however, its long-term applicability depends on the dynamic geochemical environment of the wellbore. The process comprises three stages: (1) injection of a chelating agent as the preflush to ensure a favorable environment for the polymer gel, (2) injection of polymer solution, and (3) shut-in for the polymer gelation. A systematic study was done to understand the conditions under which the polymer gel remains stable and effectively seals the leakage pathways. A numerical model, based on polymer rheological properties and governing mechanisms observed in the laboratory experiments, was developed to simulate the reactive flow and transport of pH-triggered polymers in narrow fractures. Comparison with experiments shows a generally good agreement, despite the relative simplicity of the model. The numerical model was used to investigate further the underlying mechanisms of the process. The results can be used to design effectively the remediation process for a known fracture aperture size of the target zone.

42 ENGINEERING↗

CHARMM-GUI Glycan Modeler for modeling and simulation of carbohydrates and glycoconjugates

Characterizing glycans and glycoconjugates in the context of three-dimensional structures is important in understanding their biological roles and developing efficient therapeutic agents. Computational modeling and molecular simulation have become an essential tool complementary to experimental methods. In this work, we present a computational tool, Glycan Modeler for in silico N–/O –glycosylation of the target protein and generation of carbohydrate-only systems. In our previous study, we developed Glycan Reader , a web-based tool for detecting carbohydrate molecules from a PDB structure and generation of simulation system and input files. As integrated into Glycan Reader in CHARMM-GUI, Glycan Modeler (Glycan Reader & Modeler) enables to generate the structures of glycans and glycoconjugates for given glycan sequences and glycosylation sites using PDB glycan template structures from Glycan Fragment Database (http://glycanstructure.org/fragment-db). Our benchmark tests demonstrate the universal applicability of Glycan Reader & Modeler to various glycan sequences and target proteins. We also investigated the structural properties of modeled glycan structures by running 2-μs molecular dynamics simulations of HIV envelope protein. The simulations show that the modeled glycan structures built by Glycan Reader & Modeler have the similar structural features compared to the ones solved by X-ray crystallography. We also describe the representative examples of glycoconjugate modeling with video demos to illustrate the practical applications of Glycan Reader & Modeler . Glycan Reader & Modeler is freely available at http://charmm-gui.org/input/glycan.

59 BASIC BIOLOGICAL SCIENCES↗

A Learning-based Power Management Method for Networked Microgrids Under Incomplete Information

In this paper, we present a model-free reinforcement learning (RL)-based technique to solve the power management problem of networked microgrids (MGs), when the utility has only limited or no detailed knowledge of the MG asset models.The proposed method consists of two levels: at the first level, using an approximate RL strategy and aggregated data, a utility agent determines the locational price signals to maximize its profit under incomplete information on the MGs’ private data behind their points of common coupling (PCC). The proposed RL strategy enables the utility to adapt to changing system conditions and learn from previous experiences, while respecting the data ownership of the MGs. At the second level, the MGs receive the price signals to dispatch their generation/storage assets individually over look-ahead decision time window, while considering power flow constraints. The performance of the proposed RL technique has been verified under realistic operational scenarios.

Zhang, Qianzhi↗

The autonomous sciencecraft constellations

The Autonomous Sciencecraft Experiment (ASE) will fly onboard the Air Force TechSat 21 constellation of three spacecraft scheduled for launch in 2006. ASE uses onboard continuous planning, robust task and goal-based execution, model-based mode identification and reconfiguration, and onboard machine learning and pattern recognition to radically increase science return by enabling intelligent downlink selection and autonomous retargeting. In this paper we discuss how these AI technologies are synergistically integrated in a hybrid multi-layer control architecture to enable a virtual spacecraft science agent. Demonstration of these capabilities in a flight environment will open up tremendous new opportunities in planetary science, space physics, and earth science that would be unreachable without this technology.

Autonomous Sciencecraft Experiment ASE AI technolo↗

Spacecraft autonomy using onboard processing for a SAR constellation mission

The Autonomous Sciencecraft Experiment (ASE) will fly onboard the Air Force TechSat 21 constellation of three spacecraft scheduled for launch in 2006. ASE uses onboard continuous planning, robust task and goal-based execution, model-based mode identification and reconfiguration, and onboard machine learning and pattern recognition to radically increase science return by enabling intelligent downlink selection and autonomous retargeting. In this paper we discuss how these AI technologies are synergistically integrated in a hybrid multi-layer control architecture to enable a virtual spacecruft science agent. Demonstration of these capabilities in a flight environment will open up tremendous new opportunities in planetary science, space physics, and earth science that would be unreachable without this technology.

Autonomous Sciencecraft Experiment ASE virtual spa↗

Emergency Voltage Regulation in Power Systems via Ripple-Type Control: Preprint

With increasing penetration of volatile renewable generation and cyber-physical disruptions, ensuring safe operation of bulk power systems has become unprecedentedly challenging. Since communication and computational costs restrict centralized system dispatch to be called upon every few minutes; and purely local schemes are shown to be insufficient, distributed controls have been advocated for handling unanticipated system conditions in real time. However, the applicability of distributed control schemes is fundamentally limited by their need for widespread communication and model cognizance. In this con-text, we put forth a hybrid low-communication saturation-driven protocol for the coordination of control agents that are distributed over a physical system and are allowed to communicate with peers over a ‘hotline’ communication network. Under this protocol, when agents observe a constraint violation based on local measurements, they respond locally until their control resources saturate, in which case they send a beacon for assistance to peer agents. The scheme ensures that minor violations are efficiently mitigated via fast local controls, while severe violations may be handled by a collaboration of a relatively small set of agents. We evaluate the performance of this scheme via extensive numerical tests on the IEEE 14-bus test feeder, where agents act upon noisy measurements under diverse scenarios of random load variations and severe low/high voltage events.

distributed control↗