Search NASA⌕ Search

SEARCH · Search NASA

Results for “Game engine”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12
All sourcesNASA NTRSDOE OSTI
NASA NTRS2018

NASA's Space Launch System: Unprecedented Payload Capabilities

As NASA turns 60 and plans to transition the International Space Station (ISS) and other low-Earth orbit (LEO) activities to commercial enterprises, the Agency's human exploration program turns its focus to deep space. With missions planned to send astronauts back to the Moon and to construct a lunar orbiting Gateway for surface access as well as science experiments and technology demonstrations, NASA requires a vehicle with capabilities for launching more mass and volume than is currently commercially available. To that end, NASA and its private sector partners are building the Space Launch System (SLS) super heavy-lift launch vehicle, which will send the new Orion crew capsule, eventually with a complement of four astronauts, to cislunar space for the first time since the Apollo Program in the 1960s and 1970s. NASA Kennedy Space Center's (KSC's) Exploration Ground Systems (EGS) Program has upgraded and refurbished ground and launch facilities to process, assemble and launch NASA's new deep space exploration system, which is managed by the Exploration Systems Development (ESD) organization in the Human Exploration and Operations Mission Directorate (HEOMD). Offering an unmatched combination of power, payload capacity and departure energy, the evolvable SLS features the world's most proven propulsion system: solid rocket boosters and RS-25 main engines with a modified Delta Cryogenic Second Stage (DCSS) cryogenic upper stage. The initial SLS configuration, Block 1, will deliver at least 26 metric tons (t) to trans-lunar injection (TLI). The second variant, Block 1B, will deliver at least 34 t to TLI in its crew configuration and at least 40 t to TLI in its cargo configuration. The Block 1 cargo vehicle will fly with an industry-standard 5 m fairing while the Block 1B cargo configuration will accommodate 8 m-diameter fairings in varying lengths. The Block 2 vehicle will incorporate upgraded boosters and possibly larger fairings for launching Mars-class payloads to deep space. Although designed to enable human exploration of deep space, the vehicle also provides game-changing benefits for large science payloads and even harnesses excess capacity to provide small satellites with access to deep space. Three flights of the Block 1 vehicle are now planned; the first vehicle, being built for a test flight known as Exploration Mission-1 (EM-1), is nearing completion at NASA and contractor sites across the United States. In fact, hardware for the second mission has also been built. This paper will provide an overview of the SLS vehicle, with a focus on its payload accommodations and the missions enabled by the unprecedented payload volume and departure energy of SLS. This paper also describes the status of the manufacturing and integration for first flight and beyond.

Exploration Mission-1↗
DOE OSTI2022

Interference Moral Hazard in Large Multihop Networks

Cooperation between network nodes is critical for supporting services in ad hoc networks. Cooperation, however, is an idealized assumption that may not always be present. This assumption can fail because of moral hazard, a scenario in part caused by misaligned incentives between the requesting node and supporting node. In this paper, we characterize a moral hazard that perversely incentivizes nodes to increase their routing payments by transmitting interference into the multi-hop network. We refer to this as the interference moral hazard (IMH) problem which is inherent to strategyproof mechanisms with low overpayments. We investigate IMH as a non-cooperative game played by network nodes on a random graph. For large networks, we show that IMH can be solved in the network design space. Finally, we provide sufficient conditions on the network distribution that guarantee an equilibrium path with interference-free play. This is achieved by 1) lower-bounding the number of nodes and 2) bounding the network density slightly above the 2-connectedness threshold and below a proposed upper-bound. Simulations suggest that density plays a fundamental role in IMH.

42 ENGINEERING↗
DOE OSTI2022

Quantum model learning agent: characterisation of quantum systems through machine learning

Accurate models of real quantum systems are important for investigating their behaviour, yet are difficult to distil empirically. Here, we report an algorithm—the quantum model learning agent (QMLA)—to reverse engineer Hamiltonian descriptions of a target system. We test the performance of QMLA on a number of simulated experiments, demonstrating several mechanisms for the design of candidate Hamiltonian models and simultaneously entertaining numerous hypotheses about the nature of the physical interactions governing the system under study. QMLA is shown to identify the true model in the majority of instances, when provided with limited a priori information, and control of the experimental setup. Our protocol can explore Ising, Heisenberg and Hubbard families of models in parallel, reliably identifying the family which best describes the system dynamics. We demonstrate QMLA operating on large model spaces by incorporating a genetic algorithm to formulate new hypothetical models. The selection of models whose features propagate to the next generation is based upon an objective function inspired by the Elo rating scheme, typically used to rate competitors in games such as chess and football. In all instances, our protocol finds models that exhibit F 1 score ≥ 0.88 when compared with the true model, and it precisely identifies the true model in 72% of cases, whilst exploring a space of over 250 000 potential models. By testing which interactions actually occur in the target system, QMLA is a viable tool for both the exploration of fundamental physics and the characterisation and calibration of quantum devices.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS2017

Current EBC Development and Testing at NASA

SiC SiC Ceramic Matrix Composites (CMCs) are a game changer for advanced power generation equipment because of their high temperature capability, oxidation resistance, and light weight that translate to significant reduction in fuel consumption and emission. Limitations of SiC SiC CMCs include surface recession and component cracking and associated chemical and physical degradation in the CMC. The solution pursued to mitigate surface recession of SiC SiC CMCs is the incorporation of coating systems that provide surface protection, which has become known as an Environmental Barrier Coating (EBC). The development of EBCs for the protection of SiC SiC CMCs was a continuation of coating development work for corrosion protection of silicon-based monolithics. The first and second generation EBCs developed in mid 1990s-early 2000s laid the foundation for current EBCs. Environmental degradation that limits EBC life includes surface recession by steam, oxidation in steam environments, and CMAS-EBC reactions. Many engine tests have been conducted since late 1990s and a first CMC component entered into service in 2016 in a commercial engine. The introduction of CMCs represents significant challenges as failure of the EBC means rapid reduction in component life. A reliable lifing method and engine-relevant testing methods to validate life need to be developed. This paper will current activities on EBC development and testing at NASA.

CMC↗
DOE OSTI2025

Ca X ML: Chemistry‐informed machine learning explains mutual changes between protein conformations and calcium ions in calcium‐binding proteins using structural and topological features

Proteins' flexibility is a feature in communicating changes in cell signaling instigated by binding with secondary messengers, such as calcium ions, associated with the coordination of muscle contraction, neurotransmitter release, and gene expression. When binding with the disordered parts of a protein, calcium ions must balance their charge states with the shape of calcium-binding proteins and their versatile pool of partners depending on the circumstances they transmit. Accurately determining the ionic charges of those ions is essential for understanding their role in such processes. However, it is unclear whether the limited experimental data available can be effectively used to train models to accurately predict the charges of calcium-binding protein variants. Here, we developed a chemistry-informed, machine-learning algorithm that implements a game theoretic approach to explain the output of a machine-learning model without the prerequisite of an excessively large database for high-performance prediction of atomic charges. We used the ab initio electronic structure data representing calcium ions and the structures of the disordered segments of calcium-binding peptides with surrounding water molecules to train several explainable models. Network theory was used to extract the topological features of atomic interactions in the structurally complex data dictated by the coordination chemistry of a calcium ion, a potent indicator of its charge state in protein. Our design created a computational tool of Ca X ML, which provided a framework of explainable machine learning model to annotate ionic charges of calcium ions in calcium-binding proteins in response to the chemical changes in an environment. Our framework will provide new insights into protein design for engineering functionality based on the limited size of scientific data in a genome space.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

3-D Printed Electro-Magnetic Objects for THz Communications

Advanced materials and manufacturing techniques will pave the path towards high quality electro-magnetic circuits that operate up through THz and into optics regime. Digital additive manufacturing (AM) techniques offer game-changing potential for large scale manufacturing of Radio-frequency (RF) circuits and system in custom 2D/3D geometries. The technical collaboration will explore the design flexibility and product customization capabilities of additive manufacturing techniques to process magnetic materials in custom 3D geometries with tailored dielectric properties and frequency response characteristics. Transformation of an RF circuit design idea into a 3D printed system using additive manufacturing techniques will bring together the elements of advanced materials, additive integration, and low-cost manufacturing for future advanced wireless communication systems.

36 MATERIALS SCIENCE↗
NASA NTRS2005

Game Plan

Industry proposals for the Crew Exploration Vehicle that NASA plans as a replacement for the space shuttle are due next week, but the agency's new chief says it might be necessary to slow the CEV procurement at first to speed it up later. After a quick trip to Kennedy Space Center for briefings on getting the space shuttle back in operation, Michael D. Griffin sat down with his growing staff last week to begin work on modifying the CEV procurement. "We are going to rethink our entire program in that area," he said during an inaugural press conference Apr. 18. The proposals due May 2 are being prepared in response to NASA's call for a "risk-reduction flight effort" in 2008 that would lead to delivery of a human-rated CEV in 2014. But Griffin was co-leader on an independent study in 2004 that recommended a way to get the CEV flying astronauts in 2010, the year President Bush has set as a deadline for retiring the space shuttle fleet. In that study, produced for The Planetary Society, Griffin and his team called for development of a 13-15-ton "Block 1" CEV limited to low Earth orbit (LEO) that would be launched atop a single space shuttle solid rocket motor (SRM), with a new cryogenic upper stage based on existing rocket engine technology, Under this approach, NASA would develop a "Block 2" CEV later for human exploration beyond LEO.

Morring, Frank, Jr.↗
DOE OSTI2021

Recent Cryogenic Carbon Capture™ Field Test Results

Sustainable Energy Solutions (SES) has been developing Cryogenic Carbon Capture™ (CCC) since 2008. In that time, two processes have been developed, the External Cooling Loop and Compressed Flue Gas CCC processes (CCC-ECL and CCC-CFG, respectively). The CCC-ECL process cools the flue gas with an external refrigerant loop. This process currently captures up to 1 tonne of CO2 per day (TPD). SES has tested CCC-ECL on real flue gas slip streams from subbituminous coal, bituminous coal, biomass, natural gas, shredded tires, and municipal waste fuels at field sites that include utility power stations, heating plants, cement kilns, and pilot-scale research reactors. The CO2 concentrations from these tests ranged from 5 to 22% on a dry basis. CO2 capture ranged from 95-99+% during these tests. Several other condensable species were also captured including NO2, SO2 and PMxx at 95+%. NO was also captured at a modest rate. The CCC-CFG process has been scaled up to a 0.25 ton per day system. This system has been tested on real flue gas streams including subbituminous coal, bituminous coal, and natural gas at field sites that include utility power stations, heating plants, and pilot-scale research reactors. CO2 concentrations for these tests ranged from 5 to 15% on a dry basis. CO2 capture ranged from 95-99+% during these tests. Several other condensable species were also captured including NO2, SO2, and PMxx at 95+%. NO was also captured at 90+%. Hg capture was also verified and the resulting effluent from CCC-CFG was below a 1ppt concentration. This paper will focus on discussion of the capabilities of CCC generally, the results of CCC-ECL field testing, and future steps surrounding the development of this technology. Test results that will be presented have been collected during 9 months of testing at a commercial power plant under funding from the US Department of Energy (DOE) and the host utility. Testing of one of the systems at a commercial cement plant in the United States will also be discussed. During this testing, the system captured CO2 from the cement plant and stored the CO2 in pressurized tanks. These tanks were provided to a partner company that later used the CO2 in a CO2 utilization demonstration. The CO2 was utilized to cure concrete manufactured using cement from the same plant where the CO2 was captured. This integrated capture and utilization demonstration was the first time that the cement industry has shown in the field that it can sequester its CO2 emissions in its main product stream. This represents a potential game changing solution for industrial CO2 emissions. Operational data and host-site feedback indicate that the CCC process is ideally suited for deployment into a variety of commercial environments. A few areas of de-risking remain to make sure the technology can meet very strict industrial reliability standards. These areas of de-risking are identified and discussed. The product CO2 is shown to meet specification for many uses including industrial and merchant applications. The technology is nearing readiness for deployment at commercial scale and several initial target markets have been identified.

20 FOSSIL-FUELED POWER PLANTS↗
DOE OSTI2024

Buyers Collusion in Incentivized Forwarding Networks: A Multi-Agent Reinforcement Learning Study

We present the issue of monetarily incentivized forwarding in a multi-hop mesh network architecture from an economic perspective. It is anticipated that credit-incentivized forwarding and relaying will be a simple method of exchanging transmission power and spectrum for connectivity. However, gateways and forwarding nodes, like any other free market, may create an oligopolistic market for the users they serve. In this study, a coalition scheme between buyers aims to address price control by gateways or nodes closer to gateways. In a Stackelberg competition game, buyer agents (users) and sellers (gateways) make decisions using reinforcement learning (RL), with decentralized Deep Q-Networks to buy and sell forwarding resources. We allow communication links between the buyers with a limited messaging space, without defining a collusion mechanism. The idea is to demonstrate that through messaging, and RL tacit collusion can emerge between agents in a decentralized setup. The multi-agent reinforcement learning (MARL) system is presented and analyzed from a machine-learning perspective. Moreover, MARL dynamics are discussed via mean field analysis to better understand divergence causes and make implementation recommendations for such systems. Finally, the simulation results show the results of coordination among the users.

42 ENGINEERING↗
DOE OSTI2025

Quantum Advantage in Trading: A Game-Theoretic Approach

Quantum games, like quantum algorithms, exploit quantum entanglement to establish strong correlations between strategic player actions. This paper introduces quantum game-theoretic models applied to trading and demonstrates their implementation on an ion-trap quantum computer. The results showcase a quantum advantage, previously known only theoretically, realized as higher-paying market Nash equilibria. This advantage could help uncover alpha in trading strategies, defined as excess returns compared to established benchmarks. These findings suggest that quantum computing could significantly influence the development of financial strategies.

Khan, Faisal Shah [Taqtics LLC, USA, Rethinc. Labs↗
NASA NTRS2009

Ares V: Game Changer for National Security Launch

NASA is designing the Ares V cargo launch vehicle to vastly expand exploration of the Moon begun in the Apollo program and enable the exploration of Mars and beyond. As the largest launcher in history, Ares V also represents a national asset offering unprecedented opportunities for new science, national security, and commercial missions of unmatched size and scope. The Ares V is the heavy-lift component of NASA's dual-launch architecture that will replace the current space shuttle fleet, complete the International Space Station, and establish a permanent human presence on the Moon as a stepping-stone to destinations beyond. During extensive independent and internal architecture and vehicle trade studies as part of the Exploration Systems Architecture Study (ESAS), NASA selected the Ares I crew launch vehicle and the Ares V to support future exploration. The smaller Ares I will launch the Orion crew exploration vehicle with four to six astronauts into orbit. The Ares V is designed to carry the Altair lunar lander into orbit, rendezvous with Orion, and send the mated spacecraft toward lunar orbit. The Ares V will be the largest and most powerful launch vehicle in history, providing unprecedented payload mass and volume to establish a permanent lunar outpost and explore significantly more of the lunar surface than was done during the Apollo missions. The Ares V consists of a Core Stage, two Reusable Solid Rocket Boosters (RSRBs), Earth Departure Stage (EDS), and a payload shroud. For lunar missions, the shroud would cover the Lunar Surface Access Module (LSAM). The Ares V Core Stage is 33 feet in diameter and 212 feet in length, making it the largest rocket stage ever built. It is the same diameter as the Saturn V first stage, the S-IC. However, its length is about the same as the combined length of the Saturn V first and second stages. The Core Stage uses a cluster of five Pratt & Whitney Rocketdyne RS-68B rocket engines, each supplying about 700,000 pounds of thrust. Its propellants are liquid hydrogen and liquid oxygen. The two solid rocket boosters provide about 3.5 million pounds of thrust at liftoff. These 5.5-segment boosters are derived from the 4-segment boosters now used on the Space Shuttle, and are similar to those used in the Ares I first stage. The EDS is powered by one J-2X engine. The J-2X, which has roughly 294,000 pounds of thrust, also powers the Ares I Upper Stage. It is derived from the J-2 that powered the Saturn V second and third stages. The EDS performs two functions. Its initial suborbital burns will place the lunar lander into a stable Earth orbit. After the Orion crew vehicle, launched separately on an Ares I, docks with the lander/EDS stack, EDS will ignite a second time to put the combined 65-metric ton vehicle into a lunar transfer orbit. When it stands on the launch pad at Kennedy Space Center late in the next decade, the Ares V stack will be approximately 381 feet tall and have a gross liftoff mass of 8.1 million pounds. The current point-of-departure design exceeds Saturn V s mass capability by approximately 40 percent. Using the current payload shroud design, Ares V can carry 315,000 pounds to 29-degree low Earth orbit (LEO) or 77,000 pounds to a geosynchronous orbit. Another unique aspect of the Ares V is the 33-foot-diameter payload shroud, which encloses approximately 30,400 cubic feet of usable volume. A larger hypothetical shroud for encapsulating larger payloads has been studied. While Ares V makes possible larger payload masses and volumes, it may alternately make possible more cost-effective mission design if the relevant payload communities are willing to consider an alternative to the existing approach that has driven them to employ complexity to solve current launch vehicle mass and volume constraints. By using Ares V s mass and volume capabilities as margin, payload designers stand to reduce development risk and cost. Significant progress has been made on the Ares V to support a plaed fiscal 2011 authority-to-proceed (ATP) milestone. The Ares V team is actively reaching out to external organizations during this early concept phase to ensure that the Ares V vehicle can be leveraged for national security, science, and commercial development needs. This presentation will discuss Ares V vehicle configuration, the path to the current concept, accomplishments to date, and potential payload utilization opportunities.

Sumrall, Phil↗
NASA NTRS2013

Speech Recognition Interfaces Improve Flight Safety

"Alpha, Golf, November, Echo, Zulu." "Sierra, Alpha, Golf, Echo, Sierra." "Lima, Hotel, Yankee." It looks like some strange word game, but the combinations of words above actually communicate the first three points of a flight plan from Albany, New York to Florence, South Carolina. Spoken by air traffic controllers and pilots, the aviation industry s standard International Civil Aviation Organization phonetic alphabet uses words to represent letters. The first letter of each word in the series is combined to spell waypoints, or reference points, used in flight navigation. The first waypoint above is AGNEZ (alpha for A, golf for G, etc.). The second is SAGES, and the third is LHY. For pilots of general aviation aircraft, the traditional method of entering the letters of each waypoint into a GPS device is a time-consuming process. For each of the 16 waypoints required for the complete flight plan from Albany to Florence, the pilot uses a knob to scroll through each letter of the alphabet. It takes approximately 5 minutes of the pilot s focused attention to complete this particular plan. Entering such a long flight plan into a GPS can pose a safety hazard because it can take the pilot s attention from other critical tasks like scanning gauges or avoiding other aircraft. For more than five decades, NASA has supported research and development in aviation safety, including through its Vehicle Systems Safety Technology (VSST) program, which works to advance safer and more capable flight decks (cockpits) in aircraft. Randy Bailey, a lead aerospace engineer in the VSST program at Langley Research Center, says the technology in cockpits is directly related to flight safety. For example, "GPS navigation systems are wonderful as far as improving a pilot s ability to navigate, but if you can find ways to reduce the draw of the pilot s attention into the cockpit while using the GPS, it could potentially improve safety," he says.

Source record↗
NASA NTRSDate not supplied

In-Space Inspection Needs: Opportunities for advanced NDE tools such as x-ray CT for additively manufactured parts, in-situ resource utilization, geological applications, and more

It is now 50 years since the first human presence on the surface of the Moon and as we strive to return with women and men in the next few years, we embrace new technical challenges, goals, and innovative solutions to address 21st century objectives. These new ambitions carry fresh challenges and risks, with the field of NDE playing an increasingly more relevant role towards meeting these essential goals. In recent years, more advanced NDE tools have triggered a rapid expansion of applications for the space industry. In particular, x-ray Computed Tomography (CT) has proven to be a trusted and powerful asset for spaceflight hardware inspection, as well as applied geotechnical analysis for natural materials (e.g., rocks, soils) for NASA and across industry. However, such methods have yet to be extended to “deep space” applications such as those that are now part of the US National Space Policy Directive (SPD-1) and the accelerated push to return humans to the Moon (i.e., Artemis). For this reason, advancing these powerful Earth-based laboratory methods via new technologies, integrated computational solutions, and creative engineering approaches is directly aligned with national space policies, as well as with multiple NASA Strategic Plan priorities. The use of x-ray CT at scales as fine as a few microns or smaller can identify spacecraft part failure modes relevant to quality assurance for flight hardware and AM parts such as those recently developed for ISS. This technology could also identify valuable metallic phases within geological materials (i.e., rocks or drill cores), enabling resource-relevant triage of samples for In-Situ Resource Utilization (ISRU) and high science value sample return to Earth laboratories. There is also significant application for 3D imaging tools for medical use such as inspecting protective gear as well as bone density degradation studies which are critical in establishing a sustained presence in space. Timing for development of these tools for space use is advantageous as we prepare for new opportunities in the next few years and recognize recent commercial technology advancements which make it feasible. Moreover, as NASA strives to take full advantage of developments in AM technologies, including In-Space Manufacturing (ISM), it is widely recognized that NDE tools such as CT will play an essential role in acceptance of these parts for widespread use. New in-space 3D inspection tools with complimentary technology such as AI-based automated feature recognition (accelerated by machine learning), rapid compositional analysis, and advanced sample manipulation, would be a game-changing step toward a new class of crew-based laboratory sensors once human outposts on the Moon are established.

In-Space Non-Destructive Evaluation↗
DOE OSTI2020

Medium-duty Urban Range Extended Connected Powertrain (Final Scientific Technical Report)

The project goal is to develop and demonstrate a Class 4 delivery vehicle that reduces fuel consumption by 50% or more when compared to an equivalent vehicle with a conventional internal combustion engine (ICE) powertrain driven on a comparable duty cycle. This shall be achieved using a plug-in hybrid electric (PHEV) configuration that optimizes the efficiency of the ICE. The proposed solution aims to be commercially viable for fleets to procure the system without additional incentives. To accomplish this, commercialized light-duty vehicle electric drive components shall be used. A PHEV configuration for Class 4 MD/HD vocational vehicles using commercialized light-duty vehicle electric drive components will require the development of a new topology for the hybrid powertrain applicable to medium-duty vehicles. Prior research indicates that an identified novel power split device could provide a fuel economy improvement potential of up to 51%. Utilizing an advanced battery management algorithm that will allow operation closer to the battery limits, the project will minimize battery capacity to achieve the desired performance results while maintaining the cost target for high commercialization. The solution must be cost effective to purchase and integrate into a Class 4 delivery vehicle, deliver the intended fuel economy improvement, and perform as well, or better, than the current conventional ICE powertrain. MD/HD vehicles typically require higher power, which is one factor that results in high costs for the powerful electric machines typical in larger HEV/PHEV systems. A key element in the project is the use of commercially available Bosch electric drive components (e.g., motors, batteries, and power electronics) from the larger passenger vehicle segment. This leverages the economies of scale to decrease cost and improve reliability beyond current purpose-built low-volume commercial vehicle components. These innovations will result in a game-changing PHEV system that meets DOE’s 50% fuel consumption reduction target, grants the vehicle an uncompromised driving range, and achieves the cost point for widespread adoption.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2023

Fuel-Based Nash Bargaining Approach for Adaptive Signal Control in an N -Player Cooperative Game

This paper presents a fuel-based game-theoretic approach for adaptive signal control. Our controller applies Nash bargaining (NB) in an n-player cooperative game to identify optimal phasing splits considering future traffic demands. The fuel-based NB controller utilizes an objective function that combines operational measures (delays and stops) with fuel consumption measures at intersections. The proposed controller was encoded in Python and then implemented and evaluated in a VISSIM microscopic traffic simulation model in an intersection with increasing volumes. The performance of the NB controller was compared to a traditional actuated control as the baseline. The results show that the NB controller was able to achieve superior environmental gains with a 17% saving in fuel consumption and a 17% reduction in CO emissions. In addition, the proposed controller was capable of maintaining acceptable operational conditions as it achieved a 20% reduction in delay, 8% reduction in the number of stops, and 8% reduction in queue lengths compared to the actuated controller. Compared to similar studies that applied NB for adaptive signal control, our fuel-based NB controller stands out as a promising approach to significantly improve fuel consumption at signalized intersections.

Engineering↗
DOE OSTI2020

Exascale applications: skin in the game

As noted in Wikipedia, skin in the game refers to having ‘incurred risk by being involved in achieving a goal’, where ‘ skin is a synecdoche for the person involved, and game is the metaphor for actions on the field of play under discussion’. For exascale applications under development in the US Department of Energy Exascale Computing Project, nothing could be more apt, with the skin being exascale applications and the game being delivering comprehensive science-based computational applications that effectively exploit exascale high-performance computing technologies to provide breakthrough modelling and simulation and data science solutions. These solutions will yield high-confidence insights and answers to the most critical problems and challenges for the USA in scientific discovery, national security, energy assurance, economic competitiveness and advanced healthcare. This article is part of a discussion meeting issue ‘Numerical algorithms for high-performance computational science’.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Reinforcement learning in discrete action space applied to inverse defect design

Abstract Reinforcement learning (RL) algorithms that include Monte Carlo Tree Search (MCTS) have found tremendous success in computer games such as Go, Shiga and Chess. Such learning algorithms have demonstrated super-human capabilities in navigating through an exhaustive discrete action search space. Motivated by their success in computer games, we demonstrate that RL can be applied to inverse materials design problems. We deploy RL for a representative case of the optimal atomic scale inverse design of extended defects via rearrangement of chalcogen (e.g. S) vacancies in 2D transition metal dichalcogenides (e.g. MoS 2 ). These defect rearrangements and their dynamics are important from the perspective of tunable phase transition in 2D materials i.e. 2H (semi-conducting) to 1T (metallic) in MoS 2 . We demonstrate the ability of MCTS interfaced with a reactive molecular dynamics simulator to efficiently sample the defect phase space and perform inverse design—starting from randomly distributed S vacancies, the optimal defect rearrangement of defects corresponds a line defect of S vacancies. We compare MCTS performance with evolutionary optimization i.e. genetic algorithms and show that MCTS converges to a better optimal solution (lower objective) and in fewer evaluations compared to GA. We also comprehensively evaluate and discuss the effect of MCTS hyperparameters on the convergence to solution. Overall, our study demonstrates the effectives of using RL approaches that operate in discrete action space for inverse defect design problems.

42 ENGINEERING↗
NASA NTRS2010

Integration of In-Situ Resource Utilization Into Lunar/Mars Exploration Through Field Analogs

The NASA project to develop In-Situ Resource Utilization (ISRU) technologies, in partnership with commercial and international collaborators, has achieved full system demonstrations of oxygen production using native regolith simulants. These demonstrations included robotic extraction of material from the terrain, sealed encapsulation of material in a pressurized reactor; chemical extraction of oxygen from the material in the form of water, and the electrolysis of water into oxygen and hydrogen for storage and reuse. These successes have provided growing confidence in the prospects of ISRU oxygen production as a credible source for critical mission consumables in preparation for and during crewed missions to the moon and other destinations. Other ISRU processes, especially relevant to early lunar exploration scenarios, have also been shown to be practical, including the extraction of subsurface volatiles, especially water, and the thermal processing of surface materials for civil engineering uses and for thermal energy storage. This paper describes these recent achievements and current NASA ISRU development and demonstration activity. The ability to extract and process resources at the site of exploration into useful products such as propellants, life support and power system consumables; and radiation and rocket exhaust plume debris shielding, known as In-Situ Resource Utilization or ISRU, has the potential to significantly reduce the launch mass, risk, and cost of robotic and human exploration of space. The incorporation of ISRU into missions can also significantly influence technology selection and system development in other areas such as power, life support, and propulsion. For example. the ability to extract or produce large amounts of oxygen and/or water in-situ could minimize the need to completely close life support air and water processing system cycles, change thermal and radiation protection of habitats, and influence propellant selection for ascent vehicles and surface propulsive hoppers. While concepts and even laboratory work on evaluating and developing ISRU techniques such as oxygen extraction from lunar regolith have been going on since before the Apollo 11 Moon landing, no ISRU system has ever flown in space, and only recently have ISRU technologies been developed at a scale and at a system level that is relevant to actual robotic and human mission applications. Because ISRU hardware and systems have never been demonstrated or utilized before on robotic or human missions, architecture and mission planners and surface system hardware developers are hesitant to rely on ISRU products and services that are critical to mission and system implementation success. To build confidence in ISRU systems for future missions and assess how ISRU systems can best influence and integrate with other surface system elements, NASA, with international partners, are performing analog field tests to understand how to take advantage of ISRU capabilities and benefits with the minimum of risk associated with introducing this game-changing approach to exploration. This paper will describe and review the results of four analog field tests (Moses Lake in 6/08, Mauna Kea in 11/08. Flagstaff in 9/09; and Mauna Kea in 1/10) that have begun the process of integrating ISRU into robotic and human exploration systems and missions, and propose future ISRU-related analog field test activities that can be performed in collaboration with international space agencies.

Sanders, Gerald B.↗