Search NASA⌕ Search

SEARCH · Search NASA

Results for “multiple resource limitation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

From the Rocket Equation to Maxwell's Equations: Electrodynamic Tether Propulsion Nears Space Test

The US space program is facing a growing challenge to its decades-long, global leadership position, as current launch costs consume valuable resources and limit achievements in science, exploration, and commercial development. More than 40% of projected launches over the next 10 years have payloads with intended destinations beyond low-Earth orbit. Therefore, more cost-effective upper stages and on-board propulsion systems are critical elements in reducing total space transportation costs. A new type of space propulsion, using electrodynamic tethers, may be capable of performing multiple sequential missions without resupply and have a potential usable lifetime of several years. They may provide an in-space infrastructure that has a very low life cycle cost and greatly enhanced mission flexibility, thus supporting the goal of reducing the cost of access to space. Electrodynamic tether thrusters work by virtue of the force the Earth's magnetic field exerts on a wire carrying an electrical current. The effect is the basis for electric motors and generators. The Propulsive Small Expendable Deployer System (ProSEDS) experiment, planned for launch in the summer of 2000, will demonstrate the use electrodynamic tether thrust by lowering the altitude of a Delta-H rocket's upper stage on which it will be flying. Applications of the technology include a passive deorbit system for spacecraft at their end-of-life, reusable Orbit Transfer Vehicles, propellantless reboost of the International Space Station, and propulsion and power generation for future missions to Jupiter.

Johnson, Les↗

Application of Gaussian Mixture Regression for the Correction of Low Cost PM2.5 Monitoring Data in Accra, Ghana

Low-cost sensors (LCSs) for air quality monitoring have enormous potential to improve air quality data coverage in resource-limited parts of the world such as sub-Saharan Africa. LCSs, however, are affected by environment and source conditions. To establish high-quality data, LCSs must be collocated and calibrated with reference grade PM2.5 monitors. From March 2020, a low-cost PurpleAir PM2.5 monitor was collocated with a Met One Beta Attenuation Monitor 1020 in Accra, Ghana. While previous studies have shown that multiple linear regression (MLR) and random forest regression (RF) can improve accuracy and correlation between PurpleAir and reference data, MLR and RF yielded suboptimal improvement in the Accra collocation (R2 = 0.81 and R2 = 0.81, respectively). We present the first application of Gaussian mixture regression (GMR) to air quality data calibration and demonstrate improvement over traditional methods by increasing the collocated PM2.5 correlation and accuracy to R2 = 0.88 and MAE = 2.2 μg/cu. m. Gaussian mixture models (GMMs) are a probability density estimator and clustering method from which nonlinear regressions that tolerate missing inputs can be derived. We find that even when given missing inputs, GMR provides better correlation than MLR and RF performed with complete data. GMR also allows us to estimate calibration certainty. When evaluated, 95% confidence intervals agreed with reference PM2.5 data 96% of the time, suggesting that the model accurately assesses its own confidence. Additionally, clustering within the GMM is consistent with climate characteristics, providing confidence that the calibration approach can learn underlying relationships in data.

Sensors↗

An automated environment for multiple spacecraft engineering subsystem mission operations

Flight operations at the Jet Propulsion Laboratory (JPL) are now performed by teams of specialists, each team dedicated to a particular spacecraft. Certain members of each team are responsible for monitoring the performances of their respective spacecraft subsystems. Ground operations, which are very complex, are manual, labor-intensive, slow, and tedious, and therefore costly and inefficient. The challenge of the new decade is to operate a large number of spacecraft simultaneously while sharing limited human and computer resources, without compromising overall reliability. The Engineering Analysis Subsystem Environment (EASE) is an architecture that enables fewer controllers to monitor and control spacecraft engineering subsystems. A prototype of EASE has been installed in the JPL Space Flight Operations Facility for on-line testing. This article describes the underlying concept, development, testing, and benefits of the EASE prototype.

Bahrami, K. A.↗

Autonomous image data reduction by analysis and interpretation

Image data is a critical component of the scientific information acquired by space missions. Compression of image data is required due to the limited bandwidth of the data transmission channel and limited memory space on the acquisition vehicle. This need becomes more pressing when dealing with multispectral data where each pixel may comprise 300 or more bytes. An autonomous, real time, on-board image analysis system for an exploratory vehicle such as a Mars Rover is developed. The completed system will be capable of interpreting image data to produce reduced representations of the image, and of making decisions regarding the importance of data based on current scientific goals. Data from multiple sources, including stereo images, color images, and multispectral data, are fused into single image representations. Analysis techniques emphasize artificial neural networks. Clusters are described by their outlines and class values. These analysis and compression techniques are coupled with decision-making capacity for determining importance of each image region. Areas determined to be noise or uninteresting can be discarded in favor of more important areas. Thus limited resources for data storage and transmission are allocated to the most significant images.

Eberlein, Susan↗

Feeding Ten Billion People Is Possible Within Four Terrestrial Planetary Boundaries

Global agriculture puts heavy pressure on planetary boundaries, posing the challenge to achieve future food security without compromising Earth system resilience. On the basis of process-detailed, spatially explicit representation of four interlinked planetary boundaries (biosphere integrity, land-system change, freshwater use, nitrogen flows) and agricultural systems in an internally consistent model framework, we here show that almost half of current global food production depends on planetary boundary transgressions. Hotspot regions, mainly in Asia, even face simultaneous transgression of multiple underlying local boundaries. If these boundaries were strictly respected, the present food system could provide a balanced diet (2,355 kcal per capita per day) for 3.4 billion people only. However, as we also demonstrate, transformation towards more sustainable production and consumption patterns could support 10.2 billion people within the planetary boundaries analysed. Key prerequisites are spatially redistributed cropland, improved water–nutrient management, food waste reduction and dietary changes. Adoption of the Sustainable Development Goals by all nations in 2015 is the first ever commitment to a world development path that safeguards the stability of the Earth system as a prerequisite for meeting universal human standards1. The longstanding challenge of achieving food security through sustainable agriculture is particularly acute in this context as world agriculture is a leading cause for the current transgressions of multiple planetary boundaries (PBs) globally and regionally2–5. The PB framework is a comprehensive scientific attempt to synoptically define our planet’s biogeophysical limits to anthropogenic interference. It suggests bounds to nine interacting processes that together delineate a Holocene-like Earth system state. The Holocene is chosen as the reference state as it is the only period known to provide a safe operating space for a world population of several billion people, and according to a precautionary principle, the PBs are set in sufficient distance from processes that may critically undermine Earth system resilience and global sustainability. A challenging question, thus, is whether human development goals such as food security can be met while maintaining multiple PBs along with their subglobal manifestations. Further PB transgressions could jeopardize the chances of providing sufficient food for a world population projected to be wealthier and reach >9 billion by 2050. This conundrum portrays a tradeoff between Earth’s biophysical carrying capacity and humankind’s rising food demand, calling in response for radical rethinking of food production and consumption patterns6–9. Yield gap closures, avoidance of excessive input use, shifts towards less resource-demanding diets, food waste reductions and efficient international trade are crucial options for sustainably increasing the food supply10–15. For example, enhancing water-use efficiency on irrigated and rain-fed farms can triple or quadruple crop yields in low-performing systems, suggesting possible global gains of >20% (ref. 16). Even higher gains appear feasible through globally optimized configurations of the land-use pattern17, and cutting food losses by half could generate food for another billion people18. Thus, collective large-scale implementation of such options could sustain food for a further growing world population19. Yet achieving this within a safe operating space as defined by PBs requires not only a halt to but actually a reversal of existing PB transgressions. Previous studies suggest that such a reconciliation might be possible, but these were based on aggregate representations of PBs (not accounting for the spatial patterns of limits, transgressions and interactions) or considered only one boundary in isolation17,20–23. Here, we systematically quantify to what extent current food production depends on local to global transgressions of the PBs for biosphere integrity, land-system change, freshwater use and nitrogen (N) flows, along with the potential of a range of solutions to avoid these transgressions and still increase food supply (Table 1). To this end, we configured an internally consistent process-based model of the terrestrial biosphere including agriculture (LPJmL) with multiple spatially distributed PBs and their interactions. LPJmL is among the longest-established and best-evaluated biosphere models, showing robust performance regarding simulation of, for example, carbon, water and crop yield dynamics (Supplementary Figs. 1 and 2 and Supplementary Table 1; see ref. 24 for a comprehensive benchmarking and Supplementary Methods for more detail on model evaluations). In principle following established definitions4, we refine the computation of some PBs with respect to their regional patterns and interactions (Methods), providing globally gridded precautionary limits to human interference with the Earth system at a level of great detail. In particular, we account for the evidence that many PBs need to be represented spatially explicitly4 to cover their

Gerten, Dieter↗

Crew-Centered Operations: What HAL 9000 Should Have Been

To date, manned space flight has maintained the locus of control for the mission on the ground. Mission control performs tasks such as activity planning, system health management, resource allocation, and astronaut health monitoring. Future exploration missions require the locus of control to shift to on-board due light speed constraints and potential loss of communication. The lunar campaign must begin to utilize a shared control approach to validate and understand the limitations of the technology allowing astronauts to oversee and direct aspects of operation that require timely decision making. Crew-centered Operations require a system-level approach that integrates multiple technologies together to allow a crew-prime concept of operations. This paper will provide an overview of the driving mission requirements, highlighting the limitations of existing approaches to mission operations and identifying the critical technologies necessary to enable a crew-centered mode of operations. The paper will focus on the requirements, trade spaces, and concepts for fulfillment of this capability. The paper will provide a broad overview of relevant technologies including: Activity Planning and Scheduling; System Monitoring; Repair and Recovery; Crew Work Practices.

Korsmeyer, David J.↗

Atmospheric In-Situ Resource Utilization For Mars Application

NASA now looks to Mars as the next step in human space exploration. A couple of challenges of such a destination include affordability and weight/volume limitations. As a way to solve these issues NASA is looking into the practice of In-Situ Resource Utilization (ISRU). Instead of manufacturing and bringing all the supplies necessary for a Mars mission and return trip, the goal is to send a preliminary mission to produce reserves of propellant, water, and oxygen on site. Part of this effort includes the Atmospheric Processing Module (APM). The APM is part of a lander that is composed of multiple compartments, each having a unique function; regolith collection/processing, water processing, atmospheric processing, and product storage. The overall goal is to develop the capability to produce methane (CH4) and oxygen as a fuel/oxidizer combo via a Sabatier reaction using resources from the Martian environment. The APM still must undergo modifications in design, and perhaps method, to become flight-ready to produce methane at the level of purity and quantity needed for a vehicle.

isru↗

Unstructured Grid Adaptation and Solver Technology for Turbulent Flows

Unstructured grid adaptation is a tool to control Computational Fluid Dynamics (CFD) discretization error. However, adaptive grid techniques have made limited impact on production analysis workflows where the control of discretization error is critical to obtaining reliable simulation results. Issues that prevent the use of adaptive grid methods are identified by applying unstructured grid adaptation methods to a series of benchmark cases. Once identified, these challenges to existing adaptive workflows can be addressed. Unstructured grid adaptation is evaluated for test cases described on the Turbulence Modeling Resource (TMR) web site, which documents uniform grid refinement of multiple schemes. The cases are turbulent flow over a Hemisphere Cylinder and an ONERA M6Wing. Adaptive grid force and moment trajectories are shown for three integrated grid adaptation processes with Mach interpolation control and output error based metrics. The integrated grid adaptation process with a finite element (FE) discretization produced results consistent with uniform grid refinement of fixed grids. The integrated grid adaptation processes with finite volume schemes were slower to converge to the reference solution than the FE method. Metric conformity is documented on grid/metric snapshots for five grid adaptation mechanics implementations. These tools produce anisotropic boundary conforming grids requested by the adaptation process.

Park, Michael A.↗

Development of Concept Illustration Variants of the JUMP Lander

The Artemis program is committed to landing humans on the Moon in the 2020s leading to a sustainable lunar presence by the end of the decade. It is challenging to deliver heavy payloads to the lunar surface in support of these goals given currently available Earth launch systems. The payload capacity of the launch systems limits the size of the lunar landers, thereby limiting their cargo capacity. Fortunately, lander cargo capacity can be significantly increased if multiple landers are joined together in space. This concept has been previously introduced as the Joinable Undercarriage to Maximize Payload (JUMP) Lander. Utilizing a JUMP Lander system will increase options and make it easier to comply with directives issued by senior White House leadership to initiate long duration human activity on the Moon. Such activity, by definition, implies extensive habitation, mobility, research, and resource development capability that in turn calls for significant mass delivery to the lunar surface. This paper develops three concept illustration variants of the JUMP Lander. These concepts explore hypergolic, hydrogen, and methane propellant options, as well as the power and thermal rejection systems necessary to enable such lander concepts. The paper also estimates masses for the necessary avionics, structures, and mechanical subsystems. The paper documents the resulting configurations and recommends a JUMP Lander to carry forward in further development.

Lunar Lander↗

A Comparison of System Architectures for a Mechanically Pumped Two-Phase Thermal Control System

The NASA Jet Propulsion Laboratory is developing a mechanically pumped two-phase fluid loop thermal control system to enable novel mission designs and greater science return. Pumped two-phase fluid loops have the potential to provide robust and effective thermal control that combine the best aspects of passive two-phase systems (heat pipes) and mechanically pumped single-phase fluid loops. The current program requirements include the development of a system with multiple 1 sq.m evaporators, each of which is capable of remaining spatially and temporally isothermal while accommodating heat loads of up to 500 W and local fluxes of up to 5 W/sq.cm. The goal is to attain this using less than 5 W of power. Such a system would be able to accommodate the next generation of payload and bus electronics while using minimal resources. This paper compares two different mechanically pumped two-phase fluid loop architectures in the context of these requirements. A mixed flow and separated flow architecture are compared on a theoretical and experimental basis. Test data from sub-scale, single evaporator/single condenser, mixed flow and separated flow testbeds are presented. In addition, a model is introduced to better understand separated flow systems and some expressions for the theoretical performance limits of such systems are developed. To date, the investigation suggests that a separated flow architecture is better suited to the program requirements. Separated flow systems have the potential to accommodate an isothermalizing two-phase evaporator while using lower levels of power than would be required for a mixed flow system. In addition, it is argued that separated flow systems are more robust and amenable to analysis than mixed flow systems, since they significantly reduce the occurrence of two-phase flow by separating phases in the evaporator. Future work will include developing a full-scale testbed that includes multiple evaporators and condensers in a representative flight configuration.

Furst, Benjamin↗

Sensor Data Qualification System (SDQS) Implementation Study

The Sensor Data Qualification System (SDQS) is being developed to provide a sensor fault detection capability for NASA s next-generation launch vehicles. In addition to traditional data qualification techniques (such as limit checks, rate-of-change checks and hardware redundancy checks), SDQS can provide augmented capability through additional techniques that exploit analytical redundancy relationships to enable faster and more sensitive sensor fault detection. This paper documents the results of a study that was conducted to determine the best approach for implementing a SDQS network configuration that spans multiple subsystems, similar to those that may be implemented on future vehicles. The best approach is defined as one that most minimizes computational resource requirements without impacting the detection of sensor failures.

Wong, Edmond↗

101 Surveys in 28 Days - Evaluating Response Rates to a Demanding Request

We report the results of a survey test conducted in advance of a series of community response tests (CRTs) to evaluate response to noise from NASA’s X-59 aircraft. The CRTs will require a substantial number of observations to generate a dose response curve and the timeframe is limited due to resource and scheduling constraints with an experimental aircraft. Within each CRT area, we will recruit a sample of residents in advance and ask them to fill out a brief survey each time the aircraft passes over. Respondents will be asked to fill out the survey either on the web or as part of an application they are able to download onto their mobile phones. On many days, respondents will be asked to fill out the survey for multiple passes. The survey test followed the proposed methodology of the CRTs, albeit gauging reactions to normal in-situ aircraft events. To demonstrate initial interest, we will present response rates to the recruitment portion of the survey test which used an ABS frame. We will then evaluate the ongoing response rates among the recruited population to a demanding survey schedule involving 101 surveys over a 28-day period. The response rate evaluation will focus on demographics, mode (app vs. web) and whether and how these change over time. We will use the results of this work to confirm or improve the design of the CRTs, ensuring the collection of data needed by NASA to evaluate the impact of this innovative technology.

response rates↗

Virtualization - A Key Cost Saver in NASA Multi-Mission Ground System Architecture

With science team budgets being slashed, and a lack of adequate facilities for science payload teams to operate their instruments, there is a strong need for innovative new ground systems that are able to provide necessary levels of capability processing power, system availability and redundancy while maintaining a small footprint in terms of physical space, power utilization and cooling.The ground system architecture being presented is based off of heritage from several other projects currently in development or operations at Goddard, but was designed and built specifically to meet the needs of the Science and Planetary Operations Control Center (SPOCC) as a low-cost payload command, control, planning and analysis operations center. However, this SPOCC architecture was designed to be generic enough to be re-used partially or in whole by other labs and missions (since its inception that has already happened in several cases!)The SPOCC architecture leverages a highly available VMware-based virtualization cluster with shared SAS Direct-Attached Storage (DAS) to provide an extremely high-performing, low-power-utilization and small-footprint compute environment that provides Virtual Machine resources shared among the various tenant missions in the SPOCC. The storage is also expandable, allowing future missions to chain up to 7 additional 2U chassis of storage at an extremely competitive cost if they require additional archive or virtual machine storage space.The software architecture provides a fully-redundant GMSEC-based message bus architecture based on the ActiveMQ middleware to track all health and safety status within the SPOCC ground system. All virtual machines utilize the GMSEC system agents to report system host health over the GMSEC bus, and spacecraft payload health is monitored using the Hammers Integrated Test and Operations System (ITOS) Galaxy Telemetry and Command (TC) system, which performs near-real-time limit checking and data processing on the downlinked data stream and injects messages into the GMSEC bus that are monitored to automatically page the on-call operator or Systems Administrator (SA) when an off-nominal condition is detected. This architecture, like the LTSP thin clients, are shared across all tenant missions.Other required IT security controls are implemented at the ground system level, including physical access controls, logical system-level authentication authorization management, auditing and reporting, network management and a NIST 800-53 FISMA-Moderate IT Security plan Risk Assessment Contingency Plan, helping multiple missions share the cost of compliance with agency-mandated directives.The SPOCC architecture provides science payload control centers and backup mission operations centers with a cost-effective, standardized approach to virtualizing and monitoring resources that were traditionally multiple racks full of physical machines. The increased agility in deploying new virtual systems and thin client workstations can provide significant savings in personnel costs for maintaining the ground system. The cost savings in procurement, power, rack footprint and cooling as well as the shared multi-mission design greatly reduces upfront cost for missions moving into the facility. Overall, the authors hope that this architecture will become a model for how future NASA operations centers are constructed!

Ground System Architecture↗

Collaborative Business Models for Exploration: - The Expansion of Public-Private Partnerships to Enable Exploration and Improve the Quality of Life on Earth

In May of 2007, The Space Life Sciences Strategy was published, launching a series of efforts aimed at driving human health and performance innovations that both meet space flight needs and benefit life on Earth. These efforts, led by the Space Life Science Directorate (SLSD) at the NASA Johnson Space Center, led to the development and implementation of the NASA Human Health and Performance Center (NHHPC) in October 2010. The NHHPC now has over 100 members including seven NASA centers; other federal agencies; some of the International Space Station partners; industry; academia and non-profits. The NHHPC seeks to share best practices, develop collaborative projects and experiment with open collaboration techniques such as crowdsourcing. Using this approach, the NHHPC collaborative projects are anticipated to be at the earliest possible stage of development utilizing the many possible public-private partnerships in this center. Two workshops have been successfully conducted in 2011 (January and October) with a third workshop planned for the spring of 2012. The challenges of space flight are similar in many respects to providing health care and environmental monitoring in challenging settings on the earth. These challenges to technology development include the need for low power consumption, low weight, in-situ analysis, operator independence (i.e., minimal training), robustness, and limited resupply or maintenance. When similar technology challenges are identified (such as the need to provide and monitor a safe water supply or develop a portable medical diagnostic device for remote use), opportunities arise for public-private partnerships to engage in co-creation of novel approaches for space exploration and health and environmental applications on earth. This approach can enable the use of shared resources to reduce costs, engage other organizations and the public in participatory exploration (solving real-world problems), and provide technologies with multiple uses for space exploration and life on earth. Several examples will be provided that demonstrate the application of a technology to solve a space exploration need and to provide a positive impact to the quality of life on earth.

Davis, Jeffrey R.↗

Approximation methods for stochastic petri nets

Stochastic Marked Graphs are a concurrent decision free formalism provided with a powerful synchronization mechanism generalizing conventional Fork Join Queueing Networks. In some particular cases the analysis of the throughput can be done analytically. Otherwise the analysis suffers from the classical state explosion problem. Embedded in the divide and conquer paradigm, approximation techniques are introduced for the analysis of stochastic marked graphs and Macroplace/Macrotransition-nets (MPMT-nets), a new subclass introduced herein. MPMT-nets are a subclass of Petri nets that allow limited choice, concurrency and sharing of resources. The modeling power of MPMT is much larger than that of marked graphs, e.g., MPMT-nets can model manufacturing flow lines with unreliable machines and dataflow graphs where choice and synchronization occur. The basic idea leads to the notion of a cut to split the original net system into two subnets. The cuts lead to two aggregated net systems where one of the subnets is reduced to a single transition. A further reduction leads to a basic skeleton. The generalization of the idea leads to multiple cuts, where single cuts can be applied recursively leading to a hierarchical decomposition. Based on the decomposition, a response time approximation technique for the performance analysis is introduced. Also, delay equivalence, which has previously been introduced in the context of marked graphs by Woodside et al., Marie's method and flow equivalent aggregation are applied to the aggregated net systems. The experimental results show that response time approximation converges quickly and shows reasonable accuracy in most cases. The convergence of Marie's method and flow equivalent aggregation are applied to the aggregated net systems. The experimental results show that response time approximation converges quickly and shows reasonable accuracy in most cases. The convergence of Marie's is slower, but the accuracy is generally better. Delay equivalence often fails to converge, while flow equivalent aggregation can lead to potentially bad results if a strong dependence of the mean completion time on the interarrival process exists.

Jungnitz, Hauke Joerg↗

Show Me the Money! Evaluating A Graduated Incentive Structure to Keep Respondents Engaged Through 101 Surveys in 28 Days

We report the results of a survey test conducted in advance of a series of community response tests (CRTs) to evaluate response to noise from NASA’s X-59 aircraft. The CRTs will require a substantial number of observations to generate a dose response curve for noise exposure and related annoyance levels and the timeframe is limited due to resource and scheduling constraints with an experimental aircraft. Within each CRT area, we will recruit a sample of residents in advance and ask them to fill out a brief survey each time the aircraft passes over. Respondents will be asked to fill out the survey either on the web or as part of an application they are able to download onto their mobile phones. Respondents will be notified each time the plane flies over, asking for their reactions. On many days, respondents will be asked to fill out the survey for multiple flights. Typical incentives are used during the recruitment phase (pre-incentive for a household screener and post-paid for a background survey completed by the selected respondent) and post-paid for an end of study survey. To improve response rates over such a demanding survey schedule (101 surveys in 28 days) we will implement a weekly incentive based upon participation rates, with higher incentives for greater participation and increasing rates each week. The survey test will follow the proposed methodology of the CRTs. We will report on the participation rates by incentive amount and the effectiveness of the incentive structure in obtaining and maintaining response rates over the 4 weeks. We will examine how quickly participation fades over the 4-week period and consider whether the incentive schedule could be improved by altering the distribution of payments. Finally, we will compare how these rates varied across web and app respondents. We will use the results of this work to confirm or improve the design of the CRTs, ensuring the collection of data needed by NASA to evaluate the impact of this innovative technology.

incentives↗

Preliminary Work for Examining the Scalability of Reinforcement Learning

Researchers began studying automated agents that learn to perform multiple-step tasks early in the history of artificial intelligence (Samuel, 1963; Samuel, 1967; Waterman, 1970; Fikes, Hart & Nilsonn, 1972). Multiple-step tasks are tasks that can only be solved via a sequence of decisions, such as control problems, robotics problems, classic problem-solving, and game-playing. The objective of agents attempting to learn such tasks is to use the resources they have available in order to become more proficient at the tasks. In particular, each agent attempts to develop a good policy, a mapping from states to actions, that allows it to select actions that optimize a measure of its performance on the task; for example, reducing the number of steps necessary to complete the task successfully. Our study focuses on reinforcement learning, a set of learning techniques where the learner performs trial-and-error experiments in the task and adapts its policy based on the outcome of those experiments. Much of the work in reinforcement learning has focused on a particular, simple representation, where every problem state is represented explicitly in a table, and associated with each state are the actions that can be chosen in that state. A major advantage of this table lookup representation is that one can prove that certain reinforcement learning techniques will develop an optimal policy for the current task. The drawback is that the representation limits the application of reinforcement learning to multiple-step tasks with relatively small state-spaces. There has been a little theoretical work that proves that convergence to optimal solutions can be obtained when using generalization structures, but the structures are quite simple. The theory says little about complex structures, such as multi-layer, feedforward artificial neural networks (Rumelhart & McClelland, 1986), but empirical results indicate that the use of reinforcement learning with such structures is promising. These empirical results make no theoretical claims, nor compare the policies produced to optimal policies. A goal of our work is to be able to make the comparison between an optimal policy and one stored in an artificial neural network. A difficulty of performing such a study is finding a multiple-step task that is small enough that one can find an optimal policy using table lookup, yet large enough that, for practical purposes, an artificial neural network is really required. We have identified a limited form of the game OTHELLO as satisfying these requirements. The work we report here is in the very preliminary stages of research, but this paper provides background for the problem being studied and a description of our initial approach to examining the problem. In the remainder of this paper, we first describe reinforcement learning in more detail. Next, we present the game OTHELLO. Finally we argue that a restricted form of the game meets the requirements of our study, and describe our preliminary approach to finding an optimal solution to the problem.

Clouse, Jeff↗

Enhanced Software for Scheduling Space-Shuttle Processing

The Ground Processing Scheduling System (GPSS) computer program is used to develop streamlined schedules for the inspection, repair, and refurbishment of space shuttles at Kennedy Space Center. A scheduling computer program is needed because space-shuttle processing is complex and it is frequently necessary to modify schedules to accommodate unanticipated events, unavailability of specialized personnel, unexpected delays, and the need to repair newly discovered defects. GPSS implements constraint-based scheduling algorithms and provides an interactive scheduling software environment. In response to inputs, GPSS can respond with schedules that are optimized in the sense that they contain minimal violations of constraints while supporting the most effective and efficient utilization of space-shuttle ground processing resources. The present version of GPSS is a product of re-engineering of a prototype version. While the prototype version proved to be valuable and versatile as a scheduling software tool during the first five years, it was characterized by design and algorithmic deficiencies that affected schedule revisions, query capability, task movement, report capability, and overall interface complexity. In addition, the lack of documentation gave rise to difficulties in maintenance and limited both enhanceability and portability. The goal of the GPSS re-engineering project was to upgrade the prototype into a flexible system that supports multiple- flow, multiple-site scheduling and that retains the strengths of the prototype while incorporating improvements in maintainability, enhanceability, and portability.

Barretta, Joseph A.↗