Search NASA⌕ Search

SEARCH · Search NASA

Results for “TABLES - BOUNDARY LAYER”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

Review of chemical-kinetic problems of future NASA missions. I - Earth entries

A number of chemical-kinetic problems related to phenomena occurring behind a shock wave surrounding an object flying in the earth atmosphere are discussed, including the nonequilibrium thermochemical relaxation phenomena occurring behind a shock wave surrounding the flying object, problems related to aerobraking maneuver, the radiation phenomena for shock velocities of up to 12 km/sec, and the determination of rate coefficients for ionization reactions and associated electron-impact ionization reactions. Results of experiments are presented in form of graphs and tables, giving data on the reaction rate coefficients for air, the ionization distances, thermodynamic properties behind a shock wave, radiative heat flux calculations, Damkoehler numbers for the ablation-product layer, together with conclusions.

Park, Chul↗

Piezoelectrically Enhanced Photocathodes

Doping of photocathodes with materials that have large piezoelectric coefficients has been proposed as an alternative means of increasing the desired photoemission of electrons. Treating cathode materials to increase emission of electrons is called "activation" in the art. It has been common practice to activate photocathodes by depositing thin layers of suitable metals (usually, cesium). Because cesium is unstable in air, fabrication of cesiated photocathodes and devices that contain them must be performed in sealed tubes under vacuum. It is difficult and costly to perform fabrication processes in enclosed, evacuated spaces. The proposed piezoelectrically enhanced photocathodes would have electron-emission properties similar to those of cesiated photocathodes but would be stable in air, and therefore could be fabricated more easily and at lower cost. Candidate photocathodes include nitrides of elements in column III of the periodic table . especially compounds of the general formula Al(x)Ga(1.x)N (where 0< or = x < or =.1). These compounds have high piezoelectric coefficients and are suitable for obtaining response to ultraviolet light. Fabrication of a photocathode according to the proposal would include inducement of strain in cathode layers during growth of the layers on a substrate. The strain would be induced by exploiting structural mismatches among the various constituent materials of the cathode. Because of the piezoelectric effect in this material, the strain would give rise to strong electric fields that, in turn, would give rise to a high concentration of charge near the surface. Examples of devices in which piezoelectrically enhanced photocathodes could be used include microchannel plates, electron- bombarded charge-coupled devices, image tubes, and night-vision goggles. Piezoelectrically enhanced photocathode materials could also be used in making highly efficient monolithic photodetectors. Highly efficient and stable piezoelectrically enhanced, ultraviolet-sensitive photocathodes and photodetectors could be fabricated by use of novel techniques for growing piezoelectrically enhanced layers, in conjunction with thinning and dopant-selective etching techniques.

Beach, Robert A.↗

Human Systems Integration (HSI) Practitioner's Guide

The NASA/SP-2015-3709, Human Systems Integration (HSI) Practitioner's Guide, also known as the "HSIPG," provides a tool for implementing HSI activities within the NASA systems engineering framework. The HSIPG is written to aid the HSI practitioner engaged in a program or project (P/P), and serves as a knowledge base to allow the practitioner to step into an HSI lead or team member role for NASA missions. Additionally, this HSIPG is written to address the role of HSI in the P/P management and systems engineering communities and aid their understanding of the value added by incorporating good HSI practices into their programs and projects. Through helping to build a community of knowledgeable HSI practitioners, this document also hopes to build advocacy across the Agency for establishing strong, consistent HSI policies and practices. Human Systems Integration (HSI) has been successfully adopted (and adapted) by several federal agencies-most notably the U.S. Department of Defense (DoD) and the Nuclear Regulatory Commission (NRC)-as a methodology for reducing system life cycle costs (LCCs). These cost savings manifest themselves due to reductions in required numbers of personnel, the practice of human-centered design, decreased reliance on specialized skills for operations, shortened training time, efficient logistics and maintenance, and fewer safety-related risks and mishaps due to unintended human/system interactions. The HSI process for NASA establishes how cost savings and mission success can be realized through systems engineering. Every program or project has unique attributes. This HSIPG is not intended to provide one-size-fits-all recommendations for HSI implementation. Rather, HSI processes should be tailored to the size, scope, and goals of individual situations. The instructions and processes identified here are best used as a starting point for implementing human-centered system concepts and designs across programs and projects of varying types, including manned and unmanned, human spaceflight, aviation, robotics, and environmental science missions. The practitioner using this guide should have expertise in Systems Engineering or other disciplines involved in producing systems with anticipated human interactions. (See section 1.6 of this guide for further discussion on HSI discipline domains.) The HSIPG provides an "HSI layer" to the NASA Systems Engineering Engine (SEE), detailed in NASA Procedural Requirement (NPR) 7123.1B, NASA Systems Engineering Processes and Requirements, and further explained in NASA/SP-2007-6105, Systems Engineering Handbook (see HSIPG Table 2.2-1, NASA Documents with HSI Content, for specific references and document versions).

Zumbado, Jennifer Rochlis↗

Surface ozone levels at Table Mountain during STOIC 1989

As a part of the routine operations of the Jet Propulsion Laboratory atmospheric measurements program at the Table Mountain Facility, the surface ozone concentration is continuously monitored using a Dasibi photometer. The influence of the Los Angeles basin to the southwest of the facility and the height of the inversion layer cause large fluctuations in the ozone concentration. Peaks as high as 200 parts per billion by volume (ppbv) were observed during the Stratospheric Ozone Intercomparison Campaign (STOIC) compared to a normal background level near 50 ppbv. These measurements, made during STOIC, were important in assessing the impact of the surface ozone concentration on the various instruments participating in the campaign.

McDermid, I. Stuart↗

Elemental, isotopic and molecular abundances in comets

The chemical composition of comet nuclei and the factors affecting it are discussed, summarizing the results of recent theoretical, experimental, and observational investigations. Consideration is given to the evidence supporting the view that the nucleus is radially differentiation (except for a thin outer layer), surface differentiation by heat processing and outgassing, and mantle buildup on an undifferentiated core. The nature of the refractory and volatile components is examined, and the elemental and isotopic compositions are given in tables and characterized. The uncertain (except for H2O) molecular composition of the volatile fraction is considered, and it is suggested that some oxides or aldehydes (such as CO, CO2, and H2CO), but no large amounts of fully hydrogenated compounds (such as CH4 and NH3) are included.

Delsemme, A. H.↗

CVD Of Thin Films From Single Organometallic Precursors

Method of forming thin inorganic films involves chemical vapor deposition (CVD) from single organometallic precursors. No toxic constituents, minimizes impurities, and yields films having substantially uniform crystal structure and composition. Especially suitable for depositing high-quality passivating or buffer layers of GaS on GaAs semiconductor substrates. Also applicable to formation of high-quality films for purposes other than buffering or passivation, and to different materials in which another element from same group in periodic table of elements substituted for all or portion of each element in GaS/GaAs system.

Hepp, Aloysius F.↗

Urban Image Classification: Per-Pixel Classifiers, Sub-Pixel Analysis, Object-Based Image Analysis, and Geospatial Methods: Chapter - 10

Remote sensing methods used to generate base maps to analyze the urban environment rely predominantly on digital sensor data from space-borne platforms. This is due in part from new sources of high spatial resolution data covering the globe, a variety of multispectral and multitemporal sources, sophisticated statistical and geospatial methods, and compatibility with GIS data sources and methods. The goal of this chapter is to review the four groups of classification methods for digital sensor data from space-borne platforms; per-pixel, sub-pixel, object-based (spatial-based), and geospatial methods. Per-pixel methods are widely used methods that classify pixels into distinct categories based solely on the spectral and ancillary information within that pixel. They are used for simple calculations of environmental indices (e.g., NDVI) to sophisticated expert systems to assign urban land covers. Researchers recognize however, that even with the smallest pixel size the spectral information within a pixel is really a combination of multiple urban surfaces. Sub-pixel classification methods therefore aim to statistically quantify the mixture of surfaces to improve overall classification accuracy. While within pixel variations exist, there is also significant evidence that groups of nearby pixels have similar spectral information and therefore belong to the same classification category. Object-oriented methods have emerged that group pixels prior to classification based on spectral similarity and spatial proximity. Classification accuracy using object-based methods show significant success and promise for numerous urban 3 applications. Like the object-oriented methods that recognize the importance of spatial proximity, geospatial methods for urban mapping also utilize neighboring pixels in the classification process. The primary difference though is that geostatistical methods (e.g., spatial autocorrelation methods) are utilized during both the pre- and post-classification steps. Within this chapter, each of the four approaches is described in terms of scale and accuracy classifying urban land use and urban land cover; and for its range of urban applications. We demonstrate the overview of four main classification groups in Figure 1 while Table 1 details the approaches with respect to classification requirements and procedures (e.g., reflectance conversion, steps before training sample selection, training samples, spatial approaches commonly used, classifiers, primary inputs for classification, output structures, number of output layers, and accuracy assessment). The chapter concludes with a brief summary of the methods reviewed and the challenges that remain in developing new classification methods for improving the efficiency and accuracy of mapping urban areas.

Myint, Soe W.↗

Role of MODIS Vegetation Phenology Products in the ForWarn System for Monitoring of Forest Disturbances in the Conterminous United States

This presentation discusses MODIS vegetation phenology products used in the ForWarn Early Warning System (EWS) tool for near real time regional forest disturbance detection and surveillance at regional to national scales. The ForWarn EWS is being developed by the USDA Forest Service NASA, ORNL, and USGS to aid federal and state forest health management activities. ForWarn employs multiple historical land surface phenology products that are derived from MODIS MOD13 Normalized Difference Vegetation Index (NDVI) data. The latter is temporally processed into phenology products with the Time Series Product Tool (TSPT) and the Phenological Parameter Estimation Tool (PPET) software produced at NASA Stennis Space Center. TSPT is used to effectively noise reduce, fuse, and void interpolate MODIS NDVI data. PPET employs TSPT-processed NDVI time series data as an input, outputting multiple vegetation phenology products at a 232 meter resolution for 2000 to 2011, including NDVI magnitude and day of year products for seven key points along the growing season (peak of growing season and the minima, 20%, and 80% of the peak NDVI for both the left and right side of growing season), cumulative NDVI integral products for the most active part of the growing season and sequentially across the growing season at 8 day intervals, and maximum value NDVI products composited at 24 day intervals in which each product date has 8 days of overlap between the previous and following product dates. MODIS NDVI phenology products are also used to compute nationwide NRT forest change products refreshed every 8 days. These include percent change in forest NDVI products that compare the current NDVI from USGS eMODIS products to historical MODIS MOD13 NDVI. For each date, three forest change products are produced using three different maximum value NDVI baselines (from the previous year, three previous years, and all previous years). All change products are output with a rainbow color table in which forests with the most severe NDVI decreases are assigned hot colors (yellow to red) and forests with prominent NDVI increases are assigned cold colors (blue tones). All mentioned products have been integrated as data layers into ForWarn s geospatial data viewer known as the U.S. Forest Change Assessment Viewer (FCAV). The latter is used to view and assess the context of the mentioned forest change products with respect to ancillary data layers, such as land cover, elevation, hydrologic features, climatic data, storm data, aerial disturbance surveys, fire data, and land ownership. The FCAV also includes a temporal NDVI profiler for viewing phenological change in multi-year NDVI associated with known or suspected regionally apparent forest disturbances (e.g., from fire and insects). ForWarn forest change products have been used to detect, track, and assess several biotic and abiotic regional forest disturbance events across the country, including ephemeral and longer lasting damage from storms, drought, and insects. Such change products are most effective for viewing severe disturbances affecting multiple MODIS pixels. MODIS vegetation phenology products contribute vital current information on forest conditions to the ForWarn system and this role is expected to grow as these products are refined and derivative products are added.

Spruce, Joseph P.↗

Equilibrium radiative heating tables for Earth entry

The recent resurgence of interest in blunt-body atmospheric entry for applications such as aeroassisted orbital transfer and planetary return has engendered a corresponding revival of interest in radiative heating. Radiative heating may be of importance in these blunt-body flows because of the highly energetic shock layer around the blunt nose. Sutton developed an inviscid, stagnation point, radiation coupled flow field code for investigating blunt-body atmospheric entry. The method has been compared with ground-based and flight data, and reasonable agreement has been found. To provide information for entry body studies in support of lunar and Mars return scenarios of interest in the 1970's, the code was exercised over a matrix of Earth entry conditions. Recently, this matrix was extended slightly to reflect entry vehicle designs of current interest. Complete results are presented.

Sutton, Kenneth↗

H2 spectroscopy and a diurnally changing cloud on Jupiter

Spectroscopic observations of H2 in specific longitude regions of Jupiter as they rotate from limb to limb are reported. Data obtained in the 3-0 S(0) and S(1) lines using a CCD detector and a spectrograph with either echelle or plane gratings at the Cassegrain focus of the 24-inch telescope at Whipple Observatory during April-June 1983 are presented in extensive tables and graphs and analyzed in detail, modeling spatial and temporal variations at seven latitudes. An east-to-west increase in the equivalent line widths is attributed to the combined action of internal and solar heating of a convective layer, resulting in diurnal changes in the vertical cloud structure. It is inferred that the hydrogen observed is mainly in an equilibrium thermodynamic state, with small amounts of nonequilibrium hydrogen at high altitudes.

Cunningham, Cindy C.↗

Evaluation of sensible heat flux, latent heat flux, and effective aerodynamic roughness at the land surface from a combination of satellite and in-situ data

A simple method is presented for using the daytime rise of the PBL height, combined with coincident satellite skin temperature measurements, to evaluate sensible heating and the effective surface roughness for heat transfer at synoptic locations. Multiple runs of a combination surface layer-mixed layer model are made in the central U.S., varying the values of surface moisture and roughness length around climatological means, and initializing the model with a set of atmospheric conditions from the synoptic report. The results, shown in figures and tables, are quite reasonable and spatially coherent, and depict well the sharp change in surface moisture and roughness which is known to take place across the central U.S.

Diak, George R.↗

Environmental factors controlling fluxes of dimethyl sulfide in a New Hampshire fen

The major environmental factors controlling fluxes of dimethyl sulfide (DMS) in a Sphagnum-dominated peatland were investigated in a poor fen in New Hampshire. DMS emissions from the surface of the peatland varied greatly over 24 hours and seasonally. Maximum DMS emissions occurred in summer with minima in the late fall. Temperature was the major environmental factor controlling these variabilities. There was also some evidence that the changes in water table height might have contributed to the seasonable variability in DMS emission. The influence of the water table was greater during periods of elevated temperature. DMS and MSH were the most abundant dissolved volatile sulfur compound (VSC) in the surface of the water table. Concentrations of dissolved VSC's varied with time and space throughout the fen. Dissolved MDS, MSH, and OCS in the surface of the water table were supersaturated with respect to their concentrations in the atmosphere suggesting that the peat surface was a source of VSC's in the peatland. VCS in peatlands seemed to be produced primarily by microbial processes in the anoxic surface layers of the peat rich in organic matter and inorganic sulfide. Sphagnum mosses were not a direct source of VSC's. However, they increased transport of DMS from the peat surface to the atmosphere.

Demello, William Zamboni↗

Acoustic Phased Array Quantification of Quiet Technology Demonstrator 3 Advanced Inlet Liner Noise Component

Acoustic phased array flyover noise measurements were acquired as part of the Boeing 737 MAX-7 NASA Advanced Inlet Liner segment of the Quiet Technology Demonstrator 3 (QTD3) flight test program. This paper reports on the processes used for separating and quantifying the engine inlet, exhaust and airframe noise source components and provides sample phased array-based comparisons of the component noise source levels associated with the inlet liner treatment configurations. Full scale flyover noise testing of NASA advanced inlet liners was conducted as part of the Quiet Technology Demonstrator 3 flight test program in July and August of 2018. Details on the inlet designs and testing are provided in the companion paper of Reference 1. The present paper provides supplemental details relating to the acoustic phased array portion of the analyses provided in Ref. 1. In brief, the test article was a Boeing 737MAX-7 aircraft with a modified right hand (starboard side) engine inlet, which consisted of either a production inlet liner, a NASA designed inlet liner or a simulated hard wall configuration (accomplished by applying speed tape over the inlet acoustic treatment areas). In all three configurations, the engine forward fan case acoustic panel was replaced with a unperforated (hardwall) panel. No other modifications to any other acoustic treatment areas were made. The left hand (port side) engine was a production engine and was flown at idle thrust for all measurements in order to isolate the effects of the inlet liners to the right hand engine. As described in Ref. 1, the NASA inlet treatment consists of laterally cut slots (cut perpendicular to the flow direction) which are designed to reduce excrescence drag while maintaining or exceeding the liner acoustic noise reduction capabilities. The NASA inlet liner consists of a Multi-Degree of Freedom (MDOF) design with two breathable septum layers inserted into each honeycomb cell [1]. The aircraft noise measurements were acquired for both takeoff (flaps 1 setting, gear up) and approach (flaps 30 gear up and gear down) configurations. The inlet and flight test configurations are summarized in Table 1. Table 1: Inlet Treatment and Flight Configurations Inlet Forward Fan Case Aircraft Production Hardwall Flaps 1, gear up; flaps 30 gear up; flaps 30 gear down NASA Hardwall Flaps 1, gear up; flaps 30 gear up; flaps 30 gear down Hardwall Hardwall Flaps 1, gear up; flaps 30 gear up; flaps 30 gear down III.Test Description and Hardware The flight testing was conducted at the Grant County airport in Moses Lake, WA, between 27 July and 6 August 2018. The noise measurement instrumentation included 8 flush dish microphones arranged in a noise certification configuration as well as an 840 microphone phased array. The flush dish microphones were used to quantify the levels and differences in levels between the various inlet treatments. The phased array was used to separate and quantify the narrowband (tonal) and broadband noise component levels from the engine inlet/exhaust and from the airframe. Phased array extraction of the broadband component was critical to this study because it allowed for the separation of the inlet component from the total airplane level noise even when it was significantly below the total level. Figure 1 provides an overview of the phased array microphone layout as well as a detailed image of an individual phased array microphone mounted in a plate holder (the microphone sensor is the dot in the center of the plate). The ground plane ensemble array microphones (referred to as “ensemble array” in this paper) were mounted in plates with “flower petal” edges designed to minimize edge scattering effects. Fig. 1 Flyover test microphone layout. The phased array configuration was the result of a progressive development of concepts originally implemented in Ref. 2 and refined over the following years, consisting namely of multiple multi-arm logarithmic spiral subarrays designed to cover overlapping frequency ranges and optimized for various aircraft emission angles. For the present case, the signals from all 840 microphones were acquired on a single system. The 840 microphones were parsed into 11 primary subarray sets spanning from smallest to largest aperture size and labeled accordingly as “a, b, …, k”, where “a” corresponds to the smallest fielded subarray and “k” corresponds to the largest aperture subarray. The apertures ranged from approximately 10 ft to 427 ft in size (in the flight direction) with the subarrays consisting of between 215 and 312 microphones. Figure 2 shows three such subarrays, k, h and a. As done in Ref. 2, microphones were shared between subarrays in order to reduce total channel count. Fig. 2 Sample subarray sizes (20° from overhead – refer to Figure 3a discussion). In addition to the above, each of the 11 primary subarray sets consisted of four subarrays optimized to provide near equivalent array spatial resolution in both the flight and lateral directions within 30 degrees of overhead (i.e., airplane directly above the center of the array), namely, at angles  of 0, ±10, ±20 and ±30 degrees relative to overhead where angle  is defined as shown in Figure 3a. This allowed for optimized aircraft noise measurements from 60 to 120 degree emission angle.6 An example of this pletharray design is shown in Figure 3b for the k subarray. When the aircraft is at overhead, the microphones indicated by the blue markers are used for beamforming. When the aircraft is at angles ±10 degrees from overhead, both the blue and red colored microphones are used, and so on for the ±20 and ±30 degree aircraft locations. See Ref. 3 for extensive details on pletharray design for aeroacoustic phased array testing. 6 In the discussions that follow, emission angle values are used. These are the angles at the time sound is emitted relative to the engine axis and are calculated based on flight path angle, body aircraft body angle with respect to the relative wind direction, and engine axis angle relative to aircraft body angle.

Brusniak, Leon↗

Oscillation spectra of neutron stars with strong magnetic fields

The effects of strong frozen-in vertical magnetic fields on nonradial oscillation spectra in neutron stars are investigated theoretically, focusing on the surface layers near the polar cap of a cylindrically symmetric neutron-star model with shear-supporting crust and molten-crust oceans. The pulsation equations are derived; analytical estimates are obtained; and the results of numerical experiments are presented in tables and graphs. Significant modifications in the frequencies and displacements of the modes are found when a magnetic field is present: Alfven-like g modes (designated magneto-gravity), pseudotoroidal a modes with periods less than 100 ns for a 1-TG field, p-mode displacements almost totally parallel to the field, and a mode spectrum for periods of 100 microsec or more comprising only t, s, and p modes at 1 TG.

Carroll, B. W.↗

Bit-serial neuroprocessor architecture

A neuroprocessor architecture employs a combination of bit-serial and serial-parallel techniques for implementing the neurons of the neuroprocessor. The neuroprocessor architecture includes a neural module containing a pool of neurons, a global controller, a sigmoid activation ROM look-up-table, a plurality of neuron state registers, and a synaptic weight RAM. The neuroprocessor reduces the number of neurons required to perform the task by time multiplexing groups of neurons from a fixed pool of neurons to achieve the successive hidden layers of a recurrent network topology.

Tawel, Raoul↗

Equilibrium radiative heating tables for aerobraking in the Martian atmosphere

Studies currently underway for Mars missions often envision the use of aerobraking for orbital capture at Mars. These missions generally involve blunt-nosed vehicles to dissipate the excess energy of the interplanetary transfer. Radiative heating may be of importance in these blunt-body flows because of the highly energetic shock layer around the blunt nose. In addition, the Martian atmosphere contains CO2, whose dissociation products are known to include strong radiators. An inviscid, equilibrium, stagnation point, radiation-coupled flow-field code has been developed for investigating blunt-body atmospheric entry. The method has been compared with ground-based and flight data for air, and reasonable agreement has been found. In the present work, the method was applied to a matrix of conditions in the Martian atmosphere. These conditions encompass most trajectories of interest for Mars exploration spacecraft. The predicted equilibrium radiative heating to the stagnation point of the vehicle is presented.

Hartung, Lin C.↗

Manufacturing Precise, Lightweight Paraboloidal Mirrors

A process for fabricating a precise, diffraction- limited, ultra-lightweight, composite- material (matrix/fiber) paraboloidal telescope mirror has been devised. Unlike the traditional process of fabrication of heavier glass-based mirrors, this process involves a minimum of manual steps and subjective judgment. Instead, this process involves objectively controllable, repeatable steps; hence, this process is better suited for mass production. Other processes that have been investigated for fabrication of precise composite-material lightweight mirrors have resulted in print-through of fiber patterns onto reflecting surfaces, and have not provided adequate structural support for maintenance of stable, diffraction-limited surface figures. In contrast, this process does not result in print-through of the fiber pattern onto the reflecting surface and does provide a lightweight, rigid structure capable of maintaining a diffraction-limited surface figure in the face of changing temperature, humidity, and air pressure. The process consists mainly of the following steps: 1. A precise glass mandrel is fabricated by conventional optical grinding and polishing. 2. The mandrel is coated with a release agent and covered with layers of a carbon- fiber composite material. 3. The outer surface of the outer layer of the carbon-fiber composite material is coated with a surfactant chosen to provide for the proper flow of an epoxy resin to be applied subsequently. 4. The mandrel as thus covered is mounted on a temperature-controlled spin table. 5. The table is heated to a suitable temperature and spun at a suitable speed as the epoxy resin is poured onto the coated carbon-fiber composite material. 6. The surface figure of the optic is monitored and adjusted by use of traditional Ronchi, Focault, and interferometric optical measurement techniques while the speed of rotation and the temperature are adjusted to obtain the desired figure. The proper selection of surfactant, speed or rotation, viscosity of the epoxy, and temperature make it possible to obtain the desired diffraction-limited, smooth (1/50th wave) parabolic outer surface, suitable for reflective coating. 7. A reflective coat is applied by use of conventional coating techniques. 8. Once the final figure is set, a lightweight structural foam is applied to the rear of the optic to ensure stability of the figure.

Hermann, Frederick Thomas↗

Preliminary Work for Examining the Scalability of Reinforcement Learning

Researchers began studying automated agents that learn to perform multiple-step tasks early in the history of artificial intelligence (Samuel, 1963; Samuel, 1967; Waterman, 1970; Fikes, Hart & Nilsonn, 1972). Multiple-step tasks are tasks that can only be solved via a sequence of decisions, such as control problems, robotics problems, classic problem-solving, and game-playing. The objective of agents attempting to learn such tasks is to use the resources they have available in order to become more proficient at the tasks. In particular, each agent attempts to develop a good policy, a mapping from states to actions, that allows it to select actions that optimize a measure of its performance on the task; for example, reducing the number of steps necessary to complete the task successfully. Our study focuses on reinforcement learning, a set of learning techniques where the learner performs trial-and-error experiments in the task and adapts its policy based on the outcome of those experiments. Much of the work in reinforcement learning has focused on a particular, simple representation, where every problem state is represented explicitly in a table, and associated with each state are the actions that can be chosen in that state. A major advantage of this table lookup representation is that one can prove that certain reinforcement learning techniques will develop an optimal policy for the current task. The drawback is that the representation limits the application of reinforcement learning to multiple-step tasks with relatively small state-spaces. There has been a little theoretical work that proves that convergence to optimal solutions can be obtained when using generalization structures, but the structures are quite simple. The theory says little about complex structures, such as multi-layer, feedforward artificial neural networks (Rumelhart & McClelland, 1986), but empirical results indicate that the use of reinforcement learning with such structures is promising. These empirical results make no theoretical claims, nor compare the policies produced to optimal policies. A goal of our work is to be able to make the comparison between an optimal policy and one stored in an artificial neural network. A difficulty of performing such a study is finding a multiple-step task that is small enough that one can find an optimal policy using table lookup, yet large enough that, for practical purposes, an artificial neural network is really required. We have identified a limited form of the game OTHELLO as satisfying these requirements. The work we report here is in the very preliminary stages of research, but this paper provides background for the problem being studied and a description of our initial approach to examining the problem. In the remainder of this paper, we first describe reinforcement learning in more detail. Next, we present the game OTHELLO. Finally we argue that a restricted form of the game meets the requirements of our study, and describe our preliminary approach to finding an optimal solution to the problem.

Clouse, Jeff↗