Path: utzoo!mnetor!tmsoft!dptcdc!jarvis.csri.toronto.edu!rutgers!tut.cis.ohio-state.edu!pt.cs.cmu.edu!cat.cmu.edu!jps From: jps@cat.cmu.edu (James Salsman) Newsgroups: comp.ai Subject: Re: Symbol Grounding Problem Summary: Don't Princeton AI researchers do cognitive modeling? Keywords: connectionism language categorization Searle symbol-systems Message-ID: <5772@pt.cs.cmu.edu> Date: 7 Aug 89 11:12:23 GMT References: <9753@phoenix.Princeton.EDU> <5761@pt.cs.cmu.edu> <9795@phoenix.Princeton.EDU> Organization: Carnegie Mellon Lines: 112 In article <9795@phoenix.Princeton.EDU> harnad@phoenix.Princeton.EDU (Stevan Harnad) writes: > James Salsman (jps@cat.cmu.edu) wrote: >> THE SYMBOL GROUNDING PROBLEM... No problem: >> >> The | /"Iconic"\ Distributed / \ / \Predicates &/ >> Out |--------< Buffer >-------------< EPAM >------< SOAR >----------> side| Signals \ STM / Representation\ / Symbols\ / Productions\ > This is exactly the kind of naive "hook-em-all-up-together" modularism that I > wrote the preprint in question in order to refute. Now one can either hold > onto these unexamined beliefs (and the dead-ends they lead to in cognitive > modeling) or wake up and smell the coffee... Some prefer iced tea. The theories shown in my diagram could hardly be considered unexamined. The EPAM and SOAR models have both withstood the test of several years of scientific scrutiny both in the classrooms of our nation's Universities and in the peer review process of international journals. EPAM (Elementary Perciever And Memorizer) was constructed by Herbert Simon and Edward Figenbaum in the late 1950's. Formally, EPAM is an algorithm that maps sensory signals into symbolic information. In addition, the EPAM model has been shown to predict the behavior of humans in several cognitive experimental domains such as response time measurements, patterns of forgetting, and relation of the serial position of sensory information to those factors. Additionally, EPAM, as a theory, has been described in terms of an algorithm and a data structure, so it can be implemented in practice as a program for either a parallel or serial computer. EPAM is best described as a "discrimination network" with some very special features. [For a good introduction see "The Handbook of Artificial Intelligence," Cohen, P., Figenbaum, E., 1982, William Kaufman, Inc., Volume III, Section XI.D.] A Production System is a rule-based programming language that seems to be a good model of the lower-brain conditioning systems (S --> R). Allen Newell has constructed a descendant of GPS called SOAR that explains higher-level cognition in terms of a Production System (in practice, SOAR is written on top of Forgy's OPS5.) SOAR is a goal-directed general problem solving system with an experience-based learning model (Chunking), a set of powerful default search routines implemented as "weak methods," and a way to generate useful subgoals when the system reaches an impasse. Production Systems are "forward chaining" inference systems, as opposed to the "backward chaining" systems of Prolog -- this does not mean that production systems are incapable of logical inference -- only that they have a choice of several methods with varing degrees of effectiveness for different problems, including Prolog's Depth-First-Search. The literature correlating SOAR's behavior with that of humans is based on extensive protocol and timing analysis and is especially obvious in areas such as stimulus-response compatibility and the shapes of the leaning curves of several different kinds of cognitive problems. It is clear that Connectionist Neural-Network and Parallel Distributed Processing research, present a very rich description of the "computing machinery" of the brain. We have reached the point in our understanding of cognition that we may now begin the implentation of programs such as "the mind" on computing machinery other than the brain. I've already put together a workable dataflow PS on the Connection Machine, but the SIMD architecture didn't allow enough state per processing element to properly handle the binding semantics of OPS5, which SOAR is heavly dependant on. I am currently working on a distributed production system using the Transputer's MIMD multiprocessor architecture that will include all of OPS5's binding semantics. On a 16-Transputer system with a hypercube topology and 256K RAM per processor, I expect to be able to construct a system with a capacity of 40000 total productions and still maintain a 10 millisecond cycle time. The bad news is that this will require Transputer machine code generation while the system is running -- hardly pure OCCAM. The 10 ms figure has been specified by both Newell and Simon as the assumed firing time for their human cognition models. So, to return to the symbol grounding problem: SOAR is a purely symbolist architecture, and requires another underlying system to parse sensory signals into symbolic form. That is exactly the function of EPAM. The combined system should be able perform real-time cognitive tasks such as vocal communication, perhaps as a natural language processing back-end for the Sphinx real-time speaker-independent speech recogntion system that CMU has constructed. Such a system would make a very freindly user interface for an information retrival network (like the Telephone system.) At Carnegie-Mellon, we do not use "hook-em-all-up-together" strategies for cognitive modeling. We use "functional composition," instead. Aren't there any hackers at Princeton? Or are you all "Software Engineers?" Either way, it should be easy for you to understand the difference. :James Disclaimer: I have worked for the SOAR project, but I don't represent any official viewpoint. -- :James P. Salsman (jps@CAT.CMU.EDU)