Path: utzoo!attcan!uunet!mcsun!unido!uklirb!powers From: powers@uklirb.informatik.uni-kl.de (David Powers ) Newsgroups: comp.ai.philosophy Subject: Re: Machine learning Message-ID: <7409@uklirb.informatik.uni-kl.de> Date: 13 Dec 90 11:40:04 GMT References: <4158@dftsrv.gsfc.nasa.gov> <15991@venera.isi.edu> Organization: University of Kaiserslautern, W-Germany Lines: 118 Wow! I don't know where to start and I haven't got the time for a full analysis of Machine Learning vis-a-vis Human Learning vis-a-vis Hand Coding. But there's more to learning than meets the eye - that much is agreed. >In article <4158@dftsrv.gsfc.nasa.gov> jones@amarna.gsfc.nasa.gov writes: >The question has been raised as to whether or not we could put a learning or >"reinforcement" algorithm, perhaps along the lines of Skinner's concepts, and >make the machine *learn* all sorts of neat things without their having to >be programmed in by humans. This is the oldest, worst idea in AI. Dozens >of attempts have been made to carry this effort through (I myself have made >a dozen or so.), essentially without success. The problem is that *all* >theories of learning in psychology are *unsound.* For example, Skinner >would have us believe that, if an organism is rewarded for doing a certain >action in a certain situation then he/she/it will become more likely to perform >the action in question in "similar" situations. Horsefeathers! What is a >similar action? What is a similar situation? All sorts of heavy machinery >have been swept under the rug and labeled "similarity." Similarity (or Metaphor) is one of the most important concepts in Learning, and in Science for that matter. Nothing is ever the same as anything else. Even perceptions of the same object at different times are different. So classification of similar things is the first and major step in much of Machine Learning and metaphor is actually the outworking of the same ubiquitous phenomenon in our use of language. Theories of learning which are precomputational are not intended to be complete in the sense that they dot every i and cross every t necessary to code them into a learning program. But they can be used, and the empirical work laying behind them can be reinterpreted and used, to guide and inspire computational theories of learning. I personally agree that some aspects of the dogmatics of certain of the greats of psychology, linguistics and psycholinguistics are misdirected. But who's perfect. The real problem lies with the blind followers who recognize the fundamental truths their mentors exposed, but swallow blindly the inessential baggage as well. No wonder we get indigestion when we try to do some useful work! > From the above it might be concluded that I am opposed to machine learning >in general. On the contrary, I consider it one of the most important areas >of AI. One bad habit which afflicts learning research is the failure to >distinguish between that which the machine can legitimately learn for itself, >and that which the human programmers jolly well better program in by hand. >For example, I doubt very much if a machine could do more than a few >rudimentary things without the concept of a *subroutine hierarchy* (or the >related GPS goal tree). Hence I believe that the machine should have >software for building up, testing, and using subroutine hierarchies on >its own. But can the machine *invent* subroutine hierarchies? Doubt. >Much of the *nerve net* research is marred by lack of making this distinction. >My experience with learning codes is that you start by working out just how >the performance program is to look and to operate. "the failure to distinguish" is actually a consequence of "a failure to examine". The old maxim "you can only learn what you almost already know" is really fundamental. And as your system bootstraps itself from one level to the next - which may not be very far away - A. you need to look for the right techniques and the correct characterization of the prerequisites for this learning (including teacher - what sort of examples, critic - what sort of feedback,input - what sort of features, ...), and B. you must expect that you will only achieve bootstrapping to a level which is not that far removed from where you started. After all, "you can only learn..." smoliar@vaxa.isi.edu (Stephen Smoliar) writes: >There is an even worse habit which Minsky discusses in THE SOCIETY OF MIND: > The problem is that we use the single word "learning" > to cover too diverse a society of ideas. Such a word can be > useful in the title of a book, or in the name of an institution. > But when it comes to studying the subject itself, we need more > distinctive terms for important, different ways to learn. >Minsky then goes on to propose some of these terms, not all of which I am sure >I agree with; and I suspect I could think up some more given the time. The >point is that, like intelligence itself, we assume that anything that can be >captured in a single word can, somehow or another, be implemented in code. >Anything which counts as a result in machine learning has involved results >in a very narrow, highly specific scope. Unfortunately, rather than trying >to explore the nature of that scope (let alone consider how it might interact >with other, equally narrow scopes), researchers are forever tempted to >advertise their results as advances in "machine learning," a claim which >lends little to our understanding of just what they have achieved. If we >had less inflation of accomplishment, we might discover that our achievements >are not as weak as they tend to appear. Here I tend to agree more with the spirit of the comment. And not only may our "weak" achievements be more significant than they appear, in recent times people have tended to apply the "strongest" techniques they can to the learning in an attempt to make the "strongest" achievement, or "biggest" jump in the level of complexity. In fact, it is helpful to consider the inherent structure of what we are learning and what is the weakest form of learning we can use. Some of the classical results about what cannot be learnt are applicable to classes far more general and less restricted than those where we actually want to learn. We need to understand the restrictions, and relate them to the observed phenomena, classes, learning paradigms, etc. We do, of course, have names for some different types of learning. We need no doubt to develop and characterize more. And I have had some success in machine learning in several domains, and in relating the restrictions of the "language" to be learned, the appropriate learning algorithm, the "psychological" correlates, and the "linguistic" classes and rules. I won't list my book and other references here, but feel free to write for a bibliography and/or a paper. David Powers ------------------------------------------------------------------------ David Powers +49-631/205-3449 (Uni); +49-631/205-3200 (Fax) FB Informatik powers@informatik.uni-kl.de; +49-631/13786 (Prv) Univ Kaiserslautern * COMPULOG - Language and Logic 6750 KAISERSLAUTERN * MARPIA - Concurrent Logic Programming WEST GERMANY * STANLIE - Natural Language Learning Riddle: What is the difference between the university and me. Disclaimer: My opinion.