Path: utzoo!utgpu!jarvis.csri.toronto.edu!mailrus!ames!purdue!mentor.cc.purdue.edu!pur-ee!pc.ecn.purdue.edu!cb.ecn.purdue.edu!kavuri From: kavuri@cb.ecn.purdue.edu (Surya N Kavuri ) Newsgroups: comp.ai.neural-nets Subject: Re: ART and non-stationary environments Keywords: ART Message-ID: <904@cb.ecn.purdue.edu> Date: 30 Apr 89 19:57:48 GMT References: <2503@bucsb.UUCP> <18583@gatech.edu> Organization: Purdue University Engineering Computer Network Lines: 31 In article <18583@gatech.edu>, myke@gatech.edu (Myke Reynolds) writes: > BAM is a the stationary version of ART, and blows backprop out of the > water in both power and simplicity. Its less than a linear equation solver, > but thats enough to out-preform backprop. > Myke Reynolds I do not understand what you mean by "power" but if you look at the memory capacity, BAM's look pathetic. I do not speak for BP, but I heard some explanations that the hidden layers serve as feature detectors (4-2-4 decoder) which shows a likeness(intuitive) to pattern classification methods. Surya Kavuri (FIAT LUX) P.S: What I dispise in relation to BP is the apparent tendencies that people have in romanticizing it. (I should say that the problem is not with BP but with its researchers). I have seen sinful explanations to what the hidden units stand for. I have seen claims that they stand for concepts that could be given physical meanings (sic!). These are baseless dreams that people come with. This is a disgrace to the serious scientific community as it indicates a degeneration. BP is not even Steepest gradient approach, strictly speaking. It does minimization of an error measure. (1) There are no measures of its convergence time.