Path: utzoo!attcan!uunet!decwrl!shelby!portia.stanford.edu!wan From: wan@portia.Stanford.EDU (Eric Wan) Newsgroups: comp.ai.neural-nets Subject: survey of second order techniques Message-ID: <1990Aug20.183056.20068@portia.Stanford.EDU> Date: 20 Aug 90 18:30:56 GMT Sender: wan@portia.Stanford.EDU (Eric Wan) Organization: AIR, Stanford University Lines: 14 I am compiling a study on the extent to which researches have gone beyond simple gradient descent (back-propagation) for training layered neural networks by applying more sophisticated classical techniques in non-linear optimization (e.g. Newton, Quasi-Newton, Conjugate-Gradient methods, etc.)? Please e-mail me any comments and/or references that you have on the subject. I will summarize the responses. Thanks in advance. Eric Wan wan@isl.stanford.edu