Path: utzoo!attcan!uunet!seismo!ukma!wuarchive!usc!ucsd!sdcc6!beowulf!demers
From: demers@beowulf.ucsd.edu (David Demers)
Newsgroups: comp.ai.neural-nets
Subject: Using deltas at the input layer
Message-ID: <12039@sdcc6.ucsd.edu>
Date: 26 Jul 90 06:13:14 GMT
Sender: news@sdcc6.ucsd.edu
Organization: CSE Dept., U. C. San Diego
Lines: 19
Nntp-Posting-Host: beowulf.ucsd.edu

I'm curious to know if anyone has done anything
with computation of deltas for input units.  I'm
aware of the paper by Risto Mikkulainen & Mike Dyer
in 1988 Connectionist Models Summer School proceedings.

It seems silly on the face of it to compute
an "error" for the input - a determination of
what the input SHOULD HAVE BEEN to produce a
smaller error in the mapping.  The above paper
used the deltas to improve the input representation,
with some interesting results.  

Anyone else try anything using a normal backpropogation
delta at the input layer?

Thanks for any pointers,

Dave DeMers
demers@cs.ucsd.edu