Newsgroups: comp.ai.neural-nets
Path: cantaloupe.srv.cs.cmu.edu!fs7.ece.cmu.edu!europa.eng.gtefsd.com!howland.reston.ans.net!pipex!uunet!Germany.EU.net!news.dfn.de!gs.dfn.de!news.uni-bielefeld.de!lili2!stoet
From: stoet@lili7.uni-bielefeld.de (Gijsbert Stoet)
Subject: Re: Visualizing Neural Networks
Sender: news@hermes.hrz.uni-bielefeld.de (News Administrator)
Message-ID: <STOET.94Oct17100006@lili7.uni-bielefeld.de>
In-Reply-To: jn@cs.Buffalo.EDU's message of Sun, 16 Oct 1994 21:32:07 GMT
Date: Mon, 17 Oct 1994 09:00:06 GMT
References: <HkLekqLVTBCC065yn@login.dknet.dk> <37s1uh$ogp@cantaloupe.srv.cs.cmu.edu>
	<CxsBtK.5zn@acsu.buffalo.edu>
Nntp-Posting-Host: lili7.lili.uni-bielefeld.de
Organization: Dept. of Linguistics, University of Bielefeld, Germany
Lines: 18

>>>>> "Jai" == Jai Natarajan <jn@cs.Buffalo.EDU> writes:
In article <CxsBtK.5zn@acsu.buffalo.edu> jn@cs.Buffalo.EDU (Jai Natarajan) writes:


    Jai> If i understand your second question right, you want to know how to
    Jai> judge whether your training is progressing properly. One strict rule
    Jai> you must observe (and which is tempting to violate) is that you must
    Jai> NEVER show your test set to the net while training. That means you
    Jai> can't just pause occasionally, feed some test samples into the net &
    Jai> see that the recognition rate is incresing. This process introduces a
    Jai> bias into your training process (both human and neural).

Of course can you pause occasionally. When showing the "test set", i.e. the
input-output pattern which are not part of the set to be learned, you should
not change the connection-strenghts. Then, the test-set doesn't influence the
performance. (As far as I know).

Gijsbert
