Newsgroups: comp.ai.neural-nets
Path: cantaloupe.srv.cs.cmu.edu!bb3.andrew.cmu.edu!newsfeed.pitt.edu!godot.cc.duq.edu!newsgate.duke.edu!news.mathworks.com!newsfeed.internetmci.com!realtime.net!news.mindspring.com!snooze.ser.bbnplanet.com!es.dupont.com!esds01.es.dupont.com!slivova.es.dupont.com!owens
From: owens@slivova.es.dupont.com (Aaron J. Owens)
Subject: Re: Number of hidden units
Message-ID: <1996May28.203735.6613@es.dupont.com>
Sender: news@es.dupont.com (USENET News System)
Nntp-Posting-Host: slivova.es.dupont.com
Organization: DuPont Experimental Station
X-Newsreader: TIN [version 1.2 PL0]
References: <4oes5k$a6o@highway.leidenuniv.nl>
Date: Tue, 28 May 1996 20:37:35 GMT
Lines: 28

Stephan Raaijmakers (raaijmakers@rulxho.leidenuniv.nl) wrote:
: What is the theoretical interpretation of 
: a NxMxN net (N=number of inputs/outputs; M=number of hidden units),
: where M>N? E.g., 24x74x24. Is it still possible to say that such a net
: uses a distributed representation?

Yes, all of the M hidden units participate in modeling the input-
output relationship -- if there are enough data points to allow that.

: Does anyone know of specific types of problems which demand that M>N?

Any situation in which a highly nonlinear mapping from input space
to output space is required, there is little noise, and there are
lots of exemplars.

-- Aaron --

Aaron J. Owens, Research Fellow    Telephone Numbers:
Modeling and Simulation		  	Office	  (302) 695-7341 
Engineering Research Laboratory	  	FAX	    "   695-9658
DuPont Company, E320/201	        Home      (302) 733-7836
Wilmington, DE 19880-0320	   Internet: owens@prism.es.dupont.com

-----------------------------------------------------------------------------
Opinions expressed in this electronic message should *NOT* be taken to repre-
sent the official view(s) of the DuPont Company.  ANY OPINIONS EXPRESSED ARE
THE PERSONAL VIEWS OF THE AUTHOR ONLY. 
+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
