Newsgroups: comp.ai.neural-nets
Path: cantaloupe.srv.cs.cmu.edu!das-news2.harvard.edu!news2.near.net!news.mathworks.com!news.duke.edu!concert!sas!mozart.unx.sas.com!saswss
From: saswss@hotellng.unx.sas.com (Warren Sarle)
Subject: Re: Statistics vs NN
Originator: saswss@hotellng.unx.sas.com
Sender: news@unx.sas.com (Noter of Newsworthy Events)
Message-ID: <CzDnCu.JDw@unx.sas.com>
Date: Wed, 16 Nov 1994 20:24:30 GMT
References: <39b9in$of0@omnifest.uwm.edu> <39k43i$3q0@Radon.Stanford.EDU> <39kf8c$mkp@maui.cs.ucla.edu> <Cywryq.JuM@unx.sas.com> <39qebb$j89@Radon.Stanford.EDU> <39r0bj$1oj@news.bu.edu>
Nntp-Posting-Host: hotellng.unx.sas.com
Organization: SAS Institute Inc.
Lines: 74


In article <39r0bj$1oj@news.bu.edu>, gjaja@park.bu.edu (Marin Gjaja) writes:
|> Can anyone post a list of references of review papers that have considered the
|> similarities between neural networks for pattern recognition and classification
|> and statistical methods. 

   Cheng, B. and Titterington, D.M. (1994), "Neural Networks: A Review
   from a Statistical Perspective", Statistical Science, 9, 2-54.

   Kuan, C.-M. and White, H. (1994), "Artificial Neural Networks: An
   Econometric Perspective", Econometric Reviews, 13, 1-91.

   Michie, D., Spiegelhalter, D.J. and Taylor, C.C. (1994), _Machine
   Learning, Neural and Statistical Classification_, Ellis Horwood.

   Ripley, B.D. (1993), "Statistical Aspects of Neural Networks", in
   O.E. Barndorff-Nielsen, J.L. Jensen and W.S. Kendall, eds.,
   _Networks and Chaos: Statistical and Probabilistic Aspects_,
   Chapman & Hall. ISBN 0 412 46530 2.

   Ripley, B.D. (1994?), "Neural Networks and Related Methods for
   Classification," Journal of the Royal Statistical Society, Series B,
   don't have page numbers.

   Weiss, S.M. & Kulikowski, C.A. (1991), _Computer Systems That
   Learn_, Morgan Kaufmann.

   White, H. (1989), "Learning in Artificial Neural Networks: A
   Statistical Perspective," Neural Computation, 1, 425-464.

   White, H. (1989), "Some Asymptotic Results for Learning in Single
   Hidden Layer Feedforward Network Models", J. of the American Statistical
   Assoc., 84, 1008-1013.

   White, H. (1992), _Artificial Neural Networks: Approximation and
   Learning Theory_, Blackwell. (Contains reprints of many useful articles)

Brian Ripley has several other articles on the subject. Perhaps Brian
would post his references and save me the trouble of typing them in. :-)

One book that should be avoided is Murray Smith's _Neural Networks for
Statistical Modeling_. Unfortunately, Smith is as ignorant of statistics
as is Hecht-Nielsen.

|> I think Mr. Sarle posted a terse outline of his own
|> views, but I am wondering whether anyone is aware of journal articles that
|> address this issue in a general form.

My articles are available by anonymous ftp from ftp.sas.com
(Internet gateway IP 192.35.83.8) in the directory /pub/sugi19/neural :

 neural1.ps     Sarle, W.S. (1994), "Neural Networks and Statistical
                Models," Proceedings of the Nineteenth Annual SAS Users
                Group International Conference, Cary, NC: SAS Institute,
                pp 1538-1550. (Postscript file)

 neural2.ps     Sarle, W.S. (1994), "Neural Network Implementation in
                SAS Software," Proceedings of the Nineteenth Annual SAS
                Users Group International Conference, Cary, NC: SAS
                Institute, pp 1551-1573. (Slightly revised version,
                postscript file)

|> The reason that I limit the scope to NN's for PR and classification is that
|> there are many other forms of NN's that have nothing to do with statistical
|> methods since they address a completely different problem domain - ie the
|> nominally intended one for all neural networks - neural modeling.

Quite true.

-- 

Warren S. Sarle       SAS Institute Inc.   The opinions expressed here
saswss@unx.sas.com    SAS Campus Drive     are mine and not necessarily
(919) 677-8000        Cary, NC 27513, USA  those of SAS Institute.
