Newsgroups: comp.ai.neural-nets,comp.parallel
Path: cantaloupe.srv.cs.cmu.edu!das-news2.harvard.edu!news2.near.net!news.mathworks.com!hookup!olivea!news.bu.edu!gw1.att.com!princeton!wabbit.cc.uow.edu.au!not-for-mail
From: tran@cs.uow.edu.au Mon Oct 24 22:05:29 1994
Subject: Re: Neural Nets on Parallel Machines
Message-ID: <1994Oct25.141004.15911@Princeton.EDU>
To: comp-parallel@uunet.uu.net
Originator: news@hedgehog.Princeton.EDU
Sender: news@Princeton.EDU (USENET News System)
Nntp-Posting-Host: cheops.princeton.edu
Organization: University of Wollongong, NSW, Australia.
Date: Tue, 25 Oct 1994 14:10:04 GMT
Approved: compar@ee.princeton.edu
Lines: 157
Xref: glinda.oz.cs.cmu.edu comp.ai.neural-nets:19700 comp.parallel:10916

news@pith.uoregon.edu Thu Oct 20 17:15:42 1994 writes:

>Hi out there!

>I'm looking for articles/book/postings/etc. on the implementation and 
>computation of neural networks on parallel computers.

>I'm graduate student and I'm supposed to give a talk on these topics. I 
>would really appreciate your help if one of you knew something about this 
>stuff.

>Thank you

>Wolfram


Hello all,

Here are some references I gathered when I started on my research into
NNs on parallel architectures.  I haven't updated the list for a while
but it should be a good starting point.

(Goodluck Wolfram !)

Cheers ;-)
Minh Tran

--------------------------------------------------------------
BIBLIOGRAPHY


[1] Abbruzzese, F. "A Transputer Implementation of a Mc 
Culloch & Pitts Network", in Chiricozzi, E. and D'Amico, D. 
(eds) Parallel Processing and Applications, 135-140,  Elsevier 
North-Holland (1988).

[2] Aleksic, Z. and Bossomaier, T. "An Efficient 
Implementation of the Multi-Layer Perceptron on Transputer 
Networks", 95-102, ANU Canberra (1989).

[3] Beynon, T. and Dodd, N. "The Implementation of Multi-Layer 
Perceptrons on Transputer Networks", Proc. 7th Occam Users 
Group, August, 1987.

[4] Board, J.A. and Shue-Jen, L. "Performance of Parallel 
Neural Network Simulations", Proc. Second Conf. of North 
American Transputer Users Group, Salt Lake City (1989). 

[5] Bofill, P. et al. "A Systolic Algorithm for Back- 
Propagation: Mapping onto a Transputer Network", in Stender, 
J. and Addis, T. (eds) Symbols versus Neurons ?, 32-46, IOS 
Press (1990).

[6] Dodd, N. et al. "Optimisation of Artificial Neural Network 
Structure using Genetic Techniques implemented on multiple 
Transputers", in Welch, P. et al. (eds) Transputing '91, 687-
699, IOS Press (1991).

[7] Feild, W.B. et al. "Transputer Implementation of Hopfield 
Neural Network", Proc. ICCI Conference, Canada (1989).

[8] Feild, W.B. and Navlakha, J.K. "On Choosing Non-random 
Input Exemplars to Form Stable States in a Hopfield Neural 
Net", Proc. ISMM Conference, 95-106, Miami Florida USA (1988).

[9] Forrest, B.M et al. "Implementing Neural Network Models on 
Parallel Computers", The Computer Journal, Vol. 30, No. 5, 
413-419, (1987).

[10] Johannet, A. et al. "A Transputer-Based Neurocomputer", 
in Monteau, T. (ed) Parallel Programming of Transputer Based 
Machines, OUG 7, 120-127, IOS Press, Amsterdam (1990).

[11] Kamangar, F.A. et al. "Implementing the Back-Propagation 
Algorithm on the Meiko Parallel Computing Surface", Proc. 
First Int'l Conference on Applications of Transputers, 
Liverpool UK (1989).

[12] Kaski, K. and Vanhala, J. "Neural Networks and MIMD-
multiprocessors", in Stender, J. and Addis, T. (eds) Symbols 
versus Neurons ?, 203-214, IOS Press (1990).

[13] Kerchhoffs, E. et al. "Speeding up backpropagation 
training on a hypercube computer", Neurocomputing 4, 43-63, 
Elsevier (1992).

[14] Kontoravdis, D. et al. "A Specification-Based Parallel 
Implementation of Neural Network Learning Strategies", in 
Valero, M. et.al. (eds) Parallel Computing and Transputer 
Applications, 711-720, IOS Press/CIMNE, Barcelona (1992).

[15] McIntire, G. et al. "Design of Neural Network Simulator 
on a Transputer Array", NASA Conf., Publication Number 2491 
(1987).

[16] Murre, J.M. "Transputers and Neural Networks: An Analysis 
of Implementation Constraints and Performance", IEEE 
Transactions on Neural Networks, 284-292, vol. 4, no. 2, March 
1993.

[17] Nordstrom, T. and Svensson, B. "Using and Designing 
Massively Parallel Computers for Artificial Neural Networks", 
Journal of Parallel and Distributed Computing 14, 260-285 
(1992).

[18] Obermayer, K. et al. "Large-scale simulations of self-
organising neural networks on parallel computers: application 
to biological modelling", Parallel Computing 14, 381-404, 
North Holland (1990).

[19] Obermayer, K. et al. "Simulation of Self-Organizing 
Neural Nets: A Comparison between a Transputer Ring and a 
Connection Machine CM-2", Proc. Third Conf. of the North 
American Transputer Users Group, Santa Clara (1990).

[20] Oglesby, J. and Mason, J.S. "Dynamic Scheduling For Feed-
Forward Neural Nets Using Transputers", Proc. First Int'l 
Conf. on Neural Networks, IEE Press, London (1989).

[21] Siemon, H.P. and Ultsch, A. "Kohonen Networks on 
Transputers: Implementation and Animation", in Proc. INNC, 
643-646, Paris (1990).

[22] Sijstermans, F. "A Parallel Backpropagation Algorithm", 
in Joosen, W. and Milgrom, E. (eds) Parallel Computing: From 
Theory to Sound Practice, 538-541, IOS Press (1992).

[23] Singer, A. "Exploiting the Inherent Parallelism of 
Artificial Neural Networks to Achieve 1300 Million 
Interconnects per Second", Proc. INNC, 656-660, Paris (1990).

[24] Tollenaere, T. and Roose, D. "Performance Modeling of a 
Parallel Neural Network Simulator", in Allen, A.R. (ed) 
Transputer Systems - Ongoing Research, 37-48, IOS Press 
(1992).

[25] Vuurpijl, L.G. and Schouten, T.E. "Suitability of 
Transputers for Neural Network Simulations", in Joosen, W. and 
Milgrom, E. (eds) Parallel Computing: From Theory to Sound 
Practice, 528-537, IOS Press (1992).

[26] Yoon, H. and Nang, J.H. "Multilayer Neural Networks on 
Distributed-Memory Multiprocessors", Proc. Int'l Conference on 
Neural Networks, 669-672, Paris (1990).

[27] Talia, D. "Message Routing Systems for Tranputer Based 
Parallel Computers", in Allen, A.R. (ed) Transputer Systems - 
Ongoing Research, 1-12, IOS Press (1992).

[28]  Richards, G.D.  "Implementation of Back-Propagation on a 
Tranputer Array", in Kerridge, J. (ed)  Developments Using 
Occam, OUG, IOS, Amsterdam, 1988.
-- 
Minh Tran
University of Wollongong
tran@wraith.cs.uow.edu.au

