Found ntalk.train
Performance Test...

Using datafile: ntalk.train
Total number of positions: 5603

Backpropagation Learning

Black Boxes:

ntalk (Saved at Iteration 0)

Forward...

Learning Rate: 0.050000
Inertia: 0.950000

Total Iterations 100000
Total number of connections: 27626

Once thru ntalk.train = 5603 iterations (once for every letter)
Going 30 times thru training set (~168,000 iterations)

Using datafile: ntalk.train
Total number of positions: 5603

Backpropagation Learning

Black Boxes:

ntalk (Saved at Iteration 0)

Learning...

Learning Rate: 0.050000
Inertia: 0.950000
Not testing.
Saving every 14000 iterations.
Truncating Learning after 28000 iterations.
Dumping Network at 14000.
Dumping Network at 28000.
Dumping Network at 28000.

Learning Rate: 0.050000
Inertia: 0.950000

Total Iterations 28000
Total number of connections: 27626
I saved the state after 5 passes in: ntalk5.dump

Using datafile: ntalk.train
Total number of positions: 5603
Loading Saved Network: ntalk5.dump

Backpropagation Learning

Black Boxes:

ntalk (Saved at Iteration 28000)

Learning...

Learning Rate: 0.050000
Inertia: 0.950000
Not testing.
Saving every 5000 iterations.
Truncating Learning after 140000 iterations.
Dumping Network at 5000.
Dumping Network at 10000.
Dumping Network at 15000.
Dumping Network at 20000.
Dumping Network at 25000.
Dumping Network at 30000.
Dumping Network at 35000.
Dumping Network at 40000.
Dumping Network at 45000.
Dumping Network at 50000.
Dumping Network at 55000.
Dumping Network at 60000.
Dumping Network at 65000.
Dumping Network at 70000.
Dumping Network at 75000.
Dumping Network at 80000.
Dumping Network at 85000.
Dumping Network at 90000.
Dumping Network at 95000.
Dumping Network at 100000.
Dumping Network at 105000.
Dumping Network at 110000.
Dumping Network at 115000.
Dumping Network at 120000.
Dumping Network at 125000.
Dumping Network at 130000.
Dumping Network at 135000.
Dumping Network at 140000.
Dumping Network at 140000.

Learning Rate: 0.050000
Inertia: 0.950000

Total Iterations 140000
Total number of connections: 27626
I saved the state after 30 pases in: ntalk30.dump

Let's see how well it does after 5 passes

Loading Saved Network: ntalk5.dump

Backpropagation Learning

Black Boxes:

ntalk (Saved at Iteration 28000)
Using datafile: ntalk.train

Phonemes Best Guess Stats (Smallest Angle)
Pd: 4209/5603 = 0.751205
Pfa: 1394/5603 = 0.248795


Stresses Best Guess Stats
Pd: 5027/5603 = 0.897198
Pfa: 576/5603 = 0.102802


Phonemes Best Guess Stats (Euclidian Distance)
Pd: 4277/5603 = 0.763341
Pfa: 1326/5603 = 0.236659


Stresses Best Guess Stats
Pd: 5027/5603 = 0.897198
Pfa: 576/5603 = 0.102802


Words Best Guess Stats (Largest Match)
Pd: 551/1034 = 0.532882
Pfa: 483/1034 = 0.467118

Let's see how well it does after 30 passes

Loading Saved Network: ntalk30.dump

Backpropagation Learning

Black Boxes:

ntalk (Saved at Iteration 167562)
Using datafile: ntalk.train

Phonemes Best Guess Stats (Smallest Angle)
Pd: 4905/5603 = 0.875424
Pfa: 698/5603 = 0.124576


Stresses Best Guess Stats
Pd: 5260/5603 = 0.938783
Pfa: 343/5603 = 0.061217


Phonemes Best Guess Stats (Euclidian Distance)
Pd: 4954/5603 = 0.884169
Pfa: 649/5603 = 0.115831


Stresses Best Guess Stats
Pd: 5260/5603 = 0.938783
Pfa: 343/5603 = 0.061217


Words Best Guess Stats (Largest Match)
Pd: 688/1034 = 0.665377
Pfa: 346/1034 = 0.334623

Let's see how well it does after 30 passes
ON THE WHOLE DATABASE!!! (be patient)

Loading Saved Network: ntalk30.dump

Backpropagation Learning

Black Boxes:

ntalk (Saved at Iteration 167562)
Using datafile: ntalk.data

Phonemes Best Guess Stats (Smallest Angle)
Pd: 111774/146762 = 0.761600
Pfa: 34988/146762 = 0.238400


Stresses Best Guess Stats
Pd: 118782/146762 = 0.809351
Pfa: 27980/146762 = 0.190649


Phonemes Best Guess Stats (Euclidian Distance)
Pd: 113614/146762 = 0.774138
Pfa: 33148/146762 = 0.225862


Stresses Best Guess Stats
Pd: 118784/146762 = 0.809365
Pfa: 27978/146762 = 0.190635


Words Best Guess Stats (Largest Match)
Pd: 15298/19987 = 0.765397
Pfa: 4689/19987 = 0.234602

Okay, let's continue training ON THE WHOLE DATABASE!!! (be patient)
Gotta recompile with new data file in user_init.c

Compiling User's Initialization: user_init.c ...

Making Application: ntalk ...

nnmake finished.

Once thru ntalk.data = 146943 iterations (once for every letter)
Going 5 times thru WHOLE DATABASE (~750,000 iterations)
BE PATIENT!!!

Using datafile: ntalk.data
Total number of positions: 146762
Loading Saved Network: ntalk30.dump

Backpropagation Learning

Black Boxes:

ntalk (Saved at Iteration 167562)

Learning...

Learning Rate: 0.050000
Inertia: 0.950000
Not testing.
Saving every 50000 iterations.
Truncating Learning after 750000 iterations.
Dumping Network at 50000.
Dumping Network at 100000.
Dumping Network at 150000.
Dumping Network at 200000.
Dumping Network at 250000.
Dumping Network at 300000.
Dumping Network at 350000.
Dumping Network at 400000.
Dumping Network at 450000.
Dumping Network at 500000.
Dumping Network at 550000.
Dumping Network at 600000.
Dumping Network at 650000.
Dumping Network at 700000.
Dumping Network at 750000.
Dumping Network at 750000.

Learning Rate: 0.050000
Inertia: 0.950000

Total Iterations 750000
Total number of connections: 27626

Let's see how well it does after 5 passes
ON THE WHOLE DATABASE!!! (be patient)

Loading Saved Network: ntalk.final.dump

Backpropagation Learning

Black Boxes:

ntalk (Saved at Iteration 887105)
Using datafile: ntalk.data

Phonemes Best Guess Stats (Smallest Angle)
Pd: 127890/146762 = 0.871411
Pfa: 18872/146762 = 0.128589


Stresses Best Guess Stats
Pd: 126240/146762 = 0.860168
Pfa: 20522/146762 = 0.139832


Phonemes Best Guess Stats (Euclidian Distance)
Pd: 128850/146762 = 0.877952
Pfa: 17912/146762 = 0.122048


Stresses Best Guess Stats
Pd: 126240/146762 = 0.860168
Pfa: 20522/146762 = 0.139832


Words Best Guess Stats (Largest Match)
Pd: 17542/19987 = 0.877670
Pfa: 2445/19987 = 0.122330
