Script started on Mon Aug 12 18:27:28 1991
(leviathan.1) <- Learn
Found ntalk.train
Performance Test...

Using datafile: ntalk.train
Total number of positions: 5603

Backpropagation Learning

Black Boxes:

ntalk (Saved at Iteration 0)

Forward...

Elapsed compute time: 1173.50000 seconds
Elapsed system time: 0.320000 seconds
Average performance on this task = 2.35506e+06 connections per second


Total Iterations 100000
Total number of connections: 27626
     1174.7 real      1173.0 user         0.3 sys  

Once thru ntalk.train = 5603 iterations (once for every letter)
Going 30 times thru training set (~168,000 iterations)

Using datafile: ntalk.train
Total number of positions: 5603

Backpropagation Learning

Black Boxes:

ntalk (Saved at Iteration 0)

Learning...

Learning Rate: 0.050000
Inertia: 0.950000
Not testing.
Saving every 14000 iterations.
Truncating Learning after 28000 iterations.
Dumping Network at 14000.
Dumping Network at 28000.
Dumping Network at 28000.

Learning Rate: 0.050000
Inertia: 0.950000

Elapsed compute time: 882.920000 seconds
Elapsed system time: 0.300000 seconds
Average performance on this task = 876102 connections per second


Total Iterations 28000
Total number of connections: 27626
      888.0 real       882.9 user         0.3 sys  
I saved the state after 5 passes in: ntalk5.dump

Using datafile: ntalk.train
Total number of positions: 5603
Loading Saved Network: ntalk5.dump

Backpropagation Learning

Black Boxes:

ntalk (Saved at Iteration 28000)

Learning...

Learning Rate: 0.050000
Inertia: 0.950000
Not testing.
Saving every 5000 iterations.
Truncating Learning after 140000 iterations.
Dumping Network at 5000.
Dumping Network at 10000.
Dumping Network at 15000.
Dumping Network at 20000.
Dumping Network at 25000.
Dumping Network at 30000.
Dumping Network at 35000.
Dumping Network at 40000.
Dumping Network at 45000.
Dumping Network at 50000.
Dumping Network at 55000.
Dumping Network at 60000.
Dumping Network at 65000.
Dumping Network at 70000.
Dumping Network at 75000.
Dumping Network at 80000.
Dumping Network at 85000.
Dumping Network at 90000.
Dumping Network at 95000.
Dumping Network at 100000.
Dumping Network at 105000.
Dumping Network at 110000.
Dumping Network at 115000.
Dumping Network at 120000.
Dumping Network at 125000.
Dumping Network at 130000.
Dumping Network at 135000.
Dumping Network at 140000.
Dumping Network at 140000.

Learning Rate: 0.050000
Inertia: 0.950000

Elapsed compute time: 4406.380000 seconds
Elapsed system time: 1.550000 seconds
Average performance on this task = 877736 connections per second


Total Iterations 140000
Total number of connections: 27626
     4446.0 real      4406.3 user         1.5 sys  
I saved the state after 30 pases in: ntalk30.dump

Let's see how well it does after 5 passes

Loading Saved Network: ntalk5.dump

Backpropagation Learning

Black Boxes:

ntalk (Saved at Iteration 28000)
Using datafile: ntalk.train

Phonemes Best Guess Stats (Smallest Angle)
Pd: 4180/5603 = 0.746029
Pfa: 1423/5603 = 0.253971


Stresses Best Guess Stats
Pd: 5000/5603 = 0.892379
Pfa: 603/5603 = 0.107621


Phonemes Best Guess Stats (Euclidian Distance)
Pd: 4273/5603 = 0.762627
Pfa: 1330/5603 = 0.237373


Stresses Best Guess Stats
Pd: 5000/5603 = 0.892379
Pfa: 603/5603 = 0.107621


Words Best Guess Stats (Largest Match)
Pd: 556/1034 = 0.537718
Pfa: 478/1034 = 0.462282

Let's see how well it does after 30 passes

Loading Saved Network: ntalk30.dump

Backpropagation Learning

Black Boxes:

ntalk (Saved at Iteration 167695)
Using datafile: ntalk.train

Phonemes Best Guess Stats (Smallest Angle)
Pd: 4870/5603 = 0.869177
Pfa: 733/5603 = 0.130823


Stresses Best Guess Stats
Pd: 5262/5603 = 0.939140
Pfa: 341/5603 = 0.060860


Phonemes Best Guess Stats (Euclidian Distance)
Pd: 4947/5603 = 0.882920
Pfa: 656/5603 = 0.117080


Stresses Best Guess Stats
Pd: 5262/5603 = 0.939140
Pfa: 341/5603 = 0.060860


Words Best Guess Stats (Largest Match)
Pd: 686/1034 = 0.663443
Pfa: 348/1034 = 0.336557

Let's see how well it does after 30 passes
ON THE WHOLE DATABASE!!! (be patient)

Loading Saved Network: ntalk30.dump

Backpropagation Learning

Black Boxes:

ntalk (Saved at Iteration 167695)
Using datafile: ntalk.data

Phonemes Best Guess Stats (Smallest Angle)
Pd: 111498/146762 = 0.759720
Pfa: 35264/146762 = 0.240280


Stresses Best Guess Stats
Pd: 118920/146762 = 0.810291
Pfa: 27842/146762 = 0.189709


Phonemes Best Guess Stats (Euclidian Distance)
Pd: 113145/146762 = 0.770942
Pfa: 33617/146762 = 0.229058


Stresses Best Guess Stats
Pd: 118922/146762 = 0.810305
Pfa: 27840/146762 = 0.189695


Words Best Guess Stats (Largest Match)
Pd: 15251/19987 = 0.763046
Pfa: 4736/19987 = 0.236954

Okay, let's continue training ON THE WHOLE DATABASE!!! (be patient)
Gotta recompile with new data file in user_init.c

Compiling User's Initialization: user_init.c ...

Making Application: ntalk ...

bpmake finished.

Once thru ntalk.data = 146943 iterations (once for every letter)
Going 5 times thru WHOLE DATABASE (~750,000 iterations)
BE PATIENT!!!

Using datafile: ntalk.data
Total number of positions: 146762
Loading Saved Network: ntalk30.dump

Backpropagation Learning

Black Boxes:

ntalk (Saved at Iteration 167695)

Learning...

Learning Rate: 0.050000
Inertia: 0.950000
Not testing.
Saving every 50000 iterations.
Truncating Learning after 750000 iterations.
Dumping Network at 50000.
Dumping Network at 100000.
Dumping Network at 150000.
Dumping Network at 200000.
Dumping Network at 250000.
Dumping Network at 300000.
Dumping Network at 350000.
Dumping Network at 400000.
Dumping Network at 450000.
Dumping Network at 500000.
Dumping Network at 550000.
Dumping Network at 600000.
Dumping Network at 650000.
Dumping Network at 700000.
Dumping Network at 750000.
Dumping Network at 750000.

Learning Rate: 0.050000
Inertia: 0.950000

Elapsed compute time: 22994.660000 seconds
Elapsed system time: 2.820000 seconds
Average performance on this task = 901057 connections per second


Total Iterations 750000
Total number of connections: 27626
    23041.9 real     22994.6 user         2.8 sys  

Let's see how well it does after 5 passes
ON THE WHOLE DATABASE!!! (be patient)

Loading Saved Network: ntalk.final.dump

Backpropagation Learning

Black Boxes:

ntalk (Saved at Iteration 885000)
Using datafile: ntalk.data

Phonemes Best Guess Stats (Smallest Angle)
Pd: 127907/146762 = 0.871527
Pfa: 18855/146762 = 0.128473


Stresses Best Guess Stats
Pd: 126563/146762 = 0.862369
Pfa: 20199/146762 = 0.137631


Phonemes Best Guess Stats (Euclidian Distance)
Pd: 128908/146762 = 0.878347
Pfa: 17854/146762 = 0.121653


Stresses Best Guess Stats
Pd: 126559/146762 = 0.862342
Pfa: 20203/146762 = 0.137658


Words Best Guess Stats (Largest Match)
Pd: 17499/19987 = 0.875519
Pfa: 2488/19987 = 0.124481
(leviathan.2) <- exit
(leviathan.3) <- 
script done on Tue Aug 13 06:49:06 1991
