
Script started on Mon Jan 20 10:18:03 1992
[/dev/ttyp013]
CRAY-YMP-1CPU$ Learn
Found ntalk.train
Performance Test...

Using datafile: ntalk.train
Total number of positions: 5603

Backpropagation Learning

Black Boxes:

ntalk (Saved at Iteration 0)

Forward...

Total Iterations 100000
Total number of connections: 27626

           seconds          clocks
elapsed   43.33926      7223209471
user      24.48478      4080797180
sys        0.61170       101949940

Once thru ntalk.train = 5603 iterations (once for every letter)
Going 30 times thru training set (~168,000 iterations)

Using datafile: ntalk.train
Total number of positions: 5603

Backpropagation Learning

Black Boxes:

ntalk (Saved at Iteration 0)

Learning...

Learning Rate: 0.050000
Inertia: 0.950000
Not testing.
Saving every 14000 iterations.
Truncating Learning after 28000 iterations.
Dumping Network at 14000.
Dumping Network at 28000.
Dumping Network at 28000.

Learning Rate: 0.050000
Inertia: 0.950000

Total Iterations 28000
Total number of connections: 27626

           seconds          clocks
elapsed   41.64253      6940421097
user      22.89476      3815793990
sys        0.79586       132643110
I saved the state after 5 passes in: ntalk5.dump

Using datafile: ntalk.train
Total number of positions: 5603
Loading Saved Network: ntalk5.dump

Backpropagation Learning

Black Boxes:

ntalk (Saved at Iteration 27998)

Learning...

Learning Rate: 0.050000
Inertia: 0.950000
Not testing.
Saving every 5000 iterations.
Truncating Learning after 140000 iterations.
Dumping Network at 5000.
Dumping Network at 10000.
Dumping Network at 15000.
Dumping Network at 20000.
Dumping Network at 25000.
Dumping Network at 30000.
Dumping Network at 35000.
Dumping Network at 40000.
Dumping Network at 45000.
Dumping Network at 50000.
Dumping Network at 55000.
Dumping Network at 60000.
Dumping Network at 65000.
Dumping Network at 70000.
Dumping Network at 75000.
Dumping Network at 80000.
Dumping Network at 85000.
Dumping Network at 90000.
Dumping Network at 95000.
Dumping Network at 100000.
Dumping Network at 105000.
Dumping Network at 110000.
Dumping Network at 115000.
Dumping Network at 120000.
Dumping Network at 125000.
Dumping Network at 130000.
Dumping Network at 135000.
Dumping Network at 140000.
Dumping Network at 140000.

Learning Rate: 0.050000
Inertia: 0.950000

Total Iterations 140000
Total number of connections: 27626

           seconds          clocks
elapsed  295.65053     49275089006
user     107.98427     17997379029
sys        3.69786       616310710
I saved the state after 30 pases in: ntalk30.dump

Let's see how well it does after 5 passes

Loading Saved Network: ntalk5.dump

Backpropagation Learning

Black Boxes:

ntalk (Saved at Iteration 27998)
Using datafile: ntalk.train

Phonemes Best Guess Stats (Smallest Angle)
Pd: 4198/5603 = 0.749241
Pfa: 1405/5603 = 0.250759


Stresses Best Guess Stats
Pd: 4992/5603 = 0.890951
Pfa: 611/5603 = 0.109049


Phonemes Best Guess Stats (Euclidian Distance)
Pd: 4283/5603 = 0.764412
Pfa: 1320/5603 = 0.235588


Stresses Best Guess Stats
Pd: 4992/5603 = 0.890951
Pfa: 611/5603 = 0.109049


Words Best Guess Stats (Largest Match)
Pd: 556/1034 = 0.537718
Pfa: 478/1034 = 0.462282

Let's see how well it does after 30 passes

Loading Saved Network: ntalk30.dump

Backpropagation Learning

Black Boxes:

ntalk (Saved at Iteration 160254)
Using datafile: ntalk.train

Phonemes Best Guess Stats (Smallest Angle)
Pd: 4875/5603 = 0.870070
Pfa: 728/5603 = 0.129930


Stresses Best Guess Stats
Pd: 5260/5603 = 0.938783
Pfa: 343/5603 = 0.061217


Phonemes Best Guess Stats (Euclidian Distance)
Pd: 4945/5603 = 0.882563
Pfa: 658/5603 = 0.117437


Stresses Best Guess Stats
Pd: 5260/5603 = 0.938783
Pfa: 343/5603 = 0.061217


Words Best Guess Stats (Largest Match)
Pd: 687/1034 = 0.664410
Pfa: 347/1034 = 0.335590

Let's see how well it does after 30 passes
ON THE WHOLE DATABASE!!! (be patient)

Loading Saved Network: ntalk30.dump

Backpropagation Learning

Black Boxes:

ntalk (Saved at Iteration 160254)
Using datafile: ntalk.data

Phonemes Best Guess Stats (Smallest Angle)
Pd: 111502/146762 = 0.759747
Pfa: 35260/146762 = 0.240253


Stresses Best Guess Stats
Pd: 118923/146762 = 0.810312
Pfa: 27839/146762 = 0.189688


Phonemes Best Guess Stats (Euclidian Distance)
Pd: 113247/146762 = 0.771637
Pfa: 33515/146762 = 0.228363


Stresses Best Guess Stats
Pd: 118927/146762 = 0.810339
Pfa: 27835/146762 = 0.189661


Words Best Guess Stats (Largest Match)
Pd: 15258/19987 = 0.763396
Pfa: 4729/19987 = 0.236604

Okay, let's continue training ON THE WHOLE DATABASE!!! (be patient)
Gotta recompile with new data file in user_init.c

Compiling User's Initialization: user_init.c ...

Making Application: ntalk ...

bpmake finished.

Once thru ntalk.data = 146943 iterations (once for every letter)
Going 5 times thru WHOLE DATABASE (~750,000 iterations)
BE PATIENT!!!

Using datafile: ntalk.data
Total number of positions: 146762
Loading Saved Network: ntalk30.dump

Backpropagation Learning

Black Boxes:

ntalk (Saved at Iteration 160254)

Learning...

Learning Rate: 0.050000
Inertia: 0.950000
Not testing.
Saving every 50000 iterations.
Truncating Learning after 750000 iterations.
Dumping Network at 50000.
Dumping Network at 100000.
Dumping Network at 150000.
Dumping Network at 200000.
Dumping Network at 250000.
Dumping Network at 300000.
Dumping Network at 350000.
Dumping Network at 400000.
Dumping Network at 450000.
Dumping Network at 500000.
Dumping Network at 550000.
Dumping Network at 600000.
Dumping Network at 650000.
Dumping Network at 700000.
Dumping Network at 750000.
Dumping Network at 750000.

Learning Rate: 0.050000
Inertia: 0.950000

Total Iterations 750000
Total number of connections: 27626

           seconds          clocks
elapsed  914.71450    152452417347
user     535.06333     89177222165
sys        8.59847      1433079145

Let's see how well it does after 5 passes
ON THE WHOLE DATABASE!!! (be patient)

Loading Saved Network: ntalk.final.dump

Backpropagation Learning

Black Boxes:

ntalk (Saved at Iteration 775187)
Using datafile: ntalk.data

Phonemes Best Guess Stats (Smallest Angle)
Pd: 127936/146762 = 0.871724
Pfa: 18826/146762 = 0.128276


Stresses Best Guess Stats
Pd: 126456/146762 = 0.861640
Pfa: 20306/146762 = 0.138360


Phonemes Best Guess Stats (Euclidian Distance)
Pd: 128949/146762 = 0.878627
Pfa: 17813/146762 = 0.121373


Stresses Best Guess Stats
Pd: 126468/146762 = 0.861722
Pfa: 20294/146762 = 0.138278


Words Best Guess Stats (Largest Match)
Pd: 17516/19987 = 0.876370
Pfa: 2471/19987 = 0.123630
CRAY-YMP-1CPU$ exit

Script finished on Mon Jan 20 11:13:26 1992

