
Script started on Wed Jan 22 09:39:23 1992
[/dev/ttyp008]
CRAY-C90-1CPU$ Learn
Found ntalk.train
Performance Test...

Using datafile: ntalk.data
Total number of positions: 146762

Backpropagation Learning

Black Boxes:

ntalk (Saved at Iteration 0)

Forward...

Total Iterations 100000
Total number of connections: 27626

           seconds          clocks
elapsed   29.93883      7185318841
user      12.54164      3009994144
sys        0.20501        49201930

Once thru ntalk.train = 5603 iterations (once for every letter)
Going 30 times thru training set (~168,000 iterations)

Using datafile: ntalk.data
Total number of positions: 146762

Backpropagation Learning

Black Boxes:

ntalk (Saved at Iteration 0)

Learning...

Learning Rate: 0.050000
Inertia: 0.950000
Not testing.
Saving every 14000 iterations.
Truncating Learning after 28000 iterations.
Dumping Network at 14000.
Dumping Network at 28000.
Dumping Network at 28000.

Learning Rate: 0.050000
Inertia: 0.950000

Total Iterations 28000
Total number of connections: 27626

           seconds          clocks
elapsed   32.60613      7825471814
user      13.79857      3311656798
sys        0.23176        55622640
I saved the state after 5 passes in: ntalk5.dump

Using datafile: ntalk.data
Total number of positions: 146762
Loading Saved Network: ntalk5.dump

Backpropagation Learning

Black Boxes:

ntalk (Saved at Iteration 27979)

Learning...

Learning Rate: 0.050000
Inertia: 0.950000
Not testing.
Saving every 5000 iterations.
Truncating Learning after 140000 iterations.
Dumping Network at 5000.
Dumping Network at 10000.
Dumping Network at 15000.
Dumping Network at 20000.
Dumping Network at 25000.
Dumping Network at 30000.
Dumping Network at 35000.
Dumping Network at 40000.
Dumping Network at 45000.
Dumping Network at 50000.
Dumping Network at 55000.
Dumping Network at 60000.
Dumping Network at 65000.
Dumping Network at 70000.
Dumping Network at 75000.
Dumping Network at 80000.
Dumping Network at 85000.
Dumping Network at 90000.
Dumping Network at 95000.
Dumping Network at 100000.
Dumping Network at 105000.
Dumping Network at 110000.
Dumping Network at 115000.
Dumping Network at 120000.
Dumping Network at 125000.
Dumping Network at 130000.
Dumping Network at 135000.
Dumping Network at 140000.
Dumping Network at 140000.

Learning Rate: 0.050000
Inertia: 0.950000

Total Iterations 140000
Total number of connections: 27626

           seconds          clocks
elapsed  140.42507     33702016478
user      58.94177     14146024724
sys        0.95326       228781630
I saved the state after 30 pases in: ntalk30.dump

Let's see how well it does after 5 passes

Loading Saved Network: ntalk5.dump

Backpropagation Learning

Black Boxes:

ntalk (Saved at Iteration 27979)
Using datafile: ntalk.train

Phonemes Best Guess Stats (Smallest Angle)
Pd: 3720/5603 = 0.663930
Pfa: 1883/5603 = 0.336070


Stresses Best Guess Stats
Pd: 4830/5603 = 0.862038
Pfa: 773/5603 = 0.137962


Phonemes Best Guess Stats (Euclidian Distance)
Pd: 3707/5603 = 0.661610
Pfa: 1896/5603 = 0.338390


Stresses Best Guess Stats
Pd: 4828/5603 = 0.861681
Pfa: 775/5603 = 0.138319


Words Best Guess Stats (Largest Match)
Pd: 475/1034 = 0.459381
Pfa: 559/1034 = 0.540619

Let's see how well it does after 30 passes

Loading Saved Network: ntalk30.dump

Backpropagation Learning

Black Boxes:

ntalk (Saved at Iteration 162590)
Using datafile: ntalk.train

Phonemes Best Guess Stats (Smallest Angle)
Pd: 4372/5603 = 0.780296
Pfa: 1231/5603 = 0.219704


Stresses Best Guess Stats
Pd: 4927/5603 = 0.879350
Pfa: 676/5603 = 0.120650


Phonemes Best Guess Stats (Euclidian Distance)
Pd: 4424/5603 = 0.789577
Pfa: 1179/5603 = 0.210423


Stresses Best Guess Stats
Pd: 4927/5603 = 0.879350
Pfa: 676/5603 = 0.120650


Words Best Guess Stats (Largest Match)
Pd: 587/1034 = 0.567698
Pfa: 447/1034 = 0.432302

Let's see how well it does after 30 passes
ON THE WHOLE DATABASE!!! (be patient)

Loading Saved Network: ntalk30.dump

Backpropagation Learning

Black Boxes:

ntalk (Saved at Iteration 162590)
Using datafile: ntalk.data

Phonemes Best Guess Stats (Smallest Angle)
Pd: 114870/146762 = 0.782696
Pfa: 31892/146762 = 0.217304


Stresses Best Guess Stats
Pd: 121176/146762 = 0.825663
Pfa: 25586/146762 = 0.174337


Phonemes Best Guess Stats (Euclidian Distance)
Pd: 116284/146762 = 0.792330
Pfa: 30478/146762 = 0.207670


Stresses Best Guess Stats
Pd: 121185/146762 = 0.825725
Pfa: 25577/146762 = 0.174275


Words Best Guess Stats (Largest Match)
Pd: 15245/19987 = 0.762746
Pfa: 4742/19987 = 0.237254

Okay, let's continue training ON THE WHOLE DATABASE!!! (be patient)
Gotta recompile with new data file in user_init.c

Compiling User's Initialization: user_init.c ...

Making Application: ntalk ...

bpmake finished.

Once thru ntalk.data = 146943 iterations (once for every letter)
Going 5 times thru WHOLE DATABASE (~750,000 iterations)
BE PATIENT!!!

Using datafile: ntalk.data
Total number of positions: 146762
Loading Saved Network: ntalk30.dump

Backpropagation Learning

Black Boxes:

ntalk (Saved at Iteration 162590)

Learning...

Learning Rate: 0.050000
Inertia: 0.950000
Not testing.
Saving every 50000 iterations.
Truncating Learning after 750000 iterations.
Dumping Network at 50000.
Dumping Network at 100000.
Dumping Network at 150000.
Dumping Network at 200000.
Dumping Network at 250000.
Dumping Network at 300000.
Dumping Network at 350000.
Dumping Network at 400000.
Dumping Network at 450000.
Dumping Network at 500000.
Dumping Network at 550000.
Dumping Network at 600000.
Dumping Network at 650000.
Dumping Network at 700000.
Dumping Network at 750000.
Dumping Network at 750000.

Learning Rate: 0.050000
Inertia: 0.950000

Total Iterations 750000
Total number of connections: 27626

           seconds          clocks
elapsed  823.36807    197608336615
user     277.34619     66563085339
sys        3.32927       799024798

Let's see how well it does after 5 passes
ON THE WHOLE DATABASE!!! (be patient)

Loading Saved Network: ntalk.final.dump

Backpropagation Learning

Black Boxes:

ntalk (Saved at Iteration 784548)
Using datafile: ntalk.data

Phonemes Best Guess Stats (Smallest Angle)
Pd: 128136/146762 = 0.873087
Pfa: 18626/146762 = 0.126913


Stresses Best Guess Stats
Pd: 126639/146762 = 0.862887
Pfa: 20123/146762 = 0.137113


Phonemes Best Guess Stats (Euclidian Distance)
Pd: 128845/146762 = 0.877918
Pfa: 17917/146762 = 0.122082


Stresses Best Guess Stats
Pd: 126641/146762 = 0.862900
Pfa: 20121/146762 = 0.137100


Words Best Guess Stats (Largest Match)
Pd: 17457/19987 = 0.873418
Pfa: 2530/19987 = 0.126582
CRAY-C90-1CPU$ exit

Script finished on Wed Jan 22 10:41:04 1992

