(bernhard.1) <- Learn
Found ntalk.train
Performance Test...

Using datafile: ntalk.train
Total number of positions: 5603

Backpropagation Learning

Black Boxes:

ntalk (Saved at Iteration 0)

Forward...

Learning Rate: 0.050000
Inertia: 0.950000

Elapsed compute time: 2567.980000 seconds
Elapsed system time: 0.620000 seconds
Average performance on this task = 1.07579e+06 connections per second


Total Iterations 100000
Total number of connections: 27626
     2575.3 real      2568.0 user         0.7 sys  

Once thru ntalk.train = 5603 iterations (once for every letter)
Going 30 times thru training set (~168,000 iterations)

Using datafile: ntalk.train
Total number of positions: 5603

Backpropagation Learning

Black Boxes:

ntalk (Saved at Iteration 0)

Learning...

Learning Rate: 0.050000
Inertia: 0.950000
Not testing.
Saving every 14000 iterations.
Truncating Learning after 28000 iterations.
Dumping Network at 14000.
Dumping Network at 28000.
Dumping Network at 28000.

Learning Rate: 0.050000
Inertia: 0.950000

Elapsed compute time: 2016.600000 seconds
Elapsed system time: 0.610000 seconds
Average performance on this task = 383580 connections per second


Total Iterations 28000
Total number of connections: 27626
     2025.0 real      2016.6 user         0.7 sys  
I saved the state after 5 passes in: ntalk5.dump

Using datafile: ntalk.train
Total number of positions: 5603
Loading Saved Network: ntalk5.dump

Backpropagation Learning

Black Boxes:

ntalk (Saved at Iteration 28000)

Learning...

Learning Rate: 0.050000
Inertia: 0.950000
Not testing.
Saving every 5000 iterations.
Truncating Learning after 140000 iterations.
Dumping Network at 5000.
Dumping Network at 10000.
Dumping Network at 15000.
Dumping Network at 20000.
Dumping Network at 25000.
Dumping Network at 30000.
Dumping Network at 35000.
Dumping Network at 40000.
Dumping Network at 45000.
Dumping Network at 50000.
Dumping Network at 55000.
Dumping Network at 60000.
Dumping Network at 65000.
Dumping Network at 70000.
Dumping Network at 75000.
Dumping Network at 80000.
Dumping Network at 85000.
Dumping Network at 90000.
Dumping Network at 95000.
Dumping Network at 100000.
Dumping Network at 105000.
Dumping Network at 110000.
Dumping Network at 115000.
Dumping Network at 120000.
Dumping Network at 125000.
Dumping Network at 130000.
Dumping Network at 135000.
Dumping Network at 140000.
Dumping Network at 140000.

Learning Rate: 0.050000
Inertia: 0.950000

Elapsed compute time: 10063.820000 seconds
Elapsed system time: 4.520000 seconds
Average performance on this task = 384311 connections per second


Total Iterations 140000
Total number of connections: 27626
    10128.0 real     10063.8 user         4.6 sys  
I saved the state after 30 pases in: ntalk30.dump

Let's see how well it does after 5 passes

Loading Saved Network: ntalk5.dump

Backpropagation Learning

Black Boxes:

ntalk (Saved at Iteration 28000)
Using datafile: ntalk.train

Phonemes Best Guess Stats (Smallest Angle)
Pd: 4221/5603 = 0.753346
Pfa: 1382/5603 = 0.246654


Stresses Best Guess Stats
Pd: 5014/5603 = 0.894878
Pfa: 589/5603 = 0.105122


Phonemes Best Guess Stats (Euclidian Distance)
Pd: 4264/5603 = 0.761021
Pfa: 1339/5603 = 0.238979


Stresses Best Guess Stats
Pd: 5014/5603 = 0.894878
Pfa: 589/5603 = 0.105122


Words Best Guess Stats (Largest Match)
Pd: 551/1034 = 0.532882
Pfa: 483/1034 = 0.467118

Let's see how well it does after 30 passes

Loading Saved Network: ntalk30.dump

Backpropagation Learning

Black Boxes:

ntalk (Saved at Iteration 167791)
Using datafile: ntalk.train

Phonemes Best Guess Stats (Smallest Angle)
Pd: 4908/5603 = 0.875959
Pfa: 695/5603 = 0.124041


Stresses Best Guess Stats
Pd: 5264/5603 = 0.939497
Pfa: 339/5603 = 0.060503


Phonemes Best Guess Stats (Euclidian Distance)
Pd: 4962/5603 = 0.885597
Pfa: 641/5603 = 0.114403


Stresses Best Guess Stats
Pd: 5264/5603 = 0.939497
Pfa: 339/5603 = 0.060503


Words Best Guess Stats (Largest Match)
Pd: 687/1034 = 0.664410
Pfa: 347/1034 = 0.335590

Let's see how well it does after 30 passes
ON THE WHOLE DATABASE!!! (be patient)

Loading Saved Network: ntalk30.dump

Backpropagation Learning

Black Boxes:

ntalk (Saved at Iteration 167791)
Using datafile: ntalk.data

Phonemes Best Guess Stats (Smallest Angle)
Pd: 111449/146762 = 0.759386
Pfa: 35313/146762 = 0.240614


Stresses Best Guess Stats
Pd: 118920/146762 = 0.810291
Pfa: 27842/146762 = 0.189709


Phonemes Best Guess Stats (Euclidian Distance)
Pd: 112909/146762 = 0.769334
Pfa: 33853/146762 = 0.230666


Stresses Best Guess Stats
Pd: 118920/146762 = 0.810291
Pfa: 27842/146762 = 0.189709


Words Best Guess Stats (Largest Match)
Pd: 15121/19987 = 0.756542
Pfa: 4866/19987 = 0.243458

Okay, let's continue training ON THE WHOLE DATABASE!!! (be patient)
Gotta recompile with new data file in user_init.c

Compiling User's Initialization: user_init.c ...

Making Application: ntalk ...

nnmake finished.

Once thru ntalk.data = 146943 iterations (once for every letter)
Going 5 times thru WHOLE DATABASE (~750,000 iterations)
BE PATIENT!!!

Using datafile: ntalk.data
Total number of positions: 146762
Loading Saved Network: ntalk30.dump

Backpropagation Learning

Black Boxes:

ntalk (Saved at Iteration 167791)

Learning...

Learning Rate: 0.050000
Inertia: 0.950000
Not testing.
Saving every 50000 iterations.
Truncating Learning after 750000 iterations.
Dumping Network at 50000.
Dumping Network at 100000.
Dumping Network at 150000.
Dumping Network at 200000.
Dumping Network at 250000.
Dumping Network at 300000.
Dumping Network at 350000.
Dumping Network at 400000.
Dumping Network at 450000.
Dumping Network at 500000.
Dumping Network at 550000.
Dumping Network at 600000.
Dumping Network at 650000.
Dumping Network at 700000.
Dumping Network at 750000.
Dumping Network at 750000.

Learning Rate: 0.050000
Inertia: 0.950000

Elapsed compute time: 52464.730000 seconds
Elapsed system time: 9.400000 seconds
Average performance on this task = 394922 connections per second


Total Iterations 750000
Total number of connections: 27626
    52625.4 real     52464.7 user         9.6 sys  

Let's see how well it does after 5 passes
ON THE WHOLE DATABASE!!! (be patient)

Loading Saved Network: ntalk.final.dump

Backpropagation Learning

Black Boxes:

ntalk (Saved at Iteration 886733)
Using datafile: ntalk.data

Phonemes Best Guess Stats (Smallest Angle)
Pd: 128413/146762 = 0.874974
Pfa: 18349/146762 = 0.125026


Stresses Best Guess Stats
Pd: 126410/146762 = 0.861327
Pfa: 20352/146762 = 0.138673


Phonemes Best Guess Stats (Euclidian Distance)
Pd: 129275/146762 = 0.880848
Pfa: 17487/146762 = 0.119152


Stresses Best Guess Stats
Pd: 126411/146762 = 0.861333
Pfa: 20351/146762 = 0.138667


Words Best Guess Stats (Largest Match)
Pd: 17570/19987 = 0.879071
Pfa: 2417/19987 = 0.120929
(bernhard.2) <- 
(bernhard.2) <- 