Skip to content

Commit

Permalink
inclure the overfit curve on the minibatch
Browse files Browse the repository at this point in the history
  • Loading branch information
jeremyfix committed Dec 27, 2023
1 parent 1155ca3 commit ae78ac7
Showing 1 changed file with 2 additions and 0 deletions.
2 changes: 2 additions & 0 deletions Webpage/02-pytorch-asr.md
Original file line number Diff line number Diff line change
Expand Up @@ -348,6 +348,8 @@ mymachine:~:mylogin$ python3 main_ctc.py train --debug --batch_size 16

You should pretty "quickly" see a null loss on the training set with a perfect decoding. Note that it still takes 2s. per minibatch and a hundred epochs for overfitting.

![CTC loss on the test/train/valid sets with an overfitting architecture, considering only one minibatch of size 16.](./data/02-pytorch-asr/overfit_minibatch.png){.bordered}

### Overfitting the training set

The next step is to design a sufficiently rich architecture to overfit the training set when any sort of regularization is disabled (L2/L1, dropout, data augmentation, ...) :
Expand Down

0 comments on commit ae78ac7

Please sign in to comment.