Add super convergence example #96
Conversation
|
Check out this pull request on See visual diffs & provide feedback on Jupyter Notebooks. Powered by ReviewNB |
| @@ -0,0 +1,2061 @@ | |||
| { | |||
There was a problem hiding this comment.
lr=0.1 is used in line 5 and wondering how this value is found.
Did you set this lr from some findings from find_lr call in the previous cell?
Reply via ReviewNB
There was a problem hiding this comment.
Yes from the figure approximately at learning rate 10^-1 the loss started decreasing.
There was a problem hiding this comment.
Is there a systematic way to get lr instead of eyeballing?
If not, would you add a comment how to select lr in practice?
There was a problem hiding this comment.
Hi @sathish-a, just a kind reminder. Please let us know if there is anything that we could help.
There was a problem hiding this comment.
@kihyuks thanks for the reminder. I added it.
Added information about how to choose a good learning rate.
3 participants
wrt #41 adding super convergence notebook to examples.