Learning Scheduler

[o0t1ng0o]

Hi @ipeevski @rubendax @shinshin86 @Eric-Hao @brycegoh ,

Thank you for release such interesting work.
I found the default learning schedular is constant.
Why you use a constant learning rate instead of the linear or cosine?

Thank you,