Learning rate schedulers
PyTorch Developer Podcast - En podkast av Edward Yang, Team PyTorch

Kategorier:
What’s a learning rate? Why might you want to schedule it? How does the LR scheduler API in PyTorch work? What the heck is up with the formula implementation? Why is everything terrible?