mirror of
https://github.com/facebookresearch/fairseq.git
synced 2024-09-11 17:25:31 +03:00
7633129ba8
Summary: Pull Request resolved: https://github.com/pytorch/translate/pull/283 Pull Request resolved: https://github.com/pytorch/fairseq/pull/428 Differential Revision: D13564190 Pulled By: myleott fbshipit-source-id: 3b62282d7069c288f5bdd1dd2c120788cee4abb5
35 lines
1.0 KiB
ReStructuredText
35 lines
1.0 KiB
ReStructuredText
.. role:: hidden
|
|
:class: hidden-section
|
|
|
|
.. _Learning Rate Schedulers:
|
|
|
|
Learning Rate Schedulers
|
|
========================
|
|
|
|
Learning Rate Schedulers update the learning rate over the course of training.
|
|
Learning rates can be updated after each update via :func:`step_update` or at
|
|
epoch boundaries via :func:`step`.
|
|
|
|
.. automodule:: fairseq.optim.lr_scheduler
|
|
:members:
|
|
|
|
.. autoclass:: fairseq.optim.lr_scheduler.FairseqLRScheduler
|
|
:members:
|
|
:undoc-members:
|
|
|
|
.. autoclass:: fairseq.optim.lr_scheduler.cosine_lr_scheduler.CosineSchedule
|
|
:members:
|
|
:undoc-members:
|
|
.. autoclass:: fairseq.optim.lr_scheduler.fixed_schedule.FixedSchedule
|
|
:members:
|
|
:undoc-members:
|
|
.. autoclass:: fairseq.optim.lr_scheduler.inverse_square_root_schedule.InverseSquareRootSchedule
|
|
:members:
|
|
:undoc-members:
|
|
.. autoclass:: fairseq.optim.lr_scheduler.reduce_lr_on_plateau.ReduceLROnPlateau
|
|
:members:
|
|
:undoc-members:
|
|
.. autoclass:: fairseq.optim.lr_scheduler.reduce_angular_lr_scheduler.TriangularSchedule
|
|
:members:
|
|
:undoc-members:
|