mirror of
https://github.com/facebookresearch/fairseq.git
synced 2024-09-11 17:25:31 +03:00
Summary: Pull Request resolved: https://github.com/pytorch/fairseq/pull/305 Previously, noising code assumed that every sentence had an EOS which had to be excluded from noising operations (since we shouldn't drop, blank, or shuffle EOS). This logic allows the noising module to handle sentences with EOS and without EOS Reviewed By: xianxl Differential Revision: D10114425 fbshipit-source-id: 04ec8547343eb94266bda1ac7fca3d8a1991c9f4 |
||
---|---|---|
.. | ||
__init__.py | ||
test_average_checkpoints.py | ||
test_backtranslation_dataset.py | ||
test_binaries.py | ||
test_character_token_embedder.py | ||
test_convtbc.py | ||
test_dictionary.py | ||
test_iterators.py | ||
test_label_smoothing.py | ||
test_noising.py | ||
test_reproducibility.py | ||
test_sequence_generator.py | ||
test_sequence_scorer.py | ||
test_train.py | ||
test_utils.py | ||
utils.py |