Liezl Puzon 8798a24031 Have noising account for sentences with and without EOS (#305) ... Summary: Pull Request resolved: https://github.com/pytorch/fairseq/pull/305 Previously, noising code assumed that every sentence had an EOS which had to be excluded from noising operations (since we shouldn't drop, blank, or shuffle EOS). This logic allows the noising module to handle sentences with EOS and without EOS Reviewed By: xianxl Differential Revision: D10114425 fbshipit-source-id: 04ec8547343eb94266bda1ac7fca3d8a1991c9f4		2018-10-05 18:21:26 -07:00
..
__init__.py	fairseq-py goes distributed (#106)	2018-02-27 17:09:42 -05:00
test_average_checkpoints.py	Merge internal changes (#136)	2018-04-02 10:13:07 -04:00
test_backtranslation_dataset.py	Option to remove EOS at source in backtranslation dataset	2018-10-03 18:23:32 -07:00
test_binaries.py	Fix proxying in DistributedFairseqModel	2018-10-03 16:22:35 -07:00
test_character_token_embedder.py	fix tests	2018-09-03 19:15:23 -04:00
test_convtbc.py	Remove more Variable() calls (#198)	2018-06-25 12:23:04 -04:00
test_dictionary.py	Remove more Variable() calls (#198)	2018-06-25 12:23:04 -04:00
test_iterators.py	Further generalize EpochBatchIterator and move iterators into new file	2018-09-03 19:15:23 -04:00
test_label_smoothing.py	Add FairseqTask	2018-06-15 13:05:22 -06:00
test_noising.py	Have noising account for sentences with and without EOS (#305)	2018-10-05 18:21:26 -07:00
test_reproducibility.py	Add unit test to verify reproducibility after reloading checkpoints	2018-09-25 17:36:43 -04:00
test_sequence_generator.py	Online backtranslation module	2018-09-25 17:36:43 -04:00
test_sequence_scorer.py	Add FairseqTask	2018-06-15 13:05:22 -06:00
test_train.py	core changes to support latte collab	2018-09-25 17:36:43 -04:00
test_utils.py	Remove more Variable() calls (#198)	2018-06-25 12:23:04 -04:00
utils.py	Online backtranslation module	2018-09-25 17:36:43 -04:00