facebookresearch/fairseq
1
1
Fork 0
mirror of https://github.com/facebookresearch/fairseq.git synced 2024-08-16 20:10:40 +03:00
Code Issues Packages Projects Releases Wiki Activity
3a757d7ab2
fairseq/tests
History
Wei Wei 3a757d7ab2 BT enablement on fairseq - fairseq change (#4480) 
Summary:
Pull Request resolved: https://github.com/facebookresearch/fairseq/pull/4480

as titled and depends on D36057338
Fork the inference path inside the forward function. If loaded the checkpoint file and perform the inference, we will deploy BT. Otherwise, fairseq take the position.

In summary:
Accuracy: accuracy loss due to the fp16, the maximum diff is around 0.009. If we set it to fp32, there is no accuracy loss
Perf: the current fairseq has similar speed as vanilla version. After the enablement, the speedup is similar to standalone BT test.
With batch size=64
For V100, the speedup reaches to 1.23x
For A100, the speedup reaches to 1.38x

After enable nested tensor,
For V100, the speedup reaches to 2.46x

Reviewed By: mikekgfb

Differential Revision: D37082681

fbshipit-source-id: 984266f850fc30603e48be56e41ac2c67da080f5
2022-06-15 21:48:41 -07:00
..
distributed fix flake8 issues (#2570) 2021-12-09 02:34:30 -08:00
gpu Fix EMA GPU test 2022-02-04 09:10:06 -08:00
speech Merge STPT: Step 3 2022-05-10 19:44:00 -07:00
speech_recognition Enable Hydra configs in fairseq (#1343) (#1510) 2020-10-20 00:32:26 -07:00
tasks add masked_lm test (#4344) 2022-04-18 14:47:00 -07:00
__init__.py remediation of S205607 2020-07-17 17:21:51 -07:00
test_activation_checkpointing.py Make checkpoint wrapper pickleable (#1603) 2021-02-06 08:07:32 -08:00
test_amp_optimizer.py Add linting with black (#2678) 2021-11-29 12:32:59 -08:00
test_average_checkpoints.py Apply black+isort (#1357) 2020-10-18 18:14:51 -07:00
test_backtranslation_dataset.py Apply black+isort (#1357) 2020-10-18 18:14:51 -07:00
test_binaries.py Add linting with black (#2678) 2021-11-29 12:32:59 -08:00
test_binarizer.py Preprocess Split (#2738) 2022-01-11 11:56:46 -08:00
test_character_token_embedder.py Apply black+isort (#1357) 2020-10-18 18:14:51 -07:00
test_checkpoint_utils.py Data2vec prelim (#2929) 2022-01-20 00:02:16 -08:00
test_concat_dataset.py Apply black+isort (#1357) 2020-10-18 18:14:51 -07:00
test_constraints.py fix flake8 issues (#2570) 2021-12-09 02:34:30 -08:00
test_convtbc.py Apply black+isort (#1357) 2020-10-18 18:14:51 -07:00
test_data_utils.py Add linting with black (#2678) 2021-11-29 12:32:59 -08:00
test_dataclass_utils.py Add linting with black (#2678) 2021-11-29 12:32:59 -08:00
test_dataset.py Add support for FullyShardedDataParallel (--ddp-backend=fully_sharded) (#1667) 2021-03-04 13:32:46 -08:00
test_dictionary.py Extract File Chunking to its own utils (#1955) 2021-06-28 01:46:32 -07:00
test_ema.py don't use half precision in test_ema on CPU (#3408) 2022-05-26 21:14:17 -07:00
test_espnet_multihead_attention.py conformer (#2859) 2022-01-10 16:18:38 -08:00
test_export.py BT enablement on fairseq - fairseq change (#4480) 2022-06-15 21:48:41 -07:00
test_file_chunker_utils.py Extract File Chunking to its own utils (#1955) 2021-06-28 01:46:32 -07:00
test_file_io.py fix flake8 issues (#2570) 2021-12-09 02:34:30 -08:00
test_fp16_optimizer.py fix flake8 issues (#2570) 2021-12-09 02:34:30 -08:00
test_hf_hub.py formatting fix (#2816) 2021-12-16 16:11:19 -08:00
test_huffman.py Preprocess Split (#2738) 2022-01-11 11:56:46 -08:00
test_inference_dropout.py Enable Hydra configs in fairseq (#1343) (#1510) 2020-10-20 00:32:26 -07:00
test_iopath.py Add linting with black (#2678) 2021-11-29 12:32:59 -08:00
test_iterators.py skip remainder batch (#2464) 2021-11-24 07:50:50 -08:00
test_label_smoothing.py Apply black+isort (#1357) 2020-10-18 18:14:51 -07:00
test_lm_context_window.py Fix failing test (#3065) 2022-02-10 12:17:47 -08:00
test_lstm_jitable.py Apply black+isort (#1357) 2020-10-18 18:14:51 -07:00
test_memory_efficient_fp16.py Enable Hydra configs in fairseq (#1343) (#1510) 2020-10-20 00:32:26 -07:00
test_metrics.py Apply black+isort (#1357) 2020-10-18 18:14:51 -07:00
test_multi_corpus_dataset.py Add linting with black (#2678) 2021-11-29 12:32:59 -08:00
test_multi_corpus_sampled_dataset.py fix flake8 issues (#2570) 2021-12-09 02:34:30 -08:00
test_multihead_attention.py fix broken build and docs (#3362) 2022-05-05 15:18:53 -07:00
test_noising.py Add linting with black (#2678) 2021-11-29 12:32:59 -08:00
test_online_backtranslation.py Obt 2 (#1614) 2021-03-30 09:56:03 -07:00
test_plasma_utils.py upgrade black for lints (#3004) 2022-02-02 04:31:33 -08:00
test_positional_encoding.py conformer (#2859) 2022-01-10 16:18:38 -08:00
test_reproducibility.py fix flake8 issues (#2570) 2021-12-09 02:34:30 -08:00
test_resampling_dataset.py Apply black+isort (#1357) 2020-10-18 18:14:51 -07:00
test_roberta.py Add ffn prune to fairseq 2022-01-14 16:26:59 -08:00
test_rotary_positional_embedding.py conformer (#2859) 2022-01-10 16:18:38 -08:00
test_sequence_generator.py BT enablement on fairseq - fairseq change (#4480) 2022-06-15 21:48:41 -07:00
test_sequence_scorer.py Apply black+isort (#1357) 2020-10-18 18:14:51 -07:00
test_sparse_multihead_attention.py Apply black+isort (#1357) 2020-10-18 18:14:51 -07:00
test_token_block_dataset.py TokenBlockDataset np type promotion issue (#1658) 2021-02-26 21:00:38 -08:00
test_train.py fixes tests/test_train.py to mock checkpoint.save_dir config node (#3675) 2021-07-06 15:07:31 -07:00
test_transformer.py fix MultiHeadAttention assert (#1798) 2021-04-14 04:59:59 -07:00
test_utils.py Apply black+isort (#1357) 2020-10-18 18:14:51 -07:00
test_valid_subset_checks.py Migrate DummyMaskedLMTask to FairseqTask (#3593) 2021-06-10 09:43:08 -07:00
utils.py add masked_lm test (#4344) 2022-04-18 14:47:00 -07:00