Ilia Kulikov 5528b6a382 add reading from zip audio to hubert dataset and scripts (#3403) ... Summary: These are changes from: https://github.com/fairinternal/fairseq-py/pull/3310 https://github.com/fairinternal/fairseq-py/pull/3285 which were in ust team branch, now moving them to the main. the main goal is to provide hubert dataset and scripts to read audio from zipped audio storage with backward compatibility depending on the given path. X-link: https://github.com/fairinternal/fairseq-py/pull/3403 Reviewed By: kahne Differential Revision: D37150156 Pulled By: uralik fbshipit-source-id: 7f249b09d7e971c6c7f99114709c26e6a35805cf		2022-06-24 14:09:30 -07:00
..
distributed	fix flake8 issues (#2570)	2021-12-09 02:34:30 -08:00
gpu	Fix EMA GPU test	2022-02-04 09:10:06 -08:00
speech	add reading from zip audio to hubert dataset and scripts (#3403)	2022-06-24 14:09:30 -07:00
speech_recognition	Enable Hydra configs in fairseq (#1343) (#1510)	2020-10-20 00:32:26 -07:00
tasks	add masked_lm test (#4344)	2022-04-18 14:47:00 -07:00
__init__.py	remediation of S205607	2020-07-17 17:21:51 -07:00
test_activation_checkpointing.py	Make checkpoint wrapper pickleable (#1603)	2021-02-06 08:07:32 -08:00
test_amp_optimizer.py	Add linting with black (#2678)	2021-11-29 12:32:59 -08:00
test_average_checkpoints.py	Apply black+isort (#1357)	2020-10-18 18:14:51 -07:00
test_backtranslation_dataset.py	Apply black+isort (#1357)	2020-10-18 18:14:51 -07:00
test_binaries.py	Add linting with black (#2678)	2021-11-29 12:32:59 -08:00
test_binarizer.py	Preprocess Split (#2738)	2022-01-11 11:56:46 -08:00
test_character_token_embedder.py	Apply black+isort (#1357)	2020-10-18 18:14:51 -07:00
test_checkpoint_utils.py	Data2vec prelim (#2929)	2022-01-20 00:02:16 -08:00
test_concat_dataset.py	Apply black+isort (#1357)	2020-10-18 18:14:51 -07:00
test_constraints.py	fix flake8 issues (#2570)	2021-12-09 02:34:30 -08:00
test_convtbc.py	Apply black+isort (#1357)	2020-10-18 18:14:51 -07:00
test_data_utils.py	Add linting with black (#2678)	2021-11-29 12:32:59 -08:00
test_dataclass_utils.py	Add linting with black (#2678)	2021-11-29 12:32:59 -08:00
test_dataset.py	Add support for FullyShardedDataParallel (--ddp-backend=fully_sharded) (#1667)	2021-03-04 13:32:46 -08:00
test_dictionary.py	Extract File Chunking to its own utils (#1955)	2021-06-28 01:46:32 -07:00
test_ema.py	don't use half precision in test_ema on CPU (#3408)	2022-05-26 21:14:17 -07:00
test_espnet_multihead_attention.py	conformer (#2859)	2022-01-10 16:18:38 -08:00
test_export.py	Back out "BT enablement on fairseq - fairseq change"	2022-06-21 17:27:50 -07:00
test_file_chunker_utils.py	Extract File Chunking to its own utils (#1955)	2021-06-28 01:46:32 -07:00
test_file_io.py	fix flake8 issues (#2570)	2021-12-09 02:34:30 -08:00
test_fp16_optimizer.py	fix flake8 issues (#2570)	2021-12-09 02:34:30 -08:00
test_hf_hub.py	formatting fix (#2816)	2021-12-16 16:11:19 -08:00
test_huffman.py	Preprocess Split (#2738)	2022-01-11 11:56:46 -08:00
test_inference_dropout.py	Enable Hydra configs in fairseq (#1343) (#1510)	2020-10-20 00:32:26 -07:00
test_iopath.py	Add linting with black (#2678)	2021-11-29 12:32:59 -08:00
test_iterators.py	skip remainder batch (#2464)	2021-11-24 07:50:50 -08:00
test_label_smoothing.py	Apply black+isort (#1357)	2020-10-18 18:14:51 -07:00
test_lm_context_window.py	Fix failing test (#3065)	2022-02-10 12:17:47 -08:00
test_lstm_jitable.py	Apply black+isort (#1357)	2020-10-18 18:14:51 -07:00
test_memory_efficient_fp16.py	Enable Hydra configs in fairseq (#1343) (#1510)	2020-10-20 00:32:26 -07:00
test_metrics.py	Apply black+isort (#1357)	2020-10-18 18:14:51 -07:00
test_multi_corpus_dataset.py	Add linting with black (#2678)	2021-11-29 12:32:59 -08:00
test_multi_corpus_sampled_dataset.py	fix flake8 issues (#2570)	2021-12-09 02:34:30 -08:00
test_multihead_attention.py	fix broken build and docs (#3362)	2022-05-05 15:18:53 -07:00
test_noising.py	Add linting with black (#2678)	2021-11-29 12:32:59 -08:00
test_online_backtranslation.py	Obt 2 (#1614)	2021-03-30 09:56:03 -07:00
test_plasma_utils.py	upgrade black for lints (#3004)	2022-02-02 04:31:33 -08:00
test_positional_encoding.py	conformer (#2859)	2022-01-10 16:18:38 -08:00
test_reproducibility.py	fix flake8 issues (#2570)	2021-12-09 02:34:30 -08:00
test_resampling_dataset.py	Apply black+isort (#1357)	2020-10-18 18:14:51 -07:00
test_roberta.py	Add ffn prune to fairseq	2022-01-14 16:26:59 -08:00
test_rotary_positional_embedding.py	conformer (#2859)	2022-01-10 16:18:38 -08:00
test_sequence_generator.py	Back out "BT enablement on fairseq - fairseq change"	2022-06-21 17:27:50 -07:00
test_sequence_scorer.py	Apply black+isort (#1357)	2020-10-18 18:14:51 -07:00
test_sparse_multihead_attention.py	Apply black+isort (#1357)	2020-10-18 18:14:51 -07:00
test_token_block_dataset.py	TokenBlockDataset np type promotion issue (#1658)	2021-02-26 21:00:38 -08:00
test_train.py	fixes tests/test_train.py to mock checkpoint.save_dir config node (#3675)	2021-07-06 15:07:31 -07:00
test_transformer.py	fix MultiHeadAttention assert (#1798)	2021-04-14 04:59:59 -07:00
test_utils.py	Apply black+isort (#1357)	2020-10-18 18:14:51 -07:00
test_valid_subset_checks.py	Migrate DummyMaskedLMTask to FairseqTask (#3593)	2021-06-10 09:43:08 -07:00
utils.py	add masked_lm test (#4344)	2022-04-18 14:47:00 -07:00